2024-09-17T05:08:45.422 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-17T05:08:45.443 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:08:45.548 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686 branch: wip-athakkar-testing-2024-09-16-2351 description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} email: athakkar@redhat.com first_in_suite: false job_id: '7908686' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-athakkar-testing-2024-09-16-2351 ceph: cluster-conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 2 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mon: mon op complaint time: 120 mon warn on pool no app: false osd: osd op complaint time: 180 conf: client: pid file: '' mgr: client mount timeout: 30 debug client: 20 debug finisher: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - fs.*is degraded - filesystem is degraded - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - filesystem is offline - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - insufficient standby MDS daemons available - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-athakkar-testing-2024-09-16-2351 sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 owner: scheduled_avan@teuthology priority: 80 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 448 sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 sleep_before_teardown: 0 subset: 1/20 suite: fs:volumes suite_branch: wip-athakkar-testing-2024-09-16-2351 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi081.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFb4y+qAM8eq5g/TA7vdNT7AQMPpuCG60SjWujo+KkYDw7BYMwiV8UA/pg8nYeCFFDcFmwhyVhNt2b2TO0YDXso= smithi160.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFloCkG+PemCaEje6Qwavc8nBExZmyOlu1QG9SEKoHvg+449g7oRotA7ZXN2kH20bOsaRY137UjKDufn63O0ZY= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: fail_on_skip: false modules: - tasks.cephfs.test_volumes.TestMisc teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-17_05:02:16 tube: smithi user: avan verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-17T05:08:45.548 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa; will attempt to use it 2024-09-17T05:08:45.550 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa/tasks 2024-09-17T05:08:45.550 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-17T05:08:45.568 INFO:teuthology.task.internal:Checking packages... 2024-09-17T05:08:45.592 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '820f760e4779dafd30d668ecea7aba6355dfd3d8' 2024-09-17T05:08:45.592 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-17T05:08:45.593 INFO:teuthology.packaging:ref: None 2024-09-17T05:08:45.593 INFO:teuthology.packaging:tag: None 2024-09-17T05:08:45.593 INFO:teuthology.packaging:branch: wip-athakkar-testing-2024-09-16-2351 2024-09-17T05:08:45.593 INFO:teuthology.packaging:sha1: 820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:08:45.593 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-athakkar-testing-2024-09-16-2351 2024-09-17T05:08:45.750 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-4963.g820f760e 2024-09-17T05:08:45.751 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-17T05:08:45.790 INFO:teuthology.task.internal:no buildpackages task found 2024-09-17T05:08:45.790 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-17T05:08:45.797 INFO:teuthology.task.internal:Saving configuration 2024-09-17T05:08:45.814 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-17T05:08:45.824 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-17T05:08:45.851 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi081.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:03:45.396264', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFb4y+qAM8eq5g/TA7vdNT7AQMPpuCG60SjWujo+KkYDw7BYMwiV8UA/pg8nYeCFFDcFmwhyVhNt2b2TO0YDXso='} 2024-09-17T05:08:45.874 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi160.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-17 05:03:45.397707', 'locked_by': 'scheduled_avan@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFloCkG+PemCaEje6Qwavc8nBExZmyOlu1QG9SEKoHvg+449g7oRotA7ZXN2kH20bOsaRY137UjKDufn63O0ZY='} 2024-09-17T05:08:45.874 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-17T05:08:45.886 INFO:teuthology.task.internal:roles: ubuntu@smithi081.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2024-09-17T05:08:45.886 INFO:teuthology.task.internal:roles: ubuntu@smithi160.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2024-09-17T05:08:45.886 INFO:teuthology.run_tasks:Running task console_log... 2024-09-17T05:08:45.938 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f459e3ffbe0>, signals=[15]) 2024-09-17T05:08:45.938 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-17T05:08:45.943 INFO:teuthology.task.internal:Opening connections... 2024-09-17T05:08:45.943 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:08:45.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:08:46.021 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:08:46.022 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:08:46.097 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-17T05:08:46.104 DEBUG:teuthology.orchestra.run.smithi081:> uname -m 2024-09-17T05:08:46.122 INFO:teuthology.orchestra.run.smithi081.stdout:x86_64 2024-09-17T05:08:46.123 DEBUG:teuthology.orchestra.run.smithi081:> cat /etc/os-release 2024-09-17T05:08:46.180 INFO:teuthology.orchestra.run.smithi081.stdout:NAME="CentOS Stream" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION="9" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:ID="centos" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:ID_LIKE="rhel fedora" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:VERSION_ID="9" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:PLATFORM_ID="platform:el9" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:ANSI_COLOR="0;31" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:LOGO="fedora-logo-icon" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:HOME_URL="https://centos.org/" 2024-09-17T05:08:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T05:08:46.182 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T05:08:46.182 INFO:teuthology.orchestra.run.smithi081.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T05:08:46.182 INFO:teuthology.lock.ops:Updating smithi081.front.sepia.ceph.com on lock server 2024-09-17T05:08:46.201 DEBUG:teuthology.orchestra.run.smithi160:> uname -m 2024-09-17T05:08:46.220 INFO:teuthology.orchestra.run.smithi160.stdout:x86_64 2024-09-17T05:08:46.220 DEBUG:teuthology.orchestra.run.smithi160:> cat /etc/os-release 2024-09-17T05:08:46.278 INFO:teuthology.orchestra.run.smithi160.stdout:NAME="CentOS Stream" 2024-09-17T05:08:46.278 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION="9" 2024-09-17T05:08:46.278 INFO:teuthology.orchestra.run.smithi160.stdout:ID="centos" 2024-09-17T05:08:46.278 INFO:teuthology.orchestra.run.smithi160.stdout:ID_LIKE="rhel fedora" 2024-09-17T05:08:46.278 INFO:teuthology.orchestra.run.smithi160.stdout:VERSION_ID="9" 2024-09-17T05:08:46.278 INFO:teuthology.orchestra.run.smithi160.stdout:PLATFORM_ID="platform:el9" 2024-09-17T05:08:46.278 INFO:teuthology.orchestra.run.smithi160.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-17T05:08:46.279 INFO:teuthology.orchestra.run.smithi160.stdout:ANSI_COLOR="0;31" 2024-09-17T05:08:46.279 INFO:teuthology.orchestra.run.smithi160.stdout:LOGO="fedora-logo-icon" 2024-09-17T05:08:46.279 INFO:teuthology.orchestra.run.smithi160.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-17T05:08:46.279 INFO:teuthology.orchestra.run.smithi160.stdout:HOME_URL="https://centos.org/" 2024-09-17T05:08:46.279 INFO:teuthology.orchestra.run.smithi160.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-17T05:08:46.279 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-17T05:08:46.279 INFO:teuthology.orchestra.run.smithi160.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-17T05:08:46.279 INFO:teuthology.lock.ops:Updating smithi160.front.sepia.ceph.com on lock server 2024-09-17T05:08:46.301 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-17T05:08:46.311 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-17T05:08:46.317 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-17T05:08:46.317 DEBUG:teuthology.orchestra.run.smithi081:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:08:46.319 DEBUG:teuthology.orchestra.run.smithi160:> test '!' -e /home/ubuntu/cephtest 2024-09-17T05:08:46.336 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-17T05:08:46.348 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-17T05:08:46.348 DEBUG:teuthology.orchestra.run.smithi081:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:08:46.376 DEBUG:teuthology.orchestra.run.smithi160:> test -z $(ls -A /var/lib/ceph) 2024-09-17T05:08:46.625 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-17T05:08:46.681 INFO:teuthology.run_tasks:Running task kernel... 2024-09-17T05:08:46.696 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-17T05:08:46.696 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-17T05:08:46.696 DEBUG:teuthology.orchestra.run.smithi081:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:08:46.697 DEBUG:teuthology.orchestra.run.smithi160:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-17T05:08:46.714 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:08:46.714 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-17T05:08:46.715 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:08:46.715 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-17T05:08:46.771 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-503.el9.x86_64 2024-09-17T05:08:46.772 INFO:teuthology.task.kernel:Running kernel on smithi081: 5.14.0-503.el9.x86_64 2024-09-17T05:08:46.772 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum install -y kernel 2024-09-17T05:08:46.773 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-503.el9.x86_64 2024-09-17T05:08:46.773 INFO:teuthology.task.kernel:Running kernel on smithi160: 5.14.0-503.el9.x86_64 2024-09-17T05:08:46.773 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum install -y kernel 2024-09-17T05:08:49.413 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 9.5 MB/s | 8.3 MB 00:00 2024-09-17T05:08:51.377 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 3.0 MB/s | 8.3 MB 00:02 2024-09-17T05:08:51.414 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-17T05:08:56.762 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 4.3 MB/s | 6.5 MB 00:01 2024-09-17T05:08:58.488 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 19 kB 00:00 2024-09-17T05:08:59.301 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 33 MB/s | 23 MB 00:00 2024-09-17T05:09:02.377 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 2.1 MB/s | 20 MB 00:09 2024-09-17T05:09:04.681 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-17T05:09:06.596 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T05:09:06.597 INFO:teuthology.orchestra.run.smithi160.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T05:09:06.677 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-17T05:09:06.681 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-17T05:09:06.681 INFO:teuthology.orchestra.run.smithi160.stdout: Package Architecture Version Repository Size 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout:================================================================================ 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout:Install 4 Packages 2024-09-17T05:09:06.682 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:09:06.683 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 79 M 2024-09-17T05:09:06.683 INFO:teuthology.orchestra.run.smithi160.stdout:Installed size: 126 M 2024-09-17T05:09:06.683 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-17T05:09:06.997 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T05:09:07.021 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T05:09:07.028 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T05:09:07.082 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:07.082 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:07.117 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:07.166 INFO:teuthology.orchestra.run.smithi160.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 157 kB/s | 36 kB 00:00 2024-09-17T05:09:07.220 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:07.365 INFO:teuthology.orchestra.run.smithi160.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.20) 2024-09-17T05:09:08.720 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.5 MB 00:02 2024-09-17T05:09:09.700 INFO:teuthology.orchestra.run.smithi160.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 12 MB/s | 35 MB 00:02 2024-09-17T05:09:10.478 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 43 kB/s | 19 kB 00:00 2024-09-17T05:09:11.216 INFO:teuthology.orchestra.run.smithi160.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 3.7 MB/s | 16 MB 00:04 2024-09-17T05:09:11.316 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 32 MB/s | 23 MB 00:00 2024-09-17T05:09:15.008 INFO:teuthology.orchestra.run.smithi160.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 3.6 MB/s | 29 MB 00:07 2024-09-17T05:09:15.009 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:09:15.010 INFO:teuthology.orchestra.run.smithi160.stdout:Total 9.5 MB/s | 79 MB 00:08 2024-09-17T05:09:15.694 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-17T05:09:16.035 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-17T05:09:16.035 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-17T05:09:16.672 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 27 kB/s | 1.7 kB 00:00 2024-09-17T05:09:16.995 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-17T05:09:16.995 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-17T05:09:18.578 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-17T05:09:18.578 INFO:teuthology.orchestra.run.smithi081.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-17T05:09:18.679 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-17T05:09:18.690 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-17T05:09:18.690 INFO:teuthology.orchestra.run.smithi081.stdout: Package Architecture Version Repository Size 2024-09-17T05:09:18.690 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-17T05:09:18.690 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout:================================================================================ 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout:Install 4 Packages 2024-09-17T05:09:18.691 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:09:18.692 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 79 M 2024-09-17T05:09:18.692 INFO:teuthology.orchestra.run.smithi081.stdout:Installed size: 126 M 2024-09-17T05:09:18.692 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-17T05:09:19.006 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:19.007 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:19.008 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:19.104 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-modules-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T05:09:19.110 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T05:09:19.127 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T05:09:19.446 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-17T05:09:19.673 INFO:teuthology.orchestra.run.smithi081.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 49 kB/s | 36 kB 00:00 2024-09-17T05:09:19.725 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for https://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.23) 2024-09-17T05:09:19.758 INFO:teuthology.orchestra.run.smithi081.stdout:[MIRROR] kernel-modules-core-5.14.0-508.el9.x86_64.rpm: Status code: 404 for http://us.mirrors.cicku.me/centos/9-stream/BaseOS/x86_64/os/Packages/kernel-modules-core-5.14.0-508.el9.x86_64.rpm (IP: 172.65.90.22) 2024-09-17T05:09:20.159 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:09:20.241 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:09:20.665 INFO:teuthology.orchestra.run.smithi081.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 9.1 MB/s | 16 MB 00:01 2024-09-17T05:09:21.357 INFO:teuthology.orchestra.run.smithi081.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 14 MB/s | 35 MB 00:02 2024-09-17T05:09:22.065 INFO:teuthology.orchestra.run.smithi081.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 12 MB/s | 29 MB 00:02 2024-09-17T05:09:22.069 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:09:22.070 INFO:teuthology.orchestra.run.smithi081.stdout:Total 23 MB/s | 79 MB 00:03 2024-09-17T05:09:22.749 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-17T05:09:23.017 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:09:23.093 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-17T05:09:23.093 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-17T05:09:23.135 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:09:24.049 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-17T05:09:24.049 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-17T05:09:26.450 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-17T05:09:27.192 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:09:27.302 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:09:27.967 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:09:28.044 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:09:30.043 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:09:30.172 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:09:32.916 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:09:35.000 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:09:35.038 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:09:39.885 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:11.173 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:11.213 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:11.540 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:11.540 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:10:11.540 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:10:11.541 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:10:12.394 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:10:12.395 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-17T05:10:12.751 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:10:12.836 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:10:12.857 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:10:12.857 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T05:10:12.857 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:10:12.857 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:10:12.857 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-17T05:10:12.857 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi160.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:10:12.858 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:10:12.924 INFO:teuthology.orchestra.run.smithi160.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:10:12.924 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:10:12.925 DEBUG:teuthology.orchestra.run.smithi160:> sudo rpm -qi grub2-tools 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Name : grub2-tools 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Epoch : 1 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Version : 2.06 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Release : 82.el9 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Architecture: x86_64 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Group : Unspecified 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Size : 8274670 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:License : GPLv3+ 2024-09-17T05:10:12.957 INFO:teuthology.orchestra.run.smithi160.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:Packager : builder@centos.org 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:Vendor : CentOS 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:Summary : Support tools for GRUB. 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:Description : 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T05:10:12.958 INFO:teuthology.orchestra.run.smithi160.stdout:hardware devices. 2024-09-17T05:10:12.959 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:10:12.959 INFO:teuthology.orchestra.run.smithi160.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T05:10:12.959 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T05:10:12.960 INFO:teuthology.task.kernel:Updating grub on smithi160 to boot 5.14.0-508.el9.x86_64 2024-09-17T05:10:12.960 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T05:10:13.595 INFO:teuthology.orchestra.run.smithi160.stderr:Generating grub configuration file ... 2024-09-17T05:10:14.920 INFO:teuthology.orchestra.run.smithi160.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T05:10:14.954 INFO:teuthology.orchestra.run.smithi160.stderr:done 2024-09-17T05:10:14.956 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-09-17T05:10:14.972 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.dWjM51F3uH 2024-09-17T05:10:14.972 DEBUG:teuthology.orchestra.run.smithi160:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.dWjM51F3uH 2024-09-17T05:10:15.040 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.dWjM51F3uH 2024-09-17T05:10:15.182 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.dWjM51F3uH is 6KB 2024-09-17T05:10:15.231 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.dWjM51F3uH 2024-09-17T05:10:15.246 DEBUG:teuthology.orchestra.run.smithi160:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T05:10:15.308 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T05:10:15.308 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T05:10:15.308 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T05:10:15.309 INFO:teuthology.orchestra.run.smithi160.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T05:10:15.310 DEBUG:teuthology.orchestra.run.smithi160:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T05:10:15.459 DEBUG:teuthology.orchestra.run.smithi160:> sudo shutdown -r now 2024-09-17T05:10:17.851 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:17.891 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:18.284 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:18.284 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-17T05:10:18.284 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-17T05:10:18.284 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-17T05:10:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-17T05:10:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:10:19.143 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-17T05:10:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-17T05:10:19.143 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-17T05:10:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-17T05:10:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-17T05:10:19.144 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:10:19.144 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-17T05:10:19.503 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:10:19.582 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:10:19.582 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:10:19.582 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-17T05:10:19.583 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-17T05:10:19.583 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-17T05:10:19.583 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-17T05:10:19.583 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi081.front.sepia.ceph.com, path=None, version=distro) 2024-09-17T05:10:19.583 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q kernel | sort -rV | head -n 1 2024-09-17T05:10:19.642 INFO:teuthology.orchestra.run.smithi081.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-17T05:10:19.643 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-17T05:10:19.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo rpm -qi grub2-tools 2024-09-17T05:10:19.678 INFO:teuthology.orchestra.run.smithi081.stdout:Name : grub2-tools 2024-09-17T05:10:19.678 INFO:teuthology.orchestra.run.smithi081.stdout:Epoch : 1 2024-09-17T05:10:19.678 INFO:teuthology.orchestra.run.smithi081.stdout:Version : 2.06 2024-09-17T05:10:19.679 INFO:teuthology.orchestra.run.smithi081.stdout:Release : 82.el9 2024-09-17T05:10:19.679 INFO:teuthology.orchestra.run.smithi081.stdout:Architecture: x86_64 2024-09-17T05:10:19.679 INFO:teuthology.orchestra.run.smithi081.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-17T05:10:19.679 INFO:teuthology.orchestra.run.smithi081.stdout:Group : Unspecified 2024-09-17T05:10:19.679 INFO:teuthology.orchestra.run.smithi081.stdout:Size : 8274670 2024-09-17T05:10:19.679 INFO:teuthology.orchestra.run.smithi081.stdout:License : GPLv3+ 2024-09-17T05:10:19.679 INFO:teuthology.orchestra.run.smithi081.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:Packager : builder@centos.org 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:Vendor : CentOS 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:Summary : Support tools for GRUB. 2024-09-17T05:10:19.680 INFO:teuthology.orchestra.run.smithi081.stdout:Description : 2024-09-17T05:10:19.681 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:10:19.681 INFO:teuthology.orchestra.run.smithi081.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-17T05:10:19.681 INFO:teuthology.orchestra.run.smithi081.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-17T05:10:19.681 INFO:teuthology.orchestra.run.smithi081.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-17T05:10:19.681 INFO:teuthology.orchestra.run.smithi081.stdout:hardware devices. 2024-09-17T05:10:19.681 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:10:19.681 INFO:teuthology.orchestra.run.smithi081.stdout:This subpackage provides tools for support of all platforms. 2024-09-17T05:10:19.683 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-17T05:10:19.683 INFO:teuthology.task.kernel:Updating grub on smithi081 to boot 5.14.0-508.el9.x86_64 2024-09-17T05:10:19.683 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-17T05:10:20.470 INFO:teuthology.orchestra.run.smithi081.stderr:Generating grub configuration file ... 2024-09-17T05:10:21.862 INFO:teuthology.orchestra.run.smithi081.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-17T05:10:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:done 2024-09-17T05:10:21.892 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-17T05:10:21.908 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.EK3G7vfIBU 2024-09-17T05:10:21.909 DEBUG:teuthology.orchestra.run.smithi081:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EK3G7vfIBU 2024-09-17T05:10:21.976 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.EK3G7vfIBU 2024-09-17T05:10:22.109 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.EK3G7vfIBU is 6KB 2024-09-17T05:10:22.158 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.EK3G7vfIBU 2024-09-17T05:10:22.173 DEBUG:teuthology.orchestra.run.smithi081:> sudo /bin/ls /boot/loader/entries || true 2024-09-17T05:10:22.235 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-17T05:10:22.235 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-17T05:10:22.236 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-17T05:10:22.236 INFO:teuthology.orchestra.run.smithi081.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-17T05:10:22.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-17T05:10:22.384 DEBUG:teuthology.orchestra.run.smithi081:> sudo shutdown -r now 2024-09-17T05:10:45.485 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-17T05:10:45.485 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-17T05:10:45.486 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:10:52.393 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-17T05:10:52.393 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-17T05:10:52.394 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:11:03.997 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-09-17T05:11:10.909 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-17T05:11:13.001 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-17T05:11:13.002 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:11:16.061 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.160 2024-09-17T05:11:19.913 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-17T05:11:19.914 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:11:22.977 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.81 2024-09-17T05:11:28.067 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-17T05:11:28.068 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:11:34.981 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-17T05:11:34.982 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:12:00.013 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-17T05:12:00.525 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-17T05:12:00.525 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-17T05:12:00.526 DEBUG:teuthology.orchestra.run.smithi160:> uname -r 2024-09-17T05:12:00.541 INFO:teuthology.orchestra.run.smithi160.stdout:5.14.0-508.el9.x86_64 2024-09-17T05:12:00.542 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T05:12:00.542 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:12:00.542 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T05:12:01.543 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-17T05:12:01.543 DEBUG:teuthology.orchestra.run.smithi160:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T05:12:01.679 INFO:teuthology.orchestra.run.smithi160.stdout:ttyS1 2024-09-17T05:12:01.699 DEBUG:teuthology.parallel:result is None 2024-09-17T05:12:06.967 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-17T05:12:07.316 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-17T05:12:07.316 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-17T05:12:07.317 DEBUG:teuthology.orchestra.run.smithi081:> uname -r 2024-09-17T05:12:07.331 INFO:teuthology.orchestra.run.smithi081.stdout:5.14.0-508.el9.x86_64 2024-09-17T05:12:07.332 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-17T05:12:07.332 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-17T05:12:07.332 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-17T05:12:08.333 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-17T05:12:08.333 DEBUG:teuthology.orchestra.run.smithi081:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-17T05:12:08.400 INFO:teuthology.orchestra.run.smithi081.stdout:ttyS1 2024-09-17T05:12:08.427 DEBUG:teuthology.parallel:result is None 2024-09-17T05:12:08.428 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-17T05:12:08.435 INFO:teuthology.task.internal:Creating test directory... 2024-09-17T05:12:08.435 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:12:08.438 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-17T05:12:08.456 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-17T05:12:08.464 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-17T05:12:08.471 INFO:teuthology.task.internal:Creating archive directory... 2024-09-17T05:12:08.472 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:12:08.497 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-17T05:12:08.672 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-17T05:12:08.679 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-17T05:12:08.679 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:12:08.682 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-17T05:12:08.713 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:12:08.724 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:12:08.789 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:12:08.801 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-17T05:12:08.802 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-17T05:12:08.810 INFO:teuthology.task.internal:Configuring sudo... 2024-09-17T05:12:08.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:12:08.813 DEBUG:teuthology.orchestra.run.smithi160:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-17T05:12:08.840 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-17T05:12:08.870 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-17T05:12:08.870 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:12:08.882 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-17T05:12:08.898 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:12:08.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:12:09.034 DEBUG:teuthology.orchestra.run.smithi081:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:12:09.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:12:09.158 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:12:09.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:12:09.224 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:12:09.267 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-17T05:12:09.314 DEBUG:teuthology.orchestra.run.smithi160:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:12:09.397 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-17T05:12:09.436 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:12:09.436 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-17T05:12:09.501 DEBUG:teuthology.orchestra.run.smithi081:> sudo service rsyslog restart 2024-09-17T05:12:09.504 DEBUG:teuthology.orchestra.run.smithi160:> sudo service rsyslog restart 2024-09-17T05:12:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:12:09.580 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:12:10.062 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-17T05:12:10.070 INFO:teuthology.task.internal:Starting timer... 2024-09-17T05:12:10.070 INFO:teuthology.run_tasks:Running task pcp... 2024-09-17T05:12:10.088 INFO:teuthology.run_tasks:Running task selinux... 2024-09-17T05:12:10.097 DEBUG:teuthology.orchestra.run.smithi081:> sudo service auditd rotate 2024-09-17T05:12:10.141 INFO:teuthology.orchestra.run.smithi081.stdout:Rotating logs: 2024-09-17T05:12:10.143 DEBUG:teuthology.orchestra.run.smithi160:> sudo service auditd rotate 2024-09-17T05:12:10.214 INFO:teuthology.orchestra.run.smithi160.stdout:Rotating logs: 2024-09-17T05:12:10.215 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-17T05:12:10.216 DEBUG:teuthology.orchestra.run.smithi081:> /usr/sbin/getenforce 2024-09-17T05:12:10.253 INFO:teuthology.orchestra.run.smithi081.stdout:Permissive 2024-09-17T05:12:10.253 DEBUG:teuthology.orchestra.run.smithi160:> /usr/sbin/getenforce 2024-09-17T05:12:10.291 INFO:teuthology.orchestra.run.smithi160.stdout:Permissive 2024-09-17T05:12:10.291 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi081.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi160.front.sepia.ceph.com': 'permissive'} 2024-09-17T05:12:10.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:12:10.321 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:12:10.322 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:12:10.356 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:12:10.357 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-17T05:12:10.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo /usr/sbin/setenforce permissive 2024-09-17T05:12:10.393 DEBUG:teuthology.orchestra.run.smithi160:> sudo /usr/sbin/setenforce permissive 2024-09-17T05:12:10.428 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-17T05:12:10.441 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-17T05:12:10.452 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-17T05:12:10.453 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi081.front.sepia.ceph.com,smithi160.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-17T05:15:55.790 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi081.front.sepia.ceph.com'), Remote(name='ubuntu@smithi160.front.sepia.ceph.com')] 2024-09-17T05:15:55.791 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-17T05:15:55.793 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi081.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:15:55.872 DEBUG:teuthology.orchestra.run.smithi081:> true 2024-09-17T05:15:55.948 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi081.front.sepia.ceph.com' 2024-09-17T05:15:55.948 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-17T05:15:55.949 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi160.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-17T05:15:56.024 DEBUG:teuthology.orchestra.run.smithi160:> true 2024-09-17T05:15:56.112 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi160.front.sepia.ceph.com' 2024-09-17T05:15:56.112 INFO:teuthology.run_tasks:Running task clock... 2024-09-17T05:15:56.122 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-17T05:15:56.122 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:15:56.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:15:56.125 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-17T05:15:56.125 DEBUG:teuthology.orchestra.run.smithi160:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:15:56.152 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T05:15:56.166 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T05:15:56.182 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-17T05:15:56.190 INFO:teuthology.orchestra.run.smithi081.stderr:sudo: ntpd: command not found 2024-09-17T05:15:56.197 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-17T05:15:56.201 INFO:teuthology.orchestra.run.smithi081.stdout:506 Cannot talk to daemon 2024-09-17T05:15:56.216 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T05:15:56.222 INFO:teuthology.orchestra.run.smithi160.stderr:sudo: ntpd: command not found 2024-09-17T05:15:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T05:15:56.233 INFO:teuthology.orchestra.run.smithi160.stdout:506 Cannot talk to daemon 2024-09-17T05:15:56.247 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-17T05:15:56.262 INFO:teuthology.orchestra.run.smithi160.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-17T05:15:56.290 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:15:56.293 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:15:56.293 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-17T05:15:56.293 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.293 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.294 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.294 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.321 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:15:56.325 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:15:56.325 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-17T05:15:56.325 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.325 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.325 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.325 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:15:56.326 INFO:teuthology.run_tasks:Running task install... 2024-09-17T05:15:56.333 DEBUG:teuthology.task.install:project ceph 2024-09-17T05:15:56.333 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}} 2024-09-17T05:15:56.333 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'} 2024-09-17T05:15:56.333 INFO:teuthology.task.install:Using flavor: default 2024-09-17T05:15:56.339 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-17T05:15:56.339 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-17T05:15:56.339 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'tag': None, 'wait_for_package': False} 2024-09-17T05:15:56.340 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:15:56.342 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'tag': None, 'wait_for_package': False} 2024-09-17T05:15:56.342 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:15:56.491 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/ 2024-09-17T05:15:56.492 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4963.g820f760e 2024-09-17T05:15:56.500 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/ 2024-09-17T05:15:56.500 INFO:teuthology.task.install.rpm:Package version is 19.3.0-4963.g820f760e 2024-09-17T05:15:56.603 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T05:15:56.604 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:15:56.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T05:15:56.614 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-athakkar-testing-2024-09-16-2351/820f760e4779dafd30d668ecea7aba6355dfd3d8/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-17T05:15:56.614 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:15:56.614 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-17T05:15:56.631 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T05:15:56.631 DEBUG:teuthology.orchestra.run.smithi081:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/820f760e4779dafd30d668ecea7aba6355dfd3d8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T05:15:56.641 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-17T05:15:56.641 DEBUG:teuthology.orchestra.run.smithi160:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/820f760e4779dafd30d668ecea7aba6355dfd3d8/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-17T05:15:56.698 DEBUG:teuthology.orchestra.run.smithi081:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T05:15:56.709 DEBUG:teuthology.orchestra.run.smithi160:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-17T05:15:56.772 DEBUG:teuthology.orchestra.run.smithi081:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T05:15:56.784 DEBUG:teuthology.orchestra.run.smithi160:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-17T05:15:56.837 INFO:teuthology.orchestra.run.smithi081.stdout:check_obsoletes = 1 2024-09-17T05:15:56.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum clean all 2024-09-17T05:15:56.849 INFO:teuthology.orchestra.run.smithi160.stdout:check_obsoletes = 1 2024-09-17T05:15:56.850 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum clean all 2024-09-17T05:15:57.063 INFO:teuthology.orchestra.run.smithi081.stdout:45 files removed 2024-09-17T05:15:57.084 INFO:teuthology.orchestra.run.smithi160.stdout:45 files removed 2024-09-17T05:15:57.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T05:15:57.110 DEBUG:teuthology.orchestra.run.smithi160:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-17T05:15:57.647 INFO:teuthology.orchestra.run.smithi081.stdout:ceph packages for x86_64 305 kB/s | 84 kB 00:00 2024-09-17T05:15:57.686 INFO:teuthology.orchestra.run.smithi160.stdout:ceph packages for x86_64 302 kB/s | 84 kB 00:00 2024-09-17T05:15:57.947 INFO:teuthology.orchestra.run.smithi081.stdout:ceph noarch packages 94 kB/s | 24 kB 00:00 2024-09-17T05:15:57.978 INFO:teuthology.orchestra.run.smithi160.stdout:ceph noarch packages 98 kB/s | 24 kB 00:00 2024-09-17T05:15:58.231 INFO:teuthology.orchestra.run.smithi081.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-17T05:15:58.278 INFO:teuthology.orchestra.run.smithi160.stdout:ceph source packages 7.2 kB/s | 1.9 kB 00:00 2024-09-17T05:15:59.965 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - BaseOS 4.9 MB/s | 8.3 MB 00:01 2024-09-17T05:16:00.113 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - BaseOS 4.6 MB/s | 8.3 MB 00:01 2024-09-17T05:16:02.110 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - AppStream 20 MB/s | 20 MB 00:01 2024-09-17T05:16:02.246 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - AppStream 19 MB/s | 20 MB 00:01 2024-09-17T05:16:07.501 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-17T05:16:07.889 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - CRB 3.5 MB/s | 6.5 MB 00:01 2024-09-17T05:16:09.193 INFO:teuthology.orchestra.run.smithi081.stdout:CentOS Stream 9 - Extras packages 40 kB/s | 19 kB 00:00 2024-09-17T05:16:09.723 INFO:teuthology.orchestra.run.smithi160.stdout:CentOS Stream 9 - Extras packages 38 kB/s | 19 kB 00:00 2024-09-17T05:16:10.822 INFO:teuthology.orchestra.run.smithi081.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-17T05:16:11.552 INFO:teuthology.orchestra.run.smithi160.stdout:Extra Packages for Enterprise Linux 13 MB/s | 23 MB 00:01 2024-09-17T05:16:16.403 INFO:teuthology.orchestra.run.smithi081.stdout:lab-extras 28 kB/s | 1.7 kB 00:00 2024-09-17T05:16:17.041 INFO:teuthology.orchestra.run.smithi160.stdout:lab-extras 23 kB/s | 1.7 kB 00:00 2024-09-17T05:16:18.607 INFO:teuthology.orchestra.run.smithi081.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:16:18.608 INFO:teuthology.orchestra.run.smithi081.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:16:18.619 INFO:teuthology.orchestra.run.smithi081.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T05:16:18.620 INFO:teuthology.orchestra.run.smithi081.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T05:16:18.621 INFO:teuthology.orchestra.run.smithi081.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T05:16:18.622 INFO:teuthology.orchestra.run.smithi081.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T05:16:18.624 INFO:teuthology.orchestra.run.smithi081.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T05:16:18.626 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T05:16:18.627 INFO:teuthology.orchestra.run.smithi081.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T05:16:18.691 INFO:teuthology.orchestra.run.smithi081.stdout:Dependencies resolved. 2024-09-17T05:16:18.722 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: Package Arch Version Repository Size 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout:Installing: 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: ceph x86_64 2:19.3.0-4963.g820f760e.el9 ceph 6.6 k 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 899 k 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4963.g820f760e.el9 ceph 145 k 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr x86_64 2:19.3.0-4963.g820f760e.el9 ceph 1.5 M 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 154 k 2024-09-17T05:16:18.723 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 14 M 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 7.4 M 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 49 k 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 11 M 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test x86_64 2:19.3.0-4963.g820f760e.el9 ceph 46 M 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 285 k 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 784 k 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 225 k 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell x86_64 2:19.3.0-4963.g820f760e.el9 ceph 27 k 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 18 k 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T05:16:18.724 INFO:teuthology.orchestra.run.smithi081.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 32 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 755 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 126 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T05:16:18.725 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados x86_64 2:19.3.0-4963.g820f760e.el9 ceph 320 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 305 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 99 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 85 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.2 M 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 170 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrading: 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T05:16:18.726 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: librados2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.5 M 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.3 M 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout:Installing dependencies: 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 22 M 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 34 k 2024-09-17T05:16:18.727 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds x86_64 2:19.3.0-4963.g820f760e.el9 ceph 2.4 M 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 291 k 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon x86_64 2:19.3.0-4963.g820f760e.el9 ceph 4.8 M 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 17 M 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 16 k 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux x86_64 2:19.3.0-4963.g820f760e.el9 ceph 25 k 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T05:16:18.728 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 508 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T05:16:18.729 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T05:16:18.730 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 45 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 148 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T05:16:18.731 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T05:16:18.732 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T05:16:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T05:16:18.734 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T05:16:18.735 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T05:16:18.736 INFO:teuthology.orchestra.run.smithi081.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout:Installing weak dependencies: 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction Summary 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout:======================================================================================= 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout:Install 149 Packages 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout:Upgrade 8 Packages 2024-09-17T05:16:18.737 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:16:18.738 INFO:teuthology.orchestra.run.smithi081.stdout:Total download size: 235 M 2024-09-17T05:16:18.738 INFO:teuthology.orchestra.run.smithi081.stdout:Downloading Packages: 2024-09-17T05:16:19.276 INFO:teuthology.orchestra.run.smithi160.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:16:19.277 INFO:teuthology.orchestra.run.smithi160.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-17T05:16:19.288 INFO:teuthology.orchestra.run.smithi160.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-17T05:16:19.289 INFO:teuthology.orchestra.run.smithi160.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-17T05:16:19.289 INFO:teuthology.orchestra.run.smithi160.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-17T05:16:19.290 INFO:teuthology.orchestra.run.smithi160.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-17T05:16:19.292 INFO:teuthology.orchestra.run.smithi160.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-17T05:16:19.294 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-17T05:16:19.295 INFO:teuthology.orchestra.run.smithi160.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-17T05:16:19.358 INFO:teuthology.orchestra.run.smithi160.stdout:Dependencies resolved. 2024-09-17T05:16:19.384 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-17T05:16:19.384 INFO:teuthology.orchestra.run.smithi160.stdout: Package Arch Version Repository Size 2024-09-17T05:16:19.384 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-17T05:16:19.384 INFO:teuthology.orchestra.run.smithi160.stdout:Installing: 2024-09-17T05:16:19.384 INFO:teuthology.orchestra.run.smithi160.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-17T05:16:19.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph x86_64 2:19.3.0-4963.g820f760e.el9 ceph 6.6 k 2024-09-17T05:16:19.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:16:19.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 899 k 2024-09-17T05:16:19.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-4963.g820f760e.el9 ceph 145 k 2024-09-17T05:16:19.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr x86_64 2:19.3.0-4963.g820f760e.el9 ceph 1.5 M 2024-09-17T05:16:19.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 154 k 2024-09-17T05:16:19.385 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 14 M 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 7.4 M 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 49 k 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 11 M 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test x86_64 2:19.3.0-4963.g820f760e.el9 ceph 46 M 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 285 k 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 784 k 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 225 k 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell x86_64 2:19.3.0-4963.g820f760e.el9 ceph 27 k 2024-09-17T05:16:19.386 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 18 k 2024-09-17T05:16:19.387 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-17T05:16:19.387 INFO:teuthology.orchestra.run.smithi160.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-17T05:16:19.387 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-17T05:16:19.387 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 32 k 2024-09-17T05:16:19.387 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 755 k 2024-09-17T05:16:19.387 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel x86_64 2:19.3.0-4963.g820f760e.el9 ceph 126 k 2024-09-17T05:16:19.387 INFO:teuthology.orchestra.run.smithi160.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados x86_64 2:19.3.0-4963.g820f760e.el9 ceph 320 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 305 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw x86_64 2:19.3.0-4963.g820f760e.el9 ceph 99 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 85 k 2024-09-17T05:16:19.388 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.2 M 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 170 k 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrading: 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: librados2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.5 M 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 3.3 M 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-17T05:16:19.389 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout:Installing dependencies: 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 22 M 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 34 k 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds x86_64 2:19.3.0-4963.g820f760e.el9 ceph 2.4 M 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 291 k 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon x86_64 2:19.3.0-4963.g820f760e.el9 ceph 4.8 M 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd x86_64 2:19.3.0-4963.g820f760e.el9 ceph 17 M 2024-09-17T05:16:19.390 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts noarch 2:19.3.0-4963.g820f760e.el9 ceph-noarch 16 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux x86_64 2:19.3.0-4963.g820f760e.el9 ceph 25 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite x86_64 2:19.3.0-4963.g820f760e.el9 ceph 161 k 2024-09-17T05:16:19.391 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 508 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2 x86_64 2:19.3.0-4963.g820f760e.el9 ceph 5.5 M 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-17T05:16:19.392 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-17T05:16:19.393 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse x86_64 2:19.3.0-4963.g820f760e.el9 ceph 45 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common x86_64 2:19.3.0-4963.g820f760e.el9 ceph 148 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-17T05:16:19.394 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-17T05:16:19.395 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-17T05:16:19.396 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-17T05:16:19.397 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-17T05:16:19.398 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-17T05:16:19.399 INFO:teuthology.orchestra.run.smithi160.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout:Installing weak dependencies: 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction Summary 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout:======================================================================================= 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout:Install 149 Packages 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout:Upgrade 8 Packages 2024-09-17T05:16:19.400 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:16:19.401 INFO:teuthology.orchestra.run.smithi160.stdout:Total download size: 235 M 2024-09-17T05:16:19.401 INFO:teuthology.orchestra.run.smithi160.stdout:Downloading Packages: 2024-09-17T05:16:19.911 INFO:teuthology.orchestra.run.smithi081.stdout:(1/157): ceph-19.3.0-4963.g820f760e.el9.x86_64. 42 kB/s | 6.6 kB 00:00 2024-09-17T05:16:20.201 INFO:teuthology.orchestra.run.smithi160.stdout:(1/157): ceph-19.3.0-4963.g820f760e.el9.x86_64. 29 kB/s | 6.6 kB 00:00 2024-09-17T05:16:20.313 INFO:teuthology.orchestra.run.smithi081.stdout:(2/157): ceph-base-19.3.0-4963.g820f760e.el9.x8 9.9 MB/s | 5.5 MB 00:00 2024-09-17T05:16:20.355 INFO:teuthology.orchestra.run.smithi081.stdout:(3/157): ceph-fuse-19.3.0-4963.g820f760e.el9.x8 2.0 MB/s | 899 kB 00:00 2024-09-17T05:16:20.380 INFO:teuthology.orchestra.run.smithi081.stdout:(4/157): ceph-immutable-object-cache-19.3.0-496 2.1 MB/s | 145 kB 00:00 2024-09-17T05:16:20.522 INFO:teuthology.orchestra.run.smithi081.stdout:(5/157): ceph-mgr-19.3.0-4963.g820f760e.el9.x86 11 MB/s | 1.5 MB 00:00 2024-09-17T05:16:20.798 INFO:teuthology.orchestra.run.smithi081.stdout:(6/157): ceph-mon-19.3.0-4963.g820f760e.el9.x86 17 MB/s | 4.8 MB 00:00 2024-09-17T05:16:21.118 INFO:teuthology.orchestra.run.smithi160.stdout:(2/157): ceph-fuse-19.3.0-4963.g820f760e.el9.x8 981 kB/s | 899 kB 00:00 2024-09-17T05:16:21.268 INFO:teuthology.orchestra.run.smithi160.stdout:(3/157): ceph-immutable-object-cache-19.3.0-496 969 kB/s | 145 kB 00:00 2024-09-17T05:16:21.348 INFO:teuthology.orchestra.run.smithi081.stdout:(7/157): ceph-common-19.3.0-4963.g820f760e.el9. 14 MB/s | 22 MB 00:01 2024-09-17T05:16:21.398 INFO:teuthology.orchestra.run.smithi081.stdout:(8/157): ceph-mds-19.3.0-4963.g820f760e.el9.x86 2.3 MB/s | 2.4 MB 00:01 2024-09-17T05:16:21.457 INFO:teuthology.orchestra.run.smithi081.stdout:(9/157): ceph-selinux-19.3.0-4963.g820f760e.el9 433 kB/s | 25 kB 00:00 2024-09-17T05:16:21.799 INFO:teuthology.orchestra.run.smithi081.stdout:(10/157): ceph-osd-19.3.0-4963.g820f760e.el9.x8 17 MB/s | 17 MB 00:01 2024-09-17T05:16:21.882 INFO:teuthology.orchestra.run.smithi081.stdout:(11/157): cephfs-mirror-19.3.0-4963.g820f760e.e 2.7 MB/s | 225 kB 00:00 2024-09-17T05:16:21.949 INFO:teuthology.orchestra.run.smithi081.stdout:(12/157): cephfs-shell-19.3.0-4963.g820f760e.el 406 kB/s | 27 kB 00:00 2024-09-17T05:16:22.016 INFO:teuthology.orchestra.run.smithi081.stdout:(13/157): libcephfs-devel-19.3.0-4963.g820f760e 476 kB/s | 32 kB 00:00 2024-09-17T05:16:22.183 INFO:teuthology.orchestra.run.smithi081.stdout:(14/157): ceph-radosgw-19.3.0-4963.g820f760e.el 13 MB/s | 11 MB 00:00 2024-09-17T05:16:22.225 INFO:teuthology.orchestra.run.smithi081.stdout:(15/157): libcephfs2-19.3.0-4963.g820f760e.el9. 3.5 MB/s | 755 kB 00:00 2024-09-17T05:16:22.250 INFO:teuthology.orchestra.run.smithi081.stdout:(16/157): libcephsqlite-19.3.0-4963.g820f760e.e 2.4 MB/s | 161 kB 00:00 2024-09-17T05:16:22.284 INFO:teuthology.orchestra.run.smithi081.stdout:(17/157): librados-devel-19.3.0-4963.g820f760e. 2.1 MB/s | 126 kB 00:00 2024-09-17T05:16:22.318 INFO:teuthology.orchestra.run.smithi081.stdout:(18/157): libradosstriper1-19.3.0-4963.g820f760 7.4 MB/s | 508 kB 00:00 2024-09-17T05:16:22.385 INFO:teuthology.orchestra.run.smithi081.stdout:(19/157): python3-ceph-argparse-19.3.0-4963.g82 677 kB/s | 45 kB 00:00 2024-09-17T05:16:22.426 INFO:teuthology.orchestra.run.smithi160.stdout:(4/157): ceph-mds-19.3.0-4963.g820f760e.el9.x86 2.1 MB/s | 2.4 MB 00:01 2024-09-17T05:16:22.452 INFO:teuthology.orchestra.run.smithi081.stdout:(20/157): python3-ceph-common-19.3.0-4963.g820f 2.2 MB/s | 148 kB 00:00 2024-09-17T05:16:22.535 INFO:teuthology.orchestra.run.smithi081.stdout:(21/157): librgw2-19.3.0-4963.g820f760e.el9.x86 22 MB/s | 5.5 MB 00:00 2024-09-17T05:16:22.561 INFO:teuthology.orchestra.run.smithi081.stdout:(22/157): python3-cephfs-19.3.0-4963.g820f760e. 1.4 MB/s | 161 kB 00:00 2024-09-17T05:16:22.603 INFO:teuthology.orchestra.run.smithi081.stdout:(23/157): python3-rados-19.3.0-4963.g820f760e.e 4.7 MB/s | 320 kB 00:00 2024-09-17T05:16:22.628 INFO:teuthology.orchestra.run.smithi081.stdout:(24/157): python3-rbd-19.3.0-4963.g820f760e.el9 4.5 MB/s | 305 kB 00:00 2024-09-17T05:16:22.662 INFO:teuthology.orchestra.run.smithi081.stdout:(25/157): python3-rgw-19.3.0-4963.g820f760e.el9 1.7 MB/s | 99 kB 00:00 2024-09-17T05:16:22.695 INFO:teuthology.orchestra.run.smithi081.stdout:(26/157): rbd-fuse-19.3.0-4963.g820f760e.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-17T05:16:22.796 INFO:teuthology.orchestra.run.smithi081.stdout:(27/157): rbd-nbd-19.3.0-4963.g820f760e.el9.x86 1.7 MB/s | 170 kB 00:00 2024-09-17T05:16:22.887 INFO:teuthology.orchestra.run.smithi081.stdout:(28/157): rbd-mirror-19.3.0-4963.g820f760e.el9. 14 MB/s | 3.2 MB 00:00 2024-09-17T05:16:22.913 INFO:teuthology.orchestra.run.smithi081.stdout:(29/157): ceph-grafana-dashboards-19.3.0-4963.g 293 kB/s | 34 kB 00:00 2024-09-17T05:16:22.938 INFO:teuthology.orchestra.run.smithi081.stdout:(30/157): ceph-mgr-cephadm-19.3.0-4963.g820f760 3.0 MB/s | 154 kB 00:00 2024-09-17T05:16:23.143 INFO:teuthology.orchestra.run.smithi160.stdout:(5/157): ceph-mgr-19.3.0-4963.g820f760e.el9.x86 2.1 MB/s | 1.5 MB 00:00 2024-09-17T05:16:23.372 INFO:teuthology.orchestra.run.smithi081.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 17 MB/s | 7.4 MB 00:00 2024-09-17T05:16:23.455 INFO:teuthology.orchestra.run.smithi081.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4963.g82 3.4 MB/s | 291 kB 00:00 2024-09-17T05:16:23.539 INFO:teuthology.orchestra.run.smithi081.stdout:(33/157): ceph-mgr-rook-19.3.0-4963.g820f760e.e 591 kB/s | 49 kB 00:00 2024-09-17T05:16:23.614 INFO:teuthology.orchestra.run.smithi081.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4963.g8 220 kB/s | 16 kB 00:00 2024-09-17T05:16:23.668 INFO:teuthology.orchestra.run.smithi160.stdout:(6/157): ceph-base-19.3.0-4963.g820f760e.el9.x8 1.5 MB/s | 5.5 MB 00:03 2024-09-17T05:16:23.706 INFO:teuthology.orchestra.run.smithi081.stdout:(35/157): ceph-volume-19.3.0-4963.g820f760e.el9 3.0 MB/s | 285 kB 00:00 2024-09-17T05:16:23.815 INFO:teuthology.orchestra.run.smithi081.stdout:(36/157): cephadm-19.3.0-4963.g820f760e.el9.noa 7.1 MB/s | 784 kB 00:00 2024-09-17T05:16:23.898 INFO:teuthology.orchestra.run.smithi081.stdout:(37/157): cephfs-top-19.3.0-4963.g820f760e.el9. 219 kB/s | 18 kB 00:00 2024-09-17T05:16:24.049 INFO:teuthology.orchestra.run.smithi081.stdout:(38/157): ceph-mgr-dashboard-19.3.0-4963.g820f7 12 MB/s | 14 MB 00:01 2024-09-17T05:16:24.157 INFO:teuthology.orchestra.run.smithi081.stdout:(39/157): fuse-2.9.9-16.el9.x86_64.rpm 308 kB/s | 80 kB 00:00 2024-09-17T05:16:24.241 INFO:teuthology.orchestra.run.smithi081.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 2.2 MB/s | 191 kB 00:00 2024-09-17T05:16:24.325 INFO:teuthology.orchestra.run.smithi081.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.0 MB/s | 253 kB 00:00 2024-09-17T05:16:24.366 INFO:teuthology.orchestra.run.smithi081.stdout:(42/157): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-17T05:16:24.425 INFO:teuthology.orchestra.run.smithi081.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-17T05:16:24.492 INFO:teuthology.orchestra.run.smithi081.stdout:(44/157): python3-cryptography-36.0.1-4.el9.x86 7.3 MB/s | 1.2 MB 00:00 2024-09-17T05:16:24.518 INFO:teuthology.orchestra.run.smithi081.stdout:(45/157): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 135 kB 00:00 2024-09-17T05:16:24.577 INFO:teuthology.orchestra.run.smithi081.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-09-17T05:16:24.602 INFO:teuthology.orchestra.run.smithi081.stdout:(47/157): python3-requests-2.25.1-8.el9.noarch. 1.1 MB/s | 125 kB 00:00 2024-09-17T05:16:24.852 INFO:teuthology.orchestra.run.smithi081.stdout:(48/157): automake-1.16.2-8.el9.noarch.rpm 2.4 MB/s | 689 kB 00:00 2024-09-17T05:16:24.886 INFO:teuthology.orchestra.run.smithi081.stdout:(49/157): bison-3.7.4-5.el9.x86_64.rpm 3.2 MB/s | 943 kB 00:00 2024-09-17T05:16:24.911 INFO:teuthology.orchestra.run.smithi081.stdout:(50/157): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 107 kB 00:00 2024-09-17T05:16:24.936 INFO:teuthology.orchestra.run.smithi081.stdout:(51/157): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-17T05:16:24.987 INFO:teuthology.orchestra.run.smithi081.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-09-17T05:16:25.020 INFO:teuthology.orchestra.run.smithi081.stdout:(53/157): flex-2.6.4-9.el9.x86_64.rpm 2.8 MB/s | 313 kB 00:00 2024-09-17T05:16:25.070 INFO:teuthology.orchestra.run.smithi081.stdout:(54/157): flexiblas-openblas-openmp-3.0.4-8.el9 364 kB/s | 18 kB 00:00 2024-09-17T05:16:25.129 INFO:teuthology.orchestra.run.smithi081.stdout:(55/157): libaio-devel-0.3.111-13.el9.x86_64.rp 191 kB/s | 11 kB 00:00 2024-09-17T05:16:25.196 INFO:teuthology.orchestra.run.smithi081.stdout:(56/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.5 MB/s | 171 kB 00:00 2024-09-17T05:16:25.255 INFO:teuthology.orchestra.run.smithi081.stdout:(57/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-09-17T05:16:25.305 INFO:teuthology.orchestra.run.smithi081.stdout:(58/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 905 kB/s | 45 kB 00:00 2024-09-17T05:16:25.360 INFO:teuthology.orchestra.run.smithi160.stdout:(7/157): ceph-common-19.3.0-4963.g820f760e.el9. 4.0 MB/s | 22 MB 00:05 2024-09-17T05:16:25.422 INFO:teuthology.orchestra.run.smithi081.stdout:(59/157): librdkafka-1.6.1-102.el9.x86_64.rpm 5.6 MB/s | 662 kB 00:00 2024-09-17T05:16:25.477 INFO:teuthology.orchestra.run.smithi160.stdout:(8/157): ceph-mon-19.3.0-4963.g820f760e.el9.x86 2.1 MB/s | 4.8 MB 00:02 2024-09-17T05:16:25.539 INFO:teuthology.orchestra.run.smithi081.stdout:(60/157): libtool-2.4.6-46.el9.x86_64.rpm 4.9 MB/s | 581 kB 00:00 2024-09-17T05:16:25.561 INFO:teuthology.orchestra.run.smithi160.stdout:(9/157): ceph-selinux-19.3.0-4963.g820f760e.el9 302 kB/s | 25 kB 00:00 2024-09-17T05:16:25.589 INFO:teuthology.orchestra.run.smithi081.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-17T05:16:25.639 INFO:teuthology.orchestra.run.smithi081.stdout:(62/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 4.6 MB/s | 3.0 MB 00:00 2024-09-17T05:16:25.665 INFO:teuthology.orchestra.run.smithi081.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 631 kB/s | 47 kB 00:00 2024-09-17T05:16:25.724 INFO:teuthology.orchestra.run.smithi081.stdout:(64/157): lua-5.4.4-4.el9.x86_64.rpm 3.2 MB/s | 188 kB 00:00 2024-09-17T05:16:25.749 INFO:teuthology.orchestra.run.smithi081.stdout:(65/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.6 MB/s | 292 kB 00:00 2024-09-17T05:16:25.774 INFO:teuthology.orchestra.run.smithi081.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-17T05:16:26.524 INFO:teuthology.orchestra.run.smithi081.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 6.4 MB/s | 4.9 MB 00:00 2024-09-17T05:16:26.608 INFO:teuthology.orchestra.run.smithi081.stdout:(68/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 5.3 MB/s | 4.4 MB 00:00 2024-09-17T05:16:26.783 INFO:teuthology.orchestra.run.smithi081.stdout:(69/157): postgresql-contrib-13.16-1.el9.x86_64 5.1 MB/s | 910 kB 00:00 2024-09-17T05:16:26.825 INFO:teuthology.orchestra.run.smithi081.stdout:(70/157): postgresql-13.16-1.el9.x86_64.rpm 5.3 MB/s | 1.6 MB 00:00 2024-09-17T05:16:26.851 INFO:teuthology.orchestra.run.smithi081.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-17T05:16:27.066 INFO:teuthology.orchestra.run.smithi081.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 4.7 MB/s | 1.0 MB 00:00 2024-09-17T05:16:27.126 INFO:teuthology.orchestra.run.smithi081.stdout:(73/157): python3-attrs-20.3.0-7.el9.noarch.rpm 1.4 MB/s | 87 kB 00:00 2024-09-17T05:16:27.552 INFO:teuthology.orchestra.run.smithi081.stdout:(74/157): postgresql-server-13.16-1.el9.x86_64. 8.0 MB/s | 5.8 MB 00:00 2024-09-17T05:16:27.610 INFO:teuthology.orchestra.run.smithi081.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.0 MB/s | 61 kB 00:00 2024-09-17T05:16:27.669 INFO:teuthology.orchestra.run.smithi081.stdout:(76/157): python3-devel-3.9.19-8.el9.x86_64.rpm 4.1 MB/s | 245 kB 00:00 2024-09-17T05:16:27.727 INFO:teuthology.orchestra.run.smithi081.stdout:(77/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.2 MB/s | 248 kB 00:00 2024-09-17T05:16:27.794 INFO:teuthology.orchestra.run.smithi081.stdout:(78/157): python3-jsonpatch-1.21-16.el9.noarch. 384 kB/s | 26 kB 00:00 2024-09-17T05:16:27.845 INFO:teuthology.orchestra.run.smithi081.stdout:(79/157): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-17T05:16:27.895 INFO:teuthology.orchestra.run.smithi081.stdout:(80/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-17T05:16:28.021 INFO:teuthology.orchestra.run.smithi081.stdout:(81/157): python3-babel-2.9.1-2.el9.noarch.rpm 6.7 MB/s | 6.0 MB 00:00 2024-09-17T05:16:28.046 INFO:teuthology.orchestra.run.smithi081.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 231 kB/s | 35 kB 00:00 2024-09-17T05:16:28.104 INFO:teuthology.orchestra.run.smithi081.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-17T05:16:28.163 INFO:teuthology.orchestra.run.smithi081.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 3.7 MB/s | 222 kB 00:00 2024-09-17T05:16:28.330 INFO:teuthology.orchestra.run.smithi081.stdout:(85/157): python3-packaging-20.9-5.el9.noarch.r 463 kB/s | 77 kB 00:00 2024-09-17T05:16:28.386 INFO:teuthology.orchestra.run.smithi160.stdout:(10/157): ceph-radosgw-19.3.0-4963.g820f760e.el 3.6 MB/s | 11 MB 00:03 2024-09-17T05:16:28.422 INFO:teuthology.orchestra.run.smithi081.stdout:(86/157): python3-prettytable-0.7.2-27.el9.noar 461 kB/s | 42 kB 00:00 2024-09-17T05:16:28.481 INFO:teuthology.orchestra.run.smithi081.stdout:(87/157): python3-protobuf-3.14.0-13.el9.noarch 4.5 MB/s | 269 kB 00:00 2024-09-17T05:16:28.519 INFO:teuthology.orchestra.run.smithi160.stdout:(11/157): cephfs-mirror-19.3.0-4963.g820f760e.e 1.7 MB/s | 225 kB 00:00 2024-09-17T05:16:28.539 INFO:teuthology.orchestra.run.smithi081.stdout:(88/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.7 MB/s | 159 kB 00:00 2024-09-17T05:16:28.569 INFO:teuthology.orchestra.run.smithi160.stdout:(12/157): cephfs-shell-19.3.0-4963.g820f760e.el 540 kB/s | 27 kB 00:00 2024-09-17T05:16:28.598 INFO:teuthology.orchestra.run.smithi081.stdout:(89/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.7 MB/s | 279 kB 00:00 2024-09-17T05:16:28.628 INFO:teuthology.orchestra.run.smithi160.stdout:(13/157): libcephfs-devel-19.3.0-4963.g820f760e 545 kB/s | 32 kB 00:00 2024-09-17T05:16:28.648 INFO:teuthology.orchestra.run.smithi081.stdout:(90/157): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-17T05:16:28.698 INFO:teuthology.orchestra.run.smithi081.stdout:(91/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T05:16:28.774 INFO:teuthology.orchestra.run.smithi081.stdout:(92/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 6.8 MB/s | 5.1 MB 00:00 2024-09-17T05:16:28.803 INFO:teuthology.orchestra.run.smithi160.stdout:(14/157): libcephfs2-19.3.0-4963.g820f760e.el9. 4.2 MB/s | 755 kB 00:00 2024-09-17T05:16:28.824 INFO:teuthology.orchestra.run.smithi081.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 838 kB/s | 42 kB 00:00 2024-09-17T05:16:28.862 INFO:teuthology.orchestra.run.smithi160.stdout:(15/157): libcephsqlite-19.3.0-4963.g820f760e.e 2.7 MB/s | 161 kB 00:00 2024-09-17T05:16:28.874 INFO:teuthology.orchestra.run.smithi081.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 883 kB/s | 44 kB 00:00 2024-09-17T05:16:28.912 INFO:teuthology.orchestra.run.smithi160.stdout:(16/157): librados-devel-19.3.0-4963.g820f760e. 2.5 MB/s | 126 kB 00:00 2024-09-17T05:16:28.924 INFO:teuthology.orchestra.run.smithi081.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T05:16:28.975 INFO:teuthology.orchestra.run.smithi081.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 719 kB/s | 36 kB 00:00 2024-09-17T05:16:29.021 INFO:teuthology.orchestra.run.smithi160.stdout:(17/157): libradosstriper1-19.3.0-4963.g820f760 4.6 MB/s | 508 kB 00:00 2024-09-17T05:16:29.025 INFO:teuthology.orchestra.run.smithi081.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 951 kB/s | 47 kB 00:00 2024-09-17T05:16:29.109 INFO:teuthology.orchestra.run.smithi081.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-17T05:16:29.159 INFO:teuthology.orchestra.run.smithi081.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-09-17T05:16:29.210 INFO:teuthology.orchestra.run.smithi081.stdout:(100/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-17T05:16:29.260 INFO:teuthology.orchestra.run.smithi081.stdout:(101/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T05:16:29.310 INFO:teuthology.orchestra.run.smithi081.stdout:(102/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 896 kB/s | 45 kB 00:00 2024-09-17T05:16:29.402 INFO:teuthology.orchestra.run.smithi081.stdout:(103/157): lua-devel-5.4.4-4.el9.x86_64.rpm 244 kB/s | 22 kB 00:00 2024-09-17T05:16:29.511 INFO:teuthology.orchestra.run.smithi081.stdout:(104/157): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-09-17T05:16:29.594 INFO:teuthology.orchestra.run.smithi081.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 6.4 MB/s | 548 kB 00:00 2024-09-17T05:16:29.628 INFO:teuthology.orchestra.run.smithi081.stdout:(106/157): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-17T05:16:29.653 INFO:teuthology.orchestra.run.smithi081.stdout:(107/157): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-09-17T05:16:29.837 INFO:teuthology.orchestra.run.smithi081.stdout:(108/157): libarrow-9.0.0-11.el9.x86_64.rpm 24 MB/s | 4.4 MB 00:00 2024-09-17T05:16:29.862 INFO:teuthology.orchestra.run.smithi081.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T05:16:29.887 INFO:teuthology.orchestra.run.smithi081.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T05:16:29.913 INFO:teuthology.orchestra.run.smithi081.stdout:(111/157): libunwind-1.6.2-1.el9.x86_64.rpm 2.6 MB/s | 67 kB 00:00 2024-09-17T05:16:29.929 INFO:teuthology.orchestra.run.smithi160.stdout:(18/157): librgw2-19.3.0-4963.g820f760e.el9.x86 6.1 MB/s | 5.5 MB 00:00 2024-09-17T05:16:29.946 INFO:teuthology.orchestra.run.smithi081.stdout:(112/157): luarocks-3.9.2-5.el9.noarch.rpm 4.4 MB/s | 151 kB 00:00 2024-09-17T05:16:29.988 INFO:teuthology.orchestra.run.smithi081.stdout:(113/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-09-17T05:16:29.996 INFO:teuthology.orchestra.run.smithi160.stdout:(19/157): python3-ceph-argparse-19.3.0-4963.g82 679 kB/s | 45 kB 00:00 2024-09-17T05:16:30.030 INFO:teuthology.orchestra.run.smithi081.stdout:(114/157): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-17T05:16:30.056 INFO:teuthology.orchestra.run.smithi081.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T05:16:30.063 INFO:teuthology.orchestra.run.smithi160.stdout:(20/157): python3-ceph-common-19.3.0-4963.g820f 2.2 MB/s | 148 kB 00:00 2024-09-17T05:16:30.081 INFO:teuthology.orchestra.run.smithi081.stdout:(116/157): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-17T05:16:30.106 INFO:teuthology.orchestra.run.smithi081.stdout:(117/157): python3-certifi-2023.05.07-4.el9.noa 564 kB/s | 14 kB 00:00 2024-09-17T05:16:30.130 INFO:teuthology.orchestra.run.smithi160.stdout:(21/157): python3-cephfs-19.3.0-4963.g820f760e. 2.4 MB/s | 161 kB 00:00 2024-09-17T05:16:30.131 INFO:teuthology.orchestra.run.smithi081.stdout:(118/157): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-17T05:16:30.173 INFO:teuthology.orchestra.run.smithi081.stdout:(119/157): python3-cherrypy-18.6.1-2.el9.noarch 8.4 MB/s | 358 kB 00:00 2024-09-17T05:16:30.197 INFO:teuthology.orchestra.run.smithi160.stdout:(22/157): python3-rados-19.3.0-4963.g820f760e.e 4.7 MB/s | 320 kB 00:00 2024-09-17T05:16:30.198 INFO:teuthology.orchestra.run.smithi081.stdout:(120/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-17T05:16:30.224 INFO:teuthology.orchestra.run.smithi081.stdout:(121/157): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-17T05:16:30.264 INFO:teuthology.orchestra.run.smithi160.stdout:(23/157): python3-rbd-19.3.0-4963.g820f760e.el9 4.5 MB/s | 305 kB 00:00 2024-09-17T05:16:30.299 INFO:teuthology.orchestra.run.smithi081.stdout:(122/157): python3-grpcio-1.46.7-10.el9.x86_64. 27 MB/s | 2.0 MB 00:00 2024-09-17T05:16:30.325 INFO:teuthology.orchestra.run.smithi081.stdout:(123/157): python3-grpcio-tools-1.46.7-10.el9.x 5.6 MB/s | 144 kB 00:00 2024-09-17T05:16:30.350 INFO:teuthology.orchestra.run.smithi081.stdout:(124/157): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-09-17T05:16:30.367 INFO:teuthology.orchestra.run.smithi081.stdout:(125/157): python3-jaraco-classes-3.2.1-5.el9.n 1.0 MB/s | 18 kB 00:00 2024-09-17T05:16:30.392 INFO:teuthology.orchestra.run.smithi081.stdout:(126/157): python3-jaraco-collections-3.0.0-8.e 924 kB/s | 23 kB 00:00 2024-09-17T05:16:30.417 INFO:teuthology.orchestra.run.smithi081.stdout:(127/157): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-17T05:16:30.443 INFO:teuthology.orchestra.run.smithi081.stdout:(128/157): python3-jaraco-text-3.2.0-6.el9.noar 782 kB/s | 20 kB 00:00 2024-09-17T05:16:30.448 INFO:teuthology.orchestra.run.smithi160.stdout:(24/157): ceph-osd-19.3.0-4963.g820f760e.el9.x8 2.5 MB/s | 17 MB 00:06 2024-09-17T05:16:30.473 INFO:teuthology.orchestra.run.smithi160.stdout:(25/157): python3-rgw-19.3.0-4963.g820f760e.el9 476 kB/s | 99 kB 00:00 2024-09-17T05:16:30.493 INFO:teuthology.orchestra.run.smithi081.stdout:(129/157): python3-kubernetes-26.1.0-2.el9.noar 21 MB/s | 1.0 MB 00:00 2024-09-17T05:16:30.515 INFO:teuthology.orchestra.run.smithi160.stdout:(26/157): rbd-fuse-19.3.0-4963.g820f760e.el9.x8 1.2 MB/s | 85 kB 00:00 2024-09-17T05:16:30.518 INFO:teuthology.orchestra.run.smithi081.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T05:16:30.544 INFO:teuthology.orchestra.run.smithi081.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-17T05:16:30.569 INFO:teuthology.orchestra.run.smithi081.stdout:(132/157): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-17T05:16:30.603 INFO:teuthology.orchestra.run.smithi081.stdout:(133/157): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-09-17T05:16:30.640 INFO:teuthology.orchestra.run.smithi160.stdout:(27/157): rbd-nbd-19.3.0-4963.g820f760e.el9.x86 1.3 MB/s | 170 kB 00:00 2024-09-17T05:16:30.653 INFO:teuthology.orchestra.run.smithi081.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 328 kB/s | 16 kB 00:00 2024-09-17T05:16:30.695 INFO:teuthology.orchestra.run.smithi081.stdout:(135/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 2.1 MB/s | 90 kB 00:00 2024-09-17T05:16:30.715 INFO:teuthology.orchestra.run.smithi160.stdout:(28/157): ceph-grafana-dashboards-19.3.0-4963.g 457 kB/s | 34 kB 00:00 2024-09-17T05:16:30.720 INFO:teuthology.orchestra.run.smithi081.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-17T05:16:30.745 INFO:teuthology.orchestra.run.smithi081.stdout:(137/157): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-17T05:16:30.779 INFO:teuthology.orchestra.run.smithi081.stdout:(138/157): python3-routes-2.5.1-5.el9.noarch.rp 5.5 MB/s | 188 kB 00:00 2024-09-17T05:16:30.857 INFO:teuthology.orchestra.run.smithi160.stdout:(29/157): ceph-mgr-cephadm-19.3.0-4963.g820f760 1.1 MB/s | 154 kB 00:00 2024-09-17T05:16:30.938 INFO:teuthology.orchestra.run.smithi081.stdout:(139/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 7.3 MB/s | 16 MB 00:02 2024-09-17T05:16:30.971 INFO:teuthology.orchestra.run.smithi081.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 307 kB/s | 59 kB 00:00 2024-09-17T05:16:31.005 INFO:teuthology.orchestra.run.smithi081.stdout:(141/157): python3-typing-extensions-4.12.2-2.e 2.8 MB/s | 74 kB 00:00 2024-09-17T05:16:31.039 INFO:teuthology.orchestra.run.smithi081.stdout:(142/157): python3-tempora-5.0.0-2.el9.noarch.r 357 kB/s | 36 kB 00:00 2024-09-17T05:16:31.064 INFO:teuthology.orchestra.run.smithi081.stdout:(143/157): python3-webob-1.8.8-2.el9.noarch.rpm 4.0 MB/s | 230 kB 00:00 2024-09-17T05:16:31.089 INFO:teuthology.orchestra.run.smithi081.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-17T05:16:31.123 INFO:teuthology.orchestra.run.smithi081.stdout:(145/157): python3-werkzeug-2.0.3-3.el9.1.noarc 7.1 MB/s | 427 kB 00:00 2024-09-17T05:16:31.148 INFO:teuthology.orchestra.run.smithi081.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 342 kB/s | 20 kB 00:00 2024-09-17T05:16:31.174 INFO:teuthology.orchestra.run.smithi081.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T05:16:31.274 INFO:teuthology.orchestra.run.smithi081.stdout:(148/157): thrift-0.15.0-2.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-09-17T05:16:31.433 INFO:teuthology.orchestra.run.smithi160.stdout:(30/157): rbd-mirror-19.3.0-4963.g820f760e.el9. 3.3 MB/s | 3.2 MB 00:00 2024-09-17T05:16:31.766 INFO:teuthology.orchestra.run.smithi081.stdout:(149/157): librados2-19.3.0-4963.g820f760e.el9. 5.8 MB/s | 3.5 MB 00:00 2024-09-17T05:16:31.850 INFO:teuthology.orchestra.run.smithi081.stdout:(150/157): librbd1-19.3.0-4963.g820f760e.el9.x8 5.7 MB/s | 3.3 MB 00:00 2024-09-17T05:16:32.176 INFO:teuthology.orchestra.run.smithi081.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 5.5 MB/s | 1.8 MB 00:00 2024-09-17T05:16:32.568 INFO:teuthology.orchestra.run.smithi081.stdout:(152/157): ceph-test-19.3.0-4963.g820f760e.el9. 4.1 MB/s | 46 MB 00:11 2024-09-17T05:16:32.593 INFO:teuthology.orchestra.run.smithi081.stdout:(153/157): NetworkManager-team-1.51.0-1.el9.x86 98 kB/s | 41 kB 00:00 2024-09-17T05:16:32.644 INFO:teuthology.orchestra.run.smithi081.stdout:(154/157): NetworkManager-1.51.0-1.el9.x86_64.r 2.6 MB/s | 2.3 MB 00:00 2024-09-17T05:16:32.833 INFO:teuthology.orchestra.run.smithi160.stdout:(31/157): ceph-mgr-diskprediction-local-19.3.0- 5.3 MB/s | 7.4 MB 00:01 2024-09-17T05:16:32.925 INFO:teuthology.orchestra.run.smithi160.stdout:(32/157): ceph-mgr-modules-core-19.3.0-4963.g82 3.1 MB/s | 291 kB 00:00 2024-09-17T05:16:32.936 INFO:teuthology.orchestra.run.smithi081.stdout:(155/157): NetworkManager-tui-1.51.0-1.el9.x86_ 678 kB/s | 249 kB 00:00 2024-09-17T05:16:32.975 INFO:teuthology.orchestra.run.smithi160.stdout:(33/157): ceph-mgr-rook-19.3.0-4963.g820f760e.e 990 kB/s | 49 kB 00:00 2024-09-17T05:16:32.977 INFO:teuthology.orchestra.run.smithi081.stdout:(156/157): openssl-3.2.2-6.el9.x86_64.rpm 3.5 MB/s | 1.4 MB 00:00 2024-09-17T05:16:33.067 INFO:teuthology.orchestra.run.smithi160.stdout:(34/157): ceph-prometheus-alerts-19.3.0-4963.g8 179 kB/s | 16 kB 00:00 2024-09-17T05:16:33.151 INFO:teuthology.orchestra.run.smithi160.stdout:(35/157): ceph-volume-19.3.0-4963.g820f760e.el9 3.3 MB/s | 285 kB 00:00 2024-09-17T05:16:33.268 INFO:teuthology.orchestra.run.smithi160.stdout:(36/157): cephadm-19.3.0-4963.g820f760e.el9.noa 6.6 MB/s | 784 kB 00:00 2024-09-17T05:16:33.360 INFO:teuthology.orchestra.run.smithi160.stdout:(37/157): cephfs-top-19.3.0-4963.g820f760e.el9. 199 kB/s | 18 kB 00:00 2024-09-17T05:16:33.485 INFO:teuthology.orchestra.run.smithi160.stdout:(38/157): fuse-2.9.9-16.el9.x86_64.rpm 640 kB/s | 80 kB 00:00 2024-09-17T05:16:33.585 INFO:teuthology.orchestra.run.smithi160.stdout:(39/157): libgfortran-11.5.0-2.el9.x86_64.rpm 7.8 MB/s | 801 kB 00:00 2024-09-17T05:16:33.627 INFO:teuthology.orchestra.run.smithi160.stdout:(40/157): libquadmath-11.5.0-2.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-17T05:16:33.677 INFO:teuthology.orchestra.run.smithi160.stdout:(41/157): python3-cffi-1.14.5-5.el9.x86_64.rpm 5.0 MB/s | 253 kB 00:00 2024-09-17T05:16:33.753 INFO:teuthology.orchestra.run.smithi160.stdout:(42/157): python3-cryptography-36.0.1-4.el9.x86 16 MB/s | 1.2 MB 00:00 2024-09-17T05:16:33.795 INFO:teuthology.orchestra.run.smithi160.stdout:(43/157): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-17T05:16:33.803 INFO:teuthology.orchestra.run.smithi081.stdout:(157/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 2.1 MB/s | 2.4 MB 00:01 2024-09-17T05:16:33.809 INFO:teuthology.orchestra.run.smithi081.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:16:33.809 INFO:teuthology.orchestra.run.smithi081.stdout:Total 16 MB/s | 235 MB 00:15 2024-09-17T05:16:33.845 INFO:teuthology.orchestra.run.smithi160.stdout:(44/157): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-17T05:16:33.887 INFO:teuthology.orchestra.run.smithi160.stdout:(45/157): python3-requests-2.25.1-8.el9.noarch. 2.9 MB/s | 125 kB 00:00 2024-09-17T05:16:33.971 INFO:teuthology.orchestra.run.smithi160.stdout:(46/157): python3-urllib3-1.26.5-6.el9.noarch.r 2.5 MB/s | 215 kB 00:00 2024-09-17T05:16:34.029 INFO:teuthology.orchestra.run.smithi160.stdout:(47/157): automake-1.16.2-8.el9.noarch.rpm 12 MB/s | 689 kB 00:00 2024-09-17T05:16:34.088 INFO:teuthology.orchestra.run.smithi160.stdout:(48/157): bison-3.7.4-5.el9.x86_64.rpm 16 MB/s | 943 kB 00:00 2024-09-17T05:16:34.131 INFO:teuthology.orchestra.run.smithi160.stdout:(49/157): boost-program-options-1.75.0-8.el9.x8 2.5 MB/s | 107 kB 00:00 2024-09-17T05:16:34.188 INFO:teuthology.orchestra.run.smithi160.stdout:(50/157): elfutils-libelf-devel-0.191-4.el9.x86 373 kB/s | 22 kB 00:00 2024-09-17T05:16:34.231 INFO:teuthology.orchestra.run.smithi160.stdout:(51/157): flex-2.6.4-9.el9.x86_64.rpm 7.4 MB/s | 313 kB 00:00 2024-09-17T05:16:34.272 INFO:teuthology.orchestra.run.smithi160.stdout:(52/157): flexiblas-3.0.4-8.el9.x86_64.rpm 787 kB/s | 33 kB 00:00 2024-09-17T05:16:34.381 INFO:teuthology.orchestra.run.smithi160.stdout:(53/157): flexiblas-netlib-3.0.4-8.el9.x86_64.r 28 MB/s | 3.0 MB 00:00 2024-09-17T05:16:34.515 INFO:teuthology.orchestra.run.smithi160.stdout:(54/157): ceph-mgr-dashboard-19.3.0-4963.g820f7 3.9 MB/s | 14 MB 00:03 2024-09-17T05:16:34.555 INFO:teuthology.orchestra.run.smithi160.stdout:(55/157): flexiblas-openblas-openmp-3.0.4-8.el9 105 kB/s | 18 kB 00:00 2024-09-17T05:16:34.599 INFO:teuthology.orchestra.run.smithi160.stdout:(56/157): libaio-devel-0.3.111-13.el9.x86_64.rp 134 kB/s | 11 kB 00:00 2024-09-17T05:16:34.624 INFO:teuthology.orchestra.run.smithi160.stdout:(57/157): libnbd-1.20.2-2.el9.x86_64.rpm 2.4 MB/s | 171 kB 00:00 2024-09-17T05:16:34.674 INFO:teuthology.orchestra.run.smithi160.stdout:(58/157): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-17T05:16:34.700 INFO:teuthology.orchestra.run.smithi160.stdout:(59/157): librabbitmq-0.11.0-7.el9.x86_64.rpm 602 kB/s | 45 kB 00:00 2024-09-17T05:16:34.742 INFO:teuthology.orchestra.run.smithi160.stdout:(60/157): librdkafka-1.6.1-102.el9.x86_64.rpm 9.7 MB/s | 662 kB 00:00 2024-09-17T05:16:34.783 INFO:teuthology.orchestra.run.smithi160.stdout:(61/157): libuuid-devel-2.37.4-20.el9.x86_64.rp 590 kB/s | 24 kB 00:00 2024-09-17T05:16:34.809 INFO:teuthology.orchestra.run.smithi160.stdout:(62/157): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-09-17T05:16:34.843 INFO:teuthology.orchestra.run.smithi160.stdout:(63/157): libzstd-devel-1.5.1-2.el9.x86_64.rpm 807 kB/s | 47 kB 00:00 2024-09-17T05:16:34.868 INFO:teuthology.orchestra.run.smithi160.stdout:(64/157): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-17T05:16:34.893 INFO:teuthology.orchestra.run.smithi160.stdout:(65/157): lua-5.4.4-4.el9.x86_64.rpm 3.7 MB/s | 188 kB 00:00 2024-09-17T05:16:34.918 INFO:teuthology.orchestra.run.smithi160.stdout:(66/157): openblas-0.3.26-2.el9.x86_64.rpm 769 kB/s | 38 kB 00:00 2024-09-17T05:16:35.038 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction check 2024-09-17T05:16:35.044 INFO:teuthology.orchestra.run.smithi160.stdout:(67/157): openblas-openmp-0.3.26-2.el9.x86_64.r 33 MB/s | 4.9 MB 00:00 2024-09-17T05:16:35.119 INFO:teuthology.orchestra.run.smithi160.stdout:(68/157): postgresql-13.16-1.el9.x86_64.rpm 21 MB/s | 1.6 MB 00:00 2024-09-17T05:16:35.180 INFO:teuthology.orchestra.run.smithi160.stdout:(69/157): openssl-devel-3.2.2-6.el9.x86_64.rpm 17 MB/s | 4.4 MB 00:00 2024-09-17T05:16:35.191 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction check succeeded. 2024-09-17T05:16:35.191 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction test 2024-09-17T05:16:35.211 INFO:teuthology.orchestra.run.smithi160.stdout:(70/157): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-17T05:16:35.245 INFO:teuthology.orchestra.run.smithi160.stdout:(71/157): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-17T05:16:35.320 INFO:teuthology.orchestra.run.smithi160.stdout:(72/157): protobuf-3.14.0-13.el9.x86_64.rpm 13 MB/s | 1.0 MB 00:00 2024-09-17T05:16:35.395 INFO:teuthology.orchestra.run.smithi160.stdout:(73/157): postgresql-server-13.16-1.el9.x86_64. 31 MB/s | 5.8 MB 00:00 2024-09-17T05:16:35.421 INFO:teuthology.orchestra.run.smithi160.stdout:(74/157): python3-attrs-20.3.0-7.el9.noarch.rpm 874 kB/s | 87 kB 00:00 2024-09-17T05:16:35.471 INFO:teuthology.orchestra.run.smithi160.stdout:(75/157): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-17T05:16:35.555 INFO:teuthology.orchestra.run.smithi160.stdout:(76/157): python3-babel-2.9.1-2.el9.noarch.rpm 38 MB/s | 6.0 MB 00:00 2024-09-17T05:16:35.588 INFO:teuthology.orchestra.run.smithi160.stdout:(77/157): python3-devel-3.9.19-8.el9.x86_64.rpm 2.0 MB/s | 245 kB 00:00 2024-09-17T05:16:35.614 INFO:teuthology.orchestra.run.smithi160.stdout:(78/157): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-09-17T05:16:35.639 INFO:teuthology.orchestra.run.smithi160.stdout:(79/157): python3-jsonpatch-1.21-16.el9.noarch. 510 kB/s | 26 kB 00:00 2024-09-17T05:16:35.664 INFO:teuthology.orchestra.run.smithi160.stdout:(80/157): python3-jsonpointer-2.0-4.el9.noarch. 381 kB/s | 19 kB 00:00 2024-09-17T05:16:35.689 INFO:teuthology.orchestra.run.smithi160.stdout:(81/157): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-17T05:16:35.715 INFO:teuthology.orchestra.run.smithi160.stdout:(82/157): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-09-17T05:16:35.765 INFO:teuthology.orchestra.run.smithi160.stdout:(83/157): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.9 MB/s | 250 kB 00:00 2024-09-17T05:16:35.807 INFO:teuthology.orchestra.run.smithi160.stdout:(84/157): python3-oauthlib-3.1.1-5.el9.noarch.r 5.2 MB/s | 222 kB 00:00 2024-09-17T05:16:35.891 INFO:teuthology.orchestra.run.smithi160.stdout:(85/157): python3-numpy-1.20.1-5.el9.x86_64.rpm 25 MB/s | 5.1 MB 00:00 2024-09-17T05:16:35.916 INFO:teuthology.orchestra.run.smithi160.stdout:(86/157): python3-packaging-20.9-5.el9.noarch.r 711 kB/s | 77 kB 00:00 2024-09-17T05:16:35.941 INFO:teuthology.orchestra.run.smithi160.stdout:(87/157): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-17T05:16:35.966 INFO:teuthology.orchestra.run.smithi160.stdout:(88/157): python3-protobuf-3.14.0-13.el9.noarch 5.2 MB/s | 269 kB 00:00 2024-09-17T05:16:35.992 INFO:teuthology.orchestra.run.smithi160.stdout:(89/157): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-17T05:16:36.026 INFO:teuthology.orchestra.run.smithi160.stdout:(90/157): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-17T05:16:36.051 INFO:teuthology.orchestra.run.smithi160.stdout:(91/157): python3-pytz-2021.1-5.el9.noarch.rpm 867 kB/s | 51 kB 00:00 2024-09-17T05:16:36.076 INFO:teuthology.orchestra.run.smithi160.stdout:(92/157): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-17T05:16:36.118 INFO:teuthology.orchestra.run.smithi160.stdout:(93/157): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-09-17T05:16:36.160 INFO:teuthology.orchestra.run.smithi160.stdout:(94/157): python3-wcwidth-0.2.5-8.el9.noarch.rp 1.0 MB/s | 44 kB 00:00 2024-09-17T05:16:36.210 INFO:teuthology.orchestra.run.smithi160.stdout:(95/157): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-17T05:16:36.252 INFO:teuthology.orchestra.run.smithi160.stdout:(96/157): qatlib-service-24.02.0-1.el9.x86_64.r 863 kB/s | 36 kB 00:00 2024-09-17T05:16:36.294 INFO:teuthology.orchestra.run.smithi160.stdout:(97/157): qatzip-libs-1.2.0-1.el9.x86_64.rpm 1.1 MB/s | 47 kB 00:00 2024-09-17T05:16:36.345 INFO:teuthology.orchestra.run.smithi160.stdout:(98/157): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-09-17T05:16:36.387 INFO:teuthology.orchestra.run.smithi160.stdout:(99/157): uuid-1.6.2-55.el9.x86_64.rpm 1.4 MB/s | 58 kB 00:00 2024-09-17T05:16:36.545 INFO:teuthology.orchestra.run.smithi160.stdout:(100/157): python3-scipy-1.6.2-8.el9.x86_64.rpm 33 MB/s | 16 MB 00:00 2024-09-17T05:16:36.570 INFO:teuthology.orchestra.run.smithi160.stdout:(101/157): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 522 kB/s | 96 kB 00:00 2024-09-17T05:16:36.596 INFO:teuthology.orchestra.run.smithi160.stdout:(102/157): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-17T05:16:36.621 INFO:teuthology.orchestra.run.smithi160.stdout:(103/157): zlib-devel-1.2.11-41.el9.x86_64.rpm 891 kB/s | 45 kB 00:00 2024-09-17T05:16:37.005 INFO:teuthology.orchestra.run.smithi160.stdout:(104/157): ceph-test-19.3.0-4963.g820f760e.el9. 4.0 MB/s | 46 MB 00:11 2024-09-17T05:16:37.080 INFO:teuthology.orchestra.run.smithi160.stdout:(105/157): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-17T05:16:37.105 INFO:teuthology.orchestra.run.smithi160.stdout:(106/157): lua-devel-5.4.4-4.el9.x86_64.rpm 44 kB/s | 22 kB 00:00 2024-09-17T05:16:37.155 INFO:teuthology.orchestra.run.smithi160.stdout:(107/157): gperftools-libs-2.9.1-3.el9.x86_64.r 4.0 MB/s | 308 kB 00:00 2024-09-17T05:16:37.181 INFO:teuthology.orchestra.run.smithi160.stdout:(108/157): grpc-data-1.46.7-10.el9.noarch.rpm 259 kB/s | 19 kB 00:00 2024-09-17T05:16:37.206 INFO:teuthology.orchestra.run.smithi160.stdout:(109/157): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-17T05:16:37.231 INFO:teuthology.orchestra.run.smithi160.stdout:(110/157): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-17T05:16:37.273 INFO:teuthology.orchestra.run.smithi160.stdout:(111/157): protobuf-compiler-3.14.0-13.el9.x86_ 1.3 MB/s | 863 kB 00:00 2024-09-17T05:16:37.299 INFO:teuthology.orchestra.run.smithi160.stdout:(112/157): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-17T05:16:37.366 INFO:teuthology.orchestra.run.smithi160.stdout:(113/157): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-17T05:16:37.416 INFO:teuthology.orchestra.run.smithi160.stdout:(114/157): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.5 MB/s | 839 kB 00:00 2024-09-17T05:16:37.441 INFO:teuthology.orchestra.run.smithi160.stdout:(115/157): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-17T05:16:37.474 INFO:teuthology.orchestra.run.smithi160.stdout:(116/157): python3-asyncssh-2.13.2-5.el9.noarch 4.9 MB/s | 548 kB 00:00 2024-09-17T05:16:37.500 INFO:teuthology.orchestra.run.smithi160.stdout:(117/157): python3-cachetools-4.2.4-1.el9.noarc 549 kB/s | 32 kB 00:00 2024-09-17T05:16:37.525 INFO:teuthology.orchestra.run.smithi160.stdout:(118/157): python3-certifi-2023.05.07-4.el9.noa 280 kB/s | 14 kB 00:00 2024-09-17T05:16:37.543 INFO:teuthology.orchestra.run.smithi081.stdout:Transaction test succeeded. 2024-09-17T05:16:37.543 INFO:teuthology.orchestra.run.smithi081.stdout:Running transaction 2024-09-17T05:16:37.558 INFO:teuthology.orchestra.run.smithi160.stdout:(119/157): python3-cheroot-8.6.0-4.el9.noarch.r 2.9 MB/s | 172 kB 00:00 2024-09-17T05:16:37.601 INFO:teuthology.orchestra.run.smithi160.stdout:(120/157): python3-cherrypy-18.6.1-2.el9.noarch 4.6 MB/s | 358 kB 00:00 2024-09-17T05:16:37.690 INFO:teuthology.orchestra.run.smithi160.stdout:(121/157): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-09-17T05:16:37.718 INFO:teuthology.orchestra.run.smithi160.stdout:(122/157): python3-cmd2-2.4.2-2.el9.noarch.rpm 1.9 MB/s | 303 kB 00:00 2024-09-17T05:16:37.743 INFO:teuthology.orchestra.run.smithi160.stdout:(123/157): python3-google-auth-2.34.0-1.el9.noa 1.5 MB/s | 220 kB 00:00 2024-09-17T05:16:37.769 INFO:teuthology.orchestra.run.smithi160.stdout:(124/157): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-17T05:16:37.785 INFO:teuthology.orchestra.run.smithi160.stdout:(125/157): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-09-17T05:16:37.802 INFO:teuthology.orchestra.run.smithi160.stdout:(126/157): python3-jaraco-classes-3.2.1-5.el9.n 1.1 MB/s | 18 kB 00:00 2024-09-17T05:16:37.828 INFO:teuthology.orchestra.run.smithi160.stdout:(127/157): python3-jaraco-collections-3.0.0-8.e 555 kB/s | 23 kB 00:00 2024-09-17T05:16:37.854 INFO:teuthology.orchestra.run.smithi160.stdout:(128/157): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-17T05:16:37.878 INFO:teuthology.orchestra.run.smithi160.stdout:(129/157): python3-jaraco-text-3.2.0-6.el9.noar 392 kB/s | 20 kB 00:00 2024-09-17T05:16:37.904 INFO:teuthology.orchestra.run.smithi160.stdout:(130/157): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-17T05:16:37.938 INFO:teuthology.orchestra.run.smithi160.stdout:(131/157): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-17T05:16:37.979 INFO:teuthology.orchestra.run.smithi160.stdout:(132/157): python3-grpcio-1.46.7-10.el9.x86_64. 7.1 MB/s | 2.0 MB 00:00 2024-09-17T05:16:38.146 INFO:teuthology.orchestra.run.smithi160.stdout:(133/157): python3-natsort-7.1.1-5.el9.noarch.r 276 kB/s | 58 kB 00:00 2024-09-17T05:16:38.171 INFO:teuthology.orchestra.run.smithi160.stdout:(134/157): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-09-17T05:16:38.205 INFO:teuthology.orchestra.run.smithi160.stdout:(135/157): python3-pecan-1.4.2-3.el9.noarch.rpm 1.2 MB/s | 272 kB 00:00 2024-09-17T05:16:38.230 INFO:teuthology.orchestra.run.smithi160.stdout:(136/157): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-17T05:16:38.255 INFO:teuthology.orchestra.run.smithi160.stdout:(137/157): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.0 MB/s | 90 kB 00:00 2024-09-17T05:16:38.281 INFO:teuthology.orchestra.run.smithi160.stdout:(138/157): python3-repoze-lru-0.7-16.el9.noarch 614 kB/s | 31 kB 00:00 2024-09-17T05:16:38.314 INFO:teuthology.orchestra.run.smithi160.stdout:(139/157): python3-kubernetes-26.1.0-2.el9.noar 2.2 MB/s | 1.0 MB 00:00 2024-09-17T05:16:38.340 INFO:teuthology.orchestra.run.smithi160.stdout:(140/157): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-17T05:16:38.365 INFO:teuthology.orchestra.run.smithi160.stdout:(141/157): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-17T05:16:38.390 INFO:teuthology.orchestra.run.smithi160.stdout:(142/157): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-09-17T05:16:38.415 INFO:teuthology.orchestra.run.smithi160.stdout:(143/157): python3-typing-extensions-4.12.2-2.e 988 kB/s | 74 kB 00:00 2024-09-17T05:16:38.440 INFO:teuthology.orchestra.run.smithi160.stdout:(144/157): python3-websocket-client-1.2.3-2.el9 1.8 MB/s | 90 kB 00:00 2024-09-17T05:16:38.483 INFO:teuthology.orchestra.run.smithi160.stdout:(145/157): python3-webob-1.8.8-2.el9.noarch.rpm 1.9 MB/s | 230 kB 00:00 2024-09-17T05:16:38.508 INFO:teuthology.orchestra.run.smithi160.stdout:(146/157): python3-zc-lockfile-2.0-10.el9.noarc 299 kB/s | 20 kB 00:00 2024-09-17T05:16:38.533 INFO:teuthology.orchestra.run.smithi160.stdout:(147/157): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-17T05:16:38.567 INFO:teuthology.orchestra.run.smithi160.stdout:(148/157): python3-werkzeug-2.0.3-3.el9.1.noarc 2.8 MB/s | 427 kB 00:00 2024-09-17T05:16:38.642 INFO:teuthology.orchestra.run.smithi160.stdout:(149/157): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-17T05:16:38.809 INFO:teuthology.orchestra.run.smithi160.stdout:(150/157): NetworkManager-1.51.0-1.el9.x86_64.r 14 MB/s | 2.3 MB 00:00 2024-09-17T05:16:38.876 INFO:teuthology.orchestra.run.smithi160.stdout:(151/157): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-17T05:16:38.918 INFO:teuthology.orchestra.run.smithi160.stdout:(152/157): NetworkManager-team-1.51.0-1.el9.x86 987 kB/s | 41 kB 00:00 2024-09-17T05:16:38.959 INFO:teuthology.orchestra.run.smithi160.stdout:(153/157): NetworkManager-tui-1.51.0-1.el9.x86_ 5.9 MB/s | 249 kB 00:00 2024-09-17T05:16:39.102 INFO:teuthology.orchestra.run.smithi160.stdout:(154/157): openssl-3.2.2-6.el9.x86_64.rpm 9.5 MB/s | 1.4 MB 00:00 2024-09-17T05:16:39.152 INFO:teuthology.orchestra.run.smithi160.stdout:(155/157): librados2-19.3.0-4963.g820f760e.el9. 5.6 MB/s | 3.5 MB 00:00 2024-09-17T05:16:39.211 INFO:teuthology.orchestra.run.smithi160.stdout:(156/157): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-17T05:16:39.261 INFO:teuthology.orchestra.run.smithi160.stdout:(157/157): librbd1-19.3.0-4963.g820f760e.el9.x8 4.7 MB/s | 3.3 MB 00:00 2024-09-17T05:16:39.267 INFO:teuthology.orchestra.run.smithi160.stdout:-------------------------------------------------------------------------------- 2024-09-17T05:16:39.268 INFO:teuthology.orchestra.run.smithi160.stdout:Total 12 MB/s | 235 MB 00:19 2024-09-17T05:16:40.516 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction check 2024-09-17T05:16:40.671 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction check succeeded. 2024-09-17T05:16:40.672 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction test 2024-09-17T05:16:42.956 INFO:teuthology.orchestra.run.smithi160.stdout:Transaction test succeeded. 2024-09-17T05:16:42.956 INFO:teuthology.orchestra.run.smithi160.stdout:Running transaction 2024-09-17T05:16:44.200 INFO:teuthology.orchestra.run.smithi081.stdout: Preparing : 1/1 2024-09-17T05:16:44.290 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T05:16:44.329 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T05:16:44.391 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T05:16:44.424 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T05:16:44.450 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T05:16:44.503 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T05:16:44.836 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T05:16:44.942 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:16:45.100 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:16:45.127 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:16:45.210 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:16:45.240 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:16:45.270 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T05:16:45.438 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T05:16:45.495 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T05:16:45.532 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:16:45.623 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:16:45.650 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:16:45.696 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:16:45.735 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:16:45.758 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:16:45.911 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:16:46.090 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:16:46.241 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T05:16:46.369 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:16:46.442 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:16:46.672 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:16:46.786 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T05:16:46.816 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T05:16:46.860 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T05:16:46.931 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T05:16:46.991 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T05:16:47.032 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T05:16:47.075 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T05:16:47.108 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T05:16:47.135 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T05:16:47.205 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T05:16:47.258 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T05:16:47.297 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T05:16:47.344 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T05:16:47.423 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T05:16:47.460 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 34/165 2024-09-17T05:16:47.503 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 35/165 2024-09-17T05:16:47.531 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 36/165 2024-09-17T05:16:47.601 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T05:16:47.646 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T05:16:47.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T05:16:47.862 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T05:16:47.915 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T05:16:48.439 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T05:16:48.519 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T05:16:48.580 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T05:16:48.630 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T05:16:48.662 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 46/165 2024-09-17T05:16:48.705 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T05:16:48.859 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T05:16:48.916 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T05:16:49.008 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T05:16:49.080 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T05:16:49.152 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T05:16:49.185 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T05:16:49.237 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T05:16:49.284 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T05:16:49.320 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T05:16:49.362 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T05:16:49.414 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T05:16:49.453 INFO:teuthology.orchestra.run.smithi160.stdout: Preparing : 1/1 2024-09-17T05:16:49.557 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T05:16:49.590 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/165 2024-09-17T05:16:49.599 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T05:16:49.639 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T05:16:49.662 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/165 2024-09-17T05:16:49.742 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T05:16:49.846 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/165 2024-09-17T05:16:49.916 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/165 2024-09-17T05:16:49.941 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/165 2024-09-17T05:16:50.003 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/165 2024-09-17T05:16:50.005 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T05:16:50.058 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T05:16:50.093 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T05:16:50.118 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T05:16:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T05:16:50.344 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/165 2024-09-17T05:16:50.354 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T05:16:50.400 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T05:16:50.428 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T05:16:50.449 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:16:50.462 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T05:16:50.501 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T05:16:50.533 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T05:16:50.571 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T05:16:50.572 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:16:50.606 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T05:16:50.609 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:16:50.639 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T05:16:50.680 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T05:16:50.682 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:16:50.715 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T05:16:50.717 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:16:50.752 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/165 2024-09-17T05:16:50.802 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T05:16:50.846 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T05:16:50.877 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T05:16:50.936 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 12/165 2024-09-17T05:16:50.980 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T05:16:50.986 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-13.16-1.el9.x86_64 13/165 2024-09-17T05:16:51.014 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:16:51.036 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T05:16:51.119 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:16:51.148 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:16:51.211 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 15/165 2024-09-17T05:16:51.241 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:16:51.260 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/165 2024-09-17T05:16:51.452 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:16:51.615 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/165 2024-09-17T05:16:51.737 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 18/165 2024-09-17T05:16:51.757 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T05:16:51.808 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T05:16:51.849 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T05:16:51.852 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:16:51.941 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:16:51.941 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T05:16:51.990 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T05:16:52.043 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T05:16:52.140 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T05:16:52.172 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 19/165 2024-09-17T05:16:52.188 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T05:16:52.293 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : re2-1:20211101-20.el9.x86_64 20/165 2024-09-17T05:16:52.326 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 21/165 2024-09-17T05:16:52.363 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/165 2024-09-17T05:16:52.372 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T05:16:52.402 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T05:16:52.428 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/165 2024-09-17T05:16:52.480 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T05:16:52.480 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/165 2024-09-17T05:16:52.513 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/165 2024-09-17T05:16:52.556 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/165 2024-09-17T05:16:52.589 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/165 2024-09-17T05:16:52.616 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/165 2024-09-17T05:16:52.685 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/165 2024-09-17T05:16:52.748 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/165 2024-09-17T05:16:52.778 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/165 2024-09-17T05:16:52.822 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/165 2024-09-17T05:16:52.904 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/165 2024-09-17T05:16:52.940 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 34/165 2024-09-17T05:16:52.992 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 35/165 2024-09-17T05:16:53.021 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 36/165 2024-09-17T05:16:53.092 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/165 2024-09-17T05:16:53.129 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T05:16:53.136 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/165 2024-09-17T05:16:53.211 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/165 2024-09-17T05:16:53.235 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T05:16:53.351 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/165 2024-09-17T05:16:53.405 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/165 2024-09-17T05:16:53.927 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/165 2024-09-17T05:16:54.016 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/165 2024-09-17T05:16:54.054 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/165 2024-09-17T05:16:54.098 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/165 2024-09-17T05:16:54.144 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 46/165 2024-09-17T05:16:54.186 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/165 2024-09-17T05:16:54.344 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/165 2024-09-17T05:16:54.405 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/165 2024-09-17T05:16:54.488 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T05:16:54.495 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/165 2024-09-17T05:16:54.560 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 51/165 2024-09-17T05:16:54.566 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T05:16:54.594 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T05:16:54.628 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T05:16:54.642 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 52/165 2024-09-17T05:16:54.682 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 53/165 2024-09-17T05:16:54.718 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 54/165 2024-09-17T05:16:54.765 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 55/165 2024-09-17T05:16:54.801 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 56/165 2024-09-17T05:16:54.844 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 57/165 2024-09-17T05:16:54.886 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 58/165 2024-09-17T05:16:54.956 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T05:16:55.007 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:16:55.022 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 59/165 2024-09-17T05:16:55.058 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 60/165 2024-09-17T05:16:55.099 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 61/165 2024-09-17T05:16:55.105 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:16:55.137 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 103/165 2024-09-17T05:16:55.173 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T05:16:55.210 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 62/165 2024-09-17T05:16:55.250 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 63/165 2024-09-17T05:16:55.301 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 64/165 2024-09-17T05:16:55.340 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 65/165 2024-09-17T05:16:55.365 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 66/165 2024-09-17T05:16:55.468 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 67/165 2024-09-17T05:16:55.599 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 68/165 2024-09-17T05:16:55.647 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 69/165 2024-09-17T05:16:55.664 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T05:16:55.687 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 70/165 2024-09-17T05:16:55.694 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:16:55.726 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 71/165 2024-09-17T05:16:55.765 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : uuid-1.6.2-55.el9.x86_64 72/165 2024-09-17T05:16:55.789 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:16:55.796 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 73/165 2024-09-17T05:16:55.811 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 107/165 2024-09-17T05:16:55.827 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 74/165 2024-09-17T05:16:55.861 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 75/165 2024-09-17T05:16:55.894 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 76/165 2024-09-17T05:16:55.936 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 77/165 2024-09-17T05:16:55.970 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 78/165 2024-09-17T05:16:56.059 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 79/165 2024-09-17T05:16:56.109 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 80/165 2024-09-17T05:16:56.140 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 81/165 2024-09-17T05:16:56.244 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 82/165 2024-09-17T05:16:56.299 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 83/165 2024-09-17T05:16:57.022 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 84/165 2024-09-17T05:16:57.080 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 85/165 2024-09-17T05:16:57.113 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 86/165 2024-09-17T05:16:57.212 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 87/165 2024-09-17T05:16:57.268 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 88/165 2024-09-17T05:16:57.313 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 89/165 2024-09-17T05:16:57.401 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 90/165 2024-09-17T05:16:57.441 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 91/165 2024-09-17T05:16:57.626 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-0.3.26-2.el9.x86_64 92/165 2024-09-17T05:16:57.655 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 93/165 2024-09-17T05:16:57.733 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 94/165 2024-09-17T05:16:58.141 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:16:58.183 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:16:58.397 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 95/165 2024-09-17T05:16:58.512 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 96/165 2024-09-17T05:16:58.753 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:16:58.795 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:16:58.894 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:16:58.894 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T05:16:58.895 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T05:16:58.895 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:16:58.938 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:16:59.803 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 97/165 2024-09-17T05:16:59.877 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 98/165 2024-09-17T05:16:59.913 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 99/165 2024-09-17T05:16:59.946 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 100/165 2024-09-17T05:17:00.270 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 101/165 2024-09-17T05:17:00.309 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:17:00.391 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 102/165 2024-09-17T05:17:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 103/165 2024-09-17T05:17:00.459 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 104/165 2024-09-17T05:17:00.957 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 105/165 2024-09-17T05:17:00.995 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:17:01.066 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 106/165 2024-09-17T05:17:01.097 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 107/165 2024-09-17T05:17:03.429 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:17:03.476 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:17:04.043 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 108/165 2024-09-17T05:17:04.088 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:17:04.183 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 109/165 2024-09-17T05:17:04.183 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-17T05:17:04.183 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-17T05:17:04.183 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:04.223 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:17:10.787 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /sys 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /proc 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /mnt 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /var/tmp 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /home 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /root 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout:skipping the directory /tmp 2024-09-17T05:17:10.788 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:10.959 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:17:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:17:10.975 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:10.975 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T05:17:10.975 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:12.495 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:17:12.522 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:17:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T05:17:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:17:12.522 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:17:12.523 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:12.754 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:17:12.779 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:17:12.779 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:12.779 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T05:17:12.779 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:17:12.779 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:17:12.780 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:13.238 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:17:13.262 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:17:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T05:17:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:17:13.262 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:17:13.262 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:13.369 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T05:17:13.425 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T05:17:13.481 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T05:17:13.674 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T05:17:13.748 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T05:17:13.830 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T05:17:13.914 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T05:17:14.062 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T05:17:14.108 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T05:17:14.147 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T05:17:14.174 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T05:17:14.592 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:17:14.623 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:17:14.655 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 127/165 2024-09-17T05:17:14.721 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 128/165 2024-09-17T05:17:14.746 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:17:15.938 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 110/165 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /sys 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /proc 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /mnt 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /var/tmp 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /home 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /root 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout:skipping the directory /tmp 2024-09-17T05:17:15.939 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:16.116 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:17:16.133 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 111/165 2024-09-17T05:17:16.133 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:16.133 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-17T05:17:16.134 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:17.619 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:17:17.646 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 112/165 2024-09-17T05:17:17.646 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:17.646 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-17T05:17:17.646 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:17:17.646 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-17T05:17:17.646 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:17.886 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:17:17.910 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 113/165 2024-09-17T05:17:17.910 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:17.910 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-17T05:17:17.910 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:17:17.910 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-17T05:17:17.910 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:17.926 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:17:17.986 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:17:18.371 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:17:18.394 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 114/165 2024-09-17T05:17:18.394 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:18.395 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-17T05:17:18.395 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:17:18.395 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-17T05:17:18.395 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:18.501 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : automake-1.16.2-8.el9.noarch 115/165 2024-09-17T05:17:18.566 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-ply-3.11-14.el9.noarch 116/165 2024-09-17T05:17:18.622 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 117/165 2024-09-17T05:17:18.809 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 118/165 2024-09-17T05:17:18.857 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 119/165 2024-09-17T05:17:18.932 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 120/165 2024-09-17T05:17:18.947 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:17:18.986 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:17:19.020 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 121/165 2024-09-17T05:17:19.100 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:17:19.162 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 122/165 2024-09-17T05:17:19.210 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 123/165 2024-09-17T05:17:19.253 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 124/165 2024-09-17T05:17:19.271 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 132/165 2024-09-17T05:17:19.281 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : fuse-2.9.9-16.el9.x86_64 125/165 2024-09-17T05:17:19.296 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:17:19.320 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:17:19.321 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:19.321 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T05:17:19.321 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:17:19.321 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:17:19.321 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:19.372 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:17:19.385 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:17:19.481 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 135/165 2024-09-17T05:17:19.533 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 136/165 2024-09-17T05:17:19.711 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:17:19.738 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 126/165 2024-09-17T05:17:19.771 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 127/165 2024-09-17T05:17:19.837 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 128/165 2024-09-17T05:17:19.861 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:17:20.486 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T05:17:20.524 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:17:20.548 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:17:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T05:17:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:17:20.549 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:17:20.549 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:20.600 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:17:20.623 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:17:20.623 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:20.623 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T05:17:20.623 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:20.669 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:17:20.691 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:17:20.691 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:20.691 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T05:17:20.692 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:17:20.692 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:17:20.692 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:21.018 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:17:21.042 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:17:21.042 INFO:teuthology.orchestra.run.smithi081.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:21.042 INFO:teuthology.orchestra.run.smithi081.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T05:17:21.042 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:17:21.042 INFO:teuthology.orchestra.run.smithi081.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:17:21.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:23.042 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 129/165 2024-09-17T05:17:23.108 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:17:24.075 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 130/165 2024-09-17T05:17:24.108 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:17:24.223 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 131/165 2024-09-17T05:17:24.388 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 132/165 2024-09-17T05:17:24.410 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:17:24.435 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 133/165 2024-09-17T05:17:24.435 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:24.435 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-17T05:17:24.435 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:17:24.435 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-17T05:17:24.436 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:24.486 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:17:24.498 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 134/165 2024-09-17T05:17:24.595 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 135/165 2024-09-17T05:17:24.659 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 136/165 2024-09-17T05:17:25.355 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 142/165 2024-09-17T05:17:25.397 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 143/165 2024-09-17T05:17:25.438 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 144/165 2024-09-17T05:17:25.470 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T05:17:25.497 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T05:17:25.609 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libtool-2.4.6-46.el9.x86_64 137/165 2024-09-17T05:17:25.639 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:17:25.663 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 138/165 2024-09-17T05:17:25.663 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:25.663 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-17T05:17:25.663 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:17:25.664 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-17T05:17:25.664 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:25.690 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 147/165 2024-09-17T05:17:25.706 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:17:25.729 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-4963.g820f7 139/165 2024-09-17T05:17:25.730 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:25.730 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-17T05:17:25.730 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:25.735 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T05:17:25.766 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 149/165 2024-09-17T05:17:25.773 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:17:25.796 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T05:17:25.796 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 140/165 2024-09-17T05:17:25.797 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:25.797 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-17T05:17:25.797 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:17:25.797 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-17T05:17:25.797 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:25.850 INFO:teuthology.orchestra.run.smithi081.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T05:17:26.116 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:17:26.140 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 141/165 2024-09-17T05:17:26.140 INFO:teuthology.orchestra.run.smithi160.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-17T05:17:26.140 INFO:teuthology.orchestra.run.smithi160.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-17T05:17:26.140 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:17:26.140 INFO:teuthology.orchestra.run.smithi160.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-17T05:17:26.141 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:26.479 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:17:26.514 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:17:26.535 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:17:27.362 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 153/165 2024-09-17T05:17:27.453 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T05:17:27.499 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T05:17:27.592 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T05:17:27.622 INFO:teuthology.orchestra.run.smithi081.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T05:17:27.648 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T05:17:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T05:17:27.674 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:17:27.741 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:17:27.742 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:17:27.825 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:17:27.850 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T05:17:27.856 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:17:27.857 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:17:28.035 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:17:28.036 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:17:28.145 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:17:28.209 INFO:teuthology.orchestra.run.smithi081.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:17:30.461 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 142/165 2024-09-17T05:17:30.502 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 143/165 2024-09-17T05:17:30.543 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 144/165 2024-09-17T05:17:30.575 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 145/165 2024-09-17T05:17:30.602 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 146/165 2024-09-17T05:17:30.778 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 147/165 2024-09-17T05:17:30.823 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 148/165 2024-09-17T05:17:30.854 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 149/165 2024-09-17T05:17:30.883 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 150/165 2024-09-17T05:17:30.930 INFO:teuthology.orchestra.run.smithi160.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 151/165 2024-09-17T05:17:31.560 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:17:31.602 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:17:31.622 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 152/165 2024-09-17T05:17:32.461 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 153/165 2024-09-17T05:17:32.540 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 154/165 2024-09-17T05:17:32.577 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 155/165 2024-09-17T05:17:32.678 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : flex-2.6.4-9.el9.x86_64 156/165 2024-09-17T05:17:32.709 INFO:teuthology.orchestra.run.smithi160.stdout: Installing : bison-3.7.4-5.el9.x86_64 157/165 2024-09-17T05:17:32.735 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 158/165 2024-09-17T05:17:32.769 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 159/165 2024-09-17T05:17:32.770 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:17:32.845 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 160/165 2024-09-17T05:17:32.845 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:17:32.912 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 161/165 2024-09-17T05:17:32.937 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 162/165 2024-09-17T05:17:32.943 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:17:32.943 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:17:33.123 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 163/165 2024-09-17T05:17:33.123 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:17:33.190 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 164/165 2024-09-17T05:17:33.255 INFO:teuthology.orchestra.run.smithi160.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:17:34.872 INFO:teuthology.orchestra.run.smithi081.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:17:34.872 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 1/165 2024-09-17T05:17:34.872 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2/165 2024-09-17T05:17:34.872 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 3/165 2024-09-17T05:17:34.872 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 4/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 5/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 6/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 7/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 11/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 12/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 13/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 15/165 2024-09-17T05:17:34.873 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 16/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 17/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 18/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 19/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 20/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 21/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 22/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 23/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 24/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 25/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 26/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 27/165 2024-09-17T05:17:34.874 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 28/165 2024-09-17T05:17:34.875 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 29/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 30/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 31/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 32/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 33/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 34/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 35/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 36/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 37/165 2024-09-17T05:17:34.887 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 38/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 39/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T05:17:34.888 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T05:17:34.889 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T05:17:34.890 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T05:17:34.891 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T05:17:34.892 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T05:17:34.893 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T05:17:34.894 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T05:17:34.895 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T05:17:34.896 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 150/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 152/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T05:17:34.897 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T05:17:34.898 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T05:17:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:17:37.294 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:37.294 INFO:teuthology.orchestra.run.smithi081.stdout:Upgraded: 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout:Installed: 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T05:17:37.295 INFO:teuthology.orchestra.run.smithi081.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-grafana-dashboards-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-immutable-object-cache-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.296 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.297 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T05:17:37.298 INFO:teuthology.orchestra.run.smithi081.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T05:17:37.299 INFO:teuthology.orchestra.run.smithi081.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: librados-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T05:17:37.300 INFO:teuthology.orchestra.run.smithi081.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T05:17:37.301 INFO:teuthology.orchestra.run.smithi081.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-argparse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T05:17:37.302 INFO:teuthology.orchestra.run.smithi081.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T05:17:37.303 INFO:teuthology.orchestra.run.smithi081.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T05:17:37.304 INFO:teuthology.orchestra.run.smithi081.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.305 INFO:teuthology.orchestra.run.smithi081.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T05:17:37.306 INFO:teuthology.orchestra.run.smithi081.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T05:17:37.307 INFO:teuthology.orchestra.run.smithi081.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T05:17:37.308 INFO:teuthology.orchestra.run.smithi081.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T05:17:37.308 INFO:teuthology.orchestra.run.smithi081.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T05:17:37.308 INFO:teuthology.orchestra.run.smithi081.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T05:17:37.308 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:37.308 INFO:teuthology.orchestra.run.smithi081.stdout:Complete! 2024-09-17T05:17:37.756 DEBUG:teuthology.parallel:result is None 2024-09-17T05:17:39.203 INFO:teuthology.orchestra.run.smithi160.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:17:39.203 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-2:19.3.0-4963.g820f760e.el9.x86_64 1/165 2024-09-17T05:17:39.203 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 3/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 4/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-4963.g820f7 5/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 6/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 7/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 8/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 9/165 2024-09-17T05:17:39.204 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 10/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 11/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 12/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 13/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 14/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_ 15/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 16/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 17/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados-devel-2:19.3.0-4963.g820f760e.el9.x86_6 18/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86 19/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 20/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-argparse-2:19.3.0-4963.g820f760e.el 21/165 2024-09-17T05:17:39.205 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ceph-common-2:19.3.0-4963.g820f760e.el9. 22/165 2024-09-17T05:17:39.206 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_6 23/165 2024-09-17T05:17:39.206 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 24/165 2024-09-17T05:17:39.206 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 25/165 2024-09-17T05:17:39.206 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 26/165 2024-09-17T05:17:39.206 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 27/165 2024-09-17T05:17:39.219 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 28/165 2024-09-17T05:17:39.219 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 29/165 2024-09-17T05:17:39.219 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-4963.g820f760e. 30/165 2024-09-17T05:17:39.219 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noa 31/165 2024-09-17T05:17:39.219 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.n 32/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-4963.g820 33/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el 34/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 35/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.e 36/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 37/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephadm-2:19.3.0-4963.g820f760e.el9.noarch 38/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 39/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/165 2024-09-17T05:17:39.220 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/165 2024-09-17T05:17:39.221 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 58/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 59/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 60/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 61/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 62/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 63/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 64/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 65/165 2024-09-17T05:17:39.222 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-5.4.4-4.el9.x86_64 66/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 67/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 68/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 69/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-13.16-1.el9.x86_64 70/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 71/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 72/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 73/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 74/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 75/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 76/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 77/165 2024-09-17T05:17:39.223 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 78/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 79/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 80/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 81/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 82/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 83/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 84/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 85/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 86/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 87/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 88/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 89/165 2024-09-17T05:17:39.224 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 90/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 91/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 92/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 93/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 94/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 95/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 96/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 97/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 98/165 2024-09-17T05:17:39.225 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 99/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 100/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 101/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 102/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 103/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 104/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 105/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 106/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 107/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 108/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 109/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 110/165 2024-09-17T05:17:39.226 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 111/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 112/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 113/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 114/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 115/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 116/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 117/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 118/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 119/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 120/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 121/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 122/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 123/165 2024-09-17T05:17:39.227 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 124/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 125/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 126/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 127/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 128/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 129/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 130/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 131/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 132/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 133/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 134/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 135/165 2024-09-17T05:17:39.228 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 136/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 137/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 138/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 139/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 140/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 141/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 142/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 143/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 144/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 145/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 146/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 147/165 2024-09-17T05:17:39.229 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : re2-1:20211101-20.el9.x86_64 148/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 149/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:19.3.0-4963.g820f760e.el9.x86_64 150/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 151/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 152/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 153/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 154/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 155/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 156/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 157/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 158/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 159/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 160/165 2024-09-17T05:17:39.230 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 161/165 2024-09-17T05:17:39.231 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 162/165 2024-09-17T05:17:39.231 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 163/165 2024-09-17T05:17:39.231 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 164/165 2024-09-17T05:17:42.133 INFO:teuthology.orchestra.run.smithi160.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 165/165 2024-09-17T05:17:42.133 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:42.133 INFO:teuthology.orchestra.run.smithi160.stdout:Upgraded: 2024-09-17T05:17:42.134 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:42.134 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:42.134 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:42.134 INFO:teuthology.orchestra.run.smithi160.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-17T05:17:42.134 INFO:teuthology.orchestra.run.smithi160.stdout: librados2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: librbd1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout:Installed: 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: automake-1.16.2-8.el9.noarch 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: bison-3.7.4-5.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-base-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.135 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-grafana-dashboards-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-immutable-object-cache-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mds-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-dashboard-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-diskprediction-local-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.136 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-modules-core-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mgr-rook-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-mon-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-osd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-prometheus-alerts-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-radosgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-selinux-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-test-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.137 INFO:teuthology.orchestra.run.smithi160.stdout: ceph-volume-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: cephadm-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-shell-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: cephfs-top-2:19.3.0-4963.g820f760e.el9.noarch 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: flex-2.6.4-9.el9.x86_64 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-17T05:17:42.138 INFO:teuthology.orchestra.run.smithi160.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: libcephfs2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: libcephsqlite-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.139 INFO:teuthology.orchestra.run.smithi160.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: librados-devel-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: libradosstriper1-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: librgw2-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-17T05:17:42.140 INFO:teuthology.orchestra.run.smithi160.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: lua-5.4.4-4.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-13.16-1.el9.x86_64 2024-09-17T05:17:42.141 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-17T05:17:42.142 INFO:teuthology.orchestra.run.smithi160.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-17T05:17:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-17T05:17:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-argparse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ceph-common-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cephfs-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-17T05:17:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-17T05:17:42.143 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-17T05:17:42.144 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-17T05:17:42.145 INFO:teuthology.orchestra.run.smithi160.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-ply-3.11-14.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-17T05:17:42.146 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rados-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rgw-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-17T05:17:42.147 INFO:teuthology.orchestra.run.smithi160.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-17T05:17:42.148 INFO:teuthology.orchestra.run.smithi160.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-fuse-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-mirror-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: rbd-nbd-2:19.3.0-4963.g820f760e.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: re2-1:20211101-20.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-17T05:17:42.149 INFO:teuthology.orchestra.run.smithi160.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-17T05:17:42.150 INFO:teuthology.orchestra.run.smithi160.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-17T05:17:42.150 INFO:teuthology.orchestra.run.smithi160.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-17T05:17:42.150 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:42.150 INFO:teuthology.orchestra.run.smithi160.stdout:Complete! 2024-09-17T05:17:42.561 DEBUG:teuthology.parallel:result is None 2024-09-17T05:17:42.562 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:17:42.708 DEBUG:teuthology.orchestra.run.smithi081:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T05:17:42.735 INFO:teuthology.orchestra.run.smithi081.stdout:19.3.0-4963.g820f760e.el9 2024-09-17T05:17:42.735 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4963.g820f760e.el9 2024-09-17T05:17:42.735 INFO:teuthology.task.install:The correct ceph version 19.3.0-4963.g820f760e is installed. 2024-09-17T05:17:42.737 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=820f760e4779dafd30d668ecea7aba6355dfd3d8 2024-09-17T05:17:42.877 DEBUG:teuthology.orchestra.run.smithi160:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-17T05:17:42.900 INFO:teuthology.orchestra.run.smithi160.stdout:19.3.0-4963.g820f760e.el9 2024-09-17T05:17:42.900 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-4963.g820f760e.el9 2024-09-17T05:17:42.900 INFO:teuthology.task.install:The correct ceph version 19.3.0-4963.g820f760e is installed. 2024-09-17T05:17:42.902 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-17T05:17:42.902 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:42.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:17:42.935 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:42.935 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-17T05:17:42.967 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-17T05:17:42.967 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:42.967 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:17:43.004 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:17:43.072 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:43.072 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/daemon-helper 2024-09-17T05:17:43.097 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-17T05:17:43.162 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-17T05:17:43.162 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:43.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:17:43.190 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:17:43.258 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:43.259 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-17T05:17:43.283 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-17T05:17:43.347 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-17T05:17:43.348 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:43.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:17:43.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:17:43.443 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:43.443 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/usr/bin/stdin-killer 2024-09-17T05:17:43.467 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-17T05:17:43.531 INFO:teuthology.run_tasks:Running task ceph... 2024-09-17T05:17:43.605 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-17T05:17:43.606 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 777 /var/log/ceph 2024-09-17T05:17:43.608 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 777 /var/log/ceph 2024-09-17T05:17:43.634 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-17T05:17:43.634 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:17:43.677 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-17T05:17:43.702 INFO:tasks.ceph:Creating extra log directories... 2024-09-17T05:17:43.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:17:43.745 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-17T05:17:43.775 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-09-17T05:17:43.775 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-09-17T05:17:43.776 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-09-17T05:17:43.776 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:43.776 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:17:43.827 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:17:43.936 DEBUG:teuthology.orchestra.run.smithi081:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T05:17:43.961 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:43.961 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-09-17T05:17:43.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-09-17T05:17:44.084 DEBUG:teuthology.orchestra.run.smithi160:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2024-09-17T05:17:44.114 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-17T05:17:44.114 INFO:tasks.ceph:config {'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-17T05:17:44.114 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686', 'branch': 'wip-athakkar-testing-2024-09-16-2351', 'description': 'fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}}', 'email': 'athakkar@redhat.com', 'first_in_suite': False, 'job_id': '7908686', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-athakkar-testing-2024-09-16-2351'}, 'ceph': {'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-athakkar-testing-2024-09-16-2351', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, 'owner': 'scheduled_avan@teuthology', 'priority': 80, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 448, 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'sleep_before_teardown': 0, 'subset': '1/20', 'suite': 'fs:volumes', 'suite_branch': 'wip-athakkar-testing-2024-09-16-2351', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_820f760e4779dafd30d668ecea7aba6355dfd3d8/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi081.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBFb4y+qAM8eq5g/TA7vdNT7AQMPpuCG60SjWujo+KkYDw7BYMwiV8UA/pg8nYeCFFDcFmwhyVhNt2b2TO0YDXso=', 'smithi160.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBHFloCkG+PemCaEje6Qwavc8nBExZmyOlu1QG9SEKoHvg+449g7oRotA7ZXN2kH20bOsaRY137UjKDufn63O0ZY='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8'}}, {'ceph': {'create_rbd_pool': False, 'cluster-conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 2, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon': {'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'osd op complaint time': 180}}, 'conf': {'client': {'pid file': ''}, 'mgr': {'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'fs.*is degraded', 'filesystem is degraded', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'filesystem is offline', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'insufficient standby MDS daemons available', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL'], 'sha1': '820f760e4779dafd30d668ecea7aba6355dfd3d8', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'fail_on_skip': False, 'modules': ['tasks.cephfs.test_volumes.TestMisc']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-17_05:02:16', 'tube': 'smithi', 'user': 'avan', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-17T05:17:44.115 DEBUG:teuthology.orchestra.run.smithi081:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:17:44.117 DEBUG:teuthology.orchestra.run.smithi160:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-17T05:17:44.164 DEBUG:teuthology.orchestra.run.smithi081:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:17:44.173 DEBUG:teuthology.orchestra.run.smithi160:> sudo install -d -m0777 -- /var/run/ceph 2024-09-17T05:17:44.229 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:44.229 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:17:44.252 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:17:44.252 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_1 2024-09-17T05:17:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:17:44.308 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:44.308 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-09-17T05:17:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-17 05:17:28.608989119 +0000 2024-09-17T05:17:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-17 05:15:35.295464652 +0000 2024-09-17T05:17:44.309 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-17 05:15:35.295464652 +0000 2024-09-17T05:17:44.309 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-17 05:15:35.295464652 +0000 2024-09-17T05:17:44.309 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:17:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:17:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:17:44.372 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000266656 s, 1.9 MB/s 2024-09-17T05:17:44.373 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:17:44.430 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_2 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-17 05:17:28.609989100 +0000 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-17 05:15:35.628458276 +0000 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-17 05:15:35.628458276 +0000 2024-09-17T05:17:44.486 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-17 05:15:35.628458276 +0000 2024-09-17T05:17:44.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:17:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:17:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:17:44.550 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000230029 s, 2.2 MB/s 2024-09-17T05:17:44.551 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:17:44.608 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_3 2024-09-17T05:17:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:17:44.663 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:44.663 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T05:17:44.663 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:44.663 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:44.663 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-17 05:17:28.609989100 +0000 2024-09-17T05:17:44.664 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-17 05:15:35.941452283 +0000 2024-09-17T05:17:44.664 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-17 05:15:35.941452283 +0000 2024-09-17T05:17:44.664 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-17 05:15:35.941452283 +0000 2024-09-17T05:17:44.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:17:44.727 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:17:44.727 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:17:44.727 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000224905 s, 2.3 MB/s 2024-09-17T05:17:44.728 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:17:44.785 DEBUG:teuthology.orchestra.run.smithi081:> stat /dev/vg_nvme/lv_4 2024-09-17T05:17:44.839 INFO:teuthology.orchestra.run.smithi081.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout:Access: 2024-09-17 05:17:28.609989100 +0000 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout:Modify: 2024-09-17 05:15:36.260446174 +0000 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout:Change: 2024-09-17 05:15:36.260446174 +0000 2024-09-17T05:17:44.840 INFO:teuthology.orchestra.run.smithi081.stdout: Birth: 2024-09-17 05:15:36.260446174 +0000 2024-09-17T05:17:44.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:17:44.903 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:17:44.903 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:17:44.903 INFO:teuthology.orchestra.run.smithi081.stderr:512 bytes copied, 0.000188706 s, 2.7 MB/s 2024-09-17T05:17:44.904 DEBUG:teuthology.orchestra.run.smithi081:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:17:44.960 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:17:44.960 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:44.960 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/scratch_devs of=/dev/stdout 2024-09-17T05:17:44.977 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-17T05:17:44.977 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_1 2024-09-17T05:17:45.033 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-17T05:17:45.033 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:45.033 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-17T05:17:45.033 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:45.034 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:45.034 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-17 05:17:33.616507702 +0000 2024-09-17T05:17:45.034 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-17 05:15:35.252069620 +0000 2024-09-17T05:17:45.034 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-17 05:15:35.252069620 +0000 2024-09-17T05:17:45.034 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-17 05:15:35.252069620 +0000 2024-09-17T05:17:45.034 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-17T05:17:45.098 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-17T05:17:45.098 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-17T05:17:45.098 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000210084 s, 2.4 MB/s 2024-09-17T05:17:45.099 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-17T05:17:45.156 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_2 2024-09-17T05:17:45.212 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-17T05:17:45.212 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:45.212 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-17T05:17:45.212 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:45.212 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:45.212 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-17 05:17:33.617507687 +0000 2024-09-17T05:17:45.212 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-17 05:15:35.589064552 +0000 2024-09-17T05:17:45.213 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-17 05:15:35.589064552 +0000 2024-09-17T05:17:45.213 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-17 05:15:35.589064552 +0000 2024-09-17T05:17:45.213 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-17T05:17:45.276 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-17T05:17:45.276 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-17T05:17:45.276 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.00021045 s, 2.4 MB/s 2024-09-17T05:17:45.277 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-17T05:17:45.333 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_3 2024-09-17T05:17:45.389 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-17T05:17:45.389 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:45.389 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-17T05:17:45.389 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:45.390 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:45.390 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-17 05:17:33.617507687 +0000 2024-09-17T05:17:45.390 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-17 05:15:35.912059694 +0000 2024-09-17T05:17:45.390 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-17 05:15:35.912059694 +0000 2024-09-17T05:17:45.390 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-17 05:15:35.912059694 +0000 2024-09-17T05:17:45.390 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-17T05:17:45.452 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-17T05:17:45.452 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-17T05:17:45.452 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000253411 s, 2.0 MB/s 2024-09-17T05:17:45.454 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-17T05:17:45.510 DEBUG:teuthology.orchestra.run.smithi160:> stat /dev/vg_nvme/lv_4 2024-09-17T05:17:45.565 INFO:teuthology.orchestra.run.smithi160.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout:Context: system_u:object_r:device_t:s0 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout:Access: 2024-09-17 05:17:33.618507672 +0000 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout:Modify: 2024-09-17 05:15:36.242054732 +0000 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout:Change: 2024-09-17 05:15:36.242054732 +0000 2024-09-17T05:17:45.566 INFO:teuthology.orchestra.run.smithi160.stdout: Birth: 2024-09-17 05:15:36.242054732 +0000 2024-09-17T05:17:45.566 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-17T05:17:45.629 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records in 2024-09-17T05:17:45.629 INFO:teuthology.orchestra.run.smithi160.stderr:1+0 records out 2024-09-17T05:17:45.629 INFO:teuthology.orchestra.run.smithi160.stderr:512 bytes copied, 0.000201398 s, 2.5 MB/s 2024-09-17T05:17:45.630 DEBUG:teuthology.orchestra.run.smithi160:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-17T05:17:45.686 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:17:45.686 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:17:45.686 INFO:tasks.ceph:Generating config... 2024-09-17T05:17:45.687 INFO:tasks.ceph:[client] pid file = 2024-09-17T05:17:45.687 INFO:tasks.ceph:[mgr] client mount timeout = 30 2024-09-17T05:17:45.687 INFO:tasks.ceph:[mgr] debug client = 20 2024-09-17T05:17:45.687 INFO:tasks.ceph:[mgr] debug finisher = 20 2024-09-17T05:17:45.687 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-17T05:17:45.687 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-17T05:17:45.688 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-17T05:17:45.688 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-17T05:17:45.688 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-17T05:17:45.688 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-17T05:17:45.688 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-17T05:17:45.689 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-17T05:17:45.689 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-17T05:17:45.689 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-17T05:17:45.689 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-17T05:17:45.689 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-17T05:17:45.689 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-17T05:17:45.689 INFO:tasks.ceph:Setting up mon.a... 2024-09-17T05:17:45.689 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-17T05:17:45.740 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.keyring 2024-09-17T05:17:45.742 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-17T05:17:45.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:17:45.852 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.81'), ('mon.b', '172.21.15.160'), ('mon.c', '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]')] 2024-09-17T05:17:45.852 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.81,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'client mount timeout': 30, 'debug client': 20, 'debug finisher': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'pid file': ''}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}} 2024-09-17T05:17:45.853 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:45.853 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:17:45.907 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.81 --add b 172.21.15.160 --addv c '[v2:172.21.15.160:3301,v1:172.21.15.160:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: generated fsid c4ef6ecb-6242-426c-8fbd-acb002cef223 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:setting min_mon_release = quincy 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:epoch 0 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:fsid c4ef6ecb-6242-426c-8fbd-acb002cef223 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:last_changed 2024-09-17T05:17:45.995433+0000 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:created 2024-09-17T05:17:45.995433+0000 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:min_mon_release 17 (quincy) 2024-09-17T05:17:45.995 INFO:teuthology.orchestra.run.smithi081.stdout:election_strategy: 1 2024-09-17T05:17:45.996 INFO:teuthology.orchestra.run.smithi081.stdout:0: [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] mon.a 2024-09-17T05:17:45.996 INFO:teuthology.orchestra.run.smithi081.stdout:1: [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] mon.b 2024-09-17T05:17:45.996 INFO:teuthology.orchestra.run.smithi081.stdout:2: [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] mon.c 2024-09-17T05:17:45.996 INFO:teuthology.orchestra.run.smithi081.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-09-17T05:17:45.997 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-17T05:17:46.011 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID c4ef6ecb-6242-426c-8fbd-acb002cef223... 2024-09-17T05:17:46.012 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:17:46.054 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-17T05:17:46.093 INFO:teuthology.orchestra.run.smithi081.stdout:[global] 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: chdir = "" 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: auth supported = cephx 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: filestore xattr use omap = true 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: mon clock drift allowed = 1.000 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: osd crush chooseleaf type = 0 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: auth debug = true 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.094 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on old message = true 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: ms die on bug = true 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: mon pg warn max object skew = 0 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default size = 2 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow primary affinity = true 2024-09-17T05:17:46.095 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd allow pg remap = true 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on no sortbitwise = false 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon warn on too few osds = false 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: mon_allow_pool_size_one = true 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:17:46.096 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: osd default data pool replay window = 5 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: mon allow pool delete = true 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: mon cluster log file level = debug 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: debug asserts on shutdown = true 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: mon health detail to clog = false 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: mon host = "172.21.15.81,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: fsid = c4ef6ecb-6242-426c-8fbd-acb002cef223 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout:[osd] 2024-09-17T05:17:46.097 INFO:teuthology.orchestra.run.smithi081.stdout: osd journal size = 100 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub load threshold = 5.0 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd scrub max interval = 600 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd recover clone overlap = true 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd recovery max chunk = 1048576 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug shutdown = true 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug op order = true 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug verify stray on activate = true 2024-09-17T05:17:46.098 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug trim objects = true 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: osd open classes on start = true 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug pg log writeout = true 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: osd map max advance = 10 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: journal zero on create = true 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: filestore apply finisher threads = 3 2024-09-17T05:17:46.099 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: bdev debug aio = true 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: osd debug misdirected ops = true 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: bdev async discard = True 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: bdev enable discard = True 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore allocator = bitmap 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore block size = 96636764160 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: bluestore fsck on mount = True 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluefs = 1/20 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: debug bluestore = 1/20 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-17T05:17:46.100 INFO:teuthology.orchestra.run.smithi081.stdout: debug osd = 20 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: debug rocksdb = 4/10 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd full ratio = 0.9 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: osd objectstore = bluestore 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr] 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: debug mgr = 20 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-17T05:17:46.101 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: mgr/telemetry/nag = false 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: client mount timeout = 30 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: debug client = 20 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: debug finisher = 20 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout:[mon] 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: debug ms = 1 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: debug mon = 20 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: debug paxos = 20 2024-09-17T05:17:46.102 INFO:teuthology.orchestra.run.smithi081.stdout: debug auth = 20 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: mon data avail warn = 5 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: mon mgr mkfs grace = 240 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd reporter subtree level = osd 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: mon osd prime pg temp = true 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.103 INFO:teuthology.orchestra.run.smithi081.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: # 1m isn't quite enough 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: mon down mkfs grace = 300 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout:[client] 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: rgw cache enabled = true 2024-09-17T05:17:46.104 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable ops log = true 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: rgw enable usage log = true 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout: pid file = "" 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.a] 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.b] 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:[mon.c] 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-17T05:17:46.105 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-17T05:17:46.106 INFO:teuthology.orchestra.run.smithi160.stdout:[global] 2024-09-17T05:17:46.106 INFO:teuthology.orchestra.run.smithi160.stdout: chdir = "" 2024-09-17T05:17:46.106 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-17T05:17:46.106 INFO:teuthology.orchestra.run.smithi160.stdout: auth supported = cephx 2024-09-17T05:17:46.106 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.106 INFO:teuthology.orchestra.run.smithi160.stdout: filestore xattr use omap = true 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: mon clock drift allowed = 1.000 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: osd crush chooseleaf type = 0 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: auth debug = true 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on old message = true 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: ms die on bug = true 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: mon pg warn max object skew = 0 2024-09-17T05:17:46.107 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: # disable pg_autoscaler by default for new pools 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default size = 2 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow primary affinity = true 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd allow pg remap = true 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on legacy crush tunables = false 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on crush straw calc version zero = false 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on no sortbitwise = false 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on osd down out interval zero = false 2024-09-17T05:17:46.108 INFO:teuthology.orchestra.run.smithi160.stdout: mon warn on too few osds = false 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: mon_allow_pool_size_one = true 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: osd default data pool replay window = 5 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: mon allow pool delete = true 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: mon cluster log file level = debug 2024-09-17T05:17:46.109 INFO:teuthology.orchestra.run.smithi160.stdout: debug asserts on shutdown = true 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: mon health detail to clog = false 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: mon host = "172.21.15.81,172.21.15.160,[v2:172.21.15.160:3301,v1:172.21.15.160:6790]" 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: fsid = c4ef6ecb-6242-426c-8fbd-acb002cef223 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout:[osd] 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: osd journal size = 100 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub load threshold = 5.0 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: osd scrub max interval = 600 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: osd mclock profile = high_recovery_ops 2024-09-17T05:17:46.110 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd recover clone overlap = true 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd recovery max chunk = 1048576 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug shutdown = true 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug op order = true 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug verify stray on activate = true 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug trim objects = true 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd open classes on start = true 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug pg log writeout = true 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: osd deep scrub update digest min age = 30 2024-09-17T05:17:46.111 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: osd map max advance = 10 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: journal zero on create = true 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: filestore ondisk finisher threads = 3 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: filestore apply finisher threads = 3 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: bdev debug aio = true 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: osd debug misdirected ops = true 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: bdev async discard = True 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: bdev enable discard = True 2024-09-17T05:17:46.112 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore allocator = bitmap 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore block size = 96636764160 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: bluestore fsck on mount = True 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluefs = 1/20 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: debug bluestore = 1/20 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: debug osd = 20 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: debug rocksdb = 4/10 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd backfillfull_ratio = 0.85 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd full ratio = 0.9 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd nearfull ratio = 0.8 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: osd failsafe full ratio = 0.95 2024-09-17T05:17:46.113 INFO:teuthology.orchestra.run.smithi160.stdout: osd objectstore = bluestore 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr] 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: debug mgr = 20 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: mgr/telemetry/nag = false 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: client mount timeout = 30 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: debug client = 20 2024-09-17T05:17:46.114 INFO:teuthology.orchestra.run.smithi160.stdout: debug finisher = 20 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout:[mon] 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: debug ms = 1 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: debug mon = 20 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: debug paxos = 20 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: debug auth = 20 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: mon data avail warn = 5 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: mon mgr mkfs grace = 240 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min pgs per osd = 4 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd reporter subtree level = osd 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: mon osd prime pg temp = true 2024-09-17T05:17:46.115 INFO:teuthology.orchestra.run.smithi160.stdout: mon reweight min bytes per osd = 10 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: auth mon ticket ttl = 660 # 11m 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: auth service ticket ttl = 240 # 4m 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: # don't complain about insecure global_id in the test suite 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: # 1m isn't quite enough 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: mon_down_mkfs_grace = 2m 2024-09-17T05:17:46.116 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: mon_warn_on_filestore_osds = false 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: mon down mkfs grace = 300 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout:[client] 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: rgw cache enabled = true 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable ops log = true 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: rgw enable usage log = true 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout: pid file = "" 2024-09-17T05:17:46.117 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.a] 2024-09-17T05:17:46.118 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.b] 2024-09-17T05:17:46.118 INFO:teuthology.orchestra.run.smithi160.stdout:[mon.c] 2024-09-17T05:17:46.118 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-09-17T05:17:46.118 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2024-09-17T05:17:46.118 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-09-17T05:17:46.118 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2024-09-17T05:17:46.119 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-17T05:17:46.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-17T05:17:46.214 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-17T05:17:46.214 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:46.214 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-17T05:17:46.229 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:46.229 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-17T05:17:46.285 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:17:46.285 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:46.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:17:46.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:17:46.358 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:17:46.359 DEBUG:teuthology.orchestra.run.smithi081:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:17:46.414 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:17:46.414 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:46.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-17T05:17:46.414 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-17T05:17:46.448 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:17:46.449 DEBUG:teuthology.orchestra.run.smithi160:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:17:46.504 INFO:tasks.ceph:Setting up mon nodes... 2024-09-17T05:17:46.505 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-17T05:17:46.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:17:46.555 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-09-17T05:17:46.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:17:46.629 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-17T05:17:46.632 INFO:tasks.ceph:Setting up mds nodes... 2024-09-17T05:17:46.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:17:46.683 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-09-17T05:17:46.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-09-17T05:17:46.710 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:17:46.801 INFO:teuthology.orchestra.run.smithi081.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-09-17T05:17:46.803 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-09-17T05:17:46.828 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:17:46.879 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-09-17T05:17:46.882 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-09-17T05:17:46.907 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:17:46.998 INFO:teuthology.orchestra.run.smithi160.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-09-17T05:17:47.001 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-09-17T05:17:47.025 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-17T05:17:47.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-17T05:17:47.066 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-17T05:17:47.078 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2024-09-17T05:17:47.159 INFO:teuthology.orchestra.run.smithi081.stdout:creating /etc/ceph/ceph.client.2.keyring 2024-09-17T05:17:47.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-09-17T05:17:47.213 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-09-17T05:17:47.226 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2024-09-17T05:17:47.306 INFO:teuthology.orchestra.run.smithi160.stdout:creating /etc/ceph/ceph.client.3.keyring 2024-09-17T05:17:47.319 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-17T05:17:47.319 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi081.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi160.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-09-17T05:17:47.319 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-17T05:17:47.344 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:17:47.344 INFO:tasks.ceph:role: osd.0 2024-09-17T05:17:47.344 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:17:47.344 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:17:47.416 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:17:47.417 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:17:47.935 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-17T05:17:47.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-17T05:17:47.938 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-17T05:17:48.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-17T05:17:48.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-17T05:17:48.161 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:17:48.162 INFO:tasks.ceph:role: osd.1 2024-09-17T05:17:48.162 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:17:48.162 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:17:48.233 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:17:48.233 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:17:48.233 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:17:48.233 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:17:48.233 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:17:48.233 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:17:48.233 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:17:48.234 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:17:48.234 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:17:48.234 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:17:48.688 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-17T05:17:48.690 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-17T05:17:48.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-09-17T05:17:48.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-17T05:17:48.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-17T05:17:48.877 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:17:48.878 INFO:tasks.ceph:role: osd.2 2024-09-17T05:17:48.878 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:17:48.878 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:17:48.950 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:17:48.950 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:17:48.950 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:17:48.950 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:17:48.950 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:17:48.950 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:17:48.951 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:17:48.951 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:17:48.951 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:17:48.951 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:17:49.433 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-17T05:17:49.435 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-17T05:17:49.436 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-09-17T05:17:49.572 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-17T05:17:49.602 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-17T05:17:49.667 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-09-17T05:17:49.667 INFO:tasks.ceph:role: osd.3 2024-09-17T05:17:49.667 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:17:49.667 DEBUG:teuthology.orchestra.run.smithi081:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:17:49.740 INFO:teuthology.orchestra.run.smithi081.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:17:49.741 INFO:teuthology.orchestra.run.smithi081.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:17:49.741 INFO:teuthology.orchestra.run.smithi081.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:17:50.244 INFO:teuthology.orchestra.run.smithi081.stdout:Discarding blocks...Done. 2024-09-17T05:17:50.246 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi081.front.sepia.ceph.com -o noatime 2024-09-17T05:17:50.247 DEBUG:teuthology.orchestra.run.smithi081:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-09-17T05:17:50.370 DEBUG:teuthology.orchestra.run.smithi081:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-17T05:17:50.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:17:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:50.493+0000 7fe1abe64640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-17T05:17:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:50.493+0000 7fe1abe64640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-17T05:17:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:50.493+0000 7fe1abe64640 -1 bdev(0x55f3918e1800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-17T05:17:50.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:50.493+0000 7fe1abe64640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-17T05:17:53.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-17T05:17:53.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:17:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:53.521+0000 7f4469e14640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-17T05:17:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:53.521+0000 7f4469e14640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-17T05:17:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:53.521+0000 7f4469e14640 -1 bdev(0x55ca47b9b800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-17T05:17:53.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:53.522+0000 7f4469e14640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-17T05:17:57.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-17T05:17:57.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:17:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:57.300+0000 7fe26b89c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-17T05:17:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:57.301+0000 7fe26b89c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-17T05:17:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:57.301+0000 7fe26b89c640 -1 bdev(0x5596f979f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-17T05:17:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:17:57.301+0000 7fe26b89c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-17T05:18:00.456 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-17T05:18:00.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:18:00.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:00.568+0000 7ffadb72c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-17T05:18:00.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:00.568+0000 7ffadb72c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-17T05:18:00.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:00.568+0000 7ffadb72c640 -1 bdev(0x55e0bac21800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-17T05:18:00.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:00.569+0000 7ffadb72c640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-17T05:18:03.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-17T05:18:03.761 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-09-17T05:18:03.792 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:18:03.792 INFO:tasks.ceph:role: osd.4 2024-09-17T05:18:03.792 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:18:03.792 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-17T05:18:03.869 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:18:03.869 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:18:03.869 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:18:03.869 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:18:03.869 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:18:03.870 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:18:03.870 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:18:03.870 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:18:03.870 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:18:03.870 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:18:04.402 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-17T05:18:04.404 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-17T05:18:04.405 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-09-17T05:18:04.551 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-09-17T05:18:04.586 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-09-17T05:18:04.655 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:18:04.655 INFO:tasks.ceph:role: osd.5 2024-09-17T05:18:04.655 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:18:04.656 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-17T05:18:04.729 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:18:04.729 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:18:04.729 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:18:04.730 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:18:04.730 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:18:04.730 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:18:04.730 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:18:04.730 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:18:04.730 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:18:04.730 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:18:05.175 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-17T05:18:05.178 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-17T05:18:05.179 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-09-17T05:18:05.274 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-09-17T05:18:05.308 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-09-17T05:18:05.376 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:18:05.376 INFO:tasks.ceph:role: osd.6 2024-09-17T05:18:05.376 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:18:05.376 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-17T05:18:05.449 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:18:05.450 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:18:05.935 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-17T05:18:05.937 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-17T05:18:05.938 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-09-17T05:18:06.085 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-09-17T05:18:06.120 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-09-17T05:18:06.186 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-09-17T05:18:06.186 INFO:tasks.ceph:role: osd.7 2024-09-17T05:18:06.186 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:18:06.186 DEBUG:teuthology.orchestra.run.smithi160:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-09-17T05:18:06.259 INFO:teuthology.orchestra.run.smithi160.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout: = sunit=0 swidth=0 blks 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-17T05:18:06.260 INFO:teuthology.orchestra.run.smithi160.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-17T05:18:06.778 INFO:teuthology.orchestra.run.smithi160.stdout:Discarding blocks...Done. 2024-09-17T05:18:06.780 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi160.front.sepia.ceph.com -o noatime 2024-09-17T05:18:06.780 DEBUG:teuthology.orchestra.run.smithi160:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-09-17T05:18:06.915 DEBUG:teuthology.orchestra.run.smithi160:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-09-17T05:18:06.948 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:18:07.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:07.050+0000 7f9af4354640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-09-17T05:18:07.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:07.050+0000 7f9af4354640 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-09-17T05:18:07.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:07.050+0000 7f9af4354640 -1 bdev(0x561baa4f5800 /var/lib/ceph/osd/ceph-4/block) open stat got: (1) Operation not permitted 2024-09-17T05:18:07.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:07.050+0000 7f9af4354640 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-09-17T05:18:10.202 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-09-17T05:18:10.229 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:18:10.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:10.314+0000 7ff37c424640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-09-17T05:18:10.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:10.314+0000 7ff37c424640 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-09-17T05:18:10.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:10.314+0000 7ff37c424640 -1 bdev(0x55f674b27800 /var/lib/ceph/osd/ceph-5/block) open stat got: (1) Operation not permitted 2024-09-17T05:18:10.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:10.314+0000 7ff37c424640 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-09-17T05:18:13.470 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-09-17T05:18:13.498 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:18:13.587 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:13.585+0000 7f16c2d27640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-09-17T05:18:13.587 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:13.586+0000 7f16c2d27640 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-09-17T05:18:13.588 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:13.586+0000 7f16c2d27640 -1 bdev(0x557410cfb800 /var/lib/ceph/osd/ceph-6/block) open stat got: (1) Operation not permitted 2024-09-17T05:18:13.588 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:13.586+0000 7f16c2d27640 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-09-17T05:18:14.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:18:14.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:18:16.752 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-09-17T05:18:16.781 DEBUG:teuthology.orchestra.run.smithi160:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:18:16.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:16.870+0000 7fa37900f640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-09-17T05:18:16.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:16.871+0000 7fa37900f640 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-09-17T05:18:16.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:16.871+0000 7fa37900f640 -1 bdev(0x559cac50b800 /var/lib/ceph/osd/ceph-7/block) open stat got: (1) Operation not permitted 2024-09-17T05:18:16.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:16.871+0000 7fa37900f640 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-09-17T05:18:20.038 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-09-17T05:18:20.067 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-17T05:18:20.068 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.068 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-09-17T05:18:20.097 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-09-17T05:18:20.167 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-09-17T05:18:20.234 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.235 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-17T05:18:20.302 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-17T05:18:20.369 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-17T05:18:20.435 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.435 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-17T05:18:20.502 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:20.502 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-17T05:18:20.532 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:20.532 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-09-17T05:18:20.601 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:20.601 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-09-17T05:18:20.668 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:20.669 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-09-17T05:18:20.735 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:20.735 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-09-17T05:18:20.801 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:20.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-09-17T05:18:20.867 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:20.867 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-09-17T05:18:20.933 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.933 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-17T05:18:20.949 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:20.949 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2024-09-17T05:18:21.006 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:21.006 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-09-17T05:18:21.021 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:21.022 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2024-09-17T05:18:21.077 INFO:tasks.ceph:Adding keys to all mons... 2024-09-17T05:18:21.077 DEBUG:teuthology.orchestra.run.smithi081:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:18:21.080 DEBUG:teuthology.orchestra.run.smithi160:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-17T05:18:21.120 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.y] 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q== 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.a] 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw== 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.c] 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ== 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.0] 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A== 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.1] 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw== 2024-09-17T05:18:21.121 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.2] 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw== 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.3] 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA== 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout:[mgr.x] 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ== 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.b] 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg== 2024-09-17T05:18:21.122 INFO:teuthology.orchestra.run.smithi081.stdout:[mds.d] 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA== 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.4] 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ== 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.5] 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ== 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.6] 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg== 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:[osd.7] 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ== 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:18:21.123 INFO:teuthology.orchestra.run.smithi081.stdout:[client.2] 2024-09-17T05:18:21.124 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg== 2024-09-17T05:18:21.124 INFO:teuthology.orchestra.run.smithi081.stdout:[client.1] 2024-09-17T05:18:21.124 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA== 2024-09-17T05:18:21.124 INFO:teuthology.orchestra.run.smithi081.stdout:[client.3] 2024-09-17T05:18:21.124 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA== 2024-09-17T05:18:21.140 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.y] 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q== 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.a] 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw== 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.c] 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ== 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.0] 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A== 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.1] 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw== 2024-09-17T05:18:21.141 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.2] 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw== 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.3] 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA== 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout:[mgr.x] 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ== 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.b] 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg== 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout:[mds.d] 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA== 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.4] 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ== 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.5] 2024-09-17T05:18:21.142 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ== 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.6] 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg== 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout:[osd.7] 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ== 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout:[client.0] 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout:[client.2] 2024-09-17T05:18:21.143 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg== 2024-09-17T05:18:21.144 INFO:teuthology.orchestra.run.smithi160.stdout:[client.1] 2024-09-17T05:18:21.144 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA== 2024-09-17T05:18:21.144 INFO:teuthology.orchestra.run.smithi160.stdout:[client.3] 2024-09-17T05:18:21.144 INFO:teuthology.orchestra.run.smithi160.stdout: key = AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA== 2024-09-17T05:18:21.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:18:21.168 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:18:21.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.239 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.296 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.353 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.406 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.457 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.460 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.511 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.514 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:18:21.567 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-17T05:18:21.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.620 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.675 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.677 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-09-17T05:18:21.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.733 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.787 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.838 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.840 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.892 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.894 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-17T05:18:21.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:21.949 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:22.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:22.005 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:22.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:22.061 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:22.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:22.118 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-17T05:18:22.172 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-17T05:18:22.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-17T05:18:22.196 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:18:22.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-17T05:18:22.317 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-09-17T05:18:22.343 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:18:22.439 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-09-17T05:18:22.464 DEBUG:teuthology.orchestra.run.smithi160:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-09-17T05:18:22.529 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-17T05:18:22.627 DEBUG:teuthology.orchestra.run.smithi160:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-09-17T05:18:22.652 DEBUG:teuthology.orchestra.run.smithi081:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:18:22.654 DEBUG:teuthology.orchestra.run.smithi160:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-17T05:18:22.707 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-17T05:18:22.708 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-17T05:18:22.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-17T05:18:22.710 INFO:tasks.ceph.mon.a:Started 2024-09-17T05:18:22.711 INFO:tasks.ceph.mon.b:Restarting daemon 2024-09-17T05:18:22.711 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-09-17T05:18:22.749 INFO:tasks.ceph.mon.b:Started 2024-09-17T05:18:22.750 INFO:tasks.ceph.mon.c:Restarting daemon 2024-09-17T05:18:22.750 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-09-17T05:18:22.752 INFO:tasks.ceph.mon.c:Started 2024-09-17T05:18:22.752 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-17T05:18:22.752 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-09-17T05:18:22.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-09-17T05:18:22.755 INFO:tasks.ceph.mgr.y:Started 2024-09-17T05:18:22.755 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-17T05:18:22.755 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-17T05:18:22.759 INFO:tasks.ceph.mgr.x:Started 2024-09-17T05:18:22.759 INFO:tasks.ceph:setting config [client] client_mount_timeout = 600 2024-09-17T05:18:22.759 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client client_mount_timeout 600 2024-09-17T05:18:22.761 INFO:tasks.ceph:setting config [client] debug_client = 20 2024-09-17T05:18:22.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_client 20 2024-09-17T05:18:22.804 INFO:tasks.ceph:setting config [client] debug_ms = 1 2024-09-17T05:18:22.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client debug_ms 1 2024-09-17T05:18:22.847 INFO:tasks.ceph:setting config [client] rados_mon_op_timeout = 900 2024-09-17T05:18:22.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_mon_op_timeout 900 2024-09-17T05:18:22.890 INFO:tasks.ceph:setting config [client] rados_osd_op_timeout = 900 2024-09-17T05:18:22.891 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set client rados_osd_op_timeout 900 2024-09-17T05:18:22.933 INFO:tasks.ceph:setting config [mds] debug_mds = 20 2024-09-17T05:18:22.933 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds 20 2024-09-17T05:18:22.976 INFO:tasks.ceph:setting config [mds] debug_mds_balancer = 20 2024-09-17T05:18:22.977 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_mds_balancer 20 2024-09-17T05:18:23.020 INFO:tasks.ceph:setting config [mds] debug_ms = 2 2024-09-17T05:18:23.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds debug_ms 2 2024-09-17T05:18:23.065 INFO:tasks.ceph:setting config [mds] mds_debug_frag = True 2024-09-17T05:18:23.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_frag True 2024-09-17T05:18:23.110 INFO:tasks.ceph:setting config [mds] mds_debug_scatterstat = True 2024-09-17T05:18:23.110 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_debug_scatterstat True 2024-09-17T05:18:23.161 INFO:tasks.ceph:setting config [mds] mds_op_complaint_time = 180 2024-09-17T05:18:23.162 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_op_complaint_time 180 2024-09-17T05:18:23.182 INFO:tasks.ceph:setting config [mds] mds_verify_scatter = True 2024-09-17T05:18:23.182 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds mds_verify_scatter True 2024-09-17T05:18:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.201+0000 7f38ed7fa640 1 -- 172.21.15.81:0/799796517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390814b960 msgr2=0x7f390814df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.201+0000 7f38ed7fa640 1 --2- 172.21.15.81:0/799796517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390814b960 0x7f390814df30 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f38fc005fd0 tx=0x7f38fc003d20 comp rx=0 tx=0).stop 2024-09-17T05:18:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.201+0000 7f38ed7fa640 1 -- 172.21.15.81:0/799796517 shutdown_connections 2024-09-17T05:18:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.201+0000 7f38ed7fa640 1 --2- 172.21.15.81:0/799796517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39081e5360 0x7f39081e57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.201+0000 7f38ed7fa640 1 --2- 172.21.15.81:0/799796517 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f390814b960 0x7f390814df30 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.201+0000 7f38ed7fa640 1 --2- 172.21.15.81:0/799796517 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38f0003c30 0x7f390814b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.201+0000 7f38ed7fa640 1 -- 172.21.15.81:0/799796517 >> 172.21.15.81:0/799796517 conn(0x7f39080d0be0 msgr2=0x7f39080c70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.204 INFO:tasks.ceph:setting config [mds] osd_op_complaint_time = 180 2024-09-17T05:18:23.204 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds osd_op_complaint_time 180 2024-09-17T05:18:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.203+0000 7f38ed7fa640 1 -- 172.21.15.81:0/799796517 shutdown_connections 2024-09-17T05:18:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.203+0000 7f38ed7fa640 1 -- 172.21.15.81:0/799796517 wait complete. 2024-09-17T05:18:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.203+0000 7f7c59940640 1 -- 172.21.15.81:0/3745404639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 msgr2=0x7f7c4400c890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.203+0000 7f7c59940640 1 --2- 172.21.15.81:0/3745404639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 0x7f7c4400c890 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f7c48005fd0 tx=0x7f7c44003810 comp rx=0 tx=0).stop 2024-09-17T05:18:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.203+0000 7f7c59940640 1 -- 172.21.15.81:0/3745404639 shutdown_connections 2024-09-17T05:18:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.203+0000 7f7c59940640 1 --2- 172.21.15.81:0/3745404639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 0x7f7c4400c890 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.203+0000 7f7c59940640 1 -- 172.21.15.81:0/3745404639 >> 172.21.15.81:0/3745404639 conn(0x7f7c4c054560 msgr2=0x7f7c4c054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.205+0000 7f7c59940640 1 -- 172.21.15.81:0/3745404639 shutdown_connections 2024-09-17T05:18:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.211+0000 7f7c59940640 1 -- 172.21.15.81:0/3745404639 wait complete. 2024-09-17T05:18:23.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.212+0000 7f7c59940640 1 Processor -- start 2024-09-17T05:18:23.216 INFO:tasks.ceph:setting config [mds] rados_mon_op_timeout = 900 2024-09-17T05:18:23.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_mon_op_timeout 900 2024-09-17T05:18:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.213+0000 7f7c59940640 1 -- start start 2024-09-17T05:18:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.213+0000 7f7d03c47640 1 -- 172.21.15.81:0/2033330774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=client_mount_timeout}] v 0) -- 0x7f7cd8005310 con 0x7f7cfc0d2030 2024-09-17T05:18:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.215+0000 7f7c59940640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 0x7f7c4c185950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.215+0000 7f7c59940640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c4c006f50 0x7f7c4c1894a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.215+0000 7f7c59940640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c4c0538f0 0x7f7c4c1899e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.215+0000 7f7c59940640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c035fe0 con 0x7f7c4400a3d0 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.215+0000 7f7c59940640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c4c01d380 con 0x7f7c4c006f50 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.215+0000 7f7c59940640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7c4c036160 con 0x7f7c4c0538f0 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.215+0000 7f7c5913f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c4c0538f0 0x7f7c4c1899e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c5913f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c4c0538f0 0x7f7c4c1899e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:53250/0 (socket says 172.21.15.81:53250) 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c5913f640 1 -- 172.21.15.81:0/3630769012 learned_addr learned my addr 172.21.15.81:0/3630769012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c53fff640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c4c006f50 0x7f7c4c1894a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c5913f640 1 -- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c4c006f50 msgr2=0x7f7c4c1894a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c5913f640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c4c006f50 0x7f7c4c1894a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c5913f640 1 -- 172.21.15.81:0/3630769012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 msgr2=0x7f7c4c185950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c5893e640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 0x7f7c4c185950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.216+0000 7f7c5913f640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 0x7f7c4c185950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.217+0000 7f7c5913f640 1 -- 172.21.15.81:0/3630769012 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c4c16b0e0 con 0x7f7c4c0538f0 2024-09-17T05:18:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.217+0000 7f7c5893e640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 0x7f7c4c185950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.217+0000 7f7c5913f640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c4c0538f0 0x7f7c4c1899e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009cd0 tx=0x7f7c48034b40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.223 INFO:tasks.ceph:setting config [mds] rados_osd_op_timeout = 900 2024-09-17T05:18:23.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mds rados_osd_op_timeout 900 2024-09-17T05:18:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.220+0000 7f7cf27fc640 1 -- 172.21.15.81:0/2033330774 <== mon.0 v2:172.21.15.81:3300/0 10 ==== mon_command_ack([{prefix=config set, name=client_mount_timeout}]=0 v5)=0 v5) ==== 123+0+0 (secure 0 0 0) 0x7f7cec004b20 con 0x7f7cfc0d2030 2024-09-17T05:18:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.220+0000 7f7cf27fc640 1 -- 172.21.15.81:0/2033330774 <== mon.0 v2:172.21.15.81:3300/0 11 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7cec010890 con 0x7f7cfc0d2030 2024-09-17T05:18:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.221+0000 7f5980ff9640 1 -- 172.21.15.81:0/36338147 <== mon.0 v2:172.21.15.81:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f597c004420 con 0x7f59841529b0 2024-09-17T05:18:23.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.221+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c48038040 con 0x7f7c4c0538f0 2024-09-17T05:18:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.221+0000 7f7c59940640 1 -- 172.21.15.81:0/3630769012 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c4c18a150 con 0x7f7c4c0538f0 2024-09-17T05:18:23.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.221+0000 7f7c59940640 1 -- 172.21.15.81:0/3630769012 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c4c052ef0 con 0x7f7c4c0538f0 2024-09-17T05:18:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.222+0000 7fb032ffd640 1 -- 172.21.15.81:0/1503756276 <== mon.0 v2:172.21.15.81:3300/0 10 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7fb038043b30 con 0x7fb03c06e360 2024-09-17T05:18:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.223+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(4 keys) ==== 110+0+0 (secure 0 0 0) 0x7f7c48045070 con 0x7f7c4c0538f0 2024-09-17T05:18:23.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.223+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c4803e470 con 0x7f7c4c0538f0 2024-09-17T05:18:23.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.224+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7c4802bb60 con 0x7f7c4c0538f0 2024-09-17T05:18:23.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.224+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7c4804a4b0 con 0x7f7c4c0538f0 2024-09-17T05:18:23.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.224+0000 7f7c3effd640 1 -- 172.21.15.81:0/3630769012 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c34005290 con 0x7f7c4c0538f0 2024-09-17T05:18:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.225+0000 7f7d03c47640 1 -- 172.21.15.81:0/2033330774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0d2030 msgr2=0x7f7cfc158400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.225+0000 7f7d03c47640 1 --2- 172.21.15.81:0/2033330774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0d2030 0x7f7cfc158400 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7cec00d970 tx=0x7f7cec00de30 comp rx=0 tx=0).stop 2024-09-17T05:18:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.225+0000 7f7d03c47640 1 -- 172.21.15.81:0/2033330774 shutdown_connections 2024-09-17T05:18:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.225+0000 7f7d03c47640 1 --2- 172.21.15.81:0/2033330774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cfc161500 0x7f7cfc1f37d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.225+0000 7f7d03c47640 1 --2- 172.21.15.81:0/2033330774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cfc0d2030 0x7f7cfc158400 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.225+0000 7f7d03c47640 1 --2- 172.21.15.81:0/2033330774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cfc0b4c20 0x7f7cfc1f7940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.225+0000 7f7d03c47640 1 -- 172.21.15.81:0/2033330774 >> 172.21.15.81:0/2033330774 conn(0x7f7cfc09d190 msgr2=0x7f7cfc06e7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.226+0000 7f7d03c47640 1 -- 172.21.15.81:0/2033330774 shutdown_connections 2024-09-17T05:18:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.226+0000 7f7d03c47640 1 -- 172.21.15.81:0/2033330774 wait complete. 2024-09-17T05:18:23.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.227+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7c4803e610 con 0x7f7c4c0538f0 2024-09-17T05:18:23.237 INFO:tasks.ceph:setting config [mon] mon_op_complaint_time = 120 2024-09-17T05:18:23.237 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_op_complaint_time 120 2024-09-17T05:18:23.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.230+0000 7fb04435a640 1 -- 172.21.15.81:0/1503756276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fb018005310 con 0x7fb03c06e360 2024-09-17T05:18:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.239+0000 7fb032ffd640 1 -- 172.21.15.81:0/1503756276 <== mon.0 v2:172.21.15.81:3300/0 11 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7fb038043d50 con 0x7fb03c06e360 2024-09-17T05:18:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.239+0000 7fb032ffd640 1 -- 172.21.15.81:0/1503756276 <== mon.0 v2:172.21.15.81:3300/0 12 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb03800b090 con 0x7fb03c06e360 2024-09-17T05:18:23.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.240+0000 7f5980ff9640 1 -- 172.21.15.81:0/36338147 <== mon.0 v2:172.21.15.81:3300/0 11 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f597c025440 con 0x7f59841529b0 2024-09-17T05:18:23.242 INFO:tasks.ceph:setting config [mon] mon_warn_on_pool_no_app = False 2024-09-17T05:18:23.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set mon mon_warn_on_pool_no_app False 2024-09-17T05:18:23.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.241+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 7 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c480098c0 con 0x7f7c4c0538f0 2024-09-17T05:18:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.250+0000 7fb04435a640 1 -- 172.21.15.81:0/1503756276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06e360 msgr2=0x7fb03c1f01f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.250+0000 7fb04435a640 1 --2- 172.21.15.81:0/1503756276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06e360 0x7fb03c1f01f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fb038034040 tx=0x7fb0380046c0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.254 INFO:tasks.ceph:setting config [osd] osd_op_complaint_time = 180 2024-09-17T05:18:23.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set osd osd_op_complaint_time 180 2024-09-17T05:18:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.250+0000 7fb04435a640 1 -- 172.21.15.81:0/1503756276 shutdown_connections 2024-09-17T05:18:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.250+0000 7fb04435a640 1 --2- 172.21.15.81:0/1503756276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb03c157f90 0x7fb03c0c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.250+0000 7fb04435a640 1 --2- 172.21.15.81:0/1503756276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb03c070340 0x7fb03c14ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.250+0000 7fb04435a640 1 --2- 172.21.15.81:0/1503756276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb03c06e360 0x7fb03c1f01f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.250+0000 7fb04435a640 1 -- 172.21.15.81:0/1503756276 >> 172.21.15.81:0/1503756276 conn(0x7fb03c0d0be0 msgr2=0x7fb03c06cbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.253+0000 7fb04435a640 1 -- 172.21.15.81:0/1503756276 shutdown_connections 2024-09-17T05:18:23.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.254+0000 7fb04435a640 1 -- 172.21.15.81:0/1503756276 wait complete. 2024-09-17T05:18:23.260 DEBUG:tasks.ceph:set 18 configs 2024-09-17T05:18:23.260 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'client_mount_timeout', '600'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.260 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_client', '20'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.260 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'debug_ms', '1'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.261 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.261 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'client', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.297 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds', '20'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.346+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/2786373491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10004800 msgr2=0x7fcd10004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.346+0000 7fcd2b0c2640 1 --2- 172.21.15.81:0/2786373491 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd10004800 0x7fcd10004c80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fcd24066670 tx=0x7fcd10005830 comp rx=0 tx=0).stop 2024-09-17T05:18:23.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.346+0000 7fcd2a8c1640 1 -- 172.21.15.81:0/2786373491 reap_dead start 2024-09-17T05:18:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.346+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/2786373491 shutdown_connections 2024-09-17T05:18:23.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.346+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/2786373491 >> 172.21.15.81:0/2786373491 conn(0x7fcd1c01e000 msgr2=0x7fcd1c054df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.360+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/2786373491 shutdown_connections 2024-09-17T05:18:23.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.360+0000 7f596a7fc640 1 -- 172.21.15.81:0/36338147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_mds}] v 0) -- 0x7f59840cfde0 con 0x7f59841529b0 2024-09-17T05:18:23.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.361+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/2786373491 wait complete. 2024-09-17T05:18:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.364+0000 7fcd2b0c2640 1 Processor -- start 2024-09-17T05:18:23.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.364+0000 7fcd2b0c2640 1 -- start start 2024-09-17T05:18:23.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.369+0000 7fcd2b0c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c005f50 0x7fcd1c0dffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.369+0000 7fcd2b0c2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd1c0dc430 0x7fcd1c0e04e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.369+0000 7fcd2b0c2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd1c006330 0x7fcd1c181190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.369+0000 7fcd2b0c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c0e6330 con 0x7fcd1c005f50 2024-09-17T05:18:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.369+0000 7fcd2b0c2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcd1c0e61b0 con 0x7fcd1c006330 2024-09-17T05:18:23.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.369+0000 7fcd2b0c2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcd1c0e64b0 con 0x7fcd1c0dc430 2024-09-17T05:18:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a8c1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd1c006330 0x7fcd1c181190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a8c1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd1c006330 0x7fcd1c181190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:58200/0 (socket says 172.21.15.81:58200) 2024-09-17T05:18:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a8c1640 1 -- 172.21.15.81:0/726133262 learned_addr learned my addr 172.21.15.81:0/726133262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a0c0640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c005f50 0x7fcd1c0dffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a0c0640 1 -- 172.21.15.81:0/726133262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd1c0dc430 msgr2=0x7fcd1c0e04e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:18:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a0c0640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd1c0dc430 0x7fcd1c0e04e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a0c0640 1 -- 172.21.15.81:0/726133262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd1c006330 msgr2=0x7fcd1c181190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.372+0000 7fcd2a0c0640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd1c006330 0x7fcd1c181190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.373+0000 7fcd2a0c0640 1 -- 172.21.15.81:0/726133262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd1c0489c0 con 0x7fcd1c005f50 2024-09-17T05:18:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.373+0000 7fcd2a0c0640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c005f50 0x7fcd1c0dffa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400d680 tx=0x7fcd1400db40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.373+0000 7fcd1affd640 1 -- 172.21.15.81:0/726133262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14017070 con 0x7fcd1c005f50 2024-09-17T05:18:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.374+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd1c048ca0 con 0x7fcd1c005f50 2024-09-17T05:18:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.374+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd1c049260 con 0x7fcd1c005f50 2024-09-17T05:18:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.374+0000 7fcd1affd640 1 -- 172.21.15.81:0/726133262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd14005310 con 0x7fcd1c005f50 2024-09-17T05:18:23.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.374+0000 7fcd1affd640 1 -- 172.21.15.81:0/726133262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd14009820 con 0x7fcd1c005f50 2024-09-17T05:18:23.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.376+0000 7f5980ff9640 1 -- 172.21.15.81:0/36338147 <== mon.0 v2:172.21.15.81:3300/0 12 ==== mon_command_ack([{prefix=config set, name=debug_mds}]=0 v7)=0 v7) ==== 108+0+0 (secure 0 0 0) 0x7f597c025680 con 0x7f59841529b0 2024-09-17T05:18:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.377+0000 7fcd1affd640 1 -- 172.21.15.81:0/726133262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd140099c0 con 0x7fcd1c005f50 2024-09-17T05:18:23.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.378+0000 7f596a7fc640 1 -- 172.21.15.81:0/36338147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59841529b0 msgr2=0x7f5984152e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.378+0000 7f596a7fc640 1 --2- 172.21.15.81:0/36338147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59841529b0 0x7f5984152e60 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5984162a00 tx=0x7f597c010e80 comp rx=0 tx=0).stop 2024-09-17T05:18:23.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.378+0000 7fcd1affd640 1 -- 172.21.15.81:0/726133262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd14010690 con 0x7fcd1c005f50 2024-09-17T05:18:23.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.382+0000 7f596a7fc640 1 -- 172.21.15.81:0/36338147 shutdown_connections 2024-09-17T05:18:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.382+0000 7f596a7fc640 1 --2- 172.21.15.81:0/36338147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59841529b0 0x7f5984152e60 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.382+0000 7f596a7fc640 1 --2- 172.21.15.81:0/36338147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5984150d90 0x7f59840cc8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.382+0000 7f596a7fc640 1 --2- 172.21.15.81:0/36338147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59841509b0 0x7f5984151d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.382+0000 7f596a7fc640 1 -- 172.21.15.81:0/36338147 >> 172.21.15.81:0/36338147 conn(0x7f59840cf8c0 msgr2=0x7f59840af1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.383+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd0c005290 con 0x7fcd1c005f50 2024-09-17T05:18:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.383+0000 7f596a7fc640 1 -- 172.21.15.81:0/36338147 shutdown_connections 2024-09-17T05:18:23.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.383+0000 7f596a7fc640 1 -- 172.21.15.81:0/36338147 wait complete. 2024-09-17T05:18:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.386+0000 7fcc92313640 1 -- 172.21.15.81:0/1275814351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 msgr2=0x7fcc84051320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.386+0000 7fcc92313640 1 --2- 172.21.15.81:0/1275814351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 0x7fcc84051320 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fcc8c06bbb0 tx=0x7fcc8c0a5c40 comp rx=0 tx=0).stop 2024-09-17T05:18:23.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.387+0000 7fcd1affd640 1 -- 172.21.15.81:0/726133262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcd140108e0 con 0x7fcd1c005f50 2024-09-17T05:18:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.386+0000 7fcc92313640 1 -- 172.21.15.81:0/1275814351 shutdown_connections 2024-09-17T05:18:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.386+0000 7fcc92313640 1 --2- 172.21.15.81:0/1275814351 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 0x7fcc84051320 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.386+0000 7fcc92313640 1 -- 172.21.15.81:0/1275814351 >> 172.21.15.81:0/1275814351 conn(0x7fcc84056710 msgr2=0x7fcc84056b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.386+0000 7fcc92313640 1 -- 172.21.15.81:0/1275814351 shutdown_connections 2024-09-17T05:18:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.386+0000 7fcc92313640 1 -- 172.21.15.81:0/1275814351 wait complete. 2024-09-17T05:18:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.388+0000 7fcc92313640 1 Processor -- start 2024-09-17T05:18:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.388+0000 7fcc92313640 1 -- start start 2024-09-17T05:18:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc92313640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 0x7fcc84020570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc92313640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc840536f0 0x7fcc84020ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc92313640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc840e3d80 0x7fcc84035f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc92313640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc840376e0 con 0x7fcc840e3d80 2024-09-17T05:18:23.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc92313640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcc84037560 con 0x7fcc84036e90 2024-09-17T05:18:23.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc92313640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcc84037860 con 0x7fcc840536f0 2024-09-17T05:18:23.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc91311640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 0x7fcc84020570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc91311640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 0x7fcc84020570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:58222/0 (socket says 172.21.15.81:58222) 2024-09-17T05:18:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc91b12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc840e3d80 0x7fcc84035f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.390+0000 7fcc91311640 1 -- 172.21.15.81:0/4183200038 learned_addr learned my addr 172.21.15.81:0/4183200038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.391+0000 7fcc91b12640 1 -- 172.21.15.81:0/4183200038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc840536f0 msgr2=0x7fcc84020ab0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:23.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.391+0000 7fcc91b12640 1 --2- 172.21.15.81:0/4183200038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc840536f0 0x7fcc84020ab0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.391+0000 7fcc91b12640 1 -- 172.21.15.81:0/4183200038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 msgr2=0x7fcc84020570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.391+0000 7fcc91b12640 1 --2- 172.21.15.81:0/4183200038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 0x7fcc84020570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.391+0000 7fcc91b12640 1 -- 172.21.15.81:0/4183200038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc840225a0 con 0x7fcc840e3d80 2024-09-17T05:18:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.391+0000 7fcc91b12640 1 --2- 172.21.15.81:0/4183200038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc840e3d80 0x7fcc84035f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800b750 tx=0x7fcc8800bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.391+0000 7fcc81ffb640 1 -- 172.21.15.81:0/4183200038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc88019070 con 0x7fcc840e3d80 2024-09-17T05:18:23.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.392+0000 7fcc81ffb640 1 -- 172.21.15.81:0/4183200038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc8800c810 con 0x7fcc840e3d80 2024-09-17T05:18:23.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.392+0000 7fcc81ffb640 1 -- 172.21.15.81:0/4183200038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc8800cc60 con 0x7fcc840e3d80 2024-09-17T05:18:23.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.392+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc84021130 con 0x7fcc840e3d80 2024-09-17T05:18:23.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.392+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc84022b00 con 0x7fcc840e3d80 2024-09-17T05:18:23.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.392+0000 7fcc81ffb640 1 -- 172.21.15.81:0/4183200038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcc8801c070 con 0x7fcc840e3d80 2024-09-17T05:18:23.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.392+0000 7fcc81ffb640 1 -- 172.21.15.81:0/4183200038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcc880147c0 con 0x7fcc840e3d80 2024-09-17T05:18:23.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.394+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc840522b0 con 0x7fcc840e3d80 2024-09-17T05:18:23.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.409+0000 7fcc81ffb640 1 -- 172.21.15.81:0/4183200038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcc840225a0 con 0x7fcc840e3d80 2024-09-17T05:18:23.436 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_mds_balancer', '20'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.481+0000 7f680c0ed640 1 -- 172.21.15.81:0/2693452523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 msgr2=0x7f67fc006620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.481+0000 7f680c0ed640 1 --2- 172.21.15.81:0/2693452523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc006620 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f680406b2b0 tx=0x7f68040a5ca0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.481+0000 7f680c0ed640 1 -- 172.21.15.81:0/2693452523 shutdown_connections 2024-09-17T05:18:23.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.481+0000 7f680c0ed640 1 --2- 172.21.15.81:0/2693452523 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc006620 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.481+0000 7f680c0ed640 1 --2- 172.21.15.81:0/2693452523 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67fc0deee0 0x7f67fc036010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.481+0000 7f680c0ed640 1 -- 172.21.15.81:0/2693452523 >> 172.21.15.81:0/2693452523 conn(0x7f67fc01e000 msgr2=0x7f67fc054df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.484+0000 7f680c0ed640 1 -- 172.21.15.81:0/2693452523 shutdown_connections 2024-09-17T05:18:23.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.486+0000 7f680c0ed640 1 -- 172.21.15.81:0/2693452523 wait complete. 2024-09-17T05:18:23.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.488+0000 7f680c0ed640 1 Processor -- start 2024-09-17T05:18:23.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.488+0000 7f680c0ed640 1 -- start start 2024-09-17T05:18:23.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.490+0000 7f680c0ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67fc0345b0 0x7f67fc032110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.490+0000 7f680c0ed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc0ce940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.490+0000 7f6809e89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67fc0345b0 0x7f67fc032110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.490+0000 7f6809e89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67fc0345b0 0x7f67fc032110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57490/0 (socket says 172.21.15.81:57490) 2024-09-17T05:18:23.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.490+0000 7f680c0ed640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67fc0deee0 0x7f67fc0cee80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc0ce940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc0ce940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:58264/0 (socket says 172.21.15.81:58264) 2024-09-17T05:18:23.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f680a68a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67fc0deee0 0x7f67fc0cee80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f680a68a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67fc0deee0 0x7f67fc0cee80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:53312/0 (socket says 172.21.15.81:53312) 2024-09-17T05:18:23.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 -- 172.21.15.81:0/315211095 learned_addr learned my addr 172.21.15.81:0/315211095 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f680c0ed640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc005f10 con 0x7f67fc0345b0 2024-09-17T05:18:23.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f680c0ed640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f67fc005d90 con 0x7f67fc03a250 2024-09-17T05:18:23.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f680c0ed640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f67fc006090 con 0x7f67fc0deee0 2024-09-17T05:18:23.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.488+0000 7f7c3effd640 1 -- 172.21.15.81:0/3630769012 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command([{prefix=config set, name=debug_mds_balancer}] v 0) -- 0x7f7c34005580 con 0x7f7c4c0538f0 2024-09-17T05:18:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 -- 172.21.15.81:0/315211095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67fc0deee0 msgr2=0x7f67fc0cee80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67fc0deee0 0x7f67fc0cee80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 -- 172.21.15.81:0/315211095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67fc0345b0 msgr2=0x7f67fc032110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67fc0345b0 0x7f67fc032110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.491+0000 7f6809688640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67fc0cf6b0 con 0x7f67fc03a250 2024-09-17T05:18:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.492+0000 7f6809688640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc0ce940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f67f4001e40 tx=0x7f67f4001e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.492+0000 7f67fa7fc640 1 -- 172.21.15.81:0/315211095 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f40052d0 con 0x7f67fc03a250 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.492+0000 7f67fa7fc640 1 -- 172.21.15.81:0/315211095 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67f4011890 con 0x7f67fc03a250 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.492+0000 7f680c0ed640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67fc049970 con 0x7f67fc03a250 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.492+0000 7f680c0ed640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67fc0cf3c0 con 0x7f67fc03a250 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.492+0000 7f6809e89640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67fc0345b0 0x7f67fc032110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.494+0000 7f67fa7fc640 1 -- 172.21.15.81:0/315211095 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f4011ce0 con 0x7f67fc03a250 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.494+0000 7f67fa7fc640 1 -- 172.21.15.81:0/315211095 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f67f4003980 con 0x7f67fc03a250 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.494+0000 7f67fa7fc640 1 -- 172.21.15.81:0/315211095 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f67f4022730 con 0x7f67fc03a250 2024-09-17T05:18:23.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.495+0000 7f67effff640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e4005290 con 0x7f67fc03a250 2024-09-17T05:18:23.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.494+0000 7fe73d3da640 1 -- 172.21.15.81:0/1530910832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 msgr2=0x7fe7300e6430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.494+0000 7fe73d3da640 1 --2- 172.21.15.81:0/1530910832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 0x7fe7300e6430 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fe730009710 tx=0x7fe72802a560 comp rx=0 tx=0).stop 2024-09-17T05:18:23.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.497+0000 7f7c517fa640 1 -- 172.21.15.81:0/3630769012 <== mon.2 v2:172.21.15.160:3301/0 8 ==== mon_command_ack([{prefix=config set, name=debug_mds_balancer}]=0 v8)=0 v8) ==== 117+0+0 (secure 0 0 0) 0x7f7c4803e850 con 0x7f7c4c0538f0 2024-09-17T05:18:23.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.498+0000 7fe73d3da640 1 -- 172.21.15.81:0/1530910832 shutdown_connections 2024-09-17T05:18:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.498+0000 7fe73d3da640 1 --2- 172.21.15.81:0/1530910832 >> v2:172.21.15.81:3300/0 conn(0x7fe73003b940 0x7fe7300066f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.498+0000 7fe73d3da640 1 --2- 172.21.15.81:0/1530910832 >> v2:172.21.15.160:3300/0 conn(0x7fe730037f10 0x7fe7300e6970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.498+0000 7fe73d3da640 1 --2- 172.21.15.81:0/1530910832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 0x7fe7300e6430 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.498+0000 7fe73d3da640 1 -- 172.21.15.81:0/1530910832 >> 172.21.15.81:0/1530910832 conn(0x7fe73003a3d0 msgr2=0x7fe73003a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.498+0000 7f67fa7fc640 1 -- 172.21.15.81:0/315211095 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f67f4003c70 con 0x7f67fc03a250 2024-09-17T05:18:23.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 -- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c4c0538f0 msgr2=0x7f7c4c1899e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c4c0538f0 0x7f7c4c1899e0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f7c48009cd0 tx=0x7f7c48034b40 comp rx=0 tx=0).stop 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 -- 172.21.15.81:0/3630769012 shutdown_connections 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c4c0538f0 0x7f7c4c1899e0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c4c006f50 0x7f7c4c1894a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 --2- 172.21.15.81:0/3630769012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c4400a3d0 0x7f7c4c185950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 -- 172.21.15.81:0/3630769012 >> 172.21.15.81:0/3630769012 conn(0x7f7c4c054560 msgr2=0x7f7c4c009a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 -- 172.21.15.81:0/3630769012 shutdown_connections 2024-09-17T05:18:23.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.499+0000 7f7c3effd640 1 -- 172.21.15.81:0/3630769012 wait complete. 2024-09-17T05:18:23.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.501+0000 7fe73d3da640 1 -- 172.21.15.81:0/1530910832 shutdown_connections 2024-09-17T05:18:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.501+0000 7fe73d3da640 1 -- 172.21.15.81:0/1530910832 wait complete. 2024-09-17T05:18:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.503+0000 7fe73d3da640 1 Processor -- start 2024-09-17T05:18:23.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.503+0000 7fe73d3da640 1 -- start start 2024-09-17T05:18:23.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.504+0000 7fe73d3da640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730037f10 0x7fe730038560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe73d3da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73003b940 0x7fe73004fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe73d3da640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 0x7fe7300e40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730037f10 0x7fe730038560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe736ffd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730037f10 0x7fe730038560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:58274/0 (socket says 172.21.15.81:58274) 2024-09-17T05:18:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe7367fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73003b940 0x7fe73004fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe7367fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73003b940 0x7fe73004fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57500/0 (socket says 172.21.15.81:57500) 2024-09-17T05:18:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe736ffd640 1 -- 172.21.15.81:0/1427600929 learned_addr learned my addr 172.21.15.81:0/1427600929 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe73d3da640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe730006fc0 con 0x7fe73003b940 2024-09-17T05:18:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe73d3da640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe730006e40 con 0x7fe730037f10 2024-09-17T05:18:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe73d3da640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe730007140 con 0x7fe7300e27a0 2024-09-17T05:18:23.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.505+0000 7fe7377fe640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 0x7fe7300e40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.506+0000 7fe7377fe640 1 -- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730037f10 msgr2=0x7fe730038560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.506+0000 7fe7377fe640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730037f10 0x7fe730038560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.506+0000 7fe7377fe640 1 -- 172.21.15.81:0/1427600929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73003b940 msgr2=0x7fe73004fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.506+0000 7fe7377fe640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73003b940 0x7fe73004fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.506+0000 7fe7377fe640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7300e3000 con 0x7fe7300e27a0 2024-09-17T05:18:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.507+0000 7fe7367fc640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73003b940 0x7fe73004fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.507+0000 7fe7377fe640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 0x7fe7300e40a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe73806bbb0 tx=0x7fe738069c90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.508+0000 7fe7277fe640 1 -- 172.21.15.81:0/1427600929 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738087070 con 0x7fe7300e27a0 2024-09-17T05:18:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.508+0000 7fe73d3da640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7300e32e0 con 0x7fe7300e27a0 2024-09-17T05:18:23.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.508+0000 7fe73d3da640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7300e38a0 con 0x7fe7300e27a0 2024-09-17T05:18:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.511+0000 7fe7277fe640 1 -- 172.21.15.81:0/1427600929 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7380737d0 con 0x7fe7300e27a0 2024-09-17T05:18:23.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.512+0000 7fe7277fe640 1 -- 172.21.15.81:0/1427600929 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738073be0 con 0x7fe7300e27a0 2024-09-17T05:18:23.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.516+0000 7fe7257fa640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe714005290 con 0x7fe7300e27a0 2024-09-17T05:18:23.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.516+0000 7fe7277fe640 1 -- 172.21.15.81:0/1427600929 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe73808a070 con 0x7fe7300e27a0 2024-09-17T05:18:23.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.516+0000 7fe7277fe640 1 -- 172.21.15.81:0/1427600929 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fe738082430 con 0x7fe7300e27a0 2024-09-17T05:18:23.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.518+0000 7fe7277fe640 1 -- 172.21.15.81:0/1427600929 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fe738092070 con 0x7fe7300e27a0 2024-09-17T05:18:23.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.519+0000 7f7d22eed640 1 -- 172.21.15.81:0/3335229943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c0ae4f0 msgr2=0x7f7d1c0ae980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.519+0000 7f7d22eed640 1 --2- 172.21.15.81:0/3335229943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c0ae4f0 0x7f7d1c0ae980 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f7d0c005fd0 tx=0x7f7d0c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.519+0000 7f7d22eed640 1 -- 172.21.15.81:0/3335229943 shutdown_connections 2024-09-17T05:18:23.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.519+0000 7f7d22eed640 1 --2- 172.21.15.81:0/3335229943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c0ae4f0 0x7f7d1c0ae980 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.519+0000 7f7d22eed640 1 --2- 172.21.15.81:0/3335229943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d1c161a00 0x7f7d1c161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.519+0000 7f7d22eed640 1 -- 172.21.15.81:0/3335229943 >> 172.21.15.81:0/3335229943 conn(0x7f7d1c0cfb30 msgr2=0x7f7d1c0cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.523+0000 7f03c9eb6640 1 -- 172.21.15.81:0/3669443818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ac0053f0 msgr2=0x7f03ac00ba20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.523+0000 7f03c9eb6640 1 --2- 172.21.15.81:0/3669443818 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03ac0053f0 0x7f03ac00ba20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009880 tx=0x7f03ac005830 comp rx=0 tx=0).stop 2024-09-17T05:18:23.526 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'debug_ms', '2'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.526+0000 7f7d22eed640 1 -- 172.21.15.81:0/3335229943 shutdown_connections 2024-09-17T05:18:23.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.527+0000 7f37eaba3640 1 -- 172.21.15.81:0/3635203799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 msgr2=0x7f37cc00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.527+0000 7f37eaba3640 1 --2- 172.21.15.81:0/3635203799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 0x7f37cc00b9c0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f37d8003fe0 tx=0x7f37cc005830 comp rx=0 tx=0).stop 2024-09-17T05:18:23.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.528+0000 7f03c3fff640 1 -- 172.21.15.81:0/3669443818 reap_dead start 2024-09-17T05:18:23.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.528+0000 7f03c9eb6640 1 -- 172.21.15.81:0/3669443818 shutdown_connections 2024-09-17T05:18:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.528+0000 7f03c9eb6640 1 -- 172.21.15.81:0/3669443818 >> 172.21.15.81:0/3669443818 conn(0x7f03c40cfb30 msgr2=0x7f03c40cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.529+0000 7f03c9eb6640 1 -- 172.21.15.81:0/3669443818 shutdown_connections 2024-09-17T05:18:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.529+0000 7f03c9eb6640 1 -- 172.21.15.81:0/3669443818 wait complete. 2024-09-17T05:18:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.531+0000 7f03c9eb6640 1 Processor -- start 2024-09-17T05:18:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.526+0000 7f7d22eed640 1 -- 172.21.15.81:0/3335229943 wait complete. 2024-09-17T05:18:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.528+0000 7f7d22eed640 1 Processor -- start 2024-09-17T05:18:23.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.528+0000 7f37eaba3640 1 -- 172.21.15.81:0/3635203799 shutdown_connections 2024-09-17T05:18:23.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.528+0000 7f37eaba3640 1 --2- 172.21.15.81:0/3635203799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 0x7f37cc00b9c0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.528+0000 7f37eaba3640 1 -- 172.21.15.81:0/3635203799 >> 172.21.15.81:0/3635203799 conn(0x7f37e40d3e30 msgr2=0x7f37e40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.531+0000 7f7d22eed640 1 -- start start 2024-09-17T05:18:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f7d22eed640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d1c161a00 0x7f7d1c0c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f7d22eed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c205040 0x7f7d1c2029a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f7d22eed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d1c2054c0 0x7f7d1c1fb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.531+0000 7f03c9eb6640 1 -- start start 2024-09-17T05:18:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c9eb6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03c415ade0 0x7f03c40c4d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c9eb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c41fc490 0x7f03c41f8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c9eb6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03c415d840 0x7f03c415dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c9eb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03c40af210 con 0x7f03c41fc490 2024-09-17T05:18:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c9eb6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f03c40af090 con 0x7f03c415d840 2024-09-17T05:18:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c9eb6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f03c4073cf0 con 0x7f03c415ade0 2024-09-17T05:18:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f7d22eed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c073e70 con 0x7f7d1c205040 2024-09-17T05:18:23.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c41fc490 0x7f03c41f8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f7d22eed640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7d1c073cf0 con 0x7f7d1c2054c0 2024-09-17T05:18:23.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f7d22eed640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7d1c0aeec0 con 0x7f7d1c161a00 2024-09-17T05:18:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c41fc490 0x7f03c41f8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57566/0 (socket says 172.21.15.81:57566) 2024-09-17T05:18:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f7d20c89640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d1c161a00 0x7f7d1c0c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c205040 0x7f7d1c2029a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f7d1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c205040 0x7f7d1c2029a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57578/0 (socket says 172.21.15.81:57578) 2024-09-17T05:18:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f7d1bfff640 1 -- 172.21.15.81:0/2403000030 learned_addr learned my addr 172.21.15.81:0/2403000030 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.532+0000 7f03c2ffd640 1 -- 172.21.15.81:0/2286649875 learned_addr learned my addr 172.21.15.81:0/2286649875 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7fa7475da640 1 -- 172.21.15.81:0/2841090026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7400cbd70 msgr2=0x7fa7400735e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7fa7475da640 1 --2- 172.21.15.81:0/2841090026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7400cbd70 0x7fa7400735e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fa73c005fd0 tx=0x7fa73c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7fa7475da640 1 -- 172.21.15.81:0/2841090026 shutdown_connections 2024-09-17T05:18:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7fa7475da640 1 --2- 172.21.15.81:0/2841090026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7400cbd70 0x7fa7400735e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7fa7475da640 1 --2- 172.21.15.81:0/2841090026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa740161a00 0x7fa740161de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7fa7475da640 1 -- 172.21.15.81:0/2841090026 >> 172.21.15.81:0/2841090026 conn(0x7fa7400cfb30 msgr2=0x7fa7400cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f03c2ffd640 1 -- 172.21.15.81:0/2286649875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03c415ade0 msgr2=0x7f03c40c4d40 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:23.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7fa7475da640 1 -- 172.21.15.81:0/2841090026 shutdown_connections 2024-09-17T05:18:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f03c2ffd640 1 --2- 172.21.15.81:0/2286649875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03c415ade0 0x7f03c40c4d40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 -- 172.21.15.81:0/804050401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c035fe0 msgr2=0x7f935c036490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 --2- 172.21.15.81:0/804050401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c035fe0 0x7f935c036490 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f935c039380 tx=0x7f935803b5b0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f03c2ffd640 1 -- 172.21.15.81:0/2286649875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03c415d840 msgr2=0x7f03c415dcc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f03c2ffd640 1 --2- 172.21.15.81:0/2286649875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03c415d840 0x7f03c415dcc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.533+0000 7f03c2ffd640 1 -- 172.21.15.81:0/2286649875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c40b30e0 con 0x7f03c41fc490 2024-09-17T05:18:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 -- 172.21.15.81:0/804050401 shutdown_connections 2024-09-17T05:18:23.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 --2- 172.21.15.81:0/804050401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c035fe0 0x7f935c036490 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 --2- 172.21.15.81:0/804050401 >> v2:172.21.15.160:3300/0 conn(0x7f935c038f00 0x7f935c00a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 --2- 172.21.15.81:0/804050401 >> v2:172.21.15.81:3300/0 conn(0x7f935c0e6bc0 0x7f935c0e6fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 -- 172.21.15.81:0/804050401 >> 172.21.15.81:0/804050401 conn(0x7f935c054560 msgr2=0x7f935c054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f03c2ffd640 1 --2- 172.21.15.81:0/2286649875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c41fc490 0x7f03c41f8ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f03b400ea60 tx=0x7f03b400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f7d2148a640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d1c2054c0 0x7f7d1c1fb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.535+0000 7f7d1bfff640 1 -- 172.21.15.81:0/2403000030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d1c161a00 msgr2=0x7f7d1c0c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.535+0000 7f7d1bfff640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d1c161a00 0x7f7d1c0c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.535+0000 7f7d1bfff640 1 -- 172.21.15.81:0/2403000030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d1c2054c0 msgr2=0x7f7d1c1fb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.535+0000 7f7d1bfff640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d1c2054c0 0x7f7d1c1fb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.535+0000 7f7d1bfff640 1 -- 172.21.15.81:0/2403000030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d1c0c7070 con 0x7f7d1c205040 2024-09-17T05:18:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.535+0000 7f7d1bfff640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c205040 0x7f7d1c2029a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000b3c0 tx=0x7f7d1000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 -- 172.21.15.81:0/804050401 shutdown_connections 2024-09-17T05:18:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7f9363fff640 1 -- 172.21.15.81:0/804050401 wait complete. 2024-09-17T05:18:23.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.536+0000 7f9363fff640 1 Processor -- start 2024-09-17T05:18:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.537+0000 7fcd75c72640 1 -- 172.21.15.81:0/2749644086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70161a00 msgr2=0x7fcd70161de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.537+0000 7fcd75c72640 1 --2- 172.21.15.81:0/2749644086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70161a00 0x7fcd70161de0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcd700723f0 tx=0x7fcd6002a580 comp rx=0 tx=0).stop 2024-09-17T05:18:23.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.534+0000 7fa7475da640 1 -- 172.21.15.81:0/2841090026 wait complete. 2024-09-17T05:18:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.537+0000 7f9363fff640 1 -- start start 2024-09-17T05:18:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.536+0000 7fa7475da640 1 Processor -- start 2024-09-17T05:18:23.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f03abfff640 1 -- 172.21.15.81:0/2286649875 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b4015070 con 0x7f03c41fc490 2024-09-17T05:18:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.537+0000 7f7d197fa640 1 -- 172.21.15.81:0/2403000030 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011830 con 0x7f7d1c205040 2024-09-17T05:18:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.537+0000 7f7d197fa640 1 -- 172.21.15.81:0/2403000030 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d10016070 con 0x7f7d1c205040 2024-09-17T05:18:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.537+0000 7f7d197fa640 1 -- 172.21.15.81:0/2403000030 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d10011d80 con 0x7f7d1c205040 2024-09-17T05:18:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f7d22eed640 1 -- 172.21.15.81:0/2403000030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d1c0c7350 con 0x7f7d1c205040 2024-09-17T05:18:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f7d22eed640 1 -- 172.21.15.81:0/2403000030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d1c0af890 con 0x7f7d1c205040 2024-09-17T05:18:23.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c41f9740 con 0x7f03c41fc490 2024-09-17T05:18:23.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c40c5280 con 0x7f03c41fc490 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.537+0000 7fa7475da640 1 -- start start 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa7475da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa740073b20 0x7fa7401fa440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa7475da640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7400cbd70 0x7fa7400b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa745376640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa740073b20 0x7fa7401fa440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa745376640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa740073b20 0x7fa7401fa440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57606/0 (socket says 172.21.15.81:57606) 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa745376640 1 -- 172.21.15.81:0/363282910 learned_addr learned my addr 172.21.15.81:0/363282910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa7475da640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa740161a00 0x7fa7400b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f9363fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f935c035fe0 0x7f935c0db130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa744b75640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7400cbd70 0x7fa7400b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa745b77640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa740161a00 0x7fa7400b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7400aed80 con 0x7fa740073b20 2024-09-17T05:18:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa7400aec00 con 0x7fa7400cbd70 2024-09-17T05:18:23.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa7400aef00 con 0x7fa740161a00 2024-09-17T05:18:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7f03abfff640 1 -- 172.21.15.81:0/2286649875 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03b400ce60 con 0x7f03c41fc490 2024-09-17T05:18:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fcd75c72640 1 -- 172.21.15.81:0/2749644086 shutdown_connections 2024-09-17T05:18:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fcd75c72640 1 --2- 172.21.15.81:0/2749644086 >> v2:172.21.15.160:3300/0 conn(0x7fcd700ae4f0 0x7fcd700ae960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fcd75c72640 1 --2- 172.21.15.81:0/2749644086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70161a00 0x7fcd70161de0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7fcd75c72640 1 -- 172.21.15.81:0/2749644086 >> 172.21.15.81:0/2749644086 conn(0x7fcd700cfb30 msgr2=0x7fcd700cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f03abfff640 1 -- 172.21.15.81:0/2286649875 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03b40116c0 con 0x7f03c41fc490 2024-09-17T05:18:23.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fcd75c72640 1 -- 172.21.15.81:0/2749644086 shutdown_connections 2024-09-17T05:18:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f03abfff640 1 -- 172.21.15.81:0/2286649875 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f03b4018070 con 0x7f03c41fc490 2024-09-17T05:18:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f03abfff640 1 -- 172.21.15.81:0/2286649875 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f03b40103c0 con 0x7f03c41fc490 2024-09-17T05:18:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fa745376640 1 -- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa740161a00 msgr2=0x7fa7400b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fa745376640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa740161a00 0x7fa7400b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fa745376640 1 -- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7400cbd70 msgr2=0x7fa7400b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fa745376640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7400cbd70 0x7fa7400b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fa745376640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7400b3d50 con 0x7fa740073b20 2024-09-17T05:18:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fa745376640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa740073b20 0x7fa7401fa440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa73800ba50 tx=0x7fa73800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f9363fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c038f00 0x7f935c0e83a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f9363fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f935c0e6bc0 0x7f935c048fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f9363fff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f935c01c8e0 con 0x7f935c035fe0 2024-09-17T05:18:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f9363fff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f935c01c760 con 0x7f935c0e6bc0 2024-09-17T05:18:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.536+0000 7f37eaba3640 1 -- 172.21.15.81:0/3635203799 shutdown_connections 2024-09-17T05:18:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f9363fff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f935c01ca60 con 0x7f935c038f00 2024-09-17T05:18:23.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f93627fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c038f00 0x7f935c0e83a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f93627fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c038f00 0x7f935c0e83a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:53404/0 (socket says 172.21.15.81:53404) 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f93627fc640 1 -- 172.21.15.81:0/906615075 learned_addr learned my addr 172.21.15.81:0/906615075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f9362ffd640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f935c035fe0 0x7f935c0db130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7f93627fc640 1 -- 172.21.15.81:0/906615075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f935c0e6bc0 msgr2=0x7f935c048fa0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7f93627fc640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f935c0e6bc0 0x7f935c048fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7f93627fc640 1 -- 172.21.15.81:0/906615075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f935c035fe0 msgr2=0x7f935c0db130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f93627fc640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f935c035fe0 0x7f935c0db130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f93627fc640 1 -- 172.21.15.81:0/906615075 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f935c0dfb60 con 0x7f935c038f00 2024-09-17T05:18:23.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f9362ffd640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f935c035fe0 0x7f935c0db130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f93627fc640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c038f00 0x7f935c0e83a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9364051c90 tx=0x7f936406cf10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.536+0000 7f37eaba3640 1 -- 172.21.15.81:0/3635203799 wait complete. 2024-09-17T05:18:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f37eaba3640 1 Processor -- start 2024-09-17T05:18:23.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f934b7fe640 1 -- 172.21.15.81:0/906615075 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364094440 con 0x7f935c038f00 2024-09-17T05:18:23.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.538+0000 7f37eaba3640 1 -- start start 2024-09-17T05:18:23.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37eaba3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 0x7f37e41554c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37eaba3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37e40ca3c0 0x7f37e40d0800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37eaba3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e4151610 0x7f37e40c82c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37eaba3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37e40b3790 con 0x7f37e4151610 2024-09-17T05:18:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37eaba3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f37e40d0410 con 0x7f37e40ca3c0 2024-09-17T05:18:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37eaba3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f37e40b3910 con 0x7f37cc0051c0 2024-09-17T05:18:23.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7fa744b75640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7400cbd70 0x7fa7400b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7fa745b77640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa740161a00 0x7fa7400b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7fa735ffb640 1 -- 172.21.15.81:0/363282910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa738019070 con 0x7fa740073b20 2024-09-17T05:18:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37e893f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 0x7f37e41554c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f935c0defa0 con 0x7f935c038f00 2024-09-17T05:18:23.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f935c04b030 con 0x7f935c038f00 2024-09-17T05:18:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37e893f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 0x7f37e41554c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:53428/0 (socket says 172.21.15.81:53428) 2024-09-17T05:18:23.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37e893f640 1 -- 172.21.15.81:0/1022943671 learned_addr learned my addr 172.21.15.81:0/1022943671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f37e9140640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e4151610 0x7f37e40c82c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f37e9140640 1 -- 172.21.15.81:0/1022943671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 msgr2=0x7f37e41554c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f37e9140640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 0x7f37e41554c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f37e9140640 1 -- 172.21.15.81:0/1022943671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37e40ca3c0 msgr2=0x7f37e40d0800 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f37e9140640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37e40ca3c0 0x7f37e40d0800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f37e9140640 1 -- 172.21.15.81:0/1022943671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37e4150970 con 0x7f37e4151610 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.541+0000 7f37e9140640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e4151610 0x7f37e40c82c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007fd0 tx=0x7f37d8003c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7f37e17fa640 1 -- 172.21.15.81:0/1022943671 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8042070 con 0x7f37e4151610 2024-09-17T05:18:23.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.543+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03a4005290 con 0x7f03c41fc490 2024-09-17T05:18:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7f7d197fa640 1 -- 172.21.15.81:0/2403000030 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d1001b460 con 0x7f7d1c205040 2024-09-17T05:18:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.539+0000 7f7d197fa640 1 -- 172.21.15.81:0/2403000030 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7d1001a8c0 con 0x7f7d1c205040 2024-09-17T05:18:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7f7d22eed640 1 -- 172.21.15.81:0/2403000030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d1c070050 con 0x7f7d1c205040 2024-09-17T05:18:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.543+0000 7f934b7fe640 1 -- 172.21.15.81:0/906615075 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9364094600 con 0x7f935c038f00 2024-09-17T05:18:23.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa740158390 con 0x7fa740073b20 2024-09-17T05:18:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.543+0000 7f934b7fe640 1 -- 172.21.15.81:0/906615075 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9364094a50 con 0x7f935c038f00 2024-09-17T05:18:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7400b4c10 con 0x7fa740073b20 2024-09-17T05:18:23.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.540+0000 7fcd75c72640 1 -- 172.21.15.81:0/2749644086 wait complete. 2024-09-17T05:18:23.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.544+0000 7fa735ffb640 1 -- 172.21.15.81:0/363282910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa73800cd00 con 0x7fa740073b20 2024-09-17T05:18:23.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.544+0000 7fcd75c72640 1 Processor -- start 2024-09-17T05:18:23.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.544+0000 7f934b7fe640 1 -- 172.21.15.81:0/906615075 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f936409d780 con 0x7f935c038f00 2024-09-17T05:18:23.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.544+0000 7f934b7fe640 1 -- 172.21.15.81:0/906615075 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9364093d50 con 0x7f935c038f00 2024-09-17T05:18:23.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.545+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9344005290 con 0x7f935c038f00 2024-09-17T05:18:23.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.544+0000 7fcd75c72640 1 -- start start 2024-09-17T05:18:23.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.546+0000 7fa735ffb640 1 -- 172.21.15.81:0/363282910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7380146a0 con 0x7fa740073b20 2024-09-17T05:18:23.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.546+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7400735e0 con 0x7fa740073b20 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.545+0000 7fcd75c72640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd700ae4f0 0x7fcd700c7aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.545+0000 7fcd75c72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd700cbd70 0x7fcd70160270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.545+0000 7fcd75c72640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd70161a00 0x7fcd7015f150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.545+0000 7fcd75c72640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd70073e70 con 0x7fcd700cbd70 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.545+0000 7fcd75c72640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcd70073cf0 con 0x7fcd700ae4f0 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.545+0000 7fcd75c72640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcd700aeea0 con 0x7fcd70161a00 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.546+0000 7fcd6f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd700ae4f0 0x7fcd700c7aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.546+0000 7fcd6f7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd700ae4f0 0x7fcd700c7aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:58348/0 (socket says 172.21.15.81:58348) 2024-09-17T05:18:23.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7f934b7fe640 1 -- 172.21.15.81:0/906615075 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f93640a2070 con 0x7f935c038f00 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.546+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/2602834177 learned_addr learned my addr 172.21.15.81:0/2602834177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/2602834177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd70161a00 msgr2=0x7fcd7015f150 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd6f7fe640 1 --2- 172.21.15.81:0/2602834177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd70161a00 0x7fcd7015f150 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/2602834177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd700cbd70 msgr2=0x7fcd70160270 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd6f7fe640 1 --2- 172.21.15.81:0/2602834177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd700cbd70 0x7fcd70160270 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/2602834177 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd700c80c0 con 0x7fcd700ae4f0 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd6f7fe640 1 --2- 172.21.15.81:0/2602834177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd700ae4f0 0x7fcd700c7aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009850 tx=0x7fcd60004f60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd57fff640 1 -- 172.21.15.81:0/2602834177 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd6003f070 con 0x7fcd700ae4f0 2024-09-17T05:18:23.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.547+0000 7fcd57fff640 1 -- 172.21.15.81:0/2602834177 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd60003af0 con 0x7fcd700ae4f0 2024-09-17T05:18:23.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.550+0000 7f607f423640 1 -- 172.21.15.81:0/750947378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078073a20 msgr2=0x7f60780cd760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.550+0000 7f607f423640 1 --2- 172.21.15.81:0/750947378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078073a20 0x7f60780cd760 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6074005fd0 tx=0x7f607402a560 comp rx=0 tx=0).stop 2024-09-17T05:18:23.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.548+0000 7fcd57fff640 1 -- 172.21.15.81:0/2602834177 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd60035030 con 0x7fcd700ae4f0 2024-09-17T05:18:23.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.549+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd700c4900 con 0x7fcd700ae4f0 2024-09-17T05:18:23.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.549+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd700c4ec0 con 0x7fcd700ae4f0 2024-09-17T05:18:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.542+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37e4150c50 con 0x7f37e4151610 2024-09-17T05:18:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.543+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37e4155a00 con 0x7f37e4151610 2024-09-17T05:18:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.548+0000 7f37e17fa640 1 -- 172.21.15.81:0/1022943671 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37d8001c30 con 0x7f37e4151610 2024-09-17T05:18:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.548+0000 7f37e17fa640 1 -- 172.21.15.81:0/1022943671 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d8003850 con 0x7f37e4151610 2024-09-17T05:18:23.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7fcd57fff640 1 -- 172.21.15.81:0/2602834177 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fcd60042070 con 0x7fcd700ae4f0 2024-09-17T05:18:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7f03abfff640 1 -- 172.21.15.81:0/2286649875 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f03b401a450 con 0x7f03c41fc490 2024-09-17T05:18:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7f607f423640 1 -- 172.21.15.81:0/750947378 shutdown_connections 2024-09-17T05:18:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7f607f423640 1 --2- 172.21.15.81:0/750947378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6078073a20 0x7f60780cd760 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7f607f423640 1 --2- 172.21.15.81:0/750947378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60780b2940 0x7f60780b45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7f607f423640 1 -- 172.21.15.81:0/750947378 >> 172.21.15.81:0/750947378 conn(0x7f60780cf860 msgr2=0x7f60780cfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7fcd57fff640 1 -- 172.21.15.81:0/2602834177 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fcd6003ba70 con 0x7fcd700ae4f0 2024-09-17T05:18:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd700ae960 con 0x7fcd700ae4f0 2024-09-17T05:18:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.551+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37c4005290 con 0x7f37e4151610 2024-09-17T05:18:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.552+0000 7f37e17fa640 1 -- 172.21.15.81:0/1022943671 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f37d8045070 con 0x7f37e4151610 2024-09-17T05:18:23.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.552+0000 7f37e17fa640 1 -- 172.21.15.81:0/1022943671 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f37d8047780 con 0x7f37e4151610 2024-09-17T05:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.552+0000 7fa735ffb640 1 -- 172.21.15.81:0/363282910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa73801c070 con 0x7fa740073b20 2024-09-17T05:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.552+0000 7fa735ffb640 1 -- 172.21.15.81:0/363282910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa73801ed20 con 0x7fa740073b20 2024-09-17T05:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.552+0000 7f7d197fa640 1 -- 172.21.15.81:0/2403000030 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7d1c070050 con 0x7f7d1c205040 2024-09-17T05:18:23.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.556+0000 7f607f423640 1 -- 172.21.15.81:0/750947378 shutdown_connections 2024-09-17T05:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.557+0000 7fcd57fff640 1 -- 172.21.15.81:0/2602834177 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fcd6003bcc0 con 0x7fcd700ae4f0 2024-09-17T05:18:23.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.558+0000 7f37e17fa640 1 -- 172.21.15.81:0/1022943671 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f37d804c070 con 0x7f37e4151610 2024-09-17T05:18:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.556+0000 7f607f423640 1 -- 172.21.15.81:0/750947378 wait complete. 2024-09-17T05:18:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.558+0000 7f607f423640 1 Processor -- start 2024-09-17T05:18:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.558+0000 7f607f423640 1 -- start start 2024-09-17T05:18:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.559+0000 7f607f423640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6078073a20 0x7f6078142110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.559+0000 7f607f423640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780b2940 0x7f60780aa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.559+0000 7f607f423640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60780b2d20 0x7f60781f8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.559+0000 7f607f423640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60780ce3d0 con 0x7f60780b2940 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.559+0000 7f607f423640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f60780ce250 con 0x7f60780b2d20 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.559+0000 7f607f423640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6078142a60 con 0x7f6078073a20 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.559+0000 7f607e421640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6078073a20 0x7f6078142110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.560+0000 7f607e421640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6078073a20 0x7f6078142110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:53444/0 (socket says 172.21.15.81:53444) 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.560+0000 7f607e421640 1 -- 172.21.15.81:0/481179891 learned_addr learned my addr 172.21.15.81:0/481179891 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.560+0000 7f607ec22640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60780b2d20 0x7f60781f8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.560+0000 7f607e421640 1 -- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60780b2d20 msgr2=0x7f60781f8f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.560+0000 7f607e421640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60780b2d20 0x7f60781f8f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.560+0000 7f607e421640 1 -- 172.21.15.81:0/481179891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780b2940 msgr2=0x7f60780aa820 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.560+0000 7f607dc20640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780b2940 0x7f60780aa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.561+0000 7f607e421640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780b2940 0x7f60780aa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.564+0000 7fa735ffb640 1 -- 172.21.15.81:0/363282910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa738023020 con 0x7fa740073b20 2024-09-17T05:18:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.561+0000 7f607e421640 1 -- 172.21.15.81:0/481179891 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60780a9d80 con 0x7f6078073a20 2024-09-17T05:18:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.564+0000 7f607dc20640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780b2940 0x7f60780aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.564+0000 7f607e421640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6078073a20 0x7f6078142110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f606800b4a0 tx=0x7f606800b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.564+0000 7f606effd640 1 -- 172.21.15.81:0/481179891 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068014070 con 0x7f6078073a20 2024-09-17T05:18:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.564+0000 7f606effd640 1 -- 172.21.15.81:0/481179891 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6068010700 con 0x7f6078073a20 2024-09-17T05:18:23.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.564+0000 7f606effd640 1 -- 172.21.15.81:0/481179891 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6068010b50 con 0x7f6078073a20 2024-09-17T05:18:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.565+0000 7f607f423640 1 -- 172.21.15.81:0/481179891 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60781f9a60 con 0x7f6078073a20 2024-09-17T05:18:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.566+0000 7f607f423640 1 -- 172.21.15.81:0/481179891 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f60780aa020 con 0x7f6078073a20 2024-09-17T05:18:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.567+0000 7f606cff9640 1 -- 172.21.15.81:0/481179891 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6054005290 con 0x7f6078073a20 2024-09-17T05:18:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.567+0000 7f606effd640 1 -- 172.21.15.81:0/481179891 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f6068017070 con 0x7f6078073a20 2024-09-17T05:18:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.567+0000 7f606effd640 1 -- 172.21.15.81:0/481179891 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f6068022a70 con 0x7f6078073a20 2024-09-17T05:18:23.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.569+0000 7f606effd640 1 -- 172.21.15.81:0/481179891 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f6068022d20 con 0x7f6078073a20 2024-09-17T05:18:23.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.598+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=debug_ms}] v 0) -- 0x7fcd0c005580 con 0x7fcd1c005f50 2024-09-17T05:18:23.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.603+0000 7fcd1affd640 1 -- 172.21.15.81:0/726133262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=debug_ms}]=0 v9)=0 v9) ==== 106+0+0 (secure 0 0 0) 0x7fcd14010ac0 con 0x7fcd1c005f50 2024-09-17T05:18:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.615+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c005f50 msgr2=0x7fcd1c0dffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.615+0000 7fcd2b0c2640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c005f50 0x7fcd1c0dffa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fcd1400d680 tx=0x7fcd1400db40 comp rx=0 tx=0).stop 2024-09-17T05:18:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.615+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 shutdown_connections 2024-09-17T05:18:23.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.615+0000 7fcd2b0c2640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd1c006330 0x7fcd1c181190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.615+0000 7fcd2b0c2640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd1c0dc430 0x7fcd1c0e04e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.615+0000 7fcd2b0c2640 1 --2- 172.21.15.81:0/726133262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1c005f50 0x7fcd1c0dffa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.615+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 >> 172.21.15.81:0/726133262 conn(0x7fcd1c01e000 msgr2=0x7fcd1c031a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.621+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 shutdown_connections 2024-09-17T05:18:23.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.621+0000 7fcd2b0c2640 1 -- 172.21.15.81:0/726133262 wait complete. 2024-09-17T05:18:23.637 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_frag', 'True'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.638+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_frag}] v 0) -- 0x7fcc840390b0 con 0x7fcc840e3d80 2024-09-17T05:18:23.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.643+0000 7fcc81ffb640 1 -- 172.21.15.81:0/4183200038 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_frag}]=0 v10)=0 v10) ==== 115+0+0 (secure 0 0 0) 0x7fcc88014a10 con 0x7fcc840e3d80 2024-09-17T05:18:23.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.644+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc840e3d80 msgr2=0x7fcc84035f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.644+0000 7fcc92313640 1 --2- 172.21.15.81:0/4183200038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc840e3d80 0x7fcc84035f70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fcc8800b750 tx=0x7fcc8800bc10 comp rx=0 tx=0).stop 2024-09-17T05:18:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.644+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 shutdown_connections 2024-09-17T05:18:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.644+0000 7fcc92313640 1 --2- 172.21.15.81:0/4183200038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc840e3d80 0x7fcc84035f70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.644+0000 7fcc92313640 1 --2- 172.21.15.81:0/4183200038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc840536f0 0x7fcc84020ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.644+0000 7fcc92313640 1 --2- 172.21.15.81:0/4183200038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc84036e90 0x7fcc84020570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.645+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 >> 172.21.15.81:0/4183200038 conn(0x7fcc84056710 msgr2=0x7fcc840332a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.650+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 shutdown_connections 2024-09-17T05:18:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.650+0000 7fcc92313640 1 -- 172.21.15.81:0/4183200038 wait complete. 2024-09-17T05:18:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.658+0000 7f67effff640 1 -- 172.21.15.81:0/315211095 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command([{prefix=config set, name=rados_mon_op_timeout}] v 0) -- 0x7f67e4005850 con 0x7f67fc03a250 2024-09-17T05:18:23.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.666+0000 7f67fa7fc640 1 -- 172.21.15.81:0/315211095 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{prefix=config set, name=rados_mon_op_timeout}]=0 v11)=0 v11) ==== 120+0+0 (secure 0 0 0) 0x7f67f40193f0 con 0x7f67fc03a250 2024-09-17T05:18:23.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.670+0000 7f67effff640 1 -- 172.21.15.81:0/315211095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 msgr2=0x7f67fc0ce940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.670+0000 7f67effff640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc0ce940 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f67f4001e40 tx=0x7f67f4001e70 comp rx=0 tx=0).stop 2024-09-17T05:18:23.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.670+0000 7f67effff640 1 -- 172.21.15.81:0/315211095 shutdown_connections 2024-09-17T05:18:23.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.670+0000 7f67effff640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67fc0deee0 0x7f67fc0cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.670+0000 7f67effff640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67fc03a250 0x7f67fc0ce940 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.670+0000 7f67effff640 1 --2- 172.21.15.81:0/315211095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67fc0345b0 0x7f67fc032110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.670+0000 7f67effff640 1 -- 172.21.15.81:0/315211095 >> 172.21.15.81:0/315211095 conn(0x7f67fc01e000 msgr2=0x7f67fc0521c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.673 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_debug_scatterstat', 'True'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.673+0000 7f67effff640 1 -- 172.21.15.81:0/315211095 shutdown_connections 2024-09-17T05:18:23.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.675+0000 7f67effff640 1 -- 172.21.15.81:0/315211095 wait complete. 2024-09-17T05:18:23.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.688+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f9344005580 con 0x7f935c038f00 2024-09-17T05:18:23.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.700+0000 7f934b7fe640 1 -- 172.21.15.81:0/906615075 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v12)=0 v12) ==== 121+0+0 (secure 0 0 0) 0x7f93640933e0 con 0x7f935c038f00 2024-09-17T05:18:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.702+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c038f00 msgr2=0x7f935c0e83a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.702+0000 7f9363fff640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c038f00 0x7f935c0e83a0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f9364051c90 tx=0x7f936406cf10 comp rx=0 tx=0).stop 2024-09-17T05:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.707+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 shutdown_connections 2024-09-17T05:18:23.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.707+0000 7f9363fff640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f935c0e6bc0 0x7f935c048fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.707+0000 7f9363fff640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f935c038f00 0x7f935c0e83a0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.707+0000 7f9363fff640 1 --2- 172.21.15.81:0/906615075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f935c035fe0 0x7f935c0db130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.707+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 >> 172.21.15.81:0/906615075 conn(0x7f935c054560 msgr2=0x7f935c037940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.709+0000 7f7d22eed640 1 -- 172.21.15.81:0/2403000030 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_op_complaint_time}] v 0) -- 0x7f7d1c0743d0 con 0x7f7d1c205040 2024-09-17T05:18:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.709+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 shutdown_connections 2024-09-17T05:18:23.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.709+0000 7f9363fff640 1 -- 172.21.15.81:0/906615075 wait complete. 2024-09-17T05:18:23.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.721+0000 7f7d197fa640 1 -- 172.21.15.81:0/2403000030 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_op_complaint_time}]=0 v13)=0 v13) ==== 121+0+0 (secure 0 0 0) 0x7f7d1001a3c0 con 0x7f7d1c205040 2024-09-17T05:18:23.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7fe7257fa640 1 -- 172.21.15.81:0/1427600929 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command([{prefix=config set, name=rados_osd_op_timeout}] v 0) -- 0x7fe714005850 con 0x7fe7300e27a0 2024-09-17T05:18:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7f7d02ffd640 1 -- 172.21.15.81:0/2403000030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c205040 msgr2=0x7f7d1c2029a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7f7d02ffd640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c205040 0x7f7d1c2029a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f7d1000b3c0 tx=0x7f7d1000b880 comp rx=0 tx=0).stop 2024-09-17T05:18:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7f7d02ffd640 1 -- 172.21.15.81:0/2403000030 shutdown_connections 2024-09-17T05:18:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7f7d02ffd640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d1c2054c0 0x7f7d1c1fb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7f7d02ffd640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d1c205040 0x7f7d1c2029a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7f7d02ffd640 1 --2- 172.21.15.81:0/2403000030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d1c161a00 0x7f7d1c0c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.722+0000 7f7d02ffd640 1 -- 172.21.15.81:0/2403000030 >> 172.21.15.81:0/2403000030 conn(0x7f7d1c0cfb30 msgr2=0x7f7d1c0b0cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.723+0000 7f7d02ffd640 1 -- 172.21.15.81:0/2403000030 shutdown_connections 2024-09-17T05:18:23.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.723+0000 7f7d02ffd640 1 -- 172.21.15.81:0/2403000030 wait complete. 2024-09-17T05:18:23.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.729+0000 7fe7277fe640 1 -- 172.21.15.81:0/1427600929 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{prefix=config set, name=rados_osd_op_timeout}]=0 v14)=0 v14) ==== 120+0+0 (secure 0 0 0) 0x7fe738073d80 con 0x7fe7300e27a0 2024-09-17T05:18:23.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.730+0000 7fe7257fa640 1 -- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 msgr2=0x7fe7300e40a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.730+0000 7fe7257fa640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 0x7fe7300e40a0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7fe73806bbb0 tx=0x7fe738069c90 comp rx=0 tx=0).stop 2024-09-17T05:18:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.730+0000 7fe7257fa640 1 -- 172.21.15.81:0/1427600929 shutdown_connections 2024-09-17T05:18:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.730+0000 7fe7257fa640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7300e27a0 0x7fe7300e40a0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.730+0000 7fe7257fa640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73003b940 0x7fe73004fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.730+0000 7fe7257fa640 1 --2- 172.21.15.81:0/1427600929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe730037f10 0x7fe730038560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.731+0000 7fe7257fa640 1 -- 172.21.15.81:0/1427600929 >> 172.21.15.81:0/1427600929 conn(0x7fe73003a3d0 msgr2=0x7fe73003bd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.731+0000 7fe7257fa640 1 -- 172.21.15.81:0/1427600929 shutdown_connections 2024-09-17T05:18:23.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.731+0000 7fe7257fa640 1 -- 172.21.15.81:0/1427600929 wait complete. 2024-09-17T05:18:23.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.735+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_op_complaint_time}] v 0) -- 0x7f03a4005580 con 0x7f03c41fc490 2024-09-17T05:18:23.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.741+0000 7f03abfff640 1 -- 172.21.15.81:0/2286649875 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_op_complaint_time}]=0 v15)=0 v15) ==== 121+0+0 (secure 0 0 0) 0x7f03b4011a30 con 0x7f03c41fc490 2024-09-17T05:18:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c41fc490 msgr2=0x7f03c41f8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 --2- 172.21.15.81:0/2286649875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c41fc490 0x7f03c41f8ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f03b400ea60 tx=0x7f03b400ef20 comp rx=0 tx=0).stop 2024-09-17T05:18:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 shutdown_connections 2024-09-17T05:18:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 --2- 172.21.15.81:0/2286649875 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03c415d840 0x7f03c415dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 --2- 172.21.15.81:0/2286649875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03c41fc490 0x7f03c41f8ea0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 --2- 172.21.15.81:0/2286649875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03c415ade0 0x7f03c40c4d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 >> 172.21.15.81:0/2286649875 conn(0x7f03c40cfb30 msgr2=0x7f03c40ae980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 shutdown_connections 2024-09-17T05:18:23.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.743+0000 7f03c9eb6640 1 -- 172.21.15.81:0/2286649875 wait complete. 2024-09-17T05:18:23.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.746+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command([{prefix=config set, name=mds_verify_scatter}] v 0) -- 0x7fcd700c6eb0 con 0x7fcd700ae4f0 2024-09-17T05:18:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.751+0000 7fcd57fff640 1 -- 172.21.15.81:0/2602834177 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_verify_scatter}]=0 v16)=0 v16) ==== 119+0+0 (secure 0 0 0) 0x7fcd60005220 con 0x7fcd700ae4f0 2024-09-17T05:18:23.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.751+0000 7f606cff9640 1 -- 172.21.15.81:0/481179891 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command([{prefix=config set, name=mon_warn_on_pool_no_app}] v 0) -- 0x7f6054005580 con 0x7f6078073a20 2024-09-17T05:18:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.752+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd700ae4f0 msgr2=0x7fcd700c7aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 --2- 172.21.15.81:0/2602834177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd700ae4f0 0x7fcd700c7aa0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fcd60009850 tx=0x7fcd60004f60 comp rx=0 tx=0).stop 2024-09-17T05:18:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 shutdown_connections 2024-09-17T05:18:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 --2- 172.21.15.81:0/2602834177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd70161a00 0x7fcd7015f150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 --2- 172.21.15.81:0/2602834177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd700cbd70 0x7fcd70160270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 --2- 172.21.15.81:0/2602834177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd700ae4f0 0x7fcd700c7aa0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 >> 172.21.15.81:0/2602834177 conn(0x7fcd700cfb30 msgr2=0x7fcd700cff10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 shutdown_connections 2024-09-17T05:18:23.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.753+0000 7fcd75c72640 1 -- 172.21.15.81:0/2602834177 wait complete. 2024-09-17T05:18:23.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.757+0000 7f606effd640 1 -- 172.21.15.81:0/481179891 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_pool_no_app}]=0 v17)=0 v17) ==== 125+0+0 (secure 0 0 0) 0x7f6068022d20 con 0x7f6078073a20 2024-09-17T05:18:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 -- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6078073a20 msgr2=0x7f6078142110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6078073a20 0x7f6078142110 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f606800b4a0 tx=0x7f606800b960 comp rx=0 tx=0).stop 2024-09-17T05:18:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 -- 172.21.15.81:0/481179891 shutdown_connections 2024-09-17T05:18:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60780b2d20 0x7f60781f8f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60780b2940 0x7f60780aa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 --2- 172.21.15.81:0/481179891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6078073a20 0x7f6078142110 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 -- 172.21.15.81:0/481179891 >> 172.21.15.81:0/481179891 conn(0x7f60780cf860 msgr2=0x7f607806e990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 -- 172.21.15.81:0/481179891 shutdown_connections 2024-09-17T05:18:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mds_debug_scatterstat}] v 0) -- 0x7fa7400743d0 con 0x7fa740073b20 2024-09-17T05:18:23.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.758+0000 7f606cff9640 1 -- 172.21.15.81:0/481179891 wait complete. 2024-09-17T05:18:23.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.763+0000 7fa735ffb640 1 -- 172.21.15.81:0/363282910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mds_debug_scatterstat}]=0 v18)=0 v18) ==== 122+0+0 (secure 0 0 0) 0x7fa738014840 con 0x7fa740073b20 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa740073b20 msgr2=0x7fa7401fa440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa740073b20 0x7fa7401fa440 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fa73800ba50 tx=0x7fa73800bf10 comp rx=0 tx=0).stop 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 shutdown_connections 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa740161a00 0x7fa7400b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7400cbd70 0x7fa7400b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 --2- 172.21.15.81:0/363282910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa740073b20 0x7fa7401fa440 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 >> 172.21.15.81:0/363282910 conn(0x7fa7400cfb30 msgr2=0x7fa7400cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 shutdown_connections 2024-09-17T05:18:23.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7fa7475da640 1 -- 172.21.15.81:0/363282910 wait complete. 2024-09-17T05:18:23.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.765+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=osd_op_complaint_time}] v 0) -- 0x7f37c4005850 con 0x7f37e4151610 2024-09-17T05:18:23.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.770+0000 7f37e17fa640 1 -- 172.21.15.81:0/1022943671 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_op_complaint_time}]=0 v19)=0 v19) ==== 121+0+0 (secure 0 0 0) 0x7f37d803a040 con 0x7f37e4151610 2024-09-17T05:18:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e4151610 msgr2=0x7f37e40c82c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e4151610 0x7f37e40c82c0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f37d8007fd0 tx=0x7f37d8003c30 comp rx=0 tx=0).stop 2024-09-17T05:18:23.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 shutdown_connections 2024-09-17T05:18:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37e4151610 0x7f37e40c82c0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37e40ca3c0 0x7f37e40d0800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 --2- 172.21.15.81:0/1022943671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37cc0051c0 0x7f37e41554c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 >> 172.21.15.81:0/1022943671 conn(0x7f37e40d3e30 msgr2=0x7f37e40d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 shutdown_connections 2024-09-17T05:18:23.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.771+0000 7f37eaba3640 1 -- 172.21.15.81:0/1022943671 wait complete. 2024-09-17T05:18:23.780 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.781 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'mds_verify_scatter', 'True'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.781 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.784 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_mon_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.784 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mds', 'rados_osd_op_timeout', '900'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.784 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_op_complaint_time', '120'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.785 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'mon', 'mon_warn_on_pool_no_app', 'False'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.785 DEBUG:tasks.ceph:waiting for RemoteProcess(client=, args=['sudo', 'ceph', '--cluster', 'ceph', 'config', 'set', 'osd', 'osd_op_complaint_time', '180'], check_status=True, hostname='smithi081') 2024-09-17T05:18:23.785 INFO:tasks.ceph:Setting crush tunables to default 2024-09-17T05:18:23.786 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph osd crush tunables default 2024-09-17T05:18:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.924+0000 7fd54f36b640 1 -- 172.21.15.81:0/1506281497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd548151c60 msgr2=0x7fd54806fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.924+0000 7fd54f36b640 1 --2- 172.21.15.81:0/1506281497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd548151c60 0x7fd54806fe00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd544009830 tx=0x7fd54402a510 comp rx=0 tx=0).stop 2024-09-17T05:18:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.925+0000 7fd54f36b640 1 -- 172.21.15.81:0/1506281497 shutdown_connections 2024-09-17T05:18:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.925+0000 7fd54f36b640 1 --2- 172.21.15.81:0/1506281497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd54806e360 0x7fd5480c6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.925+0000 7fd54f36b640 1 --2- 172.21.15.81:0/1506281497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd548151c60 0x7fd54806fe00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.925+0000 7fd54f36b640 1 -- 172.21.15.81:0/1506281497 >> 172.21.15.81:0/1506281497 conn(0x7fd5480d0be0 msgr2=0x7fd5480d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:23.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.925+0000 7fd54f36b640 1 -- 172.21.15.81:0/1506281497 shutdown_connections 2024-09-17T05:18:23.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.925+0000 7fd54f36b640 1 -- 172.21.15.81:0/1506281497 wait complete. 2024-09-17T05:18:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.926+0000 7fd54f36b640 1 Processor -- start 2024-09-17T05:18:23.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.926+0000 7fd54f36b640 1 -- start start 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54f36b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54806e360 0x7fd548140f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54f36b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd548070340 0x7fd5481555f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54f36b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5481f6600 0x7fd54806d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54f36b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5480c6ea0 con 0x7fd54806e360 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54f36b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5480c6d20 con 0x7fd5481f6600 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54f36b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd5480c7020 con 0x7fd548070340 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54806e360 0x7fd548140f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54806e360 0x7fd548140f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57652/0 (socket says 172.21.15.81:57652) 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 -- 172.21.15.81:0/646497281 learned_addr learned my addr 172.21.15.81:0/646497281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54c906640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd548070340 0x7fd5481555f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d908640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5481f6600 0x7fd54806d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 -- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd548070340 msgr2=0x7fd5481555f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd548070340 0x7fd5481555f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 -- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5481f6600 msgr2=0x7fd54806d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5481f6600 0x7fd54806d4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 -- 172.21.15.81:0/646497281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd548155f20 con 0x7fd54806e360 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54d107640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54806e360 0x7fd548140f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd544009950 tx=0x7fd544033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd53dffb640 1 -- 172.21.15.81:0/646497281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544005c90 con 0x7fd54806e360 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd53dffb640 1 -- 172.21.15.81:0/646497281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd544031e50 con 0x7fd54806e360 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd548143950 con 0x7fd54806e360 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.927+0000 7fd53dffb640 1 -- 172.21.15.81:0/646497281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd544005260 con 0x7fd54806e360 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.928+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd548155b30 con 0x7fd54806e360 2024-09-17T05:18:23.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.928+0000 7fd53dffb640 1 -- 172.21.15.81:0/646497281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd5440047a0 con 0x7fd54806e360 2024-09-17T05:18:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.928+0000 7fd53dffb640 1 -- 172.21.15.81:0/646497281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd5440332b0 con 0x7fd54806e360 2024-09-17T05:18:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.928+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5480c7540 con 0x7fd54806e360 2024-09-17T05:18:23.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.930+0000 7fd53dffb640 1 -- 172.21.15.81:0/646497281 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fd54403f030 con 0x7fd54806e360 2024-09-17T05:18:23.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.994+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fd5480c5ca0 con 0x7fd54806e360 2024-09-17T05:18:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.997+0000 7fd53dffb640 1 -- 172.21.15.81:0/646497281 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fd544004bd0 con 0x7fd54806e360 2024-09-17T05:18:23.998 INFO:teuthology.orchestra.run.smithi081.stderr:adjusted tunables profile to default 2024-09-17T05:18:24.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54806e360 msgr2=0x7fd548140f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54806e360 0x7fd548140f90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd544009950 tx=0x7fd544033c20 comp rx=0 tx=0).stop 2024-09-17T05:18:24.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 shutdown_connections 2024-09-17T05:18:24.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5481f6600 0x7fd54806d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd548070340 0x7fd5481555f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 --2- 172.21.15.81:0/646497281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd54806e360 0x7fd548140f90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 >> 172.21.15.81:0/646497281 conn(0x7fd5480d0be0 msgr2=0x7fd5480d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:24.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 shutdown_connections 2024-09-17T05:18:24.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:23.998+0000 7fd54f36b640 1 -- 172.21.15.81:0/646497281 wait complete. 2024-09-17T05:18:24.010 INFO:tasks.ceph:check_enable_crimson: False 2024-09-17T05:18:24.010 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-17T05:18:24.010 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:24.010 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-17T05:18:24.036 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:24.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-17T05:18:24.101 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:24.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-17T05:18:24.165 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:18:24.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-17T05:18:24.230 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:24.230 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-09-17T05:18:24.255 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:24.256 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-09-17T05:18:24.321 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:24.321 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-09-17T05:18:24.387 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:18:24.387 DEBUG:teuthology.orchestra.run.smithi160:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-09-17T05:18:24.453 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 608b7932-3897-4a57-bf7a-7c872d5ac824 0 2024-09-17T05:18:24.597 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 -- 172.21.15.160:0/2858638767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 msgr2=0x7f5d200d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.597 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 --2- 172.21.15.160:0/2858638767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 0x7f5d200d2440 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5d08005fd0 tx=0x7f5d0802a490 comp rx=0 tx=0).stop 2024-09-17T05:18:24.598 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 -- 172.21.15.160:0/2858638767 shutdown_connections 2024-09-17T05:18:24.598 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 --2- 172.21.15.160:0/2858638767 >> v2:172.21.15.81:3300/0 conn(0x7f5d200b3de0 0x7f5d200b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.598 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 --2- 172.21.15.160:0/2858638767 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 0x7f5d200d2440 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.598 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 -- 172.21.15.160:0/2858638767 >> 172.21.15.160:0/2858638767 conn(0x7f5d200d3e30 msgr2=0x7f5d200d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:24.598 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 -- 172.21.15.160:0/2858638767 shutdown_connections 2024-09-17T05:18:24.598 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.595+0000 7f5d2562a640 1 -- 172.21.15.160:0/2858638767 wait complete. 2024-09-17T05:18:24.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.596+0000 7f5d2562a640 1 Processor -- start 2024-09-17T05:18:24.599 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.596+0000 7f5d2562a640 1 -- start start 2024-09-17T05:18:24.603 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d2562a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d200b3de0 0x7f5d200c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.603 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d2562a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 0x7f5d20157a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.604 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d2562a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201617f0 0x7f5d200c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.604 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d2562a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d200b4930 con 0x7f5d201617f0 2024-09-17T05:18:24.604 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d2562a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5d200b47b0 con 0x7f5d200b3de0 2024-09-17T05:18:24.604 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d2562a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5d200b4ab0 con 0x7f5d200d01b0 2024-09-17T05:18:24.604 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d200b3de0 0x7f5d200c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.605 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d200b3de0 0x7f5d200c7960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:35204/0 (socket says 172.21.15.160:35204) 2024-09-17T05:18:24.605 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 -- 172.21.15.160:0/47661897 learned_addr learned my addr 172.21.15.160:0/47661897 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:24.605 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d17fff640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 0x7f5d20157a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.605 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1f7fe640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201617f0 0x7f5d200c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.605 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 -- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 msgr2=0x7f5d20157a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.606 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 0x7f5d20157a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.606 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 -- 172.21.15.160:0/47661897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201617f0 msgr2=0x7f5d200c9060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.606 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201617f0 0x7f5d200c9060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.606 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.597+0000 7f5d1effd640 1 -- 172.21.15.160:0/47661897 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d200cdda0 con 0x7f5d200b3de0 2024-09-17T05:18:24.606 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d1effd640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d200b3de0 0x7f5d200c7960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000b3f0 tx=0x7f5d1000b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:24.606 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d177fe640 1 -- 172.21.15.160:0/47661897 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10015020 con 0x7f5d200b3de0 2024-09-17T05:18:24.607 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d177fe640 1 -- 172.21.15.160:0/47661897 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d10011920 con 0x7f5d200b3de0 2024-09-17T05:18:24.607 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d177fe640 1 -- 172.21.15.160:0/47661897 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d10011d70 con 0x7f5d200b3de0 2024-09-17T05:18:24.607 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d200c8060 con 0x7f5d200b3de0 2024-09-17T05:18:24.607 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d200c8900 con 0x7f5d200b3de0 2024-09-17T05:18:24.607 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d177fe640 1 -- 172.21.15.160:0/47661897 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5d10018020 con 0x7f5d200b3de0 2024-09-17T05:18:24.608 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.598+0000 7f5d177fe640 1 -- 172.21.15.160:0/47661897 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f5d1001a5c0 con 0x7f5d200b3de0 2024-09-17T05:18:24.608 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.599+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d200b5040 con 0x7f5d200b3de0 2024-09-17T05:18:24.608 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.601+0000 7f5d177fe640 1 -- 172.21.15.160:0/47661897 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f5d1001f030 con 0x7f5d200b3de0 2024-09-17T05:18:24.672 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.672+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "608b7932-3897-4a57-bf7a-7c872d5ac824", "id": 0} v 0) -- 0x7f5d200b5700 con 0x7f5d200b3de0 2024-09-17T05:18:24.675 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.675+0000 7f5d177fe640 1 -- 172.21.15.160:0/47661897 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "608b7932-3897-4a57-bf7a-7c872d5ac824", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f5d1001a7c0 con 0x7f5d200b3de0 2024-09-17T05:18:24.676 INFO:teuthology.orchestra.run.smithi160.stdout:0 2024-09-17T05:18:24.677 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d200b3de0 msgr2=0x7f5d200c7960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.678 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d200b3de0 0x7f5d200c7960 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f5d1000b3f0 tx=0x7f5d1000b8b0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.678 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 shutdown_connections 2024-09-17T05:18:24.678 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d201617f0 0x7f5d200c9060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.678 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d200d01b0 0x7f5d20157a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.678 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 --2- 172.21.15.160:0/47661897 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d200b3de0 0x7f5d200c7960 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 >> 172.21.15.160:0/47661897 conn(0x7f5d200d3e30 msgr2=0x7f5d200d06c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:24.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 shutdown_connections 2024-09-17T05:18:24.679 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.676+0000 7f5d2562a640 1 -- 172.21.15.160:0/47661897 wait complete. 2024-09-17T05:18:24.687 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 953bb0fd-b21c-4570-b481-7701ef72e0a4 1 2024-09-17T05:18:24.790 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.789+0000 7f3e6c565640 1 -- 172.21.15.160:0/1659656409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e6415bb40 msgr2=0x7f3e640cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.790 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.789+0000 7f3e6c565640 1 --2- 172.21.15.160:0/1659656409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e6415bb40 0x7f3e640cff70 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3e60009860 tx=0x7f3e6002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.790 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.789+0000 7f3e6c565640 1 -- 172.21.15.160:0/1659656409 shutdown_connections 2024-09-17T05:18:24.790 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.789+0000 7f3e6c565640 1 --2- 172.21.15.160:0/1659656409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e6415bb40 0x7f3e640cff70 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.790 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.789+0000 7f3e6c565640 1 -- 172.21.15.160:0/1659656409 >> 172.21.15.160:0/1659656409 conn(0x7f3e640d0be0 msgr2=0x7f3e640d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:24.790 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.789+0000 7f3e6c565640 1 -- 172.21.15.160:0/1659656409 shutdown_connections 2024-09-17T05:18:24.790 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.789+0000 7f3e6c565640 1 -- 172.21.15.160:0/1659656409 wait complete. 2024-09-17T05:18:24.793 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.790+0000 7f3e6c565640 1 Processor -- start 2024-09-17T05:18:24.793 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.790+0000 7f3e6c565640 1 -- start start 2024-09-17T05:18:24.793 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6c565640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e64073c60 0x7f3e640b6050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.793 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6c565640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e640d04b0 0x7f3e640af850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.793 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6c565640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6415bb40 0x7f3e6406dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6c565640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e640cbd40 con 0x7f3e6415bb40 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6c565640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3e640cbbc0 con 0x7f3e640d04b0 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6c565640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3e640cbec0 con 0x7f3e64073c60 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e64073c60 0x7f3e640b6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e69b00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e640d04b0 0x7f3e640af850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e64073c60 0x7f3e640b6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:57060/0 (socket says 172.21.15.160:57060) 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 -- 172.21.15.160:0/2409186559 learned_addr learned my addr 172.21.15.160:0/2409186559 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e69b00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e640d04b0 0x7f3e640af850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:35214/0 (socket says 172.21.15.160:35214) 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6ab02640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6415bb40 0x7f3e6406dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 -- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e640d04b0 msgr2=0x7f3e640af850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.794 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e640d04b0 0x7f3e640af850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 -- 172.21.15.160:0/2409186559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6415bb40 msgr2=0x7f3e6406dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6415bb40 0x7f3e6406dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6a301640 1 -- 172.21.15.160:0/2409186559 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e640b6950 con 0x7f3e64073c60 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e69b00640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e640d04b0 0x7f3e640af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.791+0000 7f3e6ab02640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6415bb40 0x7f3e6406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e6a301640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e64073c60 0x7f3e640b6050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e60009980 tx=0x7f3e60033c20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e5affd640 1 -- 172.21.15.160:0/2409186559 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60031d60 con 0x7f3e64073c60 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e5affd640 1 -- 172.21.15.160:0/2409186559 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e60033e10 con 0x7f3e64073c60 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e641f7fa0 con 0x7f3e64073c60 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e5affd640 1 -- 172.21.15.160:0/2409186559 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e60005260 con 0x7f3e64073c60 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e640b6590 con 0x7f3e64073c60 2024-09-17T05:18:24.795 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e5affd640 1 -- 172.21.15.160:0/2409186559 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f3e600047a0 con 0x7f3e64073c60 2024-09-17T05:18:24.796 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.792+0000 7f3e5affd640 1 -- 172.21.15.160:0/2409186559 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f3e600035f0 con 0x7f3e64073c60 2024-09-17T05:18:24.796 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.793+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e640cff70 con 0x7f3e64073c60 2024-09-17T05:18:24.797 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.796+0000 7f3e5affd640 1 -- 172.21.15.160:0/2409186559 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f3e6003f030 con 0x7f3e64073c60 2024-09-17T05:18:24.868 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.867+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "953bb0fd-b21c-4570-b481-7701ef72e0a4", "id": 1} v 0) -- 0x7f3e640cc670 con 0x7f3e64073c60 2024-09-17T05:18:24.871 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.871+0000 7f3e5affd640 1 -- 172.21.15.160:0/2409186559 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "953bb0fd-b21c-4570-b481-7701ef72e0a4", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f3e60004c70 con 0x7f3e64073c60 2024-09-17T05:18:24.871 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:18:24.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.871+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e64073c60 msgr2=0x7f3e640b6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.872 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.871+0000 7f3e6c565640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e64073c60 0x7f3e640b6050 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3e60009980 tx=0x7f3e60033c20 comp rx=0 tx=0).stop 2024-09-17T05:18:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.872+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 shutdown_connections 2024-09-17T05:18:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.872+0000 7f3e6c565640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e6415bb40 0x7f3e6406dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.872+0000 7f3e6c565640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e640d04b0 0x7f3e640af850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.872+0000 7f3e6c565640 1 --2- 172.21.15.160:0/2409186559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e64073c60 0x7f3e640b6050 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.872+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 >> 172.21.15.160:0/2409186559 conn(0x7f3e640d0be0 msgr2=0x7f3e6406d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.872+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 shutdown_connections 2024-09-17T05:18:24.873 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.872+0000 7f3e6c565640 1 -- 172.21.15.160:0/2409186559 wait complete. 2024-09-17T05:18:24.882 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 13bfb47c-2b02-485d-aa37-c01ea54a6f93 2 2024-09-17T05:18:24.985 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.984+0000 7fef51352640 1 -- 172.21.15.160:0/4281056909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef34004800 msgr2=0x7fef34004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.985 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.984+0000 7fef51352640 1 --2- 172.21.15.160:0/4281056909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef34004800 0x7fef34004c80 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fef40001830 tx=0x7fef34005830 comp rx=0 tx=0).stop 2024-09-17T05:18:24.985 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.984+0000 7fef51352640 1 -- 172.21.15.160:0/4281056909 shutdown_connections 2024-09-17T05:18:24.985 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.984+0000 7fef51352640 1 --2- 172.21.15.160:0/4281056909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef34004800 0x7fef34004c80 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.986 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.984+0000 7fef51352640 1 -- 172.21.15.160:0/4281056909 >> 172.21.15.160:0/4281056909 conn(0x7fef4c09aa30 msgr2=0x7fef4c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:24.986 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.984+0000 7fef51352640 1 -- 172.21.15.160:0/4281056909 shutdown_connections 2024-09-17T05:18:24.986 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.984+0000 7fef51352640 1 -- 172.21.15.160:0/4281056909 wait complete. 2024-09-17T05:18:24.988 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.985+0000 7fef51352640 1 Processor -- start 2024-09-17T05:18:24.988 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.985+0000 7fef51352640 1 -- start start 2024-09-17T05:18:24.988 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef51352640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34004800 0x7fef4c1f5200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef51352640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4c071a70 0x7fef4c0b74d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef51352640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4c0c5640 0x7fef4c0c5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef51352640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0b2420 con 0x7fef34004800 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef51352640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fef4c0d1f90 con 0x7fef4c0c5640 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef51352640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fef4c0b25a0 con 0x7fef4c071a70 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef4a7fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4c071a70 0x7fef4c0b74d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef4a7fc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4c071a70 0x7fef4c0b74d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:57090/0 (socket says 172.21.15.160:57090) 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef4a7fc640 1 -- 172.21.15.160:0/2228651565 learned_addr learned my addr 172.21.15.160:0/2228651565 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef4b7fe640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4c0c5640 0x7fef4c0c5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.986+0000 7fef4affd640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34004800 0x7fef4c1f5200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:24.989 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4b7fe640 1 -- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4c071a70 msgr2=0x7fef4c0b74d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4b7fe640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4c071a70 0x7fef4c0b74d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4b7fe640 1 -- 172.21.15.160:0/2228651565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34004800 msgr2=0x7fef4c1f5200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4b7fe640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34004800 0x7fef4c1f5200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4b7fe640 1 -- 172.21.15.160:0/2228651565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef4c1f59e0 con 0x7fef4c0c5640 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4affd640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34004800 0x7fef4c1f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4a7fc640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4c071a70 0x7fef4c0b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef4b7fe640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4c0c5640 0x7fef4c0c5ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef4c073070 tx=0x7fef44011ba0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef337fe640 1 -- 172.21.15.160:0/2228651565 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef44004230 con 0x7fef4c0c5640 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef337fe640 1 -- 172.21.15.160:0/2228651565 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fef440043f0 con 0x7fef4c0c5640 2024-09-17T05:18:24.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef4c0c7be0 con 0x7fef4c0c5640 2024-09-17T05:18:24.991 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef337fe640 1 -- 172.21.15.160:0/2228651565 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4400faf0 con 0x7fef4c0c5640 2024-09-17T05:18:24.991 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef4c0c7ec0 con 0x7fef4c0c5640 2024-09-17T05:18:24.991 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef337fe640 1 -- 172.21.15.160:0/2228651565 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fef44005020 con 0x7fef4c0c5640 2024-09-17T05:18:24.991 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.987+0000 7fef337fe640 1 -- 172.21.15.160:0/2228651565 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7fef44003a10 con 0x7fef4c0c5640 2024-09-17T05:18:24.991 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.988+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef4c0ce600 con 0x7fef4c0c5640 2024-09-17T05:18:24.991 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:24.990+0000 7fef337fe640 1 -- 172.21.15.160:0/2228651565 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fef44027080 con 0x7fef4c0c5640 2024-09-17T05:18:25.062 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.061+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "13bfb47c-2b02-485d-aa37-c01ea54a6f93", "id": 2} v 0) -- 0x7fef4c071fc0 con 0x7fef4c0c5640 2024-09-17T05:18:25.065 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.064+0000 7fef337fe640 1 -- 172.21.15.160:0/2228651565 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "13bfb47c-2b02-485d-aa37-c01ea54a6f93", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7fef44003cf0 con 0x7fef4c0c5640 2024-09-17T05:18:25.065 INFO:teuthology.orchestra.run.smithi160.stdout:2 2024-09-17T05:18:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4c0c5640 msgr2=0x7fef4c0c5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4c0c5640 0x7fef4c0c5ac0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fef4c073070 tx=0x7fef44011ba0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.066 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 shutdown_connections 2024-09-17T05:18:25.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fef4c0c5640 0x7fef4c0c5ac0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fef4c071a70 0x7fef4c0b74d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 --2- 172.21.15.160:0/2228651565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef34004800 0x7fef4c1f5200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 >> 172.21.15.160:0/2228651565 conn(0x7fef4c09aa30 msgr2=0x7fef4c06ebb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 shutdown_connections 2024-09-17T05:18:25.067 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.065+0000 7fef51352640 1 -- 172.21.15.160:0/2228651565 wait complete. 2024-09-17T05:18:25.076 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new a375dbfa-27fa-4716-a62b-bb5bc263ea28 3 2024-09-17T05:18:25.180 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.179+0000 7f2919582640 1 -- 172.21.15.160:0/1208564499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914070340 msgr2=0x7f291406dc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.179+0000 7f2919582640 1 --2- 172.21.15.160:0/1208564499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914070340 0x7f291406dc50 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f28fc009860 tx=0x7f28fc02a540 comp rx=0 tx=0).stop 2024-09-17T05:18:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.179+0000 7f2919582640 1 -- 172.21.15.160:0/1208564499 shutdown_connections 2024-09-17T05:18:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.179+0000 7f2919582640 1 --2- 172.21.15.160:0/1208564499 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914070340 0x7f291406dc50 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.179+0000 7f2919582640 1 --2- 172.21.15.160:0/1208564499 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2914151c60 0x7f291406fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.179+0000 7f2919582640 1 -- 172.21.15.160:0/1208564499 >> 172.21.15.160:0/1208564499 conn(0x7f29140d0be0 msgr2=0x7f29140d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.180+0000 7f2919582640 1 -- 172.21.15.160:0/1208564499 shutdown_connections 2024-09-17T05:18:25.181 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.180+0000 7f2919582640 1 -- 172.21.15.160:0/1208564499 wait complete. 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 Processor -- start 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 -- start start 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291406e190 0x7f291414cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2914070340 0x7f29140c8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914158260 0x7f29140b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2914073c60 con 0x7f2914070340 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f29140c7730 con 0x7f2914158260 2024-09-17T05:18:25.184 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.181+0000 7f2919582640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2914073de0 con 0x7f291406e190 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f2912ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291406e190 0x7f291414cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f29137fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914158260 0x7f29140b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f2912ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291406e190 0x7f291414cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:57100/0 (socket says 172.21.15.160:57100) 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f2912ffd640 1 -- 172.21.15.160:0/2323361275 learned_addr learned my addr 172.21.15.160:0/2323361275 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f290bfff640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2914070340 0x7f29140c8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f29137fe640 1 -- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291406e190 msgr2=0x7f291414cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f29137fe640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291406e190 0x7f291414cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f29137fe640 1 -- 172.21.15.160:0/2323361275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2914070340 msgr2=0x7f29140c8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f29137fe640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2914070340 0x7f29140c8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f29137fe640 1 -- 172.21.15.160:0/2323361275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29140b4050 con 0x7f2914158260 2024-09-17T05:18:25.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f2912ffd640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291406e190 0x7f291414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f29137fe640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914158260 0x7f29140b3b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f290c00e920 tx=0x7f290c00ede0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f290b7fe640 1 -- 172.21.15.160:0/2323361275 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c00cd20 con 0x7f2914158260 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f290b7fe640 1 -- 172.21.15.160:0/2323361275 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f290c003970 con 0x7f2914158260 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29140c8d50 con 0x7f2914158260 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f290b7fe640 1 -- 172.21.15.160:0/2323361275 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290c003dc0 con 0x7f2914158260 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2914156a60 con 0x7f2914158260 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f290b7fe640 1 -- 172.21.15.160:0/2323361275 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f290c0050d0 con 0x7f2914158260 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.182+0000 7f290b7fe640 1 -- 172.21.15.160:0/2323361275 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f290c01a3f0 con 0x7f2914158260 2024-09-17T05:18:25.186 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.183+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29140742b0 con 0x7f2914158260 2024-09-17T05:18:25.187 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.185+0000 7f290b7fe640 1 -- 172.21.15.160:0/2323361275 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f290c016020 con 0x7f2914158260 2024-09-17T05:18:25.257 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.256+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "a375dbfa-27fa-4716-a62b-bb5bc263ea28", "id": 3} v 0) -- 0x7f29140c5ca0 con 0x7f2914158260 2024-09-17T05:18:25.260 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.260+0000 7f290b7fe640 1 -- 172.21.15.160:0/2323361275 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a375dbfa-27fa-4716-a62b-bb5bc263ea28", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f290c0055a0 con 0x7f2914158260 2024-09-17T05:18:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:3 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914158260 msgr2=0x7f29140b3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914158260 0x7f29140b3b10 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f290c00e920 tx=0x7f290c00ede0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 shutdown_connections 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2914158260 0x7f29140b3b10 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2914070340 0x7f29140c8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 --2- 172.21.15.160:0/2323361275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291406e190 0x7f291414cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 >> 172.21.15.160:0/2323361275 conn(0x7f29140d0be0 msgr2=0x7f291414d2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 shutdown_connections 2024-09-17T05:18:25.262 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.261+0000 7f2919582640 1 -- 172.21.15.160:0/2323361275 wait complete. 2024-09-17T05:18:25.272 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new a812afb1-8cb9-4bcb-8a02-0aa95a036d39 4 2024-09-17T05:18:25.377 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 -- 172.21.15.160:0/445671916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e40d1fb0 msgr2=0x7f91e40cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.377 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 --2- 172.21.15.160:0/445671916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e40d1fb0 0x7f91e40cf7e0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f91cc009830 tx=0x7f91cc02a510 comp rx=0 tx=0).stop 2024-09-17T05:18:25.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 -- 172.21.15.160:0/445671916 shutdown_connections 2024-09-17T05:18:25.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 --2- 172.21.15.160:0/445671916 >> v2:172.21.15.160:3300/0 conn(0x7f91e415f6b0 0x7f91e40cfd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 --2- 172.21.15.160:0/445671916 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e40d1fb0 0x7f91e40cf7e0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 -- 172.21.15.160:0/445671916 >> 172.21.15.160:0/445671916 conn(0x7f91e409aa30 msgr2=0x7f91e409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 -- 172.21.15.160:0/445671916 shutdown_connections 2024-09-17T05:18:25.378 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.376+0000 7f91e9d52640 1 -- 172.21.15.160:0/445671916 wait complete. 2024-09-17T05:18:25.382 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.377+0000 7f91e9d52640 1 Processor -- start 2024-09-17T05:18:25.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.378+0000 7f91e9d52640 1 -- start start 2024-09-17T05:18:25.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.378+0000 7f91e9d52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91e40d1fb0 0x7f91e415c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.378+0000 7f91e9d52640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e415bad0 0x7f91e414df40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.378+0000 7f91e9d52640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91e415f6b0 0x7f91e40b6bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.378+0000 7f91e9d52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40d0260 con 0x7f91e40d1fb0 2024-09-17T05:18:25.383 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.378+0000 7f91e9d52640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f91e40b1260 con 0x7f91e415f6b0 2024-09-17T05:18:25.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.378+0000 7f91e9d52640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f91e40d03e0 con 0x7f91e415bad0 2024-09-17T05:18:25.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e415bad0 0x7f91e414df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91e415f6b0 0x7f91e40b6bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e415bad0 0x7f91e414df40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:57122/0 (socket says 172.21.15.160:57122) 2024-09-17T05:18:25.384 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 -- 172.21.15.160:0/3617657831 learned_addr learned my addr 172.21.15.160:0/3617657831 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 -- 172.21.15.160:0/3617657831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91e415f6b0 msgr2=0x7f91e40b6bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 --2- 172.21.15.160:0/3617657831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91e415f6b0 0x7f91e40b6bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 -- 172.21.15.160:0/3617657831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91e40d1fb0 msgr2=0x7f91e415c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 --2- 172.21.15.160:0/3617657831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91e40d1fb0 0x7f91e415c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 -- 172.21.15.160:0/3617657831 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91e40b7900 con 0x7f91e415bad0 2024-09-17T05:18:25.385 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e2ffd640 1 --2- 172.21.15.160:0/3617657831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e415bad0 0x7f91e414df40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91cc000c00 tx=0x7f91cc032c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91dbfff640 1 -- 172.21.15.160:0/3617657831 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc040070 con 0x7f91e415bad0 2024-09-17T05:18:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91dbfff640 1 -- 172.21.15.160:0/3617657831 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91cc0038e0 con 0x7f91e415bad0 2024-09-17T05:18:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91e406de90 con 0x7f91e415bad0 2024-09-17T05:18:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91dbfff640 1 -- 172.21.15.160:0/3617657831 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91cc003d30 con 0x7f91e415bad0 2024-09-17T05:18:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f91e414e480 con 0x7f91e415bad0 2024-09-17T05:18:25.386 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91dbfff640 1 -- 172.21.15.160:0/3617657831 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f91cc039040 con 0x7f91e415bad0 2024-09-17T05:18:25.387 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.379+0000 7f91dbfff640 1 -- 172.21.15.160:0/3617657831 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f91cc045d70 con 0x7f91e415bad0 2024-09-17T05:18:25.387 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.381+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91e406dc80 con 0x7f91e415bad0 2024-09-17T05:18:25.387 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.382+0000 7f91dbfff640 1 -- 172.21.15.160:0/3617657831 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f91cc045460 con 0x7f91e415bad0 2024-09-17T05:18:25.454 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.453+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a812afb1-8cb9-4bcb-8a02-0aa95a036d39", "id": 4} v 0) -- 0x7f91e40ce400 con 0x7f91e415bad0 2024-09-17T05:18:25.457 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.456+0000 7f91dbfff640 1 -- 172.21.15.160:0/3617657831 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a812afb1-8cb9-4bcb-8a02-0aa95a036d39", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f91cc045640 con 0x7f91e415bad0 2024-09-17T05:18:25.458 INFO:teuthology.orchestra.run.smithi160.stdout:4 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e415bad0 msgr2=0x7f91e414df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 --2- 172.21.15.160:0/3617657831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e415bad0 0x7f91e414df40 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f91cc000c00 tx=0x7f91cc032c10 comp rx=0 tx=0).stop 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 shutdown_connections 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 --2- 172.21.15.160:0/3617657831 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91e415f6b0 0x7f91e40b6bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 --2- 172.21.15.160:0/3617657831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91e415bad0 0x7f91e414df40 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 --2- 172.21.15.160:0/3617657831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91e40d1fb0 0x7f91e415c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 >> 172.21.15.160:0/3617657831 conn(0x7f91e409aa30 msgr2=0x7f91e409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 shutdown_connections 2024-09-17T05:18:25.459 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.457+0000 7f91e9d52640 1 -- 172.21.15.160:0/3617657831 wait complete. 2024-09-17T05:18:25.468 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 0b3efa63-2f52-42be-8e50-f1e229482472 5 2024-09-17T05:18:25.572 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3183867263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64151b50 msgr2=0x7f7b6415afa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 --2- 172.21.15.160:0/3183867263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64151b50 0x7f7b6415afa0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f7b640cb190 tx=0x7f7b4c02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3183867263 shutdown_connections 2024-09-17T05:18:25.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 --2- 172.21.15.160:0/3183867263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b64151b50 0x7f7b6415afa0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 --2- 172.21.15.160:0/3183867263 >> v2:172.21.15.81:3300/0 conn(0x7f7b64151770 0x7f7b6415efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3183867263 >> 172.21.15.160:0/3183867263 conn(0x7f7b640d0bb0 msgr2=0x7f7b640d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3183867263 shutdown_connections 2024-09-17T05:18:25.573 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.571+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3183867263 wait complete. 2024-09-17T05:18:25.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.573+0000 7f7b68fbb640 1 Processor -- start 2024-09-17T05:18:25.574 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.574+0000 7f7b68fbb640 1 -- start start 2024-09-17T05:18:25.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b68fbb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b6406dc50 0x7f7b64147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b68fbb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b64151770 0x7f7b640c9050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b68fbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b64151b50 0x7f7b64154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b68fbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6406e220 con 0x7f7b64151b50 2024-09-17T05:18:25.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b68fbb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7b6406e0a0 con 0x7f7b6406dc50 2024-09-17T05:18:25.577 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b68fbb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7b6406e3a0 con 0x7f7b64151770 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b6406dc50 0x7f7b64147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b6406dc50 0x7f7b64147000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:35282/0 (socket says 172.21.15.160:35282) 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b5bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b64151770 0x7f7b640c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 -- 172.21.15.160:0/3808938174 learned_addr learned my addr 172.21.15.160:0/3808938174 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b62d9d640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b64151b50 0x7f7b64154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 -- 172.21.15.160:0/3808938174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b64151770 msgr2=0x7f7b640c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b64151770 0x7f7b640c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 -- 172.21.15.160:0/3808938174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b64151b50 msgr2=0x7f7b64154240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.578 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b64151b50 0x7f7b64154240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 -- 172.21.15.160:0/3808938174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b640c9a30 con 0x7f7b6406dc50 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.575+0000 7f7b6259c640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b6406dc50 0x7f7b64147000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e9f0 tx=0x7f7b5400eeb0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.576+0000 7f7b5affd640 1 -- 172.21.15.160:0/3808938174 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b5400cd80 con 0x7f7b6406dc50 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.576+0000 7f7b5affd640 1 -- 172.21.15.160:0/3808938174 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7b54010430 con 0x7f7b6406dc50 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.576+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b640c9d10 con 0x7f7b6406dc50 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.576+0000 7f7b5affd640 1 -- 172.21.15.160:0/3808938174 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b54010840 con 0x7f7b6406dc50 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.576+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b640ca2d0 con 0x7f7b6406dc50 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.576+0000 7f7b5affd640 1 -- 172.21.15.160:0/3808938174 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7b540109e0 con 0x7f7b6406dc50 2024-09-17T05:18:25.579 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.576+0000 7f7b5affd640 1 -- 172.21.15.160:0/3808938174 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7f7b54021970 con 0x7f7b6406dc50 2024-09-17T05:18:25.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.577+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b640cc910 con 0x7f7b6406dc50 2024-09-17T05:18:25.580 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.579+0000 7f7b5affd640 1 -- 172.21.15.160:0/3808938174 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f7b640cc910 con 0x7f7b6406dc50 2024-09-17T05:18:25.663 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.663+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "0b3efa63-2f52-42be-8e50-f1e229482472", "id": 5} v 0) -- 0x7f7b6415efa0 con 0x7f7b6406dc50 2024-09-17T05:18:25.667 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.666+0000 7f7b5affd640 1 -- 172.21.15.160:0/3808938174 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "0b3efa63-2f52-42be-8e50-f1e229482472", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7f7b54018e20 con 0x7f7b6406dc50 2024-09-17T05:18:25.667 INFO:teuthology.orchestra.run.smithi160.stdout:5 2024-09-17T05:18:25.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.667+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b6406dc50 msgr2=0x7f7b64147000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.667+0000 7f7b68fbb640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b6406dc50 0x7f7b64147000 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f7b5400e9f0 tx=0x7f7b5400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.668 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.667+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 shutdown_connections 2024-09-17T05:18:25.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.667+0000 7f7b68fbb640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7b64151b50 0x7f7b64154240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.667+0000 7f7b68fbb640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7b64151770 0x7f7b640c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.667+0000 7f7b68fbb640 1 --2- 172.21.15.160:0/3808938174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7b6406dc50 0x7f7b64147000 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.667+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 >> 172.21.15.160:0/3808938174 conn(0x7f7b640d0bb0 msgr2=0x7f7b640cc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.668+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 shutdown_connections 2024-09-17T05:18:25.669 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.668+0000 7f7b68fbb640 1 -- 172.21.15.160:0/3808938174 wait complete. 2024-09-17T05:18:25.679 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 60aebdf2-4dbf-428d-953c-a11612818cae 6 2024-09-17T05:18:25.780 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.779+0000 7fbffed5d640 1 -- 172.21.15.160:0/2638258607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815bdd0 msgr2=0x7fbff80b65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.781 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.779+0000 7fbffed5d640 1 --2- 172.21.15.160:0/2638258607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815bdd0 0x7fbff80b65c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fbfe4009860 tx=0x7fbfe402a510 comp rx=0 tx=0).stop 2024-09-17T05:18:25.781 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.779+0000 7fbffed5d640 1 -- 172.21.15.160:0/2638258607 shutdown_connections 2024-09-17T05:18:25.781 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.779+0000 7fbffed5d640 1 --2- 172.21.15.160:0/2638258607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815bdd0 0x7fbff80b65c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.781 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.779+0000 7fbffed5d640 1 -- 172.21.15.160:0/2638258607 >> 172.21.15.160:0/2638258607 conn(0x7fbff80d0bb0 msgr2=0x7fbff80d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.781 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.779+0000 7fbffed5d640 1 -- 172.21.15.160:0/2638258607 shutdown_connections 2024-09-17T05:18:25.781 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.779+0000 7fbffed5d640 1 -- 172.21.15.160:0/2638258607 wait complete. 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 Processor -- start 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 -- start start 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff815b9f0 0x7fbff8151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff815bdd0 0x7fbff81f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815f730 0x7fbff80c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbff80cd170 con 0x7fbff815b9f0 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbff80cee90 con 0x7fbff815bdd0 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.781+0000 7fbffed5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbff814d950 con 0x7fbff815f730 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbff7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff815bdd0 0x7fbff81f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.785 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbff7fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff815bdd0 0x7fbff81f5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:35288/0 (socket says 172.21.15.160:35288) 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffd2fa640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815f730 0x7fbff80c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbff7fff640 1 -- 172.21.15.160:0/2571783545 learned_addr learned my addr 172.21.15.160:0/2571783545 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffcaf9640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff815b9f0 0x7fbff8151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffd2fa640 1 -- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff815bdd0 msgr2=0x7fbff81f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffd2fa640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff815bdd0 0x7fbff81f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffd2fa640 1 -- 172.21.15.160:0/2571783545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff815b9f0 msgr2=0x7fbff8151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffd2fa640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff815b9f0 0x7fbff8151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffd2fa640 1 -- 172.21.15.160:0/2571783545 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbff81f6150 con 0x7fbff815f730 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbff7fff640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff815bdd0 0x7fbff81f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffd2fa640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815f730 0x7fbff80c7090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c700 tx=0x7fbff000cbc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:25.786 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbff57fa640 1 -- 172.21.15.160:0/2571783545 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff0003b70 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbff57fa640 1 -- 172.21.15.160:0/2571783545 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbff0003d30 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbff81f6430 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbff57fa640 1 -- 172.21.15.160:0/2571783545 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbff00052d0 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.782+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fbff81f2650 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.783+0000 7fbff57fa640 1 -- 172.21.15.160:0/2571783545 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fbff0005470 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.783+0000 7fbff57fa640 1 -- 172.21.15.160:0/2571783545 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7fbff001ba40 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.783+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbff81f2460 con 0x7fbff815f730 2024-09-17T05:18:25.787 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.785+0000 7fbff57fa640 1 -- 172.21.15.160:0/2571783545 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fbff001b450 con 0x7fbff815f730 2024-09-17T05:18:25.857 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.856+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd new", "uuid": "60aebdf2-4dbf-428d-953c-a11612818cae", "id": 6} v 0) -- 0x7fbff80cf380 con 0x7fbff815f730 2024-09-17T05:18:25.860 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.859+0000 7fbff57fa640 1 -- 172.21.15.160:0/2571783545 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "60aebdf2-4dbf-428d-953c-a11612818cae", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7fbff001b630 con 0x7fbff815f730 2024-09-17T05:18:25.860 INFO:teuthology.orchestra.run.smithi160.stdout:6 2024-09-17T05:18:25.862 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815f730 msgr2=0x7fbff80c7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.862 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815f730 0x7fbff80c7090 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7fbff000c700 tx=0x7fbff000cbc0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.862 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 shutdown_connections 2024-09-17T05:18:25.862 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbff815f730 0x7fbff80c7090 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.863 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbff815bdd0 0x7fbff81f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.863 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 --2- 172.21.15.160:0/2571783545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbff815b9f0 0x7fbff8151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.863 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 >> 172.21.15.160:0/2571783545 conn(0x7fbff80d0bb0 msgr2=0x7fbff8155f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.863 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 shutdown_connections 2024-09-17T05:18:25.863 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.860+0000 7fbffed5d640 1 -- 172.21.15.160:0/2571783545 wait complete. 2024-09-17T05:18:25.871 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --cluster ceph osd new 5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563 7 2024-09-17T05:18:25.974 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 -- 172.21.15.160:0/3914653963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c0d05d0 msgr2=0x7f060c0d09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.974 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 --2- 172.21.15.160:0/3914653963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c0d05d0 0x7f060c0d09b0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f05fc009830 tx=0x7f05fc02a3f0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.974 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 -- 172.21.15.160:0/3914653963 shutdown_connections 2024-09-17T05:18:25.975 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 --2- 172.21.15.160:0/3914653963 >> v2:172.21.15.160:3300/0 conn(0x7f060c06f040 0x7f060c161f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.975 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 --2- 172.21.15.160:0/3914653963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c0d05d0 0x7f060c0d09b0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.975 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 -- 172.21.15.160:0/3914653963 >> 172.21.15.160:0/3914653963 conn(0x7f060c09d1c0 msgr2=0x7f060c0d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:25.975 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 -- 172.21.15.160:0/3914653963 shutdown_connections 2024-09-17T05:18:25.975 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.973+0000 7f06117f3640 1 -- 172.21.15.160:0/3914653963 wait complete. 2024-09-17T05:18:25.979 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.974+0000 7f06117f3640 1 Processor -- start 2024-09-17T05:18:25.979 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.974+0000 7f06117f3640 1 -- start start 2024-09-17T05:18:25.979 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f06117f3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c06f040 0x7f060c148020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.979 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f06117f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f060c0cfe10 0x7f060c0b4a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f06117f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c0d05d0 0x7f060c0b4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f06117f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f060c06d470 con 0x7f060c0d05d0 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f06117f3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f060c06d2f0 con 0x7f060c0cfe10 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f06117f3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f060c06d5f0 con 0x7f060c06f040 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060affd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c06f040 0x7f060c148020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f060c0cfe10 0x7f060c0b4a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060affd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c06f040 0x7f060c148020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.160:57158/0 (socket says 172.21.15.160:57158) 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060affd640 1 -- 172.21.15.160:0/1563073292 learned_addr learned my addr 172.21.15.160:0/1563073292 (peer_addr_for_me v2:172.21.15.160:0/0) 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f060c0cfe10 0x7f060c0b4a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.160:35304/0 (socket says 172.21.15.160:35304) 2024-09-17T05:18:25.980 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060b7fe640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c0d05d0 0x7f060c0b4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 -- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c06f040 msgr2=0x7f060c148020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c06f040 0x7f060c148020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 -- 172.21.15.160:0/1563073292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c0d05d0 msgr2=0x7f060c0b4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c0d05d0 0x7f060c0b4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 -- 172.21.15.160:0/1563073292 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f060c0c7550 con 0x7f060c0cfe10 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060affd640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c06f040 0x7f060c148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.975+0000 7f060a7fc640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f060c0cfe10 0x7f060c0b4a90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05f4005fd0 tx=0x7f05f400ee50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:25.981 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.976+0000 7f06037fe640 1 -- 172.21.15.160:0/1563073292 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f400cd00 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.976+0000 7f06037fe640 1 -- 172.21.15.160:0/1563073292 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05f4004020 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.976+0000 7f06037fe640 1 -- 172.21.15.160:0/1563073292 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05f4004410 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.976+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f060c14ac80 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.976+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f060c14af60 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.976+0000 7f06037fe640 1 -- 172.21.15.160:0/1563073292 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f05f40053b0 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.976+0000 7f06037fe640 1 -- 172.21.15.160:0/1563073292 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f05f4003d80 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.977+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f060c09d780 con 0x7f060c0cfe10 2024-09-17T05:18:25.982 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:25.979+0000 7f06037fe640 1 -- 172.21.15.160:0/1563073292 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f060c09d780 con 0x7f060c0cfe10 2024-09-17T05:18:26.052 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.051+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd new", "uuid": "5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563", "id": 7} v 0) -- 0x7f060c0d09b0 con 0x7f060c0cfe10 2024-09-17T05:18:26.055 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.054+0000 7f06037fe640 1 -- 172.21.15.160:0/1563073292 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f05f40036e0 con 0x7f060c0cfe10 2024-09-17T05:18:26.055 INFO:teuthology.orchestra.run.smithi160.stdout:7 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f060c0cfe10 msgr2=0x7f060c0b4a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f060c0cfe10 0x7f060c0b4a90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f05f4005fd0 tx=0x7f05f400ee50 comp rx=0 tx=0).stop 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 shutdown_connections 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f060c0d05d0 0x7f060c0b4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f060c0cfe10 0x7f060c0b4a90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 --2- 172.21.15.160:0/1563073292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f060c06f040 0x7f060c148020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 >> 172.21.15.160:0/1563073292 conn(0x7f060c09d1c0 msgr2=0x7f060c0cb420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 shutdown_connections 2024-09-17T05:18:26.057 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:18:26.056+0000 7f06117f3640 1 -- 172.21.15.160:0/1563073292 wait complete. 2024-09-17T05:18:26.067 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-17T05:18:26.067 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-17T05:18:26.070 INFO:tasks.ceph.osd.0:Started 2024-09-17T05:18:26.070 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-17T05:18:26.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-17T05:18:26.072 INFO:tasks.ceph.osd.1:Started 2024-09-17T05:18:26.072 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-17T05:18:26.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-17T05:18:26.074 INFO:tasks.ceph.osd.2:Started 2024-09-17T05:18:26.075 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-17T05:18:26.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-17T05:18:26.077 INFO:tasks.ceph.osd.3:Started 2024-09-17T05:18:26.077 INFO:tasks.ceph.osd.4:Restarting daemon 2024-09-17T05:18:26.077 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-09-17T05:18:26.079 INFO:tasks.ceph.osd.4:Started 2024-09-17T05:18:26.080 INFO:tasks.ceph.osd.5:Restarting daemon 2024-09-17T05:18:26.080 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-09-17T05:18:26.082 INFO:tasks.ceph.osd.5:Started 2024-09-17T05:18:26.083 INFO:tasks.ceph.osd.6:Restarting daemon 2024-09-17T05:18:26.083 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-09-17T05:18:26.085 INFO:tasks.ceph.osd.6:Started 2024-09-17T05:18:26.085 INFO:tasks.ceph.osd.7:Restarting daemon 2024-09-17T05:18:26.085 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-09-17T05:18:26.087 INFO:tasks.ceph.osd.7:Started 2024-09-17T05:18:26.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:26.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 -- 172.21.15.81:0/1191564791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c0d49c0 msgr2=0x7fa17c0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:26.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 --2- 172.21.15.81:0/1191564791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c0d49c0 0x7fa17c0b3800 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fa174005fd0 tx=0x7fa17402a820 comp rx=0 tx=0).stop 2024-09-17T05:18:26.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 -- 172.21.15.81:0/1191564791 shutdown_connections 2024-09-17T05:18:26.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 --2- 172.21.15.81:0/1191564791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c0d49c0 0x7fa17c0b3800 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 --2- 172.21.15.81:0/1191564791 >> v2:172.21.15.160:3300/0 conn(0x7fa17c0d0d40 0x7fa17c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 -- 172.21.15.81:0/1191564791 >> 172.21.15.81:0/1191564791 conn(0x7fa17c0d3ea0 msgr2=0x7fa17c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:26.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 -- 172.21.15.81:0/1191564791 shutdown_connections 2024-09-17T05:18:26.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.211+0000 7fa18436b640 1 -- 172.21.15.81:0/1191564791 wait complete. 2024-09-17T05:18:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.212+0000 7fa18436b640 1 Processor -- start 2024-09-17T05:18:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa18436b640 1 -- start start 2024-09-17T05:18:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa18436b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c0d0d40 0x7fa17c152290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa18436b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa17c0d49c0 0x7fa17c161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:26.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa18436b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c15df90 0x7fa17c0b18d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa18436b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c162690 con 0x7fa17c0d0d40 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa18436b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa17c0b3d40 con 0x7fa17c0d49c0 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa18436b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa17c0cc7e0 con 0x7fa17c15df90 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa182107640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c0d0d40 0x7fa17c152290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa182107640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c0d0d40 0x7fa17c152290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57684/0 (socket says 172.21.15.81:57684) 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa182107640 1 -- 172.21.15.81:0/89734369 learned_addr learned my addr 172.21.15.81:0/89734369 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa182908640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c15df90 0x7fa17c0b18d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.213+0000 7fa181906640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa17c0d49c0 0x7fa17c161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa182107640 1 -- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c15df90 msgr2=0x7fa17c0b18d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa182107640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c15df90 0x7fa17c0b18d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa182107640 1 -- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa17c0d49c0 msgr2=0x7fa17c161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa182107640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa17c0d49c0 0x7fa17c161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa182107640 1 -- 172.21.15.81:0/89734369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa17c1527d0 con 0x7fa17c0d0d40 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa181906640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa17c0d49c0 0x7fa17c161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa182107640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c0d0d40 0x7fa17c152290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa17800c730 tx=0x7fa17800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa16effd640 1 -- 172.21.15.81:0/89734369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa178016020 con 0x7fa17c0d0d40 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa16effd640 1 -- 172.21.15.81:0/89734369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa17800a950 con 0x7fa17c0d0d40 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa16effd640 1 -- 172.21.15.81:0/89734369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa17800ada0 con 0x7fa17c0d0d40 2024-09-17T05:18:26.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa17c0cb470 con 0x7fa17c0d0d40 2024-09-17T05:18:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa17c0cba30 con 0x7fa17c0d0d40 2024-09-17T05:18:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa16effd640 1 -- 172.21.15.81:0/89734369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa178019020 con 0x7fa17c0d0d40 2024-09-17T05:18:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.214+0000 7fa16effd640 1 -- 172.21.15.81:0/89734369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fa1780127b0 con 0x7fa17c0d0d40 2024-09-17T05:18:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.215+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa17c08d590 con 0x7fa17c0d0d40 2024-09-17T05:18:26.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.217+0000 7fa16effd640 1 -- 172.21.15.81:0/89734369 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa178020020 con 0x7fa17c0d0d40 2024-09-17T05:18:26.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.276+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa17c06d850 con 0x7fa17c0d0d40 2024-09-17T05:18:26.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.277+0000 7fa16effd640 1 -- 172.21.15.81:0/89734369 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fa17c0ce970 con 0x7fa17c0d0d40 2024-09-17T05:18:26.278 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:26.278 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":10,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:26.053020+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c0d0d40 msgr2=0x7fa17c152290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c0d0d40 0x7fa17c152290 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa17800c730 tx=0x7fa17800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 shutdown_connections 2024-09-17T05:18:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa17c15df90 0x7fa17c0b18d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa17c0d49c0 0x7fa17c161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 --2- 172.21.15.81:0/89734369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa17c0d0d40 0x7fa17c152290 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 >> 172.21.15.81:0/89734369 conn(0x7fa17c0d3ea0 msgr2=0x7fa17c0b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 shutdown_connections 2024-09-17T05:18:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:26.278+0000 7fa18436b640 1 -- 172.21.15.81:0/89734369 wait complete. 2024-09-17T05:18:26.289 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-17T05:18:26.289 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-17T05:18:27.071 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-17T05:18:27.070+0000 7fd8f802c640 -1 Falling back to public interface 2024-09-17T05:18:27.094 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:27.188 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 -- 172.21.15.81:0/3440588493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c15e300 msgr2=0x7f2c9c0ce200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:27.188 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 --2- 172.21.15.81:0/3440588493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c15e300 0x7f2c9c0ce200 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c005fd0 tx=0x7f2c8c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.189 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 -- 172.21.15.81:0/3440588493 shutdown_connections 2024-09-17T05:18:27.189 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 --2- 172.21.15.81:0/3440588493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c9c06ff00 0x7f2c9c0cb410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.189 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 --2- 172.21.15.81:0/3440588493 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c15e300 0x7f2c9c0ce200 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.189 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 -- 172.21.15.81:0/3440588493 >> 172.21.15.81:0/3440588493 conn(0x7f2c9c0b1e70 msgr2=0x7f2c9c0b2280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:27.189 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 -- 172.21.15.81:0/3440588493 shutdown_connections 2024-09-17T05:18:27.189 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.187+0000 7f2ca410e640 1 -- 172.21.15.81:0/3440588493 wait complete. 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.188+0000 7f2ca410e640 1 Processor -- start 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.188+0000 7f2ca410e640 1 -- start start 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca410e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c06ff00 0x7f2c9c1594d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca410e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c9c0ce740 0x7f2c9c09aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca410e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c9c15e300 0x7f2c9c09d810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca410e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0b2b20 con 0x7f2c9c06ff00 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca410e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2c9c0b2ca0 con 0x7f2c9c0ce740 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca410e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2c9c0cb950 con 0x7f2c9c15e300 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c06ff00 0x7f2c9c1594d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:27.192 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c06ff00 0x7f2c9c1594d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57716/0 (socket says 172.21.15.81:57716) 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 -- 172.21.15.81:0/1608349830 learned_addr learned my addr 172.21.15.81:0/1608349830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca26ab640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c9c15e300 0x7f2c9c09d810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca16a9640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c9c0ce740 0x7f2c9c09aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 -- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c9c15e300 msgr2=0x7f2c9c09d810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c9c15e300 0x7f2c9c09d810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 -- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c9c0ce740 msgr2=0x7f2c9c09aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c9c0ce740 0x7f2c9c09aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 -- 172.21.15.81:0/1608349830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c9c09ca50 con 0x7f2c9c06ff00 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca16a9640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c9c0ce740 0x7f2c9c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.189+0000 7f2ca1eaa640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c06ff00 0x7f2c9c1594d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c034040 tx=0x7f2c8c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:27.193 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.190+0000 7f2c927fc640 1 -- 172.21.15.81:0/1608349830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c03e030 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.190+0000 7f2c927fc640 1 -- 172.21.15.81:0/1608349830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c8c003ca0 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.190+0000 7f2c927fc640 1 -- 172.21.15.81:0/1608349830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c8c035040 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.190+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c9c09cd30 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.190+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c9c09d2f0 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.190+0000 7f2c927fc640 1 -- 172.21.15.81:0/1608349830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2c8c041030 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.190+0000 7f2c927fc640 1 -- 172.21.15.81:0/1608349830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f2c8c043d00 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.191+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c9c09d4c0 con 0x7f2c9c06ff00 2024-09-17T05:18:27.194 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.193+0000 7f2c927fc640 1 -- 172.21.15.81:0/1608349830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2c8c004f00 con 0x7f2c9c06ff00 2024-09-17T05:18:27.254 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.253+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2c9c068ca0 con 0x7f2c9c06ff00 2024-09-17T05:18:27.254 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.254+0000 7f2c927fc640 1 -- 172.21.15.81:0/1608349830 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f2c8c0050e0 con 0x7f2c9c06ff00 2024-09-17T05:18:27.255 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-17T05:18:27.255 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":10,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:26.053020+0000","last_up_change":"0.000000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.254+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c06ff00 msgr2=0x7f2c9c1594d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.254+0000 7f2ca410e640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c06ff00 0x7f2c9c1594d0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2c8c034040 tx=0x7f2c8c0038a0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.255+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 shutdown_connections 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.255+0000 7f2ca410e640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c9c15e300 0x7f2c9c09d810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.255+0000 7f2ca410e640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c9c0ce740 0x7f2c9c09aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.255+0000 7f2ca410e640 1 --2- 172.21.15.81:0/1608349830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c9c06ff00 0x7f2c9c1594d0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.255+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 >> 172.21.15.81:0/1608349830 conn(0x7f2c9c0b1e70 msgr2=0x7f2c9c0ccc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.255+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 shutdown_connections 2024-09-17T05:18:27.256 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:27.255+0000 7f2ca410e640 1 -- 172.21.15.81:0/1608349830 wait complete. 2024-09-17T05:18:27.265 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-09-17T05:18:27.536 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-17T05:18:27.536+0000 7f401a61c640 -1 Falling back to public interface 2024-09-17T05:18:27.539 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-17T05:18:27.539+0000 7fe37680b640 -1 Falling back to public interface 2024-09-17T05:18:27.547 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-17T05:18:27.547+0000 7f4113ee4640 -1 Falling back to public interface 2024-09-17T05:18:27.555 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-17T05:18:27.555+0000 7fb4c5b17640 -1 Falling back to public interface 2024-09-17T05:18:27.781 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-17T05:18:27.780+0000 7f23260fe640 -1 Falling back to public interface 2024-09-17T05:18:27.804 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-17T05:18:27.803+0000 7f87e4831640 -1 Falling back to public interface 2024-09-17T05:18:28.048 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-17T05:18:28.047+0000 7fb2293a8640 -1 Falling back to public interface 2024-09-17T05:18:28.380 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:18:28.379+0000 7f03eb08f640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-09-17T05:18:28.382 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:18:28.381+0000 7f03eb08f640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-09-17T05:18:30.594 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-17T05:18:30.593+0000 7fd8f802c640 -1 osd.0 0 log_to_monitors true 2024-09-17T05:18:31.603 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-17T05:18:31.602+0000 7f23260fe640 -1 osd.3 0 log_to_monitors true 2024-09-17T05:18:31.623 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-17T05:18:31.622+0000 7f4113ee4640 -1 osd.6 0 log_to_monitors true 2024-09-17T05:18:31.656 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-17T05:18:31.655+0000 7fb4c5b17640 -1 osd.4 0 log_to_monitors true 2024-09-17T05:18:31.808 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-17T05:18:31.807+0000 7fb2293a8640 -1 osd.2 0 log_to_monitors true 2024-09-17T05:18:31.869 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-17T05:18:31.868+0000 7fe37680b640 -1 osd.5 0 log_to_monitors true 2024-09-17T05:18:31.882 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-17T05:18:31.881+0000 7f87e4831640 -1 osd.1 0 log_to_monitors true 2024-09-17T05:18:32.096 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-17T05:18:32.095+0000 7f401a61c640 -1 osd.7 0 log_to_monitors true 2024-09-17T05:18:33.216 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-17T05:18:33.215+0000 7fd8f3585640 -1 osd.0 0 waiting for initial osdmap 2024-09-17T05:18:33.233 INFO:tasks.ceph.osd.0.smithi081.stderr:2024-09-17T05:18:33.233+0000 7fd8eb3a4640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:34.073 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:34.172 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.170+0000 7f9b0829b640 1 -- 172.21.15.81:0/4043032059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aec004800 msgr2=0x7f9aec004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:34.172 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.170+0000 7f9b0829b640 1 --2- 172.21.15.81:0/4043032059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aec004800 0x7f9aec004c80 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f9af0009b20 tx=0x7f9aec005830 comp rx=0 tx=0).stop 2024-09-17T05:18:34.172 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.170+0000 7f9b0829b640 1 -- 172.21.15.81:0/4043032059 shutdown_connections 2024-09-17T05:18:34.172 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.170+0000 7f9b0829b640 1 --2- 172.21.15.81:0/4043032059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9aec004800 0x7f9aec004c80 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.173 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.170+0000 7f9b0829b640 1 -- 172.21.15.81:0/4043032059 >> 172.21.15.81:0/4043032059 conn(0x7f9b000b1640 msgr2=0x7f9b000b1a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:34.173 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.170+0000 7f9b0829b640 1 -- 172.21.15.81:0/4043032059 shutdown_connections 2024-09-17T05:18:34.173 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.170+0000 7f9b0829b640 1 -- 172.21.15.81:0/4043032059 wait complete. 2024-09-17T05:18:34.173 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.171+0000 7f9b0829b640 1 Processor -- start 2024-09-17T05:18:34.173 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.171+0000 7f9b0829b640 1 -- start start 2024-09-17T05:18:34.176 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b0829b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9aec004800 0x7f9b0015ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:34.176 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b0829b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b0015d250 0x7f9b00138f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:34.176 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b0829b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b001432a0 0x7f9b00143720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b0829b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b000cf020 con 0x7f9b001432a0 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b0829b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9b00145280 con 0x7f9aec004800 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b0829b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9b000cf1a0 con 0x7f9b0015d250 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b001432a0 0x7f9b00143720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b001432a0 0x7f9b00143720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58476/0 (socket says 172.21.15.81:58476) 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06037640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9aec004800 0x7f9b0015ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 -- 172.21.15.81:0/2389921023 learned_addr learned my addr 172.21.15.81:0/2389921023 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b05836640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b0015d250 0x7f9b00138f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 -- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b0015d250 msgr2=0x7f9b00138f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:34.177 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b0015d250 0x7f9b00138f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 -- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9aec004800 msgr2=0x7f9b0015ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9aec004800 0x7f9b0015ea40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 -- 172.21.15.81:0/2389921023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0015f510 con 0x7f9b001432a0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9b06838640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b001432a0 0x7f9b00143720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9af8000f80 tx=0x7f9af800eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.172+0000 7f9af6ffd640 1 -- 172.21.15.81:0/2389921023 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8015070 con 0x7f9b001432a0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.173+0000 7f9af6ffd640 1 -- 172.21.15.81:0/2389921023 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9af800cb00 con 0x7f9b001432a0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.173+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b001f2cf0 con 0x7f9b001432a0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.173+0000 7f9af6ffd640 1 -- 172.21.15.81:0/2389921023 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af8011460 con 0x7f9b001432a0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.173+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b001f32b0 con 0x7f9b001432a0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.174+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b00136ff0 con 0x7f9b001432a0 2024-09-17T05:18:34.178 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.175+0000 7f9af6ffd640 1 -- 172.21.15.81:0/2389921023 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f9af8018070 con 0x7f9b001432a0 2024-09-17T05:18:34.179 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.175+0000 7f9af6ffd640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ae4078b30 0x7f9ae407aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:34.179 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.175+0000 7f9af6ffd640 1 -- 172.21.15.81:0/2389921023 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2511+0+0 (secure 0 0 0) 0x7f9af809a2d0 con 0x7f9b001432a0 2024-09-17T05:18:34.179 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.175+0000 7f9b06037640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ae4078b30 0x7f9ae407aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:34.179 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.176+0000 7f9b06037640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ae4078b30 0x7f9ae407aff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9afc000c00 tx=0x7f9afc006ca0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:34.181 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.180+0000 7f9af6ffd640 1 -- 172.21.15.81:0/2389921023 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9b00136ff0 con 0x7f9b001432a0 2024-09-17T05:18:34.392 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.391+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9b00076630 con 0x7f9b001432a0 2024-09-17T05:18:34.428 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.427+0000 7f9af6ffd640 1 -- 172.21.15.81:0/2389921023 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) ==== 74+0+7555 (secure 0 0 0) 0x7f9af8062f40 con 0x7f9b001432a0 2024-09-17T05:18:34.429 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-17T05:18:34.429 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":13,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:33.388034+0000","last_up_change":"2024-09-17T05:18:33.388034+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:34.432 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ae4078b30 msgr2=0x7f9ae407aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:34.432 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ae4078b30 0x7f9ae407aff0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9afc000c00 tx=0x7f9afc006ca0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.432 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b001432a0 msgr2=0x7f9b00143720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:34.433 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b001432a0 0x7f9b00143720 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f9af8000f80 tx=0x7f9af800eb40 comp rx=0 tx=0).stop 2024-09-17T05:18:34.433 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 shutdown_connections 2024-09-17T05:18:34.433 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ae4078b30 0x7f9ae407aff0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.433 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b001432a0 0x7f9b00143720 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.433 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b0015d250 0x7f9b00138f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.433 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 --2- 172.21.15.81:0/2389921023 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9aec004800 0x7f9b0015ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:34.433 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 >> 172.21.15.81:0/2389921023 conn(0x7f9b000b1640 msgr2=0x7f9b0006e5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:34.434 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 shutdown_connections 2024-09-17T05:18:34.434 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:34.431+0000 7f9b0829b640 1 -- 172.21.15.81:0/2389921023 wait complete. 2024-09-17T05:18:34.442 DEBUG:teuthology.misc:1 of 8 OSDs are up 2024-09-17T05:18:35.065 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-17T05:18:35.064+0000 7fb225b4b640 -1 osd.2 0 waiting for initial osdmap 2024-09-17T05:18:35.074 INFO:tasks.ceph.osd.2.smithi081.stderr:2024-09-17T05:18:35.074+0000 7fb21d156640 -1 osd.2 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:35.085 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-17T05:18:35.084+0000 7f87e07c0640 -1 osd.1 0 waiting for initial osdmap 2024-09-17T05:18:35.093 INFO:tasks.ceph.osd.1.smithi081.stderr:2024-09-17T05:18:35.093+0000 7f87d85df640 -1 osd.1 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:35.141 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-17T05:18:35.141+0000 7f232208d640 -1 osd.3 0 waiting for initial osdmap 2024-09-17T05:18:35.156 INFO:tasks.ceph.osd.3.smithi081.stderr:2024-09-17T05:18:35.155+0000 7f2319eac640 -1 osd.3 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:35.386 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-17T05:18:35.385+0000 7f40165ab640 -1 osd.7 0 waiting for initial osdmap 2024-09-17T05:18:35.398 INFO:tasks.ceph.osd.7.smithi160.stderr:2024-09-17T05:18:35.398+0000 7f400e3ca640 -1 osd.7 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:35.452 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-17T05:18:35.451+0000 7fb4c22ba640 -1 osd.4 0 waiting for initial osdmap 2024-09-17T05:18:35.465 INFO:tasks.ceph.osd.4.smithi160.stderr:2024-09-17T05:18:35.465+0000 7fb4b98c5640 -1 osd.4 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:35.467 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-17T05:18:35.467+0000 7fe3728ab640 -1 osd.5 0 waiting for initial osdmap 2024-09-17T05:18:35.481 INFO:tasks.ceph.osd.5.smithi160.stderr:2024-09-17T05:18:35.481+0000 7fe369eb6640 -1 osd.5 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:35.517 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-17T05:18:35.517+0000 7f410fe73640 -1 osd.6 0 waiting for initial osdmap 2024-09-17T05:18:35.527 INFO:tasks.ceph.osd.6.smithi160.stderr:2024-09-17T05:18:35.527+0000 7f4107c92640 -1 osd.6 14 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-17T05:18:41.249 DEBUG:teuthology.orchestra.run.smithi081:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 -- 172.21.15.81:0/2292812838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00b9b70 msgr2=0x7f99c0167b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/2292812838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00b9b70 0x7f99c0167b50 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f99b8005fd0 tx=0x7f99b802aa90 comp rx=0 tx=0).stop 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 -- 172.21.15.81:0/2292812838 shutdown_connections 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/2292812838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00b9b70 0x7f99c0167b50 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/2292812838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c00d0fd0 0x7f99c00d45c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 -- 172.21.15.81:0/2292812838 >> 172.21.15.81:0/2292812838 conn(0x7f99c009d150 msgr2=0x7f99c00d3eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 -- 172.21.15.81:0/2292812838 shutdown_connections 2024-09-17T05:18:41.353 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.351+0000 7f99c6a5a640 1 -- 172.21.15.81:0/2292812838 wait complete. 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.353+0000 7f99c6a5a640 1 Processor -- start 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.353+0000 7f99c6a5a640 1 -- start start 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c00b9b70 0x7f99c01f8830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00d0fd0 0x7f99c015af60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99c015e030 0x7f99c015a120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0168210 con 0x7f99c00d0fd0 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f99c0168090 con 0x7f99c015e030 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f99c0168390 con 0x7f99c00b9b70 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00d0fd0 0x7f99c015af60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00d0fd0 0x7f99c015af60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58482/0 (socket says 172.21.15.81:58482) 2024-09-17T05:18:41.356 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 -- 172.21.15.81:0/3460506731 learned_addr learned my addr 172.21.15.81:0/3460506731 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c4ff7640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99c015e030 0x7f99c015a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bffff640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c00b9b70 0x7f99c01f8830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 -- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c00b9b70 msgr2=0x7f99c01f8830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c00b9b70 0x7f99c01f8830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 -- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99c015e030 msgr2=0x7f99c015a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99c015e030 0x7f99c015a120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 -- 172.21.15.81:0/3460506731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99c015b4a0 con 0x7f99c00d0fd0 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bf7fe640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00d0fd0 0x7f99c015af60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99b400e9f0 tx=0x7f99b400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bcff9640 1 -- 172.21.15.81:0/3460506731 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b400cd80 con 0x7f99c00d0fd0 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bcff9640 1 -- 172.21.15.81:0/3460506731 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f99b4010430 con 0x7f99c00d0fd0 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99bcff9640 1 -- 172.21.15.81:0/3460506731 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99b4010840 con 0x7f99c00d0fd0 2024-09-17T05:18:41.357 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99c01f4c40 con 0x7f99c00d0fd0 2024-09-17T05:18:41.358 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.354+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99c01f5200 con 0x7f99c00d0fd0 2024-09-17T05:18:41.358 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.355+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99c00d45c0 con 0x7f99c00d0fd0 2024-09-17T05:18:41.359 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.356+0000 7f99bcff9640 1 -- 172.21.15.81:0/3460506731 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7f99b40109e0 con 0x7f99c00d0fd0 2024-09-17T05:18:41.359 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.357+0000 7f99bcff9640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f99ac078b30 0x7f99ac07aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.359 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.357+0000 7f99bcff9640 1 -- 172.21.15.81:0/3460506731 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f99b409b2b0 con 0x7f99c00d0fd0 2024-09-17T05:18:41.359 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.357+0000 7f99bffff640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f99ac078b30 0x7f99ac07aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.359 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.357+0000 7f99bffff640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f99ac078b30 0x7f99ac07aff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99b0001720 tx=0x7f99b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:41.362 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.361+0000 7f99bcff9640 1 -- 172.21.15.81:0/3460506731 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f99c015b4a0 con 0x7f99c00d0fd0 2024-09-17T05:18:41.543 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.542+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f99c00d06a0 con 0x7f99c00d0fd0 2024-09-17T05:18:41.543 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.543+0000 7f99bcff9640 1 -- 172.21.15.81:0/3460506731 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+12896 (secure 0 0 0) 0x7f99b40636b0 con 0x7f99c00d0fd0 2024-09-17T05:18:41.544 INFO:teuthology.misc.health.smithi081.stdout: 2024-09-17T05:18:41.544 INFO:teuthology.misc.health.smithi081.stdout:{"epoch":19,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:40.081203+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f99ac078b30 msgr2=0x7f99ac07aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f99ac078b30 0x7f99ac07aff0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f99b0001720 tx=0x7f99b0009040 comp rx=0 tx=0).stop 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00d0fd0 msgr2=0x7f99c015af60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00d0fd0 0x7f99c015af60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f99b400e9f0 tx=0x7f99b400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 shutdown_connections 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f99ac078b30 0x7f99ac07aff0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f99c015e030 0x7f99c015a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.546 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f99c00d0fd0 0x7f99c015af60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 --2- 172.21.15.81:0/3460506731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f99c00b9b70 0x7f99c01f8830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 >> 172.21.15.81:0/3460506731 conn(0x7f99c009d150 msgr2=0x7f99c00b7e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:41.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 shutdown_connections 2024-09-17T05:18:41.547 INFO:teuthology.misc.health.smithi081.stderr:2024-09-17T05:18:41.545+0000 7f99c6a5a640 1 -- 172.21.15.81:0/3460506731 wait complete. 2024-09-17T05:18:41.555 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-09-17T05:18:41.555 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-17T05:18:41.556 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:18:41.556 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:18:41.558 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:18:41.558 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:18:41.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:18:41.560 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:18:41.561 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:18:41.561 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:18:41.564 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:18:41.564 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:18:41.564 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:18:41.566 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:18:41.566 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-09-17T05:18:41.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:18:41.632 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:18:41.633 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:18:41.640 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:18:41.641 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:18:41.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.671+0000 7fe237816640 1 -- 172.21.15.81:0/1958943212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21c003fd0 msgr2=0x7fe21c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.671+0000 7fe237816640 1 --2- 172.21.15.81:0/1958943212 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe21c003fd0 0x7fe21c004800 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe22000c4d0 tx=0x7fe21c005830 comp rx=0 tx=0).stop 2024-09-17T05:18:41.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.671+0000 7fe235db3640 1 -- 172.21.15.81:0/1958943212 reap_dead start 2024-09-17T05:18:41.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.671+0000 7fe237816640 1 -- 172.21.15.81:0/1958943212 shutdown_connections 2024-09-17T05:18:41.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.671+0000 7fe237816640 1 -- 172.21.15.81:0/1958943212 >> 172.21.15.81:0/1958943212 conn(0x7fe2300d3ea0 msgr2=0x7fe2300d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:41.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.671+0000 7fe237816640 1 -- 172.21.15.81:0/1958943212 shutdown_connections 2024-09-17T05:18:41.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.671+0000 7fe237816640 1 -- 172.21.15.81:0/1958943212 wait complete. 2024-09-17T05:18:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.672+0000 7fe237816640 1 Processor -- start 2024-09-17T05:18:41.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.672+0000 7fe237816640 1 -- start start 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe237816640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe21c003fd0 0x7fe2300caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe237816640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe230161150 0x7fe2301f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe237816640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2301f8790 0x7fe2301f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe237816640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe230162690 con 0x7fe2301f8790 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe237816640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe2300cf9b0 con 0x7fe21c003fd0 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe237816640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe2300ca500 con 0x7fe230161150 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe235db3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2301f8790 0x7fe2301f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe235db3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2301f8790 0x7fe2301f8c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:58540/0 (socket says 172.21.15.81:58540) 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe235db3640 1 -- 172.21.15.81:0/3383996198 learned_addr learned my addr 172.21.15.81:0/3383996198 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe2355b2640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe21c003fd0 0x7fe2300caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.673+0000 7fe234db1640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe230161150 0x7fe2301f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe235db3640 1 -- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe230161150 msgr2=0x7fe2301f8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe235db3640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe230161150 0x7fe2301f8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe235db3640 1 -- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe21c003fd0 msgr2=0x7fe2300caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe235db3640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe21c003fd0 0x7fe2300caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe235db3640 1 -- 172.21.15.81:0/3383996198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2300cd6c0 con 0x7fe2301f8790 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe234db1640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe230161150 0x7fe2301f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe235db3640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2301f8790 0x7fe2301f8c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2300d1ed0 tx=0x7fe228011ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe225ffb640 1 -- 172.21.15.81:0/3383996198 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228003970 con 0x7fe2301f8790 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe225ffb640 1 -- 172.21.15.81:0/3383996198 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe228003b10 con 0x7fe2301f8790 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2300cb550 con 0x7fe2301f8790 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe225ffb640 1 -- 172.21.15.81:0/3383996198 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe228004030 con 0x7fe2301f8790 2024-09-17T05:18:41.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.674+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2300cdc20 con 0x7fe2301f8790 2024-09-17T05:18:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.675+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe23008d590 con 0x7fe2301f8790 2024-09-17T05:18:41.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.676+0000 7fe225ffb640 1 -- 172.21.15.81:0/3383996198 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 4) ==== 101385+0+0 (secure 0 0 0) 0x7fe2280041d0 con 0x7fe2301f8790 2024-09-17T05:18:41.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.676+0000 7fe225ffb640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe214078b30 0x7fe21407aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:41.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.677+0000 7fe225ffb640 1 -- 172.21.15.81:0/3383996198 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7fe22809b870 con 0x7fe2301f8790 2024-09-17T05:18:41.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.677+0000 7fe2355b2640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe214078b30 0x7fe21407aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:41.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.677+0000 7fe2355b2640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe214078b30 0x7fe21407aff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009b70 tx=0x7fe22c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.681+0000 7fe225ffb640 1 -- 172.21.15.81:0/3383996198 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe2300cd6c0 con 0x7fe2301f8790 2024-09-17T05:18:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.890+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe2300b4cb0 con 0x7fe2301f8790 2024-09-17T05:18:41.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.891+0000 7fe225ffb640 1 -- 172.21.15.81:0/3383996198 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1434 (secure 0 0 0) 0x7fe228064200 con 0x7fe2301f8790 2024-09-17T05:18:41.892 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:41.892 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":2,"btime":"2024-09-17T05:18:41:636863+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-17T05:18:41.892 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 2 2024-09-17T05:18:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe214078b30 msgr2=0x7fe21407aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe214078b30 0x7fe21407aff0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe22c009b70 tx=0x7fe22c005f90 comp rx=0 tx=0).stop 2024-09-17T05:18:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2301f8790 msgr2=0x7fe2301f8c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2301f8790 0x7fe2301f8c20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fe2300d1ed0 tx=0x7fe228011ef0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 shutdown_connections 2024-09-17T05:18:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe214078b30 0x7fe21407aff0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2301f8790 0x7fe2301f8c20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe230161150 0x7fe2301f8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 --2- 172.21.15.81:0/3383996198 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe21c003fd0 0x7fe2300caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 >> 172.21.15.81:0/3383996198 conn(0x7fe2300d3ea0 msgr2=0x7fe2300b4090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 shutdown_connections 2024-09-17T05:18:41.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:41.893+0000 7fe237816640 1 -- 172.21.15.81:0/3383996198 wait complete. 2024-09-17T05:18:43.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:18:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1597695025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c80d2410 msgr2=0x7f25c80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1597695025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c80d2410 0x7f25c80b3090 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f25c80ce590 tx=0x7f25b802a5f0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1597695025 shutdown_connections 2024-09-17T05:18:44.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1597695025 >> v2:172.21.15.160:3300/0 conn(0x7f25c815f6d0 0x7f25c815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1597695025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c80d2410 0x7f25c80b3090 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1597695025 >> 172.21.15.81:0/1597695025 conn(0x7f25c809aa30 msgr2=0x7f25c809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:44.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1597695025 shutdown_connections 2024-09-17T05:18:44.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.018+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1597695025 wait complete. 2024-09-17T05:18:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.019+0000 7f25ce1e2640 1 Processor -- start 2024-09-17T05:18:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.019+0000 7f25ce1e2640 1 -- start start 2024-09-17T05:18:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25ce1e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c80d2410 0x7f25c81f26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25ce1e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c815cdc0 0x7f25c815b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25ce1e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c815f6d0 0x7f25c80afff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25ce1e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80b13c0 con 0x7f25c815f6d0 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25ce1e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f25c80b1240 con 0x7f25c815cdc0 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25ce1e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f25c80b1540 con 0x7f25c80d2410 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c815f6d0 0x7f25c80afff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c815f6d0 0x7f25c80afff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43612/0 (socket says 172.21.15.81:43612) 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 -- 172.21.15.81:0/1718946492 learned_addr learned my addr 172.21.15.81:0/1718946492 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c77fe640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c80d2410 0x7f25c81f26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25bffff640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c815cdc0 0x7f25c815b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 -- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c80d2410 msgr2=0x7f25c81f26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c80d2410 0x7f25c81f26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 -- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c815cdc0 msgr2=0x7f25c815b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c815cdc0 0x7f25c815b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25c7fff640 1 -- 172.21.15.81:0/1718946492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25c815a050 con 0x7f25c815f6d0 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.020+0000 7f25bffff640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c815cdc0 0x7f25c815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.021+0000 7f25c7fff640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c815f6d0 0x7f25c80afff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c7b0 tx=0x7f25c000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.021+0000 7f25c4ff9640 1 -- 172.21.15.81:0/1718946492 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c0004b60 con 0x7f25c815f6d0 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.021+0000 7f25c4ff9640 1 -- 172.21.15.81:0/1718946492 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25c0004df0 con 0x7f25c815f6d0 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.021+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25c815a330 con 0x7f25c815f6d0 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.021+0000 7f25c4ff9640 1 -- 172.21.15.81:0/1718946492 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c000aa90 con 0x7f25c815f6d0 2024-09-17T05:18:44.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.021+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25c815a8f0 con 0x7f25c815f6d0 2024-09-17T05:18:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.022+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25c80b19f0 con 0x7f25c815f6d0 2024-09-17T05:18:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.022+0000 7f25c4ff9640 1 -- 172.21.15.81:0/1718946492 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f25c000ac30 con 0x7f25c815f6d0 2024-09-17T05:18:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.023+0000 7f25c4ff9640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f25a8078b90 0x7f25a807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.023+0000 7f25c4ff9640 1 -- 172.21.15.81:0/1718946492 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f25c009aca0 con 0x7f25c815f6d0 2024-09-17T05:18:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.023+0000 7f25c77fe640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f25a8078b90 0x7f25a807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.024+0000 7f25c77fe640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f25a8078b90 0x7f25a807b050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25b8033000 tx=0x7f25b8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:44.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.028+0000 7f25c4ff9640 1 -- 172.21.15.81:0/1718946492 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f25c0020070 con 0x7f25c815f6d0 2024-09-17T05:18:44.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.238+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f25c80ce3c0 con 0x7f25c815f6d0 2024-09-17T05:18:44.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.239+0000 7f25c4ff9640 1 -- 172.21.15.81:0/1718946492 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+3909 (secure 0 0 0) 0x7f25c00634c0 con 0x7f25c815f6d0 2024-09-17T05:18:44.240 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:44.240 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":3,"btime":"2024-09-17T05:18:42:637778+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4363,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-17T05:18:44.240 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 3 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f25a8078b90 msgr2=0x7f25a807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f25a8078b90 0x7f25a807b050 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f25b8033000 tx=0x7f25b8004730 comp rx=0 tx=0).stop 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c815f6d0 msgr2=0x7f25c80afff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c815f6d0 0x7f25c80afff0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f25c000c7b0 tx=0x7f25c000cc70 comp rx=0 tx=0).stop 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 shutdown_connections 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f25a8078b90 0x7f25a807b050 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25c815f6d0 0x7f25c80afff0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25c815cdc0 0x7f25c815b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 --2- 172.21.15.81:0/1718946492 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25c80d2410 0x7f25c81f26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 >> 172.21.15.81:0/1718946492 conn(0x7f25c809aa30 msgr2=0x7f25c80b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 shutdown_connections 2024-09-17T05:18:44.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.241+0000 7f25ce1e2640 1 -- 172.21.15.81:0/1718946492 wait complete. 2024-09-17T05:18:44.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:18:44.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:18:44.298 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:18:44.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 -- 172.21.15.81:0/3651367153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0073c80 msgr2=0x7f75f00ce790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3651367153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0073c80 0x7f75f00ce790 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f75f0051860 tx=0x7f75e002a820 comp rx=0 tx=0).stop 2024-09-17T05:18:44.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 -- 172.21.15.81:0/3651367153 shutdown_connections 2024-09-17T05:18:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3651367153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f0073c80 0x7f75f00ce790 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3651367153 >> v2:172.21.15.160:3300/0 conn(0x7f75f015ee20 0x7f75f00d05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 -- 172.21.15.81:0/3651367153 >> 172.21.15.81:0/3651367153 conn(0x7f75f00d0bc0 msgr2=0x7f75f00d0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 -- 172.21.15.81:0/3651367153 shutdown_connections 2024-09-17T05:18:44.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.354+0000 7f75f7ced640 1 -- 172.21.15.81:0/3651367153 wait complete. 2024-09-17T05:18:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.355+0000 7f75f7ced640 1 Processor -- start 2024-09-17T05:18:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.355+0000 7f75f7ced640 1 -- start start 2024-09-17T05:18:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f7ced640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f0073c80 0x7f75f0154a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f7ced640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f015ee20 0x7f75f006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f7ced640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f015f200 0x7f75f006d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f7ced640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00cf060 con 0x7f75f015ee20 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f7ced640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f75f00ceee0 con 0x7f75f0073c80 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f7ced640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f75f00cf1e0 con 0x7f75f015f200 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f015ee20 0x7f75f006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f015ee20 0x7f75f006cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43636/0 (socket says 172.21.15.81:43636) 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 -- 172.21.15.81:0/3925836814 learned_addr learned my addr 172.21.15.81:0/3925836814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5a89640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f0073c80 0x7f75f0154a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f628a640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f015f200 0x7f75f006d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 -- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f015f200 msgr2=0x7f75f006d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f015f200 0x7f75f006d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 -- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f0073c80 msgr2=0x7f75f0154a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f0073c80 0x7f75f0154a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 -- 172.21.15.81:0/3925836814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75f0155620 con 0x7f75f015ee20 2024-09-17T05:18:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.356+0000 7f75f5288640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f015ee20 0x7f75f006cb40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001eb0 tx=0x7f75e400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.357+0000 7f75ee7fc640 1 -- 172.21.15.81:0/3925836814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4011790 con 0x7f75f015ee20 2024-09-17T05:18:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.357+0000 7f75ee7fc640 1 -- 172.21.15.81:0/3925836814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f75e4017070 con 0x7f75f015ee20 2024-09-17T05:18:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.357+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75f0155900 con 0x7f75f015ee20 2024-09-17T05:18:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.357+0000 7f75ee7fc640 1 -- 172.21.15.81:0/3925836814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f75e4011ca0 con 0x7f75f015ee20 2024-09-17T05:18:44.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.357+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75f0155ec0 con 0x7f75f015ee20 2024-09-17T05:18:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.358+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75f00cf740 con 0x7f75f015ee20 2024-09-17T05:18:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.358+0000 7f75ee7fc640 1 -- 172.21.15.81:0/3925836814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f75e401c460 con 0x7f75f015ee20 2024-09-17T05:18:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.359+0000 7f75ee7fc640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f75dc078bc0 0x7f75dc07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.359+0000 7f75ee7fc640 1 -- 172.21.15.81:0/3925836814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f75e409a680 con 0x7f75f015ee20 2024-09-17T05:18:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.359+0000 7f75f5a89640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f75dc078bc0 0x7f75dc07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.360+0000 7f75f5a89640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f75dc078bc0 0x7f75dc07b080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009b60 tx=0x7f75e8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:44.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.363+0000 7f75ee7fc640 1 -- 172.21.15.81:0/3925836814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f75e4062f30 con 0x7f75f015ee20 2024-09-17T05:18:44.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.541+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f75f00d1770 con 0x7f75f015ee20 2024-09-17T05:18:44.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.541+0000 7f75ee7fc640 1 -- 172.21.15.81:0/3925836814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v19) ==== 84+0+65 (secure 0 0 0) 0x7f75e4062830 con 0x7f75f015ee20 2024-09-17T05:18:44.542 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:44.542 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:18:44.542 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:18:44.542 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:18:44.542 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:18:44.543 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:18:44.543 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:18:44.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f75dc078bc0 msgr2=0x7f75dc07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f75dc078bc0 0x7f75dc07b080 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f75e8009b60 tx=0x7f75e8005f90 comp rx=0 tx=0).stop 2024-09-17T05:18:44.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f015ee20 msgr2=0x7f75f006cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f015ee20 0x7f75f006cb40 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f75e4001eb0 tx=0x7f75e400c890 comp rx=0 tx=0).stop 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 shutdown_connections 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f75dc078bc0 0x7f75dc07b080 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75f015f200 0x7f75f006d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75f015ee20 0x7f75f006cb40 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 --2- 172.21.15.81:0/3925836814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75f0073c80 0x7f75f0154a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 >> 172.21.15.81:0/3925836814 conn(0x7f75f00d0bc0 msgr2=0x7f75f015d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 shutdown_connections 2024-09-17T05:18:44.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.543+0000 7f75f7ced640 1 -- 172.21.15.81:0/3925836814 wait complete. 2024-09-17T05:18:44.554 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:18:44.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:18:44.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.699+0000 7f72fd7f8640 1 -- 172.21.15.81:0/3209857915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4004800 msgr2=0x7f72e4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.699+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/3209857915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4004800 0x7f72e4004c80 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c2e0 tx=0x7f72e4005830 comp rx=0 tx=0).stop 2024-09-17T05:18:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.699+0000 7f72fd7f8640 1 -- 172.21.15.81:0/3209857915 shutdown_connections 2024-09-17T05:18:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.699+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/3209857915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e4004800 0x7f72e4004c80 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.699+0000 7f72fd7f8640 1 -- 172.21.15.81:0/3209857915 >> 172.21.15.81:0/3209857915 conn(0x7f72f80d1bc0 msgr2=0x7f72f80d1fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.699+0000 7f72fd7f8640 1 -- 172.21.15.81:0/3209857915 shutdown_connections 2024-09-17T05:18:44.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.699+0000 7f72fd7f8640 1 -- 172.21.15.81:0/3209857915 wait complete. 2024-09-17T05:18:44.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.701+0000 7f72fd7f8640 1 Processor -- start 2024-09-17T05:18:44.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.701+0000 7f72fd7f8640 1 -- start start 2024-09-17T05:18:44.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.701+0000 7f72fd7f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e4004800 0x7f72f81501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.701+0000 7f72fd7f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f80b6ee0 0x7f72f80c7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.701+0000 7f72fd7f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f80c7870 0x7f72f80b49f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.701+0000 7f72fd7f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80b26a0 con 0x7f72f80b6ee0 2024-09-17T05:18:44.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72fd7f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f72f80b2520 con 0x7f72f80c7870 2024-09-17T05:18:44.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72fd7f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f72f80b2820 con 0x7f72e4004800 2024-09-17T05:18:44.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f80b6ee0 0x7f72f80c7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f80b6ee0 0x7f72f80c7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43668/0 (socket says 172.21.15.81:43668) 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 -- 172.21.15.81:0/2140157964 learned_addr learned my addr 172.21.15.81:0/2140157964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f6ffd640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e4004800 0x7f72f81501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f77fe640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f80c7870 0x7f72f80b49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 -- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e4004800 msgr2=0x7f72f81501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e4004800 0x7f72f81501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 -- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f80c7870 msgr2=0x7f72f80b49f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f80c7870 0x7f72f80b49f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 -- 172.21.15.81:0/2140157964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72f80b5700 con 0x7f72f80b6ee0 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72f67fc640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f80b6ee0 0x7f72f80c7330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c2e0 tx=0x7f72e0001da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72ef7fe640 1 -- 172.21.15.81:0/2140157964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0031040 con 0x7f72f80b6ee0 2024-09-17T05:18:44.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72ef7fe640 1 -- 172.21.15.81:0/2140157964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72e00035f0 con 0x7f72f80b6ee0 2024-09-17T05:18:44.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72f80b6400 con 0x7f72f80b6ee0 2024-09-17T05:18:44.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72ef7fe640 1 -- 172.21.15.81:0/2140157964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72e0003a20 con 0x7f72f80b6ee0 2024-09-17T05:18:44.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.702+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72f80b7340 con 0x7f72f80b6ee0 2024-09-17T05:18:44.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.703+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72f80ce670 con 0x7f72f80b6ee0 2024-09-17T05:18:44.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.704+0000 7f72ef7fe640 1 -- 172.21.15.81:0/2140157964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72e0034070 con 0x7f72f80b6ee0 2024-09-17T05:18:44.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.704+0000 7f72ef7fe640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d8078bc0 0x7f72d807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:44.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.704+0000 7f72ef7fe640 1 -- 172.21.15.81:0/2140157964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 4857+0+0 (secure 0 0 0) 0x7f72e00ba720 con 0x7f72f80b6ee0 2024-09-17T05:18:44.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.704+0000 7f72f6ffd640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d8078bc0 0x7f72d807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:44.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.705+0000 7f72f6ffd640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d8078bc0 0x7f72d807b080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72e8001940 tx=0x7f72e8006ef0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:44.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.708+0000 7f72ef7fe640 1 -- 172.21.15.81:0/2140157964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f72e0083020 con 0x7f72f80b6ee0 2024-09-17T05:18:44.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:44.885+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f72f80c7c50 con 0x7f72f80b6ee0 2024-09-17T05:18:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.106+0000 7f72ef7fe640 1 -- 172.21.15.81:0/2140157964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v20) ==== 138+0+0 (secure 0 0 0) 0x7f72e0082920 con 0x7f72f80b6ee0 2024-09-17T05:18:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:18:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d8078bc0 msgr2=0x7f72d807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d8078bc0 0x7f72d807b080 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f72e8001940 tx=0x7f72e8006ef0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f80b6ee0 msgr2=0x7f72f80c7330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f80b6ee0 0x7f72f80c7330 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f72e000c2e0 tx=0x7f72e0001da0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 shutdown_connections 2024-09-17T05:18:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d8078bc0 0x7f72d807b080 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72f80c7870 0x7f72f80b49f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72f80b6ee0 0x7f72f80c7330 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 --2- 172.21.15.81:0/2140157964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e4004800 0x7f72f81501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.110+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 >> 172.21.15.81:0/2140157964 conn(0x7f72f80d1bc0 msgr2=0x7f72f8071cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.112+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 shutdown_connections 2024-09-17T05:18:45.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.112+0000 7f72fd7f8640 1 -- 172.21.15.81:0/2140157964 wait complete. 2024-09-17T05:18:45.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:18:45.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.233+0000 7f3b727e2640 1 -- 172.21.15.81:0/4220881939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b54003a00 msgr2=0x7f3b54003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:45.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.233+0000 7f3b727e2640 1 --2- 172.21.15.81:0/4220881939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b54003a00 0x7f3b54003e00 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c00c6e0 tx=0x7f3b54005830 comp rx=0 tx=0).stop 2024-09-17T05:18:45.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.233+0000 7f3b727e2640 1 -- 172.21.15.81:0/4220881939 shutdown_connections 2024-09-17T05:18:45.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.233+0000 7f3b727e2640 1 --2- 172.21.15.81:0/4220881939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b54003a00 0x7f3b54003e00 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.233+0000 7f3b727e2640 1 -- 172.21.15.81:0/4220881939 >> 172.21.15.81:0/4220881939 conn(0x7f3b6c0b1700 msgr2=0x7f3b6c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:45.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.233+0000 7f3b727e2640 1 -- 172.21.15.81:0/4220881939 shutdown_connections 2024-09-17T05:18:45.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.233+0000 7f3b727e2640 1 -- 172.21.15.81:0/4220881939 wait complete. 2024-09-17T05:18:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.234+0000 7f3b727e2640 1 Processor -- start 2024-09-17T05:18:45.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.235+0000 7f3b727e2640 1 -- start start 2024-09-17T05:18:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.235+0000 7f3b727e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b54003a00 0x7f3b6c153300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.235+0000 7f3b727e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c0af8e0 0x7f3b6c157230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.235+0000 7f3b727e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b6c0afd60 0x7f3b6c157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.235+0000 7f3b727e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c0cc540 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.235+0000 7f3b727e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6c0cc6c0 con 0x7f3b54003a00 2024-09-17T05:18:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.235+0000 7f3b727e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6c0cc840 con 0x7f3b6c0afd60 2024-09-17T05:18:45.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c0af8e0 0x7f3b6c157230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c0af8e0 0x7f3b6c157230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43692/0 (socket says 172.21.15.81:43692) 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 -- 172.21.15.81:0/2525557449 learned_addr learned my addr 172.21.15.81:0/2525557449 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6bfff640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b54003a00 0x7f3b6c153300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b70d7f640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b6c0afd60 0x7f3b6c157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 -- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b6c0afd60 msgr2=0x7f3b6c157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b6c0afd60 0x7f3b6c157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 -- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b54003a00 msgr2=0x7f3b6c153300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b54003a00 0x7f3b6c153300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:45.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 -- 172.21.15.81:0/2525557449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6c153a00 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b6b7fe640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c0af8e0 0x7f3b6c157230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000f7a0 tx=0x7f3b6000fc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:45.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b68ff9640 1 -- 172.21.15.81:0/2525557449 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b6000bcb0 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b68ff9640 1 -- 172.21.15.81:0/2525557449 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b6000be50 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b6c153ce0 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b68ff9640 1 -- 172.21.15.81:0/2525557449 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b600116a0 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.236+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b6c1542a0 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.237+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b6c15b950 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.238+0000 7f3b68ff9640 1 -- 172.21.15.81:0/2525557449 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3b60019020 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.238+0000 7f3b68ff9640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b58078b90 0x7f3b5807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:45.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.238+0000 7f3b68ff9640 1 -- 172.21.15.81:0/2525557449 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 5227+0+0 (secure 0 0 0) 0x7f3b6009b230 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.238+0000 7f3b6bfff640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b58078b90 0x7f3b5807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:45.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.239+0000 7f3b6bfff640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b58078b90 0x7f3b5807b050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c032000 tx=0x7f3b5c02c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:45.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.243+0000 7f3b68ff9640 1 -- 172.21.15.81:0/2525557449 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3b60063290 con 0x7f3b6c0af8e0 2024-09-17T05:18:45.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:45.418+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3b6c0c3440 con 0x7f3b6c0af8e0 2024-09-17T05:18:46.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.111+0000 7f3b68ff9640 1 -- 172.21.15.81:0/2525557449 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v21) ==== 170+0+0 (secure 0 0 0) 0x7f3b60067cc0 con 0x7f3b6c0af8e0 2024-09-17T05:18:46.112 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:18:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b58078b90 msgr2=0x7f3b5807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:46.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b58078b90 0x7f3b5807b050 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c032000 tx=0x7f3b5c02c040 comp rx=0 tx=0).stop 2024-09-17T05:18:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c0af8e0 msgr2=0x7f3b6c157230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:46.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c0af8e0 0x7f3b6c157230 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3b6000f7a0 tx=0x7f3b6000fc60 comp rx=0 tx=0).stop 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 shutdown_connections 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b58078b90 0x7f3b5807b050 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b6c0afd60 0x7f3b6c157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b6c0af8e0 0x7f3b6c157230 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 --2- 172.21.15.81:0/2525557449 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b54003a00 0x7f3b6c153300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.115+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 >> 172.21.15.81:0/2525557449 conn(0x7f3b6c0b1700 msgr2=0x7f3b6c073360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.116+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 shutdown_connections 2024-09-17T05:18:46.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.116+0000 7f3b727e2640 1 -- 172.21.15.81:0/2525557449 wait complete. 2024-09-17T05:18:46.140 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:18:46.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.244+0000 7f5aee26e640 1 -- 172.21.15.81:0/1954300083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 msgr2=0x7f5ad0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:46.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.244+0000 7f5aee26e640 1 --2- 172.21.15.81:0/1954300083 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 0x7f5ad0003e50 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f5ad8001690 tx=0x7f5ad0005830 comp rx=0 tx=0).stop 2024-09-17T05:18:46.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.244+0000 7f5aec80b640 1 -- 172.21.15.81:0/1954300083 reap_dead start 2024-09-17T05:18:46.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.244+0000 7f5aee26e640 1 -- 172.21.15.81:0/1954300083 shutdown_connections 2024-09-17T05:18:46.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.244+0000 7f5aee26e640 1 -- 172.21.15.81:0/1954300083 >> 172.21.15.81:0/1954300083 conn(0x7f5ae80b1700 msgr2=0x7f5ae80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:46.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.244+0000 7f5aee26e640 1 -- 172.21.15.81:0/1954300083 shutdown_connections 2024-09-17T05:18:46.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.244+0000 7f5aee26e640 1 -- 172.21.15.81:0/1954300083 wait complete. 2024-09-17T05:18:46.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.245+0000 7f5aee26e640 1 Processor -- start 2024-09-17T05:18:46.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5aee26e640 1 -- start start 2024-09-17T05:18:46.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5aee26e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 0x7f5ae8155eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:46.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5aee26e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ae815b280 0x7f5ae81f3950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:46.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5aee26e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ae815a9b0 0x7f5ae80c6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:46.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5aee26e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae8070690 con 0x7f5ad0003a30 2024-09-17T05:18:46.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5aee26e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5ae8070510 con 0x7f5ae815b280 2024-09-17T05:18:46.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5aee26e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5ae81f3420 con 0x7f5ae815a9b0 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5ae7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 0x7f5ae8155eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5ae7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 0x7f5ae8155eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43704/0 (socket says 172.21.15.81:43704) 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.246+0000 7f5ae7fff640 1 -- 172.21.15.81:0/794106240 learned_addr learned my addr 172.21.15.81:0/794106240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae77fe640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ae815b280 0x7f5ae81f3950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5aec80b640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ae815a9b0 0x7f5ae80c6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae7fff640 1 -- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ae815a9b0 msgr2=0x7f5ae80c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae7fff640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ae815a9b0 0x7f5ae80c6000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae7fff640 1 -- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ae815b280 msgr2=0x7f5ae81f3950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae7fff640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ae815b280 0x7f5ae81f3950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae7fff640 1 -- 172.21.15.81:0/794106240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ae81563f0 con 0x7f5ad0003a30 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae77fe640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ae815b280 0x7f5ae81f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:46.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5aec80b640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ae815a9b0 0x7f5ae80c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae7fff640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 0x7f5ae8155eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80017b0 tx=0x7f5ad8006360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae4ff9640 1 -- 172.21.15.81:0/794106240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8038070 con 0x7f5ad0003a30 2024-09-17T05:18:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae4ff9640 1 -- 172.21.15.81:0/794106240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ad8003af0 con 0x7f5ad0003a30 2024-09-17T05:18:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ae81531b0 con 0x7f5ad0003a30 2024-09-17T05:18:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5ae4ff9640 1 -- 172.21.15.81:0/794106240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ad8033420 con 0x7f5ad0003a30 2024-09-17T05:18:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.247+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ae81f3670 con 0x7f5ad0003a30 2024-09-17T05:18:46.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.248+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ae8152e70 con 0x7f5ad0003a30 2024-09-17T05:18:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.249+0000 7f5ae4ff9640 1 -- 172.21.15.81:0/794106240 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ad8043020 con 0x7f5ad0003a30 2024-09-17T05:18:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.249+0000 7f5ae4ff9640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ad4078bc0 0x7f5ad407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.250+0000 7f5ae4ff9640 1 -- 172.21.15.81:0/794106240 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 5609+0+0 (secure 0 0 0) 0x7f5ad80ba0d0 con 0x7f5ad0003a30 2024-09-17T05:18:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.250+0000 7f5ae77fe640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ad4078bc0 0x7f5ad407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:46.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.250+0000 7f5ae77fe640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ad4078bc0 0x7f5ad407b080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80b0dd0 tx=0x7f5adc00b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:46.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.254+0000 7f5ae4ff9640 1 -- 172.21.15.81:0/794106240 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5ad8082690 con 0x7f5ad0003a30 2024-09-17T05:18:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:46.466+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f5ae80d0840 con 0x7f5ad0003a30 2024-09-17T05:18:47.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.126+0000 7f5ae4ff9640 1 -- 172.21.15.81:0/794106240 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7f5ad8081f90 con 0x7f5ad0003a30 2024-09-17T05:18:47.129 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 2 and data pool 3 2024-09-17T05:18:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.139+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ad4078bc0 msgr2=0x7f5ad407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.139+0000 7f5aee26e640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ad4078bc0 0x7f5ad407b080 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5ae80b0dd0 tx=0x7f5adc00b260 comp rx=0 tx=0).stop 2024-09-17T05:18:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.139+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 msgr2=0x7f5ae8155eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.139+0000 7f5aee26e640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 0x7f5ae8155eb0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5ad80017b0 tx=0x7f5ad8006360 comp rx=0 tx=0).stop 2024-09-17T05:18:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.140+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 shutdown_connections 2024-09-17T05:18:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.140+0000 7f5aee26e640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ad4078bc0 0x7f5ad407b080 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.140+0000 7f5aee26e640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ae815a9b0 0x7f5ae80c6000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.140+0000 7f5aee26e640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ae815b280 0x7f5ae81f3950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.140+0000 7f5aee26e640 1 --2- 172.21.15.81:0/794106240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad0003a30 0x7f5ae8155eb0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.140+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 >> 172.21.15.81:0/794106240 conn(0x7f5ae80b1700 msgr2=0x7f5ae80c6c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:47.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.141+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 shutdown_connections 2024-09-17T05:18:47.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.141+0000 7f5aee26e640 1 -- 172.21.15.81:0/794106240 wait complete. 2024-09-17T05:18:47.156 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.258+0000 7fc2477f8640 1 -- 172.21.15.81:0/3945727423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 msgr2=0x7fc2400d2170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.258+0000 7fc2477f8640 1 --2- 172.21.15.81:0/3945727423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2400d2170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fc234009830 tx=0x7fc23402a530 comp rx=0 tx=0).stop 2024-09-17T05:18:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.258+0000 7fc2477f8640 1 -- 172.21.15.81:0/3945727423 shutdown_connections 2024-09-17T05:18:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.258+0000 7fc2477f8640 1 --2- 172.21.15.81:0/3945727423 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2400d2170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.258+0000 7fc2477f8640 1 -- 172.21.15.81:0/3945727423 >> 172.21.15.81:0/3945727423 conn(0x7fc240074cb0 msgr2=0x7fc24009b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.258+0000 7fc2477f8640 1 -- 172.21.15.81:0/3945727423 shutdown_connections 2024-09-17T05:18:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.258+0000 7fc2477f8640 1 -- 172.21.15.81:0/3945727423 wait complete. 2024-09-17T05:18:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.259+0000 7fc2477f8640 1 Processor -- start 2024-09-17T05:18:47.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.259+0000 7fc2477f8640 1 -- start start 2024-09-17T05:18:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc2477f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2400b1e30 0x7fc2401f5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc2477f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2401f6340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc2477f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc24015bdc0 0x7fc2401f2810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc2477f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400cf830 con 0x7fc2400d1d10 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc2477f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc2400cf6b0 con 0x7fc2400b1e30 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc2477f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc2400cc920 con 0x7fc24015bdc0 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc244d93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2401f6340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc244d93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2401f6340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43720/0 (socket says 172.21.15.81:43720) 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc244d93640 1 -- 172.21.15.81:0/940672177 learned_addr learned my addr 172.21.15.81:0/940672177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc245594640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2400b1e30 0x7fc2401f5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.260+0000 7fc245d95640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc24015bdc0 0x7fc2401f2810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc244d93640 1 -- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc24015bdc0 msgr2=0x7fc2401f2810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc244d93640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc24015bdc0 0x7fc2401f2810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc244d93640 1 -- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2400b1e30 msgr2=0x7fc2401f5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc244d93640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2400b1e30 0x7fc2401f5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc244d93640 1 -- 172.21.15.81:0/940672177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2400ca470 con 0x7fc2400d1d10 2024-09-17T05:18:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc244d93640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2401f6340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc234009950 tx=0x7fc234032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc23dffb640 1 -- 172.21.15.81:0/940672177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc234040070 con 0x7fc2400d1d10 2024-09-17T05:18:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc23dffb640 1 -- 172.21.15.81:0/940672177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc234005310 con 0x7fc2400d1d10 2024-09-17T05:18:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2400ca750 con 0x7fc2400d1d10 2024-09-17T05:18:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc23dffb640 1 -- 172.21.15.81:0/940672177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2340047a0 con 0x7fc2400d1d10 2024-09-17T05:18:47.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.261+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2401f3ae0 con 0x7fc2400d1d10 2024-09-17T05:18:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.262+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2400cac70 con 0x7fc2400d1d10 2024-09-17T05:18:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.263+0000 7fc23dffb640 1 -- 172.21.15.81:0/940672177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc234039040 con 0x7fc2400d1d10 2024-09-17T05:18:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.263+0000 7fc23dffb640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc22c078bc0 0x7fc22c07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.263+0000 7fc23dffb640 1 -- 172.21.15.81:0/940672177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7fc2340bbd00 con 0x7fc2400d1d10 2024-09-17T05:18:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.263+0000 7fc245594640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc22c078bc0 0x7fc22c07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.264+0000 7fc245594640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc22c078bc0 0x7fc22c07b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b7fb0 tx=0x7fc230009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:47.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.267+0000 7fc23dffb640 1 -- 172.21.15.81:0/940672177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc2400cac70 con 0x7fc2400d1d10 2024-09-17T05:18:47.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.444+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc24006c540 con 0x7fc2400d1d10 2024-09-17T05:18:47.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.445+0000 7fc23dffb640 1 -- 172.21.15.81:0/940672177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16678 (secure 0 0 0) 0x7fc24006c540 con 0x7fc2400d1d10 2024-09-17T05:18:47.446 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:47.446 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:46.468139+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc22c078bc0 msgr2=0x7fc22c07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc22c078bc0 0x7fc22c07b080 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fc2400b7fb0 tx=0x7fc230009040 comp rx=0 tx=0).stop 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 msgr2=0x7fc2401f6340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2401f6340 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc234009950 tx=0x7fc234032c00 comp rx=0 tx=0).stop 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 shutdown_connections 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc22c078bc0 0x7fc22c07b080 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc24015bdc0 0x7fc2401f2810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2400d1d10 0x7fc2401f6340 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 --2- 172.21.15.81:0/940672177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2400b1e30 0x7fc2401f5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 >> 172.21.15.81:0/940672177 conn(0x7fc240074cb0 msgr2=0x7fc2400af110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:47.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 shutdown_connections 2024-09-17T05:18:47.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.447+0000 7fc2477f8640 1 -- 172.21.15.81:0/940672177 wait complete. 2024-09-17T05:18:47.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.558+0000 7f6abd19c640 1 -- 172.21.15.81:0/200927943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aa4004800 msgr2=0x7f6aa4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.558+0000 7f6abd19c640 1 --2- 172.21.15.81:0/200927943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6aa4004800 0x7f6aa4004c80 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6aa0001670 tx=0x7f6aa4005830 comp rx=0 tx=0).stop 2024-09-17T05:18:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.558+0000 7f6ab759e640 1 -- 172.21.15.81:0/200927943 reap_dead start 2024-09-17T05:18:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.558+0000 7f6abd19c640 1 -- 172.21.15.81:0/200927943 shutdown_connections 2024-09-17T05:18:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.558+0000 7f6abd19c640 1 -- 172.21.15.81:0/200927943 >> 172.21.15.81:0/200927943 conn(0x7f6ab809aa30 msgr2=0x7f6ab809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.558+0000 7f6abd19c640 1 -- 172.21.15.81:0/200927943 shutdown_connections 2024-09-17T05:18:47.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.558+0000 7f6abd19c640 1 -- 172.21.15.81:0/200927943 wait complete. 2024-09-17T05:18:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.559+0000 7f6abd19c640 1 Processor -- start 2024-09-17T05:18:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.559+0000 7f6abd19c640 1 -- start start 2024-09-17T05:18:47.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6abd19c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6aa4004800 0x7f6ab81f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6abd19c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab80b0430 0x7f6ab80cb510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6abd19c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab81f2b40 0x7f6ab80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6abd19c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab80b3090 con 0x7f6ab81f2b40 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6abd19c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ab80b1b60 con 0x7f6ab80b0430 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6abd19c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6ab80b3210 con 0x7f6aa4004800 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab81f2b40 0x7f6ab80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab81f2b40 0x7f6ab80b4aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43734/0 (socket says 172.21.15.81:43734) 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 -- 172.21.15.81:0/1400757381 learned_addr learned my addr 172.21.15.81:0/1400757381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab6d9d640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6aa4004800 0x7f6ab81f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6aae59c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab80b0430 0x7f6ab80cb510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 -- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6aa4004800 msgr2=0x7f6ab81f5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6aa4004800 0x7f6ab81f5950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 -- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab80b0430 msgr2=0x7f6ab80cb510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab80b0430 0x7f6ab80cb510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 -- 172.21.15.81:0/1400757381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ab81f2360 con 0x7f6ab81f2b40 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6aae59c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab80b0430 0x7f6ab80cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.560+0000 7f6ab759e640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab81f2b40 0x7f6ab80b4aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80b11f0 tx=0x7f6ab00064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.561+0000 7f6aaffff640 1 -- 172.21.15.81:0/1400757381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab0015070 con 0x7f6ab81f2b40 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.561+0000 7f6aaffff640 1 -- 172.21.15.81:0/1400757381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ab000ea00 con 0x7f6ab81f2b40 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.561+0000 7f6aaffff640 1 -- 172.21.15.81:0/1400757381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ab000ee50 con 0x7f6ab81f2b40 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.561+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ab81f60c0 con 0x7f6ab81f2b40 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.561+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ab81f6680 con 0x7f6ab81f2b40 2024-09-17T05:18:47.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.562+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ab80d01e0 con 0x7f6ab81f2b40 2024-09-17T05:18:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.562+0000 7f6aaffff640 1 -- 172.21.15.81:0/1400757381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6ab0018070 con 0x7f6ab81f2b40 2024-09-17T05:18:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.563+0000 7f6aaffff640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6a98078b90 0x7f6a9807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.563+0000 7f6aaffff640 1 -- 172.21.15.81:0/1400757381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f6ab009b490 con 0x7f6ab81f2b40 2024-09-17T05:18:47.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.563+0000 7f6ab6d9d640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6a98078b90 0x7f6a9807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.563+0000 7f6ab6d9d640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6a98078b90 0x7f6a9807b050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8156bf0 tx=0x7f6aa8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:47.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.567+0000 7f6aaffff640 1 -- 172.21.15.81:0/1400757381 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6ab815c0e0 con 0x7f6ab81f2b40 2024-09-17T05:18:47.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.743+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ab80d29a0 con 0x7f6ab81f2b40 2024-09-17T05:18:47.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.744+0000 7f6aaffff640 1 -- 172.21.15.81:0/1400757381 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) ==== 74+0+16678 (secure 0 0 0) 0x7f6ab00633a0 con 0x7f6ab81f2b40 2024-09-17T05:18:47.745 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:47.745 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:46.468139+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6a98078b90 msgr2=0x7f6a9807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6a98078b90 0x7f6a9807b050 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f6ab8156bf0 tx=0x7f6aa8005f90 comp rx=0 tx=0).stop 2024-09-17T05:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab81f2b40 msgr2=0x7f6ab80b4aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab81f2b40 0x7f6ab80b4aa0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f6ab80b11f0 tx=0x7f6ab00064e0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 shutdown_connections 2024-09-17T05:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6a98078b90 0x7f6a9807b050 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ab81f2b40 0x7f6ab80b4aa0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ab80b0430 0x7f6ab80cb510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 --2- 172.21.15.81:0/1400757381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6aa4004800 0x7f6ab81f5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 >> 172.21.15.81:0/1400757381 conn(0x7f6ab809aa30 msgr2=0x7f6ab80b1d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 shutdown_connections 2024-09-17T05:18:47.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.746+0000 7f6abd19c640 1 -- 172.21.15.81:0/1400757381 wait complete. 2024-09-17T05:18:47.757 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:18:47.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 -- 172.21.15.81:0/2388912170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56781617f0 msgr2=0x7f56780d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 --2- 172.21.15.81:0/2388912170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56781617f0 0x7f56780d1d30 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5668005fd0 tx=0x7f566802a540 comp rx=0 tx=0).stop 2024-09-17T05:18:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 -- 172.21.15.81:0/2388912170 shutdown_connections 2024-09-17T05:18:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 --2- 172.21.15.81:0/2388912170 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56780d01b0 0x7f56780d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 --2- 172.21.15.81:0/2388912170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56781617f0 0x7f56780d1d30 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 -- 172.21.15.81:0/2388912170 >> 172.21.15.81:0/2388912170 conn(0x7f56780d3e30 msgr2=0x7f56780d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 -- 172.21.15.81:0/2388912170 shutdown_connections 2024-09-17T05:18:47.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.861+0000 7f567dc41640 1 -- 172.21.15.81:0/2388912170 wait complete. 2024-09-17T05:18:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 Processor -- start 2024-09-17T05:18:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 -- start start 2024-09-17T05:18:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780d01b0 0x7f56781543d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56780d27b0 0x7f56780b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56781617f0 0x7f56780b9370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56780d0f50 con 0x7f56780d01b0 2024-09-17T05:18:47.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f56780b5000 con 0x7f56781617f0 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f567dc41640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f56780d10d0 con 0x7f56780d27b0 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.863+0000 7f56777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780d01b0 0x7f56781543d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780d01b0 0x7f56781543d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43746/0 (socket says 172.21.15.81:43746) 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 -- 172.21.15.81:0/1806510764 learned_addr learned my addr 172.21.15.81:0/1806510764 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f566ffff640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56780d27b0 0x7f56780b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f5677fff640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56781617f0 0x7f56780b9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 -- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56780d27b0 msgr2=0x7f56780b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56780d27b0 0x7f56780b8e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 -- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56781617f0 msgr2=0x7f56780b9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56781617f0 0x7f56780b9370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 -- 172.21.15.81:0/1806510764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56780c9570 con 0x7f56780d01b0 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f56777fe640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780d01b0 0x7f56781543d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5668034040 tx=0x7f5668003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:47.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f5674ff9640 1 -- 172.21.15.81:0/1806510764 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f566803e030 con 0x7f56780d01b0 2024-09-17T05:18:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f5674ff9640 1 -- 172.21.15.81:0/1806510764 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5668003e00 con 0x7f56780d01b0 2024-09-17T05:18:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56780c9850 con 0x7f56780d01b0 2024-09-17T05:18:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f5674ff9640 1 -- 172.21.15.81:0/1806510764 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5668035040 con 0x7f56780d01b0 2024-09-17T05:18:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.864+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5678157b70 con 0x7f56780d01b0 2024-09-17T05:18:47.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.865+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56780d1610 con 0x7f56780d01b0 2024-09-17T05:18:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.866+0000 7f5674ff9640 1 -- 172.21.15.81:0/1806510764 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5668041030 con 0x7f56780d01b0 2024-09-17T05:18:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.866+0000 7f5674ff9640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5658078bc0 0x7f565807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.866+0000 7f5674ff9640 1 -- 172.21.15.81:0/1806510764 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 5709+0+0 (secure 0 0 0) 0x7f56680bb5a0 con 0x7f56780d01b0 2024-09-17T05:18:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.866+0000 7f566ffff640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5658078bc0 0x7f565807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:47.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.867+0000 7f566ffff640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5658078bc0 0x7f565807b080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56781f8110 tx=0x7f566000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:47.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:47.870+0000 7f5674ff9640 1 -- 172.21.15.81:0/1806510764 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5668083430 con 0x7f56780d01b0 2024-09-17T05:18:48.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.085+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f56780b5700 con 0x7f56780d01b0 2024-09-17T05:18:48.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.794+0000 7f5674ff9640 1 -- 172.21.15.81:0/1806510764 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v6) ==== 118+0+0 (secure 0 0 0) 0x7f5668087e60 con 0x7f56780d01b0 2024-09-17T05:18:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5658078bc0 msgr2=0x7f565807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:48.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5658078bc0 0x7f565807b080 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f56781f8110 tx=0x7f566000b390 comp rx=0 tx=0).stop 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780d01b0 msgr2=0x7f56781543d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780d01b0 0x7f56781543d0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5668034040 tx=0x7f5668003910 comp rx=0 tx=0).stop 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 shutdown_connections 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5658078bc0 0x7f565807b080 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56781617f0 0x7f56780b9370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56780d27b0 0x7f56780b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 --2- 172.21.15.81:0/1806510764 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56780d01b0 0x7f56781543d0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 >> 172.21.15.81:0/1806510764 conn(0x7f56780d3e30 msgr2=0x7f56780b0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 shutdown_connections 2024-09-17T05:18:48.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.797+0000 7f567dc41640 1 -- 172.21.15.81:0/1806510764 wait complete. 2024-09-17T05:18:48.811 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:18:48.811 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:18:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 -- 172.21.15.81:0/532882571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 msgr2=0x7f32400b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 --2- 172.21.15.81:0/532882571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 0x7f32400b4270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3238009830 tx=0x7f323802a480 comp rx=0 tx=0).stop 2024-09-17T05:18:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 -- 172.21.15.81:0/532882571 shutdown_connections 2024-09-17T05:18:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 --2- 172.21.15.81:0/532882571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 0x7f32400b4270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 --2- 172.21.15.81:0/532882571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32401617f0 0x7f32400d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 -- 172.21.15.81:0/532882571 >> 172.21.15.81:0/532882571 conn(0x7f32400d3e30 msgr2=0x7f32400d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:48.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 -- 172.21.15.81:0/532882571 shutdown_connections 2024-09-17T05:18:48.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.920+0000 7f3245964640 1 -- 172.21.15.81:0/532882571 wait complete. 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.921+0000 7f3245964640 1 Processor -- start 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.921+0000 7f3245964640 1 -- start start 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f3245964640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 0x7f32401f8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f3245964640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32400d01b0 0x7f324015fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f3245964640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32401617f0 0x7f324014ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f3245964640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32400b4930 con 0x7f32400d01b0 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f3245964640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32400b47b0 con 0x7f32400b3de0 2024-09-17T05:18:48.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f3245964640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f32400b4ab0 con 0x7f32401617f0 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32400d01b0 0x7f324015fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32400d01b0 0x7f324015fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43760/0 (socket says 172.21.15.81:43760) 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 -- 172.21.15.81:0/4240305382 learned_addr learned my addr 172.21.15.81:0/4240305382 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323f7fe640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32401617f0 0x7f324014ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323effd640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 0x7f32401f8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 -- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32401617f0 msgr2=0x7f324014ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32401617f0 0x7f324014ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 -- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 msgr2=0x7f32401f8f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 0x7f32401f8f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 -- 172.21.15.81:0/4240305382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32400c7960 con 0x7f32400d01b0 2024-09-17T05:18:48.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f323e7fc640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32400d01b0 0x7f324015fb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f323400c420 tx=0x7f323400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:48.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.922+0000 7f3227fff640 1 -- 172.21.15.81:0/4240305382 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234017070 con 0x7f32400d01b0 2024-09-17T05:18:48.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.923+0000 7f3227fff640 1 -- 172.21.15.81:0/4240305382 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32340053c0 con 0x7f32400d01b0 2024-09-17T05:18:48.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.923+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32400c7c40 con 0x7f32400d01b0 2024-09-17T05:18:48.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.923+0000 7f3227fff640 1 -- 172.21.15.81:0/4240305382 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3234003850 con 0x7f32400d01b0 2024-09-17T05:18:48.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.923+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32401f5460 con 0x7f32400d01b0 2024-09-17T05:18:48.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.923+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32400b5040 con 0x7f32400d01b0 2024-09-17T05:18:48.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.924+0000 7f3227fff640 1 -- 172.21.15.81:0/4240305382 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f323401a070 con 0x7f32400d01b0 2024-09-17T05:18:48.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.924+0000 7f3227fff640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f322c078b90 0x7f322c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:48.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.925+0000 7f3227fff640 1 -- 172.21.15.81:0/4240305382 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f323409a070 con 0x7f32400d01b0 2024-09-17T05:18:48.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.925+0000 7f323effd640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f322c078b90 0x7f322c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:48.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.925+0000 7f323effd640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f322c078b90 0x7f322c07b050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3230005fd0 tx=0x7f32300095c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:48.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:48.929+0000 7f3227fff640 1 -- 172.21.15.81:0/4240305382 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3234062540 con 0x7f32400d01b0 2024-09-17T05:18:49.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:49.141+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f32400ce2f0 con 0x7f32400d01b0 2024-09-17T05:18:50.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.125+0000 7f3227fff640 1 -- 172.21.15.81:0/4240305382 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v7) ==== 122+0+0 (secure 0 0 0) 0x7f3234061e40 con 0x7f32400d01b0 2024-09-17T05:18:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f322c078b90 msgr2=0x7f322c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f322c078b90 0x7f322c07b050 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f3230005fd0 tx=0x7f32300095c0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32400d01b0 msgr2=0x7f324015fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32400d01b0 0x7f324015fb40 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f323400c420 tx=0x7f323400c8e0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 shutdown_connections 2024-09-17T05:18:50.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f322c078b90 0x7f322c07b050 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32401617f0 0x7f324014ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32400d01b0 0x7f324015fb40 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 --2- 172.21.15.81:0/4240305382 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32400b3de0 0x7f32401f8f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 >> 172.21.15.81:0/4240305382 conn(0x7f32400d3e30 msgr2=0x7f32400d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 shutdown_connections 2024-09-17T05:18:50.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.128+0000 7f3245964640 1 -- 172.21.15.81:0/4240305382 wait complete. 2024-09-17T05:18:50.142 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:18:50.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:18:50.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 -- 172.21.15.81:0/1829281462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 msgr2=0x7f6f7c0736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 --2- 172.21.15.81:0/1829281462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0736e0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f6f7c06ff00 tx=0x7f6f6402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 -- 172.21.15.81:0/1829281462 shutdown_connections 2024-09-17T05:18:50.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 --2- 172.21.15.81:0/1829281462 >> v2:172.21.15.160:3300/0 conn(0x7f6f7c073c20 0x7f6f7c0cba00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 --2- 172.21.15.81:0/1829281462 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0736e0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 -- 172.21.15.81:0/1829281462 >> 172.21.15.81:0/1829281462 conn(0x7f6f7c0d0d10 msgr2=0x7f6f7c0d1120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 -- 172.21.15.81:0/1829281462 shutdown_connections 2024-09-17T05:18:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.249+0000 7f6f808b1640 1 -- 172.21.15.81:0/1829281462 wait complete. 2024-09-17T05:18:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.250+0000 7f6f808b1640 1 Processor -- start 2024-09-17T05:18:50.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.250+0000 7f6f808b1640 1 -- start start 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f808b1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f7c073c20 0x7f6f7c1503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f808b1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7c151830 0x7f6f7c0b5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f808b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0b5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f808b1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0cc2d0 con 0x7f6f7c15bb90 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f808b1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6f7c0cc150 con 0x7f6f7c073c20 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f808b1640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6f7c0cc450 con 0x7f6f7c151830 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0b5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0b5a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43776/0 (socket says 172.21.15.81:43776) 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 -- 172.21.15.81:0/2556953324 learned_addr learned my addr 172.21.15.81:0/2556953324 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:50.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f71d9b640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7c151830 0x7f6f7c0b5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 -- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7c151830 msgr2=0x7f6f7c0b5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7c151830 0x7f6f7c0b5500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 -- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f7c073c20 msgr2=0x7f6f7c1503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f7c073c20 0x7f6f7c1503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f7ad9d640 1 -- 172.21.15.81:0/2556953324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f7c0b60a0 con 0x7f6f7c15bb90 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.251+0000 7f6f71d9b640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7c151830 0x7f6f7c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.252+0000 7f6f7ad9d640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0b5a40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b970 tx=0x7f6f7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.252+0000 7f6f737fe640 1 -- 172.21.15.81:0/2556953324 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f74019070 con 0x7f6f7c15bb90 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.252+0000 7f6f737fe640 1 -- 172.21.15.81:0/2556953324 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f7400cc50 con 0x7f6f7c15bb90 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.252+0000 7f6f737fe640 1 -- 172.21.15.81:0/2556953324 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f740146a0 con 0x7f6f7c15bb90 2024-09-17T05:18:50.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.252+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7c0b6380 con 0x7f6f7c15bb90 2024-09-17T05:18:50.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.252+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7c0b6940 con 0x7f6f7c15bb90 2024-09-17T05:18:50.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.253+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f7c0cc900 con 0x7f6f7c15bb90 2024-09-17T05:18:50.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.253+0000 7f6f737fe640 1 -- 172.21.15.81:0/2556953324 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f7401c070 con 0x7f6f7c15bb90 2024-09-17T05:18:50.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.254+0000 7f6f737fe640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f5c078b90 0x7f6f5c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.254+0000 7f6f737fe640 1 -- 172.21.15.81:0/2556953324 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f7409ab00 con 0x7f6f7c15bb90 2024-09-17T05:18:50.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.254+0000 7f6f7a59c640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f5c078b90 0x7f6f5c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.255+0000 7f6f7a59c640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f5c078b90 0x7f6f5c07b050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0015a0 tx=0x7f6f6c007a30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:50.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.258+0000 7f6f737fe640 1 -- 172.21.15.81:0/2556953324 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6f74062f40 con 0x7f6f7c15bb90 2024-09-17T05:18:50.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.468+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6f7c069850 con 0x7f6f7c15bb90 2024-09-17T05:18:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.469+0000 7f6f737fe640 1 -- 172.21.15.81:0/2556953324 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f6f74062840 con 0x7f6f7c15bb90 2024-09-17T05:18:50.470 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:50.470 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:18:50.470 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:18:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f5c078b90 msgr2=0x7f6f5c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f5c078b90 0x7f6f5c07b050 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f6f6c0015a0 tx=0x7f6f6c007a30 comp rx=0 tx=0).stop 2024-09-17T05:18:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 msgr2=0x7f6f7c0b5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0b5a40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f6f7400b970 tx=0x7f6f7400be30 comp rx=0 tx=0).stop 2024-09-17T05:18:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 shutdown_connections 2024-09-17T05:18:50.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f5c078b90 0x7f6f5c07b050 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7c15bb90 0x7f6f7c0b5a40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7c151830 0x7f6f7c0b5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 --2- 172.21.15.81:0/2556953324 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f7c073c20 0x7f6f7c1503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 >> 172.21.15.81:0/2556953324 conn(0x7f6f7c0d0d10 msgr2=0x7f6f7c0cedf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 shutdown_connections 2024-09-17T05:18:50.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.471+0000 7f6f808b1640 1 -- 172.21.15.81:0/2556953324 wait complete. 2024-09-17T05:18:50.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:50.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1328248938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f80d2410 msgr2=0x7fb9f80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1328248938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f80d2410 0x7fb9f80b3090 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8005fd0 tx=0x7fb9e802a5c0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1328248938 shutdown_connections 2024-09-17T05:18:50.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1328248938 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9f815f6d0 0x7fb9f815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1328248938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f80d2410 0x7fb9f80b3090 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1328248938 >> 172.21.15.81:0/1328248938 conn(0x7fb9f809aa30 msgr2=0x7fb9f809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:50.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1328248938 shutdown_connections 2024-09-17T05:18:50.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.583+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1328248938 wait complete. 2024-09-17T05:18:50.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.584+0000 7fb9fe6b8640 1 Processor -- start 2024-09-17T05:18:50.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.584+0000 7fb9fe6b8640 1 -- start start 2024-09-17T05:18:50.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fe6b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9f80d2410 0x7fb9f81e8990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fe6b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f815cdc0 0x7fb9f8148e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fe6b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9f815f6d0 0x7fb9f81493a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fe6b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f80b13c0 con 0x7fb9f815cdc0 2024-09-17T05:18:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fe6b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb9f80b1240 con 0x7fb9f80d2410 2024-09-17T05:18:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fe6b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb9f80b1540 con 0x7fb9f815f6d0 2024-09-17T05:18:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f815cdc0 0x7fb9f8148e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f815cdc0 0x7fb9f8148e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43790/0 (socket says 172.21.15.81:43790) 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 -- 172.21.15.81:0/1043429556 learned_addr learned my addr 172.21.15.81:0/1043429556 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f7fff640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9f80d2410 0x7fb9f81e8990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fcc55640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9f815f6d0 0x7fb9f81493a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 -- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9f815f6d0 msgr2=0x7fb9f81493a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9f815f6d0 0x7fb9f81493a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 -- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9f80d2410 msgr2=0x7fb9f81e8990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9f80d2410 0x7fb9f81e8990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9f77fe640 1 -- 172.21.15.81:0/1043429556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9f81f64b0 con 0x7fb9f815cdc0 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.585+0000 7fb9fcc55640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9f815f6d0 0x7fb9f81493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.586+0000 7fb9f77fe640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f815cdc0 0x7fb9f8148e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c9a0 tx=0x7fb9ec00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.586+0000 7fb9f4ff9640 1 -- 172.21.15.81:0/1043429556 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec007bb0 con 0x7fb9f815cdc0 2024-09-17T05:18:50.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.586+0000 7fb9f4ff9640 1 -- 172.21.15.81:0/1043429556 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9ec005020 con 0x7fb9f815cdc0 2024-09-17T05:18:50.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.586+0000 7fb9f4ff9640 1 -- 172.21.15.81:0/1043429556 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9ec007e60 con 0x7fb9f815cdc0 2024-09-17T05:18:50.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.586+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9f81f6790 con 0x7fb9f815cdc0 2024-09-17T05:18:50.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.586+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9f81f6d50 con 0x7fb9f815cdc0 2024-09-17T05:18:50.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.587+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9f80b19f0 con 0x7fb9f815cdc0 2024-09-17T05:18:50.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.587+0000 7fb9f4ff9640 1 -- 172.21.15.81:0/1043429556 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb9ec005470 con 0x7fb9f815cdc0 2024-09-17T05:18:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.588+0000 7fb9f4ff9640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9e4078b90 0x7fb9e407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.588+0000 7fb9f4ff9640 1 -- 172.21.15.81:0/1043429556 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb9ec09b1b0 con 0x7fb9f815cdc0 2024-09-17T05:18:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.588+0000 7fb9f7fff640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9e4078b90 0x7fb9e407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.589+0000 7fb9f7fff640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9e4078b90 0x7fb9e407b050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8033000 tx=0x7fb9e8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:50.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.592+0000 7fb9f4ff9640 1 -- 172.21.15.81:0/1043429556 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb9ec014030 con 0x7fb9f815cdc0 2024-09-17T05:18:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.768+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb9f8070f70 con 0x7fb9f815cdc0 2024-09-17T05:18:50.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.769+0000 7fb9f4ff9640 1 -- 172.21.15.81:0/1043429556 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7fb9ec063680 con 0x7fb9f815cdc0 2024-09-17T05:18:50.770 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:50.770 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:48.113992+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9e4078b90 msgr2=0x7fb9e407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9e4078b90 0x7fb9e407b050 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb9e8033000 tx=0x7fb9e8004730 comp rx=0 tx=0).stop 2024-09-17T05:18:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f815cdc0 msgr2=0x7fb9f8148e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f815cdc0 0x7fb9f8148e60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb9ec00c9a0 tx=0x7fb9ec00ce60 comp rx=0 tx=0).stop 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 shutdown_connections 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9e4078b90 0x7fb9e407b050 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9f815f6d0 0x7fb9f81493a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9f815cdc0 0x7fb9f8148e60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 --2- 172.21.15.81:0/1043429556 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9f80d2410 0x7fb9f81e8990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 >> 172.21.15.81:0/1043429556 conn(0x7fb9f809aa30 msgr2=0x7fb9f8071b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 shutdown_connections 2024-09-17T05:18:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.771+0000 7fb9fe6b8640 1 -- 172.21.15.81:0/1043429556 wait complete. 2024-09-17T05:18:50.783 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:18:50.783 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:18:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 -- 172.21.15.81:0/939800623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c074130 msgr2=0x7f942c0cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 --2- 172.21.15.81:0/939800623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c074130 0x7f942c0cc6d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9414005fd0 tx=0x7f941402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 -- 172.21.15.81:0/939800623 shutdown_connections 2024-09-17T05:18:50.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 --2- 172.21.15.81:0/939800623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f942c0ccc10 0x7f942c070990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 --2- 172.21.15.81:0/939800623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c074130 0x7f942c0cc6d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 -- 172.21.15.81:0/939800623 >> 172.21.15.81:0/939800623 conn(0x7f942c0d0c20 msgr2=0x7f942c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:50.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 -- 172.21.15.81:0/939800623 shutdown_connections 2024-09-17T05:18:50.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.882+0000 7f943306e640 1 -- 172.21.15.81:0/939800623 wait complete. 2024-09-17T05:18:50.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.883+0000 7f943306e640 1 Processor -- start 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.883+0000 7f943306e640 1 -- start start 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f943306e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c06d590 0x7f942c0c70d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f943306e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f942c074130 0x7f942c15b010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f943306e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f942c0ccc10 0x7f942c15b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f943306e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f942c06ce70 con 0x7f942c06d590 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f943306e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f942c06ccf0 con 0x7f942c0ccc10 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f943306e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f942c070ed0 con 0x7f942c074130 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f9430e0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c06d590 0x7f942c0c70d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f9430e0a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c06d590 0x7f942c0c70d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43810/0 (socket says 172.21.15.81:43810) 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f9430e0a640 1 -- 172.21.15.81:0/3834122959 learned_addr learned my addr 172.21.15.81:0/3834122959 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f943160b640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f942c0ccc10 0x7f942c15b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.884+0000 7f942bfff640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f942c074130 0x7f942c15b010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f9430e0a640 1 -- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f942c074130 msgr2=0x7f942c15b010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f9430e0a640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f942c074130 0x7f942c15b010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f9430e0a640 1 -- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f942c0ccc10 msgr2=0x7f942c15b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f9430e0a640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f942c0ccc10 0x7f942c15b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f9430e0a640 1 -- 172.21.15.81:0/3834122959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942c0c4ab0 con 0x7f942c06d590 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f942bfff640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f942c074130 0x7f942c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f9430e0a640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c06d590 0x7f942c0c70d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c870 tx=0x7f941c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f94297fa640 1 -- 172.21.15.81:0/3834122959 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c003b70 con 0x7f942c06d590 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f94297fa640 1 -- 172.21.15.81:0/3834122959 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f941c003d10 con 0x7f942c06d590 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942c0b3050 con 0x7f942c06d590 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f94297fa640 1 -- 172.21.15.81:0/3834122959 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f941c00aab0 con 0x7f942c06d590 2024-09-17T05:18:50.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.885+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f942c157080 con 0x7f942c06d590 2024-09-17T05:18:50.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.886+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f942c070990 con 0x7f942c06d590 2024-09-17T05:18:50.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.886+0000 7f94297fa640 1 -- 172.21.15.81:0/3834122959 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f941c00ac50 con 0x7f942c06d590 2024-09-17T05:18:50.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.887+0000 7f94297fa640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f940c078b90 0x7f940c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:50.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.887+0000 7f94297fa640 1 -- 172.21.15.81:0/3834122959 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f941c09aa40 con 0x7f942c06d590 2024-09-17T05:18:50.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.887+0000 7f942bfff640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f940c078b90 0x7f940c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:50.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.888+0000 7f942bfff640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f940c078b90 0x7f940c07b050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9414033000 tx=0x7f9414004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:50.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:50.891+0000 7f94297fa640 1 -- 172.21.15.81:0/3834122959 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f941c062fa0 con 0x7f942c06d590 2024-09-17T05:18:51.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.064+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f942c0d1000 con 0x7f940c078b90 2024-09-17T05:18:51.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.069+0000 7f94297fa640 1 -- 172.21.15.81:0/3834122959 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247479 (secure 0 0 0) 0x7f942c0d1000 con 0x7f940c078b90 2024-09-17T05:18:51.072 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:51.074 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:18:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f940c078b90 msgr2=0x7f940c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f940c078b90 0x7f940c07b050 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f9414033000 tx=0x7f9414004730 comp rx=0 tx=0).stop 2024-09-17T05:18:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c06d590 msgr2=0x7f942c0c70d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c06d590 0x7f942c0c70d0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f941c00c870 tx=0x7f941c00cd30 comp rx=0 tx=0).stop 2024-09-17T05:18:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 shutdown_connections 2024-09-17T05:18:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f940c078b90 0x7f940c07b050 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f942c0ccc10 0x7f942c15b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f942c074130 0x7f942c15b010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 --2- 172.21.15.81:0/3834122959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f942c06d590 0x7f942c0c70d0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 >> 172.21.15.81:0/3834122959 conn(0x7f942c0d0c20 msgr2=0x7f942c09eff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 shutdown_connections 2024-09-17T05:18:51.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.072+0000 7f943306e640 1 -- 172.21.15.81:0/3834122959 wait complete. 2024-09-17T05:18:51.084 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-17T05:18:49.374295+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2797568,"data_stored":1689504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.265924"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.132050+0000","last_change":"2024-09-17T05:18:46.132050+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.132050+0000","last_undegraded":"2024-09-17T05:18:46.132050+0000","last_fullsized":"2024-09-17T05:18:46.132050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123413+0000","last_change":"2024-09-17T05:18:46.123413+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123413+0000","last_undegraded":"2024-09-17T05:18:46.123413+0000","last_fullsized":"2024-09-17T05:18:46.123413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138898+0000","last_change":"2024-09-17T05:18:47.133451+0000","last_active":"2024-09-17T05:18:47.138898+0000","last_peered":"2024-09-17T05:18:47.138898+0000","last_clean":"2024-09-17T05:18:47.138898+0000","last_became_active":"2024-09-17T05:18:47.133212+0000","last_became_peered":"2024-09-17T05:18:47.133212+0000","last_unstale":"2024-09-17T05:18:47.138898+0000","last_undegraded":"2024-09-17T05:18:47.138898+0000","last_fullsized":"2024-09-17T05:18:47.138898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:27.337400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127318+0000","last_change":"2024-09-17T05:18:46.127318+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127318+0000","last_undegraded":"2024-09-17T05:18:46.127318+0000","last_fullsized":"2024-09-17T05:18:46.127318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128885+0000","last_change":"2024-09-17T05:18:46.128885+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128885+0000","last_undegraded":"2024-09-17T05:18:46.128885+0000","last_fullsized":"2024-09-17T05:18:46.128885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126143+0000","last_change":"2024-09-17T05:18:46.126143+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126143+0000","last_undegraded":"2024-09-17T05:18:46.126143+0000","last_fullsized":"2024-09-17T05:18:46.126143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128145+0000","last_change":"2024-09-17T05:18:46.128145+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128145+0000","last_undegraded":"2024-09-17T05:18:46.128145+0000","last_fullsized":"2024-09-17T05:18:46.128145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120567+0000","last_change":"2024-09-17T05:18:46.120567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120567+0000","last_undegraded":"2024-09-17T05:18:46.120567+0000","last_fullsized":"2024-09-17T05:18:46.120567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131588+0000","last_change":"2024-09-17T05:18:46.131588+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131588+0000","last_undegraded":"2024-09-17T05:18:46.131588+0000","last_fullsized":"2024-09-17T05:18:46.131588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124208+0000","last_change":"2024-09-17T05:18:46.124208+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124208+0000","last_undegraded":"2024-09-17T05:18:46.124208+0000","last_fullsized":"2024-09-17T05:18:46.124208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121461+0000","last_change":"2024-09-17T05:18:46.121461+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121461+0000","last_undegraded":"2024-09-17T05:18:46.121461+0000","last_fullsized":"2024-09-17T05:18:46.121461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128071+0000","last_change":"2024-09-17T05:18:46.128071+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128071+0000","last_undegraded":"2024-09-17T05:18:46.128071+0000","last_fullsized":"2024-09-17T05:18:46.128071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120985+0000","last_change":"2024-09-17T05:18:46.120985+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120985+0000","last_undegraded":"2024-09-17T05:18:46.120985+0000","last_fullsized":"2024-09-17T05:18:46.120985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138952+0000","last_change":"2024-09-17T05:18:47.133079+0000","last_active":"2024-09-17T05:18:47.138952+0000","last_peered":"2024-09-17T05:18:47.138952+0000","last_clean":"2024-09-17T05:18:47.138952+0000","last_became_active":"2024-09-17T05:18:47.132823+0000","last_became_peered":"2024-09-17T05:18:47.132823+0000","last_unstale":"2024-09-17T05:18:47.138952+0000","last_undegraded":"2024-09-17T05:18:47.138952+0000","last_fullsized":"2024-09-17T05:18:47.138952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123188+0000","last_change":"2024-09-17T05:18:46.123188+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123188+0000","last_undegraded":"2024-09-17T05:18:46.123188+0000","last_fullsized":"2024-09-17T05:18:46.123188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124789+0000","last_change":"2024-09-17T05:18:46.124789+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124789+0000","last_undegraded":"2024-09-17T05:18:46.124789+0000","last_fullsized":"2024-09-17T05:18:46.124789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123455+0000","last_change":"2024-09-17T05:18:46.123455+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123455+0000","last_undegraded":"2024-09-17T05:18:46.123455+0000","last_fullsized":"2024-09-17T05:18:46.123455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117456+0000","last_change":"2024-09-17T05:18:46.117456+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117456+0000","last_undegraded":"2024-09-17T05:18:46.117456+0000","last_fullsized":"2024-09-17T05:18:46.117456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126380+0000","last_change":"2024-09-17T05:18:46.126380+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126380+0000","last_undegraded":"2024-09-17T05:18:46.126380+0000","last_fullsized":"2024-09-17T05:18:46.126380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124095+0000","last_change":"2024-09-17T05:18:46.124095+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124095+0000","last_undegraded":"2024-09-17T05:18:46.124095+0000","last_fullsized":"2024-09-17T05:18:46.124095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.151709+0000","last_change":"2024-09-17T05:18:47.145653+0000","last_active":"2024-09-17T05:18:47.151709+0000","last_peered":"2024-09-17T05:18:47.151709+0000","last_clean":"2024-09-17T05:18:47.151709+0000","last_became_active":"2024-09-17T05:18:47.145377+0000","last_became_peered":"2024-09-17T05:18:47.145377+0000","last_unstale":"2024-09-17T05:18:47.151709+0000","last_undegraded":"2024-09-17T05:18:47.151709+0000","last_fullsized":"2024-09-17T05:18:47.151709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:25.342804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125712+0000","last_change":"2024-09-17T05:18:46.125712+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125712+0000","last_undegraded":"2024-09-17T05:18:46.125712+0000","last_fullsized":"2024-09-17T05:18:46.125712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121942+0000","last_change":"2024-09-17T05:18:46.121942+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121942+0000","last_undegraded":"2024-09-17T05:18:46.121942+0000","last_fullsized":"2024-09-17T05:18:46.121942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124325+0000","last_change":"2024-09-17T05:18:46.124325+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124325+0000","last_undegraded":"2024-09-17T05:18:46.124325+0000","last_fullsized":"2024-09-17T05:18:46.124325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119567+0000","last_change":"2024-09-17T05:18:46.119567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119567+0000","last_undegraded":"2024-09-17T05:18:46.119567+0000","last_fullsized":"2024-09-17T05:18:46.119567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123698+0000","last_change":"2024-09-17T05:18:46.123698+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123698+0000","last_undegraded":"2024-09-17T05:18:46.123698+0000","last_fullsized":"2024-09-17T05:18:46.123698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124910+0000","last_change":"2024-09-17T05:18:46.124910+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124910+0000","last_undegraded":"2024-09-17T05:18:46.124910+0000","last_fullsized":"2024-09-17T05:18:46.124910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118569+0000","last_change":"2024-09-17T05:18:46.118569+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118569+0000","last_undegraded":"2024-09-17T05:18:46.118569+0000","last_fullsized":"2024-09-17T05:18:46.118569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141444+0000","last_change":"2024-09-17T05:18:47.137341+0000","last_active":"2024-09-17T05:18:47.141444+0000","last_peered":"2024-09-17T05:18:47.141444+0000","last_clean":"2024-09-17T05:18:47.141444+0000","last_became_active":"2024-09-17T05:18:47.136527+0000","last_became_peered":"2024-09-17T05:18:47.136527+0000","last_unstale":"2024-09-17T05:18:47.141444+0000","last_undegraded":"2024-09-17T05:18:47.141444+0000","last_fullsized":"2024-09-17T05:18:47.141444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:14.590352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125302+0000","last_change":"2024-09-17T05:18:46.125302+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125302+0000","last_undegraded":"2024-09-17T05:18:46.125302+0000","last_fullsized":"2024-09-17T05:18:46.125302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117483+0000","last_change":"2024-09-17T05:18:46.117483+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117483+0000","last_undegraded":"2024-09-17T05:18:46.117483+0000","last_fullsized":"2024-09-17T05:18:46.117483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.122358+0000","last_change":"2024-09-17T05:18:46.122358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.122358+0000","last_undegraded":"2024-09-17T05:18:46.122358+0000","last_fullsized":"2024-09-17T05:18:46.122358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126772+0000","last_change":"2024-09-17T05:18:46.126772+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126772+0000","last_undegraded":"2024-09-17T05:18:46.126772+0000","last_fullsized":"2024-09-17T05:18:46.126772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137203+0000","last_change":"2024-09-17T05:18:46.133224+0000","last_active":"2024-09-17T05:18:46.137203+0000","last_peered":"2024-09-17T05:18:46.137203+0000","last_clean":"2024-09-17T05:18:46.137203+0000","last_became_active":"2024-09-17T05:18:46.132897+0000","last_became_peered":"2024-09-17T05:18:46.132897+0000","last_unstale":"2024-09-17T05:18:46.137203+0000","last_undegraded":"2024-09-17T05:18:46.137203+0000","last_fullsized":"2024-09-17T05:18:46.137203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141244+0000","last_change":"2024-09-17T05:18:47.135685+0000","last_active":"2024-09-17T05:18:47.141244+0000","last_peered":"2024-09-17T05:18:47.141244+0000","last_clean":"2024-09-17T05:18:47.141244+0000","last_became_active":"2024-09-17T05:18:47.134928+0000","last_became_peered":"2024-09-17T05:18:47.134928+0000","last_unstale":"2024-09-17T05:18:47.141244+0000","last_undegraded":"2024-09-17T05:18:47.141244+0000","last_fullsized":"2024-09-17T05:18:47.141244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:34.673271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137791+0000","last_change":"2024-09-17T05:18:46.131904+0000","last_active":"2024-09-17T05:18:46.137791+0000","last_peered":"2024-09-17T05:18:46.137791+0000","last_clean":"2024-09-17T05:18:46.137791+0000","last_became_active":"2024-09-17T05:18:46.131515+0000","last_became_peered":"2024-09-17T05:18:46.131515+0000","last_unstale":"2024-09-17T05:18:46.137791+0000","last_undegraded":"2024-09-17T05:18:46.137791+0000","last_fullsized":"2024-09-17T05:18:46.137791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:42.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134477+0000","last_change":"2024-09-17T05:18:46.130687+0000","last_active":"2024-09-17T05:18:46.134477+0000","last_peered":"2024-09-17T05:18:46.134477+0000","last_clean":"2024-09-17T05:18:46.134477+0000","last_became_active":"2024-09-17T05:18:46.130402+0000","last_became_peered":"2024-09-17T05:18:46.130402+0000","last_unstale":"2024-09-17T05:18:46.134477+0000","last_undegraded":"2024-09-17T05:18:46.134477+0000","last_fullsized":"2024-09-17T05:18:46.134477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120119+0000","last_change":"2024-09-17T05:18:46.120119+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120119+0000","last_undegraded":"2024-09-17T05:18:46.120119+0000","last_fullsized":"2024-09-17T05:18:46.120119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137804+0000","last_change":"2024-09-17T05:18:46.135197+0000","last_active":"2024-09-17T05:18:46.137804+0000","last_peered":"2024-09-17T05:18:46.137804+0000","last_clean":"2024-09-17T05:18:46.137804+0000","last_became_active":"2024-09-17T05:18:46.134931+0000","last_became_peered":"2024-09-17T05:18:46.134931+0000","last_unstale":"2024-09-17T05:18:46.137804+0000","last_undegraded":"2024-09-17T05:18:46.137804+0000","last_fullsized":"2024-09-17T05:18:46.137804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124148+0000","last_change":"2024-09-17T05:18:46.124148+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124148+0000","last_undegraded":"2024-09-17T05:18:46.124148+0000","last_fullsized":"2024-09-17T05:18:46.124148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.143659+0000","last_change":"2024-09-17T05:18:46.137454+0000","last_active":"2024-09-17T05:18:46.143659+0000","last_peered":"2024-09-17T05:18:46.143659+0000","last_clean":"2024-09-17T05:18:46.143659+0000","last_became_active":"2024-09-17T05:18:46.136894+0000","last_became_peered":"2024-09-17T05:18:46.136894+0000","last_unstale":"2024-09-17T05:18:46.143659+0000","last_undegraded":"2024-09-17T05:18:46.143659+0000","last_fullsized":"2024-09-17T05:18:46.143659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124949+0000","last_change":"2024-09-17T05:18:46.124949+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124949+0000","last_undegraded":"2024-09-17T05:18:46.124949+0000","last_fullsized":"2024-09-17T05:18:46.124949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.138344+0000","last_change":"2024-09-17T05:18:46.136107+0000","last_active":"2024-09-17T05:18:46.138344+0000","last_peered":"2024-09-17T05:18:46.138344+0000","last_clean":"2024-09-17T05:18:46.138344+0000","last_became_active":"2024-09-17T05:18:46.135733+0000","last_became_peered":"2024-09-17T05:18:46.135733+0000","last_unstale":"2024-09-17T05:18:46.138344+0000","last_undegraded":"2024-09-17T05:18:46.138344+0000","last_fullsized":"2024-09-17T05:18:46.138344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145713+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145713+0000","last_peered":"2024-09-17T05:18:47.145713+0000","last_clean":"2024-09-17T05:18:47.145713+0000","last_became_active":"2024-09-17T05:18:47.139941+0000","last_became_peered":"2024-09-17T05:18:47.139941+0000","last_unstale":"2024-09-17T05:18:47.145713+0000","last_undegraded":"2024-09-17T05:18:47.145713+0000","last_fullsized":"2024-09-17T05:18:47.145713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:36.992037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137320+0000","last_change":"2024-09-17T05:18:46.133330+0000","last_active":"2024-09-17T05:18:46.137320+0000","last_peered":"2024-09-17T05:18:46.137320+0000","last_clean":"2024-09-17T05:18:46.137320+0000","last_became_active":"2024-09-17T05:18:46.133026+0000","last_became_peered":"2024-09-17T05:18:46.133026+0000","last_unstale":"2024-09-17T05:18:46.137320+0000","last_undegraded":"2024-09-17T05:18:46.137320+0000","last_fullsized":"2024-09-17T05:18:46.137320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127560+0000","last_change":"2024-09-17T05:18:46.127560+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127560+0000","last_undegraded":"2024-09-17T05:18:46.127560+0000","last_fullsized":"2024-09-17T05:18:46.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137555+0000","last_change":"2024-09-17T05:18:46.133755+0000","last_active":"2024-09-17T05:18:46.137555+0000","last_peered":"2024-09-17T05:18:46.137555+0000","last_clean":"2024-09-17T05:18:46.137555+0000","last_became_active":"2024-09-17T05:18:46.133067+0000","last_became_peered":"2024-09-17T05:18:46.133067+0000","last_unstale":"2024-09-17T05:18:46.137555+0000","last_undegraded":"2024-09-17T05:18:46.137555+0000","last_fullsized":"2024-09-17T05:18:46.137555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.130713+0000","last_change":"2024-09-17T05:18:46.130713+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.130713+0000","last_undegraded":"2024-09-17T05:18:46.130713+0000","last_fullsized":"2024-09-17T05:18:46.130713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.144188+0000","last_change":"2024-09-17T05:18:46.129204+0000","last_active":"2024-09-17T05:18:47.144188+0000","last_peered":"2024-09-17T05:18:47.144188+0000","last_clean":"2024-09-17T05:18:47.144188+0000","last_became_active":"2024-09-17T05:18:46.128901+0000","last_became_peered":"2024-09-17T05:18:46.128901+0000","last_unstale":"2024-09-17T05:18:47.144188+0000","last_undegraded":"2024-09-17T05:18:47.144188+0000","last_fullsized":"2024-09-17T05:18:47.144188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:39.714747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.140902+0000","last_change":"2024-09-17T05:18:47.136191+0000","last_active":"2024-09-17T05:18:47.140902+0000","last_peered":"2024-09-17T05:18:47.140902+0000","last_clean":"2024-09-17T05:18:47.140902+0000","last_became_active":"2024-09-17T05:18:47.135912+0000","last_became_peered":"2024-09-17T05:18:47.135912+0000","last_unstale":"2024-09-17T05:18:47.140902+0000","last_undegraded":"2024-09-17T05:18:47.140902+0000","last_fullsized":"2024-09-17T05:18:47.140902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:16.628165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.133185+0000","last_change":"2024-09-17T05:18:46.132187+0000","last_active":"2024-09-17T05:18:46.133185+0000","last_peered":"2024-09-17T05:18:46.133185+0000","last_clean":"2024-09-17T05:18:46.133185+0000","last_became_active":"2024-09-17T05:18:46.131916+0000","last_became_peered":"2024-09-17T05:18:46.131916+0000","last_unstale":"2024-09-17T05:18:46.133185+0000","last_undegraded":"2024-09-17T05:18:46.133185+0000","last_fullsized":"2024-09-17T05:18:46.133185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127217+0000","last_change":"2024-09-17T05:18:46.127217+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127217+0000","last_undegraded":"2024-09-17T05:18:46.127217+0000","last_fullsized":"2024-09-17T05:18:46.127217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137595+0000","last_change":"2024-09-17T05:18:46.131494+0000","last_active":"2024-09-17T05:18:46.137595+0000","last_peered":"2024-09-17T05:18:46.137595+0000","last_clean":"2024-09-17T05:18:46.137595+0000","last_became_active":"2024-09-17T05:18:46.131210+0000","last_became_peered":"2024-09-17T05:18:46.131210+0000","last_unstale":"2024-09-17T05:18:46.137595+0000","last_undegraded":"2024-09-17T05:18:46.137595+0000","last_fullsized":"2024-09-17T05:18:46.137595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:22.572452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121122+0000","last_change":"2024-09-17T05:18:46.121122+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121122+0000","last_undegraded":"2024-09-17T05:18:46.121122+0000","last_fullsized":"2024-09-17T05:18:46.121122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131785+0000","last_change":"2024-09-17T05:18:46.127329+0000","last_active":"2024-09-17T05:18:46.131785+0000","last_peered":"2024-09-17T05:18:46.131785+0000","last_clean":"2024-09-17T05:18:46.131785+0000","last_became_active":"2024-09-17T05:18:46.126863+0000","last_became_peered":"2024-09-17T05:18:46.126863+0000","last_unstale":"2024-09-17T05:18:46.131785+0000","last_undegraded":"2024-09-17T05:18:46.131785+0000","last_fullsized":"2024-09-17T05:18:46.131785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127044+0000","last_change":"2024-09-17T05:18:46.127044+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127044+0000","last_undegraded":"2024-09-17T05:18:46.127044+0000","last_fullsized":"2024-09-17T05:18:46.127044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132242+0000","last_change":"2024-09-17T05:18:46.130487+0000","last_active":"2024-09-17T05:18:46.132242+0000","last_peered":"2024-09-17T05:18:46.132242+0000","last_clean":"2024-09-17T05:18:46.132242+0000","last_became_active":"2024-09-17T05:18:46.130163+0000","last_became_peered":"2024-09-17T05:18:46.130163+0000","last_unstale":"2024-09-17T05:18:46.132242+0000","last_undegraded":"2024-09-17T05:18:46.132242+0000","last_fullsized":"2024-09-17T05:18:46.132242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126358+0000","last_change":"2024-09-17T05:18:46.126358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126358+0000","last_undegraded":"2024-09-17T05:18:46.126358+0000","last_fullsized":"2024-09-17T05:18:46.126358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131836+0000","last_change":"2024-09-17T05:18:46.129081+0000","last_active":"2024-09-17T05:18:46.131836+0000","last_peered":"2024-09-17T05:18:46.131836+0000","last_clean":"2024-09-17T05:18:46.131836+0000","last_became_active":"2024-09-17T05:18:46.128776+0000","last_became_peered":"2024-09-17T05:18:46.128776+0000","last_unstale":"2024-09-17T05:18:46.131836+0000","last_undegraded":"2024-09-17T05:18:46.131836+0000","last_fullsized":"2024-09-17T05:18:46.131836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131083+0000","last_change":"2024-09-17T05:18:46.131083+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131083+0000","last_undegraded":"2024-09-17T05:18:46.131083+0000","last_fullsized":"2024-09-17T05:18:46.131083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137297+0000","last_change":"2024-09-17T05:18:46.132599+0000","last_active":"2024-09-17T05:18:46.137297+0000","last_peered":"2024-09-17T05:18:46.137297+0000","last_clean":"2024-09-17T05:18:46.137297+0000","last_became_active":"2024-09-17T05:18:46.132293+0000","last_became_peered":"2024-09-17T05:18:46.132293+0000","last_unstale":"2024-09-17T05:18:46.137297+0000","last_undegraded":"2024-09-17T05:18:46.137297+0000","last_fullsized":"2024-09-17T05:18:46.137297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123312+0000","last_change":"2024-09-17T05:18:46.123312+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123312+0000","last_undegraded":"2024-09-17T05:18:46.123312+0000","last_fullsized":"2024-09-17T05:18:46.123312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131766+0000","last_change":"2024-09-17T05:18:46.127182+0000","last_active":"2024-09-17T05:18:46.131766+0000","last_peered":"2024-09-17T05:18:46.131766+0000","last_clean":"2024-09-17T05:18:46.131766+0000","last_became_active":"2024-09-17T05:18:46.126903+0000","last_became_peered":"2024-09-17T05:18:46.126903+0000","last_unstale":"2024-09-17T05:18:46.131766+0000","last_undegraded":"2024-09-17T05:18:46.131766+0000","last_fullsized":"2024-09-17T05:18:46.131766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.129568+0000","last_change":"2024-09-17T05:18:46.129568+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.129568+0000","last_undegraded":"2024-09-17T05:18:46.129568+0000","last_fullsized":"2024-09-17T05:18:46.129568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134116+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:18:46.134116+0000","last_peered":"2024-09-17T05:18:46.134116+0000","last_clean":"2024-09-17T05:18:46.134116+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:18:46.134116+0000","last_undegraded":"2024-09-17T05:18:46.134116+0000","last_fullsized":"2024-09-17T05:18:46.134116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132517+0000","last_change":"2024-09-17T05:18:46.127446+0000","last_active":"2024-09-17T05:18:46.132517+0000","last_peered":"2024-09-17T05:18:46.132517+0000","last_clean":"2024-09-17T05:18:46.132517+0000","last_became_active":"2024-09-17T05:18:46.126901+0000","last_became_peered":"2024-09-17T05:18:46.126901+0000","last_unstale":"2024-09-17T05:18:46.132517+0000","last_undegraded":"2024-09-17T05:18:46.132517+0000","last_fullsized":"2024-09-17T05:18:46.132517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120082+0000","last_change":"2024-09-17T05:18:46.120082+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120082+0000","last_undegraded":"2024-09-17T05:18:46.120082+0000","last_fullsized":"2024-09-17T05:18:46.120082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146134+0000","last_change":"2024-09-17T05:18:46.141132+0000","last_active":"2024-09-17T05:18:46.146134+0000","last_peered":"2024-09-17T05:18:46.146134+0000","last_clean":"2024-09-17T05:18:46.146134+0000","last_became_active":"2024-09-17T05:18:46.140364+0000","last_became_peered":"2024-09-17T05:18:46.140364+0000","last_unstale":"2024-09-17T05:18:46.146134+0000","last_undegraded":"2024-09-17T05:18:46.146134+0000","last_fullsized":"2024-09-17T05:18:46.146134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141977+0000","last_change":"2024-09-17T05:18:47.139416+0000","last_active":"2024-09-17T05:18:47.141977+0000","last_peered":"2024-09-17T05:18:47.141977+0000","last_clean":"2024-09-17T05:18:47.141977+0000","last_became_active":"2024-09-17T05:18:47.139149+0000","last_became_peered":"2024-09-17T05:18:47.139149+0000","last_unstale":"2024-09-17T05:18:47.141977+0000","last_undegraded":"2024-09-17T05:18:47.141977+0000","last_fullsized":"2024-09-17T05:18:47.141977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:37.744818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131845+0000","last_change":"2024-09-17T05:18:46.129101+0000","last_active":"2024-09-17T05:18:46.131845+0000","last_peered":"2024-09-17T05:18:46.131845+0000","last_clean":"2024-09-17T05:18:46.131845+0000","last_became_active":"2024-09-17T05:18:46.128748+0000","last_became_peered":"2024-09-17T05:18:46.128748+0000","last_unstale":"2024-09-17T05:18:46.131845+0000","last_undegraded":"2024-09-17T05:18:46.131845+0000","last_fullsized":"2024-09-17T05:18:46.131845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124150+0000","last_change":"2024-09-17T05:18:46.124150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124150+0000","last_undegraded":"2024-09-17T05:18:46.124150+0000","last_fullsized":"2024-09-17T05:18:46.124150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132383+0000","last_change":"2024-09-17T05:18:46.129856+0000","last_active":"2024-09-17T05:18:46.132383+0000","last_peered":"2024-09-17T05:18:46.132383+0000","last_clean":"2024-09-17T05:18:46.132383+0000","last_became_active":"2024-09-17T05:18:46.129409+0000","last_became_peered":"2024-09-17T05:18:46.129409+0000","last_unstale":"2024-09-17T05:18:46.132383+0000","last_undegraded":"2024-09-17T05:18:46.132383+0000","last_fullsized":"2024-09-17T05:18:46.132383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125923+0000","last_change":"2024-09-17T05:18:46.125923+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125923+0000","last_undegraded":"2024-09-17T05:18:46.125923+0000","last_fullsized":"2024-09-17T05:18:46.125923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134337+0000","last_change":"2024-09-17T05:18:46.128837+0000","last_active":"2024-09-17T05:18:46.134337+0000","last_peered":"2024-09-17T05:18:46.134337+0000","last_clean":"2024-09-17T05:18:46.134337+0000","last_became_active":"2024-09-17T05:18:46.128576+0000","last_became_peered":"2024-09-17T05:18:46.128576+0000","last_unstale":"2024-09-17T05:18:46.134337+0000","last_undegraded":"2024-09-17T05:18:46.134337+0000","last_fullsized":"2024-09-17T05:18:46.134337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123328+0000","last_change":"2024-09-17T05:18:46.123328+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123328+0000","last_undegraded":"2024-09-17T05:18:46.123328+0000","last_fullsized":"2024-09-17T05:18:46.123328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146182+0000","last_change":"2024-09-17T05:18:46.141667+0000","last_active":"2024-09-17T05:18:46.146182+0000","last_peered":"2024-09-17T05:18:46.146182+0000","last_clean":"2024-09-17T05:18:46.146182+0000","last_became_active":"2024-09-17T05:18:46.140316+0000","last_became_peered":"2024-09-17T05:18:46.140316+0000","last_unstale":"2024-09-17T05:18:46.146182+0000","last_undegraded":"2024-09-17T05:18:46.146182+0000","last_fullsized":"2024-09-17T05:18:46.146182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124158+0000","last_change":"2024-09-17T05:18:46.124158+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124158+0000","last_undegraded":"2024-09-17T05:18:46.124158+0000","last_fullsized":"2024-09-17T05:18:46.124158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134353+0000","last_change":"2024-09-17T05:18:46.130971+0000","last_active":"2024-09-17T05:18:46.134353+0000","last_peered":"2024-09-17T05:18:46.134353+0000","last_clean":"2024-09-17T05:18:46.134353+0000","last_became_active":"2024-09-17T05:18:46.130678+0000","last_became_peered":"2024-09-17T05:18:46.130678+0000","last_unstale":"2024-09-17T05:18:46.134353+0000","last_undegraded":"2024-09-17T05:18:46.134353+0000","last_fullsized":"2024-09-17T05:18:46.134353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119056+0000","last_change":"2024-09-17T05:18:46.119056+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119056+0000","last_undegraded":"2024-09-17T05:18:46.119056+0000","last_fullsized":"2024-09-17T05:18:46.119056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.140398+0000","last_change":"2024-09-17T05:18:46.137090+0000","last_active":"2024-09-17T05:18:46.140398+0000","last_peered":"2024-09-17T05:18:46.140398+0000","last_clean":"2024-09-17T05:18:46.140398+0000","last_became_active":"2024-09-17T05:18:46.136506+0000","last_became_peered":"2024-09-17T05:18:46.136506+0000","last_unstale":"2024-09-17T05:18:46.140398+0000","last_undegraded":"2024-09-17T05:18:46.140398+0000","last_fullsized":"2024-09-17T05:18:46.140398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138865+0000","last_change":"2024-09-17T05:18:47.132848+0000","last_active":"2024-09-17T05:18:47.138865+0000","last_peered":"2024-09-17T05:18:47.138865+0000","last_clean":"2024-09-17T05:18:47.138865+0000","last_became_active":"2024-09-17T05:18:47.132504+0000","last_became_peered":"2024-09-17T05:18:47.132504+0000","last_unstale":"2024-09-17T05:18:47.138865+0000","last_undegraded":"2024-09-17T05:18:47.138865+0000","last_fullsized":"2024-09-17T05:18:47.138865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:08.296618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.141500+0000","last_change":"2024-09-17T05:18:46.137719+0000","last_active":"2024-09-17T05:18:46.141500+0000","last_peered":"2024-09-17T05:18:46.141500+0000","last_clean":"2024-09-17T05:18:46.141500+0000","last_became_active":"2024-09-17T05:18:46.137459+0000","last_became_peered":"2024-09-17T05:18:46.137459+0000","last_unstale":"2024-09-17T05:18:46.141500+0000","last_undegraded":"2024-09-17T05:18:46.141500+0000","last_fullsized":"2024-09-17T05:18:46.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126210+0000","last_change":"2024-09-17T05:18:46.126210+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126210+0000","last_undegraded":"2024-09-17T05:18:46.126210+0000","last_fullsized":"2024-09-17T05:18:46.126210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.139879+0000","last_change":"2024-09-17T05:18:46.136676+0000","last_active":"2024-09-17T05:18:46.139879+0000","last_peered":"2024-09-17T05:18:46.139879+0000","last_clean":"2024-09-17T05:18:46.139879+0000","last_became_active":"2024-09-17T05:18:46.136468+0000","last_became_peered":"2024-09-17T05:18:46.136468+0000","last_unstale":"2024-09-17T05:18:46.139879+0000","last_undegraded":"2024-09-17T05:18:46.139879+0000","last_fullsized":"2024-09-17T05:18:46.139879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:44.260018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118436+0000","last_change":"2024-09-17T05:18:46.118436+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118436+0000","last_undegraded":"2024-09-17T05:18:46.118436+0000","last_fullsized":"2024-09-17T05:18:46.118436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137293+0000","last_change":"2024-09-17T05:18:46.132362+0000","last_active":"2024-09-17T05:18:46.137293+0000","last_peered":"2024-09-17T05:18:46.137293+0000","last_clean":"2024-09-17T05:18:46.137293+0000","last_became_active":"2024-09-17T05:18:46.132074+0000","last_became_peered":"2024-09-17T05:18:46.132074+0000","last_unstale":"2024-09-17T05:18:46.137293+0000","last_undegraded":"2024-09-17T05:18:46.137293+0000","last_fullsized":"2024-09-17T05:18:46.137293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119206+0000","last_change":"2024-09-17T05:18:46.119206+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119206+0000","last_undegraded":"2024-09-17T05:18:46.119206+0000","last_fullsized":"2024-09-17T05:18:46.119206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145741+0000","last_change":"2024-09-17T05:18:46.140762+0000","last_active":"2024-09-17T05:18:46.145741+0000","last_peered":"2024-09-17T05:18:46.145741+0000","last_clean":"2024-09-17T05:18:46.145741+0000","last_became_active":"2024-09-17T05:18:46.140483+0000","last_became_peered":"2024-09-17T05:18:46.140483+0000","last_unstale":"2024-09-17T05:18:46.145741+0000","last_undegraded":"2024-09-17T05:18:46.145741+0000","last_fullsized":"2024-09-17T05:18:46.145741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123150+0000","last_change":"2024-09-17T05:18:46.123150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123150+0000","last_undegraded":"2024-09-17T05:18:46.123150+0000","last_fullsized":"2024-09-17T05:18:46.123150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123834+0000","last_change":"2024-09-17T05:18:46.123834+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123834+0000","last_undegraded":"2024-09-17T05:18:46.123834+0000","last_fullsized":"2024-09-17T05:18:46.123834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145734+0000","last_change":"2024-09-17T05:18:46.140678+0000","last_active":"2024-09-17T05:18:46.145734+0000","last_peered":"2024-09-17T05:18:46.145734+0000","last_clean":"2024-09-17T05:18:46.145734+0000","last_became_active":"2024-09-17T05:18:46.140137+0000","last_became_peered":"2024-09-17T05:18:46.140137+0000","last_unstale":"2024-09-17T05:18:46.145734+0000","last_undegraded":"2024-09-17T05:18:46.145734+0000","last_fullsized":"2024-09-17T05:18:46.145734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126438+0000","last_change":"2024-09-17T05:18:46.126438+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126438+0000","last_undegraded":"2024-09-17T05:18:46.126438+0000","last_fullsized":"2024-09-17T05:18:46.126438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145783+0000","last_change":"2024-09-17T05:18:46.141012+0000","last_active":"2024-09-17T05:18:46.145783+0000","last_peered":"2024-09-17T05:18:46.145783+0000","last_clean":"2024-09-17T05:18:46.145783+0000","last_became_active":"2024-09-17T05:18:46.140729+0000","last_became_peered":"2024-09-17T05:18:46.140729+0000","last_unstale":"2024-09-17T05:18:46.145783+0000","last_undegraded":"2024-09-17T05:18:46.145783+0000","last_fullsized":"2024-09-17T05:18:46.145783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145688+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145688+0000","last_peered":"2024-09-17T05:18:47.145688+0000","last_clean":"2024-09-17T05:18:47.145688+0000","last_became_active":"2024-09-17T05:18:47.140502+0000","last_became_peered":"2024-09-17T05:18:47.140502+0000","last_unstale":"2024-09-17T05:18:47.145688+0000","last_undegraded":"2024-09-17T05:18:47.145688+0000","last_fullsized":"2024-09-17T05:18:47.145688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:06.475279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132014+0000","last_change":"2024-09-17T05:18:46.126436+0000","last_active":"2024-09-17T05:18:46.132014+0000","last_peered":"2024-09-17T05:18:46.132014+0000","last_clean":"2024-09-17T05:18:46.132014+0000","last_became_active":"2024-09-17T05:18:46.126106+0000","last_became_peered":"2024-09-17T05:18:46.126106+0000","last_unstale":"2024-09-17T05:18:46.132014+0000","last_undegraded":"2024-09-17T05:18:46.132014+0000","last_fullsized":"2024-09-17T05:18:46.132014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121161+0000","last_change":"2024-09-17T05:18:46.121161+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121161+0000","last_undegraded":"2024-09-17T05:18:46.121161+0000","last_fullsized":"2024-09-17T05:18:46.121161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.149033+0000","last_change":"2024-09-17T05:18:46.135269+0000","last_active":"2024-09-17T05:18:47.149033+0000","last_peered":"2024-09-17T05:18:47.149033+0000","last_clean":"2024-09-17T05:18:47.149033+0000","last_became_active":"2024-09-17T05:18:46.135042+0000","last_became_peered":"2024-09-17T05:18:46.135042+0000","last_unstale":"2024-09-17T05:18:47.149033+0000","last_undegraded":"2024-09-17T05:18:47.149033+0000","last_fullsized":"2024-09-17T05:18:47.149033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:44.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:18:51.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:18:51.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 -- 172.21.15.81:0/2813923006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c15f6d0 msgr2=0x7f9a5c15c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 --2- 172.21.15.81:0/2813923006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c15f6d0 0x7f9a5c15c880 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c074670 tx=0x7f9a4402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 -- 172.21.15.81:0/2813923006 shutdown_connections 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 --2- 172.21.15.81:0/2813923006 >> v2:172.21.15.160:3300/0 conn(0x7f9a5c15cdc0 0x7f9a5c0cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 --2- 172.21.15.81:0/2813923006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c15f6d0 0x7f9a5c15c880 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 --2- 172.21.15.81:0/2813923006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a5c0d2410 0x7f9a5c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 -- 172.21.15.81:0/2813923006 >> 172.21.15.81:0/2813923006 conn(0x7f9a5c09aa30 msgr2=0x7f9a5c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 -- 172.21.15.81:0/2813923006 shutdown_connections 2024-09-17T05:18:51.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.223+0000 7f9a62095640 1 -- 172.21.15.81:0/2813923006 wait complete. 2024-09-17T05:18:51.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.224+0000 7f9a62095640 1 Processor -- start 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a62095640 1 -- start start 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a62095640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0d2410 0x7f9a5c06f130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a62095640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a5c15cdc0 0x7f9a5c0b0430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a62095640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a5c15f6d0 0x7f9a5c0af9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a62095640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c0b1240 con 0x7f9a5c0d2410 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a62095640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9a5c0d0580 con 0x7f9a5c15f6d0 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a62095640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9a5c0b13c0 con 0x7f9a5c15cdc0 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0d2410 0x7f9a5c06f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a5b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0d2410 0x7f9a5c06f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43822/0 (socket says 172.21.15.81:43822) 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a5b7fe640 1 -- 172.21.15.81:0/2870599944 learned_addr learned my addr 172.21.15.81:0/2870599944 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:51.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.225+0000 7f9a5affd640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a5c15cdc0 0x7f9a5c0b0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5bfff640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a5c15f6d0 0x7f9a5c0af9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5b7fe640 1 -- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a5c15cdc0 msgr2=0x7f9a5c0b0430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5b7fe640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a5c15cdc0 0x7f9a5c0b0430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5b7fe640 1 -- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a5c15f6d0 msgr2=0x7f9a5c0af9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5b7fe640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a5c15f6d0 0x7f9a5c0af9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5b7fe640 1 -- 172.21.15.81:0/2870599944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a5c0cbaf0 con 0x7f9a5c0d2410 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5affd640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a5c15cdc0 0x7f9a5c0b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a5b7fe640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0d2410 0x7f9a5c06f130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00d720 tx=0x7f9a4c00dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a53fff640 1 -- 172.21.15.81:0/2870599944 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c017070 con 0x7f9a5c0d2410 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a53fff640 1 -- 172.21.15.81:0/2870599944 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a4c009d20 con 0x7f9a5c0d2410 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a53fff640 1 -- 172.21.15.81:0/2870599944 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a4c004280 con 0x7f9a5c0d2410 2024-09-17T05:18:51.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a5c0cbdd0 con 0x7f9a5c0d2410 2024-09-17T05:18:51.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.226+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a5c0b54b0 con 0x7f9a5c0d2410 2024-09-17T05:18:51.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.227+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a5c0af2b0 con 0x7f9a5c0d2410 2024-09-17T05:18:51.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.227+0000 7f9a53fff640 1 -- 172.21.15.81:0/2870599944 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9a4c005020 con 0x7f9a5c0d2410 2024-09-17T05:18:51.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.228+0000 7f9a53fff640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9a3c078b90 0x7f9a3c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.228+0000 7f9a53fff640 1 -- 172.21.15.81:0/2870599944 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9a4c09b180 con 0x7f9a5c0d2410 2024-09-17T05:18:51.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.228+0000 7f9a5affd640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9a3c078b90 0x7f9a3c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.229+0000 7f9a5affd640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9a3c078b90 0x7f9a3c07b050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a44033000 tx=0x7f9a44004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:51.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.232+0000 7f9a53fff640 1 -- 172.21.15.81:0/2870599944 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9a4c020020 con 0x7f9a5c0d2410 2024-09-17T05:18:51.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.405+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9a5c0b0100 con 0x7f9a3c078b90 2024-09-17T05:18:51.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.409+0000 7f9a53fff640 1 -- 172.21.15.81:0/2870599944 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247479 (secure 0 0 0) 0x7f9a440042c0 con 0x7f9a3c078b90 2024-09-17T05:18:51.410 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:51.415 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:18:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9a3c078b90 msgr2=0x7f9a3c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9a3c078b90 0x7f9a3c07b050 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9a44033000 tx=0x7f9a44004730 comp rx=0 tx=0).stop 2024-09-17T05:18:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0d2410 msgr2=0x7f9a5c06f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0d2410 0x7f9a5c06f130 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f9a4c00d720 tx=0x7f9a4c00dbe0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 shutdown_connections 2024-09-17T05:18:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9a3c078b90 0x7f9a3c07b050 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a5c15f6d0 0x7f9a5c0af9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a5c15cdc0 0x7f9a5c0b0430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 --2- 172.21.15.81:0/2870599944 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a5c0d2410 0x7f9a5c06f130 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 >> 172.21.15.81:0/2870599944 conn(0x7f9a5c09aa30 msgr2=0x7f9a5c0cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 shutdown_connections 2024-09-17T05:18:51.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.412+0000 7f9a62095640 1 -- 172.21.15.81:0/2870599944 wait complete. 2024-09-17T05:18:51.424 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:18:51.374653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2797568,"data_stored":1689504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001106"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.132050+0000","last_change":"2024-09-17T05:18:46.132050+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.132050+0000","last_undegraded":"2024-09-17T05:18:46.132050+0000","last_fullsized":"2024-09-17T05:18:46.132050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123413+0000","last_change":"2024-09-17T05:18:46.123413+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123413+0000","last_undegraded":"2024-09-17T05:18:46.123413+0000","last_fullsized":"2024-09-17T05:18:46.123413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138898+0000","last_change":"2024-09-17T05:18:47.133451+0000","last_active":"2024-09-17T05:18:47.138898+0000","last_peered":"2024-09-17T05:18:47.138898+0000","last_clean":"2024-09-17T05:18:47.138898+0000","last_became_active":"2024-09-17T05:18:47.133212+0000","last_became_peered":"2024-09-17T05:18:47.133212+0000","last_unstale":"2024-09-17T05:18:47.138898+0000","last_undegraded":"2024-09-17T05:18:47.138898+0000","last_fullsized":"2024-09-17T05:18:47.138898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:27.337400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127318+0000","last_change":"2024-09-17T05:18:46.127318+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127318+0000","last_undegraded":"2024-09-17T05:18:46.127318+0000","last_fullsized":"2024-09-17T05:18:46.127318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128885+0000","last_change":"2024-09-17T05:18:46.128885+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128885+0000","last_undegraded":"2024-09-17T05:18:46.128885+0000","last_fullsized":"2024-09-17T05:18:46.128885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126143+0000","last_change":"2024-09-17T05:18:46.126143+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126143+0000","last_undegraded":"2024-09-17T05:18:46.126143+0000","last_fullsized":"2024-09-17T05:18:46.126143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128145+0000","last_change":"2024-09-17T05:18:46.128145+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128145+0000","last_undegraded":"2024-09-17T05:18:46.128145+0000","last_fullsized":"2024-09-17T05:18:46.128145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120567+0000","last_change":"2024-09-17T05:18:46.120567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120567+0000","last_undegraded":"2024-09-17T05:18:46.120567+0000","last_fullsized":"2024-09-17T05:18:46.120567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131588+0000","last_change":"2024-09-17T05:18:46.131588+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131588+0000","last_undegraded":"2024-09-17T05:18:46.131588+0000","last_fullsized":"2024-09-17T05:18:46.131588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124208+0000","last_change":"2024-09-17T05:18:46.124208+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124208+0000","last_undegraded":"2024-09-17T05:18:46.124208+0000","last_fullsized":"2024-09-17T05:18:46.124208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121461+0000","last_change":"2024-09-17T05:18:46.121461+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121461+0000","last_undegraded":"2024-09-17T05:18:46.121461+0000","last_fullsized":"2024-09-17T05:18:46.121461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128071+0000","last_change":"2024-09-17T05:18:46.128071+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128071+0000","last_undegraded":"2024-09-17T05:18:46.128071+0000","last_fullsized":"2024-09-17T05:18:46.128071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120985+0000","last_change":"2024-09-17T05:18:46.120985+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120985+0000","last_undegraded":"2024-09-17T05:18:46.120985+0000","last_fullsized":"2024-09-17T05:18:46.120985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138952+0000","last_change":"2024-09-17T05:18:47.133079+0000","last_active":"2024-09-17T05:18:47.138952+0000","last_peered":"2024-09-17T05:18:47.138952+0000","last_clean":"2024-09-17T05:18:47.138952+0000","last_became_active":"2024-09-17T05:18:47.132823+0000","last_became_peered":"2024-09-17T05:18:47.132823+0000","last_unstale":"2024-09-17T05:18:47.138952+0000","last_undegraded":"2024-09-17T05:18:47.138952+0000","last_fullsized":"2024-09-17T05:18:47.138952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123188+0000","last_change":"2024-09-17T05:18:46.123188+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123188+0000","last_undegraded":"2024-09-17T05:18:46.123188+0000","last_fullsized":"2024-09-17T05:18:46.123188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124789+0000","last_change":"2024-09-17T05:18:46.124789+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124789+0000","last_undegraded":"2024-09-17T05:18:46.124789+0000","last_fullsized":"2024-09-17T05:18:46.124789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123455+0000","last_change":"2024-09-17T05:18:46.123455+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123455+0000","last_undegraded":"2024-09-17T05:18:46.123455+0000","last_fullsized":"2024-09-17T05:18:46.123455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117456+0000","last_change":"2024-09-17T05:18:46.117456+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117456+0000","last_undegraded":"2024-09-17T05:18:46.117456+0000","last_fullsized":"2024-09-17T05:18:46.117456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126380+0000","last_change":"2024-09-17T05:18:46.126380+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126380+0000","last_undegraded":"2024-09-17T05:18:46.126380+0000","last_fullsized":"2024-09-17T05:18:46.126380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124095+0000","last_change":"2024-09-17T05:18:46.124095+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124095+0000","last_undegraded":"2024-09-17T05:18:46.124095+0000","last_fullsized":"2024-09-17T05:18:46.124095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.151709+0000","last_change":"2024-09-17T05:18:47.145653+0000","last_active":"2024-09-17T05:18:47.151709+0000","last_peered":"2024-09-17T05:18:47.151709+0000","last_clean":"2024-09-17T05:18:47.151709+0000","last_became_active":"2024-09-17T05:18:47.145377+0000","last_became_peered":"2024-09-17T05:18:47.145377+0000","last_unstale":"2024-09-17T05:18:47.151709+0000","last_undegraded":"2024-09-17T05:18:47.151709+0000","last_fullsized":"2024-09-17T05:18:47.151709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:25.342804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125712+0000","last_change":"2024-09-17T05:18:46.125712+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125712+0000","last_undegraded":"2024-09-17T05:18:46.125712+0000","last_fullsized":"2024-09-17T05:18:46.125712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121942+0000","last_change":"2024-09-17T05:18:46.121942+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121942+0000","last_undegraded":"2024-09-17T05:18:46.121942+0000","last_fullsized":"2024-09-17T05:18:46.121942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124325+0000","last_change":"2024-09-17T05:18:46.124325+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124325+0000","last_undegraded":"2024-09-17T05:18:46.124325+0000","last_fullsized":"2024-09-17T05:18:46.124325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119567+0000","last_change":"2024-09-17T05:18:46.119567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119567+0000","last_undegraded":"2024-09-17T05:18:46.119567+0000","last_fullsized":"2024-09-17T05:18:46.119567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123698+0000","last_change":"2024-09-17T05:18:46.123698+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123698+0000","last_undegraded":"2024-09-17T05:18:46.123698+0000","last_fullsized":"2024-09-17T05:18:46.123698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124910+0000","last_change":"2024-09-17T05:18:46.124910+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124910+0000","last_undegraded":"2024-09-17T05:18:46.124910+0000","last_fullsized":"2024-09-17T05:18:46.124910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118569+0000","last_change":"2024-09-17T05:18:46.118569+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118569+0000","last_undegraded":"2024-09-17T05:18:46.118569+0000","last_fullsized":"2024-09-17T05:18:46.118569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141444+0000","last_change":"2024-09-17T05:18:47.137341+0000","last_active":"2024-09-17T05:18:47.141444+0000","last_peered":"2024-09-17T05:18:47.141444+0000","last_clean":"2024-09-17T05:18:47.141444+0000","last_became_active":"2024-09-17T05:18:47.136527+0000","last_became_peered":"2024-09-17T05:18:47.136527+0000","last_unstale":"2024-09-17T05:18:47.141444+0000","last_undegraded":"2024-09-17T05:18:47.141444+0000","last_fullsized":"2024-09-17T05:18:47.141444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:14.590352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125302+0000","last_change":"2024-09-17T05:18:46.125302+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125302+0000","last_undegraded":"2024-09-17T05:18:46.125302+0000","last_fullsized":"2024-09-17T05:18:46.125302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117483+0000","last_change":"2024-09-17T05:18:46.117483+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117483+0000","last_undegraded":"2024-09-17T05:18:46.117483+0000","last_fullsized":"2024-09-17T05:18:46.117483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.122358+0000","last_change":"2024-09-17T05:18:46.122358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.122358+0000","last_undegraded":"2024-09-17T05:18:46.122358+0000","last_fullsized":"2024-09-17T05:18:46.122358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126772+0000","last_change":"2024-09-17T05:18:46.126772+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126772+0000","last_undegraded":"2024-09-17T05:18:46.126772+0000","last_fullsized":"2024-09-17T05:18:46.126772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137203+0000","last_change":"2024-09-17T05:18:46.133224+0000","last_active":"2024-09-17T05:18:46.137203+0000","last_peered":"2024-09-17T05:18:46.137203+0000","last_clean":"2024-09-17T05:18:46.137203+0000","last_became_active":"2024-09-17T05:18:46.132897+0000","last_became_peered":"2024-09-17T05:18:46.132897+0000","last_unstale":"2024-09-17T05:18:46.137203+0000","last_undegraded":"2024-09-17T05:18:46.137203+0000","last_fullsized":"2024-09-17T05:18:46.137203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141244+0000","last_change":"2024-09-17T05:18:47.135685+0000","last_active":"2024-09-17T05:18:47.141244+0000","last_peered":"2024-09-17T05:18:47.141244+0000","last_clean":"2024-09-17T05:18:47.141244+0000","last_became_active":"2024-09-17T05:18:47.134928+0000","last_became_peered":"2024-09-17T05:18:47.134928+0000","last_unstale":"2024-09-17T05:18:47.141244+0000","last_undegraded":"2024-09-17T05:18:47.141244+0000","last_fullsized":"2024-09-17T05:18:47.141244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:34.673271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137791+0000","last_change":"2024-09-17T05:18:46.131904+0000","last_active":"2024-09-17T05:18:46.137791+0000","last_peered":"2024-09-17T05:18:46.137791+0000","last_clean":"2024-09-17T05:18:46.137791+0000","last_became_active":"2024-09-17T05:18:46.131515+0000","last_became_peered":"2024-09-17T05:18:46.131515+0000","last_unstale":"2024-09-17T05:18:46.137791+0000","last_undegraded":"2024-09-17T05:18:46.137791+0000","last_fullsized":"2024-09-17T05:18:46.137791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:42.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134477+0000","last_change":"2024-09-17T05:18:46.130687+0000","last_active":"2024-09-17T05:18:46.134477+0000","last_peered":"2024-09-17T05:18:46.134477+0000","last_clean":"2024-09-17T05:18:46.134477+0000","last_became_active":"2024-09-17T05:18:46.130402+0000","last_became_peered":"2024-09-17T05:18:46.130402+0000","last_unstale":"2024-09-17T05:18:46.134477+0000","last_undegraded":"2024-09-17T05:18:46.134477+0000","last_fullsized":"2024-09-17T05:18:46.134477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120119+0000","last_change":"2024-09-17T05:18:46.120119+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120119+0000","last_undegraded":"2024-09-17T05:18:46.120119+0000","last_fullsized":"2024-09-17T05:18:46.120119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137804+0000","last_change":"2024-09-17T05:18:46.135197+0000","last_active":"2024-09-17T05:18:46.137804+0000","last_peered":"2024-09-17T05:18:46.137804+0000","last_clean":"2024-09-17T05:18:46.137804+0000","last_became_active":"2024-09-17T05:18:46.134931+0000","last_became_peered":"2024-09-17T05:18:46.134931+0000","last_unstale":"2024-09-17T05:18:46.137804+0000","last_undegraded":"2024-09-17T05:18:46.137804+0000","last_fullsized":"2024-09-17T05:18:46.137804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124148+0000","last_change":"2024-09-17T05:18:46.124148+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124148+0000","last_undegraded":"2024-09-17T05:18:46.124148+0000","last_fullsized":"2024-09-17T05:18:46.124148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.143659+0000","last_change":"2024-09-17T05:18:46.137454+0000","last_active":"2024-09-17T05:18:46.143659+0000","last_peered":"2024-09-17T05:18:46.143659+0000","last_clean":"2024-09-17T05:18:46.143659+0000","last_became_active":"2024-09-17T05:18:46.136894+0000","last_became_peered":"2024-09-17T05:18:46.136894+0000","last_unstale":"2024-09-17T05:18:46.143659+0000","last_undegraded":"2024-09-17T05:18:46.143659+0000","last_fullsized":"2024-09-17T05:18:46.143659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124949+0000","last_change":"2024-09-17T05:18:46.124949+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124949+0000","last_undegraded":"2024-09-17T05:18:46.124949+0000","last_fullsized":"2024-09-17T05:18:46.124949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.138344+0000","last_change":"2024-09-17T05:18:46.136107+0000","last_active":"2024-09-17T05:18:46.138344+0000","last_peered":"2024-09-17T05:18:46.138344+0000","last_clean":"2024-09-17T05:18:46.138344+0000","last_became_active":"2024-09-17T05:18:46.135733+0000","last_became_peered":"2024-09-17T05:18:46.135733+0000","last_unstale":"2024-09-17T05:18:46.138344+0000","last_undegraded":"2024-09-17T05:18:46.138344+0000","last_fullsized":"2024-09-17T05:18:46.138344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145713+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145713+0000","last_peered":"2024-09-17T05:18:47.145713+0000","last_clean":"2024-09-17T05:18:47.145713+0000","last_became_active":"2024-09-17T05:18:47.139941+0000","last_became_peered":"2024-09-17T05:18:47.139941+0000","last_unstale":"2024-09-17T05:18:47.145713+0000","last_undegraded":"2024-09-17T05:18:47.145713+0000","last_fullsized":"2024-09-17T05:18:47.145713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:36.992037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137320+0000","last_change":"2024-09-17T05:18:46.133330+0000","last_active":"2024-09-17T05:18:46.137320+0000","last_peered":"2024-09-17T05:18:46.137320+0000","last_clean":"2024-09-17T05:18:46.137320+0000","last_became_active":"2024-09-17T05:18:46.133026+0000","last_became_peered":"2024-09-17T05:18:46.133026+0000","last_unstale":"2024-09-17T05:18:46.137320+0000","last_undegraded":"2024-09-17T05:18:46.137320+0000","last_fullsized":"2024-09-17T05:18:46.137320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127560+0000","last_change":"2024-09-17T05:18:46.127560+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127560+0000","last_undegraded":"2024-09-17T05:18:46.127560+0000","last_fullsized":"2024-09-17T05:18:46.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137555+0000","last_change":"2024-09-17T05:18:46.133755+0000","last_active":"2024-09-17T05:18:46.137555+0000","last_peered":"2024-09-17T05:18:46.137555+0000","last_clean":"2024-09-17T05:18:46.137555+0000","last_became_active":"2024-09-17T05:18:46.133067+0000","last_became_peered":"2024-09-17T05:18:46.133067+0000","last_unstale":"2024-09-17T05:18:46.137555+0000","last_undegraded":"2024-09-17T05:18:46.137555+0000","last_fullsized":"2024-09-17T05:18:46.137555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.130713+0000","last_change":"2024-09-17T05:18:46.130713+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.130713+0000","last_undegraded":"2024-09-17T05:18:46.130713+0000","last_fullsized":"2024-09-17T05:18:46.130713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.144188+0000","last_change":"2024-09-17T05:18:46.129204+0000","last_active":"2024-09-17T05:18:47.144188+0000","last_peered":"2024-09-17T05:18:47.144188+0000","last_clean":"2024-09-17T05:18:47.144188+0000","last_became_active":"2024-09-17T05:18:46.128901+0000","last_became_peered":"2024-09-17T05:18:46.128901+0000","last_unstale":"2024-09-17T05:18:47.144188+0000","last_undegraded":"2024-09-17T05:18:47.144188+0000","last_fullsized":"2024-09-17T05:18:47.144188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:39.714747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.140902+0000","last_change":"2024-09-17T05:18:47.136191+0000","last_active":"2024-09-17T05:18:47.140902+0000","last_peered":"2024-09-17T05:18:47.140902+0000","last_clean":"2024-09-17T05:18:47.140902+0000","last_became_active":"2024-09-17T05:18:47.135912+0000","last_became_peered":"2024-09-17T05:18:47.135912+0000","last_unstale":"2024-09-17T05:18:47.140902+0000","last_undegraded":"2024-09-17T05:18:47.140902+0000","last_fullsized":"2024-09-17T05:18:47.140902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:16.628165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.133185+0000","last_change":"2024-09-17T05:18:46.132187+0000","last_active":"2024-09-17T05:18:46.133185+0000","last_peered":"2024-09-17T05:18:46.133185+0000","last_clean":"2024-09-17T05:18:46.133185+0000","last_became_active":"2024-09-17T05:18:46.131916+0000","last_became_peered":"2024-09-17T05:18:46.131916+0000","last_unstale":"2024-09-17T05:18:46.133185+0000","last_undegraded":"2024-09-17T05:18:46.133185+0000","last_fullsized":"2024-09-17T05:18:46.133185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127217+0000","last_change":"2024-09-17T05:18:46.127217+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127217+0000","last_undegraded":"2024-09-17T05:18:46.127217+0000","last_fullsized":"2024-09-17T05:18:46.127217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137595+0000","last_change":"2024-09-17T05:18:46.131494+0000","last_active":"2024-09-17T05:18:46.137595+0000","last_peered":"2024-09-17T05:18:46.137595+0000","last_clean":"2024-09-17T05:18:46.137595+0000","last_became_active":"2024-09-17T05:18:46.131210+0000","last_became_peered":"2024-09-17T05:18:46.131210+0000","last_unstale":"2024-09-17T05:18:46.137595+0000","last_undegraded":"2024-09-17T05:18:46.137595+0000","last_fullsized":"2024-09-17T05:18:46.137595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:22.572452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121122+0000","last_change":"2024-09-17T05:18:46.121122+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121122+0000","last_undegraded":"2024-09-17T05:18:46.121122+0000","last_fullsized":"2024-09-17T05:18:46.121122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131785+0000","last_change":"2024-09-17T05:18:46.127329+0000","last_active":"2024-09-17T05:18:46.131785+0000","last_peered":"2024-09-17T05:18:46.131785+0000","last_clean":"2024-09-17T05:18:46.131785+0000","last_became_active":"2024-09-17T05:18:46.126863+0000","last_became_peered":"2024-09-17T05:18:46.126863+0000","last_unstale":"2024-09-17T05:18:46.131785+0000","last_undegraded":"2024-09-17T05:18:46.131785+0000","last_fullsized":"2024-09-17T05:18:46.131785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127044+0000","last_change":"2024-09-17T05:18:46.127044+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127044+0000","last_undegraded":"2024-09-17T05:18:46.127044+0000","last_fullsized":"2024-09-17T05:18:46.127044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132242+0000","last_change":"2024-09-17T05:18:46.130487+0000","last_active":"2024-09-17T05:18:46.132242+0000","last_peered":"2024-09-17T05:18:46.132242+0000","last_clean":"2024-09-17T05:18:46.132242+0000","last_became_active":"2024-09-17T05:18:46.130163+0000","last_became_peered":"2024-09-17T05:18:46.130163+0000","last_unstale":"2024-09-17T05:18:46.132242+0000","last_undegraded":"2024-09-17T05:18:46.132242+0000","last_fullsized":"2024-09-17T05:18:46.132242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126358+0000","last_change":"2024-09-17T05:18:46.126358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126358+0000","last_undegraded":"2024-09-17T05:18:46.126358+0000","last_fullsized":"2024-09-17T05:18:46.126358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131836+0000","last_change":"2024-09-17T05:18:46.129081+0000","last_active":"2024-09-17T05:18:46.131836+0000","last_peered":"2024-09-17T05:18:46.131836+0000","last_clean":"2024-09-17T05:18:46.131836+0000","last_became_active":"2024-09-17T05:18:46.128776+0000","last_became_peered":"2024-09-17T05:18:46.128776+0000","last_unstale":"2024-09-17T05:18:46.131836+0000","last_undegraded":"2024-09-17T05:18:46.131836+0000","last_fullsized":"2024-09-17T05:18:46.131836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131083+0000","last_change":"2024-09-17T05:18:46.131083+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131083+0000","last_undegraded":"2024-09-17T05:18:46.131083+0000","last_fullsized":"2024-09-17T05:18:46.131083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137297+0000","last_change":"2024-09-17T05:18:46.132599+0000","last_active":"2024-09-17T05:18:46.137297+0000","last_peered":"2024-09-17T05:18:46.137297+0000","last_clean":"2024-09-17T05:18:46.137297+0000","last_became_active":"2024-09-17T05:18:46.132293+0000","last_became_peered":"2024-09-17T05:18:46.132293+0000","last_unstale":"2024-09-17T05:18:46.137297+0000","last_undegraded":"2024-09-17T05:18:46.137297+0000","last_fullsized":"2024-09-17T05:18:46.137297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123312+0000","last_change":"2024-09-17T05:18:46.123312+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123312+0000","last_undegraded":"2024-09-17T05:18:46.123312+0000","last_fullsized":"2024-09-17T05:18:46.123312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131766+0000","last_change":"2024-09-17T05:18:46.127182+0000","last_active":"2024-09-17T05:18:46.131766+0000","last_peered":"2024-09-17T05:18:46.131766+0000","last_clean":"2024-09-17T05:18:46.131766+0000","last_became_active":"2024-09-17T05:18:46.126903+0000","last_became_peered":"2024-09-17T05:18:46.126903+0000","last_unstale":"2024-09-17T05:18:46.131766+0000","last_undegraded":"2024-09-17T05:18:46.131766+0000","last_fullsized":"2024-09-17T05:18:46.131766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.129568+0000","last_change":"2024-09-17T05:18:46.129568+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.129568+0000","last_undegraded":"2024-09-17T05:18:46.129568+0000","last_fullsized":"2024-09-17T05:18:46.129568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134116+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:18:46.134116+0000","last_peered":"2024-09-17T05:18:46.134116+0000","last_clean":"2024-09-17T05:18:46.134116+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:18:46.134116+0000","last_undegraded":"2024-09-17T05:18:46.134116+0000","last_fullsized":"2024-09-17T05:18:46.134116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132517+0000","last_change":"2024-09-17T05:18:46.127446+0000","last_active":"2024-09-17T05:18:46.132517+0000","last_peered":"2024-09-17T05:18:46.132517+0000","last_clean":"2024-09-17T05:18:46.132517+0000","last_became_active":"2024-09-17T05:18:46.126901+0000","last_became_peered":"2024-09-17T05:18:46.126901+0000","last_unstale":"2024-09-17T05:18:46.132517+0000","last_undegraded":"2024-09-17T05:18:46.132517+0000","last_fullsized":"2024-09-17T05:18:46.132517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120082+0000","last_change":"2024-09-17T05:18:46.120082+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120082+0000","last_undegraded":"2024-09-17T05:18:46.120082+0000","last_fullsized":"2024-09-17T05:18:46.120082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146134+0000","last_change":"2024-09-17T05:18:46.141132+0000","last_active":"2024-09-17T05:18:46.146134+0000","last_peered":"2024-09-17T05:18:46.146134+0000","last_clean":"2024-09-17T05:18:46.146134+0000","last_became_active":"2024-09-17T05:18:46.140364+0000","last_became_peered":"2024-09-17T05:18:46.140364+0000","last_unstale":"2024-09-17T05:18:46.146134+0000","last_undegraded":"2024-09-17T05:18:46.146134+0000","last_fullsized":"2024-09-17T05:18:46.146134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141977+0000","last_change":"2024-09-17T05:18:47.139416+0000","last_active":"2024-09-17T05:18:47.141977+0000","last_peered":"2024-09-17T05:18:47.141977+0000","last_clean":"2024-09-17T05:18:47.141977+0000","last_became_active":"2024-09-17T05:18:47.139149+0000","last_became_peered":"2024-09-17T05:18:47.139149+0000","last_unstale":"2024-09-17T05:18:47.141977+0000","last_undegraded":"2024-09-17T05:18:47.141977+0000","last_fullsized":"2024-09-17T05:18:47.141977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:37.744818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131845+0000","last_change":"2024-09-17T05:18:46.129101+0000","last_active":"2024-09-17T05:18:46.131845+0000","last_peered":"2024-09-17T05:18:46.131845+0000","last_clean":"2024-09-17T05:18:46.131845+0000","last_became_active":"2024-09-17T05:18:46.128748+0000","last_became_peered":"2024-09-17T05:18:46.128748+0000","last_unstale":"2024-09-17T05:18:46.131845+0000","last_undegraded":"2024-09-17T05:18:46.131845+0000","last_fullsized":"2024-09-17T05:18:46.131845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124150+0000","last_change":"2024-09-17T05:18:46.124150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124150+0000","last_undegraded":"2024-09-17T05:18:46.124150+0000","last_fullsized":"2024-09-17T05:18:46.124150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132383+0000","last_change":"2024-09-17T05:18:46.129856+0000","last_active":"2024-09-17T05:18:46.132383+0000","last_peered":"2024-09-17T05:18:46.132383+0000","last_clean":"2024-09-17T05:18:46.132383+0000","last_became_active":"2024-09-17T05:18:46.129409+0000","last_became_peered":"2024-09-17T05:18:46.129409+0000","last_unstale":"2024-09-17T05:18:46.132383+0000","last_undegraded":"2024-09-17T05:18:46.132383+0000","last_fullsized":"2024-09-17T05:18:46.132383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125923+0000","last_change":"2024-09-17T05:18:46.125923+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125923+0000","last_undegraded":"2024-09-17T05:18:46.125923+0000","last_fullsized":"2024-09-17T05:18:46.125923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134337+0000","last_change":"2024-09-17T05:18:46.128837+0000","last_active":"2024-09-17T05:18:46.134337+0000","last_peered":"2024-09-17T05:18:46.134337+0000","last_clean":"2024-09-17T05:18:46.134337+0000","last_became_active":"2024-09-17T05:18:46.128576+0000","last_became_peered":"2024-09-17T05:18:46.128576+0000","last_unstale":"2024-09-17T05:18:46.134337+0000","last_undegraded":"2024-09-17T05:18:46.134337+0000","last_fullsized":"2024-09-17T05:18:46.134337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123328+0000","last_change":"2024-09-17T05:18:46.123328+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123328+0000","last_undegraded":"2024-09-17T05:18:46.123328+0000","last_fullsized":"2024-09-17T05:18:46.123328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146182+0000","last_change":"2024-09-17T05:18:46.141667+0000","last_active":"2024-09-17T05:18:46.146182+0000","last_peered":"2024-09-17T05:18:46.146182+0000","last_clean":"2024-09-17T05:18:46.146182+0000","last_became_active":"2024-09-17T05:18:46.140316+0000","last_became_peered":"2024-09-17T05:18:46.140316+0000","last_unstale":"2024-09-17T05:18:46.146182+0000","last_undegraded":"2024-09-17T05:18:46.146182+0000","last_fullsized":"2024-09-17T05:18:46.146182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124158+0000","last_change":"2024-09-17T05:18:46.124158+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124158+0000","last_undegraded":"2024-09-17T05:18:46.124158+0000","last_fullsized":"2024-09-17T05:18:46.124158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134353+0000","last_change":"2024-09-17T05:18:46.130971+0000","last_active":"2024-09-17T05:18:46.134353+0000","last_peered":"2024-09-17T05:18:46.134353+0000","last_clean":"2024-09-17T05:18:46.134353+0000","last_became_active":"2024-09-17T05:18:46.130678+0000","last_became_peered":"2024-09-17T05:18:46.130678+0000","last_unstale":"2024-09-17T05:18:46.134353+0000","last_undegraded":"2024-09-17T05:18:46.134353+0000","last_fullsized":"2024-09-17T05:18:46.134353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119056+0000","last_change":"2024-09-17T05:18:46.119056+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119056+0000","last_undegraded":"2024-09-17T05:18:46.119056+0000","last_fullsized":"2024-09-17T05:18:46.119056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.140398+0000","last_change":"2024-09-17T05:18:46.137090+0000","last_active":"2024-09-17T05:18:46.140398+0000","last_peered":"2024-09-17T05:18:46.140398+0000","last_clean":"2024-09-17T05:18:46.140398+0000","last_became_active":"2024-09-17T05:18:46.136506+0000","last_became_peered":"2024-09-17T05:18:46.136506+0000","last_unstale":"2024-09-17T05:18:46.140398+0000","last_undegraded":"2024-09-17T05:18:46.140398+0000","last_fullsized":"2024-09-17T05:18:46.140398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138865+0000","last_change":"2024-09-17T05:18:47.132848+0000","last_active":"2024-09-17T05:18:47.138865+0000","last_peered":"2024-09-17T05:18:47.138865+0000","last_clean":"2024-09-17T05:18:47.138865+0000","last_became_active":"2024-09-17T05:18:47.132504+0000","last_became_peered":"2024-09-17T05:18:47.132504+0000","last_unstale":"2024-09-17T05:18:47.138865+0000","last_undegraded":"2024-09-17T05:18:47.138865+0000","last_fullsized":"2024-09-17T05:18:47.138865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:08.296618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.141500+0000","last_change":"2024-09-17T05:18:46.137719+0000","last_active":"2024-09-17T05:18:46.141500+0000","last_peered":"2024-09-17T05:18:46.141500+0000","last_clean":"2024-09-17T05:18:46.141500+0000","last_became_active":"2024-09-17T05:18:46.137459+0000","last_became_peered":"2024-09-17T05:18:46.137459+0000","last_unstale":"2024-09-17T05:18:46.141500+0000","last_undegraded":"2024-09-17T05:18:46.141500+0000","last_fullsized":"2024-09-17T05:18:46.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126210+0000","last_change":"2024-09-17T05:18:46.126210+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126210+0000","last_undegraded":"2024-09-17T05:18:46.126210+0000","last_fullsized":"2024-09-17T05:18:46.126210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.139879+0000","last_change":"2024-09-17T05:18:46.136676+0000","last_active":"2024-09-17T05:18:46.139879+0000","last_peered":"2024-09-17T05:18:46.139879+0000","last_clean":"2024-09-17T05:18:46.139879+0000","last_became_active":"2024-09-17T05:18:46.136468+0000","last_became_peered":"2024-09-17T05:18:46.136468+0000","last_unstale":"2024-09-17T05:18:46.139879+0000","last_undegraded":"2024-09-17T05:18:46.139879+0000","last_fullsized":"2024-09-17T05:18:46.139879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:44.260018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118436+0000","last_change":"2024-09-17T05:18:46.118436+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118436+0000","last_undegraded":"2024-09-17T05:18:46.118436+0000","last_fullsized":"2024-09-17T05:18:46.118436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137293+0000","last_change":"2024-09-17T05:18:46.132362+0000","last_active":"2024-09-17T05:18:46.137293+0000","last_peered":"2024-09-17T05:18:46.137293+0000","last_clean":"2024-09-17T05:18:46.137293+0000","last_became_active":"2024-09-17T05:18:46.132074+0000","last_became_peered":"2024-09-17T05:18:46.132074+0000","last_unstale":"2024-09-17T05:18:46.137293+0000","last_undegraded":"2024-09-17T05:18:46.137293+0000","last_fullsized":"2024-09-17T05:18:46.137293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119206+0000","last_change":"2024-09-17T05:18:46.119206+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119206+0000","last_undegraded":"2024-09-17T05:18:46.119206+0000","last_fullsized":"2024-09-17T05:18:46.119206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145741+0000","last_change":"2024-09-17T05:18:46.140762+0000","last_active":"2024-09-17T05:18:46.145741+0000","last_peered":"2024-09-17T05:18:46.145741+0000","last_clean":"2024-09-17T05:18:46.145741+0000","last_became_active":"2024-09-17T05:18:46.140483+0000","last_became_peered":"2024-09-17T05:18:46.140483+0000","last_unstale":"2024-09-17T05:18:46.145741+0000","last_undegraded":"2024-09-17T05:18:46.145741+0000","last_fullsized":"2024-09-17T05:18:46.145741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123150+0000","last_change":"2024-09-17T05:18:46.123150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123150+0000","last_undegraded":"2024-09-17T05:18:46.123150+0000","last_fullsized":"2024-09-17T05:18:46.123150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123834+0000","last_change":"2024-09-17T05:18:46.123834+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123834+0000","last_undegraded":"2024-09-17T05:18:46.123834+0000","last_fullsized":"2024-09-17T05:18:46.123834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145734+0000","last_change":"2024-09-17T05:18:46.140678+0000","last_active":"2024-09-17T05:18:46.145734+0000","last_peered":"2024-09-17T05:18:46.145734+0000","last_clean":"2024-09-17T05:18:46.145734+0000","last_became_active":"2024-09-17T05:18:46.140137+0000","last_became_peered":"2024-09-17T05:18:46.140137+0000","last_unstale":"2024-09-17T05:18:46.145734+0000","last_undegraded":"2024-09-17T05:18:46.145734+0000","last_fullsized":"2024-09-17T05:18:46.145734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126438+0000","last_change":"2024-09-17T05:18:46.126438+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126438+0000","last_undegraded":"2024-09-17T05:18:46.126438+0000","last_fullsized":"2024-09-17T05:18:46.126438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145783+0000","last_change":"2024-09-17T05:18:46.141012+0000","last_active":"2024-09-17T05:18:46.145783+0000","last_peered":"2024-09-17T05:18:46.145783+0000","last_clean":"2024-09-17T05:18:46.145783+0000","last_became_active":"2024-09-17T05:18:46.140729+0000","last_became_peered":"2024-09-17T05:18:46.140729+0000","last_unstale":"2024-09-17T05:18:46.145783+0000","last_undegraded":"2024-09-17T05:18:46.145783+0000","last_fullsized":"2024-09-17T05:18:46.145783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145688+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145688+0000","last_peered":"2024-09-17T05:18:47.145688+0000","last_clean":"2024-09-17T05:18:47.145688+0000","last_became_active":"2024-09-17T05:18:47.140502+0000","last_became_peered":"2024-09-17T05:18:47.140502+0000","last_unstale":"2024-09-17T05:18:47.145688+0000","last_undegraded":"2024-09-17T05:18:47.145688+0000","last_fullsized":"2024-09-17T05:18:47.145688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:06.475279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132014+0000","last_change":"2024-09-17T05:18:46.126436+0000","last_active":"2024-09-17T05:18:46.132014+0000","last_peered":"2024-09-17T05:18:46.132014+0000","last_clean":"2024-09-17T05:18:46.132014+0000","last_became_active":"2024-09-17T05:18:46.126106+0000","last_became_peered":"2024-09-17T05:18:46.126106+0000","last_unstale":"2024-09-17T05:18:46.132014+0000","last_undegraded":"2024-09-17T05:18:46.132014+0000","last_fullsized":"2024-09-17T05:18:46.132014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121161+0000","last_change":"2024-09-17T05:18:46.121161+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121161+0000","last_undegraded":"2024-09-17T05:18:46.121161+0000","last_fullsized":"2024-09-17T05:18:46.121161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.149033+0000","last_change":"2024-09-17T05:18:46.135269+0000","last_active":"2024-09-17T05:18:47.149033+0000","last_peered":"2024-09-17T05:18:47.149033+0000","last_clean":"2024-09-17T05:18:47.149033+0000","last_became_active":"2024-09-17T05:18:46.135042+0000","last_became_peered":"2024-09-17T05:18:46.135042+0000","last_unstale":"2024-09-17T05:18:47.149033+0000","last_undegraded":"2024-09-17T05:18:47.149033+0000","last_fullsized":"2024-09-17T05:18:47.149033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:44.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:18:51.427 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:18:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.564+0000 7fe079b9f640 1 -- 172.21.15.81:0/118149073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe074152780 msgr2=0x7fe074160280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.564+0000 7fe079b9f640 1 --2- 172.21.15.81:0/118149073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe074152780 0x7fe074160280 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fe068005fd0 tx=0x7fe06802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.564+0000 7fe079b9f640 1 -- 172.21.15.81:0/118149073 shutdown_connections 2024-09-17T05:18:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.564+0000 7fe079b9f640 1 --2- 172.21.15.81:0/118149073 >> v2:172.21.15.160:3300/0 conn(0x7fe074070ee0 0x7fe074152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.564+0000 7fe079b9f640 1 --2- 172.21.15.81:0/118149073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe074152780 0x7fe074160280 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.564+0000 7fe079b9f640 1 -- 172.21.15.81:0/118149073 >> 172.21.15.81:0/118149073 conn(0x7fe0740cd630 msgr2=0x7fe0740cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:51.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.564+0000 7fe079b9f640 1 -- 172.21.15.81:0/118149073 shutdown_connections 2024-09-17T05:18:51.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.565+0000 7fe079b9f640 1 -- 172.21.15.81:0/118149073 wait complete. 2024-09-17T05:18:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.566+0000 7fe079b9f640 1 Processor -- start 2024-09-17T05:18:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.566+0000 7fe079b9f640 1 -- start start 2024-09-17T05:18:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe074070ee0 0x7fe0740b2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0740cc8c0 0x7fe0740cf9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe074152780 0x7fe074150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe074073fe0 con 0x7fe074070ee0 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe074073e60 con 0x7fe074152780 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe074074160 con 0x7fe0740cc8c0 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe074070ee0 0x7fe0740b2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe074070ee0 0x7fe0740b2f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43824/0 (socket says 172.21.15.81:43824) 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 -- 172.21.15.81:0/1750534782 learned_addr learned my addr 172.21.15.81:0/1750534782 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe07939e640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe074152780 0x7fe074150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe073fff640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0740cc8c0 0x7fe0740cf9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 -- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0740cc8c0 msgr2=0x7fe0740cf9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0740cc8c0 0x7fe0740cf9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 -- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe074152780 msgr2=0x7fe074150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe074152780 0x7fe074150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 -- 172.21.15.81:0/1750534782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0740ce920 con 0x7fe074070ee0 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe078b9d640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe074070ee0 0x7fe0740b2f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0680099f0 tx=0x7fe068003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe0717fa640 1 -- 172.21.15.81:0/1750534782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe06803f070 con 0x7fe074070ee0 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe0717fa640 1 -- 172.21.15.81:0/1750534782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe068005600 con 0x7fe074070ee0 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0740cec00 con 0x7fe074070ee0 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe0717fa640 1 -- 172.21.15.81:0/1750534782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe068035030 con 0x7fe074070ee0 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.567+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0740cf1c0 con 0x7fe074070ee0 2024-09-17T05:18:51.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.568+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe074074680 con 0x7fe074070ee0 2024-09-17T05:18:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.569+0000 7fe0717fa640 1 -- 172.21.15.81:0/1750534782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe068042070 con 0x7fe074070ee0 2024-09-17T05:18:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.569+0000 7fe0717fa640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe058078b90 0x7fe05807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.570+0000 7fe0717fa640 1 -- 172.21.15.81:0/1750534782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe0680bb860 con 0x7fe074070ee0 2024-09-17T05:18:51.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.570+0000 7fe073fff640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe058078b90 0x7fe05807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.570+0000 7fe073fff640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe058078b90 0x7fe05807b050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe074153b30 tx=0x7fe060005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:51.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.574+0000 7fe0717fa640 1 -- 172.21.15.81:0/1750534782 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe068083660 con 0x7fe074070ee0 2024-09-17T05:18:51.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.748+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe0740b3470 con 0x7fe058078b90 2024-09-17T05:18:51.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.752+0000 7fe0717fa640 1 -- 172.21.15.81:0/1750534782 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247479 (secure 0 0 0) 0x7fe0740b3470 con 0x7fe058078b90 2024-09-17T05:18:51.755 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:51.756 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe058078b90 msgr2=0x7fe05807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe058078b90 0x7fe05807b050 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fe074153b30 tx=0x7fe060005f90 comp rx=0 tx=0).stop 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe074070ee0 msgr2=0x7fe0740b2f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe074070ee0 0x7fe0740b2f30 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fe0680099f0 tx=0x7fe068003820 comp rx=0 tx=0).stop 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 shutdown_connections 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe058078b90 0x7fe05807b050 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe074152780 0x7fe074150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0740cc8c0 0x7fe0740cf9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 --2- 172.21.15.81:0/1750534782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe074070ee0 0x7fe0740b2f30 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 >> 172.21.15.81:0/1750534782 conn(0x7fe0740cd630 msgr2=0x7fe07415b290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 shutdown_connections 2024-09-17T05:18:51.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.755+0000 7fe079b9f640 1 -- 172.21.15.81:0/1750534782 wait complete. 2024-09-17T05:18:51.766 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:18:51.374653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2797568,"data_stored":1689504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001106"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.132050+0000","last_change":"2024-09-17T05:18:46.132050+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.132050+0000","last_undegraded":"2024-09-17T05:18:46.132050+0000","last_fullsized":"2024-09-17T05:18:46.132050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123413+0000","last_change":"2024-09-17T05:18:46.123413+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123413+0000","last_undegraded":"2024-09-17T05:18:46.123413+0000","last_fullsized":"2024-09-17T05:18:46.123413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138898+0000","last_change":"2024-09-17T05:18:47.133451+0000","last_active":"2024-09-17T05:18:47.138898+0000","last_peered":"2024-09-17T05:18:47.138898+0000","last_clean":"2024-09-17T05:18:47.138898+0000","last_became_active":"2024-09-17T05:18:47.133212+0000","last_became_peered":"2024-09-17T05:18:47.133212+0000","last_unstale":"2024-09-17T05:18:47.138898+0000","last_undegraded":"2024-09-17T05:18:47.138898+0000","last_fullsized":"2024-09-17T05:18:47.138898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:27.337400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127318+0000","last_change":"2024-09-17T05:18:46.127318+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127318+0000","last_undegraded":"2024-09-17T05:18:46.127318+0000","last_fullsized":"2024-09-17T05:18:46.127318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128885+0000","last_change":"2024-09-17T05:18:46.128885+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128885+0000","last_undegraded":"2024-09-17T05:18:46.128885+0000","last_fullsized":"2024-09-17T05:18:46.128885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126143+0000","last_change":"2024-09-17T05:18:46.126143+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126143+0000","last_undegraded":"2024-09-17T05:18:46.126143+0000","last_fullsized":"2024-09-17T05:18:46.126143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128145+0000","last_change":"2024-09-17T05:18:46.128145+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128145+0000","last_undegraded":"2024-09-17T05:18:46.128145+0000","last_fullsized":"2024-09-17T05:18:46.128145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120567+0000","last_change":"2024-09-17T05:18:46.120567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120567+0000","last_undegraded":"2024-09-17T05:18:46.120567+0000","last_fullsized":"2024-09-17T05:18:46.120567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131588+0000","last_change":"2024-09-17T05:18:46.131588+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131588+0000","last_undegraded":"2024-09-17T05:18:46.131588+0000","last_fullsized":"2024-09-17T05:18:46.131588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124208+0000","last_change":"2024-09-17T05:18:46.124208+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124208+0000","last_undegraded":"2024-09-17T05:18:46.124208+0000","last_fullsized":"2024-09-17T05:18:46.124208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121461+0000","last_change":"2024-09-17T05:18:46.121461+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121461+0000","last_undegraded":"2024-09-17T05:18:46.121461+0000","last_fullsized":"2024-09-17T05:18:46.121461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128071+0000","last_change":"2024-09-17T05:18:46.128071+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128071+0000","last_undegraded":"2024-09-17T05:18:46.128071+0000","last_fullsized":"2024-09-17T05:18:46.128071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120985+0000","last_change":"2024-09-17T05:18:46.120985+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120985+0000","last_undegraded":"2024-09-17T05:18:46.120985+0000","last_fullsized":"2024-09-17T05:18:46.120985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138952+0000","last_change":"2024-09-17T05:18:47.133079+0000","last_active":"2024-09-17T05:18:47.138952+0000","last_peered":"2024-09-17T05:18:47.138952+0000","last_clean":"2024-09-17T05:18:47.138952+0000","last_became_active":"2024-09-17T05:18:47.132823+0000","last_became_peered":"2024-09-17T05:18:47.132823+0000","last_unstale":"2024-09-17T05:18:47.138952+0000","last_undegraded":"2024-09-17T05:18:47.138952+0000","last_fullsized":"2024-09-17T05:18:47.138952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123188+0000","last_change":"2024-09-17T05:18:46.123188+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123188+0000","last_undegraded":"2024-09-17T05:18:46.123188+0000","last_fullsized":"2024-09-17T05:18:46.123188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124789+0000","last_change":"2024-09-17T05:18:46.124789+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124789+0000","last_undegraded":"2024-09-17T05:18:46.124789+0000","last_fullsized":"2024-09-17T05:18:46.124789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123455+0000","last_change":"2024-09-17T05:18:46.123455+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123455+0000","last_undegraded":"2024-09-17T05:18:46.123455+0000","last_fullsized":"2024-09-17T05:18:46.123455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117456+0000","last_change":"2024-09-17T05:18:46.117456+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117456+0000","last_undegraded":"2024-09-17T05:18:46.117456+0000","last_fullsized":"2024-09-17T05:18:46.117456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126380+0000","last_change":"2024-09-17T05:18:46.126380+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126380+0000","last_undegraded":"2024-09-17T05:18:46.126380+0000","last_fullsized":"2024-09-17T05:18:46.126380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124095+0000","last_change":"2024-09-17T05:18:46.124095+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124095+0000","last_undegraded":"2024-09-17T05:18:46.124095+0000","last_fullsized":"2024-09-17T05:18:46.124095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.151709+0000","last_change":"2024-09-17T05:18:47.145653+0000","last_active":"2024-09-17T05:18:47.151709+0000","last_peered":"2024-09-17T05:18:47.151709+0000","last_clean":"2024-09-17T05:18:47.151709+0000","last_became_active":"2024-09-17T05:18:47.145377+0000","last_became_peered":"2024-09-17T05:18:47.145377+0000","last_unstale":"2024-09-17T05:18:47.151709+0000","last_undegraded":"2024-09-17T05:18:47.151709+0000","last_fullsized":"2024-09-17T05:18:47.151709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:25.342804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125712+0000","last_change":"2024-09-17T05:18:46.125712+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125712+0000","last_undegraded":"2024-09-17T05:18:46.125712+0000","last_fullsized":"2024-09-17T05:18:46.125712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121942+0000","last_change":"2024-09-17T05:18:46.121942+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121942+0000","last_undegraded":"2024-09-17T05:18:46.121942+0000","last_fullsized":"2024-09-17T05:18:46.121942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124325+0000","last_change":"2024-09-17T05:18:46.124325+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124325+0000","last_undegraded":"2024-09-17T05:18:46.124325+0000","last_fullsized":"2024-09-17T05:18:46.124325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119567+0000","last_change":"2024-09-17T05:18:46.119567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119567+0000","last_undegraded":"2024-09-17T05:18:46.119567+0000","last_fullsized":"2024-09-17T05:18:46.119567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123698+0000","last_change":"2024-09-17T05:18:46.123698+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123698+0000","last_undegraded":"2024-09-17T05:18:46.123698+0000","last_fullsized":"2024-09-17T05:18:46.123698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124910+0000","last_change":"2024-09-17T05:18:46.124910+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124910+0000","last_undegraded":"2024-09-17T05:18:46.124910+0000","last_fullsized":"2024-09-17T05:18:46.124910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118569+0000","last_change":"2024-09-17T05:18:46.118569+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118569+0000","last_undegraded":"2024-09-17T05:18:46.118569+0000","last_fullsized":"2024-09-17T05:18:46.118569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141444+0000","last_change":"2024-09-17T05:18:47.137341+0000","last_active":"2024-09-17T05:18:47.141444+0000","last_peered":"2024-09-17T05:18:47.141444+0000","last_clean":"2024-09-17T05:18:47.141444+0000","last_became_active":"2024-09-17T05:18:47.136527+0000","last_became_peered":"2024-09-17T05:18:47.136527+0000","last_unstale":"2024-09-17T05:18:47.141444+0000","last_undegraded":"2024-09-17T05:18:47.141444+0000","last_fullsized":"2024-09-17T05:18:47.141444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:14.590352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125302+0000","last_change":"2024-09-17T05:18:46.125302+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125302+0000","last_undegraded":"2024-09-17T05:18:46.125302+0000","last_fullsized":"2024-09-17T05:18:46.125302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117483+0000","last_change":"2024-09-17T05:18:46.117483+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117483+0000","last_undegraded":"2024-09-17T05:18:46.117483+0000","last_fullsized":"2024-09-17T05:18:46.117483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.122358+0000","last_change":"2024-09-17T05:18:46.122358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.122358+0000","last_undegraded":"2024-09-17T05:18:46.122358+0000","last_fullsized":"2024-09-17T05:18:46.122358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126772+0000","last_change":"2024-09-17T05:18:46.126772+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126772+0000","last_undegraded":"2024-09-17T05:18:46.126772+0000","last_fullsized":"2024-09-17T05:18:46.126772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137203+0000","last_change":"2024-09-17T05:18:46.133224+0000","last_active":"2024-09-17T05:18:46.137203+0000","last_peered":"2024-09-17T05:18:46.137203+0000","last_clean":"2024-09-17T05:18:46.137203+0000","last_became_active":"2024-09-17T05:18:46.132897+0000","last_became_peered":"2024-09-17T05:18:46.132897+0000","last_unstale":"2024-09-17T05:18:46.137203+0000","last_undegraded":"2024-09-17T05:18:46.137203+0000","last_fullsized":"2024-09-17T05:18:46.137203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141244+0000","last_change":"2024-09-17T05:18:47.135685+0000","last_active":"2024-09-17T05:18:47.141244+0000","last_peered":"2024-09-17T05:18:47.141244+0000","last_clean":"2024-09-17T05:18:47.141244+0000","last_became_active":"2024-09-17T05:18:47.134928+0000","last_became_peered":"2024-09-17T05:18:47.134928+0000","last_unstale":"2024-09-17T05:18:47.141244+0000","last_undegraded":"2024-09-17T05:18:47.141244+0000","last_fullsized":"2024-09-17T05:18:47.141244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:34.673271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137791+0000","last_change":"2024-09-17T05:18:46.131904+0000","last_active":"2024-09-17T05:18:46.137791+0000","last_peered":"2024-09-17T05:18:46.137791+0000","last_clean":"2024-09-17T05:18:46.137791+0000","last_became_active":"2024-09-17T05:18:46.131515+0000","last_became_peered":"2024-09-17T05:18:46.131515+0000","last_unstale":"2024-09-17T05:18:46.137791+0000","last_undegraded":"2024-09-17T05:18:46.137791+0000","last_fullsized":"2024-09-17T05:18:46.137791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:42.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134477+0000","last_change":"2024-09-17T05:18:46.130687+0000","last_active":"2024-09-17T05:18:46.134477+0000","last_peered":"2024-09-17T05:18:46.134477+0000","last_clean":"2024-09-17T05:18:46.134477+0000","last_became_active":"2024-09-17T05:18:46.130402+0000","last_became_peered":"2024-09-17T05:18:46.130402+0000","last_unstale":"2024-09-17T05:18:46.134477+0000","last_undegraded":"2024-09-17T05:18:46.134477+0000","last_fullsized":"2024-09-17T05:18:46.134477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120119+0000","last_change":"2024-09-17T05:18:46.120119+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120119+0000","last_undegraded":"2024-09-17T05:18:46.120119+0000","last_fullsized":"2024-09-17T05:18:46.120119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137804+0000","last_change":"2024-09-17T05:18:46.135197+0000","last_active":"2024-09-17T05:18:46.137804+0000","last_peered":"2024-09-17T05:18:46.137804+0000","last_clean":"2024-09-17T05:18:46.137804+0000","last_became_active":"2024-09-17T05:18:46.134931+0000","last_became_peered":"2024-09-17T05:18:46.134931+0000","last_unstale":"2024-09-17T05:18:46.137804+0000","last_undegraded":"2024-09-17T05:18:46.137804+0000","last_fullsized":"2024-09-17T05:18:46.137804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124148+0000","last_change":"2024-09-17T05:18:46.124148+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124148+0000","last_undegraded":"2024-09-17T05:18:46.124148+0000","last_fullsized":"2024-09-17T05:18:46.124148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.143659+0000","last_change":"2024-09-17T05:18:46.137454+0000","last_active":"2024-09-17T05:18:46.143659+0000","last_peered":"2024-09-17T05:18:46.143659+0000","last_clean":"2024-09-17T05:18:46.143659+0000","last_became_active":"2024-09-17T05:18:46.136894+0000","last_became_peered":"2024-09-17T05:18:46.136894+0000","last_unstale":"2024-09-17T05:18:46.143659+0000","last_undegraded":"2024-09-17T05:18:46.143659+0000","last_fullsized":"2024-09-17T05:18:46.143659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124949+0000","last_change":"2024-09-17T05:18:46.124949+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124949+0000","last_undegraded":"2024-09-17T05:18:46.124949+0000","last_fullsized":"2024-09-17T05:18:46.124949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.138344+0000","last_change":"2024-09-17T05:18:46.136107+0000","last_active":"2024-09-17T05:18:46.138344+0000","last_peered":"2024-09-17T05:18:46.138344+0000","last_clean":"2024-09-17T05:18:46.138344+0000","last_became_active":"2024-09-17T05:18:46.135733+0000","last_became_peered":"2024-09-17T05:18:46.135733+0000","last_unstale":"2024-09-17T05:18:46.138344+0000","last_undegraded":"2024-09-17T05:18:46.138344+0000","last_fullsized":"2024-09-17T05:18:46.138344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145713+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145713+0000","last_peered":"2024-09-17T05:18:47.145713+0000","last_clean":"2024-09-17T05:18:47.145713+0000","last_became_active":"2024-09-17T05:18:47.139941+0000","last_became_peered":"2024-09-17T05:18:47.139941+0000","last_unstale":"2024-09-17T05:18:47.145713+0000","last_undegraded":"2024-09-17T05:18:47.145713+0000","last_fullsized":"2024-09-17T05:18:47.145713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:36.992037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137320+0000","last_change":"2024-09-17T05:18:46.133330+0000","last_active":"2024-09-17T05:18:46.137320+0000","last_peered":"2024-09-17T05:18:46.137320+0000","last_clean":"2024-09-17T05:18:46.137320+0000","last_became_active":"2024-09-17T05:18:46.133026+0000","last_became_peered":"2024-09-17T05:18:46.133026+0000","last_unstale":"2024-09-17T05:18:46.137320+0000","last_undegraded":"2024-09-17T05:18:46.137320+0000","last_fullsized":"2024-09-17T05:18:46.137320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127560+0000","last_change":"2024-09-17T05:18:46.127560+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127560+0000","last_undegraded":"2024-09-17T05:18:46.127560+0000","last_fullsized":"2024-09-17T05:18:46.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137555+0000","last_change":"2024-09-17T05:18:46.133755+0000","last_active":"2024-09-17T05:18:46.137555+0000","last_peered":"2024-09-17T05:18:46.137555+0000","last_clean":"2024-09-17T05:18:46.137555+0000","last_became_active":"2024-09-17T05:18:46.133067+0000","last_became_peered":"2024-09-17T05:18:46.133067+0000","last_unstale":"2024-09-17T05:18:46.137555+0000","last_undegraded":"2024-09-17T05:18:46.137555+0000","last_fullsized":"2024-09-17T05:18:46.137555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.130713+0000","last_change":"2024-09-17T05:18:46.130713+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.130713+0000","last_undegraded":"2024-09-17T05:18:46.130713+0000","last_fullsized":"2024-09-17T05:18:46.130713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.144188+0000","last_change":"2024-09-17T05:18:46.129204+0000","last_active":"2024-09-17T05:18:47.144188+0000","last_peered":"2024-09-17T05:18:47.144188+0000","last_clean":"2024-09-17T05:18:47.144188+0000","last_became_active":"2024-09-17T05:18:46.128901+0000","last_became_peered":"2024-09-17T05:18:46.128901+0000","last_unstale":"2024-09-17T05:18:47.144188+0000","last_undegraded":"2024-09-17T05:18:47.144188+0000","last_fullsized":"2024-09-17T05:18:47.144188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:39.714747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.140902+0000","last_change":"2024-09-17T05:18:47.136191+0000","last_active":"2024-09-17T05:18:47.140902+0000","last_peered":"2024-09-17T05:18:47.140902+0000","last_clean":"2024-09-17T05:18:47.140902+0000","last_became_active":"2024-09-17T05:18:47.135912+0000","last_became_peered":"2024-09-17T05:18:47.135912+0000","last_unstale":"2024-09-17T05:18:47.140902+0000","last_undegraded":"2024-09-17T05:18:47.140902+0000","last_fullsized":"2024-09-17T05:18:47.140902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:16.628165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.133185+0000","last_change":"2024-09-17T05:18:46.132187+0000","last_active":"2024-09-17T05:18:46.133185+0000","last_peered":"2024-09-17T05:18:46.133185+0000","last_clean":"2024-09-17T05:18:46.133185+0000","last_became_active":"2024-09-17T05:18:46.131916+0000","last_became_peered":"2024-09-17T05:18:46.131916+0000","last_unstale":"2024-09-17T05:18:46.133185+0000","last_undegraded":"2024-09-17T05:18:46.133185+0000","last_fullsized":"2024-09-17T05:18:46.133185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127217+0000","last_change":"2024-09-17T05:18:46.127217+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127217+0000","last_undegraded":"2024-09-17T05:18:46.127217+0000","last_fullsized":"2024-09-17T05:18:46.127217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137595+0000","last_change":"2024-09-17T05:18:46.131494+0000","last_active":"2024-09-17T05:18:46.137595+0000","last_peered":"2024-09-17T05:18:46.137595+0000","last_clean":"2024-09-17T05:18:46.137595+0000","last_became_active":"2024-09-17T05:18:46.131210+0000","last_became_peered":"2024-09-17T05:18:46.131210+0000","last_unstale":"2024-09-17T05:18:46.137595+0000","last_undegraded":"2024-09-17T05:18:46.137595+0000","last_fullsized":"2024-09-17T05:18:46.137595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:22.572452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121122+0000","last_change":"2024-09-17T05:18:46.121122+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121122+0000","last_undegraded":"2024-09-17T05:18:46.121122+0000","last_fullsized":"2024-09-17T05:18:46.121122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131785+0000","last_change":"2024-09-17T05:18:46.127329+0000","last_active":"2024-09-17T05:18:46.131785+0000","last_peered":"2024-09-17T05:18:46.131785+0000","last_clean":"2024-09-17T05:18:46.131785+0000","last_became_active":"2024-09-17T05:18:46.126863+0000","last_became_peered":"2024-09-17T05:18:46.126863+0000","last_unstale":"2024-09-17T05:18:46.131785+0000","last_undegraded":"2024-09-17T05:18:46.131785+0000","last_fullsized":"2024-09-17T05:18:46.131785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127044+0000","last_change":"2024-09-17T05:18:46.127044+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127044+0000","last_undegraded":"2024-09-17T05:18:46.127044+0000","last_fullsized":"2024-09-17T05:18:46.127044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132242+0000","last_change":"2024-09-17T05:18:46.130487+0000","last_active":"2024-09-17T05:18:46.132242+0000","last_peered":"2024-09-17T05:18:46.132242+0000","last_clean":"2024-09-17T05:18:46.132242+0000","last_became_active":"2024-09-17T05:18:46.130163+0000","last_became_peered":"2024-09-17T05:18:46.130163+0000","last_unstale":"2024-09-17T05:18:46.132242+0000","last_undegraded":"2024-09-17T05:18:46.132242+0000","last_fullsized":"2024-09-17T05:18:46.132242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126358+0000","last_change":"2024-09-17T05:18:46.126358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126358+0000","last_undegraded":"2024-09-17T05:18:46.126358+0000","last_fullsized":"2024-09-17T05:18:46.126358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131836+0000","last_change":"2024-09-17T05:18:46.129081+0000","last_active":"2024-09-17T05:18:46.131836+0000","last_peered":"2024-09-17T05:18:46.131836+0000","last_clean":"2024-09-17T05:18:46.131836+0000","last_became_active":"2024-09-17T05:18:46.128776+0000","last_became_peered":"2024-09-17T05:18:46.128776+0000","last_unstale":"2024-09-17T05:18:46.131836+0000","last_undegraded":"2024-09-17T05:18:46.131836+0000","last_fullsized":"2024-09-17T05:18:46.131836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131083+0000","last_change":"2024-09-17T05:18:46.131083+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131083+0000","last_undegraded":"2024-09-17T05:18:46.131083+0000","last_fullsized":"2024-09-17T05:18:46.131083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137297+0000","last_change":"2024-09-17T05:18:46.132599+0000","last_active":"2024-09-17T05:18:46.137297+0000","last_peered":"2024-09-17T05:18:46.137297+0000","last_clean":"2024-09-17T05:18:46.137297+0000","last_became_active":"2024-09-17T05:18:46.132293+0000","last_became_peered":"2024-09-17T05:18:46.132293+0000","last_unstale":"2024-09-17T05:18:46.137297+0000","last_undegraded":"2024-09-17T05:18:46.137297+0000","last_fullsized":"2024-09-17T05:18:46.137297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123312+0000","last_change":"2024-09-17T05:18:46.123312+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123312+0000","last_undegraded":"2024-09-17T05:18:46.123312+0000","last_fullsized":"2024-09-17T05:18:46.123312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131766+0000","last_change":"2024-09-17T05:18:46.127182+0000","last_active":"2024-09-17T05:18:46.131766+0000","last_peered":"2024-09-17T05:18:46.131766+0000","last_clean":"2024-09-17T05:18:46.131766+0000","last_became_active":"2024-09-17T05:18:46.126903+0000","last_became_peered":"2024-09-17T05:18:46.126903+0000","last_unstale":"2024-09-17T05:18:46.131766+0000","last_undegraded":"2024-09-17T05:18:46.131766+0000","last_fullsized":"2024-09-17T05:18:46.131766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.129568+0000","last_change":"2024-09-17T05:18:46.129568+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.129568+0000","last_undegraded":"2024-09-17T05:18:46.129568+0000","last_fullsized":"2024-09-17T05:18:46.129568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134116+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:18:46.134116+0000","last_peered":"2024-09-17T05:18:46.134116+0000","last_clean":"2024-09-17T05:18:46.134116+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:18:46.134116+0000","last_undegraded":"2024-09-17T05:18:46.134116+0000","last_fullsized":"2024-09-17T05:18:46.134116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132517+0000","last_change":"2024-09-17T05:18:46.127446+0000","last_active":"2024-09-17T05:18:46.132517+0000","last_peered":"2024-09-17T05:18:46.132517+0000","last_clean":"2024-09-17T05:18:46.132517+0000","last_became_active":"2024-09-17T05:18:46.126901+0000","last_became_peered":"2024-09-17T05:18:46.126901+0000","last_unstale":"2024-09-17T05:18:46.132517+0000","last_undegraded":"2024-09-17T05:18:46.132517+0000","last_fullsized":"2024-09-17T05:18:46.132517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120082+0000","last_change":"2024-09-17T05:18:46.120082+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120082+0000","last_undegraded":"2024-09-17T05:18:46.120082+0000","last_fullsized":"2024-09-17T05:18:46.120082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146134+0000","last_change":"2024-09-17T05:18:46.141132+0000","last_active":"2024-09-17T05:18:46.146134+0000","last_peered":"2024-09-17T05:18:46.146134+0000","last_clean":"2024-09-17T05:18:46.146134+0000","last_became_active":"2024-09-17T05:18:46.140364+0000","last_became_peered":"2024-09-17T05:18:46.140364+0000","last_unstale":"2024-09-17T05:18:46.146134+0000","last_undegraded":"2024-09-17T05:18:46.146134+0000","last_fullsized":"2024-09-17T05:18:46.146134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141977+0000","last_change":"2024-09-17T05:18:47.139416+0000","last_active":"2024-09-17T05:18:47.141977+0000","last_peered":"2024-09-17T05:18:47.141977+0000","last_clean":"2024-09-17T05:18:47.141977+0000","last_became_active":"2024-09-17T05:18:47.139149+0000","last_became_peered":"2024-09-17T05:18:47.139149+0000","last_unstale":"2024-09-17T05:18:47.141977+0000","last_undegraded":"2024-09-17T05:18:47.141977+0000","last_fullsized":"2024-09-17T05:18:47.141977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:37.744818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131845+0000","last_change":"2024-09-17T05:18:46.129101+0000","last_active":"2024-09-17T05:18:46.131845+0000","last_peered":"2024-09-17T05:18:46.131845+0000","last_clean":"2024-09-17T05:18:46.131845+0000","last_became_active":"2024-09-17T05:18:46.128748+0000","last_became_peered":"2024-09-17T05:18:46.128748+0000","last_unstale":"2024-09-17T05:18:46.131845+0000","last_undegraded":"2024-09-17T05:18:46.131845+0000","last_fullsized":"2024-09-17T05:18:46.131845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124150+0000","last_change":"2024-09-17T05:18:46.124150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124150+0000","last_undegraded":"2024-09-17T05:18:46.124150+0000","last_fullsized":"2024-09-17T05:18:46.124150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132383+0000","last_change":"2024-09-17T05:18:46.129856+0000","last_active":"2024-09-17T05:18:46.132383+0000","last_peered":"2024-09-17T05:18:46.132383+0000","last_clean":"2024-09-17T05:18:46.132383+0000","last_became_active":"2024-09-17T05:18:46.129409+0000","last_became_peered":"2024-09-17T05:18:46.129409+0000","last_unstale":"2024-09-17T05:18:46.132383+0000","last_undegraded":"2024-09-17T05:18:46.132383+0000","last_fullsized":"2024-09-17T05:18:46.132383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125923+0000","last_change":"2024-09-17T05:18:46.125923+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125923+0000","last_undegraded":"2024-09-17T05:18:46.125923+0000","last_fullsized":"2024-09-17T05:18:46.125923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134337+0000","last_change":"2024-09-17T05:18:46.128837+0000","last_active":"2024-09-17T05:18:46.134337+0000","last_peered":"2024-09-17T05:18:46.134337+0000","last_clean":"2024-09-17T05:18:46.134337+0000","last_became_active":"2024-09-17T05:18:46.128576+0000","last_became_peered":"2024-09-17T05:18:46.128576+0000","last_unstale":"2024-09-17T05:18:46.134337+0000","last_undegraded":"2024-09-17T05:18:46.134337+0000","last_fullsized":"2024-09-17T05:18:46.134337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123328+0000","last_change":"2024-09-17T05:18:46.123328+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123328+0000","last_undegraded":"2024-09-17T05:18:46.123328+0000","last_fullsized":"2024-09-17T05:18:46.123328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146182+0000","last_change":"2024-09-17T05:18:46.141667+0000","last_active":"2024-09-17T05:18:46.146182+0000","last_peered":"2024-09-17T05:18:46.146182+0000","last_clean":"2024-09-17T05:18:46.146182+0000","last_became_active":"2024-09-17T05:18:46.140316+0000","last_became_peered":"2024-09-17T05:18:46.140316+0000","last_unstale":"2024-09-17T05:18:46.146182+0000","last_undegraded":"2024-09-17T05:18:46.146182+0000","last_fullsized":"2024-09-17T05:18:46.146182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124158+0000","last_change":"2024-09-17T05:18:46.124158+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124158+0000","last_undegraded":"2024-09-17T05:18:46.124158+0000","last_fullsized":"2024-09-17T05:18:46.124158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134353+0000","last_change":"2024-09-17T05:18:46.130971+0000","last_active":"2024-09-17T05:18:46.134353+0000","last_peered":"2024-09-17T05:18:46.134353+0000","last_clean":"2024-09-17T05:18:46.134353+0000","last_became_active":"2024-09-17T05:18:46.130678+0000","last_became_peered":"2024-09-17T05:18:46.130678+0000","last_unstale":"2024-09-17T05:18:46.134353+0000","last_undegraded":"2024-09-17T05:18:46.134353+0000","last_fullsized":"2024-09-17T05:18:46.134353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119056+0000","last_change":"2024-09-17T05:18:46.119056+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119056+0000","last_undegraded":"2024-09-17T05:18:46.119056+0000","last_fullsized":"2024-09-17T05:18:46.119056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.140398+0000","last_change":"2024-09-17T05:18:46.137090+0000","last_active":"2024-09-17T05:18:46.140398+0000","last_peered":"2024-09-17T05:18:46.140398+0000","last_clean":"2024-09-17T05:18:46.140398+0000","last_became_active":"2024-09-17T05:18:46.136506+0000","last_became_peered":"2024-09-17T05:18:46.136506+0000","last_unstale":"2024-09-17T05:18:46.140398+0000","last_undegraded":"2024-09-17T05:18:46.140398+0000","last_fullsized":"2024-09-17T05:18:46.140398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138865+0000","last_change":"2024-09-17T05:18:47.132848+0000","last_active":"2024-09-17T05:18:47.138865+0000","last_peered":"2024-09-17T05:18:47.138865+0000","last_clean":"2024-09-17T05:18:47.138865+0000","last_became_active":"2024-09-17T05:18:47.132504+0000","last_became_peered":"2024-09-17T05:18:47.132504+0000","last_unstale":"2024-09-17T05:18:47.138865+0000","last_undegraded":"2024-09-17T05:18:47.138865+0000","last_fullsized":"2024-09-17T05:18:47.138865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:08.296618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.141500+0000","last_change":"2024-09-17T05:18:46.137719+0000","last_active":"2024-09-17T05:18:46.141500+0000","last_peered":"2024-09-17T05:18:46.141500+0000","last_clean":"2024-09-17T05:18:46.141500+0000","last_became_active":"2024-09-17T05:18:46.137459+0000","last_became_peered":"2024-09-17T05:18:46.137459+0000","last_unstale":"2024-09-17T05:18:46.141500+0000","last_undegraded":"2024-09-17T05:18:46.141500+0000","last_fullsized":"2024-09-17T05:18:46.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126210+0000","last_change":"2024-09-17T05:18:46.126210+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126210+0000","last_undegraded":"2024-09-17T05:18:46.126210+0000","last_fullsized":"2024-09-17T05:18:46.126210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.139879+0000","last_change":"2024-09-17T05:18:46.136676+0000","last_active":"2024-09-17T05:18:46.139879+0000","last_peered":"2024-09-17T05:18:46.139879+0000","last_clean":"2024-09-17T05:18:46.139879+0000","last_became_active":"2024-09-17T05:18:46.136468+0000","last_became_peered":"2024-09-17T05:18:46.136468+0000","last_unstale":"2024-09-17T05:18:46.139879+0000","last_undegraded":"2024-09-17T05:18:46.139879+0000","last_fullsized":"2024-09-17T05:18:46.139879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:44.260018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118436+0000","last_change":"2024-09-17T05:18:46.118436+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118436+0000","last_undegraded":"2024-09-17T05:18:46.118436+0000","last_fullsized":"2024-09-17T05:18:46.118436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137293+0000","last_change":"2024-09-17T05:18:46.132362+0000","last_active":"2024-09-17T05:18:46.137293+0000","last_peered":"2024-09-17T05:18:46.137293+0000","last_clean":"2024-09-17T05:18:46.137293+0000","last_became_active":"2024-09-17T05:18:46.132074+0000","last_became_peered":"2024-09-17T05:18:46.132074+0000","last_unstale":"2024-09-17T05:18:46.137293+0000","last_undegraded":"2024-09-17T05:18:46.137293+0000","last_fullsized":"2024-09-17T05:18:46.137293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119206+0000","last_change":"2024-09-17T05:18:46.119206+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119206+0000","last_undegraded":"2024-09-17T05:18:46.119206+0000","last_fullsized":"2024-09-17T05:18:46.119206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145741+0000","last_change":"2024-09-17T05:18:46.140762+0000","last_active":"2024-09-17T05:18:46.145741+0000","last_peered":"2024-09-17T05:18:46.145741+0000","last_clean":"2024-09-17T05:18:46.145741+0000","last_became_active":"2024-09-17T05:18:46.140483+0000","last_became_peered":"2024-09-17T05:18:46.140483+0000","last_unstale":"2024-09-17T05:18:46.145741+0000","last_undegraded":"2024-09-17T05:18:46.145741+0000","last_fullsized":"2024-09-17T05:18:46.145741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123150+0000","last_change":"2024-09-17T05:18:46.123150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123150+0000","last_undegraded":"2024-09-17T05:18:46.123150+0000","last_fullsized":"2024-09-17T05:18:46.123150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123834+0000","last_change":"2024-09-17T05:18:46.123834+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123834+0000","last_undegraded":"2024-09-17T05:18:46.123834+0000","last_fullsized":"2024-09-17T05:18:46.123834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145734+0000","last_change":"2024-09-17T05:18:46.140678+0000","last_active":"2024-09-17T05:18:46.145734+0000","last_peered":"2024-09-17T05:18:46.145734+0000","last_clean":"2024-09-17T05:18:46.145734+0000","last_became_active":"2024-09-17T05:18:46.140137+0000","last_became_peered":"2024-09-17T05:18:46.140137+0000","last_unstale":"2024-09-17T05:18:46.145734+0000","last_undegraded":"2024-09-17T05:18:46.145734+0000","last_fullsized":"2024-09-17T05:18:46.145734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126438+0000","last_change":"2024-09-17T05:18:46.126438+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126438+0000","last_undegraded":"2024-09-17T05:18:46.126438+0000","last_fullsized":"2024-09-17T05:18:46.126438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145783+0000","last_change":"2024-09-17T05:18:46.141012+0000","last_active":"2024-09-17T05:18:46.145783+0000","last_peered":"2024-09-17T05:18:46.145783+0000","last_clean":"2024-09-17T05:18:46.145783+0000","last_became_active":"2024-09-17T05:18:46.140729+0000","last_became_peered":"2024-09-17T05:18:46.140729+0000","last_unstale":"2024-09-17T05:18:46.145783+0000","last_undegraded":"2024-09-17T05:18:46.145783+0000","last_fullsized":"2024-09-17T05:18:46.145783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145688+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145688+0000","last_peered":"2024-09-17T05:18:47.145688+0000","last_clean":"2024-09-17T05:18:47.145688+0000","last_became_active":"2024-09-17T05:18:47.140502+0000","last_became_peered":"2024-09-17T05:18:47.140502+0000","last_unstale":"2024-09-17T05:18:47.145688+0000","last_undegraded":"2024-09-17T05:18:47.145688+0000","last_fullsized":"2024-09-17T05:18:47.145688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:06.475279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132014+0000","last_change":"2024-09-17T05:18:46.126436+0000","last_active":"2024-09-17T05:18:46.132014+0000","last_peered":"2024-09-17T05:18:46.132014+0000","last_clean":"2024-09-17T05:18:46.132014+0000","last_became_active":"2024-09-17T05:18:46.126106+0000","last_became_peered":"2024-09-17T05:18:46.126106+0000","last_unstale":"2024-09-17T05:18:46.132014+0000","last_undegraded":"2024-09-17T05:18:46.132014+0000","last_fullsized":"2024-09-17T05:18:46.132014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121161+0000","last_change":"2024-09-17T05:18:46.121161+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121161+0000","last_undegraded":"2024-09-17T05:18:46.121161+0000","last_fullsized":"2024-09-17T05:18:46.121161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.149033+0000","last_change":"2024-09-17T05:18:46.135269+0000","last_active":"2024-09-17T05:18:47.149033+0000","last_peered":"2024-09-17T05:18:47.149033+0000","last_clean":"2024-09-17T05:18:47.149033+0000","last_became_active":"2024-09-17T05:18:46.135042+0000","last_became_peered":"2024-09-17T05:18:46.135042+0000","last_unstale":"2024-09-17T05:18:47.149033+0000","last_undegraded":"2024-09-17T05:18:47.149033+0000","last_fullsized":"2024-09-17T05:18:47.149033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:44.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:18:51.770 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3f is not active+clean 2024-09-17T05:18:51.770 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.132050+0000', 'last_change': '2024-09-17T05:18:46.132050+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.132050+0000', 'last_undegraded': '2024-09-17T05:18:46.132050+0000', 'last_fullsized': '2024-09-17T05:18:46.132050+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3e is not active+clean 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123413+0000', 'last_change': '2024-09-17T05:18:46.123413+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123413+0000', 'last_undegraded': '2024-09-17T05:18:46.123413+0000', 'last_fullsized': '2024-09-17T05:18:46.123413+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3c is not active+clean 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.127318+0000', 'last_change': '2024-09-17T05:18:46.127318+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.127318+0000', 'last_undegraded': '2024-09-17T05:18:46.127318+0000', 'last_fullsized': '2024-09-17T05:18:46.127318+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3b is not active+clean 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.128885+0000', 'last_change': '2024-09-17T05:18:46.128885+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.128885+0000', 'last_undegraded': '2024-09-17T05:18:46.128885+0000', 'last_fullsized': '2024-09-17T05:18:46.128885+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3a is not active+clean 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.126143+0000', 'last_change': '2024-09-17T05:18:46.126143+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.126143+0000', 'last_undegraded': '2024-09-17T05:18:46.126143+0000', 'last_fullsized': '2024-09-17T05:18:46.126143+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:PG 3.39 is not active+clean 2024-09-17T05:18:51.771 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.128145+0000', 'last_change': '2024-09-17T05:18:46.128145+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.128145+0000', 'last_undegraded': '2024-09-17T05:18:46.128145+0000', 'last_fullsized': '2024-09-17T05:18:46.128145+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.38 is not active+clean 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.120567+0000', 'last_change': '2024-09-17T05:18:46.120567+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.120567+0000', 'last_undegraded': '2024-09-17T05:18:46.120567+0000', 'last_fullsized': '2024-09-17T05:18:46.120567+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.37 is not active+clean 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.131588+0000', 'last_change': '2024-09-17T05:18:46.131588+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.131588+0000', 'last_undegraded': '2024-09-17T05:18:46.131588+0000', 'last_fullsized': '2024-09-17T05:18:46.131588+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.36 is not active+clean 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124208+0000', 'last_change': '2024-09-17T05:18:46.124208+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124208+0000', 'last_undegraded': '2024-09-17T05:18:46.124208+0000', 'last_fullsized': '2024-09-17T05:18:46.124208+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.35 is not active+clean 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.121461+0000', 'last_change': '2024-09-17T05:18:46.121461+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.121461+0000', 'last_undegraded': '2024-09-17T05:18:46.121461+0000', 'last_fullsized': '2024-09-17T05:18:46.121461+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:18:51.772 INFO:tasks.ceph.ceph_manager.ceph:PG 3.34 is not active+clean 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.128071+0000', 'last_change': '2024-09-17T05:18:46.128071+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.128071+0000', 'last_undegraded': '2024-09-17T05:18:46.128071+0000', 'last_fullsized': '2024-09-17T05:18:46.128071+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.33 is not active+clean 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.120985+0000', 'last_change': '2024-09-17T05:18:46.120985+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.120985+0000', 'last_undegraded': '2024-09-17T05:18:46.120985+0000', 'last_fullsized': '2024-09-17T05:18:46.120985+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.31 is not active+clean 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123188+0000', 'last_change': '2024-09-17T05:18:46.123188+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123188+0000', 'last_undegraded': '2024-09-17T05:18:46.123188+0000', 'last_fullsized': '2024-09-17T05:18:46.123188+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.30 is not active+clean 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124789+0000', 'last_change': '2024-09-17T05:18:46.124789+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124789+0000', 'last_undegraded': '2024-09-17T05:18:46.124789+0000', 'last_fullsized': '2024-09-17T05:18:46.124789+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2f is not active+clean 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123455+0000', 'last_change': '2024-09-17T05:18:46.123455+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123455+0000', 'last_undegraded': '2024-09-17T05:18:46.123455+0000', 'last_fullsized': '2024-09-17T05:18:46.123455+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2e is not active+clean 2024-09-17T05:18:51.773 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.117456+0000', 'last_change': '2024-09-17T05:18:46.117456+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.117456+0000', 'last_undegraded': '2024-09-17T05:18:46.117456+0000', 'last_fullsized': '2024-09-17T05:18:46.117456+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2d is not active+clean 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.126380+0000', 'last_change': '2024-09-17T05:18:46.126380+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.126380+0000', 'last_undegraded': '2024-09-17T05:18:46.126380+0000', 'last_fullsized': '2024-09-17T05:18:46.126380+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2c is not active+clean 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124095+0000', 'last_change': '2024-09-17T05:18:46.124095+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124095+0000', 'last_undegraded': '2024-09-17T05:18:46.124095+0000', 'last_fullsized': '2024-09-17T05:18:46.124095+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2a is not active+clean 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.125712+0000', 'last_change': '2024-09-17T05:18:46.125712+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.125712+0000', 'last_undegraded': '2024-09-17T05:18:46.125712+0000', 'last_fullsized': '2024-09-17T05:18:46.125712+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.29 is not active+clean 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.121942+0000', 'last_change': '2024-09-17T05:18:46.121942+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.121942+0000', 'last_undegraded': '2024-09-17T05:18:46.121942+0000', 'last_fullsized': '2024-09-17T05:18:46.121942+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:PG 3.28 is not active+clean 2024-09-17T05:18:51.774 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124325+0000', 'last_change': '2024-09-17T05:18:46.124325+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124325+0000', 'last_undegraded': '2024-09-17T05:18:46.124325+0000', 'last_fullsized': '2024-09-17T05:18:46.124325+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.27 is not active+clean 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.119567+0000', 'last_change': '2024-09-17T05:18:46.119567+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.119567+0000', 'last_undegraded': '2024-09-17T05:18:46.119567+0000', 'last_fullsized': '2024-09-17T05:18:46.119567+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.26 is not active+clean 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123698+0000', 'last_change': '2024-09-17T05:18:46.123698+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123698+0000', 'last_undegraded': '2024-09-17T05:18:46.123698+0000', 'last_fullsized': '2024-09-17T05:18:46.123698+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.25 is not active+clean 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124910+0000', 'last_change': '2024-09-17T05:18:46.124910+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124910+0000', 'last_undegraded': '2024-09-17T05:18:46.124910+0000', 'last_fullsized': '2024-09-17T05:18:46.124910+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.24 is not active+clean 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.118569+0000', 'last_change': '2024-09-17T05:18:46.118569+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.118569+0000', 'last_undegraded': '2024-09-17T05:18:46.118569+0000', 'last_fullsized': '2024-09-17T05:18:46.118569+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.22 is not active+clean 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.125302+0000', 'last_change': '2024-09-17T05:18:46.125302+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.125302+0000', 'last_undegraded': '2024-09-17T05:18:46.125302+0000', 'last_fullsized': '2024-09-17T05:18:46.125302+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.775 INFO:tasks.ceph.ceph_manager.ceph:PG 3.21 is not active+clean 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.117483+0000', 'last_change': '2024-09-17T05:18:46.117483+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.117483+0000', 'last_undegraded': '2024-09-17T05:18:46.117483+0000', 'last_fullsized': '2024-09-17T05:18:46.117483+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.20 is not active+clean 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.122358+0000', 'last_change': '2024-09-17T05:18:46.122358+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.122358+0000', 'last_undegraded': '2024-09-17T05:18:46.122358+0000', 'last_fullsized': '2024-09-17T05:18:46.122358+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1a is not active+clean 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.126772+0000', 'last_change': '2024-09-17T05:18:46.126772+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.126772+0000', 'last_undegraded': '2024-09-17T05:18:46.126772+0000', 'last_fullsized': '2024-09-17T05:18:46.126772+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.18 is not active+clean 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.120119+0000', 'last_change': '2024-09-17T05:18:46.120119+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.120119+0000', 'last_undegraded': '2024-09-17T05:18:46.120119+0000', 'last_fullsized': '2024-09-17T05:18:46.120119+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:PG 3.19 is not active+clean 2024-09-17T05:18:51.776 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124148+0000', 'last_change': '2024-09-17T05:18:46.124148+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124148+0000', 'last_undegraded': '2024-09-17T05:18:46.124148+0000', 'last_fullsized': '2024-09-17T05:18:46.124148+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.16 is not active+clean 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124949+0000', 'last_change': '2024-09-17T05:18:46.124949+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124949+0000', 'last_undegraded': '2024-09-17T05:18:46.124949+0000', 'last_fullsized': '2024-09-17T05:18:46.124949+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.14 is not active+clean 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.127560+0000', 'last_change': '2024-09-17T05:18:46.127560+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.127560+0000', 'last_undegraded': '2024-09-17T05:18:46.127560+0000', 'last_fullsized': '2024-09-17T05:18:46.127560+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.15 is not active+clean 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.130713+0000', 'last_change': '2024-09-17T05:18:46.130713+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.130713+0000', 'last_undegraded': '2024-09-17T05:18:46.130713+0000', 'last_fullsized': '2024-09-17T05:18:46.130713+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.13 is not active+clean 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.127217+0000', 'last_change': '2024-09-17T05:18:46.127217+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.127217+0000', 'last_undegraded': '2024-09-17T05:18:46.127217+0000', 'last_fullsized': '2024-09-17T05:18:46.127217+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.10 is not active+clean 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.121122+0000', 'last_change': '2024-09-17T05:18:46.121122+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.121122+0000', 'last_undegraded': '2024-09-17T05:18:46.121122+0000', 'last_fullsized': '2024-09-17T05:18:46.121122+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:18:51.777 INFO:tasks.ceph.ceph_manager.ceph:PG 3.11 is not active+clean 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.127044+0000', 'last_change': '2024-09-17T05:18:46.127044+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.127044+0000', 'last_undegraded': '2024-09-17T05:18:46.127044+0000', 'last_fullsized': '2024-09-17T05:18:46.127044+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.e is not active+clean 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.126358+0000', 'last_change': '2024-09-17T05:18:46.126358+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.126358+0000', 'last_undegraded': '2024-09-17T05:18:46.126358+0000', 'last_fullsized': '2024-09-17T05:18:46.126358+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.f is not active+clean 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.131083+0000', 'last_change': '2024-09-17T05:18:46.131083+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.131083+0000', 'last_undegraded': '2024-09-17T05:18:46.131083+0000', 'last_fullsized': '2024-09-17T05:18:46.131083+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.c is not active+clean 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123312+0000', 'last_change': '2024-09-17T05:18:46.123312+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123312+0000', 'last_undegraded': '2024-09-17T05:18:46.123312+0000', 'last_fullsized': '2024-09-17T05:18:46.123312+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.d is not active+clean 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.129568+0000', 'last_change': '2024-09-17T05:18:46.129568+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.129568+0000', 'last_undegraded': '2024-09-17T05:18:46.129568+0000', 'last_fullsized': '2024-09-17T05:18:46.129568+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:18:51.778 INFO:tasks.ceph.ceph_manager.ceph:PG 3.2 is not active+clean 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.120082+0000', 'last_change': '2024-09-17T05:18:46.120082+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.120082+0000', 'last_undegraded': '2024-09-17T05:18:46.120082+0000', 'last_fullsized': '2024-09-17T05:18:46.120082+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.0 is not active+clean 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124150+0000', 'last_change': '2024-09-17T05:18:46.124150+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124150+0000', 'last_undegraded': '2024-09-17T05:18:46.124150+0000', 'last_fullsized': '2024-09-17T05:18:46.124150+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.3 is not active+clean 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.125923+0000', 'last_change': '2024-09-17T05:18:46.125923+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.125923+0000', 'last_undegraded': '2024-09-17T05:18:46.125923+0000', 'last_fullsized': '2024-09-17T05:18:46.125923+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.5 is not active+clean 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123328+0000', 'last_change': '2024-09-17T05:18:46.123328+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123328+0000', 'last_undegraded': '2024-09-17T05:18:46.123328+0000', 'last_fullsized': '2024-09-17T05:18:46.123328+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.4 is not active+clean 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.124158+0000', 'last_change': '2024-09-17T05:18:46.124158+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.124158+0000', 'last_undegraded': '2024-09-17T05:18:46.124158+0000', 'last_fullsized': '2024-09-17T05:18:46.124158+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:18:51.779 INFO:tasks.ceph.ceph_manager.ceph:PG 3.7 is not active+clean 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.119056+0000', 'last_change': '2024-09-17T05:18:46.119056+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.119056+0000', 'last_undegraded': '2024-09-17T05:18:46.119056+0000', 'last_fullsized': '2024-09-17T05:18:46.119056+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.9 is not active+clean 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.126210+0000', 'last_change': '2024-09-17T05:18:46.126210+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.126210+0000', 'last_undegraded': '2024-09-17T05:18:46.126210+0000', 'last_fullsized': '2024-09-17T05:18:46.126210+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.8 is not active+clean 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.118436+0000', 'last_change': '2024-09-17T05:18:46.118436+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.118436+0000', 'last_undegraded': '2024-09-17T05:18:46.118436+0000', 'last_fullsized': '2024-09-17T05:18:46.118436+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.b is not active+clean 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.119206+0000', 'last_change': '2024-09-17T05:18:46.119206+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.119206+0000', 'last_undegraded': '2024-09-17T05:18:46.119206+0000', 'last_fullsized': '2024-09-17T05:18:46.119206+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.a is not active+clean 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123150+0000', 'last_change': '2024-09-17T05:18:46.123150+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123150+0000', 'last_undegraded': '2024-09-17T05:18:46.123150+0000', 'last_fullsized': '2024-09-17T05:18:46.123150+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:18:51.780 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1d is not active+clean 2024-09-17T05:18:51.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.123834+0000', 'last_change': '2024-09-17T05:18:46.123834+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.123834+0000', 'last_undegraded': '2024-09-17T05:18:46.123834+0000', 'last_fullsized': '2024-09-17T05:18:46.123834+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.781 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1c is not active+clean 2024-09-17T05:18:51.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.126438+0000', 'last_change': '2024-09-17T05:18:46.126438+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.126438+0000', 'last_undegraded': '2024-09-17T05:18:46.126438+0000', 'last_fullsized': '2024-09-17T05:18:46.126438+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:18:51.781 INFO:tasks.ceph.ceph_manager.ceph:PG 3.1e is not active+clean 2024-09-17T05:18:51.781 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 21, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:18:46.121161+0000', 'last_change': '2024-09-17T05:18:46.121161+0000', 'last_active': '2024-09-17T05:18:46.108157+0000', 'last_peered': '2024-09-17T05:18:46.108157+0000', 'last_clean': '2024-09-17T05:18:46.108157+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:18:46.121161+0000', 'last_undegraded': '2024-09-17T05:18:46.121161+0000', 'last_fullsized': '2024-09-17T05:18:46.121161+0000', 'mapping_epoch': 21, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 21, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'last_clean_scrub_stamp': '2024-09-17T05:18:46.108157+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:18:51.781 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:18:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 -- 172.21.15.81:0/2378234875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 msgr2=0x7fe5100cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 --2- 172.21.15.81:0/2378234875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe5100cf920 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fe5100d2ce0 tx=0x7fe50002aa30 comp rx=0 tx=0).stop 2024-09-17T05:18:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 -- 172.21.15.81:0/2378234875 shutdown_connections 2024-09-17T05:18:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 --2- 172.21.15.81:0/2378234875 >> v2:172.21.15.160:3300/0 conn(0x7fe510160ac0 0x7fe510160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 --2- 172.21.15.81:0/2378234875 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5100d1a10 0x7fe510161f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 --2- 172.21.15.81:0/2378234875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe5100cf920 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 -- 172.21.15.81:0/2378234875 >> 172.21.15.81:0/2378234875 conn(0x7fe5100d3e40 msgr2=0x7fe5100d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 -- 172.21.15.81:0/2378234875 shutdown_connections 2024-09-17T05:18:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.905+0000 7fe515216640 1 -- 172.21.15.81:0/2378234875 wait complete. 2024-09-17T05:18:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.906+0000 7fe515216640 1 Processor -- start 2024-09-17T05:18:51.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.906+0000 7fe515216640 1 -- start start 2024-09-17T05:18:51.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe515216640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5100d1a10 0x7fe5100b79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe515216640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510160ac0 0x7fe5100b2750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe515216640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe510153c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe515216640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe510161820 con 0x7fe510161b30 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe515216640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe5101616a0 con 0x7fe5100d1a10 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe515216640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe5100d0710 con 0x7fe510160ac0 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe510153c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe510153c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43834/0 (socket says 172.21.15.81:43834) 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 -- 172.21.15.81:0/1531206548 learned_addr learned my addr 172.21.15.81:0/1531206548 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50e59c640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510160ac0 0x7fe5100b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50ed9d640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5100d1a10 0x7fe5100b79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 -- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510160ac0 msgr2=0x7fe5100b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510160ac0 0x7fe5100b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 -- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5100d1a10 msgr2=0x7fe5100b79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5100d1a10 0x7fe5100b79f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50f59e640 1 -- 172.21.15.81:0/1531206548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5100b2c90 con 0x7fe510161b30 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.907+0000 7fe50e59c640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510160ac0 0x7fe5100b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.908+0000 7fe50f59e640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe510153c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe50800d770 tx=0x7fe50800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.908+0000 7fe4f77fe640 1 -- 172.21.15.81:0/1531206548 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508017070 con 0x7fe510161b30 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.908+0000 7fe4f77fe640 1 -- 172.21.15.81:0/1531206548 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe508009d20 con 0x7fe510161b30 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.908+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5100b2f30 con 0x7fe510161b30 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.908+0000 7fe4f77fe640 1 -- 172.21.15.81:0/1531206548 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe508004280 con 0x7fe510161b30 2024-09-17T05:18:51.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.908+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5100c9000 con 0x7fe510161b30 2024-09-17T05:18:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.909+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe510160f50 con 0x7fe510161b30 2024-09-17T05:18:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.909+0000 7fe4f77fe640 1 -- 172.21.15.81:0/1531206548 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe5080035f0 con 0x7fe510161b30 2024-09-17T05:18:51.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.910+0000 7fe4f77fe640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4fc078b90 0x7fe4fc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.910+0000 7fe4f77fe640 1 -- 172.21.15.81:0/1531206548 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe50809adc0 con 0x7fe510161b30 2024-09-17T05:18:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.910+0000 7fe50ed9d640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4fc078b90 0x7fe4fc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:51.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.910+0000 7fe50ed9d640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4fc078b90 0x7fe4fc07b050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe500035000 tx=0x7fe50003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:51.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:51.914+0000 7fe4f77fe640 1 -- 172.21.15.81:0/1531206548 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe508062c40 con 0x7fe510161b30 2024-09-17T05:18:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.163+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fe5100b3580 con 0x7fe510161b30 2024-09-17T05:18:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.163+0000 7fe4f77fe640 1 -- 172.21.15.81:0/1531206548 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1138 (secure 0 0 0) 0x7fe508067670 con 0x7fe510161b30 2024-09-17T05:18:52.164 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:52.164 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":29,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":23,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550316,"num_in_osds":8,"osd_in_since":1726550306,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":54},{"state_name":"active+clean","count":43}],"num_pgs":97,"num_pools":3,"num_objects":6,"data_bytes":590984,"bytes_used":224210944,"bytes_avail":772869902336,"bytes_total":773094113280,"inactive_pgs_ratio":0.55670100450515747,"write_bytes_sec":1365,"read_op_per_sec":0,"write_op_per_sec":1},"fsmap":{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"d","status":"up:active","gid":4363}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2024-09-17T05:18:23.003950+0000","services":{}},"progress_events":{}} 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4fc078b90 msgr2=0x7fe4fc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4fc078b90 0x7fe4fc07b050 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe500035000 tx=0x7fe50003b040 comp rx=0 tx=0).stop 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 msgr2=0x7fe510153c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe510153c60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fe50800d770 tx=0x7fe50800dc30 comp rx=0 tx=0).stop 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 shutdown_connections 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4fc078b90 0x7fe4fc07b050 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe510161b30 0x7fe510153c60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe510160ac0 0x7fe5100b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 --2- 172.21.15.81:0/1531206548 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5100d1a10 0x7fe5100b79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 >> 172.21.15.81:0/1531206548 conn(0x7fe5100d3e40 msgr2=0x7fe5100b5a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:52.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 shutdown_connections 2024-09-17T05:18:52.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.166+0000 7fe515216640 1 -- 172.21.15.81:0/1531206548 wait complete. 2024-09-17T05:18:52.177 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:18:52.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:18:52.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.276+0000 7fd198bec640 1 -- 172.21.15.81:0/3811071866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940735a0 msgr2=0x7fd1940739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.276+0000 7fd198bec640 1 --2- 172.21.15.81:0/3811071866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940735a0 0x7fd1940739d0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fd17c009830 tx=0x7fd17c02a530 comp rx=0 tx=0).stop 2024-09-17T05:18:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.276+0000 7fd198bec640 1 -- 172.21.15.81:0/3811071866 shutdown_connections 2024-09-17T05:18:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.276+0000 7fd198bec640 1 --2- 172.21.15.81:0/3811071866 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd1940735a0 0x7fd1940739d0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.276+0000 7fd198bec640 1 -- 172.21.15.81:0/3811071866 >> 172.21.15.81:0/3811071866 conn(0x7fd1940b1690 msgr2=0x7fd1940b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.277+0000 7fd198bec640 1 -- 172.21.15.81:0/3811071866 shutdown_connections 2024-09-17T05:18:52.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.277+0000 7fd198bec640 1 -- 172.21.15.81:0/3811071866 wait complete. 2024-09-17T05:18:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.278+0000 7fd198bec640 1 Processor -- start 2024-09-17T05:18:52.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.278+0000 7fd198bec640 1 -- start start 2024-09-17T05:18:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd198bec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19406ff80 0x7fd1941e7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd198bec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1940735a0 0x7fd194144460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd198bec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19415aa70 0x7fd194150890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd198bec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd194070780 con 0x7fd19415aa70 2024-09-17T05:18:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd198bec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd194070600 con 0x7fd1940735a0 2024-09-17T05:18:52.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd198bec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd194070900 con 0x7fd19406ff80 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19415aa70 0x7fd194150890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19415aa70 0x7fd194150890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43844/0 (socket says 172.21.15.81:43844) 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 -- 172.21.15.81:0/1896822203 learned_addr learned my addr 172.21.15.81:0/1896822203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd189d9b640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1940735a0 0x7fd194144460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd19259c640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19406ff80 0x7fd1941e7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 -- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19406ff80 msgr2=0x7fd1941e7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19406ff80 0x7fd1941e7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 -- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1940735a0 msgr2=0x7fd194144460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1940735a0 0x7fd194144460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 -- 172.21.15.81:0/1896822203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1941e7c50 con 0x7fd19415aa70 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd189d9b640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1940735a0 0x7fd194144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:52.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd192d9d640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19415aa70 0x7fd194150890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c7a0 tx=0x7fd18c00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd18b7fe640 1 -- 172.21.15.81:0/1896822203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c003da0 con 0x7fd19415aa70 2024-09-17T05:18:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.279+0000 7fd18b7fe640 1 -- 172.21.15.81:0/1896822203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd18c00ce50 con 0x7fd19415aa70 2024-09-17T05:18:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.280+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1941e7f30 con 0x7fd19415aa70 2024-09-17T05:18:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.280+0000 7fd18b7fe640 1 -- 172.21.15.81:0/1896822203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd18c0052d0 con 0x7fd19415aa70 2024-09-17T05:18:52.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.280+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1941e84f0 con 0x7fd19415aa70 2024-09-17T05:18:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.281+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1940cd920 con 0x7fd19415aa70 2024-09-17T05:18:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.281+0000 7fd18b7fe640 1 -- 172.21.15.81:0/1896822203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd18c005470 con 0x7fd19415aa70 2024-09-17T05:18:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.281+0000 7fd18b7fe640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd174078b90 0x7fd17407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.282+0000 7fd18b7fe640 1 -- 172.21.15.81:0/1896822203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd18c09ab10 con 0x7fd19415aa70 2024-09-17T05:18:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.282+0000 7fd19259c640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd174078b90 0x7fd17407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:52.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.282+0000 7fd19259c640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd174078b90 0x7fd17407b050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd184000f60 tx=0x7fd184009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:52.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.286+0000 7fd18b7fe640 1 -- 172.21.15.81:0/1896822203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd18c062fe0 con 0x7fd19415aa70 2024-09-17T05:18:52.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.459+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd194156c80 con 0x7fd174078b90 2024-09-17T05:18:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.464+0000 7fd18b7fe640 1 -- 172.21.15.81:0/1896822203 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247479 (secure 0 0 0) 0x7fd194156c80 con 0x7fd174078b90 2024-09-17T05:18:52.467 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:18:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd174078b90 msgr2=0x7fd17407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd174078b90 0x7fd17407b050 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fd184000f60 tx=0x7fd184009040 comp rx=0 tx=0).stop 2024-09-17T05:18:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19415aa70 msgr2=0x7fd194150890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19415aa70 0x7fd194150890 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fd18c00c7a0 tx=0x7fd18c00cc60 comp rx=0 tx=0).stop 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 shutdown_connections 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd174078b90 0x7fd17407b050 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd19415aa70 0x7fd194150890 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd1940735a0 0x7fd194144460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 --2- 172.21.15.81:0/1896822203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd19406ff80 0x7fd1941e7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 >> 172.21.15.81:0/1896822203 conn(0x7fd1940b1690 msgr2=0x7fd194156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 shutdown_connections 2024-09-17T05:18:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:52.467+0000 7fd198bec640 1 -- 172.21.15.81:0/1896822203 wait complete. 2024-09-17T05:18:52.478 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":25,"stamp":"2024-09-17T05:18:51.374653+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590984,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":108,"num_write_kb":1636,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":47,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":218956,"kb_used_data":2732,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755764,"statfs":{"total":773094113280,"available":772869902336,"internally_reserved":0,"allocated":2797568,"data_stored":1689504,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001106"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.132050+0000","last_change":"2024-09-17T05:18:46.132050+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.132050+0000","last_undegraded":"2024-09-17T05:18:46.132050+0000","last_fullsized":"2024-09-17T05:18:46.132050+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123413+0000","last_change":"2024-09-17T05:18:46.123413+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123413+0000","last_undegraded":"2024-09-17T05:18:46.123413+0000","last_fullsized":"2024-09-17T05:18:46.123413+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138898+0000","last_change":"2024-09-17T05:18:47.133451+0000","last_active":"2024-09-17T05:18:47.138898+0000","last_peered":"2024-09-17T05:18:47.138898+0000","last_clean":"2024-09-17T05:18:47.138898+0000","last_became_active":"2024-09-17T05:18:47.133212+0000","last_became_peered":"2024-09-17T05:18:47.133212+0000","last_unstale":"2024-09-17T05:18:47.138898+0000","last_undegraded":"2024-09-17T05:18:47.138898+0000","last_fullsized":"2024-09-17T05:18:47.138898+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:27.337400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127318+0000","last_change":"2024-09-17T05:18:46.127318+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127318+0000","last_undegraded":"2024-09-17T05:18:46.127318+0000","last_fullsized":"2024-09-17T05:18:46.127318+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128885+0000","last_change":"2024-09-17T05:18:46.128885+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128885+0000","last_undegraded":"2024-09-17T05:18:46.128885+0000","last_fullsized":"2024-09-17T05:18:46.128885+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126143+0000","last_change":"2024-09-17T05:18:46.126143+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126143+0000","last_undegraded":"2024-09-17T05:18:46.126143+0000","last_fullsized":"2024-09-17T05:18:46.126143+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128145+0000","last_change":"2024-09-17T05:18:46.128145+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128145+0000","last_undegraded":"2024-09-17T05:18:46.128145+0000","last_fullsized":"2024-09-17T05:18:46.128145+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120567+0000","last_change":"2024-09-17T05:18:46.120567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120567+0000","last_undegraded":"2024-09-17T05:18:46.120567+0000","last_fullsized":"2024-09-17T05:18:46.120567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131588+0000","last_change":"2024-09-17T05:18:46.131588+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131588+0000","last_undegraded":"2024-09-17T05:18:46.131588+0000","last_fullsized":"2024-09-17T05:18:46.131588+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124208+0000","last_change":"2024-09-17T05:18:46.124208+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124208+0000","last_undegraded":"2024-09-17T05:18:46.124208+0000","last_fullsized":"2024-09-17T05:18:46.124208+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121461+0000","last_change":"2024-09-17T05:18:46.121461+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121461+0000","last_undegraded":"2024-09-17T05:18:46.121461+0000","last_fullsized":"2024-09-17T05:18:46.121461+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.128071+0000","last_change":"2024-09-17T05:18:46.128071+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.128071+0000","last_undegraded":"2024-09-17T05:18:46.128071+0000","last_fullsized":"2024-09-17T05:18:46.128071+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120985+0000","last_change":"2024-09-17T05:18:46.120985+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120985+0000","last_undegraded":"2024-09-17T05:18:46.120985+0000","last_fullsized":"2024-09-17T05:18:46.120985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138952+0000","last_change":"2024-09-17T05:18:47.133079+0000","last_active":"2024-09-17T05:18:47.138952+0000","last_peered":"2024-09-17T05:18:47.138952+0000","last_clean":"2024-09-17T05:18:47.138952+0000","last_became_active":"2024-09-17T05:18:47.132823+0000","last_became_peered":"2024-09-17T05:18:47.132823+0000","last_unstale":"2024-09-17T05:18:47.138952+0000","last_undegraded":"2024-09-17T05:18:47.138952+0000","last_fullsized":"2024-09-17T05:18:47.138952+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:29.567684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123188+0000","last_change":"2024-09-17T05:18:46.123188+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123188+0000","last_undegraded":"2024-09-17T05:18:46.123188+0000","last_fullsized":"2024-09-17T05:18:46.123188+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124789+0000","last_change":"2024-09-17T05:18:46.124789+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124789+0000","last_undegraded":"2024-09-17T05:18:46.124789+0000","last_fullsized":"2024-09-17T05:18:46.124789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123455+0000","last_change":"2024-09-17T05:18:46.123455+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123455+0000","last_undegraded":"2024-09-17T05:18:46.123455+0000","last_fullsized":"2024-09-17T05:18:46.123455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117456+0000","last_change":"2024-09-17T05:18:46.117456+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117456+0000","last_undegraded":"2024-09-17T05:18:46.117456+0000","last_fullsized":"2024-09-17T05:18:46.117456+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126380+0000","last_change":"2024-09-17T05:18:46.126380+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126380+0000","last_undegraded":"2024-09-17T05:18:46.126380+0000","last_fullsized":"2024-09-17T05:18:46.126380+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124095+0000","last_change":"2024-09-17T05:18:46.124095+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124095+0000","last_undegraded":"2024-09-17T05:18:46.124095+0000","last_fullsized":"2024-09-17T05:18:46.124095+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.151709+0000","last_change":"2024-09-17T05:18:47.145653+0000","last_active":"2024-09-17T05:18:47.151709+0000","last_peered":"2024-09-17T05:18:47.151709+0000","last_clean":"2024-09-17T05:18:47.151709+0000","last_became_active":"2024-09-17T05:18:47.145377+0000","last_became_peered":"2024-09-17T05:18:47.145377+0000","last_unstale":"2024-09-17T05:18:47.151709+0000","last_undegraded":"2024-09-17T05:18:47.151709+0000","last_fullsized":"2024-09-17T05:18:47.151709+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:25.342804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125712+0000","last_change":"2024-09-17T05:18:46.125712+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125712+0000","last_undegraded":"2024-09-17T05:18:46.125712+0000","last_fullsized":"2024-09-17T05:18:46.125712+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121942+0000","last_change":"2024-09-17T05:18:46.121942+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121942+0000","last_undegraded":"2024-09-17T05:18:46.121942+0000","last_fullsized":"2024-09-17T05:18:46.121942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124325+0000","last_change":"2024-09-17T05:18:46.124325+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124325+0000","last_undegraded":"2024-09-17T05:18:46.124325+0000","last_fullsized":"2024-09-17T05:18:46.124325+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119567+0000","last_change":"2024-09-17T05:18:46.119567+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119567+0000","last_undegraded":"2024-09-17T05:18:46.119567+0000","last_fullsized":"2024-09-17T05:18:46.119567+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123698+0000","last_change":"2024-09-17T05:18:46.123698+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123698+0000","last_undegraded":"2024-09-17T05:18:46.123698+0000","last_fullsized":"2024-09-17T05:18:46.123698+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124910+0000","last_change":"2024-09-17T05:18:46.124910+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124910+0000","last_undegraded":"2024-09-17T05:18:46.124910+0000","last_fullsized":"2024-09-17T05:18:46.124910+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118569+0000","last_change":"2024-09-17T05:18:46.118569+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118569+0000","last_undegraded":"2024-09-17T05:18:46.118569+0000","last_fullsized":"2024-09-17T05:18:46.118569+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141444+0000","last_change":"2024-09-17T05:18:47.137341+0000","last_active":"2024-09-17T05:18:47.141444+0000","last_peered":"2024-09-17T05:18:47.141444+0000","last_clean":"2024-09-17T05:18:47.141444+0000","last_became_active":"2024-09-17T05:18:47.136527+0000","last_became_peered":"2024-09-17T05:18:47.136527+0000","last_unstale":"2024-09-17T05:18:47.141444+0000","last_undegraded":"2024-09-17T05:18:47.141444+0000","last_fullsized":"2024-09-17T05:18:47.141444+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:14.590352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125302+0000","last_change":"2024-09-17T05:18:46.125302+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125302+0000","last_undegraded":"2024-09-17T05:18:46.125302+0000","last_fullsized":"2024-09-17T05:18:46.125302+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.117483+0000","last_change":"2024-09-17T05:18:46.117483+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.117483+0000","last_undegraded":"2024-09-17T05:18:46.117483+0000","last_fullsized":"2024-09-17T05:18:46.117483+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.122358+0000","last_change":"2024-09-17T05:18:46.122358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.122358+0000","last_undegraded":"2024-09-17T05:18:46.122358+0000","last_fullsized":"2024-09-17T05:18:46.122358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126772+0000","last_change":"2024-09-17T05:18:46.126772+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126772+0000","last_undegraded":"2024-09-17T05:18:46.126772+0000","last_fullsized":"2024-09-17T05:18:46.126772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137203+0000","last_change":"2024-09-17T05:18:46.133224+0000","last_active":"2024-09-17T05:18:46.137203+0000","last_peered":"2024-09-17T05:18:46.137203+0000","last_clean":"2024-09-17T05:18:46.137203+0000","last_became_active":"2024-09-17T05:18:46.132897+0000","last_became_peered":"2024-09-17T05:18:46.132897+0000","last_unstale":"2024-09-17T05:18:46.137203+0000","last_undegraded":"2024-09-17T05:18:46.137203+0000","last_fullsized":"2024-09-17T05:18:46.137203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141244+0000","last_change":"2024-09-17T05:18:47.135685+0000","last_active":"2024-09-17T05:18:47.141244+0000","last_peered":"2024-09-17T05:18:47.141244+0000","last_clean":"2024-09-17T05:18:47.141244+0000","last_became_active":"2024-09-17T05:18:47.134928+0000","last_became_peered":"2024-09-17T05:18:47.134928+0000","last_unstale":"2024-09-17T05:18:47.141244+0000","last_undegraded":"2024-09-17T05:18:47.141244+0000","last_fullsized":"2024-09-17T05:18:47.141244+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:34.673271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137791+0000","last_change":"2024-09-17T05:18:46.131904+0000","last_active":"2024-09-17T05:18:46.137791+0000","last_peered":"2024-09-17T05:18:46.137791+0000","last_clean":"2024-09-17T05:18:46.137791+0000","last_became_active":"2024-09-17T05:18:46.131515+0000","last_became_peered":"2024-09-17T05:18:46.131515+0000","last_unstale":"2024-09-17T05:18:46.137791+0000","last_undegraded":"2024-09-17T05:18:46.137791+0000","last_fullsized":"2024-09-17T05:18:46.137791+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:42.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134477+0000","last_change":"2024-09-17T05:18:46.130687+0000","last_active":"2024-09-17T05:18:46.134477+0000","last_peered":"2024-09-17T05:18:46.134477+0000","last_clean":"2024-09-17T05:18:46.134477+0000","last_became_active":"2024-09-17T05:18:46.130402+0000","last_became_peered":"2024-09-17T05:18:46.130402+0000","last_unstale":"2024-09-17T05:18:46.134477+0000","last_undegraded":"2024-09-17T05:18:46.134477+0000","last_fullsized":"2024-09-17T05:18:46.134477+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120119+0000","last_change":"2024-09-17T05:18:46.120119+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120119+0000","last_undegraded":"2024-09-17T05:18:46.120119+0000","last_fullsized":"2024-09-17T05:18:46.120119+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137804+0000","last_change":"2024-09-17T05:18:46.135197+0000","last_active":"2024-09-17T05:18:46.137804+0000","last_peered":"2024-09-17T05:18:46.137804+0000","last_clean":"2024-09-17T05:18:46.137804+0000","last_became_active":"2024-09-17T05:18:46.134931+0000","last_became_peered":"2024-09-17T05:18:46.134931+0000","last_unstale":"2024-09-17T05:18:46.137804+0000","last_undegraded":"2024-09-17T05:18:46.137804+0000","last_fullsized":"2024-09-17T05:18:46.137804+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124148+0000","last_change":"2024-09-17T05:18:46.124148+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124148+0000","last_undegraded":"2024-09-17T05:18:46.124148+0000","last_fullsized":"2024-09-17T05:18:46.124148+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.143659+0000","last_change":"2024-09-17T05:18:46.137454+0000","last_active":"2024-09-17T05:18:46.143659+0000","last_peered":"2024-09-17T05:18:46.143659+0000","last_clean":"2024-09-17T05:18:46.143659+0000","last_became_active":"2024-09-17T05:18:46.136894+0000","last_became_peered":"2024-09-17T05:18:46.136894+0000","last_unstale":"2024-09-17T05:18:46.143659+0000","last_undegraded":"2024-09-17T05:18:46.143659+0000","last_fullsized":"2024-09-17T05:18:46.143659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124949+0000","last_change":"2024-09-17T05:18:46.124949+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124949+0000","last_undegraded":"2024-09-17T05:18:46.124949+0000","last_fullsized":"2024-09-17T05:18:46.124949+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.138344+0000","last_change":"2024-09-17T05:18:46.136107+0000","last_active":"2024-09-17T05:18:46.138344+0000","last_peered":"2024-09-17T05:18:46.138344+0000","last_clean":"2024-09-17T05:18:46.138344+0000","last_became_active":"2024-09-17T05:18:46.135733+0000","last_became_peered":"2024-09-17T05:18:46.135733+0000","last_unstale":"2024-09-17T05:18:46.138344+0000","last_undegraded":"2024-09-17T05:18:46.138344+0000","last_fullsized":"2024-09-17T05:18:46.138344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145713+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145713+0000","last_peered":"2024-09-17T05:18:47.145713+0000","last_clean":"2024-09-17T05:18:47.145713+0000","last_became_active":"2024-09-17T05:18:47.139941+0000","last_became_peered":"2024-09-17T05:18:47.139941+0000","last_unstale":"2024-09-17T05:18:47.145713+0000","last_undegraded":"2024-09-17T05:18:47.145713+0000","last_fullsized":"2024-09-17T05:18:47.145713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:36.992037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137320+0000","last_change":"2024-09-17T05:18:46.133330+0000","last_active":"2024-09-17T05:18:46.137320+0000","last_peered":"2024-09-17T05:18:46.137320+0000","last_clean":"2024-09-17T05:18:46.137320+0000","last_became_active":"2024-09-17T05:18:46.133026+0000","last_became_peered":"2024-09-17T05:18:46.133026+0000","last_unstale":"2024-09-17T05:18:46.137320+0000","last_undegraded":"2024-09-17T05:18:46.137320+0000","last_fullsized":"2024-09-17T05:18:46.137320+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:35.636180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127560+0000","last_change":"2024-09-17T05:18:46.127560+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127560+0000","last_undegraded":"2024-09-17T05:18:46.127560+0000","last_fullsized":"2024-09-17T05:18:46.127560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137555+0000","last_change":"2024-09-17T05:18:46.133755+0000","last_active":"2024-09-17T05:18:46.137555+0000","last_peered":"2024-09-17T05:18:46.137555+0000","last_clean":"2024-09-17T05:18:46.137555+0000","last_became_active":"2024-09-17T05:18:46.133067+0000","last_became_peered":"2024-09-17T05:18:46.133067+0000","last_unstale":"2024-09-17T05:18:46.137555+0000","last_undegraded":"2024-09-17T05:18:46.137555+0000","last_fullsized":"2024-09-17T05:18:46.137555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.130713+0000","last_change":"2024-09-17T05:18:46.130713+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.130713+0000","last_undegraded":"2024-09-17T05:18:46.130713+0000","last_fullsized":"2024-09-17T05:18:46.130713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":15,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.144188+0000","last_change":"2024-09-17T05:18:46.129204+0000","last_active":"2024-09-17T05:18:47.144188+0000","last_peered":"2024-09-17T05:18:47.144188+0000","last_clean":"2024-09-17T05:18:47.144188+0000","last_became_active":"2024-09-17T05:18:46.128901+0000","last_became_peered":"2024-09-17T05:18:46.128901+0000","last_unstale":"2024-09-17T05:18:47.144188+0000","last_undegraded":"2024-09-17T05:18:47.144188+0000","last_fullsized":"2024-09-17T05:18:47.144188+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:39.714747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.140902+0000","last_change":"2024-09-17T05:18:47.136191+0000","last_active":"2024-09-17T05:18:47.140902+0000","last_peered":"2024-09-17T05:18:47.140902+0000","last_clean":"2024-09-17T05:18:47.140902+0000","last_became_active":"2024-09-17T05:18:47.135912+0000","last_became_peered":"2024-09-17T05:18:47.135912+0000","last_unstale":"2024-09-17T05:18:47.140902+0000","last_undegraded":"2024-09-17T05:18:47.140902+0000","last_fullsized":"2024-09-17T05:18:47.140902+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:16.628165+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.133185+0000","last_change":"2024-09-17T05:18:46.132187+0000","last_active":"2024-09-17T05:18:46.133185+0000","last_peered":"2024-09-17T05:18:46.133185+0000","last_clean":"2024-09-17T05:18:46.133185+0000","last_became_active":"2024-09-17T05:18:46.131916+0000","last_became_peered":"2024-09-17T05:18:46.131916+0000","last_unstale":"2024-09-17T05:18:46.133185+0000","last_undegraded":"2024-09-17T05:18:46.133185+0000","last_fullsized":"2024-09-17T05:18:46.133185+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127217+0000","last_change":"2024-09-17T05:18:46.127217+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127217+0000","last_undegraded":"2024-09-17T05:18:46.127217+0000","last_fullsized":"2024-09-17T05:18:46.127217+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137595+0000","last_change":"2024-09-17T05:18:46.131494+0000","last_active":"2024-09-17T05:18:46.137595+0000","last_peered":"2024-09-17T05:18:46.137595+0000","last_clean":"2024-09-17T05:18:46.137595+0000","last_became_active":"2024-09-17T05:18:46.131210+0000","last_became_peered":"2024-09-17T05:18:46.131210+0000","last_unstale":"2024-09-17T05:18:46.137595+0000","last_undegraded":"2024-09-17T05:18:46.137595+0000","last_fullsized":"2024-09-17T05:18:46.137595+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:22.572452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121122+0000","last_change":"2024-09-17T05:18:46.121122+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121122+0000","last_undegraded":"2024-09-17T05:18:46.121122+0000","last_fullsized":"2024-09-17T05:18:46.121122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131785+0000","last_change":"2024-09-17T05:18:46.127329+0000","last_active":"2024-09-17T05:18:46.131785+0000","last_peered":"2024-09-17T05:18:46.131785+0000","last_clean":"2024-09-17T05:18:46.131785+0000","last_became_active":"2024-09-17T05:18:46.126863+0000","last_became_peered":"2024-09-17T05:18:46.126863+0000","last_unstale":"2024-09-17T05:18:46.131785+0000","last_undegraded":"2024-09-17T05:18:46.131785+0000","last_fullsized":"2024-09-17T05:18:46.131785+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.127044+0000","last_change":"2024-09-17T05:18:46.127044+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.127044+0000","last_undegraded":"2024-09-17T05:18:46.127044+0000","last_fullsized":"2024-09-17T05:18:46.127044+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132242+0000","last_change":"2024-09-17T05:18:46.130487+0000","last_active":"2024-09-17T05:18:46.132242+0000","last_peered":"2024-09-17T05:18:46.132242+0000","last_clean":"2024-09-17T05:18:46.132242+0000","last_became_active":"2024-09-17T05:18:46.130163+0000","last_became_peered":"2024-09-17T05:18:46.130163+0000","last_unstale":"2024-09-17T05:18:46.132242+0000","last_undegraded":"2024-09-17T05:18:46.132242+0000","last_fullsized":"2024-09-17T05:18:46.132242+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126358+0000","last_change":"2024-09-17T05:18:46.126358+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126358+0000","last_undegraded":"2024-09-17T05:18:46.126358+0000","last_fullsized":"2024-09-17T05:18:46.126358+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131836+0000","last_change":"2024-09-17T05:18:46.129081+0000","last_active":"2024-09-17T05:18:46.131836+0000","last_peered":"2024-09-17T05:18:46.131836+0000","last_clean":"2024-09-17T05:18:46.131836+0000","last_became_active":"2024-09-17T05:18:46.128776+0000","last_became_peered":"2024-09-17T05:18:46.128776+0000","last_unstale":"2024-09-17T05:18:46.131836+0000","last_undegraded":"2024-09-17T05:18:46.131836+0000","last_fullsized":"2024-09-17T05:18:46.131836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.131083+0000","last_change":"2024-09-17T05:18:46.131083+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.131083+0000","last_undegraded":"2024-09-17T05:18:46.131083+0000","last_fullsized":"2024-09-17T05:18:46.131083+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137297+0000","last_change":"2024-09-17T05:18:46.132599+0000","last_active":"2024-09-17T05:18:46.137297+0000","last_peered":"2024-09-17T05:18:46.137297+0000","last_clean":"2024-09-17T05:18:46.137297+0000","last_became_active":"2024-09-17T05:18:46.132293+0000","last_became_peered":"2024-09-17T05:18:46.132293+0000","last_unstale":"2024-09-17T05:18:46.137297+0000","last_undegraded":"2024-09-17T05:18:46.137297+0000","last_fullsized":"2024-09-17T05:18:46.137297+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123312+0000","last_change":"2024-09-17T05:18:46.123312+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123312+0000","last_undegraded":"2024-09-17T05:18:46.123312+0000","last_fullsized":"2024-09-17T05:18:46.123312+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131766+0000","last_change":"2024-09-17T05:18:46.127182+0000","last_active":"2024-09-17T05:18:46.131766+0000","last_peered":"2024-09-17T05:18:46.131766+0000","last_clean":"2024-09-17T05:18:46.131766+0000","last_became_active":"2024-09-17T05:18:46.126903+0000","last_became_peered":"2024-09-17T05:18:46.126903+0000","last_unstale":"2024-09-17T05:18:46.131766+0000","last_undegraded":"2024-09-17T05:18:46.131766+0000","last_fullsized":"2024-09-17T05:18:46.131766+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.129568+0000","last_change":"2024-09-17T05:18:46.129568+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.129568+0000","last_undegraded":"2024-09-17T05:18:46.129568+0000","last_fullsized":"2024-09-17T05:18:46.129568+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":107,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134116+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:18:46.134116+0000","last_peered":"2024-09-17T05:18:46.134116+0000","last_clean":"2024-09-17T05:18:46.134116+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:18:46.134116+0000","last_undegraded":"2024-09-17T05:18:46.134116+0000","last_fullsized":"2024-09-17T05:18:46.134116+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132517+0000","last_change":"2024-09-17T05:18:46.127446+0000","last_active":"2024-09-17T05:18:46.132517+0000","last_peered":"2024-09-17T05:18:46.132517+0000","last_clean":"2024-09-17T05:18:46.132517+0000","last_became_active":"2024-09-17T05:18:46.126901+0000","last_became_peered":"2024-09-17T05:18:46.126901+0000","last_unstale":"2024-09-17T05:18:46.132517+0000","last_undegraded":"2024-09-17T05:18:46.132517+0000","last_fullsized":"2024-09-17T05:18:46.132517+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.120082+0000","last_change":"2024-09-17T05:18:46.120082+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.120082+0000","last_undegraded":"2024-09-17T05:18:46.120082+0000","last_fullsized":"2024-09-17T05:18:46.120082+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146134+0000","last_change":"2024-09-17T05:18:46.141132+0000","last_active":"2024-09-17T05:18:46.146134+0000","last_peered":"2024-09-17T05:18:46.146134+0000","last_clean":"2024-09-17T05:18:46.146134+0000","last_became_active":"2024-09-17T05:18:46.140364+0000","last_became_peered":"2024-09-17T05:18:46.140364+0000","last_unstale":"2024-09-17T05:18:46.146134+0000","last_undegraded":"2024-09-17T05:18:46.146134+0000","last_fullsized":"2024-09-17T05:18:46.146134+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.141977+0000","last_change":"2024-09-17T05:18:47.139416+0000","last_active":"2024-09-17T05:18:47.141977+0000","last_peered":"2024-09-17T05:18:47.141977+0000","last_clean":"2024-09-17T05:18:47.141977+0000","last_became_active":"2024-09-17T05:18:47.139149+0000","last_became_peered":"2024-09-17T05:18:47.139149+0000","last_unstale":"2024-09-17T05:18:47.141977+0000","last_undegraded":"2024-09-17T05:18:47.141977+0000","last_fullsized":"2024-09-17T05:18:47.141977+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:37.744818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.131845+0000","last_change":"2024-09-17T05:18:46.129101+0000","last_active":"2024-09-17T05:18:46.131845+0000","last_peered":"2024-09-17T05:18:46.131845+0000","last_clean":"2024-09-17T05:18:46.131845+0000","last_became_active":"2024-09-17T05:18:46.128748+0000","last_became_peered":"2024-09-17T05:18:46.128748+0000","last_unstale":"2024-09-17T05:18:46.131845+0000","last_undegraded":"2024-09-17T05:18:46.131845+0000","last_fullsized":"2024-09-17T05:18:46.131845+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:57.467347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124150+0000","last_change":"2024-09-17T05:18:46.124150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124150+0000","last_undegraded":"2024-09-17T05:18:46.124150+0000","last_fullsized":"2024-09-17T05:18:46.124150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132383+0000","last_change":"2024-09-17T05:18:46.129856+0000","last_active":"2024-09-17T05:18:46.132383+0000","last_peered":"2024-09-17T05:18:46.132383+0000","last_clean":"2024-09-17T05:18:46.132383+0000","last_became_active":"2024-09-17T05:18:46.129409+0000","last_became_peered":"2024-09-17T05:18:46.129409+0000","last_unstale":"2024-09-17T05:18:46.132383+0000","last_undegraded":"2024-09-17T05:18:46.132383+0000","last_fullsized":"2024-09-17T05:18:46.132383+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.125923+0000","last_change":"2024-09-17T05:18:46.125923+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.125923+0000","last_undegraded":"2024-09-17T05:18:46.125923+0000","last_fullsized":"2024-09-17T05:18:46.125923+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134337+0000","last_change":"2024-09-17T05:18:46.128837+0000","last_active":"2024-09-17T05:18:46.134337+0000","last_peered":"2024-09-17T05:18:46.134337+0000","last_clean":"2024-09-17T05:18:46.134337+0000","last_became_active":"2024-09-17T05:18:46.128576+0000","last_became_peered":"2024-09-17T05:18:46.128576+0000","last_unstale":"2024-09-17T05:18:46.134337+0000","last_undegraded":"2024-09-17T05:18:46.134337+0000","last_fullsized":"2024-09-17T05:18:46.134337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123328+0000","last_change":"2024-09-17T05:18:46.123328+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123328+0000","last_undegraded":"2024-09-17T05:18:46.123328+0000","last_fullsized":"2024-09-17T05:18:46.123328+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.146182+0000","last_change":"2024-09-17T05:18:46.141667+0000","last_active":"2024-09-17T05:18:46.146182+0000","last_peered":"2024-09-17T05:18:46.146182+0000","last_clean":"2024-09-17T05:18:46.146182+0000","last_became_active":"2024-09-17T05:18:46.140316+0000","last_became_peered":"2024-09-17T05:18:46.140316+0000","last_unstale":"2024-09-17T05:18:46.146182+0000","last_undegraded":"2024-09-17T05:18:46.146182+0000","last_fullsized":"2024-09-17T05:18:46.146182+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.124158+0000","last_change":"2024-09-17T05:18:46.124158+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.124158+0000","last_undegraded":"2024-09-17T05:18:46.124158+0000","last_fullsized":"2024-09-17T05:18:46.124158+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.134353+0000","last_change":"2024-09-17T05:18:46.130971+0000","last_active":"2024-09-17T05:18:46.134353+0000","last_peered":"2024-09-17T05:18:46.134353+0000","last_clean":"2024-09-17T05:18:46.134353+0000","last_became_active":"2024-09-17T05:18:46.130678+0000","last_became_peered":"2024-09-17T05:18:46.130678+0000","last_unstale":"2024-09-17T05:18:46.134353+0000","last_undegraded":"2024-09-17T05:18:46.134353+0000","last_fullsized":"2024-09-17T05:18:46.134353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:10:26.420389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119056+0000","last_change":"2024-09-17T05:18:46.119056+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119056+0000","last_undegraded":"2024-09-17T05:18:46.119056+0000","last_fullsized":"2024-09-17T05:18:46.119056+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.140398+0000","last_change":"2024-09-17T05:18:46.137090+0000","last_active":"2024-09-17T05:18:46.140398+0000","last_peered":"2024-09-17T05:18:46.140398+0000","last_clean":"2024-09-17T05:18:46.140398+0000","last_became_active":"2024-09-17T05:18:46.136506+0000","last_became_peered":"2024-09-17T05:18:46.136506+0000","last_unstale":"2024-09-17T05:18:46.140398+0000","last_undegraded":"2024-09-17T05:18:46.140398+0000","last_fullsized":"2024-09-17T05:18:46.140398+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.138865+0000","last_change":"2024-09-17T05:18:47.132848+0000","last_active":"2024-09-17T05:18:47.138865+0000","last_peered":"2024-09-17T05:18:47.138865+0000","last_clean":"2024-09-17T05:18:47.138865+0000","last_became_active":"2024-09-17T05:18:47.132504+0000","last_became_peered":"2024-09-17T05:18:47.132504+0000","last_unstale":"2024-09-17T05:18:47.138865+0000","last_undegraded":"2024-09-17T05:18:47.138865+0000","last_fullsized":"2024-09-17T05:18:47.138865+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:08.296618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.141500+0000","last_change":"2024-09-17T05:18:46.137719+0000","last_active":"2024-09-17T05:18:46.141500+0000","last_peered":"2024-09-17T05:18:46.141500+0000","last_clean":"2024-09-17T05:18:46.141500+0000","last_became_active":"2024-09-17T05:18:46.137459+0000","last_became_peered":"2024-09-17T05:18:46.137459+0000","last_unstale":"2024-09-17T05:18:46.141500+0000","last_undegraded":"2024-09-17T05:18:46.141500+0000","last_fullsized":"2024-09-17T05:18:46.141500+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:45.584755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126210+0000","last_change":"2024-09-17T05:18:46.126210+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126210+0000","last_undegraded":"2024-09-17T05:18:46.126210+0000","last_fullsized":"2024-09-17T05:18:46.126210+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.139879+0000","last_change":"2024-09-17T05:18:46.136676+0000","last_active":"2024-09-17T05:18:46.139879+0000","last_peered":"2024-09-17T05:18:46.139879+0000","last_clean":"2024-09-17T05:18:46.139879+0000","last_became_active":"2024-09-17T05:18:46.136468+0000","last_became_peered":"2024-09-17T05:18:46.136468+0000","last_unstale":"2024-09-17T05:18:46.139879+0000","last_undegraded":"2024-09-17T05:18:46.139879+0000","last_fullsized":"2024-09-17T05:18:46.139879+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:44.260018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.118436+0000","last_change":"2024-09-17T05:18:46.118436+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.118436+0000","last_undegraded":"2024-09-17T05:18:46.118436+0000","last_fullsized":"2024-09-17T05:18:46.118436+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.137293+0000","last_change":"2024-09-17T05:18:46.132362+0000","last_active":"2024-09-17T05:18:46.137293+0000","last_peered":"2024-09-17T05:18:46.137293+0000","last_clean":"2024-09-17T05:18:46.137293+0000","last_became_active":"2024-09-17T05:18:46.132074+0000","last_became_peered":"2024-09-17T05:18:46.132074+0000","last_unstale":"2024-09-17T05:18:46.137293+0000","last_undegraded":"2024-09-17T05:18:46.137293+0000","last_fullsized":"2024-09-17T05:18:46.137293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:33:38.599965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.119206+0000","last_change":"2024-09-17T05:18:46.119206+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.119206+0000","last_undegraded":"2024-09-17T05:18:46.119206+0000","last_fullsized":"2024-09-17T05:18:46.119206+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145741+0000","last_change":"2024-09-17T05:18:46.140762+0000","last_active":"2024-09-17T05:18:46.145741+0000","last_peered":"2024-09-17T05:18:46.145741+0000","last_clean":"2024-09-17T05:18:46.145741+0000","last_became_active":"2024-09-17T05:18:46.140483+0000","last_became_peered":"2024-09-17T05:18:46.140483+0000","last_unstale":"2024-09-17T05:18:46.145741+0000","last_undegraded":"2024-09-17T05:18:46.145741+0000","last_fullsized":"2024-09-17T05:18:46.145741+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123150+0000","last_change":"2024-09-17T05:18:46.123150+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123150+0000","last_undegraded":"2024-09-17T05:18:46.123150+0000","last_fullsized":"2024-09-17T05:18:46.123150+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.123834+0000","last_change":"2024-09-17T05:18:46.123834+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.123834+0000","last_undegraded":"2024-09-17T05:18:46.123834+0000","last_fullsized":"2024-09-17T05:18:46.123834+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145734+0000","last_change":"2024-09-17T05:18:46.140678+0000","last_active":"2024-09-17T05:18:46.145734+0000","last_peered":"2024-09-17T05:18:46.145734+0000","last_clean":"2024-09-17T05:18:46.145734+0000","last_became_active":"2024-09-17T05:18:46.140137+0000","last_became_peered":"2024-09-17T05:18:46.140137+0000","last_unstale":"2024-09-17T05:18:46.145734+0000","last_undegraded":"2024-09-17T05:18:46.145734+0000","last_fullsized":"2024-09-17T05:18:46.145734+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.126438+0000","last_change":"2024-09-17T05:18:46.126438+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.126438+0000","last_undegraded":"2024-09-17T05:18:46.126438+0000","last_fullsized":"2024-09-17T05:18:46.126438+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.145783+0000","last_change":"2024-09-17T05:18:46.141012+0000","last_active":"2024-09-17T05:18:46.145783+0000","last_peered":"2024-09-17T05:18:46.145783+0000","last_clean":"2024-09-17T05:18:46.145783+0000","last_became_active":"2024-09-17T05:18:46.140729+0000","last_became_peered":"2024-09-17T05:18:46.140729+0000","last_unstale":"2024-09-17T05:18:46.145783+0000","last_undegraded":"2024-09-17T05:18:46.145783+0000","last_fullsized":"2024-09-17T05:18:46.145783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.145688+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:47.145688+0000","last_peered":"2024-09-17T05:18:47.145688+0000","last_clean":"2024-09-17T05:18:47.145688+0000","last_became_active":"2024-09-17T05:18:47.140502+0000","last_became_peered":"2024-09-17T05:18:47.140502+0000","last_unstale":"2024-09-17T05:18:47.145688+0000","last_undegraded":"2024-09-17T05:18:47.145688+0000","last_fullsized":"2024-09-17T05:18:47.145688+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:06.475279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":10,"reported_epoch":21,"state":"active+clean","last_fresh":"2024-09-17T05:18:46.132014+0000","last_change":"2024-09-17T05:18:46.126436+0000","last_active":"2024-09-17T05:18:46.132014+0000","last_peered":"2024-09-17T05:18:46.132014+0000","last_clean":"2024-09-17T05:18:46.132014+0000","last_became_active":"2024-09-17T05:18:46.126106+0000","last_became_peered":"2024-09-17T05:18:46.126106+0000","last_unstale":"2024-09-17T05:18:46.132014+0000","last_undegraded":"2024-09-17T05:18:46.132014+0000","last_fullsized":"2024-09-17T05:18:46.132014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:38.313376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":1,"reported_epoch":21,"state":"creating+peering","last_fresh":"2024-09-17T05:18:46.121161+0000","last_change":"2024-09-17T05:18:46.121161+0000","last_active":"2024-09-17T05:18:46.108157+0000","last_peered":"2024-09-17T05:18:46.108157+0000","last_clean":"2024-09-17T05:18:46.108157+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:18:46.121161+0000","last_undegraded":"2024-09-17T05:18:46.121161+0000","last_fullsized":"2024-09-17T05:18:46.121161+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":17,"reported_epoch":22,"state":"active+clean","last_fresh":"2024-09-17T05:18:47.149033+0000","last_change":"2024-09-17T05:18:46.135269+0000","last_active":"2024-09-17T05:18:47.149033+0000","last_peered":"2024-09-17T05:18:47.149033+0000","last_clean":"2024-09-17T05:18:47.149033+0000","last_became_active":"2024-09-17T05:18:46.135042+0000","last_became_peered":"2024-09-17T05:18:46.135042+0000","last_unstale":"2024-09-17T05:18:47.149033+0000","last_undegraded":"2024-09-17T05:18:47.149033+0000","last_fullsized":"2024-09-17T05:18:47.149033+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:44.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":616,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27800,"kb_used_data":772,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344040,"statfs":{"total":96636764160,"available":96608296960,"internally_reserved":0,"allocated":790528,"data_stored":652253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509445,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509444,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509445,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509444,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27220,"kb_used_data":192,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344620,"statfs":{"total":96636764160,"available":96608890880,"internally_reserved":0,"allocated":196608,"data_stored":61885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":827392,"data_stored":665941,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:18:52.646 INFO:tasks.ceph.mds.d.smithi160.stderr:2024-09-17T05:18:52.645+0000 7f8fa0fd0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:18:55.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:18:55.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.596+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/620798937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a4004800 msgr2=0x7fb5a4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.596+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/620798937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a4004800 0x7fb5a4004c80 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009b20 tx=0x7fb5a4005830 comp rx=0 tx=0).stop 2024-09-17T05:18:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.596+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/620798937 shutdown_connections 2024-09-17T05:18:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.596+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/620798937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5a4004800 0x7fb5a4004c80 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.596+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/620798937 >> 172.21.15.81:0/620798937 conn(0x7fb5bc0b1690 msgr2=0x7fb5bc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.596+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/620798937 shutdown_connections 2024-09-17T05:18:55.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.596+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/620798937 wait complete. 2024-09-17T05:18:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 Processor -- start 2024-09-17T05:18:55.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 -- start start 2024-09-17T05:18:55.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5a4004800 0x7fb5bc142230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5bc1f48b0 0x7fb5bc1f4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5bc158e70 0x7fb5bc1592f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc073d60 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb5bc073be0 con 0x7fb5bc158e70 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.598+0000 7fb5c3a2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb5bc0703f0 con 0x7fb5a4004800 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5bc1f48b0 0x7fb5bc1f4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5bc1f48b0 0x7fb5bc1f4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38364/0 (socket says 172.21.15.81:38364) 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 -- 172.21.15.81:0/20983579 learned_addr learned my addr 172.21.15.81:0/20983579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c17c6640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5a4004800 0x7fb5bc142230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c1fc7640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5bc158e70 0x7fb5bc1592f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 -- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5a4004800 msgr2=0x7fb5bc142230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5a4004800 0x7fb5bc142230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 -- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5bc158e70 msgr2=0x7fb5bc1592f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5bc158e70 0x7fb5bc1592f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 -- 172.21.15.81:0/20983579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5bc142770 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c0fc5640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5bc1f48b0 0x7fb5bc1f4d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009c10 tx=0x7fb5b0033b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5b9ffb640 1 -- 172.21.15.81:0/20983579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0043030 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5b9ffb640 1 -- 172.21.15.81:0/20983579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb5b002dd70 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5bc1580b0 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5b9ffb640 1 -- 172.21.15.81:0/20983579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5b0038040 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.599+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5bc158670 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.600+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5bc0b4690 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.601+0000 7fb5b9ffb640 1 -- 172.21.15.81:0/20983579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb5b0046070 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.602+0000 7fb5b9ffb640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb5a8078bc0 0x7fb5a807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.602+0000 7fb5b9ffb640 1 -- 172.21.15.81:0/20983579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb5b00bdb10 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.602+0000 7fb5c17c6640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb5a8078bc0 0x7fb5a807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.602+0000 7fb5c17c6640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb5a8078bc0 0x7fb5a807b080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac001860 tx=0x7fb5ac001c90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:55.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.606+0000 7fb5b9ffb640 1 -- 172.21.15.81:0/20983579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb5b004d070 con 0x7fb5bc1f48b0 2024-09-17T05:18:55.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.780+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb5bc1542e0 con 0x7fb5a8078bc0 2024-09-17T05:18:55.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.785+0000 7fb5b9ffb640 1 -- 172.21.15.81:0/20983579 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251936 (secure 0 0 0) 0x7fb5bc1542e0 con 0x7fb5a8078bc0 2024-09-17T05:18:55.788 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:55.789 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb5a8078bc0 msgr2=0x7fb5a807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb5a8078bc0 0x7fb5a807b080 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb5ac001860 tx=0x7fb5ac001c90 comp rx=0 tx=0).stop 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5bc1f48b0 msgr2=0x7fb5bc1f4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5bc1f48b0 0x7fb5bc1f4d30 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fb5b0009c10 tx=0x7fb5b0033b10 comp rx=0 tx=0).stop 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 shutdown_connections 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb5a8078bc0 0x7fb5a807b080 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb5bc158e70 0x7fb5bc1592f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb5bc1f48b0 0x7fb5bc1f4d30 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 --2- 172.21.15.81:0/20983579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb5a4004800 0x7fb5bc142230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 >> 172.21.15.81:0/20983579 conn(0x7fb5bc0b1690 msgr2=0x7fb5bc15d840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:55.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 shutdown_connections 2024-09-17T05:18:55.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.788+0000 7fb5c3a2a640 1 -- 172.21.15.81:0/20983579 wait complete. 2024-09-17T05:18:55.799 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":27,"stamp":"2024-09-17T05:18:55.375515+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219296,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755424,"statfs":{"total":773094113280,"available":772869554176,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.260416"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902236+0000","last_change":"2024-09-17T05:18:47.135396+0000","last_active":"2024-09-17T05:18:48.902236+0000","last_peered":"2024-09-17T05:18:48.902236+0000","last_clean":"2024-09-17T05:18:48.902236+0000","last_became_active":"2024-09-17T05:18:47.135102+0000","last_became_peered":"2024-09-17T05:18:47.135102+0000","last_unstale":"2024-09-17T05:18:48.902236+0000","last_undegraded":"2024-09-17T05:18:48.902236+0000","last_fullsized":"2024-09-17T05:18:48.902236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:17.057030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134032+0000","last_change":"2024-09-17T05:18:47.134404+0000","last_active":"2024-09-17T05:18:48.134032+0000","last_peered":"2024-09-17T05:18:48.134032+0000","last_clean":"2024-09-17T05:18:48.134032+0000","last_became_active":"2024-09-17T05:18:47.133993+0000","last_became_peered":"2024-09-17T05:18:47.133993+0000","last_unstale":"2024-09-17T05:18:48.134032+0000","last_undegraded":"2024-09-17T05:18:48.134032+0000","last_fullsized":"2024-09-17T05:18:48.134032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601365+0000","last_change":"2024-09-17T05:18:47.133451+0000","last_active":"2024-09-17T05:18:49.601365+0000","last_peered":"2024-09-17T05:18:49.601365+0000","last_clean":"2024-09-17T05:18:49.601365+0000","last_became_active":"2024-09-17T05:18:47.133212+0000","last_became_peered":"2024-09-17T05:18:47.133212+0000","last_unstale":"2024-09-17T05:18:49.601365+0000","last_undegraded":"2024-09-17T05:18:49.601365+0000","last_fullsized":"2024-09-17T05:18:49.601365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:06.687774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231441+0000","last_change":"2024-09-17T05:18:47.140539+0000","last_active":"2024-09-17T05:18:50.231441+0000","last_peered":"2024-09-17T05:18:50.231441+0000","last_clean":"2024-09-17T05:18:50.231441+0000","last_became_active":"2024-09-17T05:18:47.139262+0000","last_became_peered":"2024-09-17T05:18:47.139262+0000","last_unstale":"2024-09-17T05:18:50.231441+0000","last_undegraded":"2024-09-17T05:18:50.231441+0000","last_fullsized":"2024-09-17T05:18:50.231441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:55.646018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901799+0000","last_change":"2024-09-17T05:18:47.145770+0000","last_active":"2024-09-17T05:18:48.901799+0000","last_peered":"2024-09-17T05:18:48.901799+0000","last_clean":"2024-09-17T05:18:48.901799+0000","last_became_active":"2024-09-17T05:18:47.145480+0000","last_became_peered":"2024-09-17T05:18:47.145480+0000","last_unstale":"2024-09-17T05:18:48.901799+0000","last_undegraded":"2024-09-17T05:18:48.901799+0000","last_fullsized":"2024-09-17T05:18:48.901799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:55.524841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231267+0000","last_change":"2024-09-17T05:18:47.133339+0000","last_active":"2024-09-17T05:18:50.231267+0000","last_peered":"2024-09-17T05:18:50.231267+0000","last_clean":"2024-09-17T05:18:50.231267+0000","last_became_active":"2024-09-17T05:18:47.133085+0000","last_became_peered":"2024-09-17T05:18:47.133085+0000","last_unstale":"2024-09-17T05:18:50.231267+0000","last_undegraded":"2024-09-17T05:18:50.231267+0000","last_fullsized":"2024-09-17T05:18:50.231267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901734+0000","last_change":"2024-09-17T05:18:47.135045+0000","last_active":"2024-09-17T05:18:48.901734+0000","last_peered":"2024-09-17T05:18:48.901734+0000","last_clean":"2024-09-17T05:18:48.901734+0000","last_became_active":"2024-09-17T05:18:47.134770+0000","last_became_peered":"2024-09-17T05:18:47.134770+0000","last_unstale":"2024-09-17T05:18:48.901734+0000","last_undegraded":"2024-09-17T05:18:48.901734+0000","last_fullsized":"2024-09-17T05:18:48.901734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116753+0000","last_change":"2024-09-17T05:18:47.144464+0000","last_active":"2024-09-17T05:18:48.116753+0000","last_peered":"2024-09-17T05:18:48.116753+0000","last_clean":"2024-09-17T05:18:48.116753+0000","last_became_active":"2024-09-17T05:18:47.144111+0000","last_became_peered":"2024-09-17T05:18:47.144111+0000","last_unstale":"2024-09-17T05:18:48.116753+0000","last_undegraded":"2024-09-17T05:18:48.116753+0000","last_fullsized":"2024-09-17T05:18:48.116753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:08.620872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902314+0000","last_change":"2024-09-17T05:18:47.143214+0000","last_active":"2024-09-17T05:18:48.902314+0000","last_peered":"2024-09-17T05:18:48.902314+0000","last_clean":"2024-09-17T05:18:48.902314+0000","last_became_active":"2024-09-17T05:18:47.142377+0000","last_became_peered":"2024-09-17T05:18:47.142377+0000","last_unstale":"2024-09-17T05:18:48.902314+0000","last_undegraded":"2024-09-17T05:18:48.902314+0000","last_fullsized":"2024-09-17T05:18:48.902314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:04.186259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118741+0000","last_change":"2024-09-17T05:18:47.129022+0000","last_active":"2024-09-17T05:18:48.118741+0000","last_peered":"2024-09-17T05:18:48.118741+0000","last_clean":"2024-09-17T05:18:48.118741+0000","last_became_active":"2024-09-17T05:18:47.128776+0000","last_became_peered":"2024-09-17T05:18:47.128776+0000","last_unstale":"2024-09-17T05:18:48.118741+0000","last_undegraded":"2024-09-17T05:18:48.118741+0000","last_fullsized":"2024-09-17T05:18:48.118741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118513+0000","last_change":"2024-09-17T05:18:47.129696+0000","last_active":"2024-09-17T05:18:48.118513+0000","last_peered":"2024-09-17T05:18:48.118513+0000","last_clean":"2024-09-17T05:18:48.118513+0000","last_became_active":"2024-09-17T05:18:47.127357+0000","last_became_peered":"2024-09-17T05:18:47.127357+0000","last_unstale":"2024-09-17T05:18:48.118513+0000","last_undegraded":"2024-09-17T05:18:48.118513+0000","last_fullsized":"2024-09-17T05:18:48.118513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:07.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118724+0000","last_change":"2024-09-17T05:18:47.122017+0000","last_active":"2024-09-17T05:18:48.118724+0000","last_peered":"2024-09-17T05:18:48.118724+0000","last_clean":"2024-09-17T05:18:48.118724+0000","last_became_active":"2024-09-17T05:18:47.120911+0000","last_became_peered":"2024-09-17T05:18:47.120911+0000","last_unstale":"2024-09-17T05:18:48.118724+0000","last_undegraded":"2024-09-17T05:18:48.118724+0000","last_fullsized":"2024-09-17T05:18:48.118724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:33.294659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117057+0000","last_change":"2024-09-17T05:18:47.135716+0000","last_active":"2024-09-17T05:18:48.117057+0000","last_peered":"2024-09-17T05:18:48.117057+0000","last_clean":"2024-09-17T05:18:48.117057+0000","last_became_active":"2024-09-17T05:18:47.135334+0000","last_became_peered":"2024-09-17T05:18:47.135334+0000","last_unstale":"2024-09-17T05:18:48.117057+0000","last_undegraded":"2024-09-17T05:18:48.117057+0000","last_fullsized":"2024-09-17T05:18:48.117057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:25.755720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601241+0000","last_change":"2024-09-17T05:18:47.133079+0000","last_active":"2024-09-17T05:18:49.601241+0000","last_peered":"2024-09-17T05:18:49.601241+0000","last_clean":"2024-09-17T05:18:49.601241+0000","last_became_active":"2024-09-17T05:18:47.132823+0000","last_became_peered":"2024-09-17T05:18:47.132823+0000","last_unstale":"2024-09-17T05:18:49.601241+0000","last_undegraded":"2024-09-17T05:18:49.601241+0000","last_fullsized":"2024-09-17T05:18:49.601241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:33.666738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133781+0000","last_change":"2024-09-17T05:18:47.138267+0000","last_active":"2024-09-17T05:18:48.133781+0000","last_peered":"2024-09-17T05:18:48.133781+0000","last_clean":"2024-09-17T05:18:48.133781+0000","last_became_active":"2024-09-17T05:18:47.137928+0000","last_became_peered":"2024-09-17T05:18:47.137928+0000","last_unstale":"2024-09-17T05:18:48.133781+0000","last_undegraded":"2024-09-17T05:18:48.133781+0000","last_fullsized":"2024-09-17T05:18:48.133781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:08.620872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231212+0000","last_change":"2024-09-17T05:18:47.133341+0000","last_active":"2024-09-17T05:18:50.231212+0000","last_peered":"2024-09-17T05:18:50.231212+0000","last_clean":"2024-09-17T05:18:50.231212+0000","last_became_active":"2024-09-17T05:18:47.133113+0000","last_became_peered":"2024-09-17T05:18:47.133113+0000","last_unstale":"2024-09-17T05:18:50.231212+0000","last_undegraded":"2024-09-17T05:18:50.231212+0000","last_fullsized":"2024-09-17T05:18:50.231212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231972+0000","last_change":"2024-09-17T05:18:47.138568+0000","last_active":"2024-09-17T05:18:50.231972+0000","last_peered":"2024-09-17T05:18:50.231972+0000","last_clean":"2024-09-17T05:18:50.231972+0000","last_became_active":"2024-09-17T05:18:47.136370+0000","last_became_peered":"2024-09-17T05:18:47.136370+0000","last_unstale":"2024-09-17T05:18:50.231972+0000","last_undegraded":"2024-09-17T05:18:50.231972+0000","last_fullsized":"2024-09-17T05:18:50.231972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:42.624419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231441+0000","last_change":"2024-09-17T05:18:47.120795+0000","last_active":"2024-09-17T05:18:50.231441+0000","last_peered":"2024-09-17T05:18:50.231441+0000","last_clean":"2024-09-17T05:18:50.231441+0000","last_became_active":"2024-09-17T05:18:47.120609+0000","last_became_peered":"2024-09-17T05:18:47.120609+0000","last_unstale":"2024-09-17T05:18:50.231441+0000","last_undegraded":"2024-09-17T05:18:50.231441+0000","last_fullsized":"2024-09-17T05:18:50.231441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:39.011324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902402+0000","last_change":"2024-09-17T05:18:47.131900+0000","last_active":"2024-09-17T05:18:48.902402+0000","last_peered":"2024-09-17T05:18:48.902402+0000","last_clean":"2024-09-17T05:18:48.902402+0000","last_became_active":"2024-09-17T05:18:47.131593+0000","last_became_peered":"2024-09-17T05:18:47.131593+0000","last_unstale":"2024-09-17T05:18:48.902402+0000","last_undegraded":"2024-09-17T05:18:48.902402+0000","last_fullsized":"2024-09-17T05:18:48.902402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:44.867751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118535+0000","last_change":"2024-09-17T05:18:47.127274+0000","last_active":"2024-09-17T05:18:48.118535+0000","last_peered":"2024-09-17T05:18:48.118535+0000","last_clean":"2024-09-17T05:18:48.118535+0000","last_became_active":"2024-09-17T05:18:47.126150+0000","last_became_peered":"2024-09-17T05:18:47.126150+0000","last_unstale":"2024-09-17T05:18:48.118535+0000","last_undegraded":"2024-09-17T05:18:48.118535+0000","last_fullsized":"2024-09-17T05:18:48.118535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:30.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601563+0000","last_change":"2024-09-17T05:18:47.145653+0000","last_active":"2024-09-17T05:18:49.601563+0000","last_peered":"2024-09-17T05:18:49.601563+0000","last_clean":"2024-09-17T05:18:49.601563+0000","last_became_active":"2024-09-17T05:18:47.145377+0000","last_became_peered":"2024-09-17T05:18:47.145377+0000","last_unstale":"2024-09-17T05:18:49.601563+0000","last_undegraded":"2024-09-17T05:18:49.601563+0000","last_fullsized":"2024-09-17T05:18:49.601563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:45.318856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231443+0000","last_change":"2024-09-17T05:18:47.136643+0000","last_active":"2024-09-17T05:18:50.231443+0000","last_peered":"2024-09-17T05:18:50.231443+0000","last_clean":"2024-09-17T05:18:50.231443+0000","last_became_active":"2024-09-17T05:18:47.136396+0000","last_became_peered":"2024-09-17T05:18:47.136396+0000","last_unstale":"2024-09-17T05:18:50.231443+0000","last_undegraded":"2024-09-17T05:18:50.231443+0000","last_fullsized":"2024-09-17T05:18:50.231443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:32.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116775+0000","last_change":"2024-09-17T05:18:47.139232+0000","last_active":"2024-09-17T05:18:48.116775+0000","last_peered":"2024-09-17T05:18:48.116775+0000","last_clean":"2024-09-17T05:18:48.116775+0000","last_became_active":"2024-09-17T05:18:47.138536+0000","last_became_peered":"2024-09-17T05:18:47.138536+0000","last_unstale":"2024-09-17T05:18:48.116775+0000","last_undegraded":"2024-09-17T05:18:48.116775+0000","last_fullsized":"2024-09-17T05:18:48.116775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:04.746430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231310+0000","last_change":"2024-09-17T05:18:47.141968+0000","last_active":"2024-09-17T05:18:50.231310+0000","last_peered":"2024-09-17T05:18:50.231310+0000","last_clean":"2024-09-17T05:18:50.231310+0000","last_became_active":"2024-09-17T05:18:47.140975+0000","last_became_peered":"2024-09-17T05:18:47.140975+0000","last_unstale":"2024-09-17T05:18:50.231310+0000","last_undegraded":"2024-09-17T05:18:50.231310+0000","last_fullsized":"2024-09-17T05:18:50.231310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:26.840419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117384+0000","last_change":"2024-09-17T05:18:47.139264+0000","last_active":"2024-09-17T05:18:48.117384+0000","last_peered":"2024-09-17T05:18:48.117384+0000","last_clean":"2024-09-17T05:18:48.117384+0000","last_became_active":"2024-09-17T05:18:47.138194+0000","last_became_peered":"2024-09-17T05:18:47.138194+0000","last_unstale":"2024-09-17T05:18:48.117384+0000","last_undegraded":"2024-09-17T05:18:48.117384+0000","last_fullsized":"2024-09-17T05:18:48.117384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:25.146819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118769+0000","last_change":"2024-09-17T05:18:47.136270+0000","last_active":"2024-09-17T05:18:48.118769+0000","last_peered":"2024-09-17T05:18:48.118769+0000","last_clean":"2024-09-17T05:18:48.118769+0000","last_became_active":"2024-09-17T05:18:47.136004+0000","last_became_peered":"2024-09-17T05:18:47.136004+0000","last_unstale":"2024-09-17T05:18:48.118769+0000","last_undegraded":"2024-09-17T05:18:48.118769+0000","last_fullsized":"2024-09-17T05:18:48.118769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133953+0000","last_change":"2024-09-17T05:18:47.136733+0000","last_active":"2024-09-17T05:18:48.133953+0000","last_peered":"2024-09-17T05:18:48.133953+0000","last_clean":"2024-09-17T05:18:48.133953+0000","last_became_active":"2024-09-17T05:18:47.136447+0000","last_became_peered":"2024-09-17T05:18:47.136447+0000","last_unstale":"2024-09-17T05:18:48.133953+0000","last_undegraded":"2024-09-17T05:18:48.133953+0000","last_fullsized":"2024-09-17T05:18:48.133953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117191+0000","last_change":"2024-09-17T05:18:47.140039+0000","last_active":"2024-09-17T05:18:48.117191+0000","last_peered":"2024-09-17T05:18:48.117191+0000","last_clean":"2024-09-17T05:18:48.117191+0000","last_became_active":"2024-09-17T05:18:47.139761+0000","last_became_peered":"2024-09-17T05:18:47.139761+0000","last_unstale":"2024-09-17T05:18:48.117191+0000","last_undegraded":"2024-09-17T05:18:48.117191+0000","last_fullsized":"2024-09-17T05:18:48.117191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:01.434619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601560+0000","last_change":"2024-09-17T05:18:47.137341+0000","last_active":"2024-09-17T05:18:49.601560+0000","last_peered":"2024-09-17T05:18:49.601560+0000","last_clean":"2024-09-17T05:18:49.601560+0000","last_became_active":"2024-09-17T05:18:47.136527+0000","last_became_peered":"2024-09-17T05:18:47.136527+0000","last_unstale":"2024-09-17T05:18:49.601560+0000","last_undegraded":"2024-09-17T05:18:49.601560+0000","last_fullsized":"2024-09-17T05:18:49.601560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:03.207999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231542+0000","last_change":"2024-09-17T05:18:47.132046+0000","last_active":"2024-09-17T05:18:50.231542+0000","last_peered":"2024-09-17T05:18:50.231542+0000","last_clean":"2024-09-17T05:18:50.231542+0000","last_became_active":"2024-09-17T05:18:47.131385+0000","last_became_peered":"2024-09-17T05:18:47.131385+0000","last_unstale":"2024-09-17T05:18:50.231542+0000","last_undegraded":"2024-09-17T05:18:50.231542+0000","last_fullsized":"2024-09-17T05:18:50.231542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:41.148848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231335+0000","last_change":"2024-09-17T05:18:47.136879+0000","last_active":"2024-09-17T05:18:50.231335+0000","last_peered":"2024-09-17T05:18:50.231335+0000","last_clean":"2024-09-17T05:18:50.231335+0000","last_became_active":"2024-09-17T05:18:47.136546+0000","last_became_peered":"2024-09-17T05:18:47.136546+0000","last_unstale":"2024-09-17T05:18:50.231335+0000","last_undegraded":"2024-09-17T05:18:50.231335+0000","last_fullsized":"2024-09-17T05:18:50.231335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:33.294659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117882+0000","last_change":"2024-09-17T05:18:47.133776+0000","last_active":"2024-09-17T05:18:48.117882+0000","last_peered":"2024-09-17T05:18:48.117882+0000","last_clean":"2024-09-17T05:18:48.117882+0000","last_became_active":"2024-09-17T05:18:47.133252+0000","last_became_peered":"2024-09-17T05:18:47.133252+0000","last_unstale":"2024-09-17T05:18:48.117882+0000","last_undegraded":"2024-09-17T05:18:48.117882+0000","last_fullsized":"2024-09-17T05:18:48.117882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:21.942728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118120+0000","last_change":"2024-09-17T05:18:47.130903+0000","last_active":"2024-09-17T05:18:48.118120+0000","last_peered":"2024-09-17T05:18:48.118120+0000","last_clean":"2024-09-17T05:18:48.118120+0000","last_became_active":"2024-09-17T05:18:47.130394+0000","last_became_peered":"2024-09-17T05:18:47.130394+0000","last_unstale":"2024-09-17T05:18:48.118120+0000","last_undegraded":"2024-09-17T05:18:48.118120+0000","last_fullsized":"2024-09-17T05:18:48.118120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:28.751511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117205+0000","last_change":"2024-09-17T05:18:46.133224+0000","last_active":"2024-09-17T05:18:48.117205+0000","last_peered":"2024-09-17T05:18:48.117205+0000","last_clean":"2024-09-17T05:18:48.117205+0000","last_became_active":"2024-09-17T05:18:46.132897+0000","last_became_peered":"2024-09-17T05:18:46.132897+0000","last_unstale":"2024-09-17T05:18:48.117205+0000","last_undegraded":"2024-09-17T05:18:48.117205+0000","last_fullsized":"2024-09-17T05:18:48.117205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601713+0000","last_change":"2024-09-17T05:18:47.135685+0000","last_active":"2024-09-17T05:18:49.601713+0000","last_peered":"2024-09-17T05:18:49.601713+0000","last_clean":"2024-09-17T05:18:49.601713+0000","last_became_active":"2024-09-17T05:18:47.134928+0000","last_became_peered":"2024-09-17T05:18:47.134928+0000","last_unstale":"2024-09-17T05:18:49.601713+0000","last_undegraded":"2024-09-17T05:18:49.601713+0000","last_fullsized":"2024-09-17T05:18:49.601713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:15.838865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118259+0000","last_change":"2024-09-17T05:18:46.131904+0000","last_active":"2024-09-17T05:18:48.118259+0000","last_peered":"2024-09-17T05:18:48.118259+0000","last_clean":"2024-09-17T05:18:48.118259+0000","last_became_active":"2024-09-17T05:18:46.131515+0000","last_became_peered":"2024-09-17T05:18:46.131515+0000","last_unstale":"2024-09-17T05:18:48.118259+0000","last_undegraded":"2024-09-17T05:18:48.118259+0000","last_fullsized":"2024-09-17T05:18:48.118259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116839+0000","last_change":"2024-09-17T05:18:46.130687+0000","last_active":"2024-09-17T05:18:48.116839+0000","last_peered":"2024-09-17T05:18:48.116839+0000","last_clean":"2024-09-17T05:18:48.116839+0000","last_became_active":"2024-09-17T05:18:46.130402+0000","last_became_peered":"2024-09-17T05:18:46.130402+0000","last_unstale":"2024-09-17T05:18:48.116839+0000","last_undegraded":"2024-09-17T05:18:48.116839+0000","last_fullsized":"2024-09-17T05:18:48.116839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116831+0000","last_change":"2024-09-17T05:18:47.133243+0000","last_active":"2024-09-17T05:18:48.116831+0000","last_peered":"2024-09-17T05:18:48.116831+0000","last_clean":"2024-09-17T05:18:48.116831+0000","last_became_active":"2024-09-17T05:18:47.132942+0000","last_became_peered":"2024-09-17T05:18:47.132942+0000","last_unstale":"2024-09-17T05:18:48.116831+0000","last_undegraded":"2024-09-17T05:18:48.116831+0000","last_fullsized":"2024-09-17T05:18:48.116831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:26.505376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231432+0000","last_change":"2024-09-17T05:18:46.135197+0000","last_active":"2024-09-17T05:18:50.231432+0000","last_peered":"2024-09-17T05:18:50.231432+0000","last_clean":"2024-09-17T05:18:50.231432+0000","last_became_active":"2024-09-17T05:18:46.134931+0000","last_became_peered":"2024-09-17T05:18:46.134931+0000","last_unstale":"2024-09-17T05:18:50.231432+0000","last_undegraded":"2024-09-17T05:18:50.231432+0000","last_fullsized":"2024-09-17T05:18:50.231432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133775+0000","last_change":"2024-09-17T05:18:47.130413+0000","last_active":"2024-09-17T05:18:48.133775+0000","last_peered":"2024-09-17T05:18:48.133775+0000","last_clean":"2024-09-17T05:18:48.133775+0000","last_became_active":"2024-09-17T05:18:47.130080+0000","last_became_peered":"2024-09-17T05:18:47.130080+0000","last_unstale":"2024-09-17T05:18:48.133775+0000","last_undegraded":"2024-09-17T05:18:48.133775+0000","last_fullsized":"2024-09-17T05:18:48.133775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:43.112366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118861+0000","last_change":"2024-09-17T05:18:46.137454+0000","last_active":"2024-09-17T05:18:48.118861+0000","last_peered":"2024-09-17T05:18:48.118861+0000","last_clean":"2024-09-17T05:18:48.118861+0000","last_became_active":"2024-09-17T05:18:46.136894+0000","last_became_peered":"2024-09-17T05:18:46.136894+0000","last_unstale":"2024-09-17T05:18:48.118861+0000","last_undegraded":"2024-09-17T05:18:48.118861+0000","last_fullsized":"2024-09-17T05:18:48.118861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231721+0000","last_change":"2024-09-17T05:18:47.140250+0000","last_active":"2024-09-17T05:18:50.231721+0000","last_peered":"2024-09-17T05:18:50.231721+0000","last_clean":"2024-09-17T05:18:50.231721+0000","last_became_active":"2024-09-17T05:18:47.136798+0000","last_became_peered":"2024-09-17T05:18:47.136798+0000","last_unstale":"2024-09-17T05:18:50.231721+0000","last_undegraded":"2024-09-17T05:18:50.231721+0000","last_fullsized":"2024-09-17T05:18:50.231721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:56.761963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231795+0000","last_change":"2024-09-17T05:18:46.136107+0000","last_active":"2024-09-17T05:18:50.231795+0000","last_peered":"2024-09-17T05:18:50.231795+0000","last_clean":"2024-09-17T05:18:50.231795+0000","last_became_active":"2024-09-17T05:18:46.135733+0000","last_became_peered":"2024-09-17T05:18:46.135733+0000","last_unstale":"2024-09-17T05:18:50.231795+0000","last_undegraded":"2024-09-17T05:18:50.231795+0000","last_fullsized":"2024-09-17T05:18:50.231795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601463+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:49.601463+0000","last_peered":"2024-09-17T05:18:49.601463+0000","last_clean":"2024-09-17T05:18:49.601463+0000","last_became_active":"2024-09-17T05:18:47.139941+0000","last_became_peered":"2024-09-17T05:18:47.139941+0000","last_unstale":"2024-09-17T05:18:49.601463+0000","last_undegraded":"2024-09-17T05:18:49.601463+0000","last_fullsized":"2024-09-17T05:18:49.601463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:14.786078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133942+0000","last_change":"2024-09-17T05:18:46.133330+0000","last_active":"2024-09-17T05:18:48.133942+0000","last_peered":"2024-09-17T05:18:48.133942+0000","last_clean":"2024-09-17T05:18:48.133942+0000","last_became_active":"2024-09-17T05:18:46.133026+0000","last_became_peered":"2024-09-17T05:18:46.133026+0000","last_unstale":"2024-09-17T05:18:48.133942+0000","last_undegraded":"2024-09-17T05:18:48.133942+0000","last_fullsized":"2024-09-17T05:18:48.133942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118942+0000","last_change":"2024-09-17T05:18:47.131328+0000","last_active":"2024-09-17T05:18:48.118942+0000","last_peered":"2024-09-17T05:18:48.118942+0000","last_clean":"2024-09-17T05:18:48.118942+0000","last_became_active":"2024-09-17T05:18:47.131061+0000","last_became_peered":"2024-09-17T05:18:47.131061+0000","last_unstale":"2024-09-17T05:18:48.118942+0000","last_undegraded":"2024-09-17T05:18:48.118942+0000","last_fullsized":"2024-09-17T05:18:48.118942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:39.011324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118502+0000","last_change":"2024-09-17T05:18:46.133755+0000","last_active":"2024-09-17T05:18:48.118502+0000","last_peered":"2024-09-17T05:18:48.118502+0000","last_clean":"2024-09-17T05:18:48.118502+0000","last_became_active":"2024-09-17T05:18:46.133067+0000","last_became_peered":"2024-09-17T05:18:46.133067+0000","last_unstale":"2024-09-17T05:18:48.118502+0000","last_undegraded":"2024-09-17T05:18:48.118502+0000","last_fullsized":"2024-09-17T05:18:48.118502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901995+0000","last_change":"2024-09-17T05:18:47.133656+0000","last_active":"2024-09-17T05:18:48.901995+0000","last_peered":"2024-09-17T05:18:48.901995+0000","last_clean":"2024-09-17T05:18:48.901995+0000","last_became_active":"2024-09-17T05:18:47.133360+0000","last_became_peered":"2024-09-17T05:18:47.133360+0000","last_unstale":"2024-09-17T05:18:48.901995+0000","last_undegraded":"2024-09-17T05:18:48.901995+0000","last_fullsized":"2024-09-17T05:18:48.901995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:22.064282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601712+0000","last_change":"2024-09-17T05:18:46.129204+0000","last_active":"2024-09-17T05:18:49.601712+0000","last_peered":"2024-09-17T05:18:49.601712+0000","last_clean":"2024-09-17T05:18:49.601712+0000","last_became_active":"2024-09-17T05:18:46.128901+0000","last_became_peered":"2024-09-17T05:18:46.128901+0000","last_unstale":"2024-09-17T05:18:49.601712+0000","last_undegraded":"2024-09-17T05:18:49.601712+0000","last_fullsized":"2024-09-17T05:18:49.601712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:39.714747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601315+0000","last_change":"2024-09-17T05:18:47.136191+0000","last_active":"2024-09-17T05:18:49.601315+0000","last_peered":"2024-09-17T05:18:49.601315+0000","last_clean":"2024-09-17T05:18:49.601315+0000","last_became_active":"2024-09-17T05:18:47.135912+0000","last_became_peered":"2024-09-17T05:18:47.135912+0000","last_unstale":"2024-09-17T05:18:49.601315+0000","last_undegraded":"2024-09-17T05:18:49.601315+0000","last_fullsized":"2024-09-17T05:18:49.601315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.562603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231754+0000","last_change":"2024-09-17T05:18:46.132187+0000","last_active":"2024-09-17T05:18:50.231754+0000","last_peered":"2024-09-17T05:18:50.231754+0000","last_clean":"2024-09-17T05:18:50.231754+0000","last_became_active":"2024-09-17T05:18:46.131916+0000","last_became_peered":"2024-09-17T05:18:46.131916+0000","last_unstale":"2024-09-17T05:18:50.231754+0000","last_undegraded":"2024-09-17T05:18:50.231754+0000","last_fullsized":"2024-09-17T05:18:50.231754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902185+0000","last_change":"2024-09-17T05:18:47.139925+0000","last_active":"2024-09-17T05:18:48.902185+0000","last_peered":"2024-09-17T05:18:48.902185+0000","last_clean":"2024-09-17T05:18:48.902185+0000","last_became_active":"2024-09-17T05:18:47.139357+0000","last_became_peered":"2024-09-17T05:18:47.139357+0000","last_unstale":"2024-09-17T05:18:48.902185+0000","last_undegraded":"2024-09-17T05:18:48.902185+0000","last_fullsized":"2024-09-17T05:18:48.902185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:51.210414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118150+0000","last_change":"2024-09-17T05:18:46.131494+0000","last_active":"2024-09-17T05:18:48.118150+0000","last_peered":"2024-09-17T05:18:48.118150+0000","last_clean":"2024-09-17T05:18:48.118150+0000","last_became_active":"2024-09-17T05:18:46.131210+0000","last_became_peered":"2024-09-17T05:18:46.131210+0000","last_unstale":"2024-09-17T05:18:48.118150+0000","last_undegraded":"2024-09-17T05:18:48.118150+0000","last_fullsized":"2024-09-17T05:18:48.118150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118112+0000","last_change":"2024-09-17T05:18:47.133501+0000","last_active":"2024-09-17T05:18:48.118112+0000","last_peered":"2024-09-17T05:18:48.118112+0000","last_clean":"2024-09-17T05:18:48.118112+0000","last_became_active":"2024-09-17T05:18:47.132900+0000","last_became_peered":"2024-09-17T05:18:47.132900+0000","last_unstale":"2024-09-17T05:18:48.118112+0000","last_undegraded":"2024-09-17T05:18:48.118112+0000","last_fullsized":"2024-09-17T05:18:48.118112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.887461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231255+0000","last_change":"2024-09-17T05:18:46.127329+0000","last_active":"2024-09-17T05:18:50.231255+0000","last_peered":"2024-09-17T05:18:50.231255+0000","last_clean":"2024-09-17T05:18:50.231255+0000","last_became_active":"2024-09-17T05:18:46.126863+0000","last_became_peered":"2024-09-17T05:18:46.126863+0000","last_unstale":"2024-09-17T05:18:50.231255+0000","last_undegraded":"2024-09-17T05:18:50.231255+0000","last_fullsized":"2024-09-17T05:18:50.231255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901789+0000","last_change":"2024-09-17T05:18:47.140406+0000","last_active":"2024-09-17T05:18:48.901789+0000","last_peered":"2024-09-17T05:18:48.901789+0000","last_clean":"2024-09-17T05:18:48.901789+0000","last_became_active":"2024-09-17T05:18:47.140107+0000","last_became_peered":"2024-09-17T05:18:47.140107+0000","last_unstale":"2024-09-17T05:18:48.901789+0000","last_undegraded":"2024-09-17T05:18:48.901789+0000","last_fullsized":"2024-09-17T05:18:48.901789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:25.146819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118276+0000","last_change":"2024-09-17T05:18:46.130487+0000","last_active":"2024-09-17T05:18:48.118276+0000","last_peered":"2024-09-17T05:18:48.118276+0000","last_clean":"2024-09-17T05:18:48.118276+0000","last_became_active":"2024-09-17T05:18:46.130163+0000","last_became_peered":"2024-09-17T05:18:46.130163+0000","last_unstale":"2024-09-17T05:18:48.118276+0000","last_undegraded":"2024-09-17T05:18:48.118276+0000","last_fullsized":"2024-09-17T05:18:48.118276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:42.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902294+0000","last_change":"2024-09-17T05:18:47.142853+0000","last_active":"2024-09-17T05:18:48.902294+0000","last_peered":"2024-09-17T05:18:48.902294+0000","last_clean":"2024-09-17T05:18:48.902294+0000","last_became_active":"2024-09-17T05:18:47.142286+0000","last_became_peered":"2024-09-17T05:18:47.142286+0000","last_unstale":"2024-09-17T05:18:48.902294+0000","last_undegraded":"2024-09-17T05:18:48.902294+0000","last_fullsized":"2024-09-17T05:18:48.902294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:46.403703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231493+0000","last_change":"2024-09-17T05:18:46.129081+0000","last_active":"2024-09-17T05:18:50.231493+0000","last_peered":"2024-09-17T05:18:50.231493+0000","last_clean":"2024-09-17T05:18:50.231493+0000","last_became_active":"2024-09-17T05:18:46.128776+0000","last_became_peered":"2024-09-17T05:18:46.128776+0000","last_unstale":"2024-09-17T05:18:50.231493+0000","last_undegraded":"2024-09-17T05:18:50.231493+0000","last_fullsized":"2024-09-17T05:18:50.231493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902419+0000","last_change":"2024-09-17T05:18:47.139542+0000","last_active":"2024-09-17T05:18:48.902419+0000","last_peered":"2024-09-17T05:18:48.902419+0000","last_clean":"2024-09-17T05:18:48.902419+0000","last_became_active":"2024-09-17T05:18:47.139188+0000","last_became_peered":"2024-09-17T05:18:47.139188+0000","last_unstale":"2024-09-17T05:18:48.902419+0000","last_undegraded":"2024-09-17T05:18:48.902419+0000","last_fullsized":"2024-09-17T05:18:48.902419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:26.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134047+0000","last_change":"2024-09-17T05:18:46.132599+0000","last_active":"2024-09-17T05:18:48.134047+0000","last_peered":"2024-09-17T05:18:48.134047+0000","last_clean":"2024-09-17T05:18:48.134047+0000","last_became_active":"2024-09-17T05:18:46.132293+0000","last_became_peered":"2024-09-17T05:18:46.132293+0000","last_unstale":"2024-09-17T05:18:48.134047+0000","last_undegraded":"2024-09-17T05:18:48.134047+0000","last_fullsized":"2024-09-17T05:18:48.134047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:38.005194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231721+0000","last_change":"2024-09-17T05:18:47.132917+0000","last_active":"2024-09-17T05:18:50.231721+0000","last_peered":"2024-09-17T05:18:50.231721+0000","last_clean":"2024-09-17T05:18:50.231721+0000","last_became_active":"2024-09-17T05:18:47.132647+0000","last_became_peered":"2024-09-17T05:18:47.132647+0000","last_unstale":"2024-09-17T05:18:50.231721+0000","last_undegraded":"2024-09-17T05:18:50.231721+0000","last_fullsized":"2024-09-17T05:18:50.231721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:58.901485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231411+0000","last_change":"2024-09-17T05:18:46.127182+0000","last_active":"2024-09-17T05:18:50.231411+0000","last_peered":"2024-09-17T05:18:50.231411+0000","last_clean":"2024-09-17T05:18:50.231411+0000","last_became_active":"2024-09-17T05:18:46.126903+0000","last_became_peered":"2024-09-17T05:18:46.126903+0000","last_unstale":"2024-09-17T05:18:50.231411+0000","last_undegraded":"2024-09-17T05:18:50.231411+0000","last_fullsized":"2024-09-17T05:18:50.231411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902120+0000","last_change":"2024-09-17T05:18:47.141769+0000","last_active":"2024-09-17T05:18:48.902120+0000","last_peered":"2024-09-17T05:18:48.902120+0000","last_clean":"2024-09-17T05:18:48.902120+0000","last_became_active":"2024-09-17T05:18:47.141454+0000","last_became_peered":"2024-09-17T05:18:47.141454+0000","last_unstale":"2024-09-17T05:18:48.902120+0000","last_undegraded":"2024-09-17T05:18:48.902120+0000","last_fullsized":"2024-09-17T05:18:48.902120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:46.015055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901837+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:18:48.901837+0000","last_peered":"2024-09-17T05:18:48.901837+0000","last_clean":"2024-09-17T05:18:48.901837+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:18:48.901837+0000","last_undegraded":"2024-09-17T05:18:48.901837+0000","last_fullsized":"2024-09-17T05:18:48.901837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231276+0000","last_change":"2024-09-17T05:18:46.127446+0000","last_active":"2024-09-17T05:18:50.231276+0000","last_peered":"2024-09-17T05:18:50.231276+0000","last_clean":"2024-09-17T05:18:50.231276+0000","last_became_active":"2024-09-17T05:18:46.126901+0000","last_became_peered":"2024-09-17T05:18:46.126901+0000","last_unstale":"2024-09-17T05:18:50.231276+0000","last_undegraded":"2024-09-17T05:18:50.231276+0000","last_fullsized":"2024-09-17T05:18:50.231276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116985+0000","last_change":"2024-09-17T05:18:47.144541+0000","last_active":"2024-09-17T05:18:48.116985+0000","last_peered":"2024-09-17T05:18:48.116985+0000","last_clean":"2024-09-17T05:18:48.116985+0000","last_became_active":"2024-09-17T05:18:47.144205+0000","last_became_peered":"2024-09-17T05:18:47.144205+0000","last_unstale":"2024-09-17T05:18:48.116985+0000","last_undegraded":"2024-09-17T05:18:48.116985+0000","last_fullsized":"2024-09-17T05:18:48.116985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:44.033449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901605+0000","last_change":"2024-09-17T05:18:46.141132+0000","last_active":"2024-09-17T05:18:48.901605+0000","last_peered":"2024-09-17T05:18:48.901605+0000","last_clean":"2024-09-17T05:18:48.901605+0000","last_became_active":"2024-09-17T05:18:46.140364+0000","last_became_peered":"2024-09-17T05:18:46.140364+0000","last_unstale":"2024-09-17T05:18:48.901605+0000","last_undegraded":"2024-09-17T05:18:48.901605+0000","last_fullsized":"2024-09-17T05:18:48.901605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:14.427012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601207+0000","last_change":"2024-09-17T05:18:47.139416+0000","last_active":"2024-09-17T05:18:49.601207+0000","last_peered":"2024-09-17T05:18:49.601207+0000","last_clean":"2024-09-17T05:18:49.601207+0000","last_became_active":"2024-09-17T05:18:47.139149+0000","last_became_peered":"2024-09-17T05:18:47.139149+0000","last_unstale":"2024-09-17T05:18:49.601207+0000","last_undegraded":"2024-09-17T05:18:49.601207+0000","last_fullsized":"2024-09-17T05:18:49.601207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:15.157191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231382+0000","last_change":"2024-09-17T05:18:46.129101+0000","last_active":"2024-09-17T05:18:50.231382+0000","last_peered":"2024-09-17T05:18:50.231382+0000","last_clean":"2024-09-17T05:18:50.231382+0000","last_became_active":"2024-09-17T05:18:46.128748+0000","last_became_peered":"2024-09-17T05:18:46.128748+0000","last_unstale":"2024-09-17T05:18:50.231382+0000","last_undegraded":"2024-09-17T05:18:50.231382+0000","last_fullsized":"2024-09-17T05:18:50.231382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:01.709036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133772+0000","last_change":"2024-09-17T05:18:47.131649+0000","last_active":"2024-09-17T05:18:48.133772+0000","last_peered":"2024-09-17T05:18:48.133772+0000","last_clean":"2024-09-17T05:18:48.133772+0000","last_became_active":"2024-09-17T05:18:47.131360+0000","last_became_peered":"2024-09-17T05:18:47.131360+0000","last_unstale":"2024-09-17T05:18:48.133772+0000","last_undegraded":"2024-09-17T05:18:48.133772+0000","last_fullsized":"2024-09-17T05:18:48.133772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.887461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231729+0000","last_change":"2024-09-17T05:18:46.129856+0000","last_active":"2024-09-17T05:18:50.231729+0000","last_peered":"2024-09-17T05:18:50.231729+0000","last_clean":"2024-09-17T05:18:50.231729+0000","last_became_active":"2024-09-17T05:18:46.129409+0000","last_became_peered":"2024-09-17T05:18:46.129409+0000","last_unstale":"2024-09-17T05:18:50.231729+0000","last_undegraded":"2024-09-17T05:18:50.231729+0000","last_fullsized":"2024-09-17T05:18:50.231729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118122+0000","last_change":"2024-09-17T05:18:47.135559+0000","last_active":"2024-09-17T05:18:48.118122+0000","last_peered":"2024-09-17T05:18:48.118122+0000","last_clean":"2024-09-17T05:18:48.118122+0000","last_became_active":"2024-09-17T05:18:47.135267+0000","last_became_peered":"2024-09-17T05:18:47.135267+0000","last_unstale":"2024-09-17T05:18:48.118122+0000","last_undegraded":"2024-09-17T05:18:48.118122+0000","last_fullsized":"2024-09-17T05:18:48.118122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:27.485204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133876+0000","last_change":"2024-09-17T05:18:46.128837+0000","last_active":"2024-09-17T05:18:48.133876+0000","last_peered":"2024-09-17T05:18:48.133876+0000","last_clean":"2024-09-17T05:18:48.133876+0000","last_became_active":"2024-09-17T05:18:46.128576+0000","last_became_peered":"2024-09-17T05:18:46.128576+0000","last_unstale":"2024-09-17T05:18:48.133876+0000","last_undegraded":"2024-09-17T05:18:48.133876+0000","last_fullsized":"2024-09-17T05:18:48.133876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231969+0000","last_change":"2024-09-17T05:18:47.135090+0000","last_active":"2024-09-17T05:18:50.231969+0000","last_peered":"2024-09-17T05:18:50.231969+0000","last_clean":"2024-09-17T05:18:50.231969+0000","last_became_active":"2024-09-17T05:18:47.134518+0000","last_became_peered":"2024-09-17T05:18:47.134518+0000","last_unstale":"2024-09-17T05:18:50.231969+0000","last_undegraded":"2024-09-17T05:18:50.231969+0000","last_fullsized":"2024-09-17T05:18:50.231969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:28.351688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902337+0000","last_change":"2024-09-17T05:18:46.141667+0000","last_active":"2024-09-17T05:18:48.902337+0000","last_peered":"2024-09-17T05:18:48.902337+0000","last_clean":"2024-09-17T05:18:48.902337+0000","last_became_active":"2024-09-17T05:18:46.140316+0000","last_became_peered":"2024-09-17T05:18:46.140316+0000","last_unstale":"2024-09-17T05:18:48.902337+0000","last_undegraded":"2024-09-17T05:18:48.902337+0000","last_fullsized":"2024-09-17T05:18:48.902337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:32.288529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133877+0000","last_change":"2024-09-17T05:18:47.131478+0000","last_active":"2024-09-17T05:18:48.133877+0000","last_peered":"2024-09-17T05:18:48.133877+0000","last_clean":"2024-09-17T05:18:48.133877+0000","last_became_active":"2024-09-17T05:18:47.131211+0000","last_became_peered":"2024-09-17T05:18:47.131211+0000","last_unstale":"2024-09-17T05:18:48.133877+0000","last_undegraded":"2024-09-17T05:18:48.133877+0000","last_fullsized":"2024-09-17T05:18:48.133877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:07.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134091+0000","last_change":"2024-09-17T05:18:46.130971+0000","last_active":"2024-09-17T05:18:48.134091+0000","last_peered":"2024-09-17T05:18:48.134091+0000","last_clean":"2024-09-17T05:18:48.134091+0000","last_became_active":"2024-09-17T05:18:46.130678+0000","last_became_peered":"2024-09-17T05:18:46.130678+0000","last_unstale":"2024-09-17T05:18:48.134091+0000","last_undegraded":"2024-09-17T05:18:48.134091+0000","last_fullsized":"2024-09-17T05:18:48.134091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117415+0000","last_change":"2024-09-17T05:18:47.146406+0000","last_active":"2024-09-17T05:18:48.117415+0000","last_peered":"2024-09-17T05:18:48.117415+0000","last_clean":"2024-09-17T05:18:48.117415+0000","last_became_active":"2024-09-17T05:18:47.146064+0000","last_became_peered":"2024-09-17T05:18:47.146064+0000","last_unstale":"2024-09-17T05:18:48.117415+0000","last_undegraded":"2024-09-17T05:18:48.117415+0000","last_fullsized":"2024-09-17T05:18:48.117415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:55.524841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118972+0000","last_change":"2024-09-17T05:18:46.137090+0000","last_active":"2024-09-17T05:18:48.118972+0000","last_peered":"2024-09-17T05:18:48.118972+0000","last_clean":"2024-09-17T05:18:48.118972+0000","last_became_active":"2024-09-17T05:18:46.136506+0000","last_became_peered":"2024-09-17T05:18:46.136506+0000","last_unstale":"2024-09-17T05:18:48.118972+0000","last_undegraded":"2024-09-17T05:18:48.118972+0000","last_fullsized":"2024-09-17T05:18:48.118972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601508+0000","last_change":"2024-09-17T05:18:47.132848+0000","last_active":"2024-09-17T05:18:49.601508+0000","last_peered":"2024-09-17T05:18:49.601508+0000","last_clean":"2024-09-17T05:18:49.601508+0000","last_became_active":"2024-09-17T05:18:47.132504+0000","last_became_peered":"2024-09-17T05:18:47.132504+0000","last_unstale":"2024-09-17T05:18:49.601508+0000","last_undegraded":"2024-09-17T05:18:49.601508+0000","last_fullsized":"2024-09-17T05:18:49.601508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:28.843941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901581+0000","last_change":"2024-09-17T05:18:46.137719+0000","last_active":"2024-09-17T05:18:48.901581+0000","last_peered":"2024-09-17T05:18:48.901581+0000","last_clean":"2024-09-17T05:18:48.901581+0000","last_became_active":"2024-09-17T05:18:46.137459+0000","last_became_peered":"2024-09-17T05:18:46.137459+0000","last_unstale":"2024-09-17T05:18:48.901581+0000","last_undegraded":"2024-09-17T05:18:48.901581+0000","last_fullsized":"2024-09-17T05:18:48.901581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:38.005194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118618+0000","last_change":"2024-09-17T05:18:47.126967+0000","last_active":"2024-09-17T05:18:48.118618+0000","last_peered":"2024-09-17T05:18:48.118618+0000","last_clean":"2024-09-17T05:18:48.118618+0000","last_became_active":"2024-09-17T05:18:47.125840+0000","last_became_peered":"2024-09-17T05:18:47.125840+0000","last_unstale":"2024-09-17T05:18:48.118618+0000","last_undegraded":"2024-09-17T05:18:48.118618+0000","last_fullsized":"2024-09-17T05:18:48.118618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:41.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133964+0000","last_change":"2024-09-17T05:18:46.136676+0000","last_active":"2024-09-17T05:18:48.133964+0000","last_peered":"2024-09-17T05:18:48.133964+0000","last_clean":"2024-09-17T05:18:48.133964+0000","last_became_active":"2024-09-17T05:18:46.136468+0000","last_became_peered":"2024-09-17T05:18:46.136468+0000","last_unstale":"2024-09-17T05:18:48.133964+0000","last_undegraded":"2024-09-17T05:18:48.133964+0000","last_fullsized":"2024-09-17T05:18:48.133964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116957+0000","last_change":"2024-09-17T05:18:47.130998+0000","last_active":"2024-09-17T05:18:48.116957+0000","last_peered":"2024-09-17T05:18:48.116957+0000","last_clean":"2024-09-17T05:18:48.116957+0000","last_became_active":"2024-09-17T05:18:47.130307+0000","last_became_peered":"2024-09-17T05:18:47.130307+0000","last_unstale":"2024-09-17T05:18:48.116957+0000","last_undegraded":"2024-09-17T05:18:48.116957+0000","last_fullsized":"2024-09-17T05:18:48.116957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:30.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133849+0000","last_change":"2024-09-17T05:18:46.132362+0000","last_active":"2024-09-17T05:18:48.133849+0000","last_peered":"2024-09-17T05:18:48.133849+0000","last_clean":"2024-09-17T05:18:48.133849+0000","last_became_active":"2024-09-17T05:18:46.132074+0000","last_became_peered":"2024-09-17T05:18:46.132074+0000","last_unstale":"2024-09-17T05:18:48.133849+0000","last_undegraded":"2024-09-17T05:18:48.133849+0000","last_fullsized":"2024-09-17T05:18:48.133849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:32.288529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117086+0000","last_change":"2024-09-17T05:18:47.133311+0000","last_active":"2024-09-17T05:18:48.117086+0000","last_peered":"2024-09-17T05:18:48.117086+0000","last_clean":"2024-09-17T05:18:48.117086+0000","last_became_active":"2024-09-17T05:18:47.132929+0000","last_became_peered":"2024-09-17T05:18:47.132929+0000","last_unstale":"2024-09-17T05:18:48.117086+0000","last_undegraded":"2024-09-17T05:18:48.117086+0000","last_fullsized":"2024-09-17T05:18:48.117086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:14.224552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902100+0000","last_change":"2024-09-17T05:18:46.140762+0000","last_active":"2024-09-17T05:18:48.902100+0000","last_peered":"2024-09-17T05:18:48.902100+0000","last_clean":"2024-09-17T05:18:48.902100+0000","last_became_active":"2024-09-17T05:18:46.140483+0000","last_became_peered":"2024-09-17T05:18:46.140483+0000","last_unstale":"2024-09-17T05:18:48.902100+0000","last_undegraded":"2024-09-17T05:18:48.902100+0000","last_fullsized":"2024-09-17T05:18:48.902100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:11.520291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118254+0000","last_change":"2024-09-17T05:18:47.125446+0000","last_active":"2024-09-17T05:18:48.118254+0000","last_peered":"2024-09-17T05:18:48.118254+0000","last_clean":"2024-09-17T05:18:48.118254+0000","last_became_active":"2024-09-17T05:18:47.125114+0000","last_became_peered":"2024-09-17T05:18:47.125114+0000","last_unstale":"2024-09-17T05:18:48.118254+0000","last_undegraded":"2024-09-17T05:18:48.118254+0000","last_fullsized":"2024-09-17T05:18:48.118254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.280584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231984+0000","last_change":"2024-09-17T05:18:47.143858+0000","last_active":"2024-09-17T05:18:50.231984+0000","last_peered":"2024-09-17T05:18:50.231984+0000","last_clean":"2024-09-17T05:18:50.231984+0000","last_became_active":"2024-09-17T05:18:47.143613+0000","last_became_peered":"2024-09-17T05:18:47.143613+0000","last_unstale":"2024-09-17T05:18:50.231984+0000","last_undegraded":"2024-09-17T05:18:50.231984+0000","last_fullsized":"2024-09-17T05:18:50.231984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:35.695324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901919+0000","last_change":"2024-09-17T05:18:46.140678+0000","last_active":"2024-09-17T05:18:48.901919+0000","last_peered":"2024-09-17T05:18:48.901919+0000","last_clean":"2024-09-17T05:18:48.901919+0000","last_became_active":"2024-09-17T05:18:46.140137+0000","last_became_peered":"2024-09-17T05:18:46.140137+0000","last_unstale":"2024-09-17T05:18:48.901919+0000","last_undegraded":"2024-09-17T05:18:48.901919+0000","last_fullsized":"2024-09-17T05:18:48.901919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231455+0000","last_change":"2024-09-17T05:18:47.139974+0000","last_active":"2024-09-17T05:18:50.231455+0000","last_peered":"2024-09-17T05:18:50.231455+0000","last_clean":"2024-09-17T05:18:50.231455+0000","last_became_active":"2024-09-17T05:18:47.139691+0000","last_became_peered":"2024-09-17T05:18:47.139691+0000","last_unstale":"2024-09-17T05:18:50.231455+0000","last_undegraded":"2024-09-17T05:18:50.231455+0000","last_fullsized":"2024-09-17T05:18:50.231455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902180+0000","last_change":"2024-09-17T05:18:46.141012+0000","last_active":"2024-09-17T05:18:48.902180+0000","last_peered":"2024-09-17T05:18:48.902180+0000","last_clean":"2024-09-17T05:18:48.902180+0000","last_became_active":"2024-09-17T05:18:46.140729+0000","last_became_peered":"2024-09-17T05:18:46.140729+0000","last_unstale":"2024-09-17T05:18:48.902180+0000","last_undegraded":"2024-09-17T05:18:48.902180+0000","last_fullsized":"2024-09-17T05:18:48.902180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601536+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:49.601536+0000","last_peered":"2024-09-17T05:18:49.601536+0000","last_clean":"2024-09-17T05:18:49.601536+0000","last_became_active":"2024-09-17T05:18:47.140502+0000","last_became_peered":"2024-09-17T05:18:47.140502+0000","last_unstale":"2024-09-17T05:18:49.601536+0000","last_undegraded":"2024-09-17T05:18:49.601536+0000","last_fullsized":"2024-09-17T05:18:49.601536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:34.571312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117361+0000","last_change":"2024-09-17T05:18:46.126436+0000","last_active":"2024-09-17T05:18:48.117361+0000","last_peered":"2024-09-17T05:18:48.117361+0000","last_clean":"2024-09-17T05:18:48.117361+0000","last_became_active":"2024-09-17T05:18:46.126106+0000","last_became_peered":"2024-09-17T05:18:46.126106+0000","last_unstale":"2024-09-17T05:18:48.117361+0000","last_undegraded":"2024-09-17T05:18:48.117361+0000","last_fullsized":"2024-09-17T05:18:48.117361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117337+0000","last_change":"2024-09-17T05:18:47.135662+0000","last_active":"2024-09-17T05:18:48.117337+0000","last_peered":"2024-09-17T05:18:48.117337+0000","last_clean":"2024-09-17T05:18:48.117337+0000","last_became_active":"2024-09-17T05:18:47.135205+0000","last_became_peered":"2024-09-17T05:18:47.135205+0000","last_unstale":"2024-09-17T05:18:48.117337+0000","last_undegraded":"2024-09-17T05:18:48.117337+0000","last_fullsized":"2024-09-17T05:18:48.117337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601609+0000","last_change":"2024-09-17T05:18:46.135269+0000","last_active":"2024-09-17T05:18:49.601609+0000","last_peered":"2024-09-17T05:18:49.601609+0000","last_clean":"2024-09-17T05:18:49.601609+0000","last_became_active":"2024-09-17T05:18:46.135042+0000","last_became_peered":"2024-09-17T05:18:46.135042+0000","last_unstale":"2024-09-17T05:18:49.601609+0000","last_undegraded":"2024-09-17T05:18:49.601609+0000","last_fullsized":"2024-09-17T05:18:49.601609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:44.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509446,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509446,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509445,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509445,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509445,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509446,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509445,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:18:55.803 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:18:55.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-17T05:18:55.805 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 -- 172.21.15.81:0/767004826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0d1ec0 msgr2=0x7f21dc0d22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 --2- 172.21.15.81:0/767004826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0d1ec0 0x7f21dc0d22a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009900 tx=0x7f21cc02a560 comp rx=0 tx=0).stop 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 -- 172.21.15.81:0/767004826 shutdown_connections 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 --2- 172.21.15.81:0/767004826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21dc0b52f0 0x7f21dc0b3ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 --2- 172.21.15.81:0/767004826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0d1ec0 0x7f21dc0d22a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 -- 172.21.15.81:0/767004826 >> 172.21.15.81:0/767004826 conn(0x7f21dc0d3e70 msgr2=0x7f21dc0d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 -- 172.21.15.81:0/767004826 shutdown_connections 2024-09-17T05:18:55.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.941+0000 7f21e159b640 1 -- 172.21.15.81:0/767004826 wait complete. 2024-09-17T05:18:55.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 Processor -- start 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 -- start start 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0b52f0 0x7f21dc0a1510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21dc0d1ec0 0x7f21dc0d0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21dc0d27e0 0x7f21dc0d0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc0b1ea0 con 0x7f21dc0b52f0 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21dc0b1d20 con 0x7f21dc0d1ec0 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.943+0000 7f21e159b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f21dc0b2020 con 0x7f21dc0d27e0 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0b52f0 0x7f21dc0a1510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0b52f0 0x7f21dc0a1510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38380/0 (socket says 172.21.15.81:38380) 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 -- 172.21.15.81:0/2402652335 learned_addr learned my addr 172.21.15.81:0/2402652335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21d27fc640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21dc0d1ec0 0x7f21dc0d0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21db7fe640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21dc0d27e0 0x7f21dc0d0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 -- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21dc0d27e0 msgr2=0x7f21dc0d0ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21dc0d27e0 0x7f21dc0d0ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 -- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21dc0d1ec0 msgr2=0x7f21dc0d0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21dc0d1ec0 0x7f21dc0d0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 -- 172.21.15.81:0/2402652335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21dc1f55a0 con 0x7f21dc0b52f0 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21db7fe640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21dc0d27e0 0x7f21dc0d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21daffd640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0b52f0 0x7f21dc0a1510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009230 tx=0x7f21cc0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21d3fff640 1 -- 172.21.15.81:0/2402652335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc03f070 con 0x7f21dc0b52f0 2024-09-17T05:18:55.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21d3fff640 1 -- 172.21.15.81:0/2402652335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21cc004890 con 0x7f21dc0b52f0 2024-09-17T05:18:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21d3fff640 1 -- 172.21.15.81:0/2402652335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21cc035030 con 0x7f21dc0b52f0 2024-09-17T05:18:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21dc1f5b80 con 0x7f21dc0b52f0 2024-09-17T05:18:55.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.944+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21dc1f6140 con 0x7f21dc0b52f0 2024-09-17T05:18:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.945+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21dc0d22a0 con 0x7f21dc0b52f0 2024-09-17T05:18:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.946+0000 7f21d3fff640 1 -- 172.21.15.81:0/2402652335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21cc042070 con 0x7f21dc0b52f0 2024-09-17T05:18:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.946+0000 7f21d3fff640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21bc078bc0 0x7f21bc07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.947+0000 7f21d3fff640 1 -- 172.21.15.81:0/2402652335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f21cc0bbc20 con 0x7f21dc0b52f0 2024-09-17T05:18:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.947+0000 7f21d27fc640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21bc078bc0 0x7f21bc07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:55.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.947+0000 7f21d27fc640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21bc078bc0 0x7f21bc07b080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21c4006fd0 tx=0x7f21c4008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:55.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:55.951+0000 7f21d3fff640 1 -- 172.21.15.81:0/2402652335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f21cc084180 con 0x7f21dc0b52f0 2024-09-17T05:18:56.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.127+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7f21dc0b4e10 con 0x7f21dc0b52f0 2024-09-17T05:18:56.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.127+0000 7f21d3fff640 1 -- 172.21.15.81:0/2402652335 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v27) ==== 86+0+160 (secure 0 0 0) 0x7f21cc083a80 con 0x7f21dc0b52f0 2024-09-17T05:18:56.128 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21bc078bc0 msgr2=0x7f21bc07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21bc078bc0 0x7f21bc07b080 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f21c4006fd0 tx=0x7f21c4008040 comp rx=0 tx=0).stop 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0b52f0 msgr2=0x7f21dc0a1510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0b52f0 0x7f21dc0a1510 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f21cc009230 tx=0x7f21cc0039e0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 shutdown_connections 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21bc078bc0 0x7f21bc07b080 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21dc0d27e0 0x7f21dc0d0ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21dc0d1ec0 0x7f21dc0d0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 --2- 172.21.15.81:0/2402652335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21dc0b52f0 0x7f21dc0a1510 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.129+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 >> 172.21.15.81:0/2402652335 conn(0x7f21dc0d3e70 msgr2=0x7f21dc0b3c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.130+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 shutdown_connections 2024-09-17T05:18:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.130+0000 7f21e159b640 1 -- 172.21.15.81:0/2402652335 wait complete. 2024-09-17T05:18:56.141 INFO:teuthology.orchestra.run.smithi081.stdout:[{"version":27,"timestamp":"2024-09-17T05:18:35.518856+0000","name":"","changes":[{"name":"osd.6/osd_mclock_max_capacity_iops_ssd","new_value":"5295.386182"}]}] 2024-09-17T05:18:56.141 INFO:tasks.ceph_manager:config epoch is 27 2024-09-17T05:18:56.142 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-17T05:18:56.142 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-17T05:18:56.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-17T05:18:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.242+0000 7eff73152640 1 -- 172.21.15.81:0/2199321576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5c003a00 msgr2=0x7eff5c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.242+0000 7eff73152640 1 --2- 172.21.15.81:0/2199321576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff5c003a00 0x7eff5c003e20 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7eff6000c2e0 tx=0x7eff5c005830 comp rx=0 tx=0).stop 2024-09-17T05:18:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.242+0000 7eff716ef640 1 -- 172.21.15.81:0/2199321576 reap_dead start 2024-09-17T05:18:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.242+0000 7eff73152640 1 -- 172.21.15.81:0/2199321576 shutdown_connections 2024-09-17T05:18:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.242+0000 7eff73152640 1 -- 172.21.15.81:0/2199321576 >> 172.21.15.81:0/2199321576 conn(0x7eff6c0741f0 msgr2=0x7eff6c074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:56.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.242+0000 7eff73152640 1 -- 172.21.15.81:0/2199321576 shutdown_connections 2024-09-17T05:18:56.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.242+0000 7eff73152640 1 -- 172.21.15.81:0/2199321576 wait complete. 2024-09-17T05:18:56.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.243+0000 7eff73152640 1 Processor -- start 2024-09-17T05:18:56.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.243+0000 7eff73152640 1 -- start start 2024-09-17T05:18:56.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff73152640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff5c003a00 0x7eff6c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff73152640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff6c0ad100 0x7eff6c0b3b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff73152640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c1f2230 0x7eff6c1f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff73152640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c15c460 con 0x7eff6c1f2230 2024-09-17T05:18:56.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff73152640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7eff6c0cf5d0 con 0x7eff5c003a00 2024-09-17T05:18:56.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff73152640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7eff6c15c5e0 con 0x7eff6c0ad100 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c1f2230 0x7eff6c1f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c1f2230 0x7eff6c1f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38390/0 (socket says 172.21.15.81:38390) 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 -- 172.21.15.81:0/999640210 learned_addr learned my addr 172.21.15.81:0/999640210 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff6bfff640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff6c0ad100 0x7eff6c0b3b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff70eee640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff5c003a00 0x7eff6c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 -- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff6c0ad100 msgr2=0x7eff6c0b3b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff6c0ad100 0x7eff6c0b3b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 -- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff5c003a00 msgr2=0x7eff6c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff5c003a00 0x7eff6c0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.244+0000 7eff716ef640 1 -- 172.21.15.81:0/999640210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6c0b1010 con 0x7eff6c1f2230 2024-09-17T05:18:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.245+0000 7eff716ef640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c1f2230 0x7eff6c1f5e20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff6400f900 tx=0x7eff6400fdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.245+0000 7eff697fa640 1 -- 172.21.15.81:0/999640210 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64003b80 con 0x7eff6c1f2230 2024-09-17T05:18:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.245+0000 7eff697fa640 1 -- 172.21.15.81:0/999640210 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7eff64003e10 con 0x7eff6c1f2230 2024-09-17T05:18:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.245+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6c0b12f0 con 0x7eff6c1f2230 2024-09-17T05:18:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.245+0000 7eff697fa640 1 -- 172.21.15.81:0/999640210 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff64004d60 con 0x7eff6c1f2230 2024-09-17T05:18:56.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.245+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6c0b18b0 con 0x7eff6c1f2230 2024-09-17T05:18:56.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.246+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff6c15a030 con 0x7eff6c1f2230 2024-09-17T05:18:56.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.246+0000 7eff697fa640 1 -- 172.21.15.81:0/999640210 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7eff6401a020 con 0x7eff6c1f2230 2024-09-17T05:18:56.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.247+0000 7eff697fa640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7eff50078b90 0x7eff5007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.247+0000 7eff697fa640 1 -- 172.21.15.81:0/999640210 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7eff6409ad10 con 0x7eff6c1f2230 2024-09-17T05:18:56.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.247+0000 7eff70eee640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7eff50078b90 0x7eff5007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.248+0000 7eff70eee640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7eff50078b90 0x7eff5007b050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff60033000 tx=0x7eff60038040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:56.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.251+0000 7eff697fa640 1 -- 172.21.15.81:0/999640210 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7eff6c15a030 con 0x7eff6c1f2230 2024-09-17T05:18:56.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.475+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7eff6c068ac0 con 0x7eff6c1f2230 2024-09-17T05:18:56.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.478+0000 7eff697fa640 1 -- 172.21.15.81:0/999640210 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+194722 (secure 0 0 0) 0x7eff64062b90 con 0x7eff6c1f2230 2024-09-17T05:18:56.483 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:56.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7eff50078b90 msgr2=0x7eff5007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7eff50078b90 0x7eff5007b050 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7eff60033000 tx=0x7eff60038040 comp rx=0 tx=0).stop 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c1f2230 msgr2=0x7eff6c1f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c1f2230 0x7eff6c1f5e20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7eff6400f900 tx=0x7eff6400fdc0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 shutdown_connections 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7eff50078b90 0x7eff5007b050 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7eff6c1f2230 0x7eff6c1f5e20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7eff6c0ad100 0x7eff6c0b3b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 --2- 172.21.15.81:0/999640210 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7eff5c003a00 0x7eff6c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 >> 172.21.15.81:0/999640210 conn(0x7eff6c0741f0 msgr2=0x7eff6c0d0410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:56.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 shutdown_connections 2024-09-17T05:18:56.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.481+0000 7eff73152640 1 -- 172.21.15.81:0/999640210 wait complete. 2024-09-17T05:18:56.493 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":5,"flags":0,"active_gid":4108,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3031880469},{"type":"v1","addr":"172.21.15.160:6801","nonce":3031880469}]},"active_addr":"172.21.15.160:6801/3031880469","active_change":"2024-09-17T05:18:27.366532+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[{"gid":4119,"name":"y","mgr_features":4540719139924082687,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":3351927694}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":3080399496}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":3804699421}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.160:0","nonce":1489157457}]}]} 2024-09-17T05:18:56.498 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-17T05:18:56.498 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-17T05:18:56.498 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.597+0000 7fb571791640 1 -- 172.21.15.81:0/4241179202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 msgr2=0x7fb56c0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.597+0000 7fb571791640 1 --2- 172.21.15.81:0/4241179202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c0d0630 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fb56c08cf10 tx=0x7fb55402a530 comp rx=0 tx=0).stop 2024-09-17T05:18:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.597+0000 7fb571791640 1 -- 172.21.15.81:0/4241179202 shutdown_connections 2024-09-17T05:18:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.597+0000 7fb571791640 1 --2- 172.21.15.81:0/4241179202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c0d0630 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.597+0000 7fb571791640 1 --2- 172.21.15.81:0/4241179202 >> v2:172.21.15.160:3300/0 conn(0x7fb56c15df90 0x7fb56c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.597+0000 7fb571791640 1 -- 172.21.15.81:0/4241179202 >> 172.21.15.81:0/4241179202 conn(0x7fb56c0d3ea0 msgr2=0x7fb56c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.598+0000 7fb571791640 1 -- 172.21.15.81:0/4241179202 shutdown_connections 2024-09-17T05:18:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.598+0000 7fb571791640 1 -- 172.21.15.81:0/4241179202 wait complete. 2024-09-17T05:18:56.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.599+0000 7fb571791640 1 Processor -- start 2024-09-17T05:18:56.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.599+0000 7fb571791640 1 -- start start 2024-09-17T05:18:56.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.599+0000 7fb571791640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c1f8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb571791640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c15df90 0x7fb56c15cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb571791640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb56c162480 0x7fb56c160410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb571791640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c0d0f00 con 0x7fb56c0d49c0 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb571791640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb56c0d0d80 con 0x7fb56c15df90 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb571791640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb56c0b3f10 con 0x7fb56c162480 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c1f8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c1f8650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38408/0 (socket says 172.21.15.81:38408) 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 -- 172.21.15.81:0/316255511 learned_addr learned my addr 172.21.15.81:0/316255511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:56.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 -- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb56c162480 msgr2=0x7fb56c160410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb56c162480 0x7fb56c160410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 -- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c15df90 msgr2=0x7fb56c15cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c15df90 0x7fb56c15cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 -- 172.21.15.81:0/316255511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb56c0b9b00 con 0x7fb56c0d49c0 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb56affd640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c1f8650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c920 tx=0x7fb55c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb563fff640 1 -- 172.21.15.81:0/316255511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c007c70 con 0x7fb56c0d49c0 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb563fff640 1 -- 172.21.15.81:0/316255511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb55c00f450 con 0x7fb56c0d49c0 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb563fff640 1 -- 172.21.15.81:0/316255511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00f8a0 con 0x7fb56c0d49c0 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb56c1f49c0 con 0x7fb56c0d49c0 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.600+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb56c1f4f80 con 0x7fb56c0d49c0 2024-09-17T05:18:56.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.601+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb56c0b4430 con 0x7fb56c0d49c0 2024-09-17T05:18:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.602+0000 7fb563fff640 1 -- 172.21.15.81:0/316255511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb55c00fa40 con 0x7fb56c0d49c0 2024-09-17T05:18:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.602+0000 7fb563fff640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb54c078b90 0x7fb54c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.602+0000 7fb563fff640 1 -- 172.21.15.81:0/316255511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb55c09b540 con 0x7fb56c0d49c0 2024-09-17T05:18:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.602+0000 7fb5627fc640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb54c078b90 0x7fb54c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.603+0000 7fb5627fc640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb54c078b90 0x7fb54c07b050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb554034000 tx=0x7fb5540046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:56.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.607+0000 7fb563fff640 1 -- 172.21.15.81:0/316255511 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb55c014030 con 0x7fb56c0d49c0 2024-09-17T05:18:56.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.784+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb56c08d590 con 0x7fb56c0d49c0 2024-09-17T05:18:56.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.785+0000 7fb563fff640 1 -- 172.21.15.81:0/316255511 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7fb55c063aa0 con 0x7fb56c0d49c0 2024-09-17T05:18:56.786 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:56.786 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:48.113992+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb54c078b90 msgr2=0x7fb54c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb54c078b90 0x7fb54c07b050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb554034000 tx=0x7fb5540046c0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 msgr2=0x7fb56c1f8650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c1f8650 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00c920 tx=0x7fb55c00cde0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 shutdown_connections 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb54c078b90 0x7fb54c07b050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb56c162480 0x7fb56c160410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb56c15df90 0x7fb56c15cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 --2- 172.21.15.81:0/316255511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb56c0d49c0 0x7fb56c1f8650 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 >> 172.21.15.81:0/316255511 conn(0x7fb56c0d3ea0 msgr2=0x7fb56c06eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:56.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 shutdown_connections 2024-09-17T05:18:56.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.787+0000 7fb571791640 1 -- 172.21.15.81:0/316255511 wait complete. 2024-09-17T05:18:56.799 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-17T05:18:56.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 -- 172.21.15.81:0/4224856376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 msgr2=0x7fa1f40703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 --2- 172.21.15.81:0/4224856376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f40703f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa1f406ee40 tx=0x7fa1e402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 -- 172.21.15.81:0/4224856376 shutdown_connections 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 --2- 172.21.15.81:0/4224856376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f40703f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 --2- 172.21.15.81:0/4224856376 >> v2:172.21.15.160:3300/0 conn(0x7fa1f40735a0 0x7fa1f40739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 -- 172.21.15.81:0/4224856376 >> 172.21.15.81:0/4224856376 conn(0x7fa1f40b1690 msgr2=0x7fa1f40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 -- 172.21.15.81:0/4224856376 shutdown_connections 2024-09-17T05:18:56.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.899+0000 7fa1fc132640 1 -- 172.21.15.81:0/4224856376 wait complete. 2024-09-17T05:18:56.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 Processor -- start 2024-09-17T05:18:56.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 -- start start 2024-09-17T05:18:56.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f41f54a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40735a0 0x7fa1f4143e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f415aa70 0x7fa1f4158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f40cd270 con 0x7fa1f406ff80 2024-09-17T05:18:56.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f40cd0f0 con 0x7fa1f40735a0 2024-09-17T05:18:56.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1fc132640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f40cd3f0 con 0x7fa1f415aa70 2024-09-17T05:18:56.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1f9ece640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f41f54a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1f9ece640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f41f54a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38434/0 (socket says 172.21.15.81:38434) 2024-09-17T05:18:56.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.901+0000 7fa1f9ece640 1 -- 172.21.15.81:0/658004369 learned_addr learned my addr 172.21.15.81:0/658004369 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:56.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f96cd640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40735a0 0x7fa1f4143e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1fa6cf640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f415aa70 0x7fa1f4158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f9ece640 1 -- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f415aa70 msgr2=0x7fa1f4158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f9ece640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f415aa70 0x7fa1f4158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f9ece640 1 -- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40735a0 msgr2=0x7fa1f4143e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:56.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f9ece640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40735a0 0x7fa1f4143e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:56.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f9ece640 1 -- 172.21.15.81:0/658004369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f41f59e0 con 0x7fa1f406ff80 2024-09-17T05:18:56.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f9ece640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f41f54a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b3e0 tx=0x7fa1ec00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:56.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f27fc640 1 -- 172.21.15.81:0/658004369 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec015020 con 0x7fa1f406ff80 2024-09-17T05:18:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f27fc640 1 -- 172.21.15.81:0/658004369 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1ec011940 con 0x7fa1f406ff80 2024-09-17T05:18:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f40c9440 con 0x7fa1f406ff80 2024-09-17T05:18:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1f27fc640 1 -- 172.21.15.81:0/658004369 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec011d90 con 0x7fa1f406ff80 2024-09-17T05:18:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.902+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f40cab50 con 0x7fa1f406ff80 2024-09-17T05:18:56.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.903+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1f4074750 con 0x7fa1f406ff80 2024-09-17T05:18:56.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.904+0000 7fa1f27fc640 1 -- 172.21.15.81:0/658004369 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa1ec018020 con 0x7fa1f406ff80 2024-09-17T05:18:56.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.904+0000 7fa1f27fc640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa1e0078b90 0x7fa1e007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:56.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.904+0000 7fa1f27fc640 1 -- 172.21.15.81:0/658004369 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa1ec09aba0 con 0x7fa1f406ff80 2024-09-17T05:18:56.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.905+0000 7fa1f96cd640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa1e0078b90 0x7fa1e007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:56.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.905+0000 7fa1f96cd640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa1e0078b90 0x7fa1e007b050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1f41f7f70 tx=0x7fa1e800d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:56.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:56.909+0000 7fa1f27fc640 1 -- 172.21.15.81:0/658004369 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa1f4074750 con 0x7fa1f406ff80 2024-09-17T05:18:57.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.086+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa1f406e5e0 con 0x7fa1f406ff80 2024-09-17T05:18:57.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.087+0000 7fa1f27fc640 1 -- 172.21.15.81:0/658004369 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7fa1f406e5e0 con 0x7fa1f406ff80 2024-09-17T05:18:57.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:57.089 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:48.113992+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:18:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa1e0078b90 msgr2=0x7fa1e007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa1e0078b90 0x7fa1e007b050 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fa1f41f7f70 tx=0x7fa1e800d040 comp rx=0 tx=0).stop 2024-09-17T05:18:57.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 msgr2=0x7fa1f41f54a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f41f54a0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec00b3e0 tx=0x7fa1ec00b8a0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 shutdown_connections 2024-09-17T05:18:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa1e0078b90 0x7fa1e007b050 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1f415aa70 0x7fa1f4158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1f40735a0 0x7fa1f4143e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 --2- 172.21.15.81:0/658004369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1f406ff80 0x7fa1f41f54a0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 >> 172.21.15.81:0/658004369 conn(0x7fa1f40b1690 msgr2=0x7fa1f415b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 shutdown_connections 2024-09-17T05:18:57.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.089+0000 7fa1fc132640 1 -- 172.21.15.81:0/658004369 wait complete. 2024-09-17T05:18:57.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-17T05:18:57.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-17T05:18:57.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-17T05:18:57.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-17T05:18:57.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-09-17T05:18:57.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-09-17T05:18:57.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-09-17T05:18:57.104 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-09-17T05:18:57.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.273+0000 7f5a2d3ec640 1 -- 172.21.15.81:0/4207615302 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a280a6d40 con 0x7f5a2003be30 2024-09-17T05:18:57.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.273+0000 7f5a30652640 1 -- 172.21.15.81:0/4207615302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 msgr2=0x7f5a200e2a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.273+0000 7f5a30652640 1 --2- 172.21.15.81:0/4207615302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 0x7f5a200e2a40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f5a280511b0 tx=0x7f5a28076fa0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f5a30652640 1 -- 172.21.15.81:0/4207615302 shutdown_connections 2024-09-17T05:18:57.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f5a30652640 1 --2- 172.21.15.81:0/4207615302 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 0x7f5a200e2a40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f5a30652640 1 --2- 172.21.15.81:0/4207615302 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a2003b9e0 0x7f5a200e2500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f5a30652640 1 -- 172.21.15.81:0/4207615302 >> 172.21.15.81:0/4207615302 conn(0x7f5a2000e1e0 msgr2=0x7f5a2000e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f5a30652640 1 -- 172.21.15.81:0/4207615302 shutdown_connections 2024-09-17T05:18:57.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f5a30652640 1 -- 172.21.15.81:0/4207615302 wait complete. 2024-09-17T05:18:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f3bd370e640 1 -- 172.21.15.81:0/3100267403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3bcc151370 msgr2=0x7f3bcc0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f3bd370e640 1 --2- 172.21.15.81:0/3100267403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3bcc151370 0x7f3bcc0cef30 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3bc8005fd0 tx=0x7f3bc802c970 comp rx=0 tx=0).stop 2024-09-17T05:18:57.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f3bd370e640 1 -- 172.21.15.81:0/3100267403 shutdown_connections 2024-09-17T05:18:57.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f3bd370e640 1 --2- 172.21.15.81:0/3100267403 >> v2:172.21.15.81:3300/0 conn(0x7f3bcc072cb0 0x7f3bcc0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 -- 172.21.15.81:0/1987393626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34fc053260 msgr2=0x7f34fc050dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 --2- 172.21.15.81:0/1987393626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34fc053260 0x7f34fc050dc0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3500009830 tx=0x7f350002a440 comp rx=0 tx=0).stop 2024-09-17T05:18:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f3bd370e640 1 --2- 172.21.15.81:0/3100267403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3bcc151370 0x7f3bcc0cef30 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f3bd370e640 1 -- 172.21.15.81:0/3100267403 >> 172.21.15.81:0/3100267403 conn(0x7f3bcc0b1690 msgr2=0x7f3bcc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.274+0000 7f3bd370e640 1 -- 172.21.15.81:0/3100267403 shutdown_connections 2024-09-17T05:18:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 -- 172.21.15.81:0/1987393626 shutdown_connections 2024-09-17T05:18:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 --2- 172.21.15.81:0/1987393626 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34fc0359e0 0x7f34fc0e23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 --2- 172.21.15.81:0/1987393626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34fc053260 0x7f34fc050dc0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 -- 172.21.15.81:0/1987393626 >> 172.21.15.81:0/1987393626 conn(0x7f34fc01f980 msgr2=0x7f34fc056770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 -- 172.21.15.81:0/1987393626 shutdown_connections 2024-09-17T05:18:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f3bd370e640 1 -- 172.21.15.81:0/3100267403 wait complete. 2024-09-17T05:18:57.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f5a30652640 1 Processor -- start 2024-09-17T05:18:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 -- 172.21.15.81:0/2194778789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f144415d9f0 msgr2=0x7f144415dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 --2- 172.21.15.81:0/2194778789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f144415d9f0 0x7f144415dea0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f1434009830 tx=0x7f143402a540 comp rx=0 tx=0).stop 2024-09-17T05:18:57.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f5a30652640 1 -- start start 2024-09-17T05:18:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 -- 172.21.15.81:0/2194778789 shutdown_connections 2024-09-17T05:18:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 --2- 172.21.15.81:0/2194778789 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f144415d9f0 0x7f144415dea0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 --2- 172.21.15.81:0/2194778789 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14440b1080 0x7f14440d0980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 -- 172.21.15.81:0/2194778789 >> 172.21.15.81:0/2194778789 conn(0x7f14440731d0 msgr2=0x7f1444074080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 -- 172.21.15.81:0/2194778789 shutdown_connections 2024-09-17T05:18:57.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.276+0000 7f144b0cf640 1 -- 172.21.15.81:0/2194778789 wait complete. 2024-09-17T05:18:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f120f59e640 1 -- 172.21.15.81:0/2867696607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080e31e0 msgr2=0x7f1208035ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f120f59e640 1 --2- 172.21.15.81:0/2867696607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080e31e0 0x7f1208035ee0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f120800d8a0 tx=0x7f120402a5a0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.275+0000 7f350a0c2640 1 -- 172.21.15.81:0/1987393626 wait complete. 2024-09-17T05:18:57.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f350a0c2640 1 Processor -- start 2024-09-17T05:18:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f3bd370e640 1 Processor -- start 2024-09-17T05:18:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f5a30652640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a2003b9e0 0x7f5a200e4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f120f59e640 1 -- 172.21.15.81:0/2867696607 shutdown_connections 2024-09-17T05:18:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f120f59e640 1 --2- 172.21.15.81:0/2867696607 >> v2:172.21.15.160:3300/0 conn(0x7f12080351b0 0x7f1208036420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f120f59e640 1 --2- 172.21.15.81:0/2867696607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080e31e0 0x7f1208035ee0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f120f59e640 1 --2- 172.21.15.81:0/2867696607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12080e2e00 0x7f1208033e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f120f59e640 1 -- 172.21.15.81:0/2867696607 >> 172.21.15.81:0/2867696607 conn(0x7f120801d770 msgr2=0x7f1208054560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f350a0c2640 1 -- start start 2024-09-17T05:18:57.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.277+0000 7f144b0cf640 1 Processor -- start 2024-09-17T05:18:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f144b0cf640 1 -- start start 2024-09-17T05:18:57.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f3bd370e640 1 -- start start 2024-09-17T05:18:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a30652640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 0x7f5a20185e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a30652640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a200e6530 0x7f5a200e2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a2e3ee640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a2003b9e0 0x7f5a200e4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a2e3ee640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a2003b9e0 0x7f5a200e4b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52006/0 (socket says 172.21.15.81:52006) 2024-09-17T05:18:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a2dbed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 0x7f5a20185e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a2dbed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 0x7f5a20185e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:36640/0 (socket says 172.21.15.81:36640) 2024-09-17T05:18:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f9632c95640 1 -- 172.21.15.81:0/457402705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962400ba30 msgr2=0x7f9624036010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f9632c95640 1 --2- 172.21.15.81:0/457402705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962400ba30 0x7f9624036010 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f96200098e0 tx=0x7f962002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a2e3ee640 1 -- 172.21.15.81:0/3545978227 learned_addr learned my addr 172.21.15.81:0/3545978227 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5a200e6e80 con 0x7f5a200e6530 2024-09-17T05:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2116566675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc494036550 msgr2=0x7fc4940e25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7fc4a2bc6640 1 --2- 172.21.15.81:0/2116566675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc494036550 0x7fc4940e25b0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc494047fe0 tx=0x7fc49002a510 comp rx=0 tx=0).stop 2024-09-17T05:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f885759e640 1 -- 172.21.15.81:0/598462848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858072e10 msgr2=0x7f885806e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f885759e640 1 --2- 172.21.15.81:0/598462848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858072e10 0x7f885806e8c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f8850005fd0 tx=0x7f885002c840 comp rx=0 tx=0).stop 2024-09-17T05:18:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2116566675 shutdown_connections 2024-09-17T05:18:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7fc4a2bc6640 1 --2- 172.21.15.81:0/2116566675 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc494036550 0x7fc4940e25b0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f120f59e640 1 -- 172.21.15.81:0/2867696607 shutdown_connections 2024-09-17T05:18:57.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7fc4a2bc6640 1 --2- 172.21.15.81:0/2116566675 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc494005a90 0x7fc494036010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7fc4a2bc6640 1 --2- 172.21.15.81:0/2116566675 >> v2:172.21.15.81:3300/0 conn(0x7fc49401c8c0 0x7fc49401cca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2116566675 >> 172.21.15.81:0/2116566675 conn(0x7fc494054590 msgr2=0x7fc494054970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f9632c95640 1 -- 172.21.15.81:0/457402705 shutdown_connections 2024-09-17T05:18:57.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f9632c95640 1 --2- 172.21.15.81:0/457402705 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9624005a90 0x7f9624036550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f9632c95640 1 --2- 172.21.15.81:0/457402705 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962400ba30 0x7f9624036010 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f9632c95640 1 -- 172.21.15.81:0/457402705 >> 172.21.15.81:0/457402705 conn(0x7f9624054590 msgr2=0x7f9624054970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2116566675 shutdown_connections 2024-09-17T05:18:57.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f350a0c2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34fc0359e0 0x7f34fc039b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5a200e6d00 con 0x7f5a2003be30 2024-09-17T05:18:57.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f9632c95640 1 -- 172.21.15.81:0/457402705 shutdown_connections 2024-09-17T05:18:57.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f350a0c2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34fc053260 0x7f34fc185d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f9632c95640 1 -- 172.21.15.81:0/457402705 wait complete. 2024-09-17T05:18:57.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.278+0000 7f5a2ebef640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a200e6530 0x7f5a200e2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f350a0c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34fc053640 0x7f34fc03bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f885759e640 1 -- 172.21.15.81:0/598462848 shutdown_connections 2024-09-17T05:18:57.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5a200e7000 con 0x7f5a2003b9e0 2024-09-17T05:18:57.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f885759e640 1 --2- 172.21.15.81:0/598462848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8858072e10 0x7f885806e8c0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f885759e640 1 --2- 172.21.15.81:0/598462848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f885815d1b0 0x7f885815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f885759e640 1 -- 172.21.15.81:0/598462848 >> 172.21.15.81:0/598462848 conn(0x7f885806cb40 msgr2=0x7f885806cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f144b0cf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14440b1080 0x7f1444158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f144b0cf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14440b1460 0x7f144409d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f144b0cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f144415d9f0 0x7f1444161a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f144b0cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14440b19e0 con 0x7f144415d9f0 2024-09-17T05:18:57.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f144b0cf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14440b1860 con 0x7f14440b1080 2024-09-17T05:18:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f144b0cf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f14440ad020 con 0x7f14440b1460 2024-09-17T05:18:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f885759e640 1 -- 172.21.15.81:0/598462848 shutdown_connections 2024-09-17T05:18:57.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2116566675 wait complete. 2024-09-17T05:18:57.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f885759e640 1 -- 172.21.15.81:0/598462848 wait complete. 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f1443fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14440b1460 0x7f144409d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f1443fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14440b1460 0x7f144409d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52026/0 (socket says 172.21.15.81:52026) 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f1443fff640 1 -- 172.21.15.81:0/924911209 learned_addr learned my addr 172.21.15.81:0/924911209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f144966c640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f144415d9f0 0x7f1444161a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f1448e6b640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14440b1080 0x7f1444158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f144966c640 1 -- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14440b1460 msgr2=0x7f144409d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f144966c640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14440b1460 0x7f144409d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f144966c640 1 -- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14440b1080 msgr2=0x7f1444158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f144966c640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14440b1080 0x7f1444158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f144966c640 1 -- 172.21.15.81:0/924911209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f144415eaa0 con 0x7f144415d9f0 2024-09-17T05:18:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f3bd370e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bcc072cb0 0x7f3bcc14c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f3bd370e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3bcc0b3140 0x7f3bcc14b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f3bd370e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bcc151370 0x7f3bcc14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f3bd370e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3bcc06ec10 con 0x7f3bcc072cb0 2024-09-17T05:18:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f3bd370e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3bcc06ea90 con 0x7f3bcc151370 2024-09-17T05:18:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f3bd370e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3bcc06f9f0 con 0x7f3bcc0b3140 2024-09-17T05:18:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f144966c640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f144415d9f0 0x7f1444161a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1434031000 tx=0x7f1434033ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f5a2ebef640 1 -- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a2003b9e0 msgr2=0x7f5a200e4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f120f59e640 1 -- 172.21.15.81:0/2867696607 wait complete. 2024-09-17T05:18:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f5a2ebef640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5a2003b9e0 0x7f5a200e4b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f5a2ebef640 1 -- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 msgr2=0x7f5a20185e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f5a2ebef640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5a2003be30 0x7f5a20185e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f5a2ebef640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a200dc310 con 0x7f5a200e6530 2024-09-17T05:18:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f5a2ebef640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a200e6530 0x7f5a200e2260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5a28069f20 tx=0x7f5a280aea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a280b3040 con 0x7f5a200e6530 2024-09-17T05:18:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5a280aeb70 con 0x7f5a200e6530 2024-09-17T05:18:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a280b7430 con 0x7f5a200e6530 2024-09-17T05:18:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f120f59e640 1 Processor -- start 2024-09-17T05:18:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7fc4a2bc6640 1 Processor -- start 2024-09-17T05:18:57.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f35088bf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34fc053260 0x7f34fc185d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f35090c0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34fc0359e0 0x7f34fc039b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f35090c0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34fc0359e0 0x7f34fc039b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52012/0 (socket says 172.21.15.81:52012) 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.279+0000 7f35088bf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34fc053260 0x7f34fc185d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:36654/0 (socket says 172.21.15.81:36654) 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f35090c0640 1 -- 172.21.15.81:0/1172595099 learned_addr learned my addr 172.21.15.81:0/1172595099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f350a0c2640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc035820 con 0x7f34fc053640 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f350a0c2640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f34fc0356a0 con 0x7f34fc053260 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f35098c1640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34fc053640 0x7f34fc03bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f350a0c2640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f34fc007d50 con 0x7f34fc0359e0 2024-09-17T05:18:57.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd14aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bcc072cb0 0x7f3bcc14c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd14aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bcc072cb0 0x7f3bcc14c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38526/0 (socket says 172.21.15.81:38526) 2024-09-17T05:18:57.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd14aa640 1 -- 172.21.15.81:0/3485184239 learned_addr learned my addr 172.21.15.81:0/3485184239 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f120f59e640 1 -- start start 2024-09-17T05:18:57.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434031b50 con 0x7f144415d9f0 2024-09-17T05:18:57.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f9632c95640 1 Processor -- start 2024-09-17T05:18:57.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd0ca9640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3bcc0b3140 0x7f3bcc14b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14440b5dc0 con 0x7f144415d9f0 2024-09-17T05:18:57.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f144409da20 con 0x7f144415d9f0 2024-09-17T05:18:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7fc4a2bc6640 1 -- start start 2024-09-17T05:18:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f35090c0640 1 -- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34fc053260 msgr2=0x7f34fc185d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f35090c0640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f34fc053260 0x7f34fc185d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f35090c0640 1 -- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34fc053640 msgr2=0x7f34fc03bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f35090c0640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f34fc053640 0x7f34fc03bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f35090c0640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34fc186290 con 0x7f34fc0359e0 2024-09-17T05:18:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f35090c0640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34fc0359e0 0x7f34fc039b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3500000c00 tx=0x7f3500003b00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f9632c95640 1 -- start start 2024-09-17T05:18:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd1cab640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bcc151370 0x7f3bcc14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd1cab640 1 -- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3bcc0b3140 msgr2=0x7f3bcc14b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd1cab640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3bcc0b3140 0x7f3bcc14b240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd1cab640 1 -- 172.21.15.81:0/3485184239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bcc072cb0 msgr2=0x7f3bcc14c120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd1cab640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3bcc072cb0 0x7f3bcc14c120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f3bd1cab640 1 -- 172.21.15.81:0/3485184239 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bcc14c660 con 0x7f3bcc151370 2024-09-17T05:18:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.280+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1434031de0 con 0x7f144415d9f0 2024-09-17T05:18:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1434005280 con 0x7f144415d9f0 2024-09-17T05:18:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.281+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a200dc5b0 con 0x7f5a200e6530 2024-09-17T05:18:57.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a200dcb70 con 0x7f5a200e6530 2024-09-17T05:18:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080351b0 0x7f12080336d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120f59e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12080e2e00 0x7f1208033c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120f59e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12080e31e0 0x7f120804bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120f59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1208053020 con 0x7f12080351b0 2024-09-17T05:18:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120f59e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1208052ea0 con 0x7f12080e2e00 2024-09-17T05:18:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120f59e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f12080531a0 con 0x7f12080e31e0 2024-09-17T05:18:57.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120ed9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12080e31e0 0x7f120804bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120ed9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12080e31e0 0x7f120804bf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52040/0 (socket says 172.21.15.81:52040) 2024-09-17T05:18:57.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f9632c95640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9624005a90 0x7f96240de100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f9632c95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962400ba30 0x7f9624180af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120ed9d640 1 -- 172.21.15.81:0/2386636162 learned_addr learned my addr 172.21.15.81:0/2386636162 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f120dd9b640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12080e2e00 0x7f1208033c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f9632c95640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f962401c650 0x7f96240df0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f885759e640 1 Processor -- start 2024-09-17T05:18:57.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7fc4a2bc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc494005a90 0x7fc49404a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7fc4a2bc6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49401c8c0 0x7fc494048ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7fc4a2bc6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc494036550 0x7fc4940eb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7fc4a2bc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4940e2af0 con 0x7fc494005a90 2024-09-17T05:18:57.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7fc4a2bc6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc49400bc40 con 0x7fc49401c8c0 2024-09-17T05:18:57.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7fc4a2bc6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc4940e2c70 con 0x7fc494036550 2024-09-17T05:18:57.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f885759e640 1 -- start start 2024-09-17T05:18:57.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f9632c95640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f962400a030 con 0x7f962400ba30 2024-09-17T05:18:57.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500037070 con 0x7f34fc0359e0 2024-09-17T05:18:57.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3500038040 con 0x7f34fc0359e0 2024-09-17T05:18:57.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3500005240 con 0x7f34fc0359e0 2024-09-17T05:18:57.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f350a0c2640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34fc186560 con 0x7f34fc0359e0 2024-09-17T05:18:57.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f350a0c2640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f34fc186b20 con 0x7f34fc0359e0 2024-09-17T05:18:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f9632c95640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9624009eb0 con 0x7f9624005a90 2024-09-17T05:18:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f9632c95640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f962400a1b0 con 0x7f962401c650 2024-09-17T05:18:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f120dd9b640 1 -- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12080e31e0 msgr2=0x7f120804bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f120dd9b640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12080e31e0 0x7f120804bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f120dd9b640 1 -- 172.21.15.81:0/2386636162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080351b0 msgr2=0x7f12080336d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f120dd9b640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12080351b0 0x7f12080336d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f120dd9b640 1 -- 172.21.15.81:0/2386636162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12080dbca0 con 0x7f12080e2e00 2024-09-17T05:18:57.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7fc49bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49401c8c0 0x7fc494048ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7fc4a1163640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc494036550 0x7fc4940eb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f9631232640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f962401c650 0x7f96240df0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f9631232640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f962401c650 0x7f96240df0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52058/0 (socket says 172.21.15.81:52058) 2024-09-17T05:18:57.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f9631232640 1 -- 172.21.15.81:0/2363548004 learned_addr learned my addr 172.21.15.81:0/2363548004 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7fc4a1163640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc494036550 0x7fc4940eb2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52050/0 (socket says 172.21.15.81:52050) 2024-09-17T05:18:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7fc4a1163640 1 -- 172.21.15.81:0/2360055833 learned_addr learned my addr 172.21.15.81:0/2360055833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7fc4a0962640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc494005a90 0x7fc49404a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f3bd1cab640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bcc151370 0x7f3bcc14f5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e940 tx=0x7f3bc400ee00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4004d20 con 0x7f3bcc151370 2024-09-17T05:18:57.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3bc400cb20 con 0x7f3bcc151370 2024-09-17T05:18:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3bc4005020 con 0x7f3bcc151370 2024-09-17T05:18:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.282+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bcc14a1a0 con 0x7f3bcc151370 2024-09-17T05:18:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f962bfff640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962400ba30 0x7f9624180af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.283+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bcc14a760 con 0x7f3bcc151370 2024-09-17T05:18:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5a20053880 con 0x7f5a200e6530 2024-09-17T05:18:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f9631232640 1 -- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9624005a90 msgr2=0x7f96240de100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-17T05:18:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f9631232640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9624005a90 0x7f96240de100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f9631232640 1 -- 172.21.15.81:0/2363548004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962400ba30 msgr2=0x7f9624180af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f9631232640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f962400ba30 0x7f9624180af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7fc49bfff640 1 -- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc494036550 msgr2=0x7fc4940eb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7fc49bfff640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc494036550 0x7fc4940eb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7fc49bfff640 1 -- 172.21.15.81:0/2360055833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc494005a90 msgr2=0x7fc49404a8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7fc49bfff640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc494005a90 0x7fc49404a8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7fc49bfff640 1 -- 172.21.15.81:0/2360055833 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc494049430 con 0x7fc49401c8c0 2024-09-17T05:18:57.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f120dd9b640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12080e2e00 0x7f1208033c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f120800d570 tx=0x7f1204031670 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f350a0c2640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f34fc0e1230 con 0x7f34fc0359e0 2024-09-17T05:18:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f9631232640 1 -- 172.21.15.81:0/2363548004 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f962404c620 con 0x7f962401c650 2024-09-17T05:18:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3bcc0725a0 con 0x7f3bcc151370 2024-09-17T05:18:57.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f885759e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885806e480 0x7f885813c330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7fc49bfff640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49401c8c0 0x7fc494048ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc48800d6d0 tx=0x7fc48800db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f885759e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8858072e10 0x7f88581f3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204040070 con 0x7f12080e2e00 2024-09-17T05:18:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1204003e50 con 0x7f12080e2e00 2024-09-17T05:18:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1204031c30 con 0x7f12080e2e00 2024-09-17T05:18:57.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f885659c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885806e480 0x7f885813c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f120804aa60 con 0x7f12080e2e00 2024-09-17T05:18:57.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f885659c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885806e480 0x7f885813c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:36724/0 (socket says 172.21.15.81:36724) 2024-09-17T05:18:57.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f885759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885815d1b0 0x7f885814b340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1208031100 con 0x7f12080e2e00 2024-09-17T05:18:57.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f8855d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8858072e10 0x7f88581f3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f8855d9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8858072e10 0x7f88581f3ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52068/0 (socket says 172.21.15.81:52068) 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f885659c640 1 -- 172.21.15.81:0/1612153264 learned_addr learned my addr 172.21.15.81:0/1612153264 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f885759e640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88580b33a0 con 0x7f885815d1b0 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f885759e640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f885806c7d0 con 0x7f885806e480 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f885759e640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f88580b3520 con 0x7f8858072e10 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.284+0000 7f9631232640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f962401c650 0x7f96240df0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f962c066670 tx=0x7f962c06c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c08f070 con 0x7f962401c650 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f962c0934a0 con 0x7f962401c650 2024-09-17T05:18:57.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f962c0938f0 con 0x7f962401c650 2024-09-17T05:18:57.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1424001030 con 0x7f144415d9f0 2024-09-17T05:18:57.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f8856d9d640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885815d1b0 0x7f885814b340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3bc40051c0 con 0x7f3bcc151370 2024-09-17T05:18:57.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96240e2140 con 0x7f962401c650 2024-09-17T05:18:57.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f962404cba0 con 0x7f962401c650 2024-09-17T05:18:57.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1434005420 con 0x7f144415d9f0 2024-09-17T05:18:57.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f8856d9d640 1 -- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8858072e10 msgr2=0x7f88581f3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f8856d9d640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8858072e10 0x7f88581f3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f8856d9d640 1 -- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885806e480 msgr2=0x7f885813c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f8856d9d640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f885806e480 0x7f885813c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f8856d9d640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f885814d560 con 0x7f885815d1b0 2024-09-17T05:18:57.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f3bc1ffb640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3bb0078ca0 0x7f3bb007b160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.285+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3500043020 con 0x7f34fc0359e0 2024-09-17T05:18:57.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f34f9ffb640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f34e8078c90 0x7f34e807b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f35000ba740 con 0x7f34fc0359e0 2024-09-17T05:18:57.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f34f9ffb640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f34e8080e30 0x7f34e8083250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f350000b0b0 con 0x7f34e8080e30 2024-09-17T05:18:57.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f35098c1640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f34e8080e30 0x7f34e8083250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488017070 con 0x7fc49401c8c0 2024-09-17T05:18:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3bc409b900 con 0x7f3bcc151370 2024-09-17T05:18:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f3bc1ffb640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7f3bb0080f20 0x7f3bb0083340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 --> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3bc401be50 con 0x7f3bb0080f20 2024-09-17T05:18:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f3bc409bcf0 con 0x7f3bcc151370 2024-09-17T05:18:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc488005310 con 0x7fc49401c8c0 2024-09-17T05:18:57.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f14417fa640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1430078c60 0x7f143007b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f3bd14aa640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3bb0078ca0 0x7f3bb007b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f14340bbd30 con 0x7f144415d9f0 2024-09-17T05:18:57.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.286+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f120801ded0 con 0x7f12080e2e00 2024-09-17T05:18:57.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f8856d9d640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885815d1b0 0x7f885814b340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8850009000 tx=0x7f8850035ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f3bd0ca9640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7f3bb0080f20 0x7f3bb0083340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f14417fa640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f1430080e60 0x7f1430083280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 --> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1430083930 con 0x7f1430080e60 2024-09-17T05:18:57.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f14340801e0 con 0x7f144415d9f0 2024-09-17T05:18:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f962401cae0 con 0x7f962401c650 2024-09-17T05:18:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f1443fff640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f1430080e60 0x7f1430083280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850044020 con 0x7f885815d1b0 2024-09-17T05:18:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f1448e6b640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1430078c60 0x7f143007b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488009820 con 0x7fc49401c8c0 2024-09-17T05:18:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f3bd14aa640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3bb0078ca0 0x7f3bb007b160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800a340 tx=0x7f3bc8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f1443fff640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f1430080e60 0x7f1430083280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8850004350 con 0x7f885815d1b0 2024-09-17T05:18:57.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8850039040 con 0x7f885815d1b0 2024-09-17T05:18:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f885759e640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88581f4400 con 0x7f885815d1b0 2024-09-17T05:18:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f885759e640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f885814dae0 con 0x7f885815d1b0 2024-09-17T05:18:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f962c092070 con 0x7f962401c650 2024-09-17T05:18:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f96297fa640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9610078c60 0x7f961007b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5a28064020 con 0x7f5a200e6530 2024-09-17T05:18:57.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f5a1effd640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5a0c078bc0 0x7f5a0c07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f1448e6b640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1430078c60 0x7f143007b120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f143c005fd0 tx=0x7f143c010040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f9630a31640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9610078c60 0x7f961007b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5a28136510 con 0x7f5a200e6530 2024-09-17T05:18:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f5a1effd640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7f5a0c080de0 0x7f5a0c083200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5a280bce80 con 0x7f5a0c080de0 2024-09-17T05:18:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f5a28136900 con 0x7f5a200e6530 2024-09-17T05:18:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f5a2e3ee640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5a0c078bc0 0x7f5a0c07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f5a2dbed640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7f5a0c080de0 0x7f5a0c083200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== osd.2 v2:172.21.15.81:6824/2317076562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1430083930 con 0x7f1430080e60 2024-09-17T05:18:57.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f5a2e3ee640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5a0c078bc0 0x7f5a0c07b080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099a0 tx=0x7f5a240090e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f5a2dbed640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7f5a0c080de0 0x7f5a0c083200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== osd.0 v2:172.21.15.81:6800/3882197778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5a280bce80 con 0x7f5a0c080de0 2024-09-17T05:18:57.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.287+0000 7f35098c1640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f34e8080e30 0x7f34e8083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f35000c1050 con 0x7f34fc0359e0 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f35088bf640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f34e8078c90 0x7f34e807b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== osd.1 v2:172.21.15.81:6816/2009991076 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f350000b0b0 con 0x7f34e8080e30 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f35088bf640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f34e8078c90 0x7f34e807b150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0dcf40 tx=0x7f34f4009260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.288+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1204043070 con 0x7f12080e2e00 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f11feffd640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11f0078c60 0x7f11f007b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f120e59c640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11f0078c60 0x7f11f007b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f12040bc030 con 0x7f12080e2e00 2024-09-17T05:18:57.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f962c115a60 con 0x7f962401c650 2024-09-17T05:18:57.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f11feffd640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7f11f0080e80 0x7f11f00832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 --> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1204045e50 con 0x7f11f0080e80 2024-09-17T05:18:57.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.289+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f12040c3050 con 0x7f12080e2e00 2024-09-17T05:18:57.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f9630a31640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9610078c60 0x7f961007b120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9620034000 tx=0x7f9620004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f96297fa640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7f9610080e80 0x7f96100832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 --> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f962c06fe50 con 0x7f9610080e80 2024-09-17T05:18:57.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f962c11a2a0 con 0x7f962401c650 2024-09-17T05:18:57.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f3bd0ca9640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7f3bb0080f20 0x7f3bb0083340 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc49404af70 con 0x7fc49401c8c0 2024-09-17T05:18:57.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f962bfff640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7f9610080e80 0x7f96100832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f885759e640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f885814e470 con 0x7f885815d1b0 2024-09-17T05:18:57.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4940df5e0 con 0x7fc49401c8c0 2024-09-17T05:18:57.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== osd.5 v2:172.21.15.160:6810/598189389 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3bc401be50 con 0x7f3bb0080f20 2024-09-17T05:18:57.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.291+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8850047020 con 0x7f885815d1b0 2024-09-17T05:18:57.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.290+0000 7f120e59c640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11f0078c60 0x7f11f007b120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1200009400 tx=0x7f1200009390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.291+0000 7f120ed9d640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7f11f0080e80 0x7f11f00832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.291+0000 7f8846ffd640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8838078c60 0x7f883807b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.291+0000 7f962bfff640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7f9610080e80 0x7f96100832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.291+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4940e3190 con 0x7fc49401c8c0 2024-09-17T05:18:57.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.291+0000 7f120ed9d640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7f11f0080e80 0x7f11f00832a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.291+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f88500bdac0 con 0x7f885815d1b0 2024-09-17T05:18:57.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f885659c640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8838078c60 0x7f883807b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f8846ffd640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f8838080ee0 0x7f8838083300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== osd.4 v2:172.21.15.160:6826/3841431636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f962c06fe50 con 0x7f9610080e80 2024-09-17T05:18:57.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f8855d9b640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f8838080ee0 0x7f8838083300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f88380839b0 con 0x7f8838080ee0 2024-09-17T05:18:57.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f88500c22a0 con 0x7f885815d1b0 2024-09-17T05:18:57.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== osd.7 v2:172.21.15.160:6802/2017118510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1204045e50 con 0x7f11f0080e80 2024-09-17T05:18:57.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7f885659c640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8838078c60 0x7f883807b120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8858154100 tx=0x7f884800b510 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.292+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc4880099c0 con 0x7fc49401c8c0 2024-09-17T05:18:57.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.293+0000 7fc4997fa640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc480078c60 0x7fc48007b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.293+0000 7f8855d9b640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f8838080ee0 0x7f8838083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.293+0000 7fc4a0962640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc480078c60 0x7fc48007b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.293+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc48809ad30 con 0x7fc49401c8c0 2024-09-17T05:18:57.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.294+0000 7fc4997fa640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7fc480080e80 0x7fc4800832a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.294+0000 7fc4a0962640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc480078c60 0x7fc48007b120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc49c06bed0 tx=0x7fc49c06f040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.294+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 --> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc488009e50 con 0x7fc480080e80 2024-09-17T05:18:57.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.294+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fc48809d5a0 con 0x7fc49401c8c0 2024-09-17T05:18:57.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.294+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== osd.3 v2:172.21.15.81:6808/437732864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f88380839b0 con 0x7f8838080ee0 2024-09-17T05:18:57.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.294+0000 7fc4a1163640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7fc480080e80 0x7fc4800832a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.295+0000 7fc4a1163640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7fc480080e80 0x7fc4800832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.295+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== osd.6 v2:172.21.15.160:6818/4274770585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc488009e50 con 0x7fc480080e80 2024-09-17T05:18:57.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.318+0000 7f350a0c2640 1 -- 172.21.15.81:0/1172595099 --> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f34fc038be0 con 0x7f34e8080e30 2024-09-17T05:18:57.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.319+0000 7f34f9ffb640 1 -- 172.21.15.81:0/1172595099 <== osd.1 v2:172.21.15.81:6816/2009991076 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f34fc038be0 con 0x7f34e8080e30 2024-09-17T05:18:57.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f34e77fe640 1 -- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f34e8080e30 msgr2=0x7f34e8083250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 --> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1424002dd0 con 0x7f1430080e60 2024-09-17T05:18:57.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f34e77fe640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f34e8080e30 0x7f34e8083250 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f34e77fe640 1 -- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f34e8078c90 msgr2=0x7f34e807b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f34e77fe640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f34e8078c90 0x7f34e807b150 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f34fc0dcf40 tx=0x7f34f4009260 comp rx=0 tx=0).stop 2024-09-17T05:18:57.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f34e77fe640 1 -- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34fc0359e0 msgr2=0x7f34fc039b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f34e77fe640 1 --2- 172.21.15.81:0/1172595099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f34fc0359e0 0x7f34fc039b80 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3500000c00 tx=0x7f3500003b00 comp rx=0 tx=0).stop 2024-09-17T05:18:57.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f35098c1640 1 -- 172.21.15.81:0/1172595099 reap_dead start 2024-09-17T05:18:57.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f14417fa640 1 -- 172.21.15.81:0/924911209 <== osd.2 v2:172.21.15.81:6824/2317076562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f1424002dd0 con 0x7f1430080e60 2024-09-17T05:18:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.320+0000 7f34e77fe640 1 -- 172.21.15.81:0/1172595099 shutdown_connections 2024-09-17T05:18:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f34e77fe640 1 -- 172.21.15.81:0/1172595099 >> 172.21.15.81:0/1172595099 conn(0x7f34fc01f980 msgr2=0x7f34fc036100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f34e77fe640 1 -- 172.21.15.81:0/1172595099 shutdown_connections 2024-09-17T05:18:57.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f34e77fe640 1 -- 172.21.15.81:0/1172595099 wait complete. 2024-09-17T05:18:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f1430080e60 msgr2=0x7f1430083280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f144b0cf640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f1430080e60 0x7f1430083280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 --> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5a20053880 con 0x7f5a0c080de0 2024-09-17T05:18:57.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 --> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3bcc0af7a0 con 0x7f3bb0080f20 2024-09-17T05:18:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1430078c60 msgr2=0x7f143007b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f144b0cf640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1430078c60 0x7f143007b120 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f143c005fd0 tx=0x7f143c010040 comp rx=0 tx=0).stop 2024-09-17T05:18:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f144415d9f0 msgr2=0x7f1444161a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f144b0cf640 1 --2- 172.21.15.81:0/924911209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f144415d9f0 0x7f1444161a70 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1434031000 tx=0x7f1434033ba0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f5a1effd640 1 -- 172.21.15.81:0/3545978227 <== osd.0 v2:172.21.15.81:6800/3882197778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f5a20053880 con 0x7f5a0c080de0 2024-09-17T05:18:57.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f144966c640 1 -- 172.21.15.81:0/924911209 reap_dead start 2024-09-17T05:18:57.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.321+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 --> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f12080e1bd0 con 0x7f11f0080e80 2024-09-17T05:18:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 shutdown_connections 2024-09-17T05:18:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 >> 172.21.15.81:0/924911209 conn(0x7f14440731d0 msgr2=0x7f144415cdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 shutdown_connections 2024-09-17T05:18:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f144b0cf640 1 -- 172.21.15.81:0/924911209 wait complete. 2024-09-17T05:18:57.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f3bc1ffb640 1 -- 172.21.15.81:0/3485184239 <== osd.5 v2:172.21.15.160:6810/598189389 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f3bcc0af7a0 con 0x7f3bb0080f20 2024-09-17T05:18:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7f5a0c080de0 msgr2=0x7f5a0c083200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7f5a0c080de0 0x7f5a0c083200 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5a0c078bc0 msgr2=0x7f5a0c07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5a0c078bc0 0x7f5a0c07b080 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f5a240099a0 tx=0x7f5a240090e0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a200e6530 msgr2=0x7f5a200e2260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 --2- 172.21.15.81:0/3545978227 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5a200e6530 0x7f5a200e2260 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f5a28069f20 tx=0x7f5a280aea00 comp rx=0 tx=0).stop 2024-09-17T05:18:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a2ebef640 1 -- 172.21.15.81:0/3545978227 reap_dead start 2024-09-17T05:18:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 shutdown_connections 2024-09-17T05:18:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 >> 172.21.15.81:0/3545978227 conn(0x7f5a2000e1e0 msgr2=0x7f5a200de320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7f3bb0080f20 msgr2=0x7f3bb0083340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f3bd370e640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7f3bb0080f20 0x7f3bb0083340 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f11feffd640 1 -- 172.21.15.81:0/2386636162 <== osd.7 v2:172.21.15.160:6802/2017118510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f12080e1bd0 con 0x7f11f0080e80 2024-09-17T05:18:57.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 shutdown_connections 2024-09-17T05:18:57.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 --> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f962401d9d0 con 0x7f9610080e80 2024-09-17T05:18:57.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f5a30652640 1 -- 172.21.15.81:0/3545978227 wait complete. 2024-09-17T05:18:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3bb0078ca0 msgr2=0x7f3bb007b160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f3bd370e640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3bb0078ca0 0x7f3bb007b160 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f3bc800a340 tx=0x7f3bc8004730 comp rx=0 tx=0).stop 2024-09-17T05:18:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bcc151370 msgr2=0x7f3bcc14f5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.322+0000 7f3bd370e640 1 --2- 172.21.15.81:0/3485184239 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3bcc151370 0x7f3bcc14f5a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3bc400e940 tx=0x7f3bc400ee00 comp rx=0 tx=0).stop 2024-09-17T05:18:57.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f3bd1cab640 1 -- 172.21.15.81:0/3485184239 reap_dead start 2024-09-17T05:18:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f96297fa640 1 -- 172.21.15.81:0/2363548004 <== osd.4 v2:172.21.15.160:6826/3841431636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f962401d9d0 con 0x7f9610080e80 2024-09-17T05:18:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 shutdown_connections 2024-09-17T05:18:57.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 >> 172.21.15.81:0/3485184239 conn(0x7f3bcc0b1690 msgr2=0x7f3bcc0affa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7f11f0080e80 msgr2=0x7f11f00832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f120f59e640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7f11f0080e80 0x7f11f00832a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 shutdown_connections 2024-09-17T05:18:57.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11f0078c60 msgr2=0x7f11f007b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.323+0000 7f3bd370e640 1 -- 172.21.15.81:0/3485184239 wait complete. 2024-09-17T05:18:57.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f120f59e640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11f0078c60 0x7f11f007b120 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f1200009400 tx=0x7f1200009390 comp rx=0 tx=0).stop 2024-09-17T05:18:57.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12080e2e00 msgr2=0x7f1208033c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f120f59e640 1 --2- 172.21.15.81:0/2386636162 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12080e2e00 0x7f1208033c10 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f120800d570 tx=0x7f1204031670 comp rx=0 tx=0).stop 2024-09-17T05:18:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f120ed9d640 1 -- 172.21.15.81:0/2386636162 reap_dead start 2024-09-17T05:18:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7f9610080e80 msgr2=0x7f96100832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7f9610080e80 0x7f96100832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9610078c60 msgr2=0x7f961007b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9610078c60 0x7f961007b120 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f9620034000 tx=0x7f9620004730 comp rx=0 tx=0).stop 2024-09-17T05:18:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f962401c650 msgr2=0x7f96240df0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 --2- 172.21.15.81:0/2363548004 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f962401c650 0x7f96240df0b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f962c066670 tx=0x7f962c06c910 comp rx=0 tx=0).stop 2024-09-17T05:18:57.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f885759e640 1 -- 172.21.15.81:0/1612153264 --> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8858148d30 con 0x7f8838080ee0 2024-09-17T05:18:57.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 shutdown_connections 2024-09-17T05:18:57.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 >> 172.21.15.81:0/2386636162 conn(0x7f120801d770 msgr2=0x7f12080e20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9631232640 1 -- 172.21.15.81:0/2363548004 reap_dead start 2024-09-17T05:18:57.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 shutdown_connections 2024-09-17T05:18:57.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 shutdown_connections 2024-09-17T05:18:57.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.324+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 >> 172.21.15.81:0/2363548004 conn(0x7f9624054590 msgr2=0x7f9624054970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8846ffd640 1 -- 172.21.15.81:0/1612153264 <== osd.3 v2:172.21.15.81:6808/437732864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8858148d30 con 0x7f8838080ee0 2024-09-17T05:18:57.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f120f59e640 1 -- 172.21.15.81:0/2386636162 wait complete. 2024-09-17T05:18:57.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 shutdown_connections 2024-09-17T05:18:57.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f9632c95640 1 -- 172.21.15.81:0/2363548004 wait complete. 2024-09-17T05:18:57.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 --> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fc49401d9d0 con 0x7fc480080e80 2024-09-17T05:18:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8844ff9640 1 -- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f8838080ee0 msgr2=0x7f8838083300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8844ff9640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f8838080ee0 0x7f8838083300 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8844ff9640 1 -- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8838078c60 msgr2=0x7f883807b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8844ff9640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8838078c60 0x7f883807b120 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8858154100 tx=0x7f884800b510 comp rx=0 tx=0).stop 2024-09-17T05:18:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8844ff9640 1 -- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885815d1b0 msgr2=0x7f885814b340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8844ff9640 1 --2- 172.21.15.81:0/1612153264 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f885815d1b0 0x7f885814b340 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8850009000 tx=0x7f8850035ec0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7f8856d9d640 1 -- 172.21.15.81:0/1612153264 reap_dead start 2024-09-17T05:18:57.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.325+0000 7fc4997fa640 1 -- 172.21.15.81:0/2360055833 <== osd.6 v2:172.21.15.160:6818/4274770585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fc49401d9d0 con 0x7fc480080e80 2024-09-17T05:18:57.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7fc480080e80 msgr2=0x7fc4800832a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7fc480080e80 0x7fc4800832a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc480078c60 msgr2=0x7fc48007b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc480078c60 0x7fc48007b120 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fc49c06bed0 tx=0x7fc49c06f040 comp rx=0 tx=0).stop 2024-09-17T05:18:57.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49401c8c0 msgr2=0x7fc494048ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 --2- 172.21.15.81:0/2360055833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc49401c8c0 0x7fc494048ef0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fc48800d6d0 tx=0x7fc48800db90 comp rx=0 tx=0).stop 2024-09-17T05:18:57.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a1163640 1 -- 172.21.15.81:0/2360055833 reap_dead start 2024-09-17T05:18:57.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 shutdown_connections 2024-09-17T05:18:57.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.326+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 >> 172.21.15.81:0/2360055833 conn(0x7fc494054590 msgr2=0x7fc49400a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.327+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 shutdown_connections 2024-09-17T05:18:57.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.327+0000 7f8844ff9640 1 -- 172.21.15.81:0/1612153264 shutdown_connections 2024-09-17T05:18:57.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.327+0000 7f8844ff9640 1 -- 172.21.15.81:0/1612153264 >> 172.21.15.81:0/1612153264 conn(0x7f885806cb40 msgr2=0x7f885814a670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.327+0000 7fc4a2bc6640 1 -- 172.21.15.81:0/2360055833 wait complete. 2024-09-17T05:18:57.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.327+0000 7f8844ff9640 1 -- 172.21.15.81:0/1612153264 shutdown_connections 2024-09-17T05:18:57.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.327+0000 7f8844ff9640 1 -- 172.21.15.81:0/1612153264 wait complete. 2024-09-17T05:18:57.390 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:57.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-17T05:18:57.392 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-17T05:18:57.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-17T05:18:57.394 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-09-17T05:18:57.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-17T05:18:57.395 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:57.396 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-09-17T05:18:57.397 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-17T05:18:57.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-09-17T05:18:57.399 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:57.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-09-17T05:18:57.401 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-17T05:18:57.401 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-09-17T05:18:57.403 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:57.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-17T05:18:57.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 -- 172.21.15.81:0/1575061782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0b5530 msgr2=0x7f5eec0b59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 --2- 172.21.15.81:0/1575061782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0b5530 0x7f5eec0b59c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f5eec0cc040 tx=0x7f5ee402aa10 comp rx=0 tx=0).stop 2024-09-17T05:18:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 -- 172.21.15.81:0/1575061782 shutdown_connections 2024-09-17T05:18:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 --2- 172.21.15.81:0/1575061782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0b5530 0x7f5eec0b59c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 --2- 172.21.15.81:0/1575061782 >> v2:172.21.15.81:3300/0 conn(0x7f5eec0ce280 0x7f5eec0d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 -- 172.21.15.81:0/1575061782 >> 172.21.15.81:0/1575061782 conn(0x7f5eec0d1a60 msgr2=0x7f5eec0d1e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 -- 172.21.15.81:0/1575061782 shutdown_connections 2024-09-17T05:18:57.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.604+0000 7f0056ffd640 1 -- 172.21.15.81:0/3157926690 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c032bf0 con 0x7f005001c890 2024-09-17T05:18:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.604+0000 7f9c5affd640 1 -- 172.21.15.81:0/2457729007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c4c02fe00 con 0x7f9c5c13ce00 2024-09-17T05:18:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 -- 172.21.15.81:0/2457729007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c13ce00 msgr2=0x7f9c5c0725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 --2- 172.21.15.81:0/2457729007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0725a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c005fd0 tx=0x7f9c4c02aa00 comp rx=0 tx=0).stop 2024-09-17T05:18:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 -- 172.21.15.81:0/2457729007 shutdown_connections 2024-09-17T05:18:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 --2- 172.21.15.81:0/2457729007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c5c070690 0x7f9c5c13f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 --2- 172.21.15.81:0/2457729007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0725a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 -- 172.21.15.81:0/2457729007 >> 172.21.15.81:0/2457729007 conn(0x7f9c5c0b1690 msgr2=0x7f9c5c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.603+0000 7f5ef4784640 1 -- 172.21.15.81:0/1575061782 wait complete. 2024-09-17T05:18:57.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 -- 172.21.15.81:0/2457729007 shutdown_connections 2024-09-17T05:18:57.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.604+0000 7f005e916640 1 -- 172.21.15.81:0/3157926690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f005001c890 msgr2=0x7f005001cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.604+0000 7f005e916640 1 --2- 172.21.15.81:0/3157926690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f005001c890 0x7f005001cc70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f004c009850 tx=0x7f004c02b570 comp rx=0 tx=0).stop 2024-09-17T05:18:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.604+0000 7f005e916640 1 -- 172.21.15.81:0/3157926690 shutdown_connections 2024-09-17T05:18:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.604+0000 7f005e916640 1 --2- 172.21.15.81:0/3157926690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f005001c890 0x7f005001cc70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.604+0000 7f005e916640 1 -- 172.21.15.81:0/3157926690 >> 172.21.15.81:0/3157926690 conn(0x7f0050054560 msgr2=0x7f0050054940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f005e916640 1 -- 172.21.15.81:0/3157926690 shutdown_connections 2024-09-17T05:18:57.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f9c61f3d640 1 -- 172.21.15.81:0/2457729007 wait complete. 2024-09-17T05:18:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f005e916640 1 -- 172.21.15.81:0/3157926690 wait complete. 2024-09-17T05:18:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.605+0000 7f6f7559a640 1 -- 172.21.15.81:0/2050570939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70036400 con 0x7f6f78072ac0 2024-09-17T05:18:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f5ef4784640 1 Processor -- start 2024-09-17T05:18:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f6f7c99c640 1 -- 172.21.15.81:0/2050570939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f78072ac0 msgr2=0x7f6f78072f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/2050570939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f78072ac0 0x7f6f78072f70 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6f70005fd0 tx=0x7f6f7002ab00 comp rx=0 tx=0).stop 2024-09-17T05:18:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f6f7c99c640 1 -- 172.21.15.81:0/2050570939 shutdown_connections 2024-09-17T05:18:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/2050570939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f78072ac0 0x7f6f78072f70 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/2050570939 >> v2:172.21.15.160:3300/0 conn(0x7f6f7815e060 0x7f6f7806f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f6f7c99c640 1 -- 172.21.15.81:0/2050570939 >> 172.21.15.81:0/2050570939 conn(0x7f6f780b1bb0 msgr2=0x7f6f780b1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f3efb59e640 1 -- 172.21.15.81:0/2200351695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ee4003a00 msgr2=0x7f3ee4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f6f7c99c640 1 -- 172.21.15.81:0/2050570939 shutdown_connections 2024-09-17T05:18:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f3efb59e640 1 --2- 172.21.15.81:0/2200351695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ee4003a00 0x7f3ee4003e20 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f3eec01d320 tx=0x7f3ee4005830 comp rx=0 tx=0).stop 2024-09-17T05:18:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.606+0000 7f3efad9d640 1 -- 172.21.15.81:0/2200351695 reap_dead start 2024-09-17T05:18:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f3efb59e640 1 -- 172.21.15.81:0/2200351695 shutdown_connections 2024-09-17T05:18:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f3efb59e640 1 -- 172.21.15.81:0/2200351695 >> 172.21.15.81:0/2200351695 conn(0x7f3efc0b1440 msgr2=0x7f3efc0b1820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f6f7c99c640 1 -- 172.21.15.81:0/2050570939 wait complete. 2024-09-17T05:18:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f9c61f3d640 1 Processor -- start 2024-09-17T05:18:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f5ef4784640 1 -- start start 2024-09-17T05:18:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f9c61f3d640 1 -- start start 2024-09-17T05:18:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f005e916640 1 Processor -- start 2024-09-17T05:18:57.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f3efb59e640 1 -- 172.21.15.81:0/2200351695 shutdown_connections 2024-09-17T05:18:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.607+0000 7f3efb59e640 1 -- 172.21.15.81:0/2200351695 wait complete. 2024-09-17T05:18:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f005e916640 1 -- start start 2024-09-17T05:18:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f5ef4784640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eec0b5530 0x7f5eec149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f5ef4784640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5eec0ce280 0x7f5eec0c7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f5ef4784640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0d2610 0x7f5eec0718a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f5ef4784640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec0b6450 con 0x7f5eec0b5530 2024-09-17T05:18:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f5ef4784640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5eec0b62d0 con 0x7f5eec0d2610 2024-09-17T05:18:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f5ef4784640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5eec0b65d0 con 0x7f5eec0ce280 2024-09-17T05:18:57.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7fca414ec640 1 -- 172.21.15.81:0/265703519 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24031bf0 con 0x7fca3c0cdcf0 2024-09-17T05:18:57.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f9c61f3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c070690 0x7f9c5c0cd1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f9c61f3d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c5c072ae0 0x7f9c5c0b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f9c61f3d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f9c61f3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c164e30 con 0x7f9c5c070690 2024-09-17T05:18:57.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7f9c61f3d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c164cb0 con 0x7f9c5c13ce00 2024-09-17T05:18:57.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c61f3d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5c164fb0 con 0x7f9c5c072ae0 2024-09-17T05:18:57.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0b3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:36776/0 (socket says 172.21.15.81:36776) 2024-09-17T05:18:57.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 -- 172.21.15.81:0/2232248135 learned_addr learned my addr 172.21.15.81:0/2232248135 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f6f7c99c640 1 Processor -- start 2024-09-17T05:18:57.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f6f7c99c640 1 -- start start 2024-09-17T05:18:57.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c52ffd640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c5c072ae0 0x7f9c5c0b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f005e916640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0050005a60 0x7f005004d970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f1a52e94640 1 -- 172.21.15.81:0/1158060531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c161ee0 msgr2=0x7f1a4c162370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f5ef2520640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eec0b5530 0x7f5eec149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f5ef2520640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eec0b5530 0x7f5eec149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38614/0 (socket says 172.21.15.81:38614) 2024-09-17T05:18:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f5ef2520640 1 -- 172.21.15.81:0/2143998756 learned_addr learned my addr 172.21.15.81:0/2143998756 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fca434f0640 1 -- 172.21.15.81:0/265703519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c0cdcf0 msgr2=0x7fca3c15ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fca434f0640 1 --2- 172.21.15.81:0/265703519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c0cdcf0 0x7fca3c15ef40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fca24009860 tx=0x7fca2402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f005e916640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005001c890 0x7f005004b5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f005e916640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00500366f0 0x7f0050046c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f5ef2d21640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0d2610 0x7f5eec0718a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 -- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c5c072ae0 msgr2=0x7f9c5c0b39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c5c072ae0 0x7f9c5c0b39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 -- 172.21.15.81:0/2232248135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c070690 msgr2=0x7f9c5c0cd1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c070690 0x7f9c5c0cd1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 -- 172.21.15.81:0/2232248135 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5c0cee70 con 0x7f9c5c13ce00 2024-09-17T05:18:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7fa0542a9640 1 -- 172.21.15.81:0/3792892004 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c06d190 msgr2=0x7fa04c073340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.608+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3792892004 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c06d190 0x7fa04c073340 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009860 tx=0x7fa03c02a590 comp rx=0 tx=0).stop 2024-09-17T05:18:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fa0542a9640 1 -- 172.21.15.81:0/3792892004 shutdown_connections 2024-09-17T05:18:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3792892004 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c06d190 0x7fa04c073340 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fa0542a9640 1 -- 172.21.15.81:0/3792892004 >> 172.21.15.81:0/3792892004 conn(0x7fa04c0b1540 msgr2=0x7fa04c0b1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fa0542a9640 1 -- 172.21.15.81:0/3792892004 shutdown_connections 2024-09-17T05:18:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f0057fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0050005a60 0x7f005004d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f1a50e90640 1 -- 172.21.15.81:0/1158060531 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44031640 con 0x7f1a4c161ee0 2024-09-17T05:18:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f005e916640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f005000a2e0 con 0x7f005001c890 2024-09-17T05:18:57.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f1a52e94640 1 --2- 172.21.15.81:0/1158060531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c161ee0 0x7f1a4c162370 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f1a44005fd0 tx=0x7f1a4402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fca434f0640 1 -- 172.21.15.81:0/265703519 shutdown_connections 2024-09-17T05:18:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fca434f0640 1 --2- 172.21.15.81:0/265703519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c0cdcf0 0x7fca3c15ef40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7fca434f0640 1 -- 172.21.15.81:0/265703519 >> 172.21.15.81:0/265703519 conn(0x7fca3c0b1540 msgr2=0x7fca3c0b1950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f005e916640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f005000a160 con 0x7f00500366f0 2024-09-17T05:18:57.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f005e916640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f005000a460 con 0x7f0050005a60 2024-09-17T05:18:57.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f1a52e94640 1 -- 172.21.15.81:0/1158060531 shutdown_connections 2024-09-17T05:18:57.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f1a52e94640 1 --2- 172.21.15.81:0/1158060531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c161ee0 0x7f1a4c162370 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f1a52e94640 1 --2- 172.21.15.81:0/1158060531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c15df80 0x7f1a4c0afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f1a52e94640 1 -- 172.21.15.81:0/1158060531 >> 172.21.15.81:0/1158060531 conn(0x7f1a4c0d0cd0 msgr2=0x7f1a4c0d10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:57.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f9c5bfff640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0b3f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400d720 tx=0x7f9c5400dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.609+0000 7f3efb59e640 1 Processor -- start 2024-09-17T05:18:57.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f3efb59e640 1 -- start start 2024-09-17T05:18:57.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ef2d21640 1 -- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5eec0ce280 msgr2=0x7f5eec0c7900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f1a52e94640 1 -- 172.21.15.81:0/1158060531 shutdown_connections 2024-09-17T05:18:57.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f005ceb3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00500366f0 0x7f0050046c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f9c58ff9640 1 -- 172.21.15.81:0/2232248135 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54017070 con 0x7f9c5c13ce00 2024-09-17T05:18:57.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f005ceb3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00500366f0 0x7f0050046c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:36790/0 (socket says 172.21.15.81:36790) 2024-09-17T05:18:57.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f005ceb3640 1 -- 172.21.15.81:0/1046405016 learned_addr learned my addr 172.21.15.81:0/1046405016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f9c58ff9640 1 -- 172.21.15.81:0/2232248135 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c54009cc0 con 0x7f9c5c13ce00 2024-09-17T05:18:57.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f9c58ff9640 1 -- 172.21.15.81:0/2232248135 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c54005280 con 0x7f9c5c13ce00 2024-09-17T05:18:57.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f00577fe640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005001c890 0x7f005004b5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ef2d21640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5eec0ce280 0x7f5eec0c7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ef2d21640 1 -- 172.21.15.81:0/2143998756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eec0b5530 msgr2=0x7f5eec149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ef2d21640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eec0b5530 0x7f5eec149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f6f7c99c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7806c540 0x7f6f781473c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ef2d21640 1 -- 172.21.15.81:0/2143998756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5eec157210 con 0x7f5eec0d2610 2024-09-17T05:18:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ef2d21640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0d2610 0x7f5eec0718a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4032000 tx=0x7f5ee4003f10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ee2ffd640 1 -- 172.21.15.81:0/2143998756 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4033050 con 0x7f5eec0d2610 2024-09-17T05:18:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5eec1574b0 con 0x7f5eec0d2610 2024-09-17T05:18:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ee2ffd640 1 -- 172.21.15.81:0/2143998756 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ee4004450 con 0x7f5eec0d2610 2024-09-17T05:18:57.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f5ee2ffd640 1 -- 172.21.15.81:0/2143998756 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ee4038450 con 0x7f5eec0d2610 2024-09-17T05:18:57.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f6f7c99c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f78072ac0 0x7f6f78149c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f1a52e94640 1 -- 172.21.15.81:0/1158060531 wait complete. 2024-09-17T05:18:57.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f6f7c99c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7815e060 0x7f6f78143780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.610+0000 7f6f7c99c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6f780b43f0 con 0x7f6f7815e060 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f78072ac0 0x7f6f78149c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f6f75d9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f78072ac0 0x7f6f78149c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:36798/0 (socket says 172.21.15.81:36798) 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f0057fff640 1 -- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00500366f0 msgr2=0x7f0050046c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f0057fff640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00500366f0 0x7f0050046c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f0057fff640 1 -- 172.21.15.81:0/1046405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005001c890 msgr2=0x7f005004b5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f0057fff640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005001c890 0x7f005004b5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f0057fff640 1 -- 172.21.15.81:0/1046405016 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005004dfc0 con 0x7f0050005a60 2024-09-17T05:18:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7fca434f0640 1 -- 172.21.15.81:0/265703519 shutdown_connections 2024-09-17T05:18:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7fca434f0640 1 -- 172.21.15.81:0/265703519 wait complete. 2024-09-17T05:18:57.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7fa0542a9640 1 -- 172.21.15.81:0/3792892004 wait complete. 2024-09-17T05:18:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f3efb59e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ee4003a00 0x7f3efc1f1160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f3efb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3efc0ae3e0 0x7f3efc072220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f6f75d9b640 1 -- 172.21.15.81:0/3201497838 learned_addr learned my addr 172.21.15.81:0/3201497838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6f780b4270 con 0x7f6f78072ac0 2024-09-17T05:18:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6f780b4570 con 0x7f6f7806c540 2024-09-17T05:18:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f6f7659c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7806c540 0x7f6f781473c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f3efb59e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3efc1f3bb0 0x7f3efc1f4030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5eec146770 con 0x7f5eec0d2610 2024-09-17T05:18:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f3efb59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc15c110 con 0x7f3efc0ae3e0 2024-09-17T05:18:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f3efb59e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3efc15bf90 con 0x7f3ee4003a00 2024-09-17T05:18:57.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f3efb59e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3efc15e750 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f1a52e94640 1 Processor -- start 2024-09-17T05:18:57.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f6f76d9d640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7815e060 0x7f6f78143780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f1a52e94640 1 -- start start 2024-09-17T05:18:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3efc1f3bb0 0x7f3efc1f4030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efa59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ee4003a00 0x7f3efc1f1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3efc1f3bb0 0x7f3efc1f4030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52150/0 (socket says 172.21.15.81:52150) 2024-09-17T05:18:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 -- 172.21.15.81:0/329907671 learned_addr learned my addr 172.21.15.81:0/329907671 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f0057fff640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0050005a60 0x7f005004d970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f004c032000 tx=0x7f004c0052f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f6f76d9d640 1 -- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7806c540 msgr2=0x7f6f781473c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f6f76d9d640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7806c540 0x7f6f781473c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f6f76d9d640 1 -- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f78072ac0 msgr2=0x7f6f78149c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f6f76d9d640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f78072ac0 0x7f6f78149c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f6f76d9d640 1 -- 172.21.15.81:0/3201497838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f78143cc0 con 0x7f6f7815e060 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 -- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ee4003a00 msgr2=0x7f3efc1f1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ee4003a00 0x7f3efc1f1160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 -- 172.21.15.81:0/329907671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3efc0ae3e0 msgr2=0x7f3efc072220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3efc0ae3e0 0x7f3efc072220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 -- 172.21.15.81:0/329907671 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3efc0729c0 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7fca434f0640 1 Processor -- start 2024-09-17T05:18:57.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f6f76d9d640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7815e060 0x7f6f78143780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6f70032000 tx=0x7f6f70003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7f3efad9d640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3efc1f3bb0 0x7f3efc1f4030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009fd0 tx=0x7f3ef400f3c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f3eeaffd640 1 -- 172.21.15.81:0/329907671 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4003970 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f3eeaffd640 1 -- 172.21.15.81:0/329907671 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ef4003b10 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f3eeaffd640 1 -- 172.21.15.81:0/329907671 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ef4004030 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f9c61f3d640 1 -- 172.21.15.81:0/2232248135 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c5c0cf150 con 0x7f9c5c13ce00 2024-09-17T05:18:57.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.611+0000 7f9c61f3d640 1 -- 172.21.15.81:0/2232248135 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c5c0cf710 con 0x7f9c5c13ce00 2024-09-17T05:18:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f5ee2ffd640 1 -- 172.21.15.81:0/2143998756 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5ee4036070 con 0x7f5eec0d2610 2024-09-17T05:18:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7fa0542a9640 1 Processor -- start 2024-09-17T05:18:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52e94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4c0d17f0 0x7f1a4c1601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52e94640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c15df80 0x7f1a4c158500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52e94640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c161ee0 0x7f1a4c1f7b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52e94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c06ccc0 con 0x7f1a4c0d17f0 2024-09-17T05:18:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52e94640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1a4c06cb40 con 0x7f1a4c15df80 2024-09-17T05:18:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52e94640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1a4c06ce40 con 0x7f1a4c161ee0 2024-09-17T05:18:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f0054ff9640 1 -- 172.21.15.81:0/1046405016 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c040020 con 0x7f0050005a60 2024-09-17T05:18:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c5c06a0c0 con 0x7f9c5c13ce00 2024-09-17T05:18:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f6f6effd640 1 -- 172.21.15.81:0/3201497838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70044070 con 0x7f6f7815e060 2024-09-17T05:18:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f6f6effd640 1 -- 172.21.15.81:0/3201497838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6f70004250 con 0x7f6f7815e060 2024-09-17T05:18:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f6f6effd640 1 -- 172.21.15.81:0/3201497838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f70044070 con 0x7f6f7815e060 2024-09-17T05:18:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f7814a3d0 con 0x7f6f7815e060 2024-09-17T05:18:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005004e2a0 con 0x7f0050005a60 2024-09-17T05:18:57.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f00500dcab0 con 0x7f0050005a60 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f0054ff9640 1 -- 172.21.15.81:0/1046405016 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f004c004380 con 0x7f0050005a60 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f0054ff9640 1 -- 172.21.15.81:0/1046405016 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c004a00 con 0x7f0050005a60 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a51691640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c15df80 0x7f1a4c158500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52693640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c161ee0 0x7f1a4c1f7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52693640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c161ee0 0x7f1a4c1f7b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52154/0 (socket says 172.21.15.81:52154) 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a52693640 1 -- 172.21.15.81:0/673292886 learned_addr learned my addr 172.21.15.81:0/673292886 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f1a51691640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c15df80 0x7f1a4c158500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:36822/0 (socket says 172.21.15.81:36822) 2024-09-17T05:18:57.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.612+0000 7fca434f0640 1 -- start start 2024-09-17T05:18:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3efc072ca0 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f3efc073260 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7fa0542a9640 1 -- start start 2024-09-17T05:18:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f1a51691640 1 -- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c161ee0 msgr2=0x7f1a4c1f7b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f1a51691640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c161ee0 0x7f1a4c1f7b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f1a51691640 1 -- 172.21.15.81:0/673292886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4c0d17f0 msgr2=0x7f1a4c1601b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-17T05:18:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f1a51691640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4c0d17f0 0x7f1a4c1601b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f1a51691640 1 -- 172.21.15.81:0/673292886 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4c160c70 con 0x7f1a4c15df80 2024-09-17T05:18:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f1a52693640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c161ee0 0x7f1a4c1f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:18:57.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca434f0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca3c0ad8b0 0x7fca3c0b3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca434f0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca3c0cdcf0 0x7fca3c1fbd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca434f0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c15eb60 0x7fca3c0723b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca434f0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c06fa10 con 0x7fca3c0cdcf0 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca434f0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca3c06f890 con 0x7fca3c15eb60 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca434f0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fca3c06fb90 con 0x7fca3c0ad8b0 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca424ee640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca3c0ad8b0 0x7fca3c0b3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca424ee640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca3c0ad8b0 0x7fca3c0b3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52168/0 (socket says 172.21.15.81:52168) 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca424ee640 1 -- 172.21.15.81:0/3277695516 learned_addr learned my addr 172.21.15.81:0/3277695516 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fca42cef640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c15eb60 0x7fca3c0723b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f5ee2ffd640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ed0078bc0 0x7f5ed007b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f5ee2ffd640 1 -- 172.21.15.81:0/2143998756 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5ee40bba20 con 0x7f5eec0d2610 2024-09-17T05:18:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f5ef2520640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ed0078bc0 0x7f5ed007b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5eec0b59c0 con 0x7f5eec0d2610 2024-09-17T05:18:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fa0542a9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa04c06cdb0 0x7fa04c149d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fa0542a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04c06d190 0x7fa04c1462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fa0542a9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c073880 0x7fa04c14f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fa0542a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c0b3610 con 0x7fa04c06d190 2024-09-17T05:18:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fa0542a9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa04c0b3490 con 0x7fa04c06cdb0 2024-09-17T05:18:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7fa0542a9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa04c1537b0 con 0x7fa04c073880 2024-09-17T05:18:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f1a51691640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c15df80 0x7f1a4c158500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00c410 tx=0x7f1a3c00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7f5ef2520640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ed0078bc0 0x7f5ed007b080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005fd0 tx=0x7f5edc00b480 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c073880 0x7fa04c14f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c073880 0x7fa04c14f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:52180/0 (socket says 172.21.15.81:52180) 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 -- 172.21.15.81:0/3529819101 learned_addr learned my addr 172.21.15.81:0/3529819101 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fca42cef640 1 -- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca3c0ad8b0 msgr2=0x7fca3c0b3220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fca42cef640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca3c0ad8b0 0x7fca3c0b3220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fca42cef640 1 -- 172.21.15.81:0/3277695516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca3c0cdcf0 msgr2=0x7fca3c1fbd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fca42cef640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca3c0cdcf0 0x7fca3c1fbd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fca42cef640 1 -- 172.21.15.81:0/3277695516 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca3c1fc290 con 0x7fca3c15eb60 2024-09-17T05:18:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa051844640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04c06d190 0x7fa04c1462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052045640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa04c06cdb0 0x7fa04c149d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.613+0000 7f6f75d9b640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f78072ac0 0x7f6f78149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.614+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f7814a990 con 0x7f6f7815e060 2024-09-17T05:18:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fca42cef640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c15eb60 0x7fca3c0723b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c730 tx=0x7fca3400cbf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 -- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa04c06cdb0 msgr2=0x7fa04c149d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa04c06cdb0 0x7fa04c149d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 -- 172.21.15.81:0/3529819101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04c06d190 msgr2=0x7fa04c1462c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04c06d190 0x7fa04c1462c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.615+0000 7fa052846640 1 -- 172.21.15.81:0/3529819101 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa04c1478d0 con 0x7fa04c073880 2024-09-17T05:18:57.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f78072f70 con 0x7f6f7815e060 2024-09-17T05:18:57.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7fa052846640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c073880 0x7fa04c14f040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c730 tx=0x7fa04400cbf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0038005290 con 0x7f0050005a60 2024-09-17T05:18:57.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7fa051844640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04c06d190 0x7fa04c1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:18:57.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7fa042ffd640 1 -- 172.21.15.81:0/3529819101 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa044003b70 con 0x7fa04c073880 2024-09-17T05:18:57.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3efc06fc20 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7fa042ffd640 1 -- 172.21.15.81:0/3529819101 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa044003d10 con 0x7fa04c073880 2024-09-17T05:18:57.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa04c147bb0 con 0x7fa04c073880 2024-09-17T05:18:57.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7fa042ffd640 1 -- 172.21.15.81:0/3529819101 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa04400aab0 con 0x7fa04c073880 2024-09-17T05:18:57.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7f6f6effd640 1 -- 172.21.15.81:0/3201497838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6f70004400 con 0x7f6f7815e060 2024-09-17T05:18:57.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa04c148170 con 0x7fa04c073880 2024-09-17T05:18:57.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7f9c58ff9640 1 -- 172.21.15.81:0/2232248135 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9c54005420 con 0x7f9c5c13ce00 2024-09-17T05:18:57.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.616+0000 7f0054ff9640 1 -- 172.21.15.81:0/1046405016 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f004c043020 con 0x7f0050005a60 2024-09-17T05:18:57.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f3eeaffd640 1 -- 172.21.15.81:0/329907671 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3ef40041d0 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f0054ff9640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f003c078c90 0x7f003c07b150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f6f6effd640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f60078fc0 0x7f6f6007b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f0054ff9640 1 -- 172.21.15.81:0/1046405016 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f004c0bb860 con 0x7f0050005a60 2024-09-17T05:18:57.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f9c58ff9640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9c3c07cfa0 0x7f9c3c07f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f00577fe640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f003c078c90 0x7f003c07b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f6f6effd640 1 -- 172.21.15.81:0/3201497838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f6f7003c070 con 0x7f6f7815e060 2024-09-17T05:18:57.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f9c5b7fe640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9c3c07cfa0 0x7f9c3c07f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa04c073340 con 0x7fa04c073880 2024-09-17T05:18:57.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f9c58ff9640 1 -- 172.21.15.81:0/2232248135 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9c5409b190 con 0x7f9c5c13ce00 2024-09-17T05:18:57.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f6f7659c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f60078fc0 0x7f6f6007b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.617+0000 7f3eeaffd640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3edc078c60 0x7f3edc07b120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7f3eeaffd640 1 -- 172.21.15.81:0/329907671 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3ef409bb90 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7f3efa59c640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3edc078c60 0x7f3edc07b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7f00577fe640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f003c078c90 0x7f003c07b150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00500de870 tx=0x7f0044009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7f9c5b7fe640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9c3c07cfa0 0x7f9c3c07f460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c035000 tx=0x7f9c4c004a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7f6f7659c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f60078fc0 0x7f6f6007b480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f780cc600 tx=0x7f6f64009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7fa042ffd640 1 -- 172.21.15.81:0/3529819101 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fa04400ac50 con 0x7fa04c073880 2024-09-17T05:18:57.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7f3efa59c640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3edc078c60 0x7f3edc07b120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3eec01d2f0 tx=0x7f3eec001890 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.618+0000 7fa042ffd640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa030078b90 0x7fa03007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.619+0000 7fa042ffd640 1 -- 172.21.15.81:0/3529819101 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fa04409a960 con 0x7fa04c073880 2024-09-17T05:18:57.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.619+0000 7fa052045640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa030078b90 0x7fa03007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.619+0000 7fa052045640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa030078b90 0x7fa03007b050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa048007fd0 tx=0x7fa048007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.620+0000 7f1a427fc640 1 -- 172.21.15.81:0/673292886 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c007030 con 0x7f1a4c15df80 2024-09-17T05:18:57.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.620+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4c0c49a0 con 0x7f1a4c15df80 2024-09-17T05:18:57.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.620+0000 7fca3affd640 1 -- 172.21.15.81:0/3277695516 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34003b70 con 0x7fca3c15eb60 2024-09-17T05:18:57.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.620+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a4c1f8860 con 0x7f1a4c15df80 2024-09-17T05:18:57.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.620+0000 7f9c58ff9640 1 -- 172.21.15.81:0/2232248135 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9c5c06a0c0 con 0x7f9c5c13ce00 2024-09-17T05:18:57.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.620+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca3c0b4c00 con 0x7fca3c15eb60 2024-09-17T05:18:57.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.620+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca3c0b51c0 con 0x7fca3c15eb60 2024-09-17T05:18:57.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.621+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a4c06d3d0 con 0x7f1a4c15df80 2024-09-17T05:18:57.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.621+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca3c1470b0 con 0x7fca3c15eb60 2024-09-17T05:18:57.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.622+0000 7f0054ff9640 1 -- 172.21.15.81:0/1046405016 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f004c04a030 con 0x7f0050005a60 2024-09-17T05:18:57.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.624+0000 7f6f6effd640 1 -- 172.21.15.81:0/3201497838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6f70032030 con 0x7f6f7815e060 2024-09-17T05:18:57.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.624+0000 7fca3affd640 1 -- 172.21.15.81:0/3277695516 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca340050d0 con 0x7fca3c15eb60 2024-09-17T05:18:57.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.624+0000 7fca3affd640 1 -- 172.21.15.81:0/3277695516 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca34005560 con 0x7fca3c15eb60 2024-09-17T05:18:57.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.625+0000 7f5ee2ffd640 1 -- 172.21.15.81:0/2143998756 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5ee4083e60 con 0x7f5eec0d2610 2024-09-17T05:18:57.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.625+0000 7f1a427fc640 1 -- 172.21.15.81:0/673292886 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a3c0071d0 con 0x7f1a4c15df80 2024-09-17T05:18:57.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.625+0000 7f1a427fc640 1 -- 172.21.15.81:0/673292886 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a3c0075c0 con 0x7f1a4c15df80 2024-09-17T05:18:57.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.626+0000 7fca3affd640 1 -- 172.21.15.81:0/3277695516 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fca3400a640 con 0x7fca3c15eb60 2024-09-17T05:18:57.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.627+0000 7f3eeaffd640 1 -- 172.21.15.81:0/329907671 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3ef4064040 con 0x7f3efc1f3bb0 2024-09-17T05:18:57.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.627+0000 7f1a427fc640 1 -- 172.21.15.81:0/673292886 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a3c011070 con 0x7f1a4c15df80 2024-09-17T05:18:57.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.627+0000 7fca3affd640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca1c078b90 0x7fca1c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.627+0000 7fca3affd640 1 -- 172.21.15.81:0/3277695516 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fca3409b880 con 0x7fca3c15eb60 2024-09-17T05:18:57.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.628+0000 7f1a427fc640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a30078b90 0x7f1a3007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:57.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.628+0000 7f1a427fc640 1 -- 172.21.15.81:0/673292886 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1a3c09a5f0 con 0x7f1a4c15df80 2024-09-17T05:18:57.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.628+0000 7f1a51e92640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a30078b90 0x7f1a3007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.628+0000 7fca424ee640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca1c078b90 0x7fca1c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:57.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.628+0000 7f1a51e92640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a30078b90 0x7f1a3007b050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800b990 tx=0x7f1a4800b370 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.629+0000 7fca424ee640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca1c078b90 0x7fca1c07b050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001770 tx=0x7fca2c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:57.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.630+0000 7f1a427fc640 1 -- 172.21.15.81:0/673292886 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1a3c062c30 con 0x7f1a4c15df80 2024-09-17T05:18:57.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.631+0000 7fa042ffd640 1 -- 172.21.15.81:0/3529819101 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa044062ec0 con 0x7fa04c073880 2024-09-17T05:18:57.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:57.635+0000 7fca3affd640 1 -- 172.21.15.81:0/3277695516 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fca3c1470b0 con 0x7fca3c15eb60 2024-09-17T05:18:58.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.049+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f9c5c0725a0 con 0x7f9c5c13ce00 2024-09-17T05:18:58.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.049+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0038005580 con 0x7f0050005a60 2024-09-17T05:18:58.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.049+0000 7f9c58ff9640 1 -- 172.21.15.81:0/2232248135 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9c54063740 con 0x7f9c5c13ce00 2024-09-17T05:18:58.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.049+0000 7f0054ff9640 1 -- 172.21.15.81:0/1046405016 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f004c083da0 con 0x7f0050005a60 2024-09-17T05:18:58.051 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:58.051 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-17T05:18:58.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.051+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f6f7814abd0 con 0x7f6f7815e060 2024-09-17T05:18:58.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.052+0000 7f6f6effd640 1 -- 172.21.15.81:0/3201497838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f70032030 con 0x7f6f7815e060 2024-09-17T05:18:58.052 INFO:teuthology.orchestra.run.smithi081.stdout:55834574855 2024-09-17T05:18:58.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.052+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f3efc1569e0 con 0x7f3efc1f3bb0 2024-09-17T05:18:58.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f3eeaffd640 1 -- 172.21.15.81:0/329907671 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ef409b020 con 0x7f3efc1f3bb0 2024-09-17T05:18:58.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f5eec0b2d70 con 0x7f5eec0d2610 2024-09-17T05:18:58.054 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:58.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9c3c07cfa0 msgr2=0x7f9c3c07f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9c3c07cfa0 0x7f9c3c07f460 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f9c4c035000 tx=0x7f9c4c004a40 comp rx=0 tx=0).stop 2024-09-17T05:18:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f5ee2ffd640 1 -- 172.21.15.81:0/2143998756 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f5ee4083760 con 0x7f5eec0d2610 2024-09-17T05:18:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c13ce00 msgr2=0x7f9c5c0b3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0b3f20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9c5400d720 tx=0x7f9c5400dbe0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 shutdown_connections 2024-09-17T05:18:58.056 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9c3c07cfa0 0x7f9c3c07f460 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c13ce00 0x7f9c5c0b3f20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c5c072ae0 0x7f9c5c0b39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 --2- 172.21.15.81:0/2232248135 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c070690 0x7f9c5c0cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.053+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 >> 172.21.15.81:0/2232248135 conn(0x7f9c5c0b1690 msgr2=0x7f9c5c13f7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 shutdown_connections 2024-09-17T05:18:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f003c078c90 msgr2=0x7f003c07b150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f9c51ffb640 1 -- 172.21.15.81:0/2232248135 wait complete. 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f003c078c90 0x7f003c07b150 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f00500de870 tx=0x7f0044009040 comp rx=0 tx=0).stop 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0050005a60 msgr2=0x7f005004d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0050005a60 0x7f005004d970 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f004c032000 tx=0x7f004c0052f0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 shutdown_connections 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f003c078c90 0x7f003c07b150 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00500366f0 0x7f0050046c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f005001c890 0x7f005004b5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 --2- 172.21.15.81:0/1046405016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0050005a60 0x7f005004d970 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 >> 172.21.15.81:0/1046405016 conn(0x7f0050054560 msgr2=0x7f0050053ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 shutdown_connections 2024-09-17T05:18:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.054+0000 7f005e916640 1 -- 172.21.15.81:0/1046405016 wait complete. 2024-09-17T05:18:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f60078fc0 msgr2=0x7f6f6007b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f60078fc0 0x7f6f6007b480 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f6f780cc600 tx=0x7f6f64009040 comp rx=0 tx=0).stop 2024-09-17T05:18:58.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3edc078c60 msgr2=0x7f3edc07b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7815e060 msgr2=0x7f6f78143780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7815e060 0x7f6f78143780 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6f70032000 tx=0x7f6f70003f10 comp rx=0 tx=0).stop 2024-09-17T05:18:58.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3edc078c60 0x7f3edc07b120 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3eec01d2f0 tx=0x7f3eec001890 comp rx=0 tx=0).stop 2024-09-17T05:18:58.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3efc1f3bb0 msgr2=0x7f3efc1f4030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 shutdown_connections 2024-09-17T05:18:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3efc1f3bb0 0x7f3efc1f4030 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f3ef4009fd0 tx=0x7f3ef400f3c0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6f60078fc0 0x7f6f6007b480 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6f7815e060 0x7f6f78143780 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6f78072ac0 0x7f6f78149c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 --2- 172.21.15.81:0/3201497838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6f7806c540 0x7f6f781473c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 >> 172.21.15.81:0/3201497838 conn(0x7f6f780b1bb0 msgr2=0x7f6f78159520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 shutdown_connections 2024-09-17T05:18:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3edc078c60 0x7f3edc07b120 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3efc1f3bb0 0x7f3efc1f4030 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3efc0ae3e0 0x7f3efc072220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 --2- 172.21.15.81:0/329907671 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ee4003a00 0x7f3efc1f1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.056+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 >> 172.21.15.81:0/329907671 conn(0x7f3efc0b1440 msgr2=0x7f3efc0cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 shutdown_connections 2024-09-17T05:18:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 shutdown_connections 2024-09-17T05:18:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f3efb59e640 1 -- 172.21.15.81:0/329907671 wait complete. 2024-09-17T05:18:58.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f6f7c99c640 1 -- 172.21.15.81:0/3201497838 wait complete. 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ed0078bc0 msgr2=0x7f5ed007b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ed0078bc0 0x7f5ed007b080 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005fd0 tx=0x7f5edc00b480 comp rx=0 tx=0).stop 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0d2610 msgr2=0x7f5eec0718a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0d2610 0x7f5eec0718a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5ee4032000 tx=0x7f5ee4003f10 comp rx=0 tx=0).stop 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 shutdown_connections 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ed0078bc0 0x7f5ed007b080 secure :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005fd0 tx=0x7f5edc00b480 comp rx=0 tx=0).stop 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5eec0d2610 0x7f5eec0718a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5eec0ce280 0x7f5eec0c7900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 --2- 172.21.15.81:0/2143998756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5eec0b5530 0x7f5eec149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 >> 172.21.15.81:0/2143998756 conn(0x7f5eec0d1a60 msgr2=0x7f5eec0b6a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.057+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fa04c0aefe0 con 0x7fa04c073880 2024-09-17T05:18:58.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.058+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 shutdown_connections 2024-09-17T05:18:58.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.058+0000 7f5ef4784640 1 -- 172.21.15.81:0/2143998756 wait complete. 2024-09-17T05:18:58.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.058+0000 7fa042ffd640 1 -- 172.21.15.81:0/3529819101 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa0440627c0 con 0x7fa04c073880 2024-09-17T05:18:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-17T05:18:58.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.059+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1a4c0b6c50 con 0x7f1a4c15df80 2024-09-17T05:18:58.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.060+0000 7f1a427fc640 1 -- 172.21.15.81:0/673292886 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1a3c062c30 con 0x7f1a4c15df80 2024-09-17T05:18:58.068 INFO:teuthology.orchestra.run.smithi081.stdout:64424509448 2024-09-17T05:18:58.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.062+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fca3c070120 con 0x7fca3c15eb60 2024-09-17T05:18:58.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.063+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa030078b90 msgr2=0x7fa03007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.063+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa030078b90 0x7fa03007b050 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa048007fd0 tx=0x7fa048007eb0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.063+0000 7fca3affd640 1 -- 172.21.15.81:0/3277695516 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fca34063cb0 con 0x7fca3c15eb60 2024-09-17T05:18:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.063+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c073880 msgr2=0x7fa04c14f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.063+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c073880 0x7fa04c14f040 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c730 tx=0x7fa04400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.071 INFO:teuthology.orchestra.run.smithi081.stdout:64424509447 2024-09-17T05:18:58.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 shutdown_connections 2024-09-17T05:18:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa030078b90 0x7fa03007b050 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa04c073880 0x7fa04c14f040 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa04c06d190 0x7fa04c1462c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7fa0542a9640 1 --2- 172.21.15.81:0/3529819101 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa04c06cdb0 0x7fa04c149d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 >> 172.21.15.81:0/3529819101 conn(0x7fa04c0b1540 msgr2=0x7fa04c06e230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a30078b90 msgr2=0x7f1a3007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.064+0000 7f1a52e94640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a30078b90 0x7f1a3007b050 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f1a4800b990 tx=0x7f1a4800b370 comp rx=0 tx=0).stop 2024-09-17T05:18:58.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c15df80 msgr2=0x7f1a4c158500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c15df80 0x7f1a4c158500 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1a3c00c410 tx=0x7f1a3c00c8d0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 shutdown_connections 2024-09-17T05:18:58.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a30078b90 0x7f1a3007b050 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a4c161ee0 0x7f1a4c1f7b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a4c15df80 0x7f1a4c158500 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 --2- 172.21.15.81:0/673292886 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a4c0d17f0 0x7f1a4c1601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 >> 172.21.15.81:0/673292886 conn(0x7f1a4c0d0cd0 msgr2=0x7f1a4c0b4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 shutdown_connections 2024-09-17T05:18:58.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7fa0542a9640 1 -- 172.21.15.81:0/3529819101 wait complete. 2024-09-17T05:18:58.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 shutdown_connections 2024-09-17T05:18:58.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.065+0000 7f1a52e94640 1 -- 172.21.15.81:0/673292886 wait complete. 2024-09-17T05:18:58.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca1c078b90 msgr2=0x7fca1c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca1c078b90 0x7fca1c07b050 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fca2c001770 tx=0x7fca2c009040 comp rx=0 tx=0).stop 2024-09-17T05:18:58.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c15eb60 msgr2=0x7fca3c0723b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c15eb60 0x7fca3c0723b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fca3400c730 tx=0x7fca3400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 shutdown_connections 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca1c078b90 0x7fca1c07b050 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca3c15eb60 0x7fca3c0723b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca3c0cdcf0 0x7fca3c1fbd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 --2- 172.21.15.81:0/3277695516 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca3c0ad8b0 0x7fca3c0b3220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 >> 172.21.15.81:0/3277695516 conn(0x7fca3c0b1540 msgr2=0x7fca3c074190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.066+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 shutdown_connections 2024-09-17T05:18:58.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.067+0000 7fca434f0640 1 -- 172.21.15.81:0/3277695516 wait complete. 2024-09-17T05:18:58.078 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.2 2024-09-17T05:18:58.079 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.079 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.4 2024-09-17T05:18:58.079 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574855 got 55834574855 for osd.0 2024-09-17T05:18:58.081 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.082 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.5 2024-09-17T05:18:58.082 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.083 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.1 2024-09-17T05:18:58.083 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.086 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.6 2024-09-17T05:18:58.086 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.088 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509448 got 64424509448 for osd.7 2024-09-17T05:18:58.089 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.089 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509447 got 64424509447 for osd.3 2024-09-17T05:18:58.089 DEBUG:teuthology.parallel:result is None 2024-09-17T05:18:58.089 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:18:58.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:18:58.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 -- 172.21.15.81:0/1432106905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785815aa70 msgr2=0x7f78580b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 --2- 172.21.15.81:0/1432106905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785815aa70 0x7f78580b4690 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7848009830 tx=0x7f784802a510 comp rx=0 tx=0).stop 2024-09-17T05:18:58.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 -- 172.21.15.81:0/1432106905 shutdown_connections 2024-09-17T05:18:58.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 --2- 172.21.15.81:0/1432106905 >> v2:172.21.15.160:3300/0 conn(0x7f7858070690 0x7f78580739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 --2- 172.21.15.81:0/1432106905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f785815aa70 0x7f78580b4690 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 -- 172.21.15.81:0/1432106905 >> 172.21.15.81:0/1432106905 conn(0x7f78580b1690 msgr2=0x7f78580b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 -- 172.21.15.81:0/1432106905 shutdown_connections 2024-09-17T05:18:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.228+0000 7f785ef5d640 1 -- 172.21.15.81:0/1432106905 wait complete. 2024-09-17T05:18:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.229+0000 7f785ef5d640 1 Processor -- start 2024-09-17T05:18:58.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.229+0000 7f785ef5d640 1 -- start start 2024-09-17T05:18:58.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785ef5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7858070690 0x7f78581598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785ef5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78580735a0 0x7f78581f5080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785ef5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785815aa70 0x7f78581f0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785ef5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78580cd270 con 0x7f785815aa70 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785ef5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f78580cd0f0 con 0x7f78580735a0 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785ef5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f78580cd3f0 con 0x7f7858070690 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785d4fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785815aa70 0x7f78581f0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785d4fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785815aa70 0x7f78581f0870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38688/0 (socket says 172.21.15.81:38688) 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785d4fa640 1 -- 172.21.15.81:0/2273322542 learned_addr learned my addr 172.21.15.81:0/2273322542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f785ccf9640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7858070690 0x7f78581598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.230+0000 7f7857fff640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78580735a0 0x7f78581f5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785d4fa640 1 -- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7858070690 msgr2=0x7f78581598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785d4fa640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7858070690 0x7f78581598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785d4fa640 1 -- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78580735a0 msgr2=0x7f78581f5080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785d4fa640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78580735a0 0x7f78581f5080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785d4fa640 1 -- 172.21.15.81:0/2273322542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7858159e10 con 0x7f785815aa70 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785d4fa640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785815aa70 0x7f78581f0870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f78500058c0 tx=0x7f785000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f78557fa640 1 -- 172.21.15.81:0/2273322542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785001c070 con 0x7f785815aa70 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f785814bf10 con 0x7f785815aa70 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f78557fa640 1 -- 172.21.15.81:0/2273322542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f785000bbe0 con 0x7f785815aa70 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f78557fa640 1 -- 172.21.15.81:0/2273322542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7850004030 con 0x7f785815aa70 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.231+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7858158b10 con 0x7f785815aa70 2024-09-17T05:18:58.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.232+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78580cd910 con 0x7f785815aa70 2024-09-17T05:18:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.233+0000 7f78557fa640 1 -- 172.21.15.81:0/2273322542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f785001f070 con 0x7f785815aa70 2024-09-17T05:18:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.233+0000 7f78557fa640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7844078b90 0x7f784407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.233+0000 7f78557fa640 1 -- 172.21.15.81:0/2273322542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f785009c890 con 0x7f785815aa70 2024-09-17T05:18:58.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.233+0000 7f785ccf9640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7844078b90 0x7f784407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.234+0000 7f785ccf9640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7844078b90 0x7f784407b050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7848034000 tx=0x7f7848004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:58.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.238+0000 7f78557fa640 1 -- 172.21.15.81:0/2273322542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7850064720 con 0x7f785815aa70 2024-09-17T05:18:58.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.407+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f78580697e0 con 0x7f7844078b90 2024-09-17T05:18:58.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.412+0000 7f78557fa640 1 -- 172.21.15.81:0/2273322542 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f78580697e0 con 0x7f7844078b90 2024-09-17T05:18:58.415 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:58.416 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:18:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7844078b90 msgr2=0x7f784407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7844078b90 0x7f784407b050 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f7848034000 tx=0x7f7848004730 comp rx=0 tx=0).stop 2024-09-17T05:18:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785815aa70 msgr2=0x7f78581f0870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785815aa70 0x7f78581f0870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f78500058c0 tx=0x7f785000ef60 comp rx=0 tx=0).stop 2024-09-17T05:18:58.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 shutdown_connections 2024-09-17T05:18:58.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7844078b90 0x7f784407b050 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f785815aa70 0x7f78581f0870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78580735a0 0x7f78581f5080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 --2- 172.21.15.81:0/2273322542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7858070690 0x7f78581598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 >> 172.21.15.81:0/2273322542 conn(0x7f78580b1690 msgr2=0x7f78580b0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 shutdown_connections 2024-09-17T05:18:58.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.415+0000 7f785ef5d640 1 -- 172.21.15.81:0/2273322542 wait complete. 2024-09-17T05:18:58.427 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-17T05:18:57.375893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219296,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755424,"statfs":{"total":773094113280,"available":772869554176,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001932"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902236+0000","last_change":"2024-09-17T05:18:47.135396+0000","last_active":"2024-09-17T05:18:48.902236+0000","last_peered":"2024-09-17T05:18:48.902236+0000","last_clean":"2024-09-17T05:18:48.902236+0000","last_became_active":"2024-09-17T05:18:47.135102+0000","last_became_peered":"2024-09-17T05:18:47.135102+0000","last_unstale":"2024-09-17T05:18:48.902236+0000","last_undegraded":"2024-09-17T05:18:48.902236+0000","last_fullsized":"2024-09-17T05:18:48.902236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:17.057030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134032+0000","last_change":"2024-09-17T05:18:47.134404+0000","last_active":"2024-09-17T05:18:48.134032+0000","last_peered":"2024-09-17T05:18:48.134032+0000","last_clean":"2024-09-17T05:18:48.134032+0000","last_became_active":"2024-09-17T05:18:47.133993+0000","last_became_peered":"2024-09-17T05:18:47.133993+0000","last_unstale":"2024-09-17T05:18:48.134032+0000","last_undegraded":"2024-09-17T05:18:48.134032+0000","last_fullsized":"2024-09-17T05:18:48.134032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601365+0000","last_change":"2024-09-17T05:18:47.133451+0000","last_active":"2024-09-17T05:18:49.601365+0000","last_peered":"2024-09-17T05:18:49.601365+0000","last_clean":"2024-09-17T05:18:49.601365+0000","last_became_active":"2024-09-17T05:18:47.133212+0000","last_became_peered":"2024-09-17T05:18:47.133212+0000","last_unstale":"2024-09-17T05:18:49.601365+0000","last_undegraded":"2024-09-17T05:18:49.601365+0000","last_fullsized":"2024-09-17T05:18:49.601365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:06.687774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231441+0000","last_change":"2024-09-17T05:18:47.140539+0000","last_active":"2024-09-17T05:18:50.231441+0000","last_peered":"2024-09-17T05:18:50.231441+0000","last_clean":"2024-09-17T05:18:50.231441+0000","last_became_active":"2024-09-17T05:18:47.139262+0000","last_became_peered":"2024-09-17T05:18:47.139262+0000","last_unstale":"2024-09-17T05:18:50.231441+0000","last_undegraded":"2024-09-17T05:18:50.231441+0000","last_fullsized":"2024-09-17T05:18:50.231441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:55.646018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901799+0000","last_change":"2024-09-17T05:18:47.145770+0000","last_active":"2024-09-17T05:18:48.901799+0000","last_peered":"2024-09-17T05:18:48.901799+0000","last_clean":"2024-09-17T05:18:48.901799+0000","last_became_active":"2024-09-17T05:18:47.145480+0000","last_became_peered":"2024-09-17T05:18:47.145480+0000","last_unstale":"2024-09-17T05:18:48.901799+0000","last_undegraded":"2024-09-17T05:18:48.901799+0000","last_fullsized":"2024-09-17T05:18:48.901799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:55.524841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231267+0000","last_change":"2024-09-17T05:18:47.133339+0000","last_active":"2024-09-17T05:18:50.231267+0000","last_peered":"2024-09-17T05:18:50.231267+0000","last_clean":"2024-09-17T05:18:50.231267+0000","last_became_active":"2024-09-17T05:18:47.133085+0000","last_became_peered":"2024-09-17T05:18:47.133085+0000","last_unstale":"2024-09-17T05:18:50.231267+0000","last_undegraded":"2024-09-17T05:18:50.231267+0000","last_fullsized":"2024-09-17T05:18:50.231267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901734+0000","last_change":"2024-09-17T05:18:47.135045+0000","last_active":"2024-09-17T05:18:48.901734+0000","last_peered":"2024-09-17T05:18:48.901734+0000","last_clean":"2024-09-17T05:18:48.901734+0000","last_became_active":"2024-09-17T05:18:47.134770+0000","last_became_peered":"2024-09-17T05:18:47.134770+0000","last_unstale":"2024-09-17T05:18:48.901734+0000","last_undegraded":"2024-09-17T05:18:48.901734+0000","last_fullsized":"2024-09-17T05:18:48.901734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116753+0000","last_change":"2024-09-17T05:18:47.144464+0000","last_active":"2024-09-17T05:18:48.116753+0000","last_peered":"2024-09-17T05:18:48.116753+0000","last_clean":"2024-09-17T05:18:48.116753+0000","last_became_active":"2024-09-17T05:18:47.144111+0000","last_became_peered":"2024-09-17T05:18:47.144111+0000","last_unstale":"2024-09-17T05:18:48.116753+0000","last_undegraded":"2024-09-17T05:18:48.116753+0000","last_fullsized":"2024-09-17T05:18:48.116753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:08.620872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902314+0000","last_change":"2024-09-17T05:18:47.143214+0000","last_active":"2024-09-17T05:18:48.902314+0000","last_peered":"2024-09-17T05:18:48.902314+0000","last_clean":"2024-09-17T05:18:48.902314+0000","last_became_active":"2024-09-17T05:18:47.142377+0000","last_became_peered":"2024-09-17T05:18:47.142377+0000","last_unstale":"2024-09-17T05:18:48.902314+0000","last_undegraded":"2024-09-17T05:18:48.902314+0000","last_fullsized":"2024-09-17T05:18:48.902314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:04.186259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118741+0000","last_change":"2024-09-17T05:18:47.129022+0000","last_active":"2024-09-17T05:18:48.118741+0000","last_peered":"2024-09-17T05:18:48.118741+0000","last_clean":"2024-09-17T05:18:48.118741+0000","last_became_active":"2024-09-17T05:18:47.128776+0000","last_became_peered":"2024-09-17T05:18:47.128776+0000","last_unstale":"2024-09-17T05:18:48.118741+0000","last_undegraded":"2024-09-17T05:18:48.118741+0000","last_fullsized":"2024-09-17T05:18:48.118741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118513+0000","last_change":"2024-09-17T05:18:47.129696+0000","last_active":"2024-09-17T05:18:48.118513+0000","last_peered":"2024-09-17T05:18:48.118513+0000","last_clean":"2024-09-17T05:18:48.118513+0000","last_became_active":"2024-09-17T05:18:47.127357+0000","last_became_peered":"2024-09-17T05:18:47.127357+0000","last_unstale":"2024-09-17T05:18:48.118513+0000","last_undegraded":"2024-09-17T05:18:48.118513+0000","last_fullsized":"2024-09-17T05:18:48.118513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:07.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118724+0000","last_change":"2024-09-17T05:18:47.122017+0000","last_active":"2024-09-17T05:18:48.118724+0000","last_peered":"2024-09-17T05:18:48.118724+0000","last_clean":"2024-09-17T05:18:48.118724+0000","last_became_active":"2024-09-17T05:18:47.120911+0000","last_became_peered":"2024-09-17T05:18:47.120911+0000","last_unstale":"2024-09-17T05:18:48.118724+0000","last_undegraded":"2024-09-17T05:18:48.118724+0000","last_fullsized":"2024-09-17T05:18:48.118724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:33.294659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117057+0000","last_change":"2024-09-17T05:18:47.135716+0000","last_active":"2024-09-17T05:18:48.117057+0000","last_peered":"2024-09-17T05:18:48.117057+0000","last_clean":"2024-09-17T05:18:48.117057+0000","last_became_active":"2024-09-17T05:18:47.135334+0000","last_became_peered":"2024-09-17T05:18:47.135334+0000","last_unstale":"2024-09-17T05:18:48.117057+0000","last_undegraded":"2024-09-17T05:18:48.117057+0000","last_fullsized":"2024-09-17T05:18:48.117057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:25.755720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601241+0000","last_change":"2024-09-17T05:18:47.133079+0000","last_active":"2024-09-17T05:18:49.601241+0000","last_peered":"2024-09-17T05:18:49.601241+0000","last_clean":"2024-09-17T05:18:49.601241+0000","last_became_active":"2024-09-17T05:18:47.132823+0000","last_became_peered":"2024-09-17T05:18:47.132823+0000","last_unstale":"2024-09-17T05:18:49.601241+0000","last_undegraded":"2024-09-17T05:18:49.601241+0000","last_fullsized":"2024-09-17T05:18:49.601241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:33.666738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133781+0000","last_change":"2024-09-17T05:18:47.138267+0000","last_active":"2024-09-17T05:18:48.133781+0000","last_peered":"2024-09-17T05:18:48.133781+0000","last_clean":"2024-09-17T05:18:48.133781+0000","last_became_active":"2024-09-17T05:18:47.137928+0000","last_became_peered":"2024-09-17T05:18:47.137928+0000","last_unstale":"2024-09-17T05:18:48.133781+0000","last_undegraded":"2024-09-17T05:18:48.133781+0000","last_fullsized":"2024-09-17T05:18:48.133781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:08.620872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231212+0000","last_change":"2024-09-17T05:18:47.133341+0000","last_active":"2024-09-17T05:18:50.231212+0000","last_peered":"2024-09-17T05:18:50.231212+0000","last_clean":"2024-09-17T05:18:50.231212+0000","last_became_active":"2024-09-17T05:18:47.133113+0000","last_became_peered":"2024-09-17T05:18:47.133113+0000","last_unstale":"2024-09-17T05:18:50.231212+0000","last_undegraded":"2024-09-17T05:18:50.231212+0000","last_fullsized":"2024-09-17T05:18:50.231212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231972+0000","last_change":"2024-09-17T05:18:47.138568+0000","last_active":"2024-09-17T05:18:50.231972+0000","last_peered":"2024-09-17T05:18:50.231972+0000","last_clean":"2024-09-17T05:18:50.231972+0000","last_became_active":"2024-09-17T05:18:47.136370+0000","last_became_peered":"2024-09-17T05:18:47.136370+0000","last_unstale":"2024-09-17T05:18:50.231972+0000","last_undegraded":"2024-09-17T05:18:50.231972+0000","last_fullsized":"2024-09-17T05:18:50.231972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:42.624419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231441+0000","last_change":"2024-09-17T05:18:47.120795+0000","last_active":"2024-09-17T05:18:50.231441+0000","last_peered":"2024-09-17T05:18:50.231441+0000","last_clean":"2024-09-17T05:18:50.231441+0000","last_became_active":"2024-09-17T05:18:47.120609+0000","last_became_peered":"2024-09-17T05:18:47.120609+0000","last_unstale":"2024-09-17T05:18:50.231441+0000","last_undegraded":"2024-09-17T05:18:50.231441+0000","last_fullsized":"2024-09-17T05:18:50.231441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:39.011324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902402+0000","last_change":"2024-09-17T05:18:47.131900+0000","last_active":"2024-09-17T05:18:48.902402+0000","last_peered":"2024-09-17T05:18:48.902402+0000","last_clean":"2024-09-17T05:18:48.902402+0000","last_became_active":"2024-09-17T05:18:47.131593+0000","last_became_peered":"2024-09-17T05:18:47.131593+0000","last_unstale":"2024-09-17T05:18:48.902402+0000","last_undegraded":"2024-09-17T05:18:48.902402+0000","last_fullsized":"2024-09-17T05:18:48.902402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:44.867751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118535+0000","last_change":"2024-09-17T05:18:47.127274+0000","last_active":"2024-09-17T05:18:48.118535+0000","last_peered":"2024-09-17T05:18:48.118535+0000","last_clean":"2024-09-17T05:18:48.118535+0000","last_became_active":"2024-09-17T05:18:47.126150+0000","last_became_peered":"2024-09-17T05:18:47.126150+0000","last_unstale":"2024-09-17T05:18:48.118535+0000","last_undegraded":"2024-09-17T05:18:48.118535+0000","last_fullsized":"2024-09-17T05:18:48.118535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:30.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601563+0000","last_change":"2024-09-17T05:18:47.145653+0000","last_active":"2024-09-17T05:18:49.601563+0000","last_peered":"2024-09-17T05:18:49.601563+0000","last_clean":"2024-09-17T05:18:49.601563+0000","last_became_active":"2024-09-17T05:18:47.145377+0000","last_became_peered":"2024-09-17T05:18:47.145377+0000","last_unstale":"2024-09-17T05:18:49.601563+0000","last_undegraded":"2024-09-17T05:18:49.601563+0000","last_fullsized":"2024-09-17T05:18:49.601563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:45.318856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231443+0000","last_change":"2024-09-17T05:18:47.136643+0000","last_active":"2024-09-17T05:18:50.231443+0000","last_peered":"2024-09-17T05:18:50.231443+0000","last_clean":"2024-09-17T05:18:50.231443+0000","last_became_active":"2024-09-17T05:18:47.136396+0000","last_became_peered":"2024-09-17T05:18:47.136396+0000","last_unstale":"2024-09-17T05:18:50.231443+0000","last_undegraded":"2024-09-17T05:18:50.231443+0000","last_fullsized":"2024-09-17T05:18:50.231443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:32.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116775+0000","last_change":"2024-09-17T05:18:47.139232+0000","last_active":"2024-09-17T05:18:48.116775+0000","last_peered":"2024-09-17T05:18:48.116775+0000","last_clean":"2024-09-17T05:18:48.116775+0000","last_became_active":"2024-09-17T05:18:47.138536+0000","last_became_peered":"2024-09-17T05:18:47.138536+0000","last_unstale":"2024-09-17T05:18:48.116775+0000","last_undegraded":"2024-09-17T05:18:48.116775+0000","last_fullsized":"2024-09-17T05:18:48.116775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:04.746430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231310+0000","last_change":"2024-09-17T05:18:47.141968+0000","last_active":"2024-09-17T05:18:50.231310+0000","last_peered":"2024-09-17T05:18:50.231310+0000","last_clean":"2024-09-17T05:18:50.231310+0000","last_became_active":"2024-09-17T05:18:47.140975+0000","last_became_peered":"2024-09-17T05:18:47.140975+0000","last_unstale":"2024-09-17T05:18:50.231310+0000","last_undegraded":"2024-09-17T05:18:50.231310+0000","last_fullsized":"2024-09-17T05:18:50.231310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:26.840419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117384+0000","last_change":"2024-09-17T05:18:47.139264+0000","last_active":"2024-09-17T05:18:48.117384+0000","last_peered":"2024-09-17T05:18:48.117384+0000","last_clean":"2024-09-17T05:18:48.117384+0000","last_became_active":"2024-09-17T05:18:47.138194+0000","last_became_peered":"2024-09-17T05:18:47.138194+0000","last_unstale":"2024-09-17T05:18:48.117384+0000","last_undegraded":"2024-09-17T05:18:48.117384+0000","last_fullsized":"2024-09-17T05:18:48.117384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:25.146819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118769+0000","last_change":"2024-09-17T05:18:47.136270+0000","last_active":"2024-09-17T05:18:48.118769+0000","last_peered":"2024-09-17T05:18:48.118769+0000","last_clean":"2024-09-17T05:18:48.118769+0000","last_became_active":"2024-09-17T05:18:47.136004+0000","last_became_peered":"2024-09-17T05:18:47.136004+0000","last_unstale":"2024-09-17T05:18:48.118769+0000","last_undegraded":"2024-09-17T05:18:48.118769+0000","last_fullsized":"2024-09-17T05:18:48.118769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133953+0000","last_change":"2024-09-17T05:18:47.136733+0000","last_active":"2024-09-17T05:18:48.133953+0000","last_peered":"2024-09-17T05:18:48.133953+0000","last_clean":"2024-09-17T05:18:48.133953+0000","last_became_active":"2024-09-17T05:18:47.136447+0000","last_became_peered":"2024-09-17T05:18:47.136447+0000","last_unstale":"2024-09-17T05:18:48.133953+0000","last_undegraded":"2024-09-17T05:18:48.133953+0000","last_fullsized":"2024-09-17T05:18:48.133953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117191+0000","last_change":"2024-09-17T05:18:47.140039+0000","last_active":"2024-09-17T05:18:48.117191+0000","last_peered":"2024-09-17T05:18:48.117191+0000","last_clean":"2024-09-17T05:18:48.117191+0000","last_became_active":"2024-09-17T05:18:47.139761+0000","last_became_peered":"2024-09-17T05:18:47.139761+0000","last_unstale":"2024-09-17T05:18:48.117191+0000","last_undegraded":"2024-09-17T05:18:48.117191+0000","last_fullsized":"2024-09-17T05:18:48.117191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:01.434619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601560+0000","last_change":"2024-09-17T05:18:47.137341+0000","last_active":"2024-09-17T05:18:49.601560+0000","last_peered":"2024-09-17T05:18:49.601560+0000","last_clean":"2024-09-17T05:18:49.601560+0000","last_became_active":"2024-09-17T05:18:47.136527+0000","last_became_peered":"2024-09-17T05:18:47.136527+0000","last_unstale":"2024-09-17T05:18:49.601560+0000","last_undegraded":"2024-09-17T05:18:49.601560+0000","last_fullsized":"2024-09-17T05:18:49.601560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:03.207999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231542+0000","last_change":"2024-09-17T05:18:47.132046+0000","last_active":"2024-09-17T05:18:50.231542+0000","last_peered":"2024-09-17T05:18:50.231542+0000","last_clean":"2024-09-17T05:18:50.231542+0000","last_became_active":"2024-09-17T05:18:47.131385+0000","last_became_peered":"2024-09-17T05:18:47.131385+0000","last_unstale":"2024-09-17T05:18:50.231542+0000","last_undegraded":"2024-09-17T05:18:50.231542+0000","last_fullsized":"2024-09-17T05:18:50.231542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:41.148848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231335+0000","last_change":"2024-09-17T05:18:47.136879+0000","last_active":"2024-09-17T05:18:50.231335+0000","last_peered":"2024-09-17T05:18:50.231335+0000","last_clean":"2024-09-17T05:18:50.231335+0000","last_became_active":"2024-09-17T05:18:47.136546+0000","last_became_peered":"2024-09-17T05:18:47.136546+0000","last_unstale":"2024-09-17T05:18:50.231335+0000","last_undegraded":"2024-09-17T05:18:50.231335+0000","last_fullsized":"2024-09-17T05:18:50.231335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:33.294659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117882+0000","last_change":"2024-09-17T05:18:47.133776+0000","last_active":"2024-09-17T05:18:48.117882+0000","last_peered":"2024-09-17T05:18:48.117882+0000","last_clean":"2024-09-17T05:18:48.117882+0000","last_became_active":"2024-09-17T05:18:47.133252+0000","last_became_peered":"2024-09-17T05:18:47.133252+0000","last_unstale":"2024-09-17T05:18:48.117882+0000","last_undegraded":"2024-09-17T05:18:48.117882+0000","last_fullsized":"2024-09-17T05:18:48.117882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:21.942728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118120+0000","last_change":"2024-09-17T05:18:47.130903+0000","last_active":"2024-09-17T05:18:48.118120+0000","last_peered":"2024-09-17T05:18:48.118120+0000","last_clean":"2024-09-17T05:18:48.118120+0000","last_became_active":"2024-09-17T05:18:47.130394+0000","last_became_peered":"2024-09-17T05:18:47.130394+0000","last_unstale":"2024-09-17T05:18:48.118120+0000","last_undegraded":"2024-09-17T05:18:48.118120+0000","last_fullsized":"2024-09-17T05:18:48.118120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:28.751511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117205+0000","last_change":"2024-09-17T05:18:46.133224+0000","last_active":"2024-09-17T05:18:48.117205+0000","last_peered":"2024-09-17T05:18:48.117205+0000","last_clean":"2024-09-17T05:18:48.117205+0000","last_became_active":"2024-09-17T05:18:46.132897+0000","last_became_peered":"2024-09-17T05:18:46.132897+0000","last_unstale":"2024-09-17T05:18:48.117205+0000","last_undegraded":"2024-09-17T05:18:48.117205+0000","last_fullsized":"2024-09-17T05:18:48.117205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601713+0000","last_change":"2024-09-17T05:18:47.135685+0000","last_active":"2024-09-17T05:18:49.601713+0000","last_peered":"2024-09-17T05:18:49.601713+0000","last_clean":"2024-09-17T05:18:49.601713+0000","last_became_active":"2024-09-17T05:18:47.134928+0000","last_became_peered":"2024-09-17T05:18:47.134928+0000","last_unstale":"2024-09-17T05:18:49.601713+0000","last_undegraded":"2024-09-17T05:18:49.601713+0000","last_fullsized":"2024-09-17T05:18:49.601713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:15.838865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118259+0000","last_change":"2024-09-17T05:18:46.131904+0000","last_active":"2024-09-17T05:18:48.118259+0000","last_peered":"2024-09-17T05:18:48.118259+0000","last_clean":"2024-09-17T05:18:48.118259+0000","last_became_active":"2024-09-17T05:18:46.131515+0000","last_became_peered":"2024-09-17T05:18:46.131515+0000","last_unstale":"2024-09-17T05:18:48.118259+0000","last_undegraded":"2024-09-17T05:18:48.118259+0000","last_fullsized":"2024-09-17T05:18:48.118259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116839+0000","last_change":"2024-09-17T05:18:46.130687+0000","last_active":"2024-09-17T05:18:48.116839+0000","last_peered":"2024-09-17T05:18:48.116839+0000","last_clean":"2024-09-17T05:18:48.116839+0000","last_became_active":"2024-09-17T05:18:46.130402+0000","last_became_peered":"2024-09-17T05:18:46.130402+0000","last_unstale":"2024-09-17T05:18:48.116839+0000","last_undegraded":"2024-09-17T05:18:48.116839+0000","last_fullsized":"2024-09-17T05:18:48.116839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116831+0000","last_change":"2024-09-17T05:18:47.133243+0000","last_active":"2024-09-17T05:18:48.116831+0000","last_peered":"2024-09-17T05:18:48.116831+0000","last_clean":"2024-09-17T05:18:48.116831+0000","last_became_active":"2024-09-17T05:18:47.132942+0000","last_became_peered":"2024-09-17T05:18:47.132942+0000","last_unstale":"2024-09-17T05:18:48.116831+0000","last_undegraded":"2024-09-17T05:18:48.116831+0000","last_fullsized":"2024-09-17T05:18:48.116831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:26.505376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231432+0000","last_change":"2024-09-17T05:18:46.135197+0000","last_active":"2024-09-17T05:18:50.231432+0000","last_peered":"2024-09-17T05:18:50.231432+0000","last_clean":"2024-09-17T05:18:50.231432+0000","last_became_active":"2024-09-17T05:18:46.134931+0000","last_became_peered":"2024-09-17T05:18:46.134931+0000","last_unstale":"2024-09-17T05:18:50.231432+0000","last_undegraded":"2024-09-17T05:18:50.231432+0000","last_fullsized":"2024-09-17T05:18:50.231432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133775+0000","last_change":"2024-09-17T05:18:47.130413+0000","last_active":"2024-09-17T05:18:48.133775+0000","last_peered":"2024-09-17T05:18:48.133775+0000","last_clean":"2024-09-17T05:18:48.133775+0000","last_became_active":"2024-09-17T05:18:47.130080+0000","last_became_peered":"2024-09-17T05:18:47.130080+0000","last_unstale":"2024-09-17T05:18:48.133775+0000","last_undegraded":"2024-09-17T05:18:48.133775+0000","last_fullsized":"2024-09-17T05:18:48.133775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:43.112366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118861+0000","last_change":"2024-09-17T05:18:46.137454+0000","last_active":"2024-09-17T05:18:48.118861+0000","last_peered":"2024-09-17T05:18:48.118861+0000","last_clean":"2024-09-17T05:18:48.118861+0000","last_became_active":"2024-09-17T05:18:46.136894+0000","last_became_peered":"2024-09-17T05:18:46.136894+0000","last_unstale":"2024-09-17T05:18:48.118861+0000","last_undegraded":"2024-09-17T05:18:48.118861+0000","last_fullsized":"2024-09-17T05:18:48.118861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231721+0000","last_change":"2024-09-17T05:18:47.140250+0000","last_active":"2024-09-17T05:18:50.231721+0000","last_peered":"2024-09-17T05:18:50.231721+0000","last_clean":"2024-09-17T05:18:50.231721+0000","last_became_active":"2024-09-17T05:18:47.136798+0000","last_became_peered":"2024-09-17T05:18:47.136798+0000","last_unstale":"2024-09-17T05:18:50.231721+0000","last_undegraded":"2024-09-17T05:18:50.231721+0000","last_fullsized":"2024-09-17T05:18:50.231721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:56.761963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231795+0000","last_change":"2024-09-17T05:18:46.136107+0000","last_active":"2024-09-17T05:18:50.231795+0000","last_peered":"2024-09-17T05:18:50.231795+0000","last_clean":"2024-09-17T05:18:50.231795+0000","last_became_active":"2024-09-17T05:18:46.135733+0000","last_became_peered":"2024-09-17T05:18:46.135733+0000","last_unstale":"2024-09-17T05:18:50.231795+0000","last_undegraded":"2024-09-17T05:18:50.231795+0000","last_fullsized":"2024-09-17T05:18:50.231795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601463+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:49.601463+0000","last_peered":"2024-09-17T05:18:49.601463+0000","last_clean":"2024-09-17T05:18:49.601463+0000","last_became_active":"2024-09-17T05:18:47.139941+0000","last_became_peered":"2024-09-17T05:18:47.139941+0000","last_unstale":"2024-09-17T05:18:49.601463+0000","last_undegraded":"2024-09-17T05:18:49.601463+0000","last_fullsized":"2024-09-17T05:18:49.601463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:14.786078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133942+0000","last_change":"2024-09-17T05:18:46.133330+0000","last_active":"2024-09-17T05:18:48.133942+0000","last_peered":"2024-09-17T05:18:48.133942+0000","last_clean":"2024-09-17T05:18:48.133942+0000","last_became_active":"2024-09-17T05:18:46.133026+0000","last_became_peered":"2024-09-17T05:18:46.133026+0000","last_unstale":"2024-09-17T05:18:48.133942+0000","last_undegraded":"2024-09-17T05:18:48.133942+0000","last_fullsized":"2024-09-17T05:18:48.133942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118942+0000","last_change":"2024-09-17T05:18:47.131328+0000","last_active":"2024-09-17T05:18:48.118942+0000","last_peered":"2024-09-17T05:18:48.118942+0000","last_clean":"2024-09-17T05:18:48.118942+0000","last_became_active":"2024-09-17T05:18:47.131061+0000","last_became_peered":"2024-09-17T05:18:47.131061+0000","last_unstale":"2024-09-17T05:18:48.118942+0000","last_undegraded":"2024-09-17T05:18:48.118942+0000","last_fullsized":"2024-09-17T05:18:48.118942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:39.011324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118502+0000","last_change":"2024-09-17T05:18:46.133755+0000","last_active":"2024-09-17T05:18:48.118502+0000","last_peered":"2024-09-17T05:18:48.118502+0000","last_clean":"2024-09-17T05:18:48.118502+0000","last_became_active":"2024-09-17T05:18:46.133067+0000","last_became_peered":"2024-09-17T05:18:46.133067+0000","last_unstale":"2024-09-17T05:18:48.118502+0000","last_undegraded":"2024-09-17T05:18:48.118502+0000","last_fullsized":"2024-09-17T05:18:48.118502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901995+0000","last_change":"2024-09-17T05:18:47.133656+0000","last_active":"2024-09-17T05:18:48.901995+0000","last_peered":"2024-09-17T05:18:48.901995+0000","last_clean":"2024-09-17T05:18:48.901995+0000","last_became_active":"2024-09-17T05:18:47.133360+0000","last_became_peered":"2024-09-17T05:18:47.133360+0000","last_unstale":"2024-09-17T05:18:48.901995+0000","last_undegraded":"2024-09-17T05:18:48.901995+0000","last_fullsized":"2024-09-17T05:18:48.901995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:22.064282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601712+0000","last_change":"2024-09-17T05:18:46.129204+0000","last_active":"2024-09-17T05:18:49.601712+0000","last_peered":"2024-09-17T05:18:49.601712+0000","last_clean":"2024-09-17T05:18:49.601712+0000","last_became_active":"2024-09-17T05:18:46.128901+0000","last_became_peered":"2024-09-17T05:18:46.128901+0000","last_unstale":"2024-09-17T05:18:49.601712+0000","last_undegraded":"2024-09-17T05:18:49.601712+0000","last_fullsized":"2024-09-17T05:18:49.601712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:39.714747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601315+0000","last_change":"2024-09-17T05:18:47.136191+0000","last_active":"2024-09-17T05:18:49.601315+0000","last_peered":"2024-09-17T05:18:49.601315+0000","last_clean":"2024-09-17T05:18:49.601315+0000","last_became_active":"2024-09-17T05:18:47.135912+0000","last_became_peered":"2024-09-17T05:18:47.135912+0000","last_unstale":"2024-09-17T05:18:49.601315+0000","last_undegraded":"2024-09-17T05:18:49.601315+0000","last_fullsized":"2024-09-17T05:18:49.601315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.562603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231754+0000","last_change":"2024-09-17T05:18:46.132187+0000","last_active":"2024-09-17T05:18:50.231754+0000","last_peered":"2024-09-17T05:18:50.231754+0000","last_clean":"2024-09-17T05:18:50.231754+0000","last_became_active":"2024-09-17T05:18:46.131916+0000","last_became_peered":"2024-09-17T05:18:46.131916+0000","last_unstale":"2024-09-17T05:18:50.231754+0000","last_undegraded":"2024-09-17T05:18:50.231754+0000","last_fullsized":"2024-09-17T05:18:50.231754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902185+0000","last_change":"2024-09-17T05:18:47.139925+0000","last_active":"2024-09-17T05:18:48.902185+0000","last_peered":"2024-09-17T05:18:48.902185+0000","last_clean":"2024-09-17T05:18:48.902185+0000","last_became_active":"2024-09-17T05:18:47.139357+0000","last_became_peered":"2024-09-17T05:18:47.139357+0000","last_unstale":"2024-09-17T05:18:48.902185+0000","last_undegraded":"2024-09-17T05:18:48.902185+0000","last_fullsized":"2024-09-17T05:18:48.902185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:51.210414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118150+0000","last_change":"2024-09-17T05:18:46.131494+0000","last_active":"2024-09-17T05:18:48.118150+0000","last_peered":"2024-09-17T05:18:48.118150+0000","last_clean":"2024-09-17T05:18:48.118150+0000","last_became_active":"2024-09-17T05:18:46.131210+0000","last_became_peered":"2024-09-17T05:18:46.131210+0000","last_unstale":"2024-09-17T05:18:48.118150+0000","last_undegraded":"2024-09-17T05:18:48.118150+0000","last_fullsized":"2024-09-17T05:18:48.118150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118112+0000","last_change":"2024-09-17T05:18:47.133501+0000","last_active":"2024-09-17T05:18:48.118112+0000","last_peered":"2024-09-17T05:18:48.118112+0000","last_clean":"2024-09-17T05:18:48.118112+0000","last_became_active":"2024-09-17T05:18:47.132900+0000","last_became_peered":"2024-09-17T05:18:47.132900+0000","last_unstale":"2024-09-17T05:18:48.118112+0000","last_undegraded":"2024-09-17T05:18:48.118112+0000","last_fullsized":"2024-09-17T05:18:48.118112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.887461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231255+0000","last_change":"2024-09-17T05:18:46.127329+0000","last_active":"2024-09-17T05:18:50.231255+0000","last_peered":"2024-09-17T05:18:50.231255+0000","last_clean":"2024-09-17T05:18:50.231255+0000","last_became_active":"2024-09-17T05:18:46.126863+0000","last_became_peered":"2024-09-17T05:18:46.126863+0000","last_unstale":"2024-09-17T05:18:50.231255+0000","last_undegraded":"2024-09-17T05:18:50.231255+0000","last_fullsized":"2024-09-17T05:18:50.231255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901789+0000","last_change":"2024-09-17T05:18:47.140406+0000","last_active":"2024-09-17T05:18:48.901789+0000","last_peered":"2024-09-17T05:18:48.901789+0000","last_clean":"2024-09-17T05:18:48.901789+0000","last_became_active":"2024-09-17T05:18:47.140107+0000","last_became_peered":"2024-09-17T05:18:47.140107+0000","last_unstale":"2024-09-17T05:18:48.901789+0000","last_undegraded":"2024-09-17T05:18:48.901789+0000","last_fullsized":"2024-09-17T05:18:48.901789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:25.146819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118276+0000","last_change":"2024-09-17T05:18:46.130487+0000","last_active":"2024-09-17T05:18:48.118276+0000","last_peered":"2024-09-17T05:18:48.118276+0000","last_clean":"2024-09-17T05:18:48.118276+0000","last_became_active":"2024-09-17T05:18:46.130163+0000","last_became_peered":"2024-09-17T05:18:46.130163+0000","last_unstale":"2024-09-17T05:18:48.118276+0000","last_undegraded":"2024-09-17T05:18:48.118276+0000","last_fullsized":"2024-09-17T05:18:48.118276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:42.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902294+0000","last_change":"2024-09-17T05:18:47.142853+0000","last_active":"2024-09-17T05:18:48.902294+0000","last_peered":"2024-09-17T05:18:48.902294+0000","last_clean":"2024-09-17T05:18:48.902294+0000","last_became_active":"2024-09-17T05:18:47.142286+0000","last_became_peered":"2024-09-17T05:18:47.142286+0000","last_unstale":"2024-09-17T05:18:48.902294+0000","last_undegraded":"2024-09-17T05:18:48.902294+0000","last_fullsized":"2024-09-17T05:18:48.902294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:46.403703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231493+0000","last_change":"2024-09-17T05:18:46.129081+0000","last_active":"2024-09-17T05:18:50.231493+0000","last_peered":"2024-09-17T05:18:50.231493+0000","last_clean":"2024-09-17T05:18:50.231493+0000","last_became_active":"2024-09-17T05:18:46.128776+0000","last_became_peered":"2024-09-17T05:18:46.128776+0000","last_unstale":"2024-09-17T05:18:50.231493+0000","last_undegraded":"2024-09-17T05:18:50.231493+0000","last_fullsized":"2024-09-17T05:18:50.231493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902419+0000","last_change":"2024-09-17T05:18:47.139542+0000","last_active":"2024-09-17T05:18:48.902419+0000","last_peered":"2024-09-17T05:18:48.902419+0000","last_clean":"2024-09-17T05:18:48.902419+0000","last_became_active":"2024-09-17T05:18:47.139188+0000","last_became_peered":"2024-09-17T05:18:47.139188+0000","last_unstale":"2024-09-17T05:18:48.902419+0000","last_undegraded":"2024-09-17T05:18:48.902419+0000","last_fullsized":"2024-09-17T05:18:48.902419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:26.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134047+0000","last_change":"2024-09-17T05:18:46.132599+0000","last_active":"2024-09-17T05:18:48.134047+0000","last_peered":"2024-09-17T05:18:48.134047+0000","last_clean":"2024-09-17T05:18:48.134047+0000","last_became_active":"2024-09-17T05:18:46.132293+0000","last_became_peered":"2024-09-17T05:18:46.132293+0000","last_unstale":"2024-09-17T05:18:48.134047+0000","last_undegraded":"2024-09-17T05:18:48.134047+0000","last_fullsized":"2024-09-17T05:18:48.134047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:38.005194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231721+0000","last_change":"2024-09-17T05:18:47.132917+0000","last_active":"2024-09-17T05:18:50.231721+0000","last_peered":"2024-09-17T05:18:50.231721+0000","last_clean":"2024-09-17T05:18:50.231721+0000","last_became_active":"2024-09-17T05:18:47.132647+0000","last_became_peered":"2024-09-17T05:18:47.132647+0000","last_unstale":"2024-09-17T05:18:50.231721+0000","last_undegraded":"2024-09-17T05:18:50.231721+0000","last_fullsized":"2024-09-17T05:18:50.231721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:58.901485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231411+0000","last_change":"2024-09-17T05:18:46.127182+0000","last_active":"2024-09-17T05:18:50.231411+0000","last_peered":"2024-09-17T05:18:50.231411+0000","last_clean":"2024-09-17T05:18:50.231411+0000","last_became_active":"2024-09-17T05:18:46.126903+0000","last_became_peered":"2024-09-17T05:18:46.126903+0000","last_unstale":"2024-09-17T05:18:50.231411+0000","last_undegraded":"2024-09-17T05:18:50.231411+0000","last_fullsized":"2024-09-17T05:18:50.231411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902120+0000","last_change":"2024-09-17T05:18:47.141769+0000","last_active":"2024-09-17T05:18:48.902120+0000","last_peered":"2024-09-17T05:18:48.902120+0000","last_clean":"2024-09-17T05:18:48.902120+0000","last_became_active":"2024-09-17T05:18:47.141454+0000","last_became_peered":"2024-09-17T05:18:47.141454+0000","last_unstale":"2024-09-17T05:18:48.902120+0000","last_undegraded":"2024-09-17T05:18:48.902120+0000","last_fullsized":"2024-09-17T05:18:48.902120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:46.015055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901837+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:18:48.901837+0000","last_peered":"2024-09-17T05:18:48.901837+0000","last_clean":"2024-09-17T05:18:48.901837+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:18:48.901837+0000","last_undegraded":"2024-09-17T05:18:48.901837+0000","last_fullsized":"2024-09-17T05:18:48.901837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231276+0000","last_change":"2024-09-17T05:18:46.127446+0000","last_active":"2024-09-17T05:18:50.231276+0000","last_peered":"2024-09-17T05:18:50.231276+0000","last_clean":"2024-09-17T05:18:50.231276+0000","last_became_active":"2024-09-17T05:18:46.126901+0000","last_became_peered":"2024-09-17T05:18:46.126901+0000","last_unstale":"2024-09-17T05:18:50.231276+0000","last_undegraded":"2024-09-17T05:18:50.231276+0000","last_fullsized":"2024-09-17T05:18:50.231276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116985+0000","last_change":"2024-09-17T05:18:47.144541+0000","last_active":"2024-09-17T05:18:48.116985+0000","last_peered":"2024-09-17T05:18:48.116985+0000","last_clean":"2024-09-17T05:18:48.116985+0000","last_became_active":"2024-09-17T05:18:47.144205+0000","last_became_peered":"2024-09-17T05:18:47.144205+0000","last_unstale":"2024-09-17T05:18:48.116985+0000","last_undegraded":"2024-09-17T05:18:48.116985+0000","last_fullsized":"2024-09-17T05:18:48.116985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:44.033449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901605+0000","last_change":"2024-09-17T05:18:46.141132+0000","last_active":"2024-09-17T05:18:48.901605+0000","last_peered":"2024-09-17T05:18:48.901605+0000","last_clean":"2024-09-17T05:18:48.901605+0000","last_became_active":"2024-09-17T05:18:46.140364+0000","last_became_peered":"2024-09-17T05:18:46.140364+0000","last_unstale":"2024-09-17T05:18:48.901605+0000","last_undegraded":"2024-09-17T05:18:48.901605+0000","last_fullsized":"2024-09-17T05:18:48.901605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:14.427012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601207+0000","last_change":"2024-09-17T05:18:47.139416+0000","last_active":"2024-09-17T05:18:49.601207+0000","last_peered":"2024-09-17T05:18:49.601207+0000","last_clean":"2024-09-17T05:18:49.601207+0000","last_became_active":"2024-09-17T05:18:47.139149+0000","last_became_peered":"2024-09-17T05:18:47.139149+0000","last_unstale":"2024-09-17T05:18:49.601207+0000","last_undegraded":"2024-09-17T05:18:49.601207+0000","last_fullsized":"2024-09-17T05:18:49.601207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:15.157191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231382+0000","last_change":"2024-09-17T05:18:46.129101+0000","last_active":"2024-09-17T05:18:50.231382+0000","last_peered":"2024-09-17T05:18:50.231382+0000","last_clean":"2024-09-17T05:18:50.231382+0000","last_became_active":"2024-09-17T05:18:46.128748+0000","last_became_peered":"2024-09-17T05:18:46.128748+0000","last_unstale":"2024-09-17T05:18:50.231382+0000","last_undegraded":"2024-09-17T05:18:50.231382+0000","last_fullsized":"2024-09-17T05:18:50.231382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:01.709036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133772+0000","last_change":"2024-09-17T05:18:47.131649+0000","last_active":"2024-09-17T05:18:48.133772+0000","last_peered":"2024-09-17T05:18:48.133772+0000","last_clean":"2024-09-17T05:18:48.133772+0000","last_became_active":"2024-09-17T05:18:47.131360+0000","last_became_peered":"2024-09-17T05:18:47.131360+0000","last_unstale":"2024-09-17T05:18:48.133772+0000","last_undegraded":"2024-09-17T05:18:48.133772+0000","last_fullsized":"2024-09-17T05:18:48.133772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.887461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231729+0000","last_change":"2024-09-17T05:18:46.129856+0000","last_active":"2024-09-17T05:18:50.231729+0000","last_peered":"2024-09-17T05:18:50.231729+0000","last_clean":"2024-09-17T05:18:50.231729+0000","last_became_active":"2024-09-17T05:18:46.129409+0000","last_became_peered":"2024-09-17T05:18:46.129409+0000","last_unstale":"2024-09-17T05:18:50.231729+0000","last_undegraded":"2024-09-17T05:18:50.231729+0000","last_fullsized":"2024-09-17T05:18:50.231729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118122+0000","last_change":"2024-09-17T05:18:47.135559+0000","last_active":"2024-09-17T05:18:48.118122+0000","last_peered":"2024-09-17T05:18:48.118122+0000","last_clean":"2024-09-17T05:18:48.118122+0000","last_became_active":"2024-09-17T05:18:47.135267+0000","last_became_peered":"2024-09-17T05:18:47.135267+0000","last_unstale":"2024-09-17T05:18:48.118122+0000","last_undegraded":"2024-09-17T05:18:48.118122+0000","last_fullsized":"2024-09-17T05:18:48.118122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:27.485204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133876+0000","last_change":"2024-09-17T05:18:46.128837+0000","last_active":"2024-09-17T05:18:48.133876+0000","last_peered":"2024-09-17T05:18:48.133876+0000","last_clean":"2024-09-17T05:18:48.133876+0000","last_became_active":"2024-09-17T05:18:46.128576+0000","last_became_peered":"2024-09-17T05:18:46.128576+0000","last_unstale":"2024-09-17T05:18:48.133876+0000","last_undegraded":"2024-09-17T05:18:48.133876+0000","last_fullsized":"2024-09-17T05:18:48.133876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231969+0000","last_change":"2024-09-17T05:18:47.135090+0000","last_active":"2024-09-17T05:18:50.231969+0000","last_peered":"2024-09-17T05:18:50.231969+0000","last_clean":"2024-09-17T05:18:50.231969+0000","last_became_active":"2024-09-17T05:18:47.134518+0000","last_became_peered":"2024-09-17T05:18:47.134518+0000","last_unstale":"2024-09-17T05:18:50.231969+0000","last_undegraded":"2024-09-17T05:18:50.231969+0000","last_fullsized":"2024-09-17T05:18:50.231969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:28.351688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902337+0000","last_change":"2024-09-17T05:18:46.141667+0000","last_active":"2024-09-17T05:18:48.902337+0000","last_peered":"2024-09-17T05:18:48.902337+0000","last_clean":"2024-09-17T05:18:48.902337+0000","last_became_active":"2024-09-17T05:18:46.140316+0000","last_became_peered":"2024-09-17T05:18:46.140316+0000","last_unstale":"2024-09-17T05:18:48.902337+0000","last_undegraded":"2024-09-17T05:18:48.902337+0000","last_fullsized":"2024-09-17T05:18:48.902337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:32.288529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133877+0000","last_change":"2024-09-17T05:18:47.131478+0000","last_active":"2024-09-17T05:18:48.133877+0000","last_peered":"2024-09-17T05:18:48.133877+0000","last_clean":"2024-09-17T05:18:48.133877+0000","last_became_active":"2024-09-17T05:18:47.131211+0000","last_became_peered":"2024-09-17T05:18:47.131211+0000","last_unstale":"2024-09-17T05:18:48.133877+0000","last_undegraded":"2024-09-17T05:18:48.133877+0000","last_fullsized":"2024-09-17T05:18:48.133877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:07.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134091+0000","last_change":"2024-09-17T05:18:46.130971+0000","last_active":"2024-09-17T05:18:48.134091+0000","last_peered":"2024-09-17T05:18:48.134091+0000","last_clean":"2024-09-17T05:18:48.134091+0000","last_became_active":"2024-09-17T05:18:46.130678+0000","last_became_peered":"2024-09-17T05:18:46.130678+0000","last_unstale":"2024-09-17T05:18:48.134091+0000","last_undegraded":"2024-09-17T05:18:48.134091+0000","last_fullsized":"2024-09-17T05:18:48.134091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117415+0000","last_change":"2024-09-17T05:18:47.146406+0000","last_active":"2024-09-17T05:18:48.117415+0000","last_peered":"2024-09-17T05:18:48.117415+0000","last_clean":"2024-09-17T05:18:48.117415+0000","last_became_active":"2024-09-17T05:18:47.146064+0000","last_became_peered":"2024-09-17T05:18:47.146064+0000","last_unstale":"2024-09-17T05:18:48.117415+0000","last_undegraded":"2024-09-17T05:18:48.117415+0000","last_fullsized":"2024-09-17T05:18:48.117415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:55.524841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118972+0000","last_change":"2024-09-17T05:18:46.137090+0000","last_active":"2024-09-17T05:18:48.118972+0000","last_peered":"2024-09-17T05:18:48.118972+0000","last_clean":"2024-09-17T05:18:48.118972+0000","last_became_active":"2024-09-17T05:18:46.136506+0000","last_became_peered":"2024-09-17T05:18:46.136506+0000","last_unstale":"2024-09-17T05:18:48.118972+0000","last_undegraded":"2024-09-17T05:18:48.118972+0000","last_fullsized":"2024-09-17T05:18:48.118972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601508+0000","last_change":"2024-09-17T05:18:47.132848+0000","last_active":"2024-09-17T05:18:49.601508+0000","last_peered":"2024-09-17T05:18:49.601508+0000","last_clean":"2024-09-17T05:18:49.601508+0000","last_became_active":"2024-09-17T05:18:47.132504+0000","last_became_peered":"2024-09-17T05:18:47.132504+0000","last_unstale":"2024-09-17T05:18:49.601508+0000","last_undegraded":"2024-09-17T05:18:49.601508+0000","last_fullsized":"2024-09-17T05:18:49.601508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:28.843941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901581+0000","last_change":"2024-09-17T05:18:46.137719+0000","last_active":"2024-09-17T05:18:48.901581+0000","last_peered":"2024-09-17T05:18:48.901581+0000","last_clean":"2024-09-17T05:18:48.901581+0000","last_became_active":"2024-09-17T05:18:46.137459+0000","last_became_peered":"2024-09-17T05:18:46.137459+0000","last_unstale":"2024-09-17T05:18:48.901581+0000","last_undegraded":"2024-09-17T05:18:48.901581+0000","last_fullsized":"2024-09-17T05:18:48.901581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:38.005194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118618+0000","last_change":"2024-09-17T05:18:47.126967+0000","last_active":"2024-09-17T05:18:48.118618+0000","last_peered":"2024-09-17T05:18:48.118618+0000","last_clean":"2024-09-17T05:18:48.118618+0000","last_became_active":"2024-09-17T05:18:47.125840+0000","last_became_peered":"2024-09-17T05:18:47.125840+0000","last_unstale":"2024-09-17T05:18:48.118618+0000","last_undegraded":"2024-09-17T05:18:48.118618+0000","last_fullsized":"2024-09-17T05:18:48.118618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:41.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133964+0000","last_change":"2024-09-17T05:18:46.136676+0000","last_active":"2024-09-17T05:18:48.133964+0000","last_peered":"2024-09-17T05:18:48.133964+0000","last_clean":"2024-09-17T05:18:48.133964+0000","last_became_active":"2024-09-17T05:18:46.136468+0000","last_became_peered":"2024-09-17T05:18:46.136468+0000","last_unstale":"2024-09-17T05:18:48.133964+0000","last_undegraded":"2024-09-17T05:18:48.133964+0000","last_fullsized":"2024-09-17T05:18:48.133964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116957+0000","last_change":"2024-09-17T05:18:47.130998+0000","last_active":"2024-09-17T05:18:48.116957+0000","last_peered":"2024-09-17T05:18:48.116957+0000","last_clean":"2024-09-17T05:18:48.116957+0000","last_became_active":"2024-09-17T05:18:47.130307+0000","last_became_peered":"2024-09-17T05:18:47.130307+0000","last_unstale":"2024-09-17T05:18:48.116957+0000","last_undegraded":"2024-09-17T05:18:48.116957+0000","last_fullsized":"2024-09-17T05:18:48.116957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:30.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133849+0000","last_change":"2024-09-17T05:18:46.132362+0000","last_active":"2024-09-17T05:18:48.133849+0000","last_peered":"2024-09-17T05:18:48.133849+0000","last_clean":"2024-09-17T05:18:48.133849+0000","last_became_active":"2024-09-17T05:18:46.132074+0000","last_became_peered":"2024-09-17T05:18:46.132074+0000","last_unstale":"2024-09-17T05:18:48.133849+0000","last_undegraded":"2024-09-17T05:18:48.133849+0000","last_fullsized":"2024-09-17T05:18:48.133849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:32.288529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117086+0000","last_change":"2024-09-17T05:18:47.133311+0000","last_active":"2024-09-17T05:18:48.117086+0000","last_peered":"2024-09-17T05:18:48.117086+0000","last_clean":"2024-09-17T05:18:48.117086+0000","last_became_active":"2024-09-17T05:18:47.132929+0000","last_became_peered":"2024-09-17T05:18:47.132929+0000","last_unstale":"2024-09-17T05:18:48.117086+0000","last_undegraded":"2024-09-17T05:18:48.117086+0000","last_fullsized":"2024-09-17T05:18:48.117086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:14.224552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902100+0000","last_change":"2024-09-17T05:18:46.140762+0000","last_active":"2024-09-17T05:18:48.902100+0000","last_peered":"2024-09-17T05:18:48.902100+0000","last_clean":"2024-09-17T05:18:48.902100+0000","last_became_active":"2024-09-17T05:18:46.140483+0000","last_became_peered":"2024-09-17T05:18:46.140483+0000","last_unstale":"2024-09-17T05:18:48.902100+0000","last_undegraded":"2024-09-17T05:18:48.902100+0000","last_fullsized":"2024-09-17T05:18:48.902100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:11.520291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118254+0000","last_change":"2024-09-17T05:18:47.125446+0000","last_active":"2024-09-17T05:18:48.118254+0000","last_peered":"2024-09-17T05:18:48.118254+0000","last_clean":"2024-09-17T05:18:48.118254+0000","last_became_active":"2024-09-17T05:18:47.125114+0000","last_became_peered":"2024-09-17T05:18:47.125114+0000","last_unstale":"2024-09-17T05:18:48.118254+0000","last_undegraded":"2024-09-17T05:18:48.118254+0000","last_fullsized":"2024-09-17T05:18:48.118254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.280584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231984+0000","last_change":"2024-09-17T05:18:47.143858+0000","last_active":"2024-09-17T05:18:50.231984+0000","last_peered":"2024-09-17T05:18:50.231984+0000","last_clean":"2024-09-17T05:18:50.231984+0000","last_became_active":"2024-09-17T05:18:47.143613+0000","last_became_peered":"2024-09-17T05:18:47.143613+0000","last_unstale":"2024-09-17T05:18:50.231984+0000","last_undegraded":"2024-09-17T05:18:50.231984+0000","last_fullsized":"2024-09-17T05:18:50.231984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:35.695324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901919+0000","last_change":"2024-09-17T05:18:46.140678+0000","last_active":"2024-09-17T05:18:48.901919+0000","last_peered":"2024-09-17T05:18:48.901919+0000","last_clean":"2024-09-17T05:18:48.901919+0000","last_became_active":"2024-09-17T05:18:46.140137+0000","last_became_peered":"2024-09-17T05:18:46.140137+0000","last_unstale":"2024-09-17T05:18:48.901919+0000","last_undegraded":"2024-09-17T05:18:48.901919+0000","last_fullsized":"2024-09-17T05:18:48.901919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231455+0000","last_change":"2024-09-17T05:18:47.139974+0000","last_active":"2024-09-17T05:18:50.231455+0000","last_peered":"2024-09-17T05:18:50.231455+0000","last_clean":"2024-09-17T05:18:50.231455+0000","last_became_active":"2024-09-17T05:18:47.139691+0000","last_became_peered":"2024-09-17T05:18:47.139691+0000","last_unstale":"2024-09-17T05:18:50.231455+0000","last_undegraded":"2024-09-17T05:18:50.231455+0000","last_fullsized":"2024-09-17T05:18:50.231455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902180+0000","last_change":"2024-09-17T05:18:46.141012+0000","last_active":"2024-09-17T05:18:48.902180+0000","last_peered":"2024-09-17T05:18:48.902180+0000","last_clean":"2024-09-17T05:18:48.902180+0000","last_became_active":"2024-09-17T05:18:46.140729+0000","last_became_peered":"2024-09-17T05:18:46.140729+0000","last_unstale":"2024-09-17T05:18:48.902180+0000","last_undegraded":"2024-09-17T05:18:48.902180+0000","last_fullsized":"2024-09-17T05:18:48.902180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601536+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:49.601536+0000","last_peered":"2024-09-17T05:18:49.601536+0000","last_clean":"2024-09-17T05:18:49.601536+0000","last_became_active":"2024-09-17T05:18:47.140502+0000","last_became_peered":"2024-09-17T05:18:47.140502+0000","last_unstale":"2024-09-17T05:18:49.601536+0000","last_undegraded":"2024-09-17T05:18:49.601536+0000","last_fullsized":"2024-09-17T05:18:49.601536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:34.571312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117361+0000","last_change":"2024-09-17T05:18:46.126436+0000","last_active":"2024-09-17T05:18:48.117361+0000","last_peered":"2024-09-17T05:18:48.117361+0000","last_clean":"2024-09-17T05:18:48.117361+0000","last_became_active":"2024-09-17T05:18:46.126106+0000","last_became_peered":"2024-09-17T05:18:46.126106+0000","last_unstale":"2024-09-17T05:18:48.117361+0000","last_undegraded":"2024-09-17T05:18:48.117361+0000","last_fullsized":"2024-09-17T05:18:48.117361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117337+0000","last_change":"2024-09-17T05:18:47.135662+0000","last_active":"2024-09-17T05:18:48.117337+0000","last_peered":"2024-09-17T05:18:48.117337+0000","last_clean":"2024-09-17T05:18:48.117337+0000","last_became_active":"2024-09-17T05:18:47.135205+0000","last_became_peered":"2024-09-17T05:18:47.135205+0000","last_unstale":"2024-09-17T05:18:48.117337+0000","last_undegraded":"2024-09-17T05:18:48.117337+0000","last_fullsized":"2024-09-17T05:18:48.117337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601609+0000","last_change":"2024-09-17T05:18:46.135269+0000","last_active":"2024-09-17T05:18:49.601609+0000","last_peered":"2024-09-17T05:18:49.601609+0000","last_clean":"2024-09-17T05:18:49.601609+0000","last_became_active":"2024-09-17T05:18:46.135042+0000","last_became_peered":"2024-09-17T05:18:46.135042+0000","last_unstale":"2024-09-17T05:18:49.601609+0000","last_undegraded":"2024-09-17T05:18:49.601609+0000","last_fullsized":"2024-09-17T05:18:49.601609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:44.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:18:58.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:18:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 -- 172.21.15.81:0/1661836853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 msgr2=0x7f57380ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1661836853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380ceac0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f5730009ca0 tx=0x7f573002aa30 comp rx=0 tx=0).stop 2024-09-17T05:18:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 -- 172.21.15.81:0/1661836853 shutdown_connections 2024-09-17T05:18:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1661836853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380ceac0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1661836853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5738159680 0x7f573815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 -- 172.21.15.81:0/1661836853 >> 172.21.15.81:0/1661836853 conn(0x7f57380b1690 msgr2=0x7f57380b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 -- 172.21.15.81:0/1661836853 shutdown_connections 2024-09-17T05:18:58.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.567+0000 7f573ca9b640 1 -- 172.21.15.81:0/1661836853 wait complete. 2024-09-17T05:18:58.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.568+0000 7f573ca9b640 1 Processor -- start 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.568+0000 7f573ca9b640 1 -- start start 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f573ca9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57380cc490 0x7f57381f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f573ca9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5738159680 0x7f57380b43c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f573ca9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f573ca9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f57380cca50 con 0x7f573815fe60 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f573ca9b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57380cc8d0 con 0x7f5738159680 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f573ca9b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f57380ccbd0 con 0x7f57380cc490 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38710/0 (socket says 172.21.15.81:38710) 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 -- 172.21.15.81:0/1597302290 learned_addr learned my addr 172.21.15.81:0/1597302290 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:58.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5735d9b640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5738159680 0x7f57380b43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f573659c640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57380cc490 0x7f57381f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 -- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57380cc490 msgr2=0x7f57381f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57380cc490 0x7f57381f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 -- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5738159680 msgr2=0x7f57380b43c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5738159680 0x7f57380b43c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 -- 172.21.15.81:0/1597302290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57380b4900 con 0x7f573815fe60 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.569+0000 7f5736d9d640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380aecd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5730009ca0 tx=0x7f5730003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.570+0000 7f5726ffd640 1 -- 172.21.15.81:0/1597302290 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730033050 con 0x7f573815fe60 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.570+0000 7f5726ffd640 1 -- 172.21.15.81:0/1597302290 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5730004550 con 0x7f573815fe60 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.570+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57380b2c50 con 0x7f573815fe60 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.570+0000 7f5726ffd640 1 -- 172.21.15.81:0/1597302290 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5730038450 con 0x7f573815fe60 2024-09-17T05:18:58.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.570+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57380b3210 con 0x7f573815fe60 2024-09-17T05:18:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.570+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57380cf2a0 con 0x7f573815fe60 2024-09-17T05:18:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.571+0000 7f5726ffd640 1 -- 172.21.15.81:0/1597302290 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5730036070 con 0x7f573815fe60 2024-09-17T05:18:58.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.572+0000 7f5726ffd640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5718078b90 0x7f571807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.572+0000 7f5726ffd640 1 -- 172.21.15.81:0/1597302290 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f57300bc0b0 con 0x7f573815fe60 2024-09-17T05:18:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.572+0000 7f573659c640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5718078b90 0x7f571807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.572+0000 7f573659c640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5718078b90 0x7f571807b050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5738158420 tx=0x7f5728008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:58.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.576+0000 7f5726ffd640 1 -- 172.21.15.81:0/1597302290 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f57380b4900 con 0x7f573815fe60 2024-09-17T05:18:58.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.751+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f573815e880 con 0x7f5718078b90 2024-09-17T05:18:58.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.755+0000 7f5726ffd640 1 -- 172.21.15.81:0/1597302290 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251826 (secure 0 0 0) 0x7f573815e880 con 0x7f5718078b90 2024-09-17T05:18:58.759 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:58.760 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:18:58.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.758+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5718078b90 msgr2=0x7f571807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.758+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5718078b90 0x7f571807b050 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f5738158420 tx=0x7f5728008040 comp rx=0 tx=0).stop 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.758+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 msgr2=0x7f57380aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.758+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380aecd0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f5730009ca0 tx=0x7f5730003f10 comp rx=0 tx=0).stop 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 shutdown_connections 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5718078b90 0x7f571807b050 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f573815fe60 0x7f57380aecd0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5738159680 0x7f57380b43c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 --2- 172.21.15.81:0/1597302290 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57380cc490 0x7f57381f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 >> 172.21.15.81:0/1597302290 conn(0x7f57380b1690 msgr2=0x7f573815eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 shutdown_connections 2024-09-17T05:18:58.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.759+0000 7f573ca9b640 1 -- 172.21.15.81:0/1597302290 wait complete. 2024-09-17T05:18:58.770 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":28,"stamp":"2024-09-17T05:18:57.375893+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":219296,"kb_used_data":3048,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755424,"statfs":{"total":773094113280,"available":772869554176,"internally_reserved":0,"allocated":3121152,"data_stored":1835436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001932"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902236+0000","last_change":"2024-09-17T05:18:47.135396+0000","last_active":"2024-09-17T05:18:48.902236+0000","last_peered":"2024-09-17T05:18:48.902236+0000","last_clean":"2024-09-17T05:18:48.902236+0000","last_became_active":"2024-09-17T05:18:47.135102+0000","last_became_peered":"2024-09-17T05:18:47.135102+0000","last_unstale":"2024-09-17T05:18:48.902236+0000","last_undegraded":"2024-09-17T05:18:48.902236+0000","last_fullsized":"2024-09-17T05:18:48.902236+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:17.057030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134032+0000","last_change":"2024-09-17T05:18:47.134404+0000","last_active":"2024-09-17T05:18:48.134032+0000","last_peered":"2024-09-17T05:18:48.134032+0000","last_clean":"2024-09-17T05:18:48.134032+0000","last_became_active":"2024-09-17T05:18:47.133993+0000","last_became_peered":"2024-09-17T05:18:47.133993+0000","last_unstale":"2024-09-17T05:18:48.134032+0000","last_undegraded":"2024-09-17T05:18:48.134032+0000","last_fullsized":"2024-09-17T05:18:48.134032+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601365+0000","last_change":"2024-09-17T05:18:47.133451+0000","last_active":"2024-09-17T05:18:49.601365+0000","last_peered":"2024-09-17T05:18:49.601365+0000","last_clean":"2024-09-17T05:18:49.601365+0000","last_became_active":"2024-09-17T05:18:47.133212+0000","last_became_peered":"2024-09-17T05:18:47.133212+0000","last_unstale":"2024-09-17T05:18:49.601365+0000","last_undegraded":"2024-09-17T05:18:49.601365+0000","last_fullsized":"2024-09-17T05:18:49.601365+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:06.687774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231441+0000","last_change":"2024-09-17T05:18:47.140539+0000","last_active":"2024-09-17T05:18:50.231441+0000","last_peered":"2024-09-17T05:18:50.231441+0000","last_clean":"2024-09-17T05:18:50.231441+0000","last_became_active":"2024-09-17T05:18:47.139262+0000","last_became_peered":"2024-09-17T05:18:47.139262+0000","last_unstale":"2024-09-17T05:18:50.231441+0000","last_undegraded":"2024-09-17T05:18:50.231441+0000","last_fullsized":"2024-09-17T05:18:50.231441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:27:55.646018+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901799+0000","last_change":"2024-09-17T05:18:47.145770+0000","last_active":"2024-09-17T05:18:48.901799+0000","last_peered":"2024-09-17T05:18:48.901799+0000","last_clean":"2024-09-17T05:18:48.901799+0000","last_became_active":"2024-09-17T05:18:47.145480+0000","last_became_peered":"2024-09-17T05:18:47.145480+0000","last_unstale":"2024-09-17T05:18:48.901799+0000","last_undegraded":"2024-09-17T05:18:48.901799+0000","last_fullsized":"2024-09-17T05:18:48.901799+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:55.524841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231267+0000","last_change":"2024-09-17T05:18:47.133339+0000","last_active":"2024-09-17T05:18:50.231267+0000","last_peered":"2024-09-17T05:18:50.231267+0000","last_clean":"2024-09-17T05:18:50.231267+0000","last_became_active":"2024-09-17T05:18:47.133085+0000","last_became_peered":"2024-09-17T05:18:47.133085+0000","last_unstale":"2024-09-17T05:18:50.231267+0000","last_undegraded":"2024-09-17T05:18:50.231267+0000","last_fullsized":"2024-09-17T05:18:50.231267+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901734+0000","last_change":"2024-09-17T05:18:47.135045+0000","last_active":"2024-09-17T05:18:48.901734+0000","last_peered":"2024-09-17T05:18:48.901734+0000","last_clean":"2024-09-17T05:18:48.901734+0000","last_became_active":"2024-09-17T05:18:47.134770+0000","last_became_peered":"2024-09-17T05:18:47.134770+0000","last_unstale":"2024-09-17T05:18:48.901734+0000","last_undegraded":"2024-09-17T05:18:48.901734+0000","last_fullsized":"2024-09-17T05:18:48.901734+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116753+0000","last_change":"2024-09-17T05:18:47.144464+0000","last_active":"2024-09-17T05:18:48.116753+0000","last_peered":"2024-09-17T05:18:48.116753+0000","last_clean":"2024-09-17T05:18:48.116753+0000","last_became_active":"2024-09-17T05:18:47.144111+0000","last_became_peered":"2024-09-17T05:18:47.144111+0000","last_unstale":"2024-09-17T05:18:48.116753+0000","last_undegraded":"2024-09-17T05:18:48.116753+0000","last_fullsized":"2024-09-17T05:18:48.116753+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:08.620872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902314+0000","last_change":"2024-09-17T05:18:47.143214+0000","last_active":"2024-09-17T05:18:48.902314+0000","last_peered":"2024-09-17T05:18:48.902314+0000","last_clean":"2024-09-17T05:18:48.902314+0000","last_became_active":"2024-09-17T05:18:47.142377+0000","last_became_peered":"2024-09-17T05:18:47.142377+0000","last_unstale":"2024-09-17T05:18:48.902314+0000","last_undegraded":"2024-09-17T05:18:48.902314+0000","last_fullsized":"2024-09-17T05:18:48.902314+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:04.186259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118741+0000","last_change":"2024-09-17T05:18:47.129022+0000","last_active":"2024-09-17T05:18:48.118741+0000","last_peered":"2024-09-17T05:18:48.118741+0000","last_clean":"2024-09-17T05:18:48.118741+0000","last_became_active":"2024-09-17T05:18:47.128776+0000","last_became_peered":"2024-09-17T05:18:47.128776+0000","last_unstale":"2024-09-17T05:18:48.118741+0000","last_undegraded":"2024-09-17T05:18:48.118741+0000","last_fullsized":"2024-09-17T05:18:48.118741+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118513+0000","last_change":"2024-09-17T05:18:47.129696+0000","last_active":"2024-09-17T05:18:48.118513+0000","last_peered":"2024-09-17T05:18:48.118513+0000","last_clean":"2024-09-17T05:18:48.118513+0000","last_became_active":"2024-09-17T05:18:47.127357+0000","last_became_peered":"2024-09-17T05:18:47.127357+0000","last_unstale":"2024-09-17T05:18:48.118513+0000","last_undegraded":"2024-09-17T05:18:48.118513+0000","last_fullsized":"2024-09-17T05:18:48.118513+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:07.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118724+0000","last_change":"2024-09-17T05:18:47.122017+0000","last_active":"2024-09-17T05:18:48.118724+0000","last_peered":"2024-09-17T05:18:48.118724+0000","last_clean":"2024-09-17T05:18:48.118724+0000","last_became_active":"2024-09-17T05:18:47.120911+0000","last_became_peered":"2024-09-17T05:18:47.120911+0000","last_unstale":"2024-09-17T05:18:48.118724+0000","last_undegraded":"2024-09-17T05:18:48.118724+0000","last_fullsized":"2024-09-17T05:18:48.118724+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:33.294659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117057+0000","last_change":"2024-09-17T05:18:47.135716+0000","last_active":"2024-09-17T05:18:48.117057+0000","last_peered":"2024-09-17T05:18:48.117057+0000","last_clean":"2024-09-17T05:18:48.117057+0000","last_became_active":"2024-09-17T05:18:47.135334+0000","last_became_peered":"2024-09-17T05:18:47.135334+0000","last_unstale":"2024-09-17T05:18:48.117057+0000","last_undegraded":"2024-09-17T05:18:48.117057+0000","last_fullsized":"2024-09-17T05:18:48.117057+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:25.755720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601241+0000","last_change":"2024-09-17T05:18:47.133079+0000","last_active":"2024-09-17T05:18:49.601241+0000","last_peered":"2024-09-17T05:18:49.601241+0000","last_clean":"2024-09-17T05:18:49.601241+0000","last_became_active":"2024-09-17T05:18:47.132823+0000","last_became_peered":"2024-09-17T05:18:47.132823+0000","last_unstale":"2024-09-17T05:18:49.601241+0000","last_undegraded":"2024-09-17T05:18:49.601241+0000","last_fullsized":"2024-09-17T05:18:49.601241+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:13:33.666738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133781+0000","last_change":"2024-09-17T05:18:47.138267+0000","last_active":"2024-09-17T05:18:48.133781+0000","last_peered":"2024-09-17T05:18:48.133781+0000","last_clean":"2024-09-17T05:18:48.133781+0000","last_became_active":"2024-09-17T05:18:47.137928+0000","last_became_peered":"2024-09-17T05:18:47.137928+0000","last_unstale":"2024-09-17T05:18:48.133781+0000","last_undegraded":"2024-09-17T05:18:48.133781+0000","last_fullsized":"2024-09-17T05:18:48.133781+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:08.620872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231212+0000","last_change":"2024-09-17T05:18:47.133341+0000","last_active":"2024-09-17T05:18:50.231212+0000","last_peered":"2024-09-17T05:18:50.231212+0000","last_clean":"2024-09-17T05:18:50.231212+0000","last_became_active":"2024-09-17T05:18:47.133113+0000","last_became_peered":"2024-09-17T05:18:47.133113+0000","last_unstale":"2024-09-17T05:18:50.231212+0000","last_undegraded":"2024-09-17T05:18:50.231212+0000","last_fullsized":"2024-09-17T05:18:50.231212+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231972+0000","last_change":"2024-09-17T05:18:47.138568+0000","last_active":"2024-09-17T05:18:50.231972+0000","last_peered":"2024-09-17T05:18:50.231972+0000","last_clean":"2024-09-17T05:18:50.231972+0000","last_became_active":"2024-09-17T05:18:47.136370+0000","last_became_peered":"2024-09-17T05:18:47.136370+0000","last_unstale":"2024-09-17T05:18:50.231972+0000","last_undegraded":"2024-09-17T05:18:50.231972+0000","last_fullsized":"2024-09-17T05:18:50.231972+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:42.624419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231441+0000","last_change":"2024-09-17T05:18:47.120795+0000","last_active":"2024-09-17T05:18:50.231441+0000","last_peered":"2024-09-17T05:18:50.231441+0000","last_clean":"2024-09-17T05:18:50.231441+0000","last_became_active":"2024-09-17T05:18:47.120609+0000","last_became_peered":"2024-09-17T05:18:47.120609+0000","last_unstale":"2024-09-17T05:18:50.231441+0000","last_undegraded":"2024-09-17T05:18:50.231441+0000","last_fullsized":"2024-09-17T05:18:50.231441+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:39.011324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902402+0000","last_change":"2024-09-17T05:18:47.131900+0000","last_active":"2024-09-17T05:18:48.902402+0000","last_peered":"2024-09-17T05:18:48.902402+0000","last_clean":"2024-09-17T05:18:48.902402+0000","last_became_active":"2024-09-17T05:18:47.131593+0000","last_became_peered":"2024-09-17T05:18:47.131593+0000","last_unstale":"2024-09-17T05:18:48.902402+0000","last_undegraded":"2024-09-17T05:18:48.902402+0000","last_fullsized":"2024-09-17T05:18:48.902402+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:44.867751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118535+0000","last_change":"2024-09-17T05:18:47.127274+0000","last_active":"2024-09-17T05:18:48.118535+0000","last_peered":"2024-09-17T05:18:48.118535+0000","last_clean":"2024-09-17T05:18:48.118535+0000","last_became_active":"2024-09-17T05:18:47.126150+0000","last_became_peered":"2024-09-17T05:18:47.126150+0000","last_unstale":"2024-09-17T05:18:48.118535+0000","last_undegraded":"2024-09-17T05:18:48.118535+0000","last_fullsized":"2024-09-17T05:18:48.118535+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:30.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601563+0000","last_change":"2024-09-17T05:18:47.145653+0000","last_active":"2024-09-17T05:18:49.601563+0000","last_peered":"2024-09-17T05:18:49.601563+0000","last_clean":"2024-09-17T05:18:49.601563+0000","last_became_active":"2024-09-17T05:18:47.145377+0000","last_became_peered":"2024-09-17T05:18:47.145377+0000","last_unstale":"2024-09-17T05:18:49.601563+0000","last_undegraded":"2024-09-17T05:18:49.601563+0000","last_fullsized":"2024-09-17T05:18:49.601563+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:45.318856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231443+0000","last_change":"2024-09-17T05:18:47.136643+0000","last_active":"2024-09-17T05:18:50.231443+0000","last_peered":"2024-09-17T05:18:50.231443+0000","last_clean":"2024-09-17T05:18:50.231443+0000","last_became_active":"2024-09-17T05:18:47.136396+0000","last_became_peered":"2024-09-17T05:18:47.136396+0000","last_unstale":"2024-09-17T05:18:50.231443+0000","last_undegraded":"2024-09-17T05:18:50.231443+0000","last_fullsized":"2024-09-17T05:18:50.231443+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:32.243671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116775+0000","last_change":"2024-09-17T05:18:47.139232+0000","last_active":"2024-09-17T05:18:48.116775+0000","last_peered":"2024-09-17T05:18:48.116775+0000","last_clean":"2024-09-17T05:18:48.116775+0000","last_became_active":"2024-09-17T05:18:47.138536+0000","last_became_peered":"2024-09-17T05:18:47.138536+0000","last_unstale":"2024-09-17T05:18:48.116775+0000","last_undegraded":"2024-09-17T05:18:48.116775+0000","last_fullsized":"2024-09-17T05:18:48.116775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:00:04.746430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231310+0000","last_change":"2024-09-17T05:18:47.141968+0000","last_active":"2024-09-17T05:18:50.231310+0000","last_peered":"2024-09-17T05:18:50.231310+0000","last_clean":"2024-09-17T05:18:50.231310+0000","last_became_active":"2024-09-17T05:18:47.140975+0000","last_became_peered":"2024-09-17T05:18:47.140975+0000","last_unstale":"2024-09-17T05:18:50.231310+0000","last_undegraded":"2024-09-17T05:18:50.231310+0000","last_fullsized":"2024-09-17T05:18:50.231310+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:26.840419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117384+0000","last_change":"2024-09-17T05:18:47.139264+0000","last_active":"2024-09-17T05:18:48.117384+0000","last_peered":"2024-09-17T05:18:48.117384+0000","last_clean":"2024-09-17T05:18:48.117384+0000","last_became_active":"2024-09-17T05:18:47.138194+0000","last_became_peered":"2024-09-17T05:18:47.138194+0000","last_unstale":"2024-09-17T05:18:48.117384+0000","last_undegraded":"2024-09-17T05:18:48.117384+0000","last_fullsized":"2024-09-17T05:18:48.117384+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:25.146819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118769+0000","last_change":"2024-09-17T05:18:47.136270+0000","last_active":"2024-09-17T05:18:48.118769+0000","last_peered":"2024-09-17T05:18:48.118769+0000","last_clean":"2024-09-17T05:18:48.118769+0000","last_became_active":"2024-09-17T05:18:47.136004+0000","last_became_peered":"2024-09-17T05:18:47.136004+0000","last_unstale":"2024-09-17T05:18:48.118769+0000","last_undegraded":"2024-09-17T05:18:48.118769+0000","last_fullsized":"2024-09-17T05:18:48.118769+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:05.823979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133953+0000","last_change":"2024-09-17T05:18:47.136733+0000","last_active":"2024-09-17T05:18:48.133953+0000","last_peered":"2024-09-17T05:18:48.133953+0000","last_clean":"2024-09-17T05:18:48.133953+0000","last_became_active":"2024-09-17T05:18:47.136447+0000","last_became_peered":"2024-09-17T05:18:47.136447+0000","last_unstale":"2024-09-17T05:18:48.133953+0000","last_undegraded":"2024-09-17T05:18:48.133953+0000","last_fullsized":"2024-09-17T05:18:48.133953+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:52:32.847505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117191+0000","last_change":"2024-09-17T05:18:47.140039+0000","last_active":"2024-09-17T05:18:48.117191+0000","last_peered":"2024-09-17T05:18:48.117191+0000","last_clean":"2024-09-17T05:18:48.117191+0000","last_became_active":"2024-09-17T05:18:47.139761+0000","last_became_peered":"2024-09-17T05:18:47.139761+0000","last_unstale":"2024-09-17T05:18:48.117191+0000","last_undegraded":"2024-09-17T05:18:48.117191+0000","last_fullsized":"2024-09-17T05:18:48.117191+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:01.434619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601560+0000","last_change":"2024-09-17T05:18:47.137341+0000","last_active":"2024-09-17T05:18:49.601560+0000","last_peered":"2024-09-17T05:18:49.601560+0000","last_clean":"2024-09-17T05:18:49.601560+0000","last_became_active":"2024-09-17T05:18:47.136527+0000","last_became_peered":"2024-09-17T05:18:47.136527+0000","last_unstale":"2024-09-17T05:18:49.601560+0000","last_undegraded":"2024-09-17T05:18:49.601560+0000","last_fullsized":"2024-09-17T05:18:49.601560+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:03.207999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231542+0000","last_change":"2024-09-17T05:18:47.132046+0000","last_active":"2024-09-17T05:18:50.231542+0000","last_peered":"2024-09-17T05:18:50.231542+0000","last_clean":"2024-09-17T05:18:50.231542+0000","last_became_active":"2024-09-17T05:18:47.131385+0000","last_became_peered":"2024-09-17T05:18:47.131385+0000","last_unstale":"2024-09-17T05:18:50.231542+0000","last_undegraded":"2024-09-17T05:18:50.231542+0000","last_fullsized":"2024-09-17T05:18:50.231542+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:41.148848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231335+0000","last_change":"2024-09-17T05:18:47.136879+0000","last_active":"2024-09-17T05:18:50.231335+0000","last_peered":"2024-09-17T05:18:50.231335+0000","last_clean":"2024-09-17T05:18:50.231335+0000","last_became_active":"2024-09-17T05:18:47.136546+0000","last_became_peered":"2024-09-17T05:18:47.136546+0000","last_unstale":"2024-09-17T05:18:50.231335+0000","last_undegraded":"2024-09-17T05:18:50.231335+0000","last_fullsized":"2024-09-17T05:18:50.231335+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:33.294659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117882+0000","last_change":"2024-09-17T05:18:47.133776+0000","last_active":"2024-09-17T05:18:48.117882+0000","last_peered":"2024-09-17T05:18:48.117882+0000","last_clean":"2024-09-17T05:18:48.117882+0000","last_became_active":"2024-09-17T05:18:47.133252+0000","last_became_peered":"2024-09-17T05:18:47.133252+0000","last_unstale":"2024-09-17T05:18:48.117882+0000","last_undegraded":"2024-09-17T05:18:48.117882+0000","last_fullsized":"2024-09-17T05:18:48.117882+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:21.942728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118120+0000","last_change":"2024-09-17T05:18:47.130903+0000","last_active":"2024-09-17T05:18:48.118120+0000","last_peered":"2024-09-17T05:18:48.118120+0000","last_clean":"2024-09-17T05:18:48.118120+0000","last_became_active":"2024-09-17T05:18:47.130394+0000","last_became_peered":"2024-09-17T05:18:47.130394+0000","last_unstale":"2024-09-17T05:18:48.118120+0000","last_undegraded":"2024-09-17T05:18:48.118120+0000","last_fullsized":"2024-09-17T05:18:48.118120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:28.751511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117205+0000","last_change":"2024-09-17T05:18:46.133224+0000","last_active":"2024-09-17T05:18:48.117205+0000","last_peered":"2024-09-17T05:18:48.117205+0000","last_clean":"2024-09-17T05:18:48.117205+0000","last_became_active":"2024-09-17T05:18:46.132897+0000","last_became_peered":"2024-09-17T05:18:46.132897+0000","last_unstale":"2024-09-17T05:18:48.117205+0000","last_undegraded":"2024-09-17T05:18:48.117205+0000","last_fullsized":"2024-09-17T05:18:48.117205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601713+0000","last_change":"2024-09-17T05:18:47.135685+0000","last_active":"2024-09-17T05:18:49.601713+0000","last_peered":"2024-09-17T05:18:49.601713+0000","last_clean":"2024-09-17T05:18:49.601713+0000","last_became_active":"2024-09-17T05:18:47.134928+0000","last_became_peered":"2024-09-17T05:18:47.134928+0000","last_unstale":"2024-09-17T05:18:49.601713+0000","last_undegraded":"2024-09-17T05:18:49.601713+0000","last_fullsized":"2024-09-17T05:18:49.601713+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:15.838865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118259+0000","last_change":"2024-09-17T05:18:46.131904+0000","last_active":"2024-09-17T05:18:48.118259+0000","last_peered":"2024-09-17T05:18:48.118259+0000","last_clean":"2024-09-17T05:18:48.118259+0000","last_became_active":"2024-09-17T05:18:46.131515+0000","last_became_peered":"2024-09-17T05:18:46.131515+0000","last_unstale":"2024-09-17T05:18:48.118259+0000","last_undegraded":"2024-09-17T05:18:48.118259+0000","last_fullsized":"2024-09-17T05:18:48.118259+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116839+0000","last_change":"2024-09-17T05:18:46.130687+0000","last_active":"2024-09-17T05:18:48.116839+0000","last_peered":"2024-09-17T05:18:48.116839+0000","last_clean":"2024-09-17T05:18:48.116839+0000","last_became_active":"2024-09-17T05:18:46.130402+0000","last_became_peered":"2024-09-17T05:18:46.130402+0000","last_unstale":"2024-09-17T05:18:48.116839+0000","last_undegraded":"2024-09-17T05:18:48.116839+0000","last_fullsized":"2024-09-17T05:18:48.116839+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:31.780171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116831+0000","last_change":"2024-09-17T05:18:47.133243+0000","last_active":"2024-09-17T05:18:48.116831+0000","last_peered":"2024-09-17T05:18:48.116831+0000","last_clean":"2024-09-17T05:18:48.116831+0000","last_became_active":"2024-09-17T05:18:47.132942+0000","last_became_peered":"2024-09-17T05:18:47.132942+0000","last_unstale":"2024-09-17T05:18:48.116831+0000","last_undegraded":"2024-09-17T05:18:48.116831+0000","last_fullsized":"2024-09-17T05:18:48.116831+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:17:26.505376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231432+0000","last_change":"2024-09-17T05:18:46.135197+0000","last_active":"2024-09-17T05:18:50.231432+0000","last_peered":"2024-09-17T05:18:50.231432+0000","last_clean":"2024-09-17T05:18:50.231432+0000","last_became_active":"2024-09-17T05:18:46.134931+0000","last_became_peered":"2024-09-17T05:18:46.134931+0000","last_unstale":"2024-09-17T05:18:50.231432+0000","last_undegraded":"2024-09-17T05:18:50.231432+0000","last_fullsized":"2024-09-17T05:18:50.231432+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133775+0000","last_change":"2024-09-17T05:18:47.130413+0000","last_active":"2024-09-17T05:18:48.133775+0000","last_peered":"2024-09-17T05:18:48.133775+0000","last_clean":"2024-09-17T05:18:48.133775+0000","last_became_active":"2024-09-17T05:18:47.130080+0000","last_became_peered":"2024-09-17T05:18:47.130080+0000","last_unstale":"2024-09-17T05:18:48.133775+0000","last_undegraded":"2024-09-17T05:18:48.133775+0000","last_fullsized":"2024-09-17T05:18:48.133775+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:43.112366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118861+0000","last_change":"2024-09-17T05:18:46.137454+0000","last_active":"2024-09-17T05:18:48.118861+0000","last_peered":"2024-09-17T05:18:48.118861+0000","last_clean":"2024-09-17T05:18:48.118861+0000","last_became_active":"2024-09-17T05:18:46.136894+0000","last_became_peered":"2024-09-17T05:18:46.136894+0000","last_unstale":"2024-09-17T05:18:48.118861+0000","last_undegraded":"2024-09-17T05:18:48.118861+0000","last_fullsized":"2024-09-17T05:18:48.118861+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231721+0000","last_change":"2024-09-17T05:18:47.140250+0000","last_active":"2024-09-17T05:18:50.231721+0000","last_peered":"2024-09-17T05:18:50.231721+0000","last_clean":"2024-09-17T05:18:50.231721+0000","last_became_active":"2024-09-17T05:18:47.136798+0000","last_became_peered":"2024-09-17T05:18:47.136798+0000","last_unstale":"2024-09-17T05:18:50.231721+0000","last_undegraded":"2024-09-17T05:18:50.231721+0000","last_fullsized":"2024-09-17T05:18:50.231721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:56.761963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231795+0000","last_change":"2024-09-17T05:18:46.136107+0000","last_active":"2024-09-17T05:18:50.231795+0000","last_peered":"2024-09-17T05:18:50.231795+0000","last_clean":"2024-09-17T05:18:50.231795+0000","last_became_active":"2024-09-17T05:18:46.135733+0000","last_became_peered":"2024-09-17T05:18:46.135733+0000","last_unstale":"2024-09-17T05:18:50.231795+0000","last_undegraded":"2024-09-17T05:18:50.231795+0000","last_fullsized":"2024-09-17T05:18:50.231795+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601463+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:49.601463+0000","last_peered":"2024-09-17T05:18:49.601463+0000","last_clean":"2024-09-17T05:18:49.601463+0000","last_became_active":"2024-09-17T05:18:47.139941+0000","last_became_peered":"2024-09-17T05:18:47.139941+0000","last_unstale":"2024-09-17T05:18:49.601463+0000","last_undegraded":"2024-09-17T05:18:49.601463+0000","last_fullsized":"2024-09-17T05:18:49.601463+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:16:14.786078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"22'3","reported_seq":18,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133942+0000","last_change":"2024-09-17T05:18:46.133330+0000","last_active":"2024-09-17T05:18:48.133942+0000","last_peered":"2024-09-17T05:18:48.133942+0000","last_clean":"2024-09-17T05:18:48.133942+0000","last_became_active":"2024-09-17T05:18:46.133026+0000","last_became_peered":"2024-09-17T05:18:46.133026+0000","last_unstale":"2024-09-17T05:18:48.133942+0000","last_undegraded":"2024-09-17T05:18:48.133942+0000","last_fullsized":"2024-09-17T05:18:48.133942+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118942+0000","last_change":"2024-09-17T05:18:47.131328+0000","last_active":"2024-09-17T05:18:48.118942+0000","last_peered":"2024-09-17T05:18:48.118942+0000","last_clean":"2024-09-17T05:18:48.118942+0000","last_became_active":"2024-09-17T05:18:47.131061+0000","last_became_peered":"2024-09-17T05:18:47.131061+0000","last_unstale":"2024-09-17T05:18:48.118942+0000","last_undegraded":"2024-09-17T05:18:48.118942+0000","last_fullsized":"2024-09-17T05:18:48.118942+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:39.011324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"22'6","reported_seq":21,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118502+0000","last_change":"2024-09-17T05:18:46.133755+0000","last_active":"2024-09-17T05:18:48.118502+0000","last_peered":"2024-09-17T05:18:48.118502+0000","last_clean":"2024-09-17T05:18:48.118502+0000","last_became_active":"2024-09-17T05:18:46.133067+0000","last_became_peered":"2024-09-17T05:18:46.133067+0000","last_unstale":"2024-09-17T05:18:48.118502+0000","last_undegraded":"2024-09-17T05:18:48.118502+0000","last_fullsized":"2024-09-17T05:18:48.118502+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901995+0000","last_change":"2024-09-17T05:18:47.133656+0000","last_active":"2024-09-17T05:18:48.901995+0000","last_peered":"2024-09-17T05:18:48.901995+0000","last_clean":"2024-09-17T05:18:48.901995+0000","last_became_active":"2024-09-17T05:18:47.133360+0000","last_became_peered":"2024-09-17T05:18:47.133360+0000","last_unstale":"2024-09-17T05:18:48.901995+0000","last_undegraded":"2024-09-17T05:18:48.901995+0000","last_fullsized":"2024-09-17T05:18:48.901995+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:22.064282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601712+0000","last_change":"2024-09-17T05:18:46.129204+0000","last_active":"2024-09-17T05:18:49.601712+0000","last_peered":"2024-09-17T05:18:49.601712+0000","last_clean":"2024-09-17T05:18:49.601712+0000","last_became_active":"2024-09-17T05:18:46.128901+0000","last_became_peered":"2024-09-17T05:18:46.128901+0000","last_unstale":"2024-09-17T05:18:49.601712+0000","last_undegraded":"2024-09-17T05:18:49.601712+0000","last_fullsized":"2024-09-17T05:18:49.601712+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:39.714747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601315+0000","last_change":"2024-09-17T05:18:47.136191+0000","last_active":"2024-09-17T05:18:49.601315+0000","last_peered":"2024-09-17T05:18:49.601315+0000","last_clean":"2024-09-17T05:18:49.601315+0000","last_became_active":"2024-09-17T05:18:47.135912+0000","last_became_peered":"2024-09-17T05:18:47.135912+0000","last_unstale":"2024-09-17T05:18:49.601315+0000","last_undegraded":"2024-09-17T05:18:49.601315+0000","last_fullsized":"2024-09-17T05:18:49.601315+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:05.562603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231754+0000","last_change":"2024-09-17T05:18:46.132187+0000","last_active":"2024-09-17T05:18:50.231754+0000","last_peered":"2024-09-17T05:18:50.231754+0000","last_clean":"2024-09-17T05:18:50.231754+0000","last_became_active":"2024-09-17T05:18:46.131916+0000","last_became_peered":"2024-09-17T05:18:46.131916+0000","last_unstale":"2024-09-17T05:18:50.231754+0000","last_undegraded":"2024-09-17T05:18:50.231754+0000","last_fullsized":"2024-09-17T05:18:50.231754+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902185+0000","last_change":"2024-09-17T05:18:47.139925+0000","last_active":"2024-09-17T05:18:48.902185+0000","last_peered":"2024-09-17T05:18:48.902185+0000","last_clean":"2024-09-17T05:18:48.902185+0000","last_became_active":"2024-09-17T05:18:47.139357+0000","last_became_peered":"2024-09-17T05:18:47.139357+0000","last_unstale":"2024-09-17T05:18:48.902185+0000","last_undegraded":"2024-09-17T05:18:48.902185+0000","last_fullsized":"2024-09-17T05:18:48.902185+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:51.210414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118150+0000","last_change":"2024-09-17T05:18:46.131494+0000","last_active":"2024-09-17T05:18:48.118150+0000","last_peered":"2024-09-17T05:18:48.118150+0000","last_clean":"2024-09-17T05:18:48.118150+0000","last_became_active":"2024-09-17T05:18:46.131210+0000","last_became_peered":"2024-09-17T05:18:46.131210+0000","last_unstale":"2024-09-17T05:18:48.118150+0000","last_undegraded":"2024-09-17T05:18:48.118150+0000","last_fullsized":"2024-09-17T05:18:48.118150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118112+0000","last_change":"2024-09-17T05:18:47.133501+0000","last_active":"2024-09-17T05:18:48.118112+0000","last_peered":"2024-09-17T05:18:48.118112+0000","last_clean":"2024-09-17T05:18:48.118112+0000","last_became_active":"2024-09-17T05:18:47.132900+0000","last_became_peered":"2024-09-17T05:18:47.132900+0000","last_unstale":"2024-09-17T05:18:48.118112+0000","last_undegraded":"2024-09-17T05:18:48.118112+0000","last_fullsized":"2024-09-17T05:18:48.118112+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.887461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"22'8","reported_seq":23,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231255+0000","last_change":"2024-09-17T05:18:46.127329+0000","last_active":"2024-09-17T05:18:50.231255+0000","last_peered":"2024-09-17T05:18:50.231255+0000","last_clean":"2024-09-17T05:18:50.231255+0000","last_became_active":"2024-09-17T05:18:46.126863+0000","last_became_peered":"2024-09-17T05:18:46.126863+0000","last_unstale":"2024-09-17T05:18:50.231255+0000","last_undegraded":"2024-09-17T05:18:50.231255+0000","last_fullsized":"2024-09-17T05:18:50.231255+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:21.719941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901789+0000","last_change":"2024-09-17T05:18:47.140406+0000","last_active":"2024-09-17T05:18:48.901789+0000","last_peered":"2024-09-17T05:18:48.901789+0000","last_clean":"2024-09-17T05:18:48.901789+0000","last_became_active":"2024-09-17T05:18:47.140107+0000","last_became_peered":"2024-09-17T05:18:47.140107+0000","last_unstale":"2024-09-17T05:18:48.901789+0000","last_undegraded":"2024-09-17T05:18:48.901789+0000","last_fullsized":"2024-09-17T05:18:48.901789+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:01:25.146819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118276+0000","last_change":"2024-09-17T05:18:46.130487+0000","last_active":"2024-09-17T05:18:48.118276+0000","last_peered":"2024-09-17T05:18:48.118276+0000","last_clean":"2024-09-17T05:18:48.118276+0000","last_became_active":"2024-09-17T05:18:46.130163+0000","last_became_peered":"2024-09-17T05:18:46.130163+0000","last_unstale":"2024-09-17T05:18:48.118276+0000","last_undegraded":"2024-09-17T05:18:48.118276+0000","last_fullsized":"2024-09-17T05:18:48.118276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:42.067559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902294+0000","last_change":"2024-09-17T05:18:47.142853+0000","last_active":"2024-09-17T05:18:48.902294+0000","last_peered":"2024-09-17T05:18:48.902294+0000","last_clean":"2024-09-17T05:18:48.902294+0000","last_became_active":"2024-09-17T05:18:47.142286+0000","last_became_peered":"2024-09-17T05:18:47.142286+0000","last_unstale":"2024-09-17T05:18:48.902294+0000","last_undegraded":"2024-09-17T05:18:48.902294+0000","last_fullsized":"2024-09-17T05:18:48.902294+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:46.403703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231493+0000","last_change":"2024-09-17T05:18:46.129081+0000","last_active":"2024-09-17T05:18:50.231493+0000","last_peered":"2024-09-17T05:18:50.231493+0000","last_clean":"2024-09-17T05:18:50.231493+0000","last_became_active":"2024-09-17T05:18:46.128776+0000","last_became_peered":"2024-09-17T05:18:46.128776+0000","last_unstale":"2024-09-17T05:18:50.231493+0000","last_undegraded":"2024-09-17T05:18:50.231493+0000","last_fullsized":"2024-09-17T05:18:50.231493+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902419+0000","last_change":"2024-09-17T05:18:47.139542+0000","last_active":"2024-09-17T05:18:48.902419+0000","last_peered":"2024-09-17T05:18:48.902419+0000","last_clean":"2024-09-17T05:18:48.902419+0000","last_became_active":"2024-09-17T05:18:47.139188+0000","last_became_peered":"2024-09-17T05:18:47.139188+0000","last_unstale":"2024-09-17T05:18:48.902419+0000","last_undegraded":"2024-09-17T05:18:48.902419+0000","last_fullsized":"2024-09-17T05:18:48.902419+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:26.800943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134047+0000","last_change":"2024-09-17T05:18:46.132599+0000","last_active":"2024-09-17T05:18:48.134047+0000","last_peered":"2024-09-17T05:18:48.134047+0000","last_clean":"2024-09-17T05:18:48.134047+0000","last_became_active":"2024-09-17T05:18:46.132293+0000","last_became_peered":"2024-09-17T05:18:46.132293+0000","last_unstale":"2024-09-17T05:18:48.134047+0000","last_undegraded":"2024-09-17T05:18:48.134047+0000","last_fullsized":"2024-09-17T05:18:48.134047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:38.005194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231721+0000","last_change":"2024-09-17T05:18:47.132917+0000","last_active":"2024-09-17T05:18:50.231721+0000","last_peered":"2024-09-17T05:18:50.231721+0000","last_clean":"2024-09-17T05:18:50.231721+0000","last_became_active":"2024-09-17T05:18:47.132647+0000","last_became_peered":"2024-09-17T05:18:47.132647+0000","last_unstale":"2024-09-17T05:18:50.231721+0000","last_undegraded":"2024-09-17T05:18:50.231721+0000","last_fullsized":"2024-09-17T05:18:50.231721+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:58.901485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231411+0000","last_change":"2024-09-17T05:18:46.127182+0000","last_active":"2024-09-17T05:18:50.231411+0000","last_peered":"2024-09-17T05:18:50.231411+0000","last_clean":"2024-09-17T05:18:50.231411+0000","last_became_active":"2024-09-17T05:18:46.126903+0000","last_became_peered":"2024-09-17T05:18:46.126903+0000","last_unstale":"2024-09-17T05:18:50.231411+0000","last_undegraded":"2024-09-17T05:18:50.231411+0000","last_fullsized":"2024-09-17T05:18:50.231411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902120+0000","last_change":"2024-09-17T05:18:47.141769+0000","last_active":"2024-09-17T05:18:48.902120+0000","last_peered":"2024-09-17T05:18:48.902120+0000","last_clean":"2024-09-17T05:18:48.902120+0000","last_became_active":"2024-09-17T05:18:47.141454+0000","last_became_peered":"2024-09-17T05:18:47.141454+0000","last_unstale":"2024-09-17T05:18:48.902120+0000","last_undegraded":"2024-09-17T05:18:48.902120+0000","last_fullsized":"2024-09-17T05:18:48.902120+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:46.015055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":111,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901837+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:18:48.901837+0000","last_peered":"2024-09-17T05:18:48.901837+0000","last_clean":"2024-09-17T05:18:48.901837+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:18:48.901837+0000","last_undegraded":"2024-09-17T05:18:48.901837+0000","last_fullsized":"2024-09-17T05:18:48.901837+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231276+0000","last_change":"2024-09-17T05:18:46.127446+0000","last_active":"2024-09-17T05:18:50.231276+0000","last_peered":"2024-09-17T05:18:50.231276+0000","last_clean":"2024-09-17T05:18:50.231276+0000","last_became_active":"2024-09-17T05:18:46.126901+0000","last_became_peered":"2024-09-17T05:18:46.126901+0000","last_unstale":"2024-09-17T05:18:50.231276+0000","last_undegraded":"2024-09-17T05:18:50.231276+0000","last_fullsized":"2024-09-17T05:18:50.231276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116985+0000","last_change":"2024-09-17T05:18:47.144541+0000","last_active":"2024-09-17T05:18:48.116985+0000","last_peered":"2024-09-17T05:18:48.116985+0000","last_clean":"2024-09-17T05:18:48.116985+0000","last_became_active":"2024-09-17T05:18:47.144205+0000","last_became_peered":"2024-09-17T05:18:47.144205+0000","last_unstale":"2024-09-17T05:18:48.116985+0000","last_undegraded":"2024-09-17T05:18:48.116985+0000","last_fullsized":"2024-09-17T05:18:48.116985+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:12:44.033449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901605+0000","last_change":"2024-09-17T05:18:46.141132+0000","last_active":"2024-09-17T05:18:48.901605+0000","last_peered":"2024-09-17T05:18:48.901605+0000","last_clean":"2024-09-17T05:18:48.901605+0000","last_became_active":"2024-09-17T05:18:46.140364+0000","last_became_peered":"2024-09-17T05:18:46.140364+0000","last_unstale":"2024-09-17T05:18:48.901605+0000","last_undegraded":"2024-09-17T05:18:48.901605+0000","last_fullsized":"2024-09-17T05:18:48.901605+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:14.427012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601207+0000","last_change":"2024-09-17T05:18:47.139416+0000","last_active":"2024-09-17T05:18:49.601207+0000","last_peered":"2024-09-17T05:18:49.601207+0000","last_clean":"2024-09-17T05:18:49.601207+0000","last_became_active":"2024-09-17T05:18:47.139149+0000","last_became_peered":"2024-09-17T05:18:47.139149+0000","last_unstale":"2024-09-17T05:18:49.601207+0000","last_undegraded":"2024-09-17T05:18:49.601207+0000","last_fullsized":"2024-09-17T05:18:49.601207+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:15.157191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231382+0000","last_change":"2024-09-17T05:18:46.129101+0000","last_active":"2024-09-17T05:18:50.231382+0000","last_peered":"2024-09-17T05:18:50.231382+0000","last_clean":"2024-09-17T05:18:50.231382+0000","last_became_active":"2024-09-17T05:18:46.128748+0000","last_became_peered":"2024-09-17T05:18:46.128748+0000","last_unstale":"2024-09-17T05:18:50.231382+0000","last_undegraded":"2024-09-17T05:18:50.231382+0000","last_fullsized":"2024-09-17T05:18:50.231382+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:01.709036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133772+0000","last_change":"2024-09-17T05:18:47.131649+0000","last_active":"2024-09-17T05:18:48.133772+0000","last_peered":"2024-09-17T05:18:48.133772+0000","last_clean":"2024-09-17T05:18:48.133772+0000","last_became_active":"2024-09-17T05:18:47.131360+0000","last_became_peered":"2024-09-17T05:18:47.131360+0000","last_unstale":"2024-09-17T05:18:48.133772+0000","last_undegraded":"2024-09-17T05:18:48.133772+0000","last_fullsized":"2024-09-17T05:18:48.133772+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:49.887461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231729+0000","last_change":"2024-09-17T05:18:46.129856+0000","last_active":"2024-09-17T05:18:50.231729+0000","last_peered":"2024-09-17T05:18:50.231729+0000","last_clean":"2024-09-17T05:18:50.231729+0000","last_became_active":"2024-09-17T05:18:46.129409+0000","last_became_peered":"2024-09-17T05:18:46.129409+0000","last_unstale":"2024-09-17T05:18:50.231729+0000","last_undegraded":"2024-09-17T05:18:50.231729+0000","last_fullsized":"2024-09-17T05:18:50.231729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118122+0000","last_change":"2024-09-17T05:18:47.135559+0000","last_active":"2024-09-17T05:18:48.118122+0000","last_peered":"2024-09-17T05:18:48.118122+0000","last_clean":"2024-09-17T05:18:48.118122+0000","last_became_active":"2024-09-17T05:18:47.135267+0000","last_became_peered":"2024-09-17T05:18:47.135267+0000","last_unstale":"2024-09-17T05:18:48.118122+0000","last_undegraded":"2024-09-17T05:18:48.118122+0000","last_fullsized":"2024-09-17T05:18:48.118122+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:27.485204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133876+0000","last_change":"2024-09-17T05:18:46.128837+0000","last_active":"2024-09-17T05:18:48.133876+0000","last_peered":"2024-09-17T05:18:48.133876+0000","last_clean":"2024-09-17T05:18:48.133876+0000","last_became_active":"2024-09-17T05:18:46.128576+0000","last_became_peered":"2024-09-17T05:18:46.128576+0000","last_unstale":"2024-09-17T05:18:48.133876+0000","last_undegraded":"2024-09-17T05:18:48.133876+0000","last_fullsized":"2024-09-17T05:18:48.133876+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:27.745380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231969+0000","last_change":"2024-09-17T05:18:47.135090+0000","last_active":"2024-09-17T05:18:50.231969+0000","last_peered":"2024-09-17T05:18:50.231969+0000","last_clean":"2024-09-17T05:18:50.231969+0000","last_became_active":"2024-09-17T05:18:47.134518+0000","last_became_peered":"2024-09-17T05:18:47.134518+0000","last_unstale":"2024-09-17T05:18:50.231969+0000","last_undegraded":"2024-09-17T05:18:50.231969+0000","last_fullsized":"2024-09-17T05:18:50.231969+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:29:28.351688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902337+0000","last_change":"2024-09-17T05:18:46.141667+0000","last_active":"2024-09-17T05:18:48.902337+0000","last_peered":"2024-09-17T05:18:48.902337+0000","last_clean":"2024-09-17T05:18:48.902337+0000","last_became_active":"2024-09-17T05:18:46.140316+0000","last_became_peered":"2024-09-17T05:18:46.140316+0000","last_unstale":"2024-09-17T05:18:48.902337+0000","last_undegraded":"2024-09-17T05:18:48.902337+0000","last_fullsized":"2024-09-17T05:18:48.902337+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:32.288529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133877+0000","last_change":"2024-09-17T05:18:47.131478+0000","last_active":"2024-09-17T05:18:48.133877+0000","last_peered":"2024-09-17T05:18:48.133877+0000","last_clean":"2024-09-17T05:18:48.133877+0000","last_became_active":"2024-09-17T05:18:47.131211+0000","last_became_peered":"2024-09-17T05:18:47.131211+0000","last_unstale":"2024-09-17T05:18:48.133877+0000","last_undegraded":"2024-09-17T05:18:48.133877+0000","last_fullsized":"2024-09-17T05:18:48.133877+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:07.778843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"23'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.134091+0000","last_change":"2024-09-17T05:18:46.130971+0000","last_active":"2024-09-17T05:18:48.134091+0000","last_peered":"2024-09-17T05:18:48.134091+0000","last_clean":"2024-09-17T05:18:48.134091+0000","last_became_active":"2024-09-17T05:18:46.130678+0000","last_became_peered":"2024-09-17T05:18:46.130678+0000","last_unstale":"2024-09-17T05:18:48.134091+0000","last_undegraded":"2024-09-17T05:18:48.134091+0000","last_fullsized":"2024-09-17T05:18:48.134091+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:29:21.356632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117415+0000","last_change":"2024-09-17T05:18:47.146406+0000","last_active":"2024-09-17T05:18:48.117415+0000","last_peered":"2024-09-17T05:18:48.117415+0000","last_clean":"2024-09-17T05:18:48.117415+0000","last_became_active":"2024-09-17T05:18:47.146064+0000","last_became_peered":"2024-09-17T05:18:47.146064+0000","last_unstale":"2024-09-17T05:18:48.117415+0000","last_undegraded":"2024-09-17T05:18:48.117415+0000","last_fullsized":"2024-09-17T05:18:48.117415+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:55.524841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118972+0000","last_change":"2024-09-17T05:18:46.137090+0000","last_active":"2024-09-17T05:18:48.118972+0000","last_peered":"2024-09-17T05:18:48.118972+0000","last_clean":"2024-09-17T05:18:48.118972+0000","last_became_active":"2024-09-17T05:18:46.136506+0000","last_became_peered":"2024-09-17T05:18:46.136506+0000","last_unstale":"2024-09-17T05:18:48.118972+0000","last_undegraded":"2024-09-17T05:18:48.118972+0000","last_fullsized":"2024-09-17T05:18:48.118972+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601508+0000","last_change":"2024-09-17T05:18:47.132848+0000","last_active":"2024-09-17T05:18:49.601508+0000","last_peered":"2024-09-17T05:18:49.601508+0000","last_clean":"2024-09-17T05:18:49.601508+0000","last_became_active":"2024-09-17T05:18:47.132504+0000","last_became_peered":"2024-09-17T05:18:47.132504+0000","last_unstale":"2024-09-17T05:18:49.601508+0000","last_undegraded":"2024-09-17T05:18:49.601508+0000","last_fullsized":"2024-09-17T05:18:49.601508+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:28.843941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901581+0000","last_change":"2024-09-17T05:18:46.137719+0000","last_active":"2024-09-17T05:18:48.901581+0000","last_peered":"2024-09-17T05:18:48.901581+0000","last_clean":"2024-09-17T05:18:48.901581+0000","last_became_active":"2024-09-17T05:18:46.137459+0000","last_became_peered":"2024-09-17T05:18:46.137459+0000","last_unstale":"2024-09-17T05:18:48.901581+0000","last_undegraded":"2024-09-17T05:18:48.901581+0000","last_fullsized":"2024-09-17T05:18:48.901581+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:38.005194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118618+0000","last_change":"2024-09-17T05:18:47.126967+0000","last_active":"2024-09-17T05:18:48.118618+0000","last_peered":"2024-09-17T05:18:48.118618+0000","last_clean":"2024-09-17T05:18:48.118618+0000","last_became_active":"2024-09-17T05:18:47.125840+0000","last_became_peered":"2024-09-17T05:18:47.125840+0000","last_unstale":"2024-09-17T05:18:48.118618+0000","last_undegraded":"2024-09-17T05:18:48.118618+0000","last_fullsized":"2024-09-17T05:18:48.118618+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:41.718797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133964+0000","last_change":"2024-09-17T05:18:46.136676+0000","last_active":"2024-09-17T05:18:48.133964+0000","last_peered":"2024-09-17T05:18:48.133964+0000","last_clean":"2024-09-17T05:18:48.133964+0000","last_became_active":"2024-09-17T05:18:46.136468+0000","last_became_peered":"2024-09-17T05:18:46.136468+0000","last_unstale":"2024-09-17T05:18:48.133964+0000","last_undegraded":"2024-09-17T05:18:48.133964+0000","last_fullsized":"2024-09-17T05:18:48.133964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.116957+0000","last_change":"2024-09-17T05:18:47.130998+0000","last_active":"2024-09-17T05:18:48.116957+0000","last_peered":"2024-09-17T05:18:48.116957+0000","last_clean":"2024-09-17T05:18:48.116957+0000","last_became_active":"2024-09-17T05:18:47.130307+0000","last_became_peered":"2024-09-17T05:18:47.130307+0000","last_unstale":"2024-09-17T05:18:48.116957+0000","last_undegraded":"2024-09-17T05:18:48.116957+0000","last_fullsized":"2024-09-17T05:18:48.116957+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:40:30.063678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":15,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.133849+0000","last_change":"2024-09-17T05:18:46.132362+0000","last_active":"2024-09-17T05:18:48.133849+0000","last_peered":"2024-09-17T05:18:48.133849+0000","last_clean":"2024-09-17T05:18:48.133849+0000","last_became_active":"2024-09-17T05:18:46.132074+0000","last_became_peered":"2024-09-17T05:18:46.132074+0000","last_unstale":"2024-09-17T05:18:48.133849+0000","last_undegraded":"2024-09-17T05:18:48.133849+0000","last_fullsized":"2024-09-17T05:18:48.133849+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:32.288529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117086+0000","last_change":"2024-09-17T05:18:47.133311+0000","last_active":"2024-09-17T05:18:48.117086+0000","last_peered":"2024-09-17T05:18:48.117086+0000","last_clean":"2024-09-17T05:18:48.117086+0000","last_became_active":"2024-09-17T05:18:47.132929+0000","last_became_peered":"2024-09-17T05:18:47.132929+0000","last_unstale":"2024-09-17T05:18:48.117086+0000","last_undegraded":"2024-09-17T05:18:48.117086+0000","last_fullsized":"2024-09-17T05:18:48.117086+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:14.224552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902100+0000","last_change":"2024-09-17T05:18:46.140762+0000","last_active":"2024-09-17T05:18:48.902100+0000","last_peered":"2024-09-17T05:18:48.902100+0000","last_clean":"2024-09-17T05:18:48.902100+0000","last_became_active":"2024-09-17T05:18:46.140483+0000","last_became_peered":"2024-09-17T05:18:46.140483+0000","last_unstale":"2024-09-17T05:18:48.902100+0000","last_undegraded":"2024-09-17T05:18:48.902100+0000","last_fullsized":"2024-09-17T05:18:48.902100+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:11.520291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.118254+0000","last_change":"2024-09-17T05:18:47.125446+0000","last_active":"2024-09-17T05:18:48.118254+0000","last_peered":"2024-09-17T05:18:48.118254+0000","last_clean":"2024-09-17T05:18:48.118254+0000","last_became_active":"2024-09-17T05:18:47.125114+0000","last_became_peered":"2024-09-17T05:18:47.125114+0000","last_unstale":"2024-09-17T05:18:48.118254+0000","last_undegraded":"2024-09-17T05:18:48.118254+0000","last_fullsized":"2024-09-17T05:18:48.118254+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.280584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231984+0000","last_change":"2024-09-17T05:18:47.143858+0000","last_active":"2024-09-17T05:18:50.231984+0000","last_peered":"2024-09-17T05:18:50.231984+0000","last_clean":"2024-09-17T05:18:50.231984+0000","last_became_active":"2024-09-17T05:18:47.143613+0000","last_became_peered":"2024-09-17T05:18:47.143613+0000","last_unstale":"2024-09-17T05:18:50.231984+0000","last_undegraded":"2024-09-17T05:18:50.231984+0000","last_fullsized":"2024-09-17T05:18:50.231984+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:35.695324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.901919+0000","last_change":"2024-09-17T05:18:46.140678+0000","last_active":"2024-09-17T05:18:48.901919+0000","last_peered":"2024-09-17T05:18:48.901919+0000","last_clean":"2024-09-17T05:18:48.901919+0000","last_became_active":"2024-09-17T05:18:46.140137+0000","last_became_peered":"2024-09-17T05:18:46.140137+0000","last_unstale":"2024-09-17T05:18:48.901919+0000","last_undegraded":"2024-09-17T05:18:48.901919+0000","last_fullsized":"2024-09-17T05:18:48.901919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:40.712667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:50.231455+0000","last_change":"2024-09-17T05:18:47.139974+0000","last_active":"2024-09-17T05:18:50.231455+0000","last_peered":"2024-09-17T05:18:50.231455+0000","last_clean":"2024-09-17T05:18:50.231455+0000","last_became_active":"2024-09-17T05:18:47.139691+0000","last_became_peered":"2024-09-17T05:18:47.139691+0000","last_unstale":"2024-09-17T05:18:50.231455+0000","last_undegraded":"2024-09-17T05:18:50.231455+0000","last_fullsized":"2024-09-17T05:18:50.231455+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"22'2","reported_seq":17,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.902180+0000","last_change":"2024-09-17T05:18:46.141012+0000","last_active":"2024-09-17T05:18:48.902180+0000","last_peered":"2024-09-17T05:18:48.902180+0000","last_clean":"2024-09-17T05:18:48.902180+0000","last_became_active":"2024-09-17T05:18:46.140729+0000","last_became_peered":"2024-09-17T05:18:46.140729+0000","last_unstale":"2024-09-17T05:18:48.902180+0000","last_undegraded":"2024-09-17T05:18:48.902180+0000","last_fullsized":"2024-09-17T05:18:48.902180+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:26.479073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601536+0000","last_change":"2024-09-17T05:18:47.140788+0000","last_active":"2024-09-17T05:18:49.601536+0000","last_peered":"2024-09-17T05:18:49.601536+0000","last_clean":"2024-09-17T05:18:49.601536+0000","last_became_active":"2024-09-17T05:18:47.140502+0000","last_became_peered":"2024-09-17T05:18:47.140502+0000","last_unstale":"2024-09-17T05:18:49.601536+0000","last_undegraded":"2024-09-17T05:18:49.601536+0000","last_fullsized":"2024-09-17T05:18:49.601536+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:34.571312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"22'1","reported_seq":16,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117361+0000","last_change":"2024-09-17T05:18:46.126436+0000","last_active":"2024-09-17T05:18:48.117361+0000","last_peered":"2024-09-17T05:18:48.117361+0000","last_clean":"2024-09-17T05:18:48.117361+0000","last_became_active":"2024-09-17T05:18:46.126106+0000","last_became_peered":"2024-09-17T05:18:46.126106+0000","last_unstale":"2024-09-17T05:18:48.117361+0000","last_undegraded":"2024-09-17T05:18:48.117361+0000","last_fullsized":"2024-09-17T05:18:48.117361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:19.885120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":13,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:48.117337+0000","last_change":"2024-09-17T05:18:47.135662+0000","last_active":"2024-09-17T05:18:48.117337+0000","last_peered":"2024-09-17T05:18:48.117337+0000","last_clean":"2024-09-17T05:18:48.117337+0000","last_became_active":"2024-09-17T05:18:47.135205+0000","last_became_peered":"2024-09-17T05:18:47.135205+0000","last_unstale":"2024-09-17T05:18:48.117337+0000","last_undegraded":"2024-09-17T05:18:48.117337+0000","last_fullsized":"2024-09-17T05:18:48.117337+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:46.108157+0000","last_clean_scrub_stamp":"2024-09-17T05:18:46.108157+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:14.026901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"22'4","reported_seq":19,"reported_epoch":23,"state":"active+clean","last_fresh":"2024-09-17T05:18:49.601609+0000","last_change":"2024-09-17T05:18:46.135269+0000","last_active":"2024-09-17T05:18:49.601609+0000","last_peered":"2024-09-17T05:18:49.601609+0000","last_clean":"2024-09-17T05:18:49.601609+0000","last_became_active":"2024-09-17T05:18:46.135042+0000","last_became_peered":"2024-09-17T05:18:46.135042+0000","last_unstale":"2024-09-17T05:18:49.601609+0000","last_undegraded":"2024-09-17T05:18:49.601609+0000","last_fullsized":"2024-09-17T05:18:49.601609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:45.102026+0000","last_clean_scrub_stamp":"2024-09-17T05:18:45.102026+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:44.839201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509448,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":812,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":831488,"data_stored":672185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509448,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509447,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27260,"kb_used_data":232,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344580,"statfs":{"total":96636764160,"available":96608849920,"internally_reserved":0,"allocated":237568,"data_stored":81325,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509447,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":81361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509447,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":240,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":245760,"data_stored":82847,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509448,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27256,"kb_used_data":228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344584,"statfs":{"total":96636764160,"available":96608854016,"internally_reserved":0,"allocated":233472,"data_stored":81235,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509447,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27272,"kb_used_data":236,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344568,"statfs":{"total":96636764160,"available":96608837632,"internally_reserved":0,"allocated":241664,"data_stored":81395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574855,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":839680,"data_stored":672241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:18:58.774 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:18:58.774 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-17T05:18:58.774 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-17T05:18:58.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-17T05:18:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 -- 172.21.15.81:0/1539972607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161760 msgr2=0x7fd6640b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 --2- 172.21.15.81:0/1539972607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161760 0x7fd6640b5440 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fd650009830 tx=0x7fd65002a510 comp rx=0 tx=0).stop 2024-09-17T05:18:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 -- 172.21.15.81:0/1539972607 shutdown_connections 2024-09-17T05:18:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 --2- 172.21.15.81:0/1539972607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6640d24b0 0x7fd6640d2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 --2- 172.21.15.81:0/1539972607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161760 0x7fd6640b5440 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 -- 172.21.15.81:0/1539972607 >> 172.21.15.81:0/1539972607 conn(0x7fd6640d3ea0 msgr2=0x7fd6640d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 -- 172.21.15.81:0/1539972607 shutdown_connections 2024-09-17T05:18:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.913+0000 7fd66b072640 1 -- 172.21.15.81:0/1539972607 wait complete. 2024-09-17T05:18:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.914+0000 7fd66b072640 1 Processor -- start 2024-09-17T05:18:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.914+0000 7fd66b072640 1 -- start start 2024-09-17T05:18:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66b072640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6640d24b0 0x7fd6641f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66b072640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161380 0x7fd6640b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66b072640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd664161760 0x7fd6640d0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66b072640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640b1fb0 con 0x7fd6640d24b0 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66b072640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6640b1e30 con 0x7fd664161380 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66b072640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd6640b2130 con 0x7fd664161760 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6640d24b0 0x7fd6641f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6640d24b0 0x7fd6641f46a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38726/0 (socket says 172.21.15.81:38726) 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 -- 172.21.15.81:0/2947527903 learned_addr learned my addr 172.21.15.81:0/2947527903 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd663fff640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161380 0x7fd6640b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66960f640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd664161760 0x7fd6640d0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 -- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd664161760 msgr2=0x7fd6640d0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd664161760 0x7fd6640d0c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 -- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161380 msgr2=0x7fd6640b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161380 0x7fd6640b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 -- 172.21.15.81:0/2947527903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6640b7440 con 0x7fd6640d24b0 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd663fff640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161380 0x7fd6640b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd66960f640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd664161760 0x7fd6640d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd668e0e640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6640d24b0 0x7fd6641f46a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd65800c400 tx=0x7fd65800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd6617fa640 1 -- 172.21.15.81:0/2947527903 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6580052d0 con 0x7fd6640d24b0 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.915+0000 7fd6617fa640 1 -- 172.21.15.81:0/2947527903 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd658007020 con 0x7fd6640d24b0 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.916+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6640b7720 con 0x7fd6640d24b0 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.916+0000 7fd6617fa640 1 -- 172.21.15.81:0/2947527903 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd658007470 con 0x7fd6640d24b0 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.916+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6640cba00 con 0x7fd6640d24b0 2024-09-17T05:18:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.917+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6640d2900 con 0x7fd6640d24b0 2024-09-17T05:18:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.917+0000 7fd6617fa640 1 -- 172.21.15.81:0/2947527903 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd6580067d0 con 0x7fd6640d24b0 2024-09-17T05:18:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.918+0000 7fd6617fa640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd648078b90 0x7fd64807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.918+0000 7fd6617fa640 1 -- 172.21.15.81:0/2947527903 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd65809a130 con 0x7fd6640d24b0 2024-09-17T05:18:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.918+0000 7fd663fff640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd648078b90 0x7fd64807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:58.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.918+0000 7fd663fff640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd648078b90 0x7fd64807b050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd650034000 tx=0x7fd650004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:58.922+0000 7fd6617fa640 1 -- 172.21.15.81:0/2947527903 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd658062690 con 0x7fd6640d24b0 2024-09-17T05:18:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.135+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fd6640d4420 con 0x7fd6640d24b0 2024-09-17T05:18:59.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.135+0000 7fd6617fa640 1 -- 172.21.15.81:0/2947527903 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fd658061f90 con 0x7fd6640d24b0 2024-09-17T05:18:59.136 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:59.136 INFO:teuthology.orchestra.run.smithi081.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-17T05:18:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd648078b90 msgr2=0x7fd64807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd648078b90 0x7fd64807b050 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd650034000 tx=0x7fd650004730 comp rx=0 tx=0).stop 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6640d24b0 msgr2=0x7fd6641f46a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6640d24b0 0x7fd6641f46a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd65800c400 tx=0x7fd65800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 shutdown_connections 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd648078b90 0x7fd64807b050 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd664161760 0x7fd6640d0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd664161380 0x7fd6640b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 --2- 172.21.15.81:0/2947527903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6640d24b0 0x7fd6641f46a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 >> 172.21.15.81:0/2947527903 conn(0x7fd6640d3ea0 msgr2=0x7fd6640b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 shutdown_connections 2024-09-17T05:18:59.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.137+0000 7fd66b072640 1 -- 172.21.15.81:0/2947527903 wait complete. 2024-09-17T05:18:59.148 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-17T05:18:59.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 -- 172.21.15.81:0/1755469225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 msgr2=0x7f97e40b0cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 --2- 172.21.15.81:0/1755469225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40b0cd0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f97e0005fd0 tx=0x7f97e002a540 comp rx=0 tx=0).stop 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 -- 172.21.15.81:0/1755469225 shutdown_connections 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 --2- 172.21.15.81:0/1755469225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e40d2ae0 0x7f97e40b4130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 --2- 172.21.15.81:0/1755469225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40b0cd0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 -- 172.21.15.81:0/1755469225 >> 172.21.15.81:0/1755469225 conn(0x7f97e409d370 msgr2=0x7f97e40d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 -- 172.21.15.81:0/1755469225 shutdown_connections 2024-09-17T05:18:59.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.249+0000 7f97ec016640 1 -- 172.21.15.81:0/1755469225 wait complete. 2024-09-17T05:18:59.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.250+0000 7f97ec016640 1 Processor -- start 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ec016640 1 -- start start 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ec016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ec016640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e40d2690 0x7f97e4160b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ec016640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e40d2ae0 0x7f97e4161090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ec016640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40b2990 con 0x7f97e40d22b0 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ec016640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f97e40b2810 con 0x7f97e40d2ae0 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ec016640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f97e40b2b10 con 0x7f97e40d2690 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97e9db2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97e9db2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40d0bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38750/0 (socket says 172.21.15.81:38750) 2024-09-17T05:18:59.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97e9db2640 1 -- 172.21.15.81:0/1677433339 learned_addr learned my addr 172.21.15.81:0/1677433339 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97e95b1640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e40d2690 0x7f97e4160b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.251+0000 7f97ea5b3640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e40d2ae0 0x7f97e4161090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97e9db2640 1 -- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e40d2690 msgr2=0x7f97e4160b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97e9db2640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e40d2690 0x7f97e4160b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97e9db2640 1 -- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e40d2ae0 msgr2=0x7f97e4161090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97e9db2640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e40d2ae0 0x7f97e4161090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97e9db2640 1 -- 172.21.15.81:0/1677433339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97e40cfe70 con 0x7f97e40d22b0 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97e9db2640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40d0bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009850 tx=0x7f97e00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97da7fc640 1 -- 172.21.15.81:0/1677433339 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e003f070 con 0x7f97e40d22b0 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97da7fc640 1 -- 172.21.15.81:0/1677433339 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e00047a0 con 0x7f97e40d22b0 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97e41f8e50 con 0x7f97e40d22b0 2024-09-17T05:18:59.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97da7fc640 1 -- 172.21.15.81:0/1677433339 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0035030 con 0x7f97e40d22b0 2024-09-17T05:18:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.252+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97e40d03c0 con 0x7f97e40d22b0 2024-09-17T05:18:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.253+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97e40b0cd0 con 0x7f97e40d22b0 2024-09-17T05:18:59.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.253+0000 7f97da7fc640 1 -- 172.21.15.81:0/1677433339 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f97e0042070 con 0x7f97e40d22b0 2024-09-17T05:18:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.254+0000 7f97da7fc640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f97c8078b90 0x7f97c807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.254+0000 7f97da7fc640 1 -- 172.21.15.81:0/1677433339 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f97e00bba00 con 0x7f97e40d22b0 2024-09-17T05:18:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.254+0000 7f97e95b1640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f97c8078b90 0x7f97c807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.255+0000 7f97e95b1640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f97c8078b90 0x7f97c807b050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97e415cb60 tx=0x7f97d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:59.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.258+0000 7f97da7fc640 1 -- 172.21.15.81:0/1677433339 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f97e0083910 con 0x7f97e40d22b0 2024-09-17T05:18:59.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.475+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f97e406e8a0 con 0x7f97e40d22b0 2024-09-17T05:18:59.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.475+0000 7f97da7fc640 1 -- 172.21.15.81:0/1677433339 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f97e0088340 con 0x7f97e40d22b0 2024-09-17T05:18:59.476 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:59.476 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:18:59.477 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f97c8078b90 msgr2=0x7f97c807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f97c8078b90 0x7f97c807b050 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f97e415cb60 tx=0x7f97d4009040 comp rx=0 tx=0).stop 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 msgr2=0x7f97e40d0bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40d0bc0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f97e0009850 tx=0x7f97e00038a0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 shutdown_connections 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f97c8078b90 0x7f97c807b050 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97e40d2ae0 0x7f97e4161090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97e40d2690 0x7f97e4160b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 --2- 172.21.15.81:0/1677433339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97e40d22b0 0x7f97e40d0bc0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 >> 172.21.15.81:0/1677433339 conn(0x7f97e409d370 msgr2=0x7f97e41ea8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 shutdown_connections 2024-09-17T05:18:59.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.478+0000 7f97ec016640 1 -- 172.21.15.81:0/1677433339 wait complete. 2024-09-17T05:18:59.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:18:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 -- 172.21.15.81:0/546680366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f40d49c0 msgr2=0x7f78f40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 --2- 172.21.15.81:0/546680366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f40d49c0 0x7f78f40d0630 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f78e4005fd0 tx=0x7f78e402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 -- 172.21.15.81:0/546680366 shutdown_connections 2024-09-17T05:18:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 --2- 172.21.15.81:0/546680366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f40d49c0 0x7f78f40d0630 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 --2- 172.21.15.81:0/546680366 >> v2:172.21.15.160:3300/0 conn(0x7f78f415df90 0x7f78f40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 -- 172.21.15.81:0/546680366 >> 172.21.15.81:0/546680366 conn(0x7f78f40d3ea0 msgr2=0x7f78f40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 -- 172.21.15.81:0/546680366 shutdown_connections 2024-09-17T05:18:59.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.590+0000 7f78fc591640 1 -- 172.21.15.81:0/546680366 wait complete. 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.591+0000 7f78fc591640 1 Processor -- start 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.591+0000 7f78fc591640 1 -- start start 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f40d49c0 0x7f78f41f7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78f415df90 0x7f78f41f5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f4162480 0x7f78f4160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78f40d0f00 con 0x7f78f40d49c0 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f78f40d0d80 con 0x7f78f415df90 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f78f40b3f10 con 0x7f78f4162480 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f40d49c0 0x7f78f41f7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f40d49c0 0x7f78f41f7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38758/0 (socket says 172.21.15.81:38758) 2024-09-17T05:18:59.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 -- 172.21.15.81:0/3292254500 learned_addr learned my addr 172.21.15.81:0/3292254500 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78f9b2c640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78f415df90 0x7f78f41f5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fab2e640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f4162480 0x7f78f4160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 -- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f4162480 msgr2=0x7f78f4160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f4162480 0x7f78f4160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 -- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78f415df90 msgr2=0x7f78f41f5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78f415df90 0x7f78f41f5ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 -- 172.21.15.81:0/3292254500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78f41f5620 con 0x7f78f40d49c0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fa32d640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f40d49c0 0x7f78f41f7930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ea90 tx=0x7f78f000ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78eaffd640 1 -- 172.21.15.81:0/3292254500 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f000ce40 con 0x7f78f40d49c0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78eaffd640 1 -- 172.21.15.81:0/3292254500 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f78f0004020 con 0x7f78f40d49c0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78f40cc220 con 0x7f78f40d49c0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78eaffd640 1 -- 172.21.15.81:0/3292254500 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78f0004470 con 0x7f78f40d49c0 2024-09-17T05:18:59.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.592+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78f4161230 con 0x7f78f40d49c0 2024-09-17T05:18:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.593+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78f40b4430 con 0x7f78f40d49c0 2024-09-17T05:18:59.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.594+0000 7f78eaffd640 1 -- 172.21.15.81:0/3292254500 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f78f00035f0 con 0x7f78f40d49c0 2024-09-17T05:18:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.595+0000 7f78eaffd640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f78d8078bc0 0x7f78d807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.595+0000 7f78eaffd640 1 -- 172.21.15.81:0/3292254500 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f78f009b640 con 0x7f78f40d49c0 2024-09-17T05:18:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.595+0000 7f78f9b2c640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f78d8078bc0 0x7f78d807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.595+0000 7f78f9b2c640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f78d8078bc0 0x7f78d807b080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78e4033000 tx=0x7f78e4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:59.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.599+0000 7f78eaffd640 1 -- 172.21.15.81:0/3292254500 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f78f0063b20 con 0x7f78f40d49c0 2024-09-17T05:18:59.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.812+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78f408d590 con 0x7f78f40d49c0 2024-09-17T05:18:59.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.812+0000 7f78eaffd640 1 -- 172.21.15.81:0/3292254500 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f78f0063420 con 0x7f78f40d49c0 2024-09-17T05:18:59.813 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:18:59.813 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:18:59.814 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:18:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f78d8078bc0 msgr2=0x7f78d807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f78d8078bc0 0x7f78d807b080 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f78e4033000 tx=0x7f78e4004730 comp rx=0 tx=0).stop 2024-09-17T05:18:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f40d49c0 msgr2=0x7f78f41f7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f40d49c0 0x7f78f41f7930 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f78f000ea90 tx=0x7f78f000ef50 comp rx=0 tx=0).stop 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 shutdown_connections 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f78d8078bc0 0x7f78d807b080 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78f4162480 0x7f78f4160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78f415df90 0x7f78f41f5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 --2- 172.21.15.81:0/3292254500 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78f40d49c0 0x7f78f41f7930 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 >> 172.21.15.81:0/3292254500 conn(0x7f78f40d3ea0 msgr2=0x7f78f406e830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 shutdown_connections 2024-09-17T05:18:59.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.814+0000 7f78fc591640 1 -- 172.21.15.81:0/3292254500 wait complete. 2024-09-17T05:18:59.826 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.925+0000 7f1a7155d640 1 -- 172.21.15.81:0/619389833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a540051c0 msgr2=0x7f1a5400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.925+0000 7f1a7155d640 1 --2- 172.21.15.81:0/619389833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a540051c0 0x7f1a5400b9c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f1a64001dc0 tx=0x7f1a54005830 comp rx=0 tx=0).stop 2024-09-17T05:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.925+0000 7f1a7155d640 1 -- 172.21.15.81:0/619389833 shutdown_connections 2024-09-17T05:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.925+0000 7f1a7155d640 1 --2- 172.21.15.81:0/619389833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a540051c0 0x7f1a5400b9c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.925+0000 7f1a7155d640 1 -- 172.21.15.81:0/619389833 >> 172.21.15.81:0/619389833 conn(0x7f1a6c09aa30 msgr2=0x7f1a6c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.926+0000 7f1a7155d640 1 -- 172.21.15.81:0/619389833 shutdown_connections 2024-09-17T05:18:59.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.926+0000 7f1a7155d640 1 -- 172.21.15.81:0/619389833 wait complete. 2024-09-17T05:18:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.927+0000 7f1a7155d640 1 Processor -- start 2024-09-17T05:18:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.927+0000 7f1a7155d640 1 -- start start 2024-09-17T05:18:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.927+0000 7f1a7155d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a540051c0 0x7f1a6c15ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a7155d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a6c154cf0 0x7f1a6c154420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a7155d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a6c06e6d0 0x7f1a6c0ae970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a7155d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c0d00f0 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a7155d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1a6c15fbb0 con 0x7f1a540051c0 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a7155d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1a6c0d0270 con 0x7f1a6c154cf0 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a6c06e6d0 0x7f1a6c0ae970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a6c06e6d0 0x7f1a6c0ae970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38784/0 (socket says 172.21.15.81:38784) 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 -- 172.21.15.81:0/4051336182 learned_addr learned my addr 172.21.15.81:0/4051336182 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6affd640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a540051c0 0x7f1a6c15ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6a7fc640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a6c154cf0 0x7f1a6c154420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 -- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a6c154cf0 msgr2=0x7f1a6c154420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a6c154cf0 0x7f1a6c154420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 -- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a540051c0 msgr2=0x7f1a6c15ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a540051c0 0x7f1a6c15ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:18:59.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 -- 172.21.15.81:0/4051336182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a6c155260 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a6b7fe640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a6c06e6d0 0x7f1a6c0ae970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a64001eb0 tx=0x7f1a64001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a537fe640 1 -- 172.21.15.81:0/4051336182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a64003d80 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a537fe640 1 -- 172.21.15.81:0/4051336182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1a64032470 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a6c155540 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a537fe640 1 -- 172.21.15.81:0/4051336182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a640328c0 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.928+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a6c159c40 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.929+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a6c15c880 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.930+0000 7f1a537fe640 1 -- 172.21.15.81:0/4051336182 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1a64032a60 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.930+0000 7f1a537fe640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a58078bc0 0x7f1a5807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:18:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.930+0000 7f1a537fe640 1 -- 172.21.15.81:0/4051336182 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1a640bac40 con 0x7f1a6c06e6d0 2024-09-17T05:18:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.930+0000 7f1a6affd640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a58078bc0 0x7f1a5807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:18:59.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.931+0000 7f1a6affd640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a58078bc0 0x7f1a5807b080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c001410 tx=0x7f1a5c0068d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:18:59.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:18:59.935+0000 7f1a537fe640 1 -- 172.21.15.81:0/4051336182 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1a64083260 con 0x7f1a6c06e6d0 2024-09-17T05:19:00.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.113+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1a6c0cc230 con 0x7f1a6c06e6d0 2024-09-17T05:19:00.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.114+0000 7f1a537fe640 1 -- 172.21.15.81:0/4051336182 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7f1a64082b60 con 0x7f1a6c06e6d0 2024-09-17T05:19:00.115 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:00.115 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:48.113992+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a58078bc0 msgr2=0x7f1a5807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a58078bc0 0x7f1a5807b080 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f1a5c001410 tx=0x7f1a5c0068d0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a6c06e6d0 msgr2=0x7f1a6c0ae970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a6c06e6d0 0x7f1a6c0ae970 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1a64001eb0 tx=0x7f1a64001a00 comp rx=0 tx=0).stop 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 shutdown_connections 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1a58078bc0 0x7f1a5807b080 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1a6c06e6d0 0x7f1a6c0ae970 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1a6c154cf0 0x7f1a6c154420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 --2- 172.21.15.81:0/4051336182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1a540051c0 0x7f1a6c15ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 >> 172.21.15.81:0/4051336182 conn(0x7f1a6c09aa30 msgr2=0x7f1a6c0cdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 shutdown_connections 2024-09-17T05:19:00.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.116+0000 7f1a7155d640 1 -- 172.21.15.81:0/4051336182 wait complete. 2024-09-17T05:19:00.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 -- 172.21.15.81:0/2942143366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 msgr2=0x7fe7980b19c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 --2- 172.21.15.81:0/2942143366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7980b19c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fe790009ca0 tx=0x7fe79002a9a0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 -- 172.21.15.81:0/2942143366 shutdown_connections 2024-09-17T05:19:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 --2- 172.21.15.81:0/2942143366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7980b19c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 --2- 172.21.15.81:0/2942143366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7981615f0 0x7fe7980b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 -- 172.21.15.81:0/2942143366 >> 172.21.15.81:0/2942143366 conn(0x7fe7980d3e60 msgr2=0x7fe7980d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 -- 172.21.15.81:0/2942143366 shutdown_connections 2024-09-17T05:19:00.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.228+0000 7fe79d310640 1 -- 172.21.15.81:0/2942143366 wait complete. 2024-09-17T05:19:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.229+0000 7fe79d310640 1 Processor -- start 2024-09-17T05:19:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.229+0000 7fe79d310640 1 -- start start 2024-09-17T05:19:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe79d310640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7980b4d20 0x7fe7981f88b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe79d310640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7981f41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe79d310640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7981615f0 0x7fe7980b8650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe79d310640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7980b2370 con 0x7fe7980d2350 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe79d310640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe7980b21f0 con 0x7fe7981615f0 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe79d310640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe7980b24f0 con 0x7fe7980b4d20 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7967fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7981f41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7967fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7981f41c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38794/0 (socket says 172.21.15.81:38794) 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7967fc640 1 -- 172.21.15.81:0/975722829 learned_addr learned my addr 172.21.15.81:0/975722829 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7977fe640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7981615f0 0x7fe7980b8650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe796ffd640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7980b4d20 0x7fe7981f88b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7967fc640 1 -- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7980b4d20 msgr2=0x7fe7981f88b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7967fc640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7980b4d20 0x7fe7981f88b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7967fc640 1 -- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7981615f0 msgr2=0x7fe7980b8650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.230+0000 7fe7967fc640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7981615f0 0x7fe7980b8650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.231+0000 7fe7967fc640 1 -- 172.21.15.81:0/975722829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7981f8df0 con 0x7fe7980d2350 2024-09-17T05:19:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.231+0000 7fe7967fc640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7981f41c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c400 tx=0x7fe78000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.231+0000 7fe78f7fe640 1 -- 172.21.15.81:0/975722829 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780011790 con 0x7fe7980d2350 2024-09-17T05:19:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.231+0000 7fe78f7fe640 1 -- 172.21.15.81:0/975722829 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe780017070 con 0x7fe7980d2350 2024-09-17T05:19:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.231+0000 7fe78f7fe640 1 -- 172.21.15.81:0/975722829 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780011d00 con 0x7fe7980d2350 2024-09-17T05:19:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.231+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7980cbde0 con 0x7fe7980d2350 2024-09-17T05:19:00.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.231+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7980cc080 con 0x7fe7980d2350 2024-09-17T05:19:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.232+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7980b19c0 con 0x7fe7980d2350 2024-09-17T05:19:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.232+0000 7fe78f7fe640 1 -- 172.21.15.81:0/975722829 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe78001c460 con 0x7fe7980d2350 2024-09-17T05:19:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.233+0000 7fe78f7fe640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe778078b90 0x7fe77807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.233+0000 7fe78f7fe640 1 -- 172.21.15.81:0/975722829 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fe78009aa20 con 0x7fe7980d2350 2024-09-17T05:19:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.233+0000 7fe796ffd640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe778078b90 0x7fe77807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.234+0000 7fe796ffd640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe778078b90 0x7fe77807b050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7980d1040 tx=0x7fe78800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:00.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.237+0000 7fe78f7fe640 1 -- 172.21.15.81:0/975722829 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe7981f8df0 con 0x7fe7980d2350 2024-09-17T05:19:00.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.447+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7980b6580 con 0x7fe7980d2350 2024-09-17T05:19:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.448+0000 7fe78f7fe640 1 -- 172.21.15.81:0/975722829 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fe780062930 con 0x7fe7980d2350 2024-09-17T05:19:00.449 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:00.449 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:19:00.449 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe778078b90 msgr2=0x7fe77807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe778078b90 0x7fe77807b050 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe7980d1040 tx=0x7fe78800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 msgr2=0x7fe7981f41c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7981f41c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fe78000c400 tx=0x7fe78000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 shutdown_connections 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe778078b90 0x7fe77807b050 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7981615f0 0x7fe7980b8650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7980d2350 0x7fe7981f41c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 --2- 172.21.15.81:0/975722829 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7980b4d20 0x7fe7981f88b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 >> 172.21.15.81:0/975722829 conn(0x7fe7980d3e60 msgr2=0x7fe7980b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:00.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 shutdown_connections 2024-09-17T05:19:00.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.450+0000 7fe79d310640 1 -- 172.21.15.81:0/975722829 wait complete. 2024-09-17T05:19:00.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 7, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:18:46.468095+0000', 'modified': '2024-09-17T05:18:49.142842+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4363}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4363': {'gid': 4363, 'name': 'd', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6836/3590527387', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6834', 'nonce': 3590527387}, {'type': 'v1', 'addr': '172.21.15.160:6836', 'nonce': 3590527387}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4363, 'qdb_cluster': [4363]} 2024-09-17T05:19:00.865 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:19:00.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:19:00.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.967+0000 7f0b5dda3640 1 -- 172.21.15.81:0/4211951733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b5815bdc0 msgr2=0x7f0b580b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.967+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/4211951733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b5815bdc0 0x7f0b580b13e0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009830 tx=0x7f0b4802a480 comp rx=0 tx=0).stop 2024-09-17T05:19:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.967+0000 7f0b5dda3640 1 -- 172.21.15.81:0/4211951733 shutdown_connections 2024-09-17T05:19:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.967+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/4211951733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b5815bdc0 0x7f0b580b13e0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.967+0000 7f0b5dda3640 1 -- 172.21.15.81:0/4211951733 >> 172.21.15.81:0/4211951733 conn(0x7f0b58074cb0 msgr2=0x7f0b5809b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.967+0000 7f0b5dda3640 1 -- 172.21.15.81:0/4211951733 shutdown_connections 2024-09-17T05:19:00.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.967+0000 7f0b5dda3640 1 -- 172.21.15.81:0/4211951733 wait complete. 2024-09-17T05:19:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.968+0000 7f0b5dda3640 1 Processor -- start 2024-09-17T05:19:00.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b5dda3640 1 -- start start 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b5dda3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b580b1920 0x7f0b581f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b5dda3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b580d2420 0x7f0b580b76a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b5dda3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b5815bdc0 0x7f0b580cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b5dda3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580cdc40 con 0x7f0b580d2420 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b5dda3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b580cdac0 con 0x7f0b580b1920 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b5dda3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0b580b2540 con 0x7f0b5815bdc0 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b580d2420 0x7f0b580b76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b580d2420 0x7f0b580b76a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38812/0 (socket says 172.21.15.81:38812) 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b4effd640 1 -- 172.21.15.81:0/35600128 learned_addr learned my addr 172.21.15.81:0/35600128 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.969+0000 7f0b577fe640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b580b1920 0x7f0b581f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b57fff640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b5815bdc0 0x7f0b580cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b4effd640 1 -- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b5815bdc0 msgr2=0x7f0b580cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b4effd640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b5815bdc0 0x7f0b580cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b4effd640 1 -- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b580b1920 msgr2=0x7f0b581f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b4effd640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b580b1920 0x7f0b581f44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b4effd640 1 -- 172.21.15.81:0/35600128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b581f4b30 con 0x7f0b580d2420 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b4effd640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b580d2420 0x7f0b580b76a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c340 tx=0x7f0b4000c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b54ff9640 1 -- 172.21.15.81:0/35600128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40017070 con 0x7f0b580d2420 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b54ff9640 1 -- 172.21.15.81:0/35600128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b400035f0 con 0x7f0b580d2420 2024-09-17T05:19:00.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b581f4e10 con 0x7f0b580d2420 2024-09-17T05:19:00.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b54ff9640 1 -- 172.21.15.81:0/35600128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40003a80 con 0x7f0b580d2420 2024-09-17T05:19:00.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.970+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b5815d7d0 con 0x7f0b580d2420 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.971+0000 7f0b54ff9640 1 -- 172.21.15.81:0/35600128 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0b4001a070 con 0x7f0b580d2420 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.972+0000 7f0b54ff9640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0b38078b90 0x7f0b3807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.972+0000 7f0b54ff9640 1 -- 172.21.15.81:0/35600128 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b40099e60 con 0x7f0b580d2420 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.972+0000 7f0b577fe640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0b38078b90 0x7f0b3807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.973+0000 7f0b60c4b740 1 Processor -- start 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.973+0000 7f0b577fe640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0b38078b90 0x7f0b3807b050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b48034000 tx=0x7f0b48004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.973+0000 7f0b60c4b740 1 -- start start 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec911b0 0x5556aec68b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aecb11f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec665f0 0x5556aec66a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556aebdd820 con 0x5556aec665f0 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5556aebccc50 con 0x5556aecb0df0 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5556aebd0a60 con 0x5556aec911b0 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec665f0 0x5556aec66a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec665f0 0x5556aec66a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38820/0 (socket says 172.21.15.81:38820) 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 -- 172.21.15.81:0/2253329565 learned_addr learned my addr 172.21.15.81:0/2253329565 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b4effd640 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aecb11f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b577fe640 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec911b0 0x5556aec68b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 -- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec911b0 msgr2=0x5556aec68b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec911b0 0x5556aec68b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 -- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 msgr2=0x5556aecb11f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aecb11f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 -- 172.21.15.81:0/2253329565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556ae92e850 con 0x5556aec665f0 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec665f0 0x5556aec66a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b50001c70 tx=0x7f0b50002130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4682e3a9dc56da6b server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b4d7fa640 1 -- 172.21.15.81:0/2253329565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50019070 con 0x5556aec665f0 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b4d7fa640 1 -- 172.21.15.81:0/2253329565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b50003b80 con 0x5556aec665f0 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.974+0000 7f0b4d7fa640 1 -- 172.21.15.81:0/2253329565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b5000e860 con 0x5556aec665f0 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2253329565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec665f0 msgr2=0x5556aec66a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec665f0 0x5556aec66a40 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f0b50001c70 tx=0x7f0b50002130 comp rx=0 tx=0).stop 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2253329565 shutdown_connections 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec665f0 0x5556aec66a40 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aecb11f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2253329565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec911b0 0x5556aec68b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2253329565 >> 172.21.15.81:0/2253329565 conn(0x5556aec676a0 msgr2=0x5556aec6b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:00.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2253329565 shutdown_connections 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.975+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2253329565 wait complete. 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 -- start start 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 Processor -- start 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec8c920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec8ce60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556ae93d620 con 0x5556aecb0df0 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5556aeb725f0 con 0x5556aec911b0 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5556aec65b30 con 0x5556aec93100 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.976+0000 7f0b60c4b740 10 client.0 _ll_register_callbacks cb 0x5556aeb760a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:19:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec8ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec8ce60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38836/0 (socket says 172.21.15.81:38836) 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 -- 172.21.15.81:0/3664902261 learned_addr learned my addr 172.21.15.81:0/3664902261 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b577fe640 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec8c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b57fff640 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 -- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 msgr2=0x5556aec93580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 -- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 msgr2=0x5556aec8c920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec8c920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 -- 172.21.15.81:0/3664902261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556ae9a56b0 con 0x5556aecb0df0 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b4effd640 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec8ce60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b400619c0 tx=0x7f0b40003f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44a2d62e2aacc04c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b367fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:19:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b367fc640 1 -- 172.21.15.81:0/3664902261 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b40088020 con 0x5556aecb0df0 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b367fc640 1 -- 172.21.15.81:0/3664902261 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b4005d610 con 0x5556aecb0df0 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b50003b80 con 0x5556aecb0df0 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b367fc640 1 -- 172.21.15.81:0/3664902261 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0b40082050 con 0x5556aecb0df0 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 10 client.4620 fetch_fsmap learned FSMap version 7 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5556aec94690 con 0x5556aecb0df0 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b367fc640 1 -- 172.21.15.81:0/3664902261 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b4007d020 con 0x5556aecb0df0 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b367fc640 1 -- 172.21.15.81:0/3664902261 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f0b4005d810 con 0x5556aecb0df0 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 10 client.4620 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 10 client.4620 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 20 client.4620 populate_metadata read hostname 'smithi081' 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8af50 0x5556aec8b330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:00.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 4 client.4620 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.977+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 --> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556aebdf770 con 0x5556aec8af50 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.978+0000 7f0b577fe640 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8af50 0x5556aec8b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.978+0000 7f0b577fe640 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8af50 0x5556aec8b330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=782aa6b90fa69ffb server_cookie=413dbb94f2d67ff1 in_seq=0 out_seq=0 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.978+0000 7f0b367fc640 10 client.4620 ms_handle_connect on v2:172.21.15.160:6834/3590527387 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b367fc640 1 -- 172.21.15.81:0/3664902261 <== mds.0 v2:172.21.15.160:6834/3590527387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5556aebdf770 con 0x5556aec8af50 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b367fc640 10 client.4620 handle_command_reply: tid=0 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 client.4620 shutdown 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 msgr2=0x5556aec8ce60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec8ce60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f0b400619c0 tx=0x7f0b40003f60 comp rx=0 tx=0).stop 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 shutdown_connections 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8af50 0x5556aec8b330 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec8ce60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/3664902261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec8c920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b367fc640 0 client.4620 ms_handle_reset on v2:172.21.15.160:6834/3590527387 2024-09-17T05:19:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 >> 172.21.15.81:0/3664902261 conn(0x5556aec665f0 msgr2=0x5556aec91590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 shutdown_connections 2024-09-17T05:19:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 1 -- 172.21.15.81:0/3664902261 wait complete. 2024-09-17T05:19:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.979+0000 7f0b60c4b740 20 client.4620 trim_cache size 0 max 16384 2024-09-17T05:19:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.997+0000 7f0b60c4b740 1 Processor -- start 2024-09-17T05:19:00.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.997+0000 7f0b60c4b740 1 -- start start 2024-09-17T05:19:01.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec64970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec64eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec69b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b581fff50 con 0x5556aecb0df0 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5815e600 con 0x5556aec911b0 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0b5815ec50 con 0x5556aec93100 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec69b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec69b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38852/0 (socket says 172.21.15.81:38852) 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 -- 172.21.15.81:0/2401194149 learned_addr learned my addr 172.21.15.81:0/2401194149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b577fe640 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec64970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b4effd640 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec64eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 -- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 msgr2=0x5556aec64eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec64eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 -- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 msgr2=0x5556aec64970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec64970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 -- 172.21.15.81:0/2401194149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556aec90fe0 con 0x5556aecb0df0 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b577fe640 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec64970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec69b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b50017040 tx=0x7f0b500013a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24be79de176c7d29 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.998+0000 7f0b4cff9640 1 -- 172.21.15.81:0/2401194149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50021020 con 0x5556aecb0df0 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b4cff9640 1 -- 172.21.15.81:0/2401194149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b5000e860 con 0x5556aecb0df0 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b4cff9640 1 -- 172.21.15.81:0/2401194149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b50019040 con 0x5556aecb0df0 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2401194149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 msgr2=0x5556aec69b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec69b30 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f0b50017040 tx=0x7f0b500013a0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2401194149 shutdown_connections 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aecb0df0 0x5556aec69b30 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec64eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2401194149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aec911b0 0x5556aec64970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2401194149 >> 172.21.15.81:0/2401194149 conn(0x5556aec665f0 msgr2=0x5556aec60cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2401194149 shutdown_connections 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:00.999+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2401194149 wait complete. 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.000+0000 7f0b60c4b740 1 -- start start 2024-09-17T05:19:01.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.000+0000 7f0b60c4b740 1 Processor -- start 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.000+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec911b0 0x5556aed33d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.000+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aec93ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5556aec89490 con 0x5556aec911b0 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5556aec8bcd0 con 0x5556aecb0df0 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5556aecc3670 con 0x5556aec93100 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 10 client.0 _ll_register_callbacks cb 0x7f0b40061a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:19:01.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec911b0 0x5556aed33d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec911b0 0x5556aed33d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38858/0 (socket says 172.21.15.81:38858) 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 -- 172.21.15.81:0/2783815433 learned_addr learned my addr 172.21.15.81:0/2783815433 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b57fff640 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aec93ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b4effd640 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 -- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 msgr2=0x5556aec93580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 -- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 msgr2=0x5556aec93ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aec93ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 -- 172.21.15.81:0/2783815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556aed34240 con 0x5556aec911b0 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b577fe640 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec911b0 0x5556aed33d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009950 tx=0x7f0b48005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b85eb612428ee328 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:01.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b367fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b367fc640 1 -- 172.21.15.81:0/2783815433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48058060 con 0x5556aec911b0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b367fc640 1 -- 172.21.15.81:0/2783815433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0b4804a900 con 0x5556aec911b0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b5000e860 con 0x5556aec911b0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b367fc640 1 -- 172.21.15.81:0/2783815433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f0b4805e050 con 0x5556aec911b0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 10 client.4626 fetch_fsmap learned FSMap version 7 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5556aecd3ed0 con 0x5556aec911b0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b367fc640 1 -- 172.21.15.81:0/2783815433 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0b5000e860 con 0x5556aec911b0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b367fc640 1 -- 172.21.15.81:0/2783815433 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 7) ==== 3502+0+0 (secure 0 0 0) 0x7f0b48061020 con 0x5556aec911b0 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 10 client.4626 fetch_fsmap finished waiting for FSMap version 7 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 10 client.4626 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.001+0000 7f0b60c4b740 20 client.4626 populate_metadata read hostname 'smithi081' 2024-09-17T05:19:01.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8cb50 0x5556aecd2e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 4 client.4626 mds_command: new command op to 4363 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 --> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] -- command(tid 0: {"prefix": "status"}) -- 0x5556aebdb220 con 0x5556aec8cb50 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b4effd640 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8cb50 0x5556aecd2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b4effd640 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8cb50 0x5556aecd2e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9dc3814825ade5d4 server_cookie=c13e8b995d86fbef in_seq=0 out_seq=0 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b367fc640 10 client.4626 ms_handle_connect on v2:172.21.15.160:6834/3590527387 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b367fc640 1 -- 172.21.15.81:0/2783815433 <== mds.0 v2:172.21.15.160:6834/3590527387 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x5556aebdb220 con 0x5556aec8cb50 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b367fc640 10 client.4626 handle_command_reply: tid=0 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 client.4626 shutdown 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec911b0 msgr2=0x5556aed33d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec911b0 0x5556aed33d00 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f0b48009950 tx=0x7f0b48005f90 comp rx=0 tx=0).stop 2024-09-17T05:19:01.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 shutdown_connections 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5556aecb0df0 0x5556aec93ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5556aec93100 0x5556aec93580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.160:6834/3590527387,v1:172.21.15.160:6836/3590527387] conn(0x5556aec8cb50 0x5556aecd2e50 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 --2- 172.21.15.81:0/2783815433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5556aec911b0 0x5556aed33d00 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b367fc640 0 client.4626 ms_handle_reset on v2:172.21.15.160:6834/3590527387 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.002+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 >> 172.21.15.81:0/2783815433 conn(0x5556aec665f0 msgr2=0x5556aec60e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 shutdown_connections 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b60c4b740 1 -- 172.21.15.81:0/2783815433 wait complete. 2024-09-17T05:19:01.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b60c4b740 20 client.4626 trim_cache size 0 max 16384 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4363, 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 13.875873957, 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 7, 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 23, 2024-09-17T05:19:01.012 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 23, 2024-09-17T05:19:01.013 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 19.361094296000001 2024-09-17T05:19:01.013 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0b38078b90 msgr2=0x7f0b3807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0b38078b90 0x7f0b3807b050 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f0b48034000 tx=0x7f0b48004730 comp rx=0 tx=0).stop 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b580d2420 msgr2=0x7f0b580b76a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b580d2420 0x7f0b580b76a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000c340 tx=0x7f0b4000c800 comp rx=0 tx=0).stop 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 shutdown_connections 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0b38078b90 0x7f0b3807b050 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b5815bdc0 0x7f0b580cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b580d2420 0x7f0b580b76a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 --2- 172.21.15.81:0/35600128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b580b1920 0x7f0b581f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 >> 172.21.15.81:0/35600128 conn(0x7f0b58074cb0 msgr2=0x7f0b5806dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 shutdown_connections 2024-09-17T05:19:01.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.003+0000 7f0b5dda3640 1 -- 172.21.15.81:0/35600128 wait complete. 2024-09-17T05:19:01.016 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-17T05:19:01.042 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-17T05:19:01.042 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2024-09-17T05:19:01.042 INFO:tasks.ceph_fuse:client.0 config is {} 2024-09-17T05:19:01.042 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:19:01.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:01.043 INFO:tasks.ceph_fuse:client.2 config is {} 2024-09-17T05:19:01.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:19:01.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:01.043 INFO:tasks.ceph_fuse:client.1 config is {} 2024-09-17T05:19:01.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:19:01.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:01.043 INFO:tasks.ceph_fuse:client.3 config is {} 2024-09-17T05:19:01.043 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-17T05:19:01.043 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:01.044 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:01.044 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:19:01.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:01.060 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-17T05:19:01.126 INFO:teuthology.orchestra.run.smithi081.stderr:Cannot find device "ceph-brx" 2024-09-17T05:19:01.127 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:19:01.128 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:01.128 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:19:01.147 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:01.148 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2024-09-17T05:19:01.219 INFO:teuthology.orchestra.run.smithi160.stderr:Cannot find device "ceph-brx" 2024-09-17T05:19:01.221 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:19:01.221 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-17T05:19:01.221 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T05:19:01.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 -- 172.21.15.81:0/3877248587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3015df90 msgr2=0x7f0a300cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/3877248587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3015df90 0x7f0a300cf9b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0a300b9f20 tx=0x7f0a2802a560 comp rx=0 tx=0).stop 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 -- 172.21.15.81:0/3877248587 shutdown_connections 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/3877248587 >> v2:172.21.15.160:3300/0 conn(0x7f0a300d0d40 0x7f0a300b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/3877248587 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a3015df90 0x7f0a300cf9b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 -- 172.21.15.81:0/3877248587 >> 172.21.15.81:0/3877248587 conn(0x7f0a300d3ea0 msgr2=0x7f0a300d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 -- 172.21.15.81:0/3877248587 shutdown_connections 2024-09-17T05:19:01.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.321+0000 7f0a36cbf640 1 -- 172.21.15.81:0/3877248587 wait complete. 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.322+0000 7f0a36cbf640 1 Processor -- start 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a36cbf640 1 -- start start 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a36cbf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a300d0d40 0x7f0a300a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a36cbf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a300d49c0 0x7f0a300b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a36cbf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a3015df90 0x7f0a3014dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a36cbf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a30162690 con 0x7f0a300d49c0 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a36cbf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a300b3d40 con 0x7f0a3015df90 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a36cbf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0a300a1bc0 con 0x7f0a300d0d40 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.323+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a300d49c0 0x7f0a300b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a300d49c0 0x7f0a300b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38868/0 (socket says 172.21.15.81:38868) 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 -- 172.21.15.81:0/1022830338 learned_addr learned my addr 172.21.15.81:0/1022830338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:01.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a34a5b640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a300d0d40 0x7f0a300a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a3525c640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a3015df90 0x7f0a3014dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 -- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a300d0d40 msgr2=0x7f0a300a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a300d0d40 0x7f0a300a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 -- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a3015df90 msgr2=0x7f0a3014dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a3015df90 0x7f0a3014dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 -- 172.21.15.81:0/1022830338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a300b9800 con 0x7f0a300d49c0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a3525c640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a3015df90 0x7f0a3014dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2ffff640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a300d49c0 0x7f0a300b92c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c7d0 tx=0x7f0a2000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2d7fa640 1 -- 172.21.15.81:0/1022830338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a20017070 con 0x7f0a300d49c0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2d7fa640 1 -- 172.21.15.81:0/1022830338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a20005070 con 0x7f0a300d49c0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a300b8220 con 0x7f0a300d49c0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a2d7fa640 1 -- 172.21.15.81:0/1022830338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a200054c0 con 0x7f0a300d49c0 2024-09-17T05:19:01.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.324+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a300b87e0 con 0x7f0a300d49c0 2024-09-17T05:19:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.325+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a300b5440 con 0x7f0a300d49c0 2024-09-17T05:19:01.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.326+0000 7f0a2d7fa640 1 -- 172.21.15.81:0/1022830338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f0a2001a070 con 0x7f0a300d49c0 2024-09-17T05:19:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.326+0000 7f0a2d7fa640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a10078b90 0x7f0a1007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.326+0000 7f0a2d7fa640 1 -- 172.21.15.81:0/1022830338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f0a2009a390 con 0x7f0a300d49c0 2024-09-17T05:19:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.326+0000 7f0a34a5b640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a10078b90 0x7f0a1007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:01.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.327+0000 7f0a34a5b640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a10078b90 0x7f0a1007b050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a28033000 tx=0x7f0a28004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:01.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.330+0000 7f0a2d7fa640 1 -- 172.21.15.81:0/1022830338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0a20062210 con 0x7f0a300d49c0 2024-09-17T05:19:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.545+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f0a3008d590 con 0x7f0a300d49c0 2024-09-17T05:19:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.545+0000 7f0a2d7fa640 1 -- 172.21.15.81:0/1022830338 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f0a20066c40 con 0x7f0a300d49c0 2024-09-17T05:19:01.547 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:19:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.547+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a10078b90 msgr2=0x7f0a1007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.547+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a10078b90 0x7f0a1007b050 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f0a28033000 tx=0x7f0a28004730 comp rx=0 tx=0).stop 2024-09-17T05:19:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.547+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a300d49c0 msgr2=0x7f0a300b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.547+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a300d49c0 0x7f0a300b92c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0a2000c7d0 tx=0x7f0a2000cc90 comp rx=0 tx=0).stop 2024-09-17T05:19:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 shutdown_connections 2024-09-17T05:19:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a10078b90 0x7f0a1007b050 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a3015df90 0x7f0a3014dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a300d49c0 0x7f0a300b92c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 --2- 172.21.15.81:0/1022830338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a300d0d40 0x7f0a300a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 >> 172.21.15.81:0/1022830338 conn(0x7f0a300d3ea0 msgr2=0x7f0a3006e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 shutdown_connections 2024-09-17T05:19:01.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01.548+0000 7f0a36cbf640 1 -- 172.21.15.81:0/1022830338 wait complete. 2024-09-17T05:19:01.559 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:19:01.559 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:19:01.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:19:01.560 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:19:01.560 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:01.560 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:19:01.560 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:19:01.560 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:19:01.560 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:19:01.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:01.561 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:19:01.576 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:01.576 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:01.576 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:01.576 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:01.576 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:19:01.577 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:01.578 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:19:01.578 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42776sec preferred_lft 42776sec 2024-09-17T05:19:01.578 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:19:01.578 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:01.578 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:19:01.578 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:01.579 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:01.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:19:01.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr flush dev ceph-brx 2024-09-17T05:19:01.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set ceph-brx up 2024-09-17T05:19:01.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:19:01.579 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:01.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:01.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:01.775 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:01.775 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:19:01.800 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:19:01.802 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:01.802 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:19:01.865 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:19:01.865 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:19:01.865 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:19:01.865 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:19:01.865 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:19:01.866 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:01.866 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:01.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:19:01.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:19:01.866 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:19:01.866 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:01.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:01 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:02.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:02.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:02.183 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:19:02.199 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:02.199 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-17T05:19:02.254 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:02.255 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:02.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:02.255 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-17T05:19:02.255 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:02.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:02.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:02.372 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-17T05:19:02.372 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:02.372 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:02.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-17T05:19:02.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:19:02.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-17T05:19:02.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-17T05:19:02.373 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-17T05:19:02.373 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:02.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:02.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:02.502 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:02.502 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:02.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:19:02.502 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:19:02.502 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:02.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:02 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:02.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:02 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:02.578 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:19:02.578 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:02.578 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:02.593 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:19:02.594 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:02.594 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:02.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:19:02.716 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:02.773 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:19:02.773 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:19:02.773 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:19:02.773 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:19:02.774 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:19:02.775 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:02.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:02.776 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:19:02.829 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:19:02.829 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:19:02.872 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:19:02.896 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:19:02.953 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:02.954 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:02.955 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:02.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:02.956 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:19:02.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:19:02.974+0000 7fa28ca65480 -1 init, newargv = 0x55a169337620 newargc=15 2024-09-17T05:19:02.975 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45213]: starting ceph client 2024-09-17T05:19:02.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[45213]: starting fuse 2024-09-17T05:19:02.990 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:19:02.990 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:19:02.991 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:02.992 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:19:02.993 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:19:03.107 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.45213.asok 2024-09-17T05:19:03.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:03.117 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.45213.asok 2024-09-17T05:19:03.117 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:03.117 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.45213.asok status 2024-09-17T05:19:03.249 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "45213", 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:19:03.250 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4638, 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4638 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 560867750 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:03.251 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 560867750 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4638 192.168.0.1:0/560867750", 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/560867750", 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 23, 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:19:03.252 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:19:03.253 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:19:03.253 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:19:03.258 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T05:19:03.258 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:19:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.357+0000 7f7e2145a640 1 -- 172.21.15.81:0/3321714789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 msgr2=0x7f7e1c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.357+0000 7f7e2145a640 1 --2- 172.21.15.81:0/3321714789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c0cf9b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7e1c0cf6a0 tx=0x7f7e0c02a510 comp rx=0 tx=0).stop 2024-09-17T05:19:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.357+0000 7f7e2145a640 1 -- 172.21.15.81:0/3321714789 shutdown_connections 2024-09-17T05:19:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.357+0000 7f7e2145a640 1 --2- 172.21.15.81:0/3321714789 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c0cf9b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.357+0000 7f7e2145a640 1 -- 172.21.15.81:0/3321714789 >> 172.21.15.81:0/3321714789 conn(0x7f7e1c0d3ea0 msgr2=0x7f7e1c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.357+0000 7f7e2145a640 1 -- 172.21.15.81:0/3321714789 shutdown_connections 2024-09-17T05:19:03.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.357+0000 7f7e2145a640 1 -- 172.21.15.81:0/3321714789 wait complete. 2024-09-17T05:19:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.358+0000 7f7e2145a640 1 Processor -- start 2024-09-17T05:19:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.358+0000 7f7e2145a640 1 -- start start 2024-09-17T05:19:03.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e2145a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e1c0d0d40 0x7f7e1c150d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e2145a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e1c0d49c0 0x7f7e1c0cddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e2145a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c14d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e2145a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c162690 con 0x7f7e1c15df90 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e2145a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7e1c0b3f10 con 0x7f7e1c0d49c0 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e2145a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7e1c160730 con 0x7f7e1c0d0d40 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c14d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e1b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c14d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33586/0 (socket says 172.21.15.81:33586) 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e1b7fe640 1 -- 172.21.15.81:0/248111344 learned_addr learned my addr 172.21.15.81:0/248111344 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.359+0000 7f7e127fc640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e1c0d49c0 0x7f7e1c0cddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1affd640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e1c0d0d40 0x7f7e1c150d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1b7fe640 1 -- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e1c0d0d40 msgr2=0x7f7e1c150d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1b7fe640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e1c0d0d40 0x7f7e1c150d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1b7fe640 1 -- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e1c0d49c0 msgr2=0x7f7e1c0cddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1b7fe640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e1c0d49c0 0x7f7e1c0cddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1b7fe640 1 -- 172.21.15.81:0/248111344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e1c15e710 con 0x7f7e1c15df90 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1affd640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e1c0d0d40 0x7f7e1c150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e1b7fe640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c14d820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c770 tx=0x7f7e1400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e13fff640 1 -- 172.21.15.81:0/248111344 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e14003da0 con 0x7f7e1c15df90 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e13fff640 1 -- 172.21.15.81:0/248111344 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e14005070 con 0x7f7e1c15df90 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e1c1600e0 con 0x7f7e1c15df90 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e13fff640 1 -- 172.21.15.81:0/248111344 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e140054c0 con 0x7f7e1c15df90 2024-09-17T05:19:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.360+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e1c14e120 con 0x7f7e1c15df90 2024-09-17T05:19:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.361+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e1c0b44e0 con 0x7f7e1c15df90 2024-09-17T05:19:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.361+0000 7f7e13fff640 1 -- 172.21.15.81:0/248111344 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7e14005660 con 0x7f7e1c15df90 2024-09-17T05:19:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.362+0000 7f7e13fff640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7dfc078bc0 0x7f7dfc07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.362+0000 7f7e13fff640 1 -- 172.21.15.81:0/248111344 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f7e1409ab20 con 0x7f7e1c15df90 2024-09-17T05:19:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.362+0000 7f7e1affd640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7dfc078bc0 0x7f7dfc07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.363+0000 7f7e1affd640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7dfc078bc0 0x7f7dfc07b080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c034000 tx=0x7f7e0c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:03.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.367+0000 7f7e13fff640 1 -- 172.21.15.81:0/248111344 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7e1c0ce970 con 0x7f7e1c15df90 2024-09-17T05:19:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.581+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7e1c0cad30 con 0x7f7e1c15df90 2024-09-17T05:19:03.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.582+0000 7f7e13fff640 1 -- 172.21.15.81:0/248111344 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f7e14062ff0 con 0x7f7e1c15df90 2024-09-17T05:19:03.583 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:19:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7dfc078bc0 msgr2=0x7f7dfc07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7dfc078bc0 0x7f7dfc07b080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c034000 tx=0x7f7e0c004730 comp rx=0 tx=0).stop 2024-09-17T05:19:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 msgr2=0x7f7e1c14d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c14d820 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f7e1400c770 tx=0x7f7e1400cc30 comp rx=0 tx=0).stop 2024-09-17T05:19:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 shutdown_connections 2024-09-17T05:19:03.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7dfc078bc0 0x7f7dfc07b080 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e1c15df90 0x7f7e1c14d820 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e1c0d49c0 0x7f7e1c0cddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 --2- 172.21.15.81:0/248111344 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e1c0d0d40 0x7f7e1c150d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 >> 172.21.15.81:0/248111344 conn(0x7f7e1c0d3ea0 msgr2=0x7f7e1c0cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 shutdown_connections 2024-09-17T05:19:03.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03.584+0000 7f7e2145a640 1 -- 172.21.15.81:0/248111344 wait complete. 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:self.client.name = client.2 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:19:03.596 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:19:03.596 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:03.597 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:19:03.612 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:03.612 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:03.612 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:03.613 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42774sec preferred_lft 42774sec 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:19:03.614 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:03.615 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:19:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:19:03.615 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:03.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:03.615 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:19:03.676 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:19:03.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:03.678 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:19:03.734 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:19:03.734 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:19:03.734 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:19:03.734 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:19:03.734 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:19:03.735 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:03.735 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:03.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:19:03.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:19:03.735 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:19:03.735 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:03.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:03.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:03.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:03.860 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:19:03.876 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:19:03.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:03.876 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list-id 2024-09-17T05:19:03.931 INFO:teuthology.orchestra.run.smithi081.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2024-09-17T05:19:03.931 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:03.931 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:03.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:03.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2024-09-17T05:19:03.931 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:04.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:04.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:04.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:04.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:19:04.071 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:04.072 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:04.072 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:04.072 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.072 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:04.072 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.073 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:04.073 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 2a:45:87:ce:f9:4e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:19:04.073 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:19:04.073 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.073 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::2845:87ff:fece:f94e/64 scope link 2024-09-17T05:19:04.074 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.075 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:04.075 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2024-09-17T05:19:04.139 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:04.139 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:04.139 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:04.139 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.139 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:04.139 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.139 INFO:teuthology.orchestra.run.smithi081.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:04.140 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 2a:45:87:ce:f9:4e brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:19:04.140 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:19:04.140 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.140 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::2845:87ff:fece:f94e/64 scope link 2024-09-17T05:19:04.140 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:04.146 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2024-09-17T05:19:04.146 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:04.146 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:04.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2024-09-17T05:19:04.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:19:04.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2024-09-17T05:19:04.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2024-09-17T05:19:04.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2024-09-17T05:19:04.147 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:04.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:04.293 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:04.293 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:04.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.1 up 2024-09-17T05:19:04.293 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:19:04.293 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:04.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:04.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:04.369 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2024-09-17T05:19:04.370 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:04.370 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:04.384 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2024-09-17T05:19:04.385 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:04.385 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:04.440 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:19:04.505 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:04.562 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:19:04.562 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:19:04.562 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:19:04.563 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:04.564 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:04.565 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:04.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:04.566 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:19:04.617 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:19:04.618 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-17T05:19:04.618 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2024-09-17T05:19:04.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:19:04.685 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:04.741 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:19:04.742 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:19:04.742 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:19:04.742 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:19:04.742 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:19:04.742 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:19:04.742 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:19:04.743 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:19:04.743 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:19:04.743 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:19:04.743 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:19:04.743 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:19:04.743 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:04.744 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:19:04.744 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:19:04.744 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:19:04.744 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:19:04.744 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:04.744 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:19:04.745 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:04.745 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:04.745 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:04.745 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:04.745 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:19:04.746 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:19:04.746 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:19:04.746 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:19:04.747 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:19:04.747 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:19:04.747 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:19:04.747 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:04.747 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:04.747 INFO:teuthology.orchestra.run.smithi081.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:04.748 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:04.748 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:04.748 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:2024-09-17T05:19:04.740+0000 7f143b824480 -1 init, newargv = 0x55cad17d94c0 newargc=15 2024-09-17T05:19:04.749 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:ceph-fuse[45693]: starting ceph client 2024-09-17T05:19:04.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:04.750 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:19:04.751 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi081.stderr:ceph-fuse[45693]: starting fuse 2024-09-17T05:19:04.806 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:19:04.806 INFO:teuthology.orchestra.run.smithi081.stdout:44 2024-09-17T05:19:04.806 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-17T05:19:04.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:04.807 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:19:04.808 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:04.809 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.2")) 2024-09-17T05:19:04.809 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:19:04.923 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.2.45693.asok 2024-09-17T05:19:04.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:04.934 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.45693.asok 2024-09-17T05:19:04.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:04.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.45693.asok status 2024-09-17T05:19:05.067 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:19:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:19:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:19:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:19:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "2", 2024-09-17T05:19:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:19:05.067 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "45693", 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4656, 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 4656 2024-09-17T05:19:05.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.2:0", 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 992188011 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.2:0", 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 992188011 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:05.069 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.4656 192.168.0.2:0/992188011", 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.2:0/992188011", 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 7, 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 23, 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:19:05.070 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:19:05.076 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T05:19:05.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:19:05.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 -- 172.21.15.81:0/1775636465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d49c0 msgr2=0x7f9ae40b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:05.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 --2- 172.21.15.81:0/1775636465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d49c0 0x7f9ae40b3800 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40d1eb0 tx=0x7f9ad402a560 comp rx=0 tx=0).stop 2024-09-17T05:19:05.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 -- 172.21.15.81:0/1775636465 shutdown_connections 2024-09-17T05:19:05.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 --2- 172.21.15.81:0/1775636465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d49c0 0x7f9ae40b3800 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 --2- 172.21.15.81:0/1775636465 >> v2:172.21.15.160:3300/0 conn(0x7f9ae40d0d40 0x7f9ae40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 -- 172.21.15.81:0/1775636465 >> 172.21.15.81:0/1775636465 conn(0x7f9ae40d3ea0 msgr2=0x7f9ae40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:05.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 -- 172.21.15.81:0/1775636465 shutdown_connections 2024-09-17T05:19:05.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.177+0000 7f9ae9247640 1 -- 172.21.15.81:0/1775636465 wait complete. 2024-09-17T05:19:05.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.178+0000 7f9ae9247640 1 Processor -- start 2024-09-17T05:19:05.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae9247640 1 -- start start 2024-09-17T05:19:05.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae9247640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d0d40 0x7f9ae409dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:05.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae9247640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 0x7f9ae415c070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:05.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae9247640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae415df90 0x7f9ae415ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:05.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae9247640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae4162690 con 0x7f9ae40d0d40 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae9247640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40b3d40 con 0x7f9ae40d49c0 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae9247640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae41604d0 con 0x7f9ae415df90 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d0d40 0x7f9ae409dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d0d40 0x7f9ae409dc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33600/0 (socket says 172.21.15.81:33600) 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae2d9d640 1 -- 172.21.15.81:0/3611040184 learned_addr learned my addr 172.21.15.81:0/3611040184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae259c640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 0x7f9ae415c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.179+0000 7f9ae359e640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae415df90 0x7f9ae415ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae2d9d640 1 -- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae415df90 msgr2=0x7f9ae415ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae2d9d640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae415df90 0x7f9ae415ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae2d9d640 1 -- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 msgr2=0x7f9ae415c070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:05.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae2d9d640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 0x7f9ae415c070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae2d9d640 1 -- 172.21.15.81:0/3611040184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae4160f90 con 0x7f9ae40d0d40 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae359e640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae415df90 0x7f9ae415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae2d9d640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d0d40 0x7f9ae409dc30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00ba80 tx=0x7f9adc00be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9adb7fe640 1 -- 172.21.15.81:0/3611040184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc019070 con 0x7f9ae40d0d40 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9adb7fe640 1 -- 172.21.15.81:0/3611040184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9adc00cc60 con 0x7f9ae40d0d40 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae4161270 con 0x7f9ae40d0d40 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9adb7fe640 1 -- 172.21.15.81:0/3611040184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc0146a0 con 0x7f9ae40d0d40 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.180+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae40cbe00 con 0x7f9ae40d0d40 2024-09-17T05:19:05.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.181+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae40cbfd0 con 0x7f9ae40d0d40 2024-09-17T05:19:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.182+0000 7f9adb7fe640 1 -- 172.21.15.81:0/3611040184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9adc01c070 con 0x7f9ae40d0d40 2024-09-17T05:19:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.182+0000 7f9adb7fe640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac4078b90 0x7f9ac407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.182+0000 7f9adb7fe640 1 -- 172.21.15.81:0/3611040184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f9adc09aae0 con 0x7f9ae40d0d40 2024-09-17T05:19:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.182+0000 7f9ae259c640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac4078b90 0x7f9ac407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:05.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.183+0000 7f9ae259c640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac4078b90 0x7f9ac407b050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40b3120 tx=0x7f9acc009110 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:05.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.186+0000 7f9adb7fe640 1 -- 172.21.15.81:0/3611040184 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9adc062f30 con 0x7f9ae40d0d40 2024-09-17T05:19:05.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.405+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9ae40b53f0 con 0x7f9ae40d0d40 2024-09-17T05:19:05.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.405+0000 7f9adb7fe640 1 -- 172.21.15.81:0/3611040184 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f9adc062830 con 0x7f9ae40d0d40 2024-09-17T05:19:05.406 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:19:05.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac4078b90 msgr2=0x7f9ac407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:05.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac4078b90 0x7f9ac407b050 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40b3120 tx=0x7f9acc009110 comp rx=0 tx=0).stop 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d0d40 msgr2=0x7f9ae409dc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d0d40 0x7f9ae409dc30 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f9adc00ba80 tx=0x7f9adc00be80 comp rx=0 tx=0).stop 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 shutdown_connections 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac4078b90 0x7f9ac407b050 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae415df90 0x7f9ae415ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 0x7f9ae415c070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 --2- 172.21.15.81:0/3611040184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae40d0d40 0x7f9ae409dc30 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 >> 172.21.15.81:0/3611040184 conn(0x7f9ae40d3ea0 msgr2=0x7f9ae406e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 shutdown_connections 2024-09-17T05:19:05.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:05.407+0000 7f9ae9247640 1 -- 172.21.15.81:0/3611040184 wait complete. 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:19:05.419 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:19:05.420 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:05.420 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:19:05.439 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:05.439 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:05.439 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:05.440 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:05.441 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:19:05.441 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:05.441 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:19:05.441 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42770sec preferred_lft 42770sec 2024-09-17T05:19:05.441 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:19:05.441 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:05.441 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-17T05:19:05.441 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:05.441 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:05.442 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add name ceph-brx type bridge 2024-09-17T05:19:05.442 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr flush dev ceph-brx 2024-09-17T05:19:05.442 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set ceph-brx up 2024-09-17T05:19:05.442 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-17T05:19:05.442 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:05.536 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:05.653 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:05.659 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:05.659 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:19:05.684 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:19:05.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:05.686 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:19:05.753 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:19:05.754 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:19:05.754 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:19:05.754 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:19:05.754 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:19:05.754 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:05.754 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:05.754 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:19:05.754 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:19:05.754 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:19:05.755 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:05.842 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:05 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:06.074 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:06.080 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:06.080 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:19:06.095 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:06.095 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list-id 2024-09-17T05:19:06.151 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:06.151 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:06.151 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:06.151 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-09-17T05:19:06.151 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:06.239 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:06.263 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:06.269 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-09-17T05:19:06.269 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:06.269 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:06.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-09-17T05:19:06.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-17T05:19:06.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-09-17T05:19:06.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-09-17T05:19:06.270 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-09-17T05:19:06.270 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:06.319 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:06.387 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:06.394 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:06.394 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:06.394 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:19:06.394 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.0 master ceph-brx 2024-09-17T05:19:06.394 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:06.442 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:06.464 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:06.470 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:19:06.471 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:06.471 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:06.486 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:19:06.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:06.486 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:06.541 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:19:06.607 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:19:06.664 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:06.665 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:06.666 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:06.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:06.667 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:19:06.721 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:19:06.721 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:19:06.764 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:19:06.788 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:19:06.845 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:19:06.846 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:19:06.847 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:06.848 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:06.848 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:06.848 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:19:06.856 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:19:06.855+0000 7faa44b23480 -1 init, newargv = 0x5626a0dff5f0 newargc=15 2024-09-17T05:19:06.856 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[42783]: starting ceph client 2024-09-17T05:19:06.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[42783]: starting fuse 2024-09-17T05:19:06.871 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:19:06.871 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:19:06.871 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:19:06.871 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:19:06.871 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:19:06.871 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:06.872 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:19:06.873 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:19:06.989 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.42783.asok 2024-09-17T05:19:06.992 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:06.999 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.42783.asok 2024-09-17T05:19:06.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:06.999 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.42783.asok status 2024-09-17T05:19:07.133 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:19:07.133 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:19:07.133 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:19:07.133 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:19:07.133 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:19:07.133 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:19:07.133 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "42783", 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4529, 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 4529 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:19:07.134 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 3747482055 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 3747482055 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.4529 192.168.0.1:0/3747482055", 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/3747482055", 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 7, 2024-09-17T05:19:07.135 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 23, 2024-09-17T05:19:07.136 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:19:07.136 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:19:07.136 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:19:07.136 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:19:07.141 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-17T05:19:07.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:19:07.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 -- 172.21.15.81:0/1956036360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d0d40 msgr2=0x7f796c0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 --2- 172.21.15.81:0/1956036360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d0d40 0x7f796c0b3800 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7964005fd0 tx=0x7f796402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 -- 172.21.15.81:0/1956036360 shutdown_connections 2024-09-17T05:19:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 --2- 172.21.15.81:0/1956036360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d0d40 0x7f796c0b3800 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 --2- 172.21.15.81:0/1956036360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796c15df90 0x7f796c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 -- 172.21.15.81:0/1956036360 >> 172.21.15.81:0/1956036360 conn(0x7f796c0d3ea0 msgr2=0x7f796c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 -- 172.21.15.81:0/1956036360 shutdown_connections 2024-09-17T05:19:07.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.256+0000 7f79709bb640 1 -- 172.21.15.81:0/1956036360 wait complete. 2024-09-17T05:19:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.257+0000 7f79709bb640 1 Processor -- start 2024-09-17T05:19:07.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.257+0000 7f79709bb640 1 -- start start 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f79709bb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796c0d0d40 0x7f796c0b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f79709bb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d49c0 0x7f796c1601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f79709bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796c15df90 0x7f796c1606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f79709bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f796c0b3d40 con 0x7f796c15df90 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f79709bb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f796c162710 con 0x7f796c0d49c0 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f79709bb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f796c0b3ec0 con 0x7f796c0d0d40 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796c15df90 0x7f796c1606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796c15df90 0x7f796c1606e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33608/0 (socket says 172.21.15.81:33608) 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796ad9d640 1 -- 172.21.15.81:0/3626928451 learned_addr learned my addr 172.21.15.81:0/3626928451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:07.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796a59c640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796c0d0d40 0x7f796c0b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f7963fff640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d49c0 0x7f796c1601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796ad9d640 1 -- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796c0d0d40 msgr2=0x7f796c0b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796ad9d640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796c0d0d40 0x7f796c0b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796ad9d640 1 -- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d49c0 msgr2=0x7f796c1601a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.258+0000 7f796ad9d640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d49c0 0x7f796c1601a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f796ad9d640 1 -- 172.21.15.81:0/3626928451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f796c161590 con 0x7f796c15df90 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f7963fff640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d49c0 0x7f796c1601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f796a59c640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796c0d0d40 0x7f796c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f796ad9d640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796c15df90 0x7f796c1606e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7964009cd0 tx=0x7f7964031760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f7962ffd640 1 -- 172.21.15.81:0/3626928451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964040070 con 0x7f796c15df90 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f7962ffd640 1 -- 172.21.15.81:0/3626928451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7964004040 con 0x7f796c15df90 2024-09-17T05:19:07.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f796c160cf0 con 0x7f796c15df90 2024-09-17T05:19:07.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f7962ffd640 1 -- 172.21.15.81:0/3626928451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964004450 con 0x7f796c15df90 2024-09-17T05:19:07.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.259+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f796c1612b0 con 0x7f796c15df90 2024-09-17T05:19:07.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.260+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f796c0c7c90 con 0x7f796c15df90 2024-09-17T05:19:07.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.260+0000 7f7962ffd640 1 -- 172.21.15.81:0/3626928451 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f7964039040 con 0x7f796c15df90 2024-09-17T05:19:07.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.261+0000 7f7962ffd640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f794c078b90 0x7f794c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:07.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.261+0000 7f7962ffd640 1 -- 172.21.15.81:0/3626928451 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f79640bc160 con 0x7f796c15df90 2024-09-17T05:19:07.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.261+0000 7f796a59c640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f794c078b90 0x7f794c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:07.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.262+0000 7f796a59c640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f794c078b90 0x7f794c07b050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f795c0095f0 tx=0x7f795c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:07.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.265+0000 7f7962ffd640 1 -- 172.21.15.81:0/3626928451 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f796c0c7c90 con 0x7f796c15df90 2024-09-17T05:19:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.478+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f796c15e860 con 0x7f796c15df90 2024-09-17T05:19:07.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.479+0000 7f7962ffd640 1 -- 172.21.15.81:0/3626928451 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+73 (secure 0 0 0) 0x7f7964083ff0 con 0x7f796c15df90 2024-09-17T05:19:07.479 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f794c078b90 msgr2=0x7f794c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f794c078b90 0x7f794c07b050 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f795c0095f0 tx=0x7f795c005f90 comp rx=0 tx=0).stop 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796c15df90 msgr2=0x7f796c1606e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796c15df90 0x7f796c1606e0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f7964009cd0 tx=0x7f7964031760 comp rx=0 tx=0).stop 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 shutdown_connections 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f794c078b90 0x7f794c07b050 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f796c15df90 0x7f796c1606e0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f796c0d49c0 0x7f796c1601a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 --2- 172.21.15.81:0/3626928451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f796c0d0d40 0x7f796c0b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 >> 172.21.15.81:0/3626928451 conn(0x7f796c0d3ea0 msgr2=0x7f796c0b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 shutdown_connections 2024-09-17T05:19:07.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:07.481+0000 7f79709bb640 1 -- 172.21.15.81:0/3626928451 wait complete. 2024-09-17T05:19:07.491 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:19:07.491 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:19:07.491 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:19:07.491 INFO:tasks.cephfs.mount:self.client.name = client.3 2024-09-17T05:19:07.491 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:07.491 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:19:07.492 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:19:07.492 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:19:07.492 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:19:07.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:07.492 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:19:07.508 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:07.508 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:07.508 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:07.508 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:07.509 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42768sec preferred_lft 42768sec 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:19:07.510 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.511 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:19:07.511 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.511 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:19:07.511 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:07.511 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link tentative 2024-09-17T05:19:07.511 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.511 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:07.511 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:19:07.572 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:19:07.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:07.574 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:19:07.630 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:19:07.631 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:19:07.631 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:19:07.631 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:19:07.631 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:19:07.631 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:07.631 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:07.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:19:07.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:19:07.631 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:19:07.632 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:07.719 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:07.751 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:07.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:07.757 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:19:07.773 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:19:07.773 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:07.774 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list-id 2024-09-17T05:19:07.829 INFO:teuthology.orchestra.run.smithi160.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2024-09-17T05:19:07.829 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:07.829 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:07.829 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:07.829 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2024-09-17T05:19:07.829 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:07.917 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:07.939 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:07.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:07.946 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:07.970 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 42:f0:90:e6:d7:cd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:19:07.971 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:19:07.971 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.971 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::40f0:90ff:fee6:d7cd/64 scope link 2024-09-17T05:19:07.971 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:07.972 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:07.972 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 42:f0:90:e6:d7:cd brd ff:ff:ff:ff:ff:ff link-netnsid 0 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2024-09-17T05:19:08.037 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:08.038 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::40f0:90ff:fee6:d7cd/64 scope link 2024-09-17T05:19:08.038 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:08.039 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2024-09-17T05:19:08.039 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:08.039 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:08.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2024-09-17T05:19:08.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2024-09-17T05:19:08.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2024-09-17T05:19:08.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2024-09-17T05:19:08.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2024-09-17T05:19:08.040 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:08.128 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:08.185 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:08.192 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:08.192 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:08.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.1 up 2024-09-17T05:19:08.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set dev brx.1 master ceph-brx 2024-09-17T05:19:08.192 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:08.244 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:08 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:08.266 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:08.272 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2024-09-17T05:19:08.272 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:08.272 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:08.287 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2024-09-17T05:19:08.287 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:08.287 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:08.343 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:19:08.407 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:19:08.464 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:08.465 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:08.466 INFO:teuthology.orchestra.run.smithi160.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:08.467 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:08.467 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:08.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:08.467 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:19:08.520 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:19:08.520 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2024-09-17T05:19:08.520 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2024-09-17T05:19:08.563 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:19:08.587 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:08.643 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:19:08.643 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:19:08.643 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:19:08.644 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:19:08.645 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:08.646 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:08.647 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:19:08.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi160.stderr:2024-09-17T05:19:08.645+0000 7f1941954480 -1 init, newargv = 0x557ead1716c0 newargc=15 2024-09-17T05:19:08.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi160.stderr:ceph-fuse[43234]: starting ceph client 2024-09-17T05:19:08.649 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi160.stderr:ceph-fuse[43234]: starting fuse 2024-09-17T05:19:08.662 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:19:08.662 INFO:teuthology.orchestra.run.smithi160.stdout:44 2024-09-17T05:19:08.662 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:19:08.663 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:19:08.664 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:08.665 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.3")) 2024-09-17T05:19:08.665 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:19:08.780 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.3.43234.asok 2024-09-17T05:19:08.783 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:08 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:08.790 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.43234.asok 2024-09-17T05:19:08.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:08.791 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.43234.asok status 2024-09-17T05:19:08.924 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:19:08.924 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:19:08.924 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:19:08.924 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:19:08.924 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "3", 2024-09-17T05:19:08.924 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "43234", 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4633, 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:19:08.925 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 4633 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.2:0", 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 2170969642 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.2:0", 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 2170969642 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:08.926 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.4633 192.168.0.2:0/2170969642", 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.2:0/2170969642", 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 7, 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 23, 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:19:08.927 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:19:08.932 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:08.932 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:19:08.932 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:08.952 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:19:08.952 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:08.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:08.953 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:09.024 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:09.024 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:19:09.024 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:09.083 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:19:09.084 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:09.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:09.084 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:09.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:09.155 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:19:09.156 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:09.172 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:19:09.172 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:09.172 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:09.172 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:09.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:09.238 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:19:09.238 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:09.294 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:19:09.294 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:09.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:09.295 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:09.359 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2024-09-17T05:19:09.445 INFO:tasks.cephfs_test_runner:Starting test: test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate binary .meta file on legacy subvol root doesn't break the system 2024-09-17T05:19:09.445 INFO:tasks.cephfs_test_runner:test_binary_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:19:09.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:09.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 -- 172.21.15.81:0/3685800201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40159680 msgr2=0x7f3a4015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 --2- 172.21.15.81:0/3685800201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40159680 0x7f3a4015d270 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f3a30005fd0 tx=0x7f3a3002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 -- 172.21.15.81:0/3685800201 shutdown_connections 2024-09-17T05:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 --2- 172.21.15.81:0/3685800201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a4015fe60 0x7f3a400ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 --2- 172.21.15.81:0/3685800201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a40159680 0x7f3a4015d270 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 -- 172.21.15.81:0/3685800201 >> 172.21.15.81:0/3685800201 conn(0x7f3a400b1690 msgr2=0x7f3a400b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 -- 172.21.15.81:0/3685800201 shutdown_connections 2024-09-17T05:19:09.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.559+0000 7f3a480b8640 1 -- 172.21.15.81:0/3685800201 wait complete. 2024-09-17T05:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.560+0000 7f3a480b8640 1 Processor -- start 2024-09-17T05:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.560+0000 7f3a480b8640 1 -- start start 2024-09-17T05:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a480b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a400cc490 0x7f3a40145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a480b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a40159680 0x7f3a400af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a480b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4015fe60 0x7f3a400afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a480b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3a400cca80 con 0x7f3a4015fe60 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a480b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3a400cc900 con 0x7f3a400cc490 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a480b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3a400ccc00 con 0x7f3a40159680 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a46655640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4015fe60 0x7f3a400afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a46655640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4015fe60 0x7f3a400afb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33620/0 (socket says 172.21.15.81:33620) 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a46655640 1 -- 172.21.15.81:0/2338702898 learned_addr learned my addr 172.21.15.81:0/2338702898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a45e54640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a400cc490 0x7f3a40145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.561+0000 7f3a45653640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a40159680 0x7f3a400af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a46655640 1 -- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a40159680 msgr2=0x7f3a400af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a46655640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a40159680 0x7f3a400af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a46655640 1 -- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a400cc490 msgr2=0x7f3a40145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a46655640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a400cc490 0x7f3a40145c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a46655640 1 -- 172.21.15.81:0/2338702898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a401491a0 con 0x7f3a4015fe60 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a46655640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4015fe60 0x7f3a400afb40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800d6a0 tx=0x7f3a3800db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a3e7fc640 1 -- 172.21.15.81:0/2338702898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38017070 con 0x7f3a4015fe60 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a3e7fc640 1 -- 172.21.15.81:0/2338702898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3a38004310 con 0x7f3a4015fe60 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a401465d0 con 0x7f3a4015fe60 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a3e7fc640 1 -- 172.21.15.81:0/2338702898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a38005280 con 0x7f3a4015fe60 2024-09-17T05:19:09.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.562+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a40146b90 con 0x7f3a4015fe60 2024-09-17T05:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.563+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a40146d90 con 0x7f3a4015fe60 2024-09-17T05:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.564+0000 7f3a3e7fc640 1 -- 172.21.15.81:0/2338702898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3a38005420 con 0x7f3a4015fe60 2024-09-17T05:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.564+0000 7f3a3e7fc640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3a2c078b90 0x7f3a2c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.564+0000 7f3a3e7fc640 1 -- 172.21.15.81:0/2338702898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f3a3809aeb0 con 0x7f3a4015fe60 2024-09-17T05:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.564+0000 7f3a45e54640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3a2c078b90 0x7f3a2c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.565+0000 7f3a45e54640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3a2c078b90 0x7f3a2c07b050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a30034000 tx=0x7f3a30004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:09.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.569+0000 7f3a3e7fc640 1 -- 172.21.15.81:0/2338702898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3a40146d90 con 0x7f3a4015fe60 2024-09-17T05:19:09.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.747+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3a4015aa30 con 0x7f3a4015fe60 2024-09-17T05:19:09.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.748+0000 7f3a3e7fc640 1 -- 172.21.15.81:0/2338702898 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7f3a38020020 con 0x7f3a4015fe60 2024-09-17T05:19:09.748 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:09.748 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:48.113992+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3a2c078b90 msgr2=0x7f3a2c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3a2c078b90 0x7f3a2c07b050 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3a30034000 tx=0x7f3a30004ab0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4015fe60 msgr2=0x7f3a400afb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4015fe60 0x7f3a400afb40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f3a3800d6a0 tx=0x7f3a3800db60 comp rx=0 tx=0).stop 2024-09-17T05:19:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 shutdown_connections 2024-09-17T05:19:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3a2c078b90 0x7f3a2c07b050 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3a4015fe60 0x7f3a400afb40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3a40159680 0x7f3a400af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 --2- 172.21.15.81:0/2338702898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3a400cc490 0x7f3a40145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 >> 172.21.15.81:0/2338702898 conn(0x7f3a400b1690 msgr2=0x7f3a40159d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 shutdown_connections 2024-09-17T05:19:09.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.750+0000 7f3a480b8640 1 -- 172.21.15.81:0/2338702898 wait complete. 2024-09-17T05:19:09.761 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-17T05:18:44.889840+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-17T05:18:45.422842+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '23', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:19:09.761 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 -- 172.21.15.81:0/3188825299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 msgr2=0x7f51ec0b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 --2- 172.21.15.81:0/3188825299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec0b4270 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f51e4005fd0 tx=0x7f51e402a820 comp rx=0 tx=0).stop 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 -- 172.21.15.81:0/3188825299 shutdown_connections 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 --2- 172.21.15.81:0/3188825299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec0b4270 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 --2- 172.21.15.81:0/3188825299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51ec1617f0 0x7f51ec0d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 -- 172.21.15.81:0/3188825299 >> 172.21.15.81:0/3188825299 conn(0x7f51ec0d3e30 msgr2=0x7f51ec0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 -- 172.21.15.81:0/3188825299 shutdown_connections 2024-09-17T05:19:09.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.864+0000 7f51f126b640 1 -- 172.21.15.81:0/3188825299 wait complete. 2024-09-17T05:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 Processor -- start 2024-09-17T05:19:09.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 -- start start 2024-09-17T05:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec15cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51ec0d01b0 0x7f51ec14d980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec1617f0 0x7f51ec1503b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec0b4930 con 0x7f51ec0b3de0 2024-09-17T05:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f51ec0b47b0 con 0x7f51ec1617f0 2024-09-17T05:19:09.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.866+0000 7f51f126b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f51ec0b4ab0 con 0x7f51ec0d01b0 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec15cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec15cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33642/0 (socket says 172.21.15.81:33642) 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 -- 172.21.15.81:0/446144455 learned_addr learned my addr 172.21.15.81:0/446144455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51e27fc640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51ec0d01b0 0x7f51ec14d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eb7fe640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec1617f0 0x7f51ec1503b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 -- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51ec0d01b0 msgr2=0x7f51ec14d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51ec0d01b0 0x7f51ec14d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 -- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec1617f0 msgr2=0x7f51ec1503b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec1617f0 0x7f51ec1503b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 -- 172.21.15.81:0/446144455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51ec15f280 con 0x7f51ec0b3de0 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51e27fc640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51ec0d01b0 0x7f51ec14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:09.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eb7fe640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec1617f0 0x7f51ec1503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51eaffd640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec15cb00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00e790 tx=0x7f51dc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51e3fff640 1 -- 172.21.15.81:0/446144455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc00eea0 con 0x7f51ec0b3de0 2024-09-17T05:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51e3fff640 1 -- 172.21.15.81:0/446144455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51dc00cdb0 con 0x7f51ec0b3de0 2024-09-17T05:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51ec15f560 con 0x7f51ec0b3de0 2024-09-17T05:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51e3fff640 1 -- 172.21.15.81:0/446144455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51dc010690 con 0x7f51ec0b3de0 2024-09-17T05:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.867+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51ec15fb20 con 0x7f51ec0b3de0 2024-09-17T05:19:09.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.868+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51ec0b5040 con 0x7f51ec0b3de0 2024-09-17T05:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.869+0000 7f51e3fff640 1 -- 172.21.15.81:0/446144455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f51dc010830 con 0x7f51ec0b3de0 2024-09-17T05:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.869+0000 7f51e3fff640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51cc078b90 0x7f51cc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.869+0000 7f51e3fff640 1 -- 172.21.15.81:0/446144455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f51dc09b700 con 0x7f51ec0b3de0 2024-09-17T05:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.869+0000 7f51e27fc640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51cc078b90 0x7f51cc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:09.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.870+0000 7f51e27fc640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51cc078b90 0x7f51cc07b050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51d4007a50 tx=0x7f51d4009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:09.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:09.874+0000 7f51e3fff640 1 -- 172.21.15.81:0/446144455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f51dc063bd0 con 0x7f51ec0b3de0 2024-09-17T05:19:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.049+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f51ec0ce2f0 con 0x7f51ec0b3de0 2024-09-17T05:19:10.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.049+0000 7f51e3fff640 1 -- 172.21.15.81:0/446144455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v23) ==== 93+0+10 (secure 0 0 0) 0x7f51dc0634d0 con 0x7f51ec0b3de0 2024-09-17T05:19:10.050 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51cc078b90 msgr2=0x7f51cc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51cc078b90 0x7f51cc07b050 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f51d4007a50 tx=0x7f51d4009040 comp rx=0 tx=0).stop 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 msgr2=0x7f51ec15cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec15cb00 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f51dc00e790 tx=0x7f51dc00ec50 comp rx=0 tx=0).stop 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 shutdown_connections 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51cc078b90 0x7f51cc07b050 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51ec1617f0 0x7f51ec1503b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51ec0d01b0 0x7f51ec14d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 --2- 172.21.15.81:0/446144455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51ec0b3de0 0x7f51ec15cb00 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 >> 172.21.15.81:0/446144455 conn(0x7f51ec0d3e30 msgr2=0x7f51ec0b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 shutdown_connections 2024-09-17T05:19:10.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.051+0000 7f51f126b640 1 -- 172.21.15.81:0/446144455 wait complete. 2024-09-17T05:19:10.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-17T05:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.168+0000 7fb3f380f640 1 -- 172.21.15.81:0/3801094638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec1617f0 msgr2=0x7fb3ec0d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.168+0000 7fb3f380f640 1 --2- 172.21.15.81:0/3801094638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec1617f0 0x7fb3ec0d1d30 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb3ec0cf750 tx=0x7fb3dc02a890 comp rx=0 tx=0).stop 2024-09-17T05:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.169+0000 7fb3f380f640 1 -- 172.21.15.81:0/3801094638 shutdown_connections 2024-09-17T05:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.169+0000 7fb3f380f640 1 --2- 172.21.15.81:0/3801094638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec1617f0 0x7fb3ec0d1d30 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.169+0000 7fb3f380f640 1 -- 172.21.15.81:0/3801094638 >> 172.21.15.81:0/3801094638 conn(0x7fb3ec0d3e30 msgr2=0x7fb3ec0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.169+0000 7fb3f380f640 1 -- 172.21.15.81:0/3801094638 shutdown_connections 2024-09-17T05:19:10.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.169+0000 7fb3f380f640 1 -- 172.21.15.81:0/3801094638 wait complete. 2024-09-17T05:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 Processor -- start 2024-09-17T05:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 -- start start 2024-09-17T05:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec0b3de0 0x7fb3ec0cb8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec0d01b0 0x7fb3ec1569d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3ec1617f0 0x7fb3ec1f8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec0b4b00 con 0x7fb3ec1617f0 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb3ec0b4980 con 0x7fb3ec0d01b0 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.170+0000 7fb3f380f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb3ec0b4c80 con 0x7fb3ec0b3de0 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3ec1617f0 0x7fb3ec1f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3ec1617f0 0x7fb3ec1f8590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33658/0 (socket says 172.21.15.81:33658) 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 -- 172.21.15.81:0/2804019572 learned_addr learned my addr 172.21.15.81:0/2804019572 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f15ab640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec0b3de0 0x7fb3ec0cb8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f0daa640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec0d01b0 0x7fb3ec1569d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 -- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec0b3de0 msgr2=0x7fb3ec0cb8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec0b3de0 0x7fb3ec0cb8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 -- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec0d01b0 msgr2=0x7fb3ec1569d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec0d01b0 0x7fb3ec1569d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 -- 172.21.15.81:0/2804019572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3ec1f8f00 con 0x7fb3ec1617f0 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f1dac640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3ec1617f0 0x7fb3ec1f8590 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400c390 tx=0x7fb3e400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3e9ffb640 1 -- 172.21.15.81:0/2804019572 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4011790 con 0x7fb3ec1617f0 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3e9ffb640 1 -- 172.21.15.81:0/2804019572 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3e4017070 con 0x7fb3ec1617f0 2024-09-17T05:19:10.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3ec1f91e0 con 0x7fb3ec1617f0 2024-09-17T05:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3e9ffb640 1 -- 172.21.15.81:0/2804019572 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3e4011ce0 con 0x7fb3ec1617f0 2024-09-17T05:19:10.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.171+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3ec0cb380 con 0x7fb3ec1617f0 2024-09-17T05:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.172+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3ec0b4270 con 0x7fb3ec1617f0 2024-09-17T05:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.173+0000 7fb3e9ffb640 1 -- 172.21.15.81:0/2804019572 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fb3e401c460 con 0x7fb3ec1617f0 2024-09-17T05:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.174+0000 7fb3e9ffb640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb3d8078b90 0x7fb3d807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.174+0000 7fb3e9ffb640 1 -- 172.21.15.81:0/2804019572 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fb3e409aa40 con 0x7fb3ec1617f0 2024-09-17T05:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.174+0000 7fb3f15ab640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb3d8078b90 0x7fb3d807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.174+0000 7fb3f15ab640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb3d8078b90 0x7fb3d807b050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc034000 tx=0x7fb3dc004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:10.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.178+0000 7fb3e9ffb640 1 -- 172.21.15.81:0/2804019572 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb3e40628c0 con 0x7fb3ec1617f0 2024-09-17T05:19:10.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.355+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fb3ec0b3570 con 0x7fb3ec1617f0 2024-09-17T05:19:10.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.355+0000 7fb3e9ffb640 1 -- 172.21.15.81:0/2804019572 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v23) ==== 104+0+11 (secure 0 0 0) 0x7fb3e409ae20 con 0x7fb3ec1617f0 2024-09-17T05:19:10.355 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 32 2024-09-17T05:19:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb3d8078b90 msgr2=0x7fb3d807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb3d8078b90 0x7fb3d807b050 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fb3dc034000 tx=0x7fb3dc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3ec1617f0 msgr2=0x7fb3ec1f8590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3ec1617f0 0x7fb3ec1f8590 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fb3e400c390 tx=0x7fb3e400c850 comp rx=0 tx=0).stop 2024-09-17T05:19:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 shutdown_connections 2024-09-17T05:19:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb3d8078b90 0x7fb3d807b050 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3ec1617f0 0x7fb3ec1f8590 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb3ec0d01b0 0x7fb3ec1569d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 --2- 172.21.15.81:0/2804019572 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3ec0b3de0 0x7fb3ec0cb8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 >> 172.21.15.81:0/2804019572 conn(0x7fb3ec0d3e30 msgr2=0x7fb3ec0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 shutdown_connections 2024-09-17T05:19:10.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.358+0000 7fb3f380f640 1 -- 172.21.15.81:0/2804019572 wait complete. 2024-09-17T05:19:10.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-17T05:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 -- 172.21.15.81:0/1957447094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640d01b0 msgr2=0x7f30640d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 --2- 172.21.15.81:0/1957447094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640d01b0 0x7f30640d2440 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f306406a240 tx=0x7f305402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 -- 172.21.15.81:0/1957447094 shutdown_connections 2024-09-17T05:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 --2- 172.21.15.81:0/1957447094 >> v2:172.21.15.160:3300/0 conn(0x7f30640b3de0 0x7f30640b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 --2- 172.21.15.81:0/1957447094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640d01b0 0x7f30640d2440 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 -- 172.21.15.81:0/1957447094 >> 172.21.15.81:0/1957447094 conn(0x7f30640d3e30 msgr2=0x7f30640d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 -- 172.21.15.81:0/1957447094 shutdown_connections 2024-09-17T05:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.474+0000 7f306b13d640 1 -- 172.21.15.81:0/1957447094 wait complete. 2024-09-17T05:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.475+0000 7f306b13d640 1 Processor -- start 2024-09-17T05:19:10.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.475+0000 7f306b13d640 1 -- start start 2024-09-17T05:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f306b13d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640b3de0 0x7f30640ccb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f306b13d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30640d01b0 0x7f30640c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f306b13d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30641617f0 0x7f3064157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f306b13d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30640b48b0 con 0x7f30640b3de0 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f306b13d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f30640b4730 con 0x7f30640d01b0 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f306b13d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f30640b4a30 con 0x7f30641617f0 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f3068ed9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640b3de0 0x7f30640ccb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f3068ed9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640b3de0 0x7f30640ccb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33668/0 (socket says 172.21.15.81:33668) 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f3068ed9640 1 -- 172.21.15.81:0/1878587613 learned_addr learned my addr 172.21.15.81:0/1878587613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f305bfff640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30640d01b0 0x7f30640c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.476+0000 7f30696da640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30641617f0 0x7f3064157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f3068ed9640 1 -- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30641617f0 msgr2=0x7f3064157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f3068ed9640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30641617f0 0x7f3064157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f3068ed9640 1 -- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30640d01b0 msgr2=0x7f30640c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f3068ed9640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30640d01b0 0x7f30640c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f3068ed9640 1 -- 172.21.15.81:0/1878587613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30641f4d30 con 0x7f30640b3de0 2024-09-17T05:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f3068ed9640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640b3de0 0x7f30640ccb60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f306000c3a0 tx=0x7f306000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f30597fa640 1 -- 172.21.15.81:0/1878587613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060011790 con 0x7f30640b3de0 2024-09-17T05:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f30597fa640 1 -- 172.21.15.81:0/1878587613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3060017070 con 0x7f30640b3de0 2024-09-17T05:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30641f5010 con 0x7f30640b3de0 2024-09-17T05:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f30597fa640 1 -- 172.21.15.81:0/1878587613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3060011d20 con 0x7f30640b3de0 2024-09-17T05:19:10.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.477+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30641f55d0 con 0x7f30640b3de0 2024-09-17T05:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.478+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30640b4f50 con 0x7f30640b3de0 2024-09-17T05:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.478+0000 7f30597fa640 1 -- 172.21.15.81:0/1878587613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f306001c460 con 0x7f30640b3de0 2024-09-17T05:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.479+0000 7f30597fa640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3050078b90 0x7f305007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.479+0000 7f30597fa640 1 -- 172.21.15.81:0/1878587613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f306009a8e0 con 0x7f30640b3de0 2024-09-17T05:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.479+0000 7f305bfff640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3050078b90 0x7f305007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.479+0000 7f305bfff640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3050078b90 0x7f305007b050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3054034000 tx=0x7f3054004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:10.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.483+0000 7f30597fa640 1 -- 172.21.15.81:0/1878587613 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f30600627f0 con 0x7f30640b3de0 2024-09-17T05:19:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.660+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f30640b5700 con 0x7f30640b3de0 2024-09-17T05:19:10.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.661+0000 7f30597fa640 1 -- 172.21.15.81:0/1878587613 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v23) ==== 100+0+11 (secure 0 0 0) 0x7f3060067220 con 0x7f30640b3de0 2024-09-17T05:19:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 64 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3050078b90 msgr2=0x7f305007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3050078b90 0x7f305007b050 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f3054034000 tx=0x7f3054004730 comp rx=0 tx=0).stop 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640b3de0 msgr2=0x7f30640ccb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640b3de0 0x7f30640ccb60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f306000c3a0 tx=0x7f306000c860 comp rx=0 tx=0).stop 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 shutdown_connections 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3050078b90 0x7f305007b050 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30641617f0 0x7f3064157720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30640d01b0 0x7f30640c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 --2- 172.21.15.81:0/1878587613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30640b3de0 0x7f30640ccb60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 >> 172.21.15.81:0/1878587613 conn(0x7f30640d3e30 msgr2=0x7f30640b2d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 shutdown_connections 2024-09-17T05:19:10.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.663+0000 7f306b13d640 1 -- 172.21.15.81:0/1878587613 wait complete. 2024-09-17T05:19:10.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:19:10.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.776+0000 7f68ecae2640 1 -- 172.21.15.81:0/1516874316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 msgr2=0x7f68d0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.776+0000 7f68ecae2640 1 --2- 172.21.15.81:0/1516874316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 0x7f68d0004800 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68dc00bb00 tx=0x7f68d0005830 comp rx=0 tx=0).stop 2024-09-17T05:19:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.776+0000 7f68e6d9d640 1 -- 172.21.15.81:0/1516874316 reap_dead start 2024-09-17T05:19:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.776+0000 7f68ecae2640 1 -- 172.21.15.81:0/1516874316 shutdown_connections 2024-09-17T05:19:10.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.776+0000 7f68ecae2640 1 -- 172.21.15.81:0/1516874316 >> 172.21.15.81:0/1516874316 conn(0x7f68e80741f0 msgr2=0x7f68e8074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.776+0000 7f68ecae2640 1 -- 172.21.15.81:0/1516874316 shutdown_connections 2024-09-17T05:19:10.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.776+0000 7f68ecae2640 1 -- 172.21.15.81:0/1516874316 wait complete. 2024-09-17T05:19:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 Processor -- start 2024-09-17T05:19:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 -- start start 2024-09-17T05:19:10.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 0x7f68e80b27e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80c6c30 0x7f68e8155f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e81f6a90 0x7f68e81f5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68e80d0f40 con 0x7f68d0004080 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f68e80d10c0 con 0x7f68e80c6c30 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68ecae2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f68e80cbdb0 con 0x7f68e81f6a90 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68e659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 0x7f68e80b27e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68e659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 0x7f68e80b27e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33694/0 (socket says 172.21.15.81:33694) 2024-09-17T05:19:10.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68e659c640 1 -- 172.21.15.81:0/3730004542 learned_addr learned my addr 172.21.15.81:0/3730004542 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68e5d9b640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80c6c30 0x7f68e8155f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.778+0000 7f68e6d9d640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e81f6a90 0x7f68e81f5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68e659c640 1 -- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e81f6a90 msgr2=0x7f68e81f5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68e659c640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e81f6a90 0x7f68e81f5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68e659c640 1 -- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80c6c30 msgr2=0x7f68e8155f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68e659c640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80c6c30 0x7f68e8155f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68e659c640 1 -- 172.21.15.81:0/3730004542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e80c58b0 con 0x7f68d0004080 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68e659c640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 0x7f68e80b27e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68d8004650 tx=0x7f68d800bac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:10.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68d6ffd640 1 -- 172.21.15.81:0/3730004542 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8010b10 con 0x7f68d0004080 2024-09-17T05:19:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68d6ffd640 1 -- 172.21.15.81:0/3730004542 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68d8015070 con 0x7f68d0004080 2024-09-17T05:19:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e80c5b90 con 0x7f68d0004080 2024-09-17T05:19:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68d6ffd640 1 -- 172.21.15.81:0/3730004542 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d801a470 con 0x7f68d0004080 2024-09-17T05:19:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.779+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e80c6150 con 0x7f68d0004080 2024-09-17T05:19:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.780+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e8068ac0 con 0x7f68d0004080 2024-09-17T05:19:10.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.781+0000 7f68d6ffd640 1 -- 172.21.15.81:0/3730004542 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f68d801a610 con 0x7f68d0004080 2024-09-17T05:19:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.781+0000 7f68d6ffd640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68c8078b90 0x7f68c807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.781+0000 7f68d6ffd640 1 -- 172.21.15.81:0/3730004542 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f68d809b800 con 0x7f68d0004080 2024-09-17T05:19:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.781+0000 7f68e5d9b640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68c8078b90 0x7f68c807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:10.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.782+0000 7f68e5d9b640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68c8078b90 0x7f68c807b050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68dc036000 tx=0x7f68dc03d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:10.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:10.785+0000 7f68d6ffd640 1 -- 172.21.15.81:0/3730004542 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f68d8063680 con 0x7f68d0004080 2024-09-17T05:19:11.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.028+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f68e8157ca0 con 0x7f68d0004080 2024-09-17T05:19:11.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.476+0000 7f68d6ffd640 1 -- 172.21.15.81:0/3730004542 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v45) ==== 161+0+0 (secure 0 0 0) 0x7f68d80680b0 con 0x7f68d0004080 2024-09-17T05:19:11.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68c8078b90 msgr2=0x7f68c807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68c8078b90 0x7f68c807b050 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f68dc036000 tx=0x7f68dc03d040 comp rx=0 tx=0).stop 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 msgr2=0x7f68e80b27e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 0x7f68e80b27e0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f68d8004650 tx=0x7f68d800bac0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 shutdown_connections 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68c8078b90 0x7f68c807b050 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e81f6a90 0x7f68e81f5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80c6c30 0x7f68e8155f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 --2- 172.21.15.81:0/3730004542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68d0004080 0x7f68e80b27e0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 >> 172.21.15.81:0/3730004542 conn(0x7f68e80741f0 msgr2=0x7f68e80ae410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 shutdown_connections 2024-09-17T05:19:11.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.478+0000 7f68ecae2640 1 -- 172.21.15.81:0/3730004542 wait complete. 2024-09-17T05:19:11.490 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:19:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.591+0000 7f3106c7f640 1 -- 172.21.15.81:0/4060861139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000d0b60 msgr2=0x7f3100068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.591+0000 7f3106c7f640 1 --2- 172.21.15.81:0/4060861139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000d0b60 0x7f3100068ac0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f31000cdbd0 tx=0x7f30fc02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.591+0000 7f3106c7f640 1 -- 172.21.15.81:0/4060861139 shutdown_connections 2024-09-17T05:19:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.591+0000 7f3106c7f640 1 --2- 172.21.15.81:0/4060861139 >> v2:172.21.15.160:3300/0 conn(0x7f31000cc4c0 0x7f310015c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.591+0000 7f3106c7f640 1 --2- 172.21.15.81:0/4060861139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000d0b60 0x7f3100068ac0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.591+0000 7f3106c7f640 1 -- 172.21.15.81:0/4060861139 >> 172.21.15.81:0/4060861139 conn(0x7f31000741f0 msgr2=0x7f3100074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.591+0000 7f3106c7f640 1 -- 172.21.15.81:0/4060861139 shutdown_connections 2024-09-17T05:19:11.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.592+0000 7f3106c7f640 1 -- 172.21.15.81:0/4060861139 wait complete. 2024-09-17T05:19:11.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.593+0000 7f3106c7f640 1 Processor -- start 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.593+0000 7f3106c7f640 1 -- start start 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.593+0000 7f3106c7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000cc4c0 0x7f3100099b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.593+0000 7f3106c7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31000cd760 0x7f31000c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3106c7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31000d0b60 0x7f31000b1a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3106c7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f310015c9a0 con 0x7f31000cc4c0 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3106c7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f310015cb20 con 0x7f31000cd760 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3106c7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f310015cca0 con 0x7f31000d0b60 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000cc4c0 0x7f3100099b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000cc4c0 0x7f3100099b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33720/0 (socket says 172.21.15.81:33720) 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 -- 172.21.15.81:0/646313814 learned_addr learned my addr 172.21.15.81:0/646313814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f30f7fff640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31000cd760 0x7f31000c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f310521c640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31000d0b60 0x7f31000b1a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 -- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31000d0b60 msgr2=0x7f31000b1a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31000d0b60 0x7f31000b1a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 -- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31000cd760 msgr2=0x7f31000c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31000cd760 0x7f31000c6b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 -- 172.21.15.81:0/646313814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31000c5af0 con 0x7f31000cc4c0 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f30f7fff640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31000cd760 0x7f31000c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3104a1b640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000cc4c0 0x7f3100099b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009780 tx=0x7f30fc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f30f57fa640 1 -- 172.21.15.81:0/646313814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc031d60 con 0x7f31000cc4c0 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f30f57fa640 1 -- 172.21.15.81:0/646313814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30fc005020 con 0x7f31000cc4c0 2024-09-17T05:19:11.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f30f57fa640 1 -- 172.21.15.81:0/646313814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30fc005470 con 0x7f31000cc4c0 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31000c5dd0 con 0x7f31000cc4c0 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.594+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31000c6390 con 0x7f31000cc4c0 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.595+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f310015d150 con 0x7f31000cc4c0 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.596+0000 7f30f57fa640 1 -- 172.21.15.81:0/646313814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30fc0047a0 con 0x7f31000cc4c0 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.597+0000 7f30f57fa640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f30ec078b90 0x7f30ec07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.597+0000 7f30f57fa640 1 -- 172.21.15.81:0/646313814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f30fc0bbf50 con 0x7f31000cc4c0 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.597+0000 7f30f7fff640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f30ec078b90 0x7f30ec07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.597+0000 7f30f7fff640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f30ec078b90 0x7f30ec07b050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31000b6300 tx=0x7f30f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:11.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.601+0000 7f30f57fa640 1 -- 172.21.15.81:0/646313814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f30fc03f030 con 0x7f31000cc4c0 2024-09-17T05:19:11.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.776+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f310015c310 con 0x7f31000cc4c0 2024-09-17T05:19:11.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.777+0000 7f30f57fa640 1 -- 172.21.15.81:0/646313814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v27) ==== 59+0+1998 (secure 0 0 0) 0x7f30fc084390 con 0x7f31000cc4c0 2024-09-17T05:19:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:19:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:19:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:19:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:19:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:19:11.777 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:19:11.778 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:19:11.779 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:19:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f30ec078b90 msgr2=0x7f30ec07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f30ec078b90 0x7f30ec07b050 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f31000b6300 tx=0x7f30f0009040 comp rx=0 tx=0).stop 2024-09-17T05:19:11.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000cc4c0 msgr2=0x7f3100099b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000cc4c0 0x7f3100099b10 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f30fc009780 tx=0x7f30fc033d60 comp rx=0 tx=0).stop 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 shutdown_connections 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f30ec078b90 0x7f30ec07b050 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31000d0b60 0x7f31000b1a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31000cd760 0x7f31000c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 --2- 172.21.15.81:0/646313814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31000cc4c0 0x7f3100099b10 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 >> 172.21.15.81:0/646313814 conn(0x7f31000741f0 msgr2=0x7f31000cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 shutdown_connections 2024-09-17T05:19:11.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.779+0000 7f3106c7f640 1 -- 172.21.15.81:0/646313814 wait complete. 2024-09-17T05:19:11.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:19:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.895+0000 7f5d0d447640 1 -- 172.21.15.81:0/862522624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 msgr2=0x7f5cf400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.895+0000 7f5d0d447640 1 --2- 172.21.15.81:0/862522624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5cf400b9c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5d0000c2e0 tx=0x7f5cf4005830 comp rx=0 tx=0).stop 2024-09-17T05:19:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.895+0000 7f5d0d447640 1 -- 172.21.15.81:0/862522624 shutdown_connections 2024-09-17T05:19:11.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.895+0000 7f5d0d447640 1 --2- 172.21.15.81:0/862522624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5cf400b9c0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.895+0000 7f5d0d447640 1 -- 172.21.15.81:0/862522624 >> 172.21.15.81:0/862522624 conn(0x7f5d080d3e30 msgr2=0x7f5d080d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.895+0000 7f5d0d447640 1 -- 172.21.15.81:0/862522624 shutdown_connections 2024-09-17T05:19:11.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.895+0000 7f5d0d447640 1 -- 172.21.15.81:0/862522624 wait complete. 2024-09-17T05:19:11.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.896+0000 7f5d0d447640 1 Processor -- start 2024-09-17T05:19:11.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.896+0000 7f5d0d447640 1 -- start start 2024-09-17T05:19:11.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d0d447640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5d08156b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d0d447640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d080c8830 0x7f5d0815f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d0d447640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d08155f50 0x7f5d081563a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d0d447640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080d2170 con 0x7f5cf40053c0 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d0d447640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5d080d1ff0 con 0x7f5d080c8830 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d0d447640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5d080d22f0 con 0x7f5d08155f50 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5d08156b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5d08156b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33732/0 (socket says 172.21.15.81:33732) 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 -- 172.21.15.81:0/1351950467 learned_addr learned my addr 172.21.15.81:0/1351950467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d077fe640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d08155f50 0x7f5d081563a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d067fc640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d080c8830 0x7f5d0815f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 -- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d08155f50 msgr2=0x7f5d081563a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d08155f50 0x7f5d081563a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 -- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d080c8830 msgr2=0x7f5d0815f5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d080c8830 0x7f5d0815f5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 -- 172.21.15.81:0/1351950467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d080ca9d0 con 0x7f5cf40053c0 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d077fe640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d08155f50 0x7f5d081563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d067fc640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d080c8830 0x7f5d0815f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5d06ffd640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5d08156b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80018c0 tx=0x7f5cf8001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.897+0000 7f5cff7fe640 1 -- 172.21.15.81:0/1351950467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf8015070 con 0x7f5cf40053c0 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.898+0000 7f5cff7fe640 1 -- 172.21.15.81:0/1351950467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5cf800ebb0 con 0x7f5cf40053c0 2024-09-17T05:19:11.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.898+0000 7f5cff7fe640 1 -- 172.21.15.81:0/1351950467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cf80020c0 con 0x7f5cf40053c0 2024-09-17T05:19:11.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.898+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d080c8cb0 con 0x7f5cf40053c0 2024-09-17T05:19:11.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.898+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d080b6d70 con 0x7f5cf40053c0 2024-09-17T05:19:11.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.899+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d080d2850 con 0x7f5cf40053c0 2024-09-17T05:19:11.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.899+0000 7f5cff7fe640 1 -- 172.21.15.81:0/1351950467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5cf8018070 con 0x7f5cf40053c0 2024-09-17T05:19:11.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.900+0000 7f5cff7fe640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ce8078b90 0x7f5ce807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:11.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.900+0000 7f5cff7fe640 1 -- 172.21.15.81:0/1351950467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f5cf809b580 con 0x7f5cf40053c0 2024-09-17T05:19:11.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.900+0000 7f5d067fc640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ce8078b90 0x7f5ce807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:11.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.901+0000 7f5d067fc640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ce8078b90 0x7f5ce807b050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000ea60 tx=0x7f5cf000e460 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:11.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:11.904+0000 7f5cff7fe640 1 -- 172.21.15.81:0/1351950467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5cf8063a50 con 0x7f5cf40053c0 2024-09-17T05:19:12.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.081+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5d080b2ac0 con 0x7f5cf40053c0 2024-09-17T05:19:12.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.084+0000 7f5cff7fe640 1 -- 172.21.15.81:0/1351950467 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7f5cf8063350 con 0x7f5cf40053c0 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ce8078b90 msgr2=0x7f5ce807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ce8078b90 0x7f5ce807b050 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f5cf000ea60 tx=0x7f5cf000e460 comp rx=0 tx=0).stop 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 msgr2=0x7f5d08156b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5d08156b80 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f5cf80018c0 tx=0x7f5cf8001d80 comp rx=0 tx=0).stop 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 shutdown_connections 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ce8078b90 0x7f5ce807b050 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d08155f50 0x7f5d081563a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d080c8830 0x7f5d0815f5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 --2- 172.21.15.81:0/1351950467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5cf40053c0 0x7f5d08156b80 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 >> 172.21.15.81:0/1351950467 conn(0x7f5d080d3e30 msgr2=0x7f5d080d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 shutdown_connections 2024-09-17T05:19:12.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.087+0000 7f5d0d447640 1 -- 172.21.15.81:0/1351950467 wait complete. 2024-09-17T05:19:12.100 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:19:12.100 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:19:12.136 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:19:12.185 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:19:12.185 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:12.185 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:12.202 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:12.202 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:12.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 -- 172.21.15.81:0/57087889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 msgr2=0x7f28e00ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 --2- 172.21.15.81:0/57087889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e00ce240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f28e00727b0 tx=0x7f28c802a530 comp rx=0 tx=0).stop 2024-09-17T05:19:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 -- 172.21.15.81:0/57087889 shutdown_connections 2024-09-17T05:19:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 --2- 172.21.15.81:0/57087889 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e00ce240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 --2- 172.21.15.81:0/57087889 >> v2:172.21.15.160:3300/0 conn(0x7f28e006f0b0 0x7f28e00cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 -- 172.21.15.81:0/57087889 >> 172.21.15.81:0/57087889 conn(0x7f28e00741f0 msgr2=0x7f28e0074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 -- 172.21.15.81:0/57087889 shutdown_connections 2024-09-17T05:19:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.399+0000 7f28e50b8640 1 -- 172.21.15.81:0/57087889 wait complete. 2024-09-17T05:19:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.400+0000 7f28e50b8640 1 Processor -- start 2024-09-17T05:19:12.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.400+0000 7f28e50b8640 1 -- start start 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28e50b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28e006f0b0 0x7f28e01f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28e50b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e0158e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28e50b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e00ce780 0x7f28e0159390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28e50b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28e015e5e0 con 0x7f28e006f490 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28e50b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28e015e460 con 0x7f28e00ce780 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28e50b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f28e00cc290 con 0x7f28e006f0b0 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28de59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e0158e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28de59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e0158e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33756/0 (socket says 172.21.15.81:33756) 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28de59c640 1 -- 172.21.15.81:0/4210853368 learned_addr learned my addr 172.21.15.81:0/4210853368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28df59e640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e00ce780 0x7f28e0159390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.401+0000 7f28ded9d640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28e006f0b0 0x7f28e01f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28de59c640 1 -- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28e006f0b0 msgr2=0x7f28e01f8360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28de59c640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28e006f0b0 0x7f28e01f8360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28de59c640 1 -- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e00ce780 msgr2=0x7f28e0159390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28de59c640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e00ce780 0x7f28e0159390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28de59c640 1 -- 172.21.15.81:0/4210853368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e00ca070 con 0x7f28e006f490 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28df59e640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e00ce780 0x7f28e0159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28de59c640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e0158e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28c802ab20 tx=0x7f28c8032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28d77fe640 1 -- 172.21.15.81:0/4210853368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c8040070 con 0x7f28e006f490 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28d77fe640 1 -- 172.21.15.81:0/4210853368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f28c8005310 con 0x7f28e006f490 2024-09-17T05:19:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28d77fe640 1 -- 172.21.15.81:0/4210853368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28c80047a0 con 0x7f28e006f490 2024-09-17T05:19:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e01f8dc0 con 0x7f28e006f490 2024-09-17T05:19:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.402+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e00ca320 con 0x7f28e006f490 2024-09-17T05:19:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.403+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28e00cd3e0 con 0x7f28e006f490 2024-09-17T05:19:12.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.404+0000 7f28d77fe640 1 -- 172.21.15.81:0/4210853368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f28c8039040 con 0x7f28e006f490 2024-09-17T05:19:12.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.404+0000 7f28d77fe640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28c0078b90 0x7f28c007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.404+0000 7f28d77fe640 1 -- 172.21.15.81:0/4210853368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f28c80bc0b0 con 0x7f28e006f490 2024-09-17T05:19:12.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.404+0000 7f28ded9d640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28c0078b90 0x7f28c007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.405+0000 7f28ded9d640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28c0078b90 0x7f28c007b050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009f20 tx=0x7f28d00094f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:12.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.408+0000 7f28d77fe640 1 -- 172.21.15.81:0/4210853368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f28c8084610 con 0x7f28e006f490 2024-09-17T05:19:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.597+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f28e0075070 con 0x7f28e006f490 2024-09-17T05:19:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.597+0000 7f28d77fe640 1 -- 172.21.15.81:0/4210853368 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f28c8083f10 con 0x7f28e006f490 2024-09-17T05:19:12.598 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28c0078b90 msgr2=0x7f28c007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28c0078b90 0x7f28c007b050 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f28d0009f20 tx=0x7f28d00094f0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 msgr2=0x7f28e0158e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e0158e50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f28c802ab20 tx=0x7f28c8032c10 comp rx=0 tx=0).stop 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 shutdown_connections 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28c0078b90 0x7f28c007b050 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28e00ce780 0x7f28e0159390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28e006f490 0x7f28e0158e50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 --2- 172.21.15.81:0/4210853368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28e006f0b0 0x7f28e01f8360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 >> 172.21.15.81:0/4210853368 conn(0x7f28e00741f0 msgr2=0x7f28e00745d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.599+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 shutdown_connections 2024-09-17T05:19:12.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.600+0000 7f28e50b8640 1 -- 172.21.15.81:0/4210853368 wait complete. 2024-09-17T05:19:12.611 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:12.612 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:12.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 -- 172.21.15.81:0/488401065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc0735a0 msgr2=0x7f59cc0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/488401065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc0735a0 0x7f59cc0739d0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f59b4009830 tx=0x7f59b402a470 comp rx=0 tx=0).stop 2024-09-17T05:19:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 -- 172.21.15.81:0/488401065 shutdown_connections 2024-09-17T05:19:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/488401065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59cc06ff80 0x7f59cc070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/488401065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc0735a0 0x7f59cc0739d0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 -- 172.21.15.81:0/488401065 >> 172.21.15.81:0/488401065 conn(0x7f59cc0b1690 msgr2=0x7f59cc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 -- 172.21.15.81:0/488401065 shutdown_connections 2024-09-17T05:19:12.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.770+0000 7f59d2cdd640 1 -- 172.21.15.81:0/488401065 wait complete. 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.771+0000 7f59d2cdd640 1 Processor -- start 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.771+0000 7f59d2cdd640 1 -- start start 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d2cdd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc06ff80 0x7f59cc1f8670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d2cdd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59cc0735a0 0x7f59cc06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d2cdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc15aa70 0x7f59cc144150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d2cdd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0cd270 con 0x7f59cc15aa70 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d2cdd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc0cd0f0 con 0x7f59cc06ff80 2024-09-17T05:19:12.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d2cdd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc0cd3f0 con 0x7f59cc0735a0 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d127a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc15aa70 0x7f59cc144150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d127a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc15aa70 0x7f59cc144150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33766/0 (socket says 172.21.15.81:33766) 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d127a640 1 -- 172.21.15.81:0/1124570930 learned_addr learned my addr 172.21.15.81:0/1124570930 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59d0a79640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc06ff80 0x7f59cc1f8670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.772+0000 7f59cbfff640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59cc0735a0 0x7f59cc06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d127a640 1 -- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59cc0735a0 msgr2=0x7f59cc06f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d127a640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59cc0735a0 0x7f59cc06f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d127a640 1 -- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc06ff80 msgr2=0x7f59cc1f8670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d127a640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc06ff80 0x7f59cc1f8670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d127a640 1 -- 172.21.15.81:0/1124570930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc14faa0 con 0x7f59cc15aa70 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d127a640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc15aa70 0x7f59cc144150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59c400e970 tx=0x7f59c400ee30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:12.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59c97fa640 1 -- 172.21.15.81:0/1124570930 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c400cd80 con 0x7f59cc15aa70 2024-09-17T05:19:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59c97fa640 1 -- 172.21.15.81:0/1124570930 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59c4004030 con 0x7f59cc15aa70 2024-09-17T05:19:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59c97fa640 1 -- 172.21.15.81:0/1124570930 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59c4004480 con 0x7f59cc15aa70 2024-09-17T05:19:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59cc14fd80 con 0x7f59cc15aa70 2024-09-17T05:19:12.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.773+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59cc150340 con 0x7f59cc15aa70 2024-09-17T05:19:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.774+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59cc15afc0 con 0x7f59cc15aa70 2024-09-17T05:19:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.774+0000 7f59c97fa640 1 -- 172.21.15.81:0/1124570930 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f59c40035f0 con 0x7f59cc15aa70 2024-09-17T05:19:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.775+0000 7f59c97fa640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f59ac078b90 0x7f59ac07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.775+0000 7f59c97fa640 1 -- 172.21.15.81:0/1124570930 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f59c409b5c0 con 0x7f59cc15aa70 2024-09-17T05:19:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.775+0000 7f59d0a79640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f59ac078b90 0x7f59ac07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:12.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.776+0000 7f59d0a79640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f59ac078b90 0x7f59ac07b050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f59bc001e20 tx=0x7f59bc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:12.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.779+0000 7f59c97fa640 1 -- 172.21.15.81:0/1124570930 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f59cc15afc0 con 0x7f59cc15aa70 2024-09-17T05:19:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.968+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f59cc0cd8a0 con 0x7f59cc15aa70 2024-09-17T05:19:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.968+0000 7f59c97fa640 1 -- 172.21.15.81:0/1124570930 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f59c4063440 con 0x7f59cc15aa70 2024-09-17T05:19:12.969 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f59ac078b90 msgr2=0x7f59ac07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f59ac078b90 0x7f59ac07b050 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f59bc001e20 tx=0x7f59bc009040 comp rx=0 tx=0).stop 2024-09-17T05:19:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc15aa70 msgr2=0x7f59cc144150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc15aa70 0x7f59cc144150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f59c400e970 tx=0x7f59c400ee30 comp rx=0 tx=0).stop 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 shutdown_connections 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f59ac078b90 0x7f59ac07b050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59cc15aa70 0x7f59cc144150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59cc0735a0 0x7f59cc06f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 --2- 172.21.15.81:0/1124570930 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59cc06ff80 0x7f59cc1f8670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 >> 172.21.15.81:0/1124570930 conn(0x7f59cc0b1690 msgr2=0x7f59cc0b1b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 shutdown_connections 2024-09-17T05:19:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:12.970+0000 7f59d2cdd640 1 -- 172.21.15.81:0/1124570930 wait complete. 2024-09-17T05:19:12.982 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:19:12.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:12.982 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:13.007 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:13.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:19:13.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:13.008 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:19:13.072 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:13.073 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:13.093 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:13.093 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:13.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:13.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 -- 172.21.15.81:0/3673991874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 msgr2=0x7f2f980725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 --2- 172.21.15.81:0/3673991874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 0x7f2f980725a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f2f8c009830 tx=0x7f2f8c02a510 comp rx=0 tx=0).stop 2024-09-17T05:19:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 -- 172.21.15.81:0/3673991874 shutdown_connections 2024-09-17T05:19:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 --2- 172.21.15.81:0/3673991874 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f980b3140 0x7f2f98072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 --2- 172.21.15.81:0/3673991874 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 0x7f2f980725a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 -- 172.21.15.81:0/3673991874 >> 172.21.15.81:0/3673991874 conn(0x7f2f980b1690 msgr2=0x7f2f980b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 -- 172.21.15.81:0/3673991874 shutdown_connections 2024-09-17T05:19:13.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.257+0000 7f2f9daef640 1 -- 172.21.15.81:0/3673991874 wait complete. 2024-09-17T05:19:13.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.258+0000 7f2f9daef640 1 Processor -- start 2024-09-17T05:19:13.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f9daef640 1 -- start start 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f9daef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f980b3140 0x7f2f9813c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f9daef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 0x7f2f980cd9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f9daef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f98151370 0x7f2f9813cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f9daef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9806ebe0 con 0x7f2f98151370 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f9daef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2f9806ea60 con 0x7f2f980cf640 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f9daef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2f9806f9f0 con 0x7f2f980b3140 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f97fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f98151370 0x7f2f9813cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f977fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f980b3140 0x7f2f9813c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f97fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f98151370 0x7f2f9813cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51254/0 (socket says 172.21.15.81:51254) 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f97fff640 1 -- 172.21.15.81:0/1445863445 learned_addr learned my addr 172.21.15.81:0/1445863445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.259+0000 7f2f96ffd640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 0x7f2f980cd9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f97fff640 1 -- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f980b3140 msgr2=0x7f2f9813c570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f97fff640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f980b3140 0x7f2f9813c570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f97fff640 1 -- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 msgr2=0x7f2f980cd9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f97fff640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 0x7f2f980cd9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f97fff640 1 -- 172.21.15.81:0/1445863445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f9813cab0 con 0x7f2f98151370 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f97fff640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f98151370 0x7f2f9813cfe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f90010c80 tx=0x7f2f9000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f7ffff640 1 -- 172.21.15.81:0/1445863445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f90004230 con 0x7f2f98151370 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f980cc950 con 0x7f2f98151370 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f7ffff640 1 -- 172.21.15.81:0/1445863445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f900035f0 con 0x7f2f98151370 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f7ffff640 1 -- 172.21.15.81:0/1445863445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f900044c0 con 0x7f2f98151370 2024-09-17T05:19:13.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.260+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f980ccf10 con 0x7f2f98151370 2024-09-17T05:19:13.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.261+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f980cef30 con 0x7f2f98151370 2024-09-17T05:19:13.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.262+0000 7f2f7ffff640 1 -- 172.21.15.81:0/1445863445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2f90003a00 con 0x7f2f98151370 2024-09-17T05:19:13.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.262+0000 7f2f7ffff640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f84078bc0 0x7f2f8407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.262+0000 7f2f7ffff640 1 -- 172.21.15.81:0/1445863445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f2f9009d940 con 0x7f2f98151370 2024-09-17T05:19:13.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.262+0000 7f2f977fe640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f84078bc0 0x7f2f8407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.263+0000 7f2f977fe640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f84078bc0 0x7f2f8407b080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f98146fa0 tx=0x7f2f88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:13.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.267+0000 7f2f7ffff640 1 -- 172.21.15.81:0/1445863445 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2f900657d0 con 0x7f2f98151370 2024-09-17T05:19:13.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.453+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f2f980b3ab0 con 0x7f2f98151370 2024-09-17T05:19:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.454+0000 7f2f7ffff640 1 -- 172.21.15.81:0/1445863445 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f2f9006a200 con 0x7f2f98151370 2024-09-17T05:19:13.455 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f84078bc0 msgr2=0x7f2f8407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f84078bc0 0x7f2f8407b080 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f2f98146fa0 tx=0x7f2f88009040 comp rx=0 tx=0).stop 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f98151370 msgr2=0x7f2f9813cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f98151370 0x7f2f9813cfe0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f2f90010c80 tx=0x7f2f9000c7a0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 shutdown_connections 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f84078bc0 0x7f2f8407b080 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f98151370 0x7f2f9813cfe0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f980cf640 0x7f2f980cd9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 --2- 172.21.15.81:0/1445863445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f980b3140 0x7f2f9813c570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 >> 172.21.15.81:0/1445863445 conn(0x7f2f980b1690 msgr2=0x7f2f980af790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 shutdown_connections 2024-09-17T05:19:13.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.456+0000 7f2f9daef640 1 -- 172.21.15.81:0/1445863445 wait complete. 2024-09-17T05:19:13.467 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:13.468 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:13.487 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.588+0000 7f3335532640 1 -- 172.21.15.81:0/2359449253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f333015df90 msgr2=0x7f33300cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.588+0000 7f3335532640 1 --2- 172.21.15.81:0/2359449253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f333015df90 0x7f33300cf9b0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f33300cf6a0 tx=0x7f332002a890 comp rx=0 tx=0).stop 2024-09-17T05:19:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.588+0000 7f3335532640 1 -- 172.21.15.81:0/2359449253 shutdown_connections 2024-09-17T05:19:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.588+0000 7f3335532640 1 --2- 172.21.15.81:0/2359449253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f333015df90 0x7f33300cf9b0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.588+0000 7f3335532640 1 -- 172.21.15.81:0/2359449253 >> 172.21.15.81:0/2359449253 conn(0x7f33300d3ea0 msgr2=0x7f33300d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:13.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.588+0000 7f3335532640 1 -- 172.21.15.81:0/2359449253 shutdown_connections 2024-09-17T05:19:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.588+0000 7f3335532640 1 -- 172.21.15.81:0/2359449253 wait complete. 2024-09-17T05:19:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.589+0000 7f3335532640 1 Processor -- start 2024-09-17T05:19:13.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.589+0000 7f3335532640 1 -- start start 2024-09-17T05:19:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f3335532640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33300d0d40 0x7f33301f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f3335532640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300d49c0 0x7f33300cd920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f3335532640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f333015df90 0x7f33300cde60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f3335532640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3330162690 con 0x7f33300d49c0 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f3335532640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f33300b3f10 con 0x7f33300d0d40 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f3335532640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3330150bd0 con 0x7f333015df90 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300d49c0 0x7f33300cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300d49c0 0x7f33300cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51262/0 (socket says 172.21.15.81:51262) 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 -- 172.21.15.81:0/987503714 learned_addr learned my addr 172.21.15.81:0/987503714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 -- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f333015df90 msgr2=0x7f33300cde60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332f7fe640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f333015df90 0x7f33300cde60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f333015df90 0x7f33300cde60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 -- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33300d0d40 msgr2=0x7f33301f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332effd640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33300d0d40 0x7f33301f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33300d0d40 0x7f33301f5220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 -- 172.21.15.81:0/987503714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3330160400 con 0x7f33300d49c0 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.590+0000 7f332e7fc640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300d49c0 0x7f33300cd920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f332400c460 tx=0x7f332400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.591+0000 7f33177fe640 1 -- 172.21.15.81:0/987503714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324016020 con 0x7f33300d49c0 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.591+0000 7f33177fe640 1 -- 172.21.15.81:0/987503714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3324012960 con 0x7f33300d49c0 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.591+0000 7f33177fe640 1 -- 172.21.15.81:0/987503714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3324012db0 con 0x7f33300d49c0 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.591+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33301606e0 con 0x7f33300d49c0 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.591+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3330160ca0 con 0x7f33300d49c0 2024-09-17T05:19:13.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.592+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33300b4480 con 0x7f33300d49c0 2024-09-17T05:19:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.592+0000 7f33177fe640 1 -- 172.21.15.81:0/987503714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3324019020 con 0x7f33300d49c0 2024-09-17T05:19:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.593+0000 7f33177fe640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f331c078b90 0x7f331c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.593+0000 7f33177fe640 1 -- 172.21.15.81:0/987503714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f332409aa60 con 0x7f33300d49c0 2024-09-17T05:19:13.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.593+0000 7f332effd640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f331c078b90 0x7f331c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:13.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.594+0000 7f332effd640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f331c078b90 0x7f331c07b050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3320034000 tx=0x7f3320004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:13.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.597+0000 7f33177fe640 1 -- 172.21.15.81:0/987503714 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3324020030 con 0x7f33300d49c0 2024-09-17T05:19:13.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.790+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f333008d590 con 0x7f33300d49c0 2024-09-17T05:19:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.791+0000 7f33177fe640 1 -- 172.21.15.81:0/987503714 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f3324062eb0 con 0x7f33300d49c0 2024-09-17T05:19:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:13.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f331c078b90 msgr2=0x7f331c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f331c078b90 0x7f331c07b050 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f3320034000 tx=0x7f3320004ab0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300d49c0 msgr2=0x7f33300cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300d49c0 0x7f33300cd920 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f332400c460 tx=0x7f332400c920 comp rx=0 tx=0).stop 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 shutdown_connections 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f331c078b90 0x7f331c07b050 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f333015df90 0x7f33300cde60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33300d49c0 0x7f33300cd920 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 --2- 172.21.15.81:0/987503714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33300d0d40 0x7f33301f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 >> 172.21.15.81:0/987503714 conn(0x7f33300d3ea0 msgr2=0x7f33300b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 shutdown_connections 2024-09-17T05:19:13.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:13.793+0000 7f3335532640 1 -- 172.21.15.81:0/987503714 wait complete. 2024-09-17T05:19:13.805 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:19:13.805 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:13.805 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:13.836 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:13.837 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:19:13.837 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:13.837 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:19:13.951 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:13.952 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:13.968 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:13.968 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:14.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:14.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.164+0000 7f1dc1110640 1 -- 172.21.15.81:0/3369334548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc490 msgr2=0x7f1dbc15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.164+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3369334548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc490 0x7f1dbc15f750 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009830 tx=0x7f1da402a510 comp rx=0 tx=0).stop 2024-09-17T05:19:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.164+0000 7f1dc1110640 1 -- 172.21.15.81:0/3369334548 shutdown_connections 2024-09-17T05:19:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.164+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3369334548 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc490 0x7f1dbc15f750 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.164+0000 7f1dc1110640 1 -- 172.21.15.81:0/3369334548 >> 172.21.15.81:0/3369334548 conn(0x7f1dbc0b1690 msgr2=0x7f1dbc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.164+0000 7f1dc1110640 1 -- 172.21.15.81:0/3369334548 shutdown_connections 2024-09-17T05:19:14.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.164+0000 7f1dc1110640 1 -- 172.21.15.81:0/3369334548 wait complete. 2024-09-17T05:19:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.166+0000 7f1dc1110640 1 Processor -- start 2024-09-17T05:19:14.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.166+0000 7f1dc1110640 1 -- start start 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.166+0000 7f1dc1110640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1dbc0cc490 0x7f1dbc1470b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.166+0000 7f1dc1110640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc900 0x7f1dbc1f8430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.166+0000 7f1dc1110640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1dbc159680 0x7f1dbc15e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dc1110640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc0cf560 con 0x7f1dbc0cc900 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dc1110640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1dbc0cf3e0 con 0x7f1dbc0cc490 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dc1110640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1dbc06f130 con 0x7f1dbc159680 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc900 0x7f1dbc1f8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc900 0x7f1dbc1f8430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51270/0 (socket says 172.21.15.81:51270) 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 -- 172.21.15.81:0/3130130685 learned_addr learned my addr 172.21.15.81:0/3130130685 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dbad9d640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1dbc0cc490 0x7f1dbc1470b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dbb59e640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1dbc159680 0x7f1dbc15e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 -- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1dbc159680 msgr2=0x7f1dbc15e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1dbc159680 0x7f1dbc15e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 -- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1dbc0cc490 msgr2=0x7f1dbc1470b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1dbc0cc490 0x7f1dbc1470b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 -- 172.21.15.81:0/3130130685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1dbc1475f0 con 0x7f1dbc0cc900 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dba59c640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc900 0x7f1dbc1f8430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009950 tx=0x7f1da4032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1db37fe640 1 -- 172.21.15.81:0/3130130685 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4040070 con 0x7f1dbc0cc900 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1db37fe640 1 -- 172.21.15.81:0/3130130685 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1da4003af0 con 0x7f1dbc0cc900 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1dbc1f4730 con 0x7f1dbc0cc900 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1db37fe640 1 -- 172.21.15.81:0/3130130685 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1da4045460 con 0x7f1dbc0cc900 2024-09-17T05:19:14.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.167+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1dbc1f4cd0 con 0x7f1dbc0cc900 2024-09-17T05:19:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.169+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1dbc15ff40 con 0x7f1dbc0cc900 2024-09-17T05:19:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.169+0000 7f1db37fe640 1 -- 172.21.15.81:0/3130130685 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f1da4039040 con 0x7f1dbc0cc900 2024-09-17T05:19:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.170+0000 7f1db37fe640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1d9c078b90 0x7f1d9c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.170+0000 7f1db37fe640 1 -- 172.21.15.81:0/3130130685 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f1da40bc250 con 0x7f1dbc0cc900 2024-09-17T05:19:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.170+0000 7f1dbad9d640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1d9c078b90 0x7f1d9c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.170+0000 7f1dbad9d640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1d9c078b90 0x7f1d9c07b050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1dac000f60 tx=0x7f1dac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:14.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.174+0000 7f1db37fe640 1 -- 172.21.15.81:0/3130130685 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1da40840d0 con 0x7f1dbc0cc900 2024-09-17T05:19:14.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.360+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1dbc15f8c0 con 0x7f1dbc0cc900 2024-09-17T05:19:14.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.361+0000 7f1db37fe640 1 -- 172.21.15.81:0/3130130685 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7f1da4088b00 con 0x7f1dbc0cc900 2024-09-17T05:19:14.361 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1d9c078b90 msgr2=0x7f1d9c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1d9c078b90 0x7f1d9c07b050 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1dac000f60 tx=0x7f1dac009040 comp rx=0 tx=0).stop 2024-09-17T05:19:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc900 msgr2=0x7f1dbc1f8430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc900 0x7f1dbc1f8430 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1da4009950 tx=0x7f1da4032d50 comp rx=0 tx=0).stop 2024-09-17T05:19:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 shutdown_connections 2024-09-17T05:19:14.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1d9c078b90 0x7f1d9c07b050 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1dbc159680 0x7f1dbc15e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1dbc0cc900 0x7f1dbc1f8430 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 --2- 172.21.15.81:0/3130130685 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1dbc0cc490 0x7f1dbc1470b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 >> 172.21.15.81:0/3130130685 conn(0x7f1dbc0b1690 msgr2=0x7f1dbc06e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 shutdown_connections 2024-09-17T05:19:14.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.363+0000 7f1dc1110640 1 -- 172.21.15.81:0/3130130685 wait complete. 2024-09-17T05:19:14.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:19:14.370 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:19:14.374 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:14.374 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:14.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.572+0000 7fc4972dd640 1 -- 172.21.15.81:0/754378364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 msgr2=0x7fc4900b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.572+0000 7fc4972dd640 1 --2- 172.21.15.81:0/754378364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900b4690 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fc48c009830 tx=0x7fc48c02a510 comp rx=0 tx=0).stop 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.572+0000 7fc4972dd640 1 -- 172.21.15.81:0/754378364 shutdown_connections 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.572+0000 7fc4972dd640 1 --2- 172.21.15.81:0/754378364 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4900735a0 0x7fc4900739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.572+0000 7fc4972dd640 1 --2- 172.21.15.81:0/754378364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900b4690 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.572+0000 7fc4972dd640 1 -- 172.21.15.81:0/754378364 >> 172.21.15.81:0/754378364 conn(0x7fc4900b1690 msgr2=0x7fc4900b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.573+0000 7fc4972dd640 1 -- 172.21.15.81:0/754378364 shutdown_connections 2024-09-17T05:19:14.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.573+0000 7fc4972dd640 1 -- 172.21.15.81:0/754378364 wait complete. 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 Processor -- start 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 -- start start 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc49006ff80 0x7fc4900cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4900735a0 0x7fc490144810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900c9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4900707a0 con 0x7fc49015aa70 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc490070620 con 0x7fc4900735a0 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc4972dd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc4901f23a0 con 0x7fc49006ff80 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.574+0000 7fc49587a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900c9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900c9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51288/0 (socket says 172.21.15.81:51288) 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 -- 172.21.15.81:0/1903223145 learned_addr learned my addr 172.21.15.81:0/1903223145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc495079640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc49006ff80 0x7fc4900cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc494878640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4900735a0 0x7fc490144810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 -- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc49006ff80 msgr2=0x7fc4900cba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc49006ff80 0x7fc4900cba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 -- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4900735a0 msgr2=0x7fc490144810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4900735a0 0x7fc490144810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 -- 172.21.15.81:0/1903223145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4901f2620 con 0x7fc49015aa70 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc495079640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc49006ff80 0x7fc4900cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc49587a640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900c9220 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c770 tx=0x7fc48800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc485ffb640 1 -- 172.21.15.81:0/1903223145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488003da0 con 0x7fc49015aa70 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc485ffb640 1 -- 172.21.15.81:0/1903223145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc48800ce20 con 0x7fc49015aa70 2024-09-17T05:19:14.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4901f2900 con 0x7fc49015aa70 2024-09-17T05:19:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc485ffb640 1 -- 172.21.15.81:0/1903223145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc488005290 con 0x7fc49015aa70 2024-09-17T05:19:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.575+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4901f2ec0 con 0x7fc49015aa70 2024-09-17T05:19:14.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.576+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4900cd8c0 con 0x7fc49015aa70 2024-09-17T05:19:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.577+0000 7fc485ffb640 1 -- 172.21.15.81:0/1903223145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc488005430 con 0x7fc49015aa70 2024-09-17T05:19:14.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.577+0000 7fc485ffb640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc474078b90 0x7fc47407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.577+0000 7fc485ffb640 1 -- 172.21.15.81:0/1903223145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fc48809aac0 con 0x7fc49015aa70 2024-09-17T05:19:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.577+0000 7fc495079640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc474078b90 0x7fc47407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:14.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.578+0000 7fc495079640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc474078b90 0x7fc47407b050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc48c034000 tx=0x7fc48c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:14.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.581+0000 7fc485ffb640 1 -- 172.21.15.81:0/1903223145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc488063020 con 0x7fc49015aa70 2024-09-17T05:19:14.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.771+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc4900b2f90 con 0x7fc49015aa70 2024-09-17T05:19:14.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.771+0000 7fc485ffb640 1 -- 172.21.15.81:0/1903223145 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fc488062920 con 0x7fc49015aa70 2024-09-17T05:19:14.772 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:14.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.773+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc474078b90 msgr2=0x7fc47407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.773+0000 7fc4972dd640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc474078b90 0x7fc47407b050 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fc48c034000 tx=0x7fc48c004730 comp rx=0 tx=0).stop 2024-09-17T05:19:14.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.773+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 msgr2=0x7fc4900c9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.773+0000 7fc4972dd640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900c9220 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fc48800c770 tx=0x7fc48800cc30 comp rx=0 tx=0).stop 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 shutdown_connections 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc474078b90 0x7fc47407b050 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc49015aa70 0x7fc4900c9220 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4900735a0 0x7fc490144810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 --2- 172.21.15.81:0/1903223145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc49006ff80 0x7fc4900cba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 >> 172.21.15.81:0/1903223145 conn(0x7fc4900b1690 msgr2=0x7fc4900ce2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 shutdown_connections 2024-09-17T05:19:14.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:14.774+0000 7fc4972dd640 1 -- 172.21.15.81:0/1903223145 wait complete. 2024-09-17T05:19:14.785 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:19:14.785 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:14.785 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2024-09-17T05:19:14.810 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:14.810 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:19:14.810 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:14.811 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2024-09-17T05:19:14.866 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:14.866 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:14.886 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:14.886 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:14.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 -- 172.21.15.81:0/1191929770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800ce780 msgr2=0x7fbe800cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 --2- 172.21.15.81:0/1191929770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800ce780 0x7fbe800cbb80 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbe78009be0 tx=0x7fbe7802a8d0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 -- 172.21.15.81:0/1191929770 shutdown_connections 2024-09-17T05:19:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 --2- 172.21.15.81:0/1191929770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800ce780 0x7fbe800cbb80 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 --2- 172.21.15.81:0/1191929770 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe800cd3e0 0x7fbe800ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 -- 172.21.15.81:0/1191929770 >> 172.21.15.81:0/1191929770 conn(0x7fbe800741f0 msgr2=0x7fbe80074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 -- 172.21.15.81:0/1191929770 shutdown_connections 2024-09-17T05:19:15.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.047+0000 7fbe86285640 1 -- 172.21.15.81:0/1191929770 wait complete. 2024-09-17T05:19:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.048+0000 7fbe86285640 1 Processor -- start 2024-09-17T05:19:15.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.048+0000 7fbe86285640 1 -- start start 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe86285640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe8006f0b0 0x7fbe800c5c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe86285640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800cd3e0 0x7fbe801f55a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe86285640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800ce780 0x7fbe800c69b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe86285640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800cc0c0 con 0x7fbe800cd3e0 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe86285640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe8015e670 con 0x7fbe800ce780 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe86285640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbe800cc240 con 0x7fbe8006f0b0 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe7f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800cd3e0 0x7fbe801f55a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe7f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800cd3e0 0x7fbe801f55a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51300/0 (socket says 172.21.15.81:51300) 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe7f7fe640 1 -- 172.21.15.81:0/202408830 learned_addr learned my addr 172.21.15.81:0/202408830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.049+0000 7fbe7ffff640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe8006f0b0 0x7fbe800c5c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe84822640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800ce780 0x7fbe800c69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7f7fe640 1 -- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe8006f0b0 msgr2=0x7fbe800c5c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7f7fe640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe8006f0b0 0x7fbe800c5c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7f7fe640 1 -- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800ce780 msgr2=0x7fbe800c69b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7f7fe640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800ce780 0x7fbe800c69b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7f7fe640 1 -- 172.21.15.81:0/202408830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8009a990 con 0x7fbe800cd3e0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7f7fe640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800cd3e0 0x7fbe801f55a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400d950 tx=0x7fbe7400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7cff9640 1 -- 172.21.15.81:0/202408830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe74017070 con 0x7fbe800cd3e0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7cff9640 1 -- 172.21.15.81:0/202408830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe74009cc0 con 0x7fbe800cd3e0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe7cff9640 1 -- 172.21.15.81:0/202408830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe740106c0 con 0x7fbe800cd3e0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe800b4f50 con 0x7fbe800cd3e0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.050+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe8009a620 con 0x7fbe800cd3e0 2024-09-17T05:19:15.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.051+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe800ce240 con 0x7fbe800cd3e0 2024-09-17T05:19:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.052+0000 7fbe7cff9640 1 -- 172.21.15.81:0/202408830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fbe7401a070 con 0x7fbe800cd3e0 2024-09-17T05:19:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.052+0000 7fbe7cff9640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbe6c078b90 0x7fbe6c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.052+0000 7fbe7cff9640 1 -- 172.21.15.81:0/202408830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fbe7409ae50 con 0x7fbe800cd3e0 2024-09-17T05:19:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.052+0000 7fbe7ffff640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbe6c078b90 0x7fbe6c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.053+0000 7fbe7ffff640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbe6c078b90 0x7fbe6c07b050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe70000f60 tx=0x7fbe70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:15.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.056+0000 7fbe7cff9640 1 -- 172.21.15.81:0/202408830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbe740633b0 con 0x7fbe800cd3e0 2024-09-17T05:19:15.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.243+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbe800b3170 con 0x7fbe800cd3e0 2024-09-17T05:19:15.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.243+0000 7fbe7cff9640 1 -- 172.21.15.81:0/202408830 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fbe74062cb0 con 0x7fbe800cd3e0 2024-09-17T05:19:15.244 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:15.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbe6c078b90 msgr2=0x7fbe6c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbe6c078b90 0x7fbe6c07b050 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fbe70000f60 tx=0x7fbe70009040 comp rx=0 tx=0).stop 2024-09-17T05:19:15.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800cd3e0 msgr2=0x7fbe801f55a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800cd3e0 0x7fbe801f55a0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fbe7400d950 tx=0x7fbe7400de10 comp rx=0 tx=0).stop 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 shutdown_connections 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbe6c078b90 0x7fbe6c07b050 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800ce780 0x7fbe800c69b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe800cd3e0 0x7fbe801f55a0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 --2- 172.21.15.81:0/202408830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe8006f0b0 0x7fbe800c5c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 >> 172.21.15.81:0/202408830 conn(0x7fbe800741f0 msgr2=0x7fbe800c80c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 shutdown_connections 2024-09-17T05:19:15.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.245+0000 7fbe86285640 1 -- 172.21.15.81:0/202408830 wait complete. 2024-09-17T05:19:15.257 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:15.257 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:15.276 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.377+0000 7fd488d00640 1 -- 172.21.15.81:0/1775346061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d0d40 msgr2=0x7fd4840cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.377+0000 7fd488d00640 1 --2- 172.21.15.81:0/1775346061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d0d40 0x7fd4840cf9b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd46c009830 tx=0x7fd46c02a5c0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.377+0000 7fd488d00640 1 -- 172.21.15.81:0/1775346061 shutdown_connections 2024-09-17T05:19:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.377+0000 7fd488d00640 1 --2- 172.21.15.81:0/1775346061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d0d40 0x7fd4840cf9b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.377+0000 7fd488d00640 1 -- 172.21.15.81:0/1775346061 >> 172.21.15.81:0/1775346061 conn(0x7fd4840d3ea0 msgr2=0x7fd4840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.377+0000 7fd488d00640 1 -- 172.21.15.81:0/1775346061 shutdown_connections 2024-09-17T05:19:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.377+0000 7fd488d00640 1 -- 172.21.15.81:0/1775346061 wait complete. 2024-09-17T05:19:15.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 Processor -- start 2024-09-17T05:19:15.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 -- start start 2024-09-17T05:19:15.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4840d0d40 0x7fd4840c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d49c0 0x7fd4840b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd48415df90 0x7fd4840cd790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd484162690 con 0x7fd4840d49c0 2024-09-17T05:19:15.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4840b3f10 con 0x7fd4840d0d40 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.379+0000 7fd488d00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd4841f82e0 con 0x7fd48415df90 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4840d0d40 0x7fd4840c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4840d0d40 0x7fd4840c9ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3300/0 says I am v2:172.21.15.81:60834/0 (socket says 172.21.15.81:60834) 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 -- 172.21.15.81:0/301401174 learned_addr learned my addr 172.21.15.81:0/301401174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd482d9d640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd48415df90 0x7fd4840cd790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd47bfff640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d49c0 0x7fd4840b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 -- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd48415df90 msgr2=0x7fd4840cd790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd48415df90 0x7fd4840cd790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 -- 172.21.15.81:0/301401174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d49c0 msgr2=0x7fd4840b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d49c0 0x7fd4840b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 -- 172.21.15.81:0/301401174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4840b51b0 con 0x7fd4840d0d40 2024-09-17T05:19:15.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd482d9d640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd48415df90 0x7fd4840cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:19:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd48259c640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4840d0d40 0x7fd4840c9ec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c3c0 tx=0x7fd47400c880 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.380+0000 7fd47affd640 1 -- 172.21.15.81:0/301401174 <== mon.1 v2:172.21.15.160:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474017070 con 0x7fd4840d0d40 2024-09-17T05:19:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.381+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4841f8530 con 0x7fd4840d0d40 2024-09-17T05:19:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.381+0000 7fd47affd640 1 -- 172.21.15.81:0/301401174 <== mon.1 v2:172.21.15.160:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd4740053e0 con 0x7fd4840d0d40 2024-09-17T05:19:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.381+0000 7fd47affd640 1 -- 172.21.15.81:0/301401174 <== mon.1 v2:172.21.15.160:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474003870 con 0x7fd4840d0d40 2024-09-17T05:19:15.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.381+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4841f8af0 con 0x7fd4840d0d40 2024-09-17T05:19:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.381+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4841f91b0 con 0x7fd4840d0d40 2024-09-17T05:19:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.382+0000 7fd47affd640 1 -- 172.21.15.81:0/301401174 <== mon.1 v2:172.21.15.160:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd47401a070 con 0x7fd4840d0d40 2024-09-17T05:19:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.383+0000 7fd47affd640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd464078b90 0x7fd46407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.383+0000 7fd47affd640 1 -- 172.21.15.81:0/301401174 <== mon.1 v2:172.21.15.160:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd47409a3c0 con 0x7fd4840d0d40 2024-09-17T05:19:15.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.383+0000 7fd47bfff640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd464078b90 0x7fd46407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.384+0000 7fd47bfff640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd464078b90 0x7fd46407b050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd46c034000 tx=0x7fd46c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.387+0000 7fd47affd640 1 -- 172.21.15.81:0/301401174 <== mon.1 v2:172.21.15.160:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd4841f91b0 con 0x7fd4840d0d40 2024-09-17T05:19:15.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.574+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fd4840b4430 con 0x7fd4840d0d40 2024-09-17T05:19:15.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.575+0000 7fd47affd640 1 -- 172.21.15.81:0/301401174 <== mon.1 v2:172.21.15.160:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v23) ==== 80+0+0 (secure 0 0 0) 0x7fd474021020 con 0x7fd4840d0d40 2024-09-17T05:19:15.576 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:15.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd464078b90 msgr2=0x7fd46407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd464078b90 0x7fd46407b050 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fd46c034000 tx=0x7fd46c004730 comp rx=0 tx=0).stop 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4840d0d40 msgr2=0x7fd4840c9ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4840d0d40 0x7fd4840c9ec0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd47400c3c0 tx=0x7fd47400c880 comp rx=0 tx=0).stop 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 shutdown_connections 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd464078b90 0x7fd46407b050 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd48415df90 0x7fd4840cd790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd4840d49c0 0x7fd4840b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 --2- 172.21.15.81:0/301401174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4840d0d40 0x7fd4840c9ec0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 >> 172.21.15.81:0/301401174 conn(0x7fd4840d3ea0 msgr2=0x7fd4840b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 shutdown_connections 2024-09-17T05:19:15.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.577+0000 7fd488d00640 1 -- 172.21.15.81:0/301401174 wait complete. 2024-09-17T05:19:15.589 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:19:15.589 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:15.589 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2024-09-17T05:19:15.618 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:15.618 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:19:15.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:15.619 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2024-09-17T05:19:15.676 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:19:15.677 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/3158262369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c013f9a0 msgr2=0x7fd0c006f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/3158262369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c013f9a0 0x7fd0c006f0f0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd0b8005fd0 tx=0x7fd0b802aa00 comp rx=0 tx=0).stop 2024-09-17T05:19:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/3158262369 shutdown_connections 2024-09-17T05:19:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/3158262369 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c013f9a0 0x7fd0c006f0f0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/3158262369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0c013ce00 0x7fd0c00725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/3158262369 >> 172.21.15.81:0/3158262369 conn(0x7fd0c00b1690 msgr2=0x7fd0c00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:15.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/3158262369 shutdown_connections 2024-09-17T05:19:15.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.776+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/3158262369 wait complete. 2024-09-17T05:19:15.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.777+0000 7fd0c6d5d640 1 Processor -- start 2024-09-17T05:19:15.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.777+0000 7fd0c6d5d640 1 -- start start 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c6d5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0072ae0 0x7fd0c013c570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c6d5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0c013ce00 0x7fd0c014ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c6d5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0c013f9a0 0x7fd0c01f2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c6d5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0070810 con 0x7fd0c0072ae0 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c6d5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0070690 con 0x7fd0c013ce00 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c6d5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd0c006f630 con 0x7fd0c013f9a0 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0072ae0 0x7fd0c013c570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0072ae0 0x7fd0c013c570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51334/0 (socket says 172.21.15.81:51334) 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 -- 172.21.15.81:0/2896183857 learned_addr learned my addr 172.21.15.81:0/2896183857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c52fa640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0c013f9a0 0x7fd0c01f2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 -- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0c013f9a0 msgr2=0x7fd0c01f2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0c013f9a0 0x7fd0c01f2e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 -- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0c013ce00 msgr2=0x7fd0c014ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0b7fff640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0c013ce00 0x7fd0c014ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0c013ce00 0x7fd0c014ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 -- 172.21.15.81:0/2896183857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c014cf50 con 0x7fd0c0072ae0 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c4af9640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0072ae0 0x7fd0c013c570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c8c0 tx=0x7fd0bc00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0b57fa640 1 -- 172.21.15.81:0/2896183857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc004220 con 0x7fd0c0072ae0 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0b57fa640 1 -- 172.21.15.81:0/2896183857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0bc0079b0 con 0x7fd0c0072ae0 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.778+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c0153320 con 0x7fd0c0072ae0 2024-09-17T05:19:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.779+0000 7fd0b57fa640 1 -- 172.21.15.81:0/2896183857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0bc007de0 con 0x7fd0c0072ae0 2024-09-17T05:19:15.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.779+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c01538e0 con 0x7fd0c0072ae0 2024-09-17T05:19:15.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.779+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c00725a0 con 0x7fd0c0072ae0 2024-09-17T05:19:15.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.780+0000 7fd0b57fa640 1 -- 172.21.15.81:0/2896183857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd0bc005020 con 0x7fd0c0072ae0 2024-09-17T05:19:15.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.781+0000 7fd0b57fa640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd0ac078b90 0x7fd0ac07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:15.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.781+0000 7fd0b57fa640 1 -- 172.21.15.81:0/2896183857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fd0bc09b1a0 con 0x7fd0c0072ae0 2024-09-17T05:19:15.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.781+0000 7fd0b7fff640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd0ac078b90 0x7fd0ac07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:15.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.781+0000 7fd0b7fff640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd0ac078b90 0x7fd0ac07b050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0154930 tx=0x7fd0b0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.785+0000 7fd0b57fa640 1 -- 172.21.15.81:0/2896183857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd0bc014030 con 0x7fd0c0072ae0 2024-09-17T05:19:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.993+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0c006f3f0 con 0x7fd0c0072ae0 2024-09-17T05:19:15.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.994+0000 7fd0b57fa640 1 -- 172.21.15.81:0/2896183857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fd0bc063670 con 0x7fd0c0072ae0 2024-09-17T05:19:15.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:15.995 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:19:15.995 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:19:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd0ac078b90 msgr2=0x7fd0ac07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd0ac078b90 0x7fd0ac07b050 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fd0c0154930 tx=0x7fd0b0009040 comp rx=0 tx=0).stop 2024-09-17T05:19:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0072ae0 msgr2=0x7fd0c013c570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0072ae0 0x7fd0c013c570 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc00c8c0 tx=0x7fd0bc00cd80 comp rx=0 tx=0).stop 2024-09-17T05:19:15.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 shutdown_connections 2024-09-17T05:19:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd0ac078b90 0x7fd0ac07b050 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0c013f9a0 0x7fd0c01f2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0c013ce00 0x7fd0c014ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 --2- 172.21.15.81:0/2896183857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0c0072ae0 0x7fd0c013c570 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 >> 172.21.15.81:0/2896183857 conn(0x7fd0c00b1690 msgr2=0x7fd0c0157ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 shutdown_connections 2024-09-17T05:19:15.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:15.996+0000 7fd0c6d5d640 1 -- 172.21.15.81:0/2896183857 wait complete. 2024-09-17T05:19:16.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.108+0000 7fea0f59e640 1 -- 172.21.15.81:0/1984815981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f510 msgr2=0x7fea100d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.108+0000 7fea0f59e640 1 --2- 172.21.15.81:0/1984815981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f510 0x7fea100d0750 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fea08005fd0 tx=0x7fea0802aa90 comp rx=0 tx=0).stop 2024-09-17T05:19:16.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.108+0000 7fea0f59e640 1 -- 172.21.15.81:0/1984815981 shutdown_connections 2024-09-17T05:19:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.108+0000 7fea0f59e640 1 --2- 172.21.15.81:0/1984815981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f510 0x7fea100d0750 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.108+0000 7fea0f59e640 1 -- 172.21.15.81:0/1984815981 >> 172.21.15.81:0/1984815981 conn(0x7fea100d1b30 msgr2=0x7fea100d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.108+0000 7fea0f59e640 1 -- 172.21.15.81:0/1984815981 shutdown_connections 2024-09-17T05:19:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.108+0000 7fea0f59e640 1 -- 172.21.15.81:0/1984815981 wait complete. 2024-09-17T05:19:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.109+0000 7fea0f59e640 1 Processor -- start 2024-09-17T05:19:16.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.109+0000 7fea0f59e640 1 -- start start 2024-09-17T05:19:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0f59e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea100d02c0 0x7fea1015a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f130 0x7fea100b1ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0f59e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea1015f510 0x7fea100c5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0f59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea100b5a20 con 0x7fea1015f130 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0f59e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fea100b58a0 con 0x7fea100d02c0 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0f59e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fea100b5ba0 con 0x7fea1015f510 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f130 0x7fea100b1ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f130 0x7fea100b1ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51354/0 (socket says 172.21.15.81:51354) 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 -- 172.21.15.81:0/2813515629 learned_addr learned my addr 172.21.15.81:0/2813515629 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0e59c640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea100d02c0 0x7fea1015a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0ed9d640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea1015f510 0x7fea100c5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 -- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea1015f510 msgr2=0x7fea100c5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea1015f510 0x7fea100c5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 -- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea100d02c0 msgr2=0x7fea1015a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea100d02c0 0x7fea1015a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.110+0000 7fea0dd9b640 1 -- 172.21.15.81:0/2813515629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea100b0e50 con 0x7fea1015f130 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.111+0000 7fea0dd9b640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f130 0x7fea100b1ef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea0400c430 tx=0x7fea0400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.111+0000 7fe9feffd640 1 -- 172.21.15.81:0/2813515629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea04011790 con 0x7fea1015f130 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.111+0000 7fe9feffd640 1 -- 172.21.15.81:0/2813515629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea04017070 con 0x7fea1015f130 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.111+0000 7fe9feffd640 1 -- 172.21.15.81:0/2813515629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea04011d00 con 0x7fea1015f130 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.111+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea100b1130 con 0x7fea1015f130 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.111+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea100b16f0 con 0x7fea1015f130 2024-09-17T05:19:16.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.112+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea100d0750 con 0x7fea1015f130 2024-09-17T05:19:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.112+0000 7fe9feffd640 1 -- 172.21.15.81:0/2813515629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fea0401c460 con 0x7fea1015f130 2024-09-17T05:19:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.113+0000 7fe9feffd640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9f0078b90 0x7fe9f007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.113+0000 7fe9feffd640 1 -- 172.21.15.81:0/2813515629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fea0409abe0 con 0x7fea1015f130 2024-09-17T05:19:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.113+0000 7fea0e59c640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9f0078b90 0x7fe9f007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.114+0000 7fea0e59c640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9f0078b90 0x7fe9f007b050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea00000f60 tx=0x7fea00009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:16.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.117+0000 7fe9feffd640 1 -- 172.21.15.81:0/2813515629 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fea040630b0 con 0x7fea1015f130 2024-09-17T05:19:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.333+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea100cbbf0 con 0x7fea1015f130 2024-09-17T05:19:16.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.334+0000 7fe9feffd640 1 -- 172.21.15.81:0/2813515629 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fea040629b0 con 0x7fea1015f130 2024-09-17T05:19:16.335 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:16.335 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:19:16.336 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:19:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9f0078b90 msgr2=0x7fe9f007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9f0078b90 0x7fe9f007b050 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fea00000f60 tx=0x7fea00009040 comp rx=0 tx=0).stop 2024-09-17T05:19:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f130 msgr2=0x7fea100b1ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f130 0x7fea100b1ef0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fea0400c430 tx=0x7fea0400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 shutdown_connections 2024-09-17T05:19:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9f0078b90 0x7fe9f007b050 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea1015f510 0x7fea100c5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea1015f130 0x7fea100b1ef0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 --2- 172.21.15.81:0/2813515629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea100d02c0 0x7fea1015a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 >> 172.21.15.81:0/2813515629 conn(0x7fea100d1b30 msgr2=0x7fea100b6020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 shutdown_connections 2024-09-17T05:19:16.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.336+0000 7fea0f59e640 1 -- 172.21.15.81:0/2813515629 wait complete. 2024-09-17T05:19:16.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 -- 172.21.15.81:0/2126929258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17440735a0 msgr2=0x7f17440739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 --2- 172.21.15.81:0/2126929258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17440735a0 0x7f17440739d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f17440b26e0 tx=0x7f173802a560 comp rx=0 tx=0).stop 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 -- 172.21.15.81:0/2126929258 shutdown_connections 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 --2- 172.21.15.81:0/2126929258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17440735a0 0x7f17440739d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 --2- 172.21.15.81:0/2126929258 >> v2:172.21.15.160:3300/0 conn(0x7f174415aa70 0x7f17440b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 -- 172.21.15.81:0/2126929258 >> 172.21.15.81:0/2126929258 conn(0x7f17440b1690 msgr2=0x7f17440b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 -- 172.21.15.81:0/2126929258 shutdown_connections 2024-09-17T05:19:16.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.447+0000 7f174a247640 1 -- 172.21.15.81:0/2126929258 wait complete. 2024-09-17T05:19:16.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.448+0000 7f174a247640 1 Processor -- start 2024-09-17T05:19:16.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.448+0000 7f174a247640 1 -- start start 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f174a247640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f174406ff80 0x7f174413e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f174a247640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17440735a0 0x7f174414fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f174a247640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f174415aa70 0x7f1744150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f174a247640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1744070780 con 0x7f174406ff80 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f174a247640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1744070600 con 0x7f17440735a0 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f174a247640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1744070900 con 0x7f174415aa70 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f17437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f174406ff80 0x7f174413e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f17437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f174406ff80 0x7f174413e820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51382/0 (socket says 172.21.15.81:51382) 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f17437fe640 1 -- 172.21.15.81:0/4268973514 learned_addr learned my addr 172.21.15.81:0/4268973514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f17437fe640 1 -- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f174415aa70 msgr2=0x7f1744150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f17437fe640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f174415aa70 0x7f1744150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f17437fe640 1 -- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17440735a0 msgr2=0x7f174414fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.449+0000 7f17437fe640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17440735a0 0x7f174414fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.450+0000 7f17437fe640 1 -- 172.21.15.81:0/4268973514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1744150930 con 0x7f174406ff80 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.450+0000 7f17437fe640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f174406ff80 0x7f174413e820 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f173400ba50 tx=0x7f173400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.450+0000 7f172bfff640 1 -- 172.21.15.81:0/4268973514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1734019070 con 0x7f174406ff80 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.450+0000 7f172bfff640 1 -- 172.21.15.81:0/4268973514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f173400ccf0 con 0x7f174406ff80 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.450+0000 7f172bfff640 1 -- 172.21.15.81:0/4268973514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17340146a0 con 0x7f174406ff80 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.450+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1744150c10 con 0x7f174406ff80 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.450+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174413ed60 con 0x7f174406ff80 2024-09-17T05:19:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.451+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1744151130 con 0x7f174406ff80 2024-09-17T05:19:16.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.451+0000 7f172bfff640 1 -- 172.21.15.81:0/4268973514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f173401c070 con 0x7f174406ff80 2024-09-17T05:19:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.452+0000 7f172bfff640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1730078bc0 0x7f173007b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.452+0000 7f172bfff640 1 -- 172.21.15.81:0/4268973514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f173409aab0 con 0x7f174406ff80 2024-09-17T05:19:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.452+0000 7f1742ffd640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1730078bc0 0x7f173007b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.453+0000 7f1742ffd640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1730078bc0 0x7f173007b080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1738033000 tx=0x7f17380046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.456+0000 7f172bfff640 1 -- 172.21.15.81:0/4268973514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1744151130 con 0x7f174406ff80 2024-09-17T05:19:16.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.634+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f17440739d0 con 0x7f174406ff80 2024-09-17T05:19:16.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.635+0000 7f172bfff640 1 -- 172.21.15.81:0/4268973514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7f1734062f80 con 0x7f174406ff80 2024-09-17T05:19:16.637 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:16.637 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:48.113992+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1730078bc0 msgr2=0x7f173007b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1730078bc0 0x7f173007b080 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f1738033000 tx=0x7f17380046c0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f174406ff80 msgr2=0x7f174413e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f174406ff80 0x7f174413e820 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f173400ba50 tx=0x7f173400bf10 comp rx=0 tx=0).stop 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 shutdown_connections 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1730078bc0 0x7f173007b080 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f174415aa70 0x7f1744150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17440735a0 0x7f174414fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 --2- 172.21.15.81:0/4268973514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f174406ff80 0x7f174413e820 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 >> 172.21.15.81:0/4268973514 conn(0x7f17440b1690 msgr2=0x7f17440b2a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:16.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 shutdown_connections 2024-09-17T05:19:16.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.638+0000 7f174a247640 1 -- 172.21.15.81:0/4268973514 wait complete. 2024-09-17T05:19:16.707 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:19:16.707 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 -- 172.21.15.81:0/2786343047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 msgr2=0x7fcebc0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 --2- 172.21.15.81:0/2786343047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 0x7fcebc0cf9b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7fceac009830 tx=0x7fceac02a510 comp rx=0 tx=0).stop 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 -- 172.21.15.81:0/2786343047 shutdown_connections 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 --2- 172.21.15.81:0/2786343047 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcebc0d49c0 0x7fcebc0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 --2- 172.21.15.81:0/2786343047 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 0x7fcebc0cf9b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 -- 172.21.15.81:0/2786343047 >> 172.21.15.81:0/2786343047 conn(0x7fcebc0d3ea0 msgr2=0x7fcebc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 -- 172.21.15.81:0/2786343047 shutdown_connections 2024-09-17T05:19:16.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.808+0000 7fcec27e2640 1 -- 172.21.15.81:0/2786343047 wait complete. 2024-09-17T05:19:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.809+0000 7fcec27e2640 1 Processor -- start 2024-09-17T05:19:16.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.809+0000 7fcec27e2640 1 -- start start 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcec27e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcebc0d49c0 0x7fcebc153930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcec27e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 0x7fcebc15ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcec27e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcebc162480 0x7fcebc0cd550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcec27e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0d0f00 con 0x7fcebc0d49c0 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcec27e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcebc0d0d80 con 0x7fcebc15df90 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcec27e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcebc0b3f10 con 0x7fcebc162480 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcebc0d49c0 0x7fcebc153930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcebc0d49c0 0x7fcebc153930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51394/0 (socket says 172.21.15.81:51394) 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 -- 172.21.15.81:0/3141053621 learned_addr learned my addr 172.21.15.81:0/3141053621 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebb7fe640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 0x7fcebc15ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcec0d7f640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcebc162480 0x7fcebc0cd550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 -- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcebc162480 msgr2=0x7fcebc0cd550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcebc162480 0x7fcebc0cd550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 -- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 msgr2=0x7fcebc15ffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 0x7fcebc15ffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.810+0000 7fcebbfff640 1 -- 172.21.15.81:0/3141053621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcebc1604f0 con 0x7fcebc0d49c0 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.811+0000 7fcebbfff640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcebc0d49c0 0x7fcebc153930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fceac009950 tx=0x7fceac032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.811+0000 7fceb8ff9640 1 -- 172.21.15.81:0/3141053621 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac040070 con 0x7fcebc0d49c0 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.811+0000 7fceb8ff9640 1 -- 172.21.15.81:0/3141053621 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fceac005310 con 0x7fcebc0d49c0 2024-09-17T05:19:16.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.811+0000 7fceb8ff9640 1 -- 172.21.15.81:0/3141053621 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceac0047a0 con 0x7fcebc0d49c0 2024-09-17T05:19:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.811+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcebc160790 con 0x7fcebc0d49c0 2024-09-17T05:19:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.811+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcebc160d50 con 0x7fcebc0d49c0 2024-09-17T05:19:16.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.812+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcebc0b4430 con 0x7fcebc0d49c0 2024-09-17T05:19:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.812+0000 7fceb8ff9640 1 -- 172.21.15.81:0/3141053621 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fceac039040 con 0x7fcebc0d49c0 2024-09-17T05:19:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.813+0000 7fceb8ff9640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcea8078bc0 0x7fcea807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.813+0000 7fceb8ff9640 1 -- 172.21.15.81:0/3141053621 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7fceac0bbd90 con 0x7fcebc0d49c0 2024-09-17T05:19:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.813+0000 7fcebb7fe640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcea8078bc0 0x7fcea807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:16.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.814+0000 7fcebb7fe640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcea8078bc0 0x7fcea807b080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcebc161b00 tx=0x7fceb0005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:16.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:16.817+0000 7fceb8ff9640 1 -- 172.21.15.81:0/3141053621 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fceac083ca0 con 0x7fcebc0d49c0 2024-09-17T05:19:17.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.027+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcebc08d590 con 0x7fcebc0d49c0 2024-09-17T05:19:17.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.028+0000 7fceb8ff9640 1 -- 172.21.15.81:0/3141053621 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7fceac0886d0 con 0x7fcebc0d49c0 2024-09-17T05:19:17.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:17.029 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:19:17.029 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:19:17.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcea8078bc0 msgr2=0x7fcea807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcea8078bc0 0x7fcea807b080 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fcebc161b00 tx=0x7fceb0005f90 comp rx=0 tx=0).stop 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcebc0d49c0 msgr2=0x7fcebc153930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcebc0d49c0 0x7fcebc153930 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fceac009950 tx=0x7fceac032c10 comp rx=0 tx=0).stop 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 shutdown_connections 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcea8078bc0 0x7fcea807b080 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcebc162480 0x7fcebc0cd550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcebc15df90 0x7fcebc15ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 --2- 172.21.15.81:0/3141053621 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcebc0d49c0 0x7fcebc153930 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 >> 172.21.15.81:0/3141053621 conn(0x7fcebc0d3ea0 msgr2=0x7fcebc0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 shutdown_connections 2024-09-17T05:19:17.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.030+0000 7fcec27e2640 1 -- 172.21.15.81:0/3141053621 wait complete. 2024-09-17T05:19:17.042 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 -- 172.21.15.81:0/4238994211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d14157a70 msgr2=0x7f4d14157e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 --2- 172.21.15.81:0/4238994211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d14157a70 0x7f4d14157e90 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f4d140b1500 tx=0x7f4d0c02aac0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 -- 172.21.15.81:0/4238994211 shutdown_connections 2024-09-17T05:19:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 --2- 172.21.15.81:0/4238994211 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d14157a70 0x7f4d14157e90 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 --2- 172.21.15.81:0/4238994211 >> v2:172.21.15.160:3300/0 conn(0x7f4d140d2010 0x7f4d1415ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 -- 172.21.15.81:0/4238994211 >> 172.21.15.81:0/4238994211 conn(0x7f4d1409aa30 msgr2=0x7f4d1409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:17.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 -- 172.21.15.81:0/4238994211 shutdown_connections 2024-09-17T05:19:17.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.142+0000 7f4d1c260640 1 -- 172.21.15.81:0/4238994211 wait complete. 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.143+0000 7f4d1c260640 1 Processor -- start 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.143+0000 7f4d1c260640 1 -- start start 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d140b01a0 0x7f4d14152690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d140d2010 0x7f4d140b12d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d14157a70 0x7f4d141f4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d141583d0 con 0x7f4d140d2010 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4d140b0e30 con 0x7f4d14157a70 2024-09-17T05:19:17.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4d14158550 con 0x7f4d140b01a0 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d140d2010 0x7f4d140b12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d140d2010 0x7f4d140b12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51402/0 (socket says 172.21.15.81:51402) 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 -- 172.21.15.81:0/3212314507 learned_addr learned my addr 172.21.15.81:0/3212314507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 -- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d140b01a0 msgr2=0x7f4d14152690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d140b01a0 0x7f4d14152690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 -- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d14157a70 msgr2=0x7f4d141f4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d14157a70 0x7f4d141f4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 -- 172.21.15.81:0/3212314507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d141f8560 con 0x7f4d140d2010 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d197fb640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d140d2010 0x7f4d140b12d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400d770 tx=0x7f4d0400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d0a7fc640 1 -- 172.21.15.81:0/3212314507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04017070 con 0x7f4d140d2010 2024-09-17T05:19:17.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d0a7fc640 1 -- 172.21.15.81:0/3212314507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d04009cc0 con 0x7f4d140d2010 2024-09-17T05:19:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d141f8840 con 0x7f4d140d2010 2024-09-17T05:19:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d0a7fc640 1 -- 172.21.15.81:0/3212314507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d04005280 con 0x7f4d140d2010 2024-09-17T05:19:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.144+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d141f8e00 con 0x7f4d140d2010 2024-09-17T05:19:17.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.145+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d1415ed90 con 0x7f4d140d2010 2024-09-17T05:19:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.146+0000 7f4d0a7fc640 1 -- 172.21.15.81:0/3212314507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4d04005420 con 0x7f4d140d2010 2024-09-17T05:19:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.146+0000 7f4d0a7fc640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cf8078b90 0x7f4cf807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.146+0000 7f4d0a7fc640 1 -- 172.21.15.81:0/3212314507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f4d0409ae20 con 0x7f4d140d2010 2024-09-17T05:19:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.147+0000 7f4d19ffc640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cf8078b90 0x7f4cf807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.147+0000 7f4d19ffc640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cf8078b90 0x7f4cf807b050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000f60 tx=0x7f4d100079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:17.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.151+0000 7f4d0a7fc640 1 -- 172.21.15.81:0/3212314507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4d040632f0 con 0x7f4d140d2010 2024-09-17T05:19:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.361+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d140d2850 con 0x7f4d140d2010 2024-09-17T05:19:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.361+0000 7f4d0a7fc640 1 -- 172.21.15.81:0/3212314507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+5220 (secure 0 0 0) 0x7f4d04062bf0 con 0x7f4d140d2010 2024-09-17T05:19:17.362 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:17.363 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":7,"btime":"2024-09-17T05:18:50:121296+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4335,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2680342608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2680342608},{"type":"v1","addr":"172.21.15.81:6834","nonce":2680342608}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4338,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/427188234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":427188234},{"type":"v1","addr":"172.21.15.81:6835","nonce":427188234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4353,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/2291318880","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":2291318880},{"type":"v1","addr":"172.21.15.160:6837","nonce":2291318880}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":7,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:18:46.468095+0000","modified":"2024-09-17T05:18:49.142842+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4363},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4363":{"gid":4363,"name":"d","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6836/3590527387","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3590527387},{"type":"v1","addr":"172.21.15.160:6836","nonce":3590527387}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4363,"qdb_cluster":[4363]},"id":1}]} 2024-09-17T05:19:17.363 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 7 2024-09-17T05:19:17.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cf8078b90 msgr2=0x7f4cf807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cf8078b90 0x7f4cf807b050 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f4d10000f60 tx=0x7f4d100079b0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d140d2010 msgr2=0x7f4d140b12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d140d2010 0x7f4d140b12d0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f4d0400d770 tx=0x7f4d0400dc30 comp rx=0 tx=0).stop 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 shutdown_connections 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cf8078b90 0x7f4cf807b050 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d14157a70 0x7f4d141f4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d140d2010 0x7f4d140b12d0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 --2- 172.21.15.81:0/3212314507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d140b01a0 0x7f4d14152690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.363+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 >> 172.21.15.81:0/3212314507 conn(0x7f4d1409aa30 msgr2=0x7f4d140b71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.364+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 shutdown_connections 2024-09-17T05:19:17.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.364+0000 7f4d1c260640 1 -- 172.21.15.81:0/3212314507 wait complete. 2024-09-17T05:19:17.375 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.476+0000 7f212533d640 1 -- 172.21.15.81:0/1867892610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f210c004d40 msgr2=0x7f210c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.476+0000 7f212533d640 1 --2- 172.21.15.81:0/1867892610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f210c004d40 0x7f210c0051c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f21200b2350 tx=0x7f210c005830 comp rx=0 tx=0).stop 2024-09-17T05:19:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.476+0000 7f211f7fe640 1 -- 172.21.15.81:0/1867892610 reap_dead start 2024-09-17T05:19:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.476+0000 7f212533d640 1 -- 172.21.15.81:0/1867892610 shutdown_connections 2024-09-17T05:19:17.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.476+0000 7f212533d640 1 -- 172.21.15.81:0/1867892610 >> 172.21.15.81:0/1867892610 conn(0x7f21200b1690 msgr2=0x7f21200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.476+0000 7f212533d640 1 -- 172.21.15.81:0/1867892610 shutdown_connections 2024-09-17T05:19:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.476+0000 7f212533d640 1 -- 172.21.15.81:0/1867892610 wait complete. 2024-09-17T05:19:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.477+0000 7f212533d640 1 Processor -- start 2024-09-17T05:19:17.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.477+0000 7f212533d640 1 -- start start 2024-09-17T05:19:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f212533d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f210c004d40 0x7f212013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f212533d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2120141320 0x7f21201f3150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f212533d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f212015ae70 0x7f212015b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f212533d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21200cf1d0 con 0x7f2120141320 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f212533d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21200ccbf0 con 0x7f210c004d40 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f212533d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f21200cf350 con 0x7f212015ae70 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2120141320 0x7f21201f3150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2120141320 0x7f21201f3150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51412/0 (socket says 172.21.15.81:51412) 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 -- 172.21.15.81:0/1822608727 learned_addr learned my addr 172.21.15.81:0/1822608727 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211effd640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f210c004d40 0x7f212013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211f7fe640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f212015ae70 0x7f212015b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 -- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f212015ae70 msgr2=0x7f212015b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f212015ae70 0x7f212015b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 -- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f210c004d40 msgr2=0x7f212013eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f210c004d40 0x7f212013eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 -- 172.21.15.81:0/1822608727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2120141850 con 0x7f2120141320 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211f7fe640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f212015ae70 0x7f212015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.478+0000 7f211e7fc640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2120141320 0x7f21201f3150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2108006630 tx=0x7f21080039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.479+0000 7f21177fe640 1 -- 172.21.15.81:0/1822608727 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108015070 con 0x7f2120141320 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.479+0000 7f21177fe640 1 -- 172.21.15.81:0/1822608727 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2108011920 con 0x7f2120141320 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.479+0000 7f21177fe640 1 -- 172.21.15.81:0/1822608727 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108011d70 con 0x7f2120141320 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.479+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2120141b30 con 0x7f2120141320 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.479+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21201420f0 con 0x7f2120141320 2024-09-17T05:19:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.480+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f212015f750 con 0x7f2120141320 2024-09-17T05:19:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.480+0000 7f21177fe640 1 -- 172.21.15.81:0/1822608727 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2108010420 con 0x7f2120141320 2024-09-17T05:19:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.481+0000 7f21177fe640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2100078b90 0x7f210007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.481+0000 7f21177fe640 1 -- 172.21.15.81:0/1822608727 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f210809b970 con 0x7f2120141320 2024-09-17T05:19:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.481+0000 7f211effd640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2100078b90 0x7f210007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.481+0000 7f211effd640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2100078b90 0x7f210007b050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21201f5be0 tx=0x7f2110009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:17.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.485+0000 7f21177fe640 1 -- 172.21.15.81:0/1822608727 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2108063800 con 0x7f2120141320 2024-09-17T05:19:17.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.664+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f212015cf40 con 0x7f2120141320 2024-09-17T05:19:17.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.665+0000 7f21177fe640 1 -- 172.21.15.81:0/1822608727 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v23) ==== 74+0+16665 (secure 0 0 0) 0x7f2108068230 con 0x7f2120141320 2024-09-17T05:19:17.666 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:17.666 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:18:48.113992+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:18:44.889840+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-17T05:18:45.422842+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"23","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:17.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2100078b90 msgr2=0x7f210007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2100078b90 0x7f210007b050 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f21201f5be0 tx=0x7f2110009500 comp rx=0 tx=0).stop 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2120141320 msgr2=0x7f21201f3150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2120141320 0x7f21201f3150 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f2108006630 tx=0x7f21080039c0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 shutdown_connections 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2100078b90 0x7f210007b050 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f212015ae70 0x7f212015b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2120141320 0x7f21201f3150 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 --2- 172.21.15.81:0/1822608727 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f210c004d40 0x7f212013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 >> 172.21.15.81:0/1822608727 conn(0x7f21200b1690 msgr2=0x7f212006e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 shutdown_connections 2024-09-17T05:19:17.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.667+0000 7f212533d640 1 -- 172.21.15.81:0/1822608727 wait complete. 2024-09-17T05:19:17.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:19:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 -- 172.21.15.81:0/1997305756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0cfce0 msgr2=0x7f32ec0d00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 --2- 172.21.15.81:0/1997305756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0cfce0 0x7f32ec0d00f0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0ce590 tx=0x7f32e402ab40 comp rx=0 tx=0).stop 2024-09-17T05:19:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 -- 172.21.15.81:0/1997305756 shutdown_connections 2024-09-17T05:19:17.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 --2- 172.21.15.81:0/1997305756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0cfce0 0x7f32ec0d00f0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 --2- 172.21.15.81:0/1997305756 >> v2:172.21.15.160:3300/0 conn(0x7f32ec0b3090 0x7f32ec15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 -- 172.21.15.81:0/1997305756 >> 172.21.15.81:0/1997305756 conn(0x7f32ec09aa30 msgr2=0x7f32ec09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 -- 172.21.15.81:0/1997305756 shutdown_connections 2024-09-17T05:19:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.780+0000 7f32f1d24640 1 -- 172.21.15.81:0/1997305756 wait complete. 2024-09-17T05:19:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.781+0000 7f32f1d24640 1 Processor -- start 2024-09-17T05:19:17.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.781+0000 7f32f1d24640 1 -- start start 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32f1d24640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0b3090 0x7f32ec158f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32f1d24640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32ec0cfce0 0x7f32ec0af8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32f1d24640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32ec0d2410 0x7f32ec0afe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32f1d24640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0b13c0 con 0x7f32ec0b3090 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32f1d24640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32ec0b1240 con 0x7f32ec0d2410 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32f1d24640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f32ec0b1540 con 0x7f32ec0cfce0 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32eb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0b3090 0x7f32ec158f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32eb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0b3090 0x7f32ec158f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51418/0 (socket says 172.21.15.81:51418) 2024-09-17T05:19:17.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32eb7fe640 1 -- 172.21.15.81:0/3711541510 learned_addr learned my addr 172.21.15.81:0/3711541510 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32eaffd640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32ec0cfce0 0x7f32ec0af8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.782+0000 7f32ebfff640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32ec0d2410 0x7f32ec0afe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32eb7fe640 1 -- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32ec0cfce0 msgr2=0x7f32ec0af8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32eb7fe640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32ec0cfce0 0x7f32ec0af8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32eb7fe640 1 -- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32ec0d2410 msgr2=0x7f32ec0afe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32eb7fe640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32ec0d2410 0x7f32ec0afe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32eb7fe640 1 -- 172.21.15.81:0/3711541510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32ec06fc40 con 0x7f32ec0b3090 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32ebfff640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32ec0d2410 0x7f32ec0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32eb7fe640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0b3090 0x7f32ec158f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c3a0 tx=0x7f32dc00c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32d3fff640 1 -- 172.21.15.81:0/3711541510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc017070 con 0x7f32ec0b3090 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32d3fff640 1 -- 172.21.15.81:0/3711541510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32dc0053c0 con 0x7f32ec0b3090 2024-09-17T05:19:17.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32ec1f49a0 con 0x7f32ec0b3090 2024-09-17T05:19:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32d3fff640 1 -- 172.21.15.81:0/3711541510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32dc003850 con 0x7f32ec0b3090 2024-09-17T05:19:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.783+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32ec1f4f60 con 0x7f32ec0b3090 2024-09-17T05:19:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.784+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32ec0b19f0 con 0x7f32ec0b3090 2024-09-17T05:19:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.785+0000 7f32d3fff640 1 -- 172.21.15.81:0/3711541510 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f32dc01a070 con 0x7f32ec0b3090 2024-09-17T05:19:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.785+0000 7f32d3fff640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f32d8078b90 0x7f32d807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.785+0000 7f32d3fff640 1 -- 172.21.15.81:0/3711541510 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 5709+0+0 (secure 0 0 0) 0x7f32dc099fd0 con 0x7f32ec0b3090 2024-09-17T05:19:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.785+0000 7f32eaffd640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f32d8078b90 0x7f32d807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:17.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.786+0000 7f32eaffd640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f32d8078b90 0x7f32d807b050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0b0660 tx=0x7f32e000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:17.790+0000 7f32d3fff640 1 -- 172.21.15.81:0/3711541510 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f32ec15c0e0 con 0x7f32ec0b3090 2024-09-17T05:19:18.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.002+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f32ec0d29a0 con 0x7f32ec0b3090 2024-09-17T05:19:18.004 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:19:18.003+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:19:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.005+0000 7f32d3fff640 1 -- 172.21.15.81:0/3711541510 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v8) ==== 161+0+0 (secure 0 0 0) 0x7f32dc061e50 con 0x7f32ec0b3090 2024-09-17T05:19:18.005 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:19:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f32d8078b90 msgr2=0x7f32d807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:18.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f32d8078b90 0x7f32d807b050 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f32ec0b0660 tx=0x7f32e000b390 comp rx=0 tx=0).stop 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0b3090 msgr2=0x7f32ec158f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0b3090 0x7f32ec158f20 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f32dc00c3a0 tx=0x7f32dc00c860 comp rx=0 tx=0).stop 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 shutdown_connections 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f32d8078b90 0x7f32d807b050 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32ec0d2410 0x7f32ec0afe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32ec0cfce0 0x7f32ec0af8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 --2- 172.21.15.81:0/3711541510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32ec0b3090 0x7f32ec158f20 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 >> 172.21.15.81:0/3711541510 conn(0x7f32ec09aa30 msgr2=0x7f32ec15f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 shutdown_connections 2024-09-17T05:19:18.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.007+0000 7f32f1d24640 1 -- 172.21.15.81:0/3711541510 wait complete. 2024-09-17T05:19:18.011 INFO:tasks.ceph.mds.d.smithi160.stderr: -2069> 2024-09-17T05:18:52.645+0000 7f8fa0fd0640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:19:18.019 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:19:18.040 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:19:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.121+0000 7fded1a71640 1 -- 172.21.15.81:0/1090797183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdeb4004800 msgr2=0x7fdeb4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.121+0000 7fded1a71640 1 --2- 172.21.15.81:0/1090797183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdeb4004800 0x7fdeb4004c80 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fdec0001830 tx=0x7fdeb4005830 comp rx=0 tx=0).stop 2024-09-17T05:19:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.121+0000 7fded1a71640 1 -- 172.21.15.81:0/1090797183 shutdown_connections 2024-09-17T05:19:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.121+0000 7fded1a71640 1 --2- 172.21.15.81:0/1090797183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdeb4004800 0x7fdeb4004c80 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.121+0000 7fded1a71640 1 -- 172.21.15.81:0/1090797183 >> 172.21.15.81:0/1090797183 conn(0x7fdecc074160 msgr2=0x7fdecc074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.121+0000 7fded1a71640 1 -- 172.21.15.81:0/1090797183 shutdown_connections 2024-09-17T05:19:18.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.121+0000 7fded1a71640 1 -- 172.21.15.81:0/1090797183 wait complete. 2024-09-17T05:19:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 Processor -- start 2024-09-17T05:19:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 -- start start 2024-09-17T05:19:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdeb4004800 0x7fdecc0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdecc0ae530 0x7fdecc1f1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdecc0adff0 0x7fdecc15d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc0cd0b0 con 0x7fdecc0ae530 2024-09-17T05:19:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdecc0ccf30 con 0x7fdeb4004800 2024-09-17T05:19:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.123+0000 7fded1a71640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdecc0cb7c0 con 0x7fdecc0adff0 2024-09-17T05:19:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdecc0ae530 0x7fdecc1f1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdecc0ae530 0x7fdecc1f1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51436/0 (socket says 172.21.15.81:51436) 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 -- 172.21.15.81:0/355590402 learned_addr learned my addr 172.21.15.81:0/355590402 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecbfff640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdecc0adff0 0x7fdecc15d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecb7fe640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdeb4004800 0x7fdecc0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 -- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdecc0adff0 msgr2=0x7fdecc15d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdecc0adff0 0x7fdecc15d620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 -- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdeb4004800 msgr2=0x7fdecc0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdeb4004800 0x7fdecc0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 -- 172.21.15.81:0/355590402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdecc1f2650 con 0x7fdecc0ae530 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdecaffd640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdecc0ae530 0x7fdecc1f1eb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdec002aa40 tx=0x7fdec00060e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdeb3fff640 1 -- 172.21.15.81:0/355590402 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec0043070 con 0x7fdecc0ae530 2024-09-17T05:19:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdeb3fff640 1 -- 172.21.15.81:0/355590402 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdec0003af0 con 0x7fdecc0ae530 2024-09-17T05:19:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdecc1f2930 con 0x7fdecc0ae530 2024-09-17T05:19:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fdeb3fff640 1 -- 172.21.15.81:0/355590402 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdec00064c0 con 0x7fdecc0ae530 2024-09-17T05:19:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.124+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdecc1f2ef0 con 0x7fdecc0ae530 2024-09-17T05:19:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.125+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdecc0ce230 con 0x7fdecc0ae530 2024-09-17T05:19:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.126+0000 7fdeb3fff640 1 -- 172.21.15.81:0/355590402 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fdec0046070 con 0x7fdecc0ae530 2024-09-17T05:19:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.127+0000 7fdeb3fff640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdeb8078b90 0x7fdeb807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.127+0000 7fdeb3fff640 1 -- 172.21.15.81:0/355590402 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7fdec00ba8e0 con 0x7fdecc0ae530 2024-09-17T05:19:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.127+0000 7fdecb7fe640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdeb8078b90 0x7fdeb807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.127+0000 7fdecb7fe640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdeb8078b90 0x7fdeb807b050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdebc005fd0 tx=0x7fdebc009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:18.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.131+0000 7fdeb3fff640 1 -- 172.21.15.81:0/355590402 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdec0082790 con 0x7fdecc0ae530 2024-09-17T05:19:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:18.342+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7fdecc0adad0 con 0x7fdecc0ae530 2024-09-17T05:19:19.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.006+0000 7fdeb3fff640 1 -- 172.21.15.81:0/355590402 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v9) ==== 104+0+0 (secure 0 0 0) 0x7fdec00871c0 con 0x7fdecc0ae530 2024-09-17T05:19:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.008+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdeb8078b90 msgr2=0x7fdeb807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.008+0000 7fded1a71640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdeb8078b90 0x7fdeb807b050 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdebc005fd0 tx=0x7fdebc009500 comp rx=0 tx=0).stop 2024-09-17T05:19:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.008+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdecc0ae530 msgr2=0x7fdecc1f1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.008+0000 7fded1a71640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdecc0ae530 0x7fdecc1f1eb0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fdec002aa40 tx=0x7fdec00060e0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 shutdown_connections 2024-09-17T05:19:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdeb8078b90 0x7fdeb807b050 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdecc0adff0 0x7fdecc15d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdecc0ae530 0x7fdecc1f1eb0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 --2- 172.21.15.81:0/355590402 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdeb4004800 0x7fdecc0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 >> 172.21.15.81:0/355590402 conn(0x7fdecc074160 msgr2=0x7fdecc0b1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 shutdown_connections 2024-09-17T05:19:19.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.009+0000 7fded1a71640 1 -- 172.21.15.81:0/355590402 wait complete. 2024-09-17T05:19:19.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 -- 172.21.15.81:0/660987313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c070590 msgr2=0x7efd0c1595d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 --2- 172.21.15.81:0/660987313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c070590 0x7efd0c1595d0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7efd04005fd0 tx=0x7efd0402a820 comp rx=0 tx=0).stop 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 -- 172.21.15.81:0/660987313 shutdown_connections 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 --2- 172.21.15.81:0/660987313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c070590 0x7efd0c1595d0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 --2- 172.21.15.81:0/660987313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd0c158770 0x7efd0c15ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 -- 172.21.15.81:0/660987313 >> 172.21.15.81:0/660987313 conn(0x7efd0c0b1620 msgr2=0x7efd0c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 -- 172.21.15.81:0/660987313 shutdown_connections 2024-09-17T05:19:19.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.126+0000 7efd14272640 1 -- 172.21.15.81:0/660987313 wait complete. 2024-09-17T05:19:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 Processor -- start 2024-09-17T05:19:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 -- start start 2024-09-17T05:19:19.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd0c070590 0x7efd0c1e5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c073190 0x7efd0c1f3270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd0c1f37b0 0x7efd0c0ae9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c15a200 con 0x7efd0c073190 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efd0c15a080 con 0x7efd0c070590 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd14272640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efd0c15a380 con 0x7efd0c1f37b0 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd1180d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c073190 0x7efd0c1f3270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd1180d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c073190 0x7efd0c1f3270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51458/0 (socket says 172.21.15.81:51458) 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.128+0000 7efd1180d640 1 -- 172.21.15.81:0/3877810826 learned_addr learned my addr 172.21.15.81:0/3877810826 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1200e640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd0c070590 0x7efd0c1e5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:19.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1280f640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd0c1f37b0 0x7efd0c0ae9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1180d640 1 -- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd0c1f37b0 msgr2=0x7efd0c0ae9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1180d640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd0c1f37b0 0x7efd0c0ae9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1180d640 1 -- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd0c070590 msgr2=0x7efd0c1e5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1180d640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd0c070590 0x7efd0c1e5990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1180d640 1 -- 172.21.15.81:0/3877810826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd0c1f3da0 con 0x7efd0c073190 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd1180d640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c073190 0x7efd0c1f3270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd0000c4d0 tx=0x7efd0000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efcfeffd640 1 -- 172.21.15.81:0/3877810826 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00016020 con 0x7efd0c073190 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efcfeffd640 1 -- 172.21.15.81:0/3877810826 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efd00012920 con 0x7efd0c073190 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd0c1f4080 con 0x7efd0c073190 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efcfeffd640 1 -- 172.21.15.81:0/3877810826 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd00012d10 con 0x7efd0c073190 2024-09-17T05:19:19.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.129+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd0c142070 con 0x7efd0c073190 2024-09-17T05:19:19.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.130+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd0c1e6790 con 0x7efd0c073190 2024-09-17T05:19:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.131+0000 7efcfeffd640 1 -- 172.21.15.81:0/3877810826 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7efd00019020 con 0x7efd0c073190 2024-09-17T05:19:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.131+0000 7efcfeffd640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efcf0078b90 0x7efcf007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.131+0000 7efcfeffd640 1 -- 172.21.15.81:0/3877810826 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 5795+0+0 (secure 0 0 0) 0x7efd0009abb0 con 0x7efd0c073190 2024-09-17T05:19:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.132+0000 7efd1200e640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efcf0078b90 0x7efcf007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:19.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.132+0000 7efd1200e640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efcf0078b90 0x7efcf007b050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efd0c1553e0 tx=0x7efd08005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:19.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.136+0000 7efcfeffd640 1 -- 172.21.15.81:0/3877810826 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7efd00020020 con 0x7efd0c073190 2024-09-17T05:19:19.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:19.313+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7efd0c1595d0 con 0x7efd0c073190 2024-09-17T05:19:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.011+0000 7efcfeffd640 1 -- 172.21.15.81:0/3877810826 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v25) ==== 181+0+0 (secure 0 0 0) 0x7efd000629d0 con 0x7efd0c073190 2024-09-17T05:19:20.012 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:19:20.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.014+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efcf0078b90 msgr2=0x7efcf007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:20.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.014+0000 7efd14272640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efcf0078b90 0x7efcf007b050 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7efd0c1553e0 tx=0x7efd08005f90 comp rx=0 tx=0).stop 2024-09-17T05:19:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.014+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c073190 msgr2=0x7efd0c1f3270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.014+0000 7efd14272640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c073190 0x7efd0c1f3270 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7efd0000c4d0 tx=0x7efd0000c990 comp rx=0 tx=0).stop 2024-09-17T05:19:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.014+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 shutdown_connections 2024-09-17T05:19:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.014+0000 7efd14272640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efcf0078b90 0x7efcf007b050 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:20.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.015+0000 7efd14272640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efd0c1f37b0 0x7efd0c0ae9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.015+0000 7efd14272640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efd0c073190 0x7efd0c1f3270 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.015+0000 7efd14272640 1 --2- 172.21.15.81:0/3877810826 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efd0c070590 0x7efd0c1e5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.015+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 >> 172.21.15.81:0/3877810826 conn(0x7efd0c0b1620 msgr2=0x7efd0c155530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.015+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 shutdown_connections 2024-09-17T05:19:20.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.015+0000 7efd14272640 1 -- 172.21.15.81:0/3877810826 wait complete. 2024-09-17T05:19:20.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:19:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.141+0000 7f30b47ec640 1 -- 172.21.15.81:0/197651397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 msgr2=0x7f30ac0d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.141+0000 7f30b47ec640 1 --2- 172.21.15.81:0/197651397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac0d4940 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f30a8009830 tx=0x7f30a802a640 comp rx=0 tx=0).stop 2024-09-17T05:19:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.141+0000 7f30b47ec640 1 -- 172.21.15.81:0/197651397 shutdown_connections 2024-09-17T05:19:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.141+0000 7f30b47ec640 1 --2- 172.21.15.81:0/197651397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac0d4940 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.141+0000 7f30b47ec640 1 -- 172.21.15.81:0/197651397 >> 172.21.15.81:0/197651397 conn(0x7f30ac0d3e20 msgr2=0x7f30ac0d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.141+0000 7f30b47ec640 1 -- 172.21.15.81:0/197651397 shutdown_connections 2024-09-17T05:19:20.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.141+0000 7f30b47ec640 1 -- 172.21.15.81:0/197651397 wait complete. 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.142+0000 7f30b47ec640 1 Processor -- start 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b47ec640 1 -- start start 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b47ec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30ac0d25b0 0x7f30ac1f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b47ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac152550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b47ec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30ac1616e0 0x7f30ac14f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b47ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0b7ec0 con 0x7f30ac161300 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b47ec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f30ac0b7d40 con 0x7f30ac1616e0 2024-09-17T05:19:20.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b47ec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f30ac0b8040 con 0x7f30ac0d25b0 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b1d87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac152550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b1d87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac152550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51472/0 (socket says 172.21.15.81:51472) 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.143+0000 7f30b1d87640 1 -- 172.21.15.81:0/2150216935 learned_addr learned my addr 172.21.15.81:0/2150216935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b2588640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30ac0d25b0 0x7f30ac1f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b2d89640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30ac1616e0 0x7f30ac14f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b1d87640 1 -- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30ac0d25b0 msgr2=0x7f30ac1f87c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b1d87640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30ac0d25b0 0x7f30ac1f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b1d87640 1 -- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30ac1616e0 msgr2=0x7f30ac14f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b1d87640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30ac1616e0 0x7f30ac14f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b1d87640 1 -- 172.21.15.81:0/2150216935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30ac1f8d00 con 0x7f30ac161300 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b1d87640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac152550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f30a000c3a0 tx=0x7f30a000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:20.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f309effd640 1 -- 172.21.15.81:0/2150216935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0017070 con 0x7f30ac161300 2024-09-17T05:19:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f309effd640 1 -- 172.21.15.81:0/2150216935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30a00053c0 con 0x7f30ac161300 2024-09-17T05:19:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30ac152fc0 con 0x7f30ac161300 2024-09-17T05:19:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f309effd640 1 -- 172.21.15.81:0/2150216935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30a0003850 con 0x7f30ac161300 2024-09-17T05:19:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.144+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30ac1f7fc0 con 0x7f30ac161300 2024-09-17T05:19:20.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.145+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30ac0b84f0 con 0x7f30ac161300 2024-09-17T05:19:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.146+0000 7f309effd640 1 -- 172.21.15.81:0/2150216935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f30a001a070 con 0x7f30ac161300 2024-09-17T05:19:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.146+0000 7f309effd640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3090078b90 0x7f309007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.146+0000 7f309effd640 1 -- 172.21.15.81:0/2150216935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 5357+0+0 (secure 0 0 0) 0x7f30a0099e20 con 0x7f30ac161300 2024-09-17T05:19:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.146+0000 7f30b2588640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3090078b90 0x7f309007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:20.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.147+0000 7f30b2588640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3090078b90 0x7f309007b050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a8034000 tx=0x7f30a8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:20.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.150+0000 7f309effd640 1 -- 172.21.15.81:0/2150216935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f30a00624e0 con 0x7f30ac161300 2024-09-17T05:19:20.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:20.324+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f30ac0b9290 con 0x7f30ac161300 2024-09-17T05:19:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.015+0000 7f309effd640 1 -- 172.21.15.81:0/2150216935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v26) ==== 169+0+0 (secure 0 0 0) 0x7f30a0061de0 con 0x7f30ac161300 2024-09-17T05:19:21.016 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:19:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3090078b90 msgr2=0x7f309007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3090078b90 0x7f309007b050 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f30a8034000 tx=0x7f30a8004730 comp rx=0 tx=0).stop 2024-09-17T05:19:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 msgr2=0x7f30ac152550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac152550 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f30a000c3a0 tx=0x7f30a000c860 comp rx=0 tx=0).stop 2024-09-17T05:19:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 shutdown_connections 2024-09-17T05:19:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3090078b90 0x7f309007b050 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:21.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30ac1616e0 0x7f30ac14f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30ac161300 0x7f30ac152550 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 --2- 172.21.15.81:0/2150216935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f30ac0d25b0 0x7f30ac1f87c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 >> 172.21.15.81:0/2150216935 conn(0x7f30ac0d3e20 msgr2=0x7f30ac06eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 shutdown_connections 2024-09-17T05:19:21.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.019+0000 7f30b47ec640 1 -- 172.21.15.81:0/2150216935 wait complete. 2024-09-17T05:19:21.034 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:19:21.034 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:19:21.034 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:19:21.034 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:21.034 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:19:21.034 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:19:21.034 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:19:21.035 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:21.035 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:19:21.035 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:19:21.035 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:19:21.035 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:21.035 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:19:21.035 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:19:21.036 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:19:21.036 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:21.044 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:19:21.044 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:19:21.046 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:19:21.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:19:21.047 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:19:21.047 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:19:21.048 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:19:21.049 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:19:21.090 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:19:21.090 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:21.091 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:19:21.091 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:19:21.092 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:21.092 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:21.092 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:19:21.093 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:21.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:19:21.167 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:19:21.167 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:19:21.171 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:19:21.171 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:19:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.199+0000 7fc077c47640 1 -- 172.21.15.81:0/983702522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d49c0 msgr2=0x7fc0700cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.199+0000 7fc077c47640 1 --2- 172.21.15.81:0/983702522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d49c0 0x7fc0700cf9b0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fc0700cf6a0 tx=0x7fc06802a890 comp rx=0 tx=0).stop 2024-09-17T05:19:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.200+0000 7fc077c47640 1 -- 172.21.15.81:0/983702522 shutdown_connections 2024-09-17T05:19:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.200+0000 7fc077c47640 1 --2- 172.21.15.81:0/983702522 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d49c0 0x7fc0700cf9b0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.200+0000 7fc077c47640 1 -- 172.21.15.81:0/983702522 >> 172.21.15.81:0/983702522 conn(0x7fc0700d3ea0 msgr2=0x7fc0700d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.200+0000 7fc077c47640 1 -- 172.21.15.81:0/983702522 shutdown_connections 2024-09-17T05:19:21.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.200+0000 7fc077c47640 1 -- 172.21.15.81:0/983702522 wait complete. 2024-09-17T05:19:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.201+0000 7fc077c47640 1 Processor -- start 2024-09-17T05:19:21.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.201+0000 7fc077c47640 1 -- start start 2024-09-17T05:19:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc077c47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d0d40 0x7fc0700cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc077c47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700d49c0 0x7fc070158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc077c47640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07015df90 0x7fc0700d00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc077c47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0700b3f10 con 0x7fc0700d49c0 2024-09-17T05:19:21.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc077c47640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc070162740 con 0x7fc07015df90 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc077c47640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc0700b4090 con 0x7fc0700d0d40 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700d49c0 0x7fc070158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700d49c0 0x7fc070158aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51512/0 (socket says 172.21.15.81:51512) 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 -- 172.21.15.81:0/3765937368 learned_addr learned my addr 172.21.15.81:0/3765937368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0759e3640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d0d40 0x7fc0700cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0761e4640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07015df90 0x7fc0700d00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 -- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d0d40 msgr2=0x7fc0700cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d0d40 0x7fc0700cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 -- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07015df90 msgr2=0x7fc0700d00a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07015df90 0x7fc0700d00a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:21.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.202+0000 7fc0751e2640 1 -- 172.21.15.81:0/3765937368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0700b7890 con 0x7fc0700d49c0 2024-09-17T05:19:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.203+0000 7fc0751e2640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700d49c0 0x7fc070158aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c500 tx=0x7fc06000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.203+0000 7fc0667fc640 1 -- 172.21.15.81:0/3765937368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060018070 con 0x7fc0700d49c0 2024-09-17T05:19:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.203+0000 7fc0667fc640 1 -- 172.21.15.81:0/3765937368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc0600035f0 con 0x7fc0700d49c0 2024-09-17T05:19:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.203+0000 7fc0667fc640 1 -- 172.21.15.81:0/3765937368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc060003ac0 con 0x7fc0700d49c0 2024-09-17T05:19:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.203+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0700cb390 con 0x7fc0700d49c0 2024-09-17T05:19:21.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.203+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0700cbaf0 con 0x7fc0700d49c0 2024-09-17T05:19:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.205+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0700b7a60 con 0x7fc0700d49c0 2024-09-17T05:19:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.205+0000 7fc0667fc640 1 -- 172.21.15.81:0/3765937368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fc06001b070 con 0x7fc0700d49c0 2024-09-17T05:19:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.206+0000 7fc0667fc640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc054078b90 0x7fc05407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.206+0000 7fc0667fc640 1 -- 172.21.15.81:0/3765937368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 4943+0+0 (secure 0 0 0) 0x7fc060099cf0 con 0x7fc0700d49c0 2024-09-17T05:19:21.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.206+0000 7fc0759e3640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc054078b90 0x7fc05407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:21.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.207+0000 7fc0759e3640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc054078b90 0x7fc05407b050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc06c007d60 tx=0x7fc06c007cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:21.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.210+0000 7fc0667fc640 1 -- 172.21.15.81:0/3765937368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc06009e070 con 0x7fc0700d49c0 2024-09-17T05:19:21.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:21.423+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fc07008d590 con 0x7fc0700d49c0 2024-09-17T05:19:22.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.031+0000 7fc0667fc640 1 -- 172.21.15.81:0/3765937368 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v28) ==== 97+0+0 (secure 0 0 0) 0x7fc060061e80 con 0x7fc0700d49c0 2024-09-17T05:19:22.033 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc054078b90 msgr2=0x7fc05407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc054078b90 0x7fc05407b050 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fc06c007d60 tx=0x7fc06c007cf0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700d49c0 msgr2=0x7fc070158aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700d49c0 0x7fc070158aa0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fc06000c500 tx=0x7fc06000c9c0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 shutdown_connections 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc054078b90 0x7fc05407b050 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc07015df90 0x7fc0700d00a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0700d49c0 0x7fc070158aa0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 --2- 172.21.15.81:0/3765937368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0700d0d40 0x7fc0700cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 >> 172.21.15.81:0/3765937368 conn(0x7fc0700d3ea0 msgr2=0x7fc07006e360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 shutdown_connections 2024-09-17T05:19:22.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.034+0000 7fc077c47640 1 -- 172.21.15.81:0/3765937368 wait complete. 2024-09-17T05:19:22.048 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:19:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.150+0000 7fad0992b640 1 -- 172.21.15.81:0/1150738970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 msgr2=0x7facf0005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.150+0000 7fad0992b640 1 --2- 172.21.15.81:0/1150738970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 0x7facf0005910 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7facec00baf0 tx=0x7facf0006940 comp rx=0 tx=0).stop 2024-09-17T05:19:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.150+0000 7fad037fe640 1 -- 172.21.15.81:0/1150738970 reap_dead start 2024-09-17T05:19:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.150+0000 7fad0992b640 1 -- 172.21.15.81:0/1150738970 shutdown_connections 2024-09-17T05:19:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.150+0000 7fad0992b640 1 -- 172.21.15.81:0/1150738970 >> 172.21.15.81:0/1150738970 conn(0x7fad040b1690 msgr2=0x7fad040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.150+0000 7fad0992b640 1 -- 172.21.15.81:0/1150738970 shutdown_connections 2024-09-17T05:19:22.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.151+0000 7fad0992b640 1 -- 172.21.15.81:0/1150738970 wait complete. 2024-09-17T05:19:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.152+0000 7fad0992b640 1 Processor -- start 2024-09-17T05:19:22.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.152+0000 7fad0992b640 1 -- start start 2024-09-17T05:19:22.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 0x7fad0414b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad04154590 0x7fad04147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041591c0 0x7fad04159640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fad0406e760 con 0x7facf0005190 2024-09-17T05:19:22.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fad0406e5e0 con 0x7fad041591c0 2024-09-17T05:19:22.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fad0406e8e0 con 0x7fad04154590 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 0x7fad0414b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 0x7fad0414b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51536/0 (socket says 172.21.15.81:51536) 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 -- 172.21.15.81:0/2982388313 learned_addr learned my addr 172.21.15.81:0/2982388313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad027fc640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad04154590 0x7fad04147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad037fe640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041591c0 0x7fad04159640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 -- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad04154590 msgr2=0x7fad04147520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad04154590 0x7fad04147520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 -- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041591c0 msgr2=0x7fad04159640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041591c0 0x7fad04159640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 -- 172.21.15.81:0/2982388313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad04154a10 con 0x7facf0005190 2024-09-17T05:19:22.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad027fc640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad04154590 0x7fad04147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad037fe640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041591c0 0x7fad04159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad02ffd640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 0x7fad0414b3e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7facf400e930 tx=0x7facf400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7facfbfff640 1 -- 172.21.15.81:0/2982388313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf4015070 con 0x7facf0005190 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7facfbfff640 1 -- 172.21.15.81:0/2982388313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facf400ce00 con 0x7facf0005190 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7facfbfff640 1 -- 172.21.15.81:0/2982388313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facf40116c0 con 0x7facf0005190 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad04147a60 con 0x7facf0005190 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.153+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad0414bd50 con 0x7facf0005190 2024-09-17T05:19:22.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.154+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad04159b80 con 0x7facf0005190 2024-09-17T05:19:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.155+0000 7facfbfff640 1 -- 172.21.15.81:0/2982388313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7facf4018070 con 0x7facf0005190 2024-09-17T05:19:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.156+0000 7facfbfff640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7face4078bc0 0x7face407b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.156+0000 7facfbfff640 1 -- 172.21.15.81:0/2982388313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7facf409b1f0 con 0x7facf0005190 2024-09-17T05:19:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.156+0000 7fad027fc640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7face4078bc0 0x7face407b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.156+0000 7fad027fc640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7face4078bc0 0x7face407b080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7facec036000 tx=0x7facec035040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:22.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.160+0000 7facfbfff640 1 -- 172.21.15.81:0/2982388313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fad04154a10 con 0x7facf0005190 2024-09-17T05:19:22.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.410+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7fad040cf340 con 0x7facf0005190 2024-09-17T05:19:22.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.410+0000 7facfbfff640 1 -- 172.21.15.81:0/2982388313 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v8) ==== 80+0+6645 (secure 0 0 0) 0x7facf4063a10 con 0x7facf0005190 2024-09-17T05:19:22.411 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:22.411 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:19:22.411 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:19:22.411 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:19:22.412 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.413 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:22.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:19:22.416 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.417 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.418 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:19:22.419 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:22.420 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.421 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.422 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:19:22.423 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.424 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mds", 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAfEelmVHcyABAApZLEK4+/ZSHSrMiyg92nrw==", 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mds" 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-mgr", 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAfEelmq38yABAA7NFmibTzdEZlNR5kibWWyQ==", 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-mgr" 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-osd", 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAfEelmGoYyABAAZRdBEKq6wcZKvNq4QgRuzg==", 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.426 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-osd" 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd", 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAfEelm3IwyABAAMH+AroPI+KMgpyGL6fGSuA==", 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd" 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rbd-mirror", 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAfEelmlJMyABAAnsPWFeWMFoEfHrb3iaL61g==", 2024-09-17T05:19:22.427 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.bootstrap-rgw", 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAfEelmqpoyABAAlu6XnUUOeBLPxWf1/Pyk+g==", 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile bootstrap-rgw" 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.428 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:19:22.429 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:19:22.430 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:22.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.430 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:22.430 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:19:22.430 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:19:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7face4078bc0 msgr2=0x7face407b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7face4078bc0 0x7face407b080 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7facec036000 tx=0x7facec035040 comp rx=0 tx=0).stop 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 msgr2=0x7fad0414b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 0x7fad0414b3e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7facf400e930 tx=0x7facf400edf0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 shutdown_connections 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7face4078bc0 0x7face407b080 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fad041591c0 0x7fad04159640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fad04154590 0x7fad04147520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 --2- 172.21.15.81:0/2982388313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7facf0005190 0x7fad0414b3e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 >> 172.21.15.81:0/2982388313 conn(0x7fad040b1690 msgr2=0x7fad040cde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 shutdown_connections 2024-09-17T05:19:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.413+0000 7fad0992b640 1 -- 172.21.15.81:0/2982388313 wait complete. 2024-09-17T05:19:22.433 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2024-09-17T05:19:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 -- 172.21.15.81:0/396487921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c0d28d0 msgr2=0x7f9f3c0d0b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 --2- 172.21.15.81:0/396487921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c0d28d0 0x7f9f3c0d0b30 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c08c4c0 tx=0x7f9f3402a560 comp rx=0 tx=0).stop 2024-09-17T05:19:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 -- 172.21.15.81:0/396487921 shutdown_connections 2024-09-17T05:19:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 --2- 172.21.15.81:0/396487921 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c0d28d0 0x7f9f3c0d0b30 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 --2- 172.21.15.81:0/396487921 >> v2:172.21.15.160:3300/0 conn(0x7f9f3c0d4960 0x7f9f3c0d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 --2- 172.21.15.81:0/396487921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f3c15df30 0x7f9f3c0cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 -- 172.21.15.81:0/396487921 >> 172.21.15.81:0/396487921 conn(0x7f9f3c0d3e40 msgr2=0x7f9f3c0d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 -- 172.21.15.81:0/396487921 shutdown_connections 2024-09-17T05:19:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.534+0000 7f9f416dd640 1 -- 172.21.15.81:0/396487921 wait complete. 2024-09-17T05:19:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.535+0000 7f9f416dd640 1 Processor -- start 2024-09-17T05:19:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.535+0000 7f9f416dd640 1 -- start start 2024-09-17T05:19:22.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f416dd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f3c0d28d0 0x7f9f3c0cbf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f416dd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f3c0d4960 0x7f9f3c1f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f416dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c15df30 0x7f9f3c1f8480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f416dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c0b6df0 con 0x7f9f3c15df30 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f416dd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9f3c0b6c70 con 0x7f9f3c0d4960 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f416dd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9f3c0b6f70 con 0x7f9f3c0d28d0 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c15df30 0x7f9f3c1f8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c15df30 0x7f9f3c1f8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51554/0 (socket says 172.21.15.81:51554) 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 -- 172.21.15.81:0/1680262591 learned_addr learned my addr 172.21.15.81:0/1680262591 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3affd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f3c0d28d0 0x7f9f3c0cbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3a7fc640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f3c0d4960 0x7f9f3c1f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 -- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f3c0d28d0 msgr2=0x7f9f3c0cbf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f3c0d28d0 0x7f9f3c0cbf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 -- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f3c0d4960 msgr2=0x7f9f3c1f7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f3c0d4960 0x7f9f3c1f7f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3b7fe640 1 -- 172.21.15.81:0/1680262591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f3c1f8da0 con 0x7f9f3c15df30 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.536+0000 7f9f3a7fc640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f3c0d4960 0x7f9f3c1f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.537+0000 7f9f3b7fe640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c15df30 0x7f9f3c1f8480 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009230 tx=0x7f9f34003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.537+0000 7f9f337fe640 1 -- 172.21.15.81:0/1680262591 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f3403f070 con 0x7f9f3c15df30 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.537+0000 7f9f337fe640 1 -- 172.21.15.81:0/1680262591 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f340047a0 con 0x7f9f3c15df30 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.537+0000 7f9f337fe640 1 -- 172.21.15.81:0/1680262591 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f34035030 con 0x7f9f3c15df30 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.537+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f3c156080 con 0x7f9f3c15df30 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.537+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f3c157d20 con 0x7f9f3c15df30 2024-09-17T05:19:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.538+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f3c0cf9e0 con 0x7f9f3c15df30 2024-09-17T05:19:22.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.538+0000 7f9f337fe640 1 -- 172.21.15.81:0/1680262591 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9f34042070 con 0x7f9f3c15df30 2024-09-17T05:19:22.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.539+0000 7f9f337fe640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9f1c078b90 0x7f9f1c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.539+0000 7f9f337fe640 1 -- 172.21.15.81:0/1680262591 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f9f340bb780 con 0x7f9f3c15df30 2024-09-17T05:19:22.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.539+0000 7f9f3affd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9f1c078b90 0x7f9f1c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.540+0000 7f9f3affd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9f1c078b90 0x7f9f1c07b050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0b5390 tx=0x7f9f2c0095e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:22.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.543+0000 7f9f337fe640 1 -- 172.21.15.81:0/1680262591 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9f3c1f8da0 con 0x7f9f3c15df30 2024-09-17T05:19:22.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.790+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) -- 0x7f9f3c0d13f0 con 0x7f9f3c15df30 2024-09-17T05:19:22.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.792+0000 7f9f337fe640 1 -- 172.21.15.81:0/1680262591 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v9) ==== 90+0+0 (secure 0 0 0) 0x7f9f340838d0 con 0x7f9f3c15df30 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9f1c078b90 msgr2=0x7f9f1c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9f1c078b90 0x7f9f1c07b050 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f3c0b5390 tx=0x7f9f2c0095e0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c15df30 msgr2=0x7f9f3c1f8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c15df30 0x7f9f3c1f8480 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9f34009230 tx=0x7f9f34003960 comp rx=0 tx=0).stop 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 shutdown_connections 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9f1c078b90 0x7f9f1c07b050 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f3c15df30 0x7f9f3c1f8480 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9f3c0d4960 0x7f9f3c1f7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.794+0000 7f9f416dd640 1 --2- 172.21.15.81:0/1680262591 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9f3c0d28d0 0x7f9f3c0cbf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.795+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 >> 172.21.15.81:0/1680262591 conn(0x7f9f3c0d3e40 msgr2=0x7f9f3c159140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.795+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 shutdown_connections 2024-09-17T05:19:22.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.795+0000 7f9f416dd640 1 -- 172.21.15.81:0/1680262591 wait complete. 2024-09-17T05:19:22.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2024-09-17T05:19:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 -- 172.21.15.81:0/3094884961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c074310 msgr2=0x7f931c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 --2- 172.21.15.81:0/3094884961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c074310 0x7f931c06e920 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f931c0cfe20 tx=0x7f931402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 -- 172.21.15.81:0/3094884961 shutdown_connections 2024-09-17T05:19:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 --2- 172.21.15.81:0/3094884961 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c074310 0x7f931c06e920 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 --2- 172.21.15.81:0/3094884961 >> v2:172.21.15.160:3300/0 conn(0x7f931c0cdaa0 0x7f931c073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 -- 172.21.15.81:0/3094884961 >> 172.21.15.81:0/3094884961 conn(0x7f931c0b19c0 msgr2=0x7f931c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:22.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 -- 172.21.15.81:0/3094884961 shutdown_connections 2024-09-17T05:19:22.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.907+0000 7f932358a640 1 -- 172.21.15.81:0/3094884961 wait complete. 2024-09-17T05:19:22.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.908+0000 7f932358a640 1 Processor -- start 2024-09-17T05:19:22.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.908+0000 7f932358a640 1 -- start start 2024-09-17T05:19:22.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f932358a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f931c074310 0x7f931c0c2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f932358a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c0cdaa0 0x7f931c0c2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f932358a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c15f3d0 0x7f931c1f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f932358a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f931c073360 con 0x7f931c15f3d0 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f932358a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f931c15f9c0 con 0x7f931c0cdaa0 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f932358a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f931c06ee60 con 0x7f931c074310 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c15f3d0 0x7f931c1f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c15f3d0 0x7f931c1f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51568/0 (socket says 172.21.15.81:51568) 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 -- 172.21.15.81:0/1768947975 learned_addr learned my addr 172.21.15.81:0/1768947975 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9320b25640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c0cdaa0 0x7f931c0c2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321326640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f931c074310 0x7f931c0c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 -- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f931c074310 msgr2=0x7f931c0c2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f931c074310 0x7f931c0c2710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 -- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c0cdaa0 msgr2=0x7f931c0c2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c0cdaa0 0x7f931c0c2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 -- 172.21.15.81:0/1768947975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f931c15a3c0 con 0x7f931c15f3d0 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9320b25640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c0cdaa0 0x7f931c0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9321b27640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c15f3d0 0x7f931c1f84b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9314009ca0 tx=0x7f9314003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9311ffb640 1 -- 172.21.15.81:0/1768947975 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314040070 con 0x7f931c15f3d0 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9311ffb640 1 -- 172.21.15.81:0/1768947975 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9314004330 con 0x7f931c15f3d0 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f931c1e6ad0 con 0x7f931c15f3d0 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.909+0000 7f9311ffb640 1 -- 172.21.15.81:0/1768947975 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9314004700 con 0x7f931c15f3d0 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.910+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f931c15a660 con 0x7f931c15f3d0 2024-09-17T05:19:22.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.911+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f931c06e920 con 0x7f931c15f3d0 2024-09-17T05:19:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.911+0000 7f9311ffb640 1 -- 172.21.15.81:0/1768947975 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9314039040 con 0x7f931c15f3d0 2024-09-17T05:19:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.912+0000 7f9311ffb640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9300078b90 0x7f930007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.912+0000 7f9311ffb640 1 -- 172.21.15.81:0/1768947975 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f93140bc0e0 con 0x7f931c15f3d0 2024-09-17T05:19:22.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.912+0000 7f9321326640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9300078b90 0x7f930007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:22.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.912+0000 7f9321326640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9300078b90 0x7f930007b050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9318007fd0 tx=0x7f9318009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:22.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:22.916+0000 7f9311ffb640 1 -- 172.21.15.81:0/1768947975 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9314084990 con 0x7f931c15f3d0 2024-09-17T05:19:23.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.162+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) -- 0x7f931c1e81f0 con 0x7f931c15f3d0 2024-09-17T05:19:23.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.164+0000 7f9311ffb640 1 -- 172.21.15.81:0/1768947975 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v10) ==== 90+0+0 (secure 0 0 0) 0x7f9314084290 con 0x7f931c15f3d0 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9300078b90 msgr2=0x7f930007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9300078b90 0x7f930007b050 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9318007fd0 tx=0x7f9318009040 comp rx=0 tx=0).stop 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c15f3d0 msgr2=0x7f931c1f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c15f3d0 0x7f931c1f84b0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9314009ca0 tx=0x7f9314003ba0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 shutdown_connections 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9300078b90 0x7f930007b050 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f931c15f3d0 0x7f931c1f84b0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f931c0cdaa0 0x7f931c0c2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 --2- 172.21.15.81:0/1768947975 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f931c074310 0x7f931c0c2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 >> 172.21.15.81:0/1768947975 conn(0x7f931c0b19c0 msgr2=0x7f931c1e8710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:23.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 shutdown_connections 2024-09-17T05:19:23.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.166+0000 7f932358a640 1 -- 172.21.15.81:0/1768947975 wait complete. 2024-09-17T05:19:23.177 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2024-09-17T05:19:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 -- 172.21.15.81:0/1596858101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 msgr2=0x7f5c04072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/1596858101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04072a10 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f5c04069dc0 tx=0x7f5bfc02b910 comp rx=0 tx=0).stop 2024-09-17T05:19:23.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 -- 172.21.15.81:0/1596858101 shutdown_connections 2024-09-17T05:19:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/1596858101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04072a10 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/1596858101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c040b3140 0x7f5c040cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/1596858101 >> v2:172.21.15.160:3300/0 conn(0x7f5c04151370 0x7f5c040cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 -- 172.21.15.81:0/1596858101 >> 172.21.15.81:0/1596858101 conn(0x7f5c040b1690 msgr2=0x7f5c040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 -- 172.21.15.81:0/1596858101 shutdown_connections 2024-09-17T05:19:23.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.278+0000 7f5c0b50e640 1 -- 172.21.15.81:0/1596858101 wait complete. 2024-09-17T05:19:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.279+0000 7f5c0b50e640 1 Processor -- start 2024-09-17T05:19:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.279+0000 7f5c0b50e640 1 -- start start 2024-09-17T05:19:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c0b50e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04135c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c0b50e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c040b3140 0x7f5c0406fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c0b50e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c04151370 0x7f5c040701f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c0b50e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0406ea80 con 0x7f5c040725a0 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c0b50e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0406e900 con 0x7f5c04151370 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c0b50e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5c0406ec00 con 0x7f5c040b3140 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04135c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04135c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53020/0 (socket says 172.21.15.81:53020) 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 -- 172.21.15.81:0/274507042 learned_addr learned my addr 172.21.15.81:0/274507042 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c09aab640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c04151370 0x7f5c040701f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c08aa9640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c040b3140 0x7f5c0406fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 -- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c040b3140 msgr2=0x7f5c0406fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c040b3140 0x7f5c0406fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 -- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c04151370 msgr2=0x7f5c040701f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c04151370 0x7f5c040701f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 -- 172.21.15.81:0/274507042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c041e35f0 con 0x7f5c040725a0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c092aa640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04135c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000d740 tx=0x7f5c0000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5bf9ffb640 1 -- 172.21.15.81:0/274507042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00017070 con 0x7f5c040725a0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5bf9ffb640 1 -- 172.21.15.81:0/274507042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5c00009d20 con 0x7f5c040725a0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5bf9ffb640 1 -- 172.21.15.81:0/274507042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c000106c0 con 0x7f5c040725a0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.280+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c04138190 con 0x7f5c040725a0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.281+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c04138750 con 0x7f5c040725a0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.282+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c04072a10 con 0x7f5c040725a0 2024-09-17T05:19:23.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.282+0000 7f5bf9ffb640 1 -- 172.21.15.81:0/274507042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f5c0001a070 con 0x7f5c040725a0 2024-09-17T05:19:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.283+0000 7f5bf9ffb640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5be8078b90 0x7f5be807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.283+0000 7f5bf9ffb640 1 -- 172.21.15.81:0/274507042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f5c0009aaa0 con 0x7f5c040725a0 2024-09-17T05:19:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.283+0000 7f5c08aa9640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5be8078b90 0x7f5be807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.284+0000 7f5c08aa9640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5be8078b90 0x7f5be807b050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c0415a3b0 tx=0x7f5bf4005e50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:23.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.287+0000 7f5bf9ffb640 1 -- 172.21.15.81:0/274507042 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5c00063350 con 0x7f5c040725a0 2024-09-17T05:19:23.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.528+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) -- 0x7f5c0415add0 con 0x7f5c040725a0 2024-09-17T05:19:23.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.532+0000 7f5bf9ffb640 1 -- 172.21.15.81:0/274507042 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v11) ==== 90+0+0 (secure 0 0 0) 0x7f5c00062c50 con 0x7f5c040725a0 2024-09-17T05:19:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5be8078b90 msgr2=0x7f5be807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5be8078b90 0x7f5be807b050 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f5c0415a3b0 tx=0x7f5bf4005e50 comp rx=0 tx=0).stop 2024-09-17T05:19:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 msgr2=0x7f5c04135c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04135c20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5c0000d740 tx=0x7f5c0000dc00 comp rx=0 tx=0).stop 2024-09-17T05:19:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 shutdown_connections 2024-09-17T05:19:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5be8078b90 0x7f5be807b050 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5c04151370 0x7f5c040701f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5c040b3140 0x7f5c0406fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 --2- 172.21.15.81:0/274507042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5c040725a0 0x7f5c04135c20 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 >> 172.21.15.81:0/274507042 conn(0x7f5c040b1690 msgr2=0x7f5c040b3650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 shutdown_connections 2024-09-17T05:19:23.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.535+0000 7f5c0b50e640 1 -- 172.21.15.81:0/274507042 wait complete. 2024-09-17T05:19:23.546 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2024-09-17T05:19:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.649+0000 7fba3c3bc640 1 -- 172.21.15.81:0/3105921861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 msgr2=0x7fba20003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.649+0000 7fba3c3bc640 1 --2- 172.21.15.81:0/3105921861 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 0x7fba20003de0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fba300043e0 tx=0x7fba20005830 comp rx=0 tx=0).stop 2024-09-17T05:19:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.649+0000 7fba3a959640 1 -- 172.21.15.81:0/3105921861 reap_dead start 2024-09-17T05:19:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.649+0000 7fba3c3bc640 1 -- 172.21.15.81:0/3105921861 shutdown_connections 2024-09-17T05:19:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.649+0000 7fba3c3bc640 1 -- 172.21.15.81:0/3105921861 >> 172.21.15.81:0/3105921861 conn(0x7fba340741f0 msgr2=0x7fba34074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.649+0000 7fba3c3bc640 1 -- 172.21.15.81:0/3105921861 shutdown_connections 2024-09-17T05:19:23.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.649+0000 7fba3c3bc640 1 -- 172.21.15.81:0/3105921861 wait complete. 2024-09-17T05:19:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.650+0000 7fba3c3bc640 1 Processor -- start 2024-09-17T05:19:23.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.650+0000 7fba3c3bc640 1 -- start start 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3c3bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 0x7fba3409d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3c3bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba3409d710 0x7fba340b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3c3bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba341f5330 0x7fba340b19e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3c3bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba340cbd00 con 0x7fba200039e0 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3c3bc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba340cbb80 con 0x7fba3409d710 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3c3bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fba340cbe80 con 0x7fba341f5330 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 0x7fba3409d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 0x7fba3409d1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53034/0 (socket says 172.21.15.81:53034) 2024-09-17T05:19:23.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 -- 172.21.15.81:0/1942896613 learned_addr learned my addr 172.21.15.81:0/1942896613 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a959640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba341f5330 0x7fba340b19e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba39957640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba3409d710 0x7fba340b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 -- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba341f5330 msgr2=0x7fba340b19e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba341f5330 0x7fba340b19e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 -- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba3409d710 msgr2=0x7fba340b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba3409d710 0x7fba340b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 -- 172.21.15.81:0/1942896613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba341f88f0 con 0x7fba200039e0 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.651+0000 7fba3a158640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 0x7fba3409d1d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fba3002abf0 tx=0x7fba30004af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.652+0000 7fba2affd640 1 -- 172.21.15.81:0/1942896613 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30037040 con 0x7fba200039e0 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.652+0000 7fba2affd640 1 -- 172.21.15.81:0/1942896613 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba30041070 con 0x7fba200039e0 2024-09-17T05:19:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.652+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba341f4850 con 0x7fba200039e0 2024-09-17T05:19:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.652+0000 7fba2affd640 1 -- 172.21.15.81:0/1942896613 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba30006540 con 0x7fba200039e0 2024-09-17T05:19:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.652+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba341f7ca0 con 0x7fba200039e0 2024-09-17T05:19:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.653+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba340b4cf0 con 0x7fba200039e0 2024-09-17T05:19:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.653+0000 7fba2affd640 1 -- 172.21.15.81:0/1942896613 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fba300066e0 con 0x7fba200039e0 2024-09-17T05:19:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.654+0000 7fba2affd640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba18078bc0 0x7fba1807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.654+0000 7fba2affd640 1 -- 172.21.15.81:0/1942896613 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7fba300ba850 con 0x7fba200039e0 2024-09-17T05:19:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.654+0000 7fba39957640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba18078bc0 0x7fba1807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:23.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.655+0000 7fba39957640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba18078bc0 0x7fba1807b080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fba24001860 tx=0x7fba24001ba0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.658+0000 7fba2affd640 1 -- 172.21.15.81:0/1942896613 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fba3002ae20 con 0x7fba200039e0 2024-09-17T05:19:23.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.900+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) -- 0x7fba340cc3e0 con 0x7fba200039e0 2024-09-17T05:19:23.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.904+0000 7fba2affd640 1 -- 172.21.15.81:0/1942896613 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v12) ==== 90+0+0 (secure 0 0 0) 0x7fba30083100 con 0x7fba200039e0 2024-09-17T05:19:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba18078bc0 msgr2=0x7fba1807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba18078bc0 0x7fba1807b080 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fba24001860 tx=0x7fba24001ba0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 msgr2=0x7fba3409d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 0x7fba3409d1d0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7fba3002abf0 tx=0x7fba30004af0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 shutdown_connections 2024-09-17T05:19:23.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba18078bc0 0x7fba1807b080 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba341f5330 0x7fba340b19e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba3409d710 0x7fba340b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 --2- 172.21.15.81:0/1942896613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba200039e0 0x7fba3409d1d0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 >> 172.21.15.81:0/1942896613 conn(0x7fba340741f0 msgr2=0x7fba340c9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 shutdown_connections 2024-09-17T05:19:23.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:23.907+0000 7fba3c3bc640 1 -- 172.21.15.81:0/1942896613 wait complete. 2024-09-17T05:19:23.918 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.019+0000 7f6d7c307640 1 -- 172.21.15.81:0/3110177076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d74162480 msgr2=0x7f6d740d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.019+0000 7f6d7c307640 1 --2- 172.21.15.81:0/3110177076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d74162480 0x7f6d740d0b70 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6d7406d080 tx=0x7f6d6c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.020+0000 7f6d7c307640 1 -- 172.21.15.81:0/3110177076 shutdown_connections 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.020+0000 7f6d7c307640 1 --2- 172.21.15.81:0/3110177076 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d74162480 0x7f6d740d0b70 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.020+0000 7f6d7c307640 1 --2- 172.21.15.81:0/3110177076 >> v2:172.21.15.160:3300/0 conn(0x7f6d740d49c0 0x7f6d740d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.020+0000 7f6d7c307640 1 --2- 172.21.15.81:0/3110177076 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d7415df90 0x7f6d740cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.020+0000 7f6d7c307640 1 -- 172.21.15.81:0/3110177076 >> 172.21.15.81:0/3110177076 conn(0x7f6d740d3ea0 msgr2=0x7f6d740d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.020+0000 7f6d7c307640 1 -- 172.21.15.81:0/3110177076 shutdown_connections 2024-09-17T05:19:24.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.020+0000 7f6d7c307640 1 -- 172.21.15.81:0/3110177076 wait complete. 2024-09-17T05:19:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.021+0000 7f6d7c307640 1 Processor -- start 2024-09-17T05:19:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.021+0000 7f6d7c307640 1 -- start start 2024-09-17T05:19:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d740d49c0 0x7f6d741f76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d7415df90 0x7f6d740b2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d74162480 0x7f6d740cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740b3b90 con 0x7f6d740d49c0 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6d740b3a10 con 0x7f6d74162480 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6d740b3d10 con 0x7f6d7415df90 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d740d49c0 0x7f6d741f76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d740d49c0 0x7f6d741f76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53040/0 (socket says 172.21.15.81:53040) 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 -- 172.21.15.81:0/1962386909 learned_addr learned my addr 172.21.15.81:0/1962386909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a8a4640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d74162480 0x7f6d740cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d798a2640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d7415df90 0x7f6d740b2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 -- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d7415df90 msgr2=0x7f6d740b2540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d7415df90 0x7f6d740b2540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 -- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d74162480 msgr2=0x7f6d740cd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d74162480 0x7f6d740cd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 -- 172.21.15.81:0/1962386909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d741f7c30 con 0x7f6d740d49c0 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7a0a3640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d740d49c0 0x7f6d741f76f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000d770 tx=0x7f6d7000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d6affd640 1 -- 172.21.15.81:0/1962386909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70017070 con 0x7f6d740d49c0 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d6affd640 1 -- 172.21.15.81:0/1962386909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d70009d20 con 0x7f6d740d49c0 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d741f4cc0 con 0x7f6d740d49c0 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d6affd640 1 -- 172.21.15.81:0/1962386909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d70005280 con 0x7f6d740d49c0 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.022+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d741f5280 con 0x7f6d740d49c0 2024-09-17T05:19:24.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.023+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d7406ef60 con 0x7f6d740d49c0 2024-09-17T05:19:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.024+0000 7f6d6affd640 1 -- 172.21.15.81:0/1962386909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f6d70005420 con 0x7f6d740d49c0 2024-09-17T05:19:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.024+0000 7f6d6affd640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6d58078b90 0x7f6d5807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.025+0000 7f6d6affd640 1 -- 172.21.15.81:0/1962386909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f6d7009a980 con 0x7f6d740d49c0 2024-09-17T05:19:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.025+0000 7f6d798a2640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6d58078b90 0x7f6d5807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.025+0000 7f6d798a2640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6d58078b90 0x7f6d5807b050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d740b92b0 tx=0x7f6d6400b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:24.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.029+0000 7f6d6affd640 1 -- 172.21.15.81:0/1962386909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6d7406ef60 con 0x7f6d740d49c0 2024-09-17T05:19:24.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.273+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) -- 0x7f6d740cf9b0 con 0x7f6d740d49c0 2024-09-17T05:19:24.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.275+0000 7f6d6affd640 1 -- 172.21.15.81:0/1962386909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v13) ==== 97+0+0 (secure 0 0 0) 0x7f6d70062be0 con 0x7f6d740d49c0 2024-09-17T05:19:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6d58078b90 msgr2=0x7f6d5807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6d58078b90 0x7f6d5807b050 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f6d740b92b0 tx=0x7f6d6400b390 comp rx=0 tx=0).stop 2024-09-17T05:19:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d740d49c0 msgr2=0x7f6d741f76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d740d49c0 0x7f6d741f76f0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6d7000d770 tx=0x7f6d7000dc30 comp rx=0 tx=0).stop 2024-09-17T05:19:24.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 shutdown_connections 2024-09-17T05:19:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6d58078b90 0x7f6d5807b050 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d74162480 0x7f6d740cd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d7415df90 0x7f6d740b2540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 --2- 172.21.15.81:0/1962386909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d740d49c0 0x7f6d741f76f0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 >> 172.21.15.81:0/1962386909 conn(0x7f6d740d3ea0 msgr2=0x7f6d7406e850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 shutdown_connections 2024-09-17T05:19:24.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.278+0000 7f6d7c307640 1 -- 172.21.15.81:0/1962386909 wait complete. 2024-09-17T05:19:24.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2024-09-17T05:19:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.389+0000 7f87712cd640 1 -- 172.21.15.81:0/1418243356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 msgr2=0x7f876c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.389+0000 7f87712cd640 1 --2- 172.21.15.81:0/1418243356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c0cf9b0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f876c0b9f50 tx=0x7f876402a870 comp rx=0 tx=0).stop 2024-09-17T05:19:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.389+0000 7f87712cd640 1 -- 172.21.15.81:0/1418243356 shutdown_connections 2024-09-17T05:19:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.389+0000 7f87712cd640 1 --2- 172.21.15.81:0/1418243356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c0cf9b0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.389+0000 7f87712cd640 1 -- 172.21.15.81:0/1418243356 >> 172.21.15.81:0/1418243356 conn(0x7f876c0d3ea0 msgr2=0x7f876c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.390+0000 7f87712cd640 1 -- 172.21.15.81:0/1418243356 shutdown_connections 2024-09-17T05:19:24.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.390+0000 7f87712cd640 1 -- 172.21.15.81:0/1418243356 wait complete. 2024-09-17T05:19:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.391+0000 7f87712cd640 1 Processor -- start 2024-09-17T05:19:24.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.391+0000 7f87712cd640 1 -- start start 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f876c0d0d40 0x7f876c15cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c15fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f876c15df90 0x7f876c0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f876c162690 con 0x7f876c0d49c0 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f876c0b3f10 con 0x7f876c0d0d40 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f876c0cbc80 con 0x7f876c15df90 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c15fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c15fb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53062/0 (socket says 172.21.15.81:53062) 2024-09-17T05:19:24.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 -- 172.21.15.81:0/3017841579 learned_addr learned my addr 172.21.15.81:0/3017841579 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876affd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f876c0d0d40 0x7f876c15cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876b7fe640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f876c15df90 0x7f876c0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 -- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f876c15df90 msgr2=0x7f876c0cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f876c15df90 0x7f876c0cda90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 -- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f876c0d0d40 msgr2=0x7f876c15cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f876c0d0d40 0x7f876c15cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 -- 172.21.15.81:0/3017841579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f876c0cbed0 con 0x7f876c0d49c0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f876a7fc640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c15fb80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f876000c450 tx=0x7f876000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87537fe640 1 -- 172.21.15.81:0/3017841579 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760016020 con 0x7f876c0d49c0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87537fe640 1 -- 172.21.15.81:0/3017841579 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8760012920 con 0x7f876c0d49c0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f876c0cc1b0 con 0x7f876c0d49c0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87537fe640 1 -- 172.21.15.81:0/3017841579 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8760012d70 con 0x7f876c0d49c0 2024-09-17T05:19:24.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.392+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f876c15d4c0 con 0x7f876c0d49c0 2024-09-17T05:19:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.393+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f876c0b4450 con 0x7f876c0d49c0 2024-09-17T05:19:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.394+0000 7f87537fe640 1 -- 172.21.15.81:0/3017841579 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8760019020 con 0x7f876c0d49c0 2024-09-17T05:19:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.394+0000 7f87537fe640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8758078bc0 0x7f875807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.395+0000 7f87537fe640 1 -- 172.21.15.81:0/3017841579 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f876009a930 con 0x7f876c0d49c0 2024-09-17T05:19:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.395+0000 7f876affd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8758078bc0 0x7f875807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.395+0000 7f876affd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8758078bc0 0x7f875807b080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f875c006fd0 tx=0x7f875c008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:24.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.399+0000 7f87537fe640 1 -- 172.21.15.81:0/3017841579 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8760020020 con 0x7f876c0d49c0 2024-09-17T05:19:24.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.643+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) -- 0x7f876c162260 con 0x7f876c0d49c0 2024-09-17T05:19:24.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.645+0000 7f87537fe640 1 -- 172.21.15.81:0/3017841579 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v14) ==== 90+0+0 (secure 0 0 0) 0x7f876c0ce970 con 0x7f876c0d49c0 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8758078bc0 msgr2=0x7f875807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8758078bc0 0x7f875807b080 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f875c006fd0 tx=0x7f875c008040 comp rx=0 tx=0).stop 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 msgr2=0x7f876c15fb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c15fb80 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f876000c450 tx=0x7f876000c910 comp rx=0 tx=0).stop 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 shutdown_connections 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8758078bc0 0x7f875807b080 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f876c15df90 0x7f876c0cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f876c0d49c0 0x7f876c15fb80 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 --2- 172.21.15.81:0/3017841579 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f876c0d0d40 0x7f876c15cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 >> 172.21.15.81:0/3017841579 conn(0x7f876c0d3ea0 msgr2=0x7f876c0b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:24.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 shutdown_connections 2024-09-17T05:19:24.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.647+0000 7f87712cd640 1 -- 172.21.15.81:0/3017841579 wait complete. 2024-09-17T05:19:24.659 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:19:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 -- 172.21.15.81:0/2466888646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357006ff80 msgr2=0x7f3570070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 --2- 172.21.15.81:0/2466888646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357006ff80 0x7f3570070410 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f3568009830 tx=0x7f356802a480 comp rx=0 tx=0).stop 2024-09-17T05:19:24.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 -- 172.21.15.81:0/2466888646 shutdown_connections 2024-09-17T05:19:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 --2- 172.21.15.81:0/2466888646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f357006ff80 0x7f3570070410 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 --2- 172.21.15.81:0/2466888646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f35700735a0 0x7f35700739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 -- 172.21.15.81:0/2466888646 >> 172.21.15.81:0/2466888646 conn(0x7f35700b1690 msgr2=0x7f35700b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 -- 172.21.15.81:0/2466888646 shutdown_connections 2024-09-17T05:19:24.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.759+0000 7f35773a0640 1 -- 172.21.15.81:0/2466888646 wait complete. 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.760+0000 7f35773a0640 1 Processor -- start 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.760+0000 7f35773a0640 1 -- start start 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f35773a0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f357006ff80 0x7f357013de10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f35773a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35700735a0 0x7f357013fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f35773a0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f357015aa70 0x7f357013e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f35773a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f35700cd270 con 0x7f35700735a0 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f35773a0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f35700cd0f0 con 0x7f357015aa70 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f35773a0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f35700cd3f0 con 0x7f357006ff80 2024-09-17T05:19:24.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35700735a0 0x7f357013fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35700735a0 0x7f357013fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53076/0 (socket says 172.21.15.81:53076) 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 -- 172.21.15.81:0/4060595254 learned_addr learned my addr 172.21.15.81:0/4060595254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357513c640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f357006ff80 0x7f357013de10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357593d640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f357015aa70 0x7f357013e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 -- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f357006ff80 msgr2=0x7f357013de10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f357006ff80 0x7f357013de10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 -- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f357015aa70 msgr2=0x7f357013e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f357015aa70 0x7f357013e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357493b640 1 -- 172.21.15.81:0/4060595254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35701402e0 con 0x7f35700735a0 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.761+0000 7f357513c640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f357006ff80 0x7f357013de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.762+0000 7f357493b640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35700735a0 0x7f357013fda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f356400d950 tx=0x7f356400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.762+0000 7f356dffb640 1 -- 172.21.15.81:0/4060595254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3564017070 con 0x7f35700735a0 2024-09-17T05:19:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.762+0000 7f356dffb640 1 -- 172.21.15.81:0/4060595254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3564009d20 con 0x7f35700735a0 2024-09-17T05:19:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.762+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357013ed00 con 0x7f35700735a0 2024-09-17T05:19:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.762+0000 7f356dffb640 1 -- 172.21.15.81:0/4060595254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35640106c0 con 0x7f35700735a0 2024-09-17T05:19:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.762+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357013f2c0 con 0x7f35700735a0 2024-09-17T05:19:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.763+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35700b1a70 con 0x7f35700735a0 2024-09-17T05:19:24.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.763+0000 7f356dffb640 1 -- 172.21.15.81:0/4060595254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f3564010860 con 0x7f35700735a0 2024-09-17T05:19:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.764+0000 7f356dffb640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f355c078b90 0x7f355c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.764+0000 7f356dffb640 1 -- 172.21.15.81:0/4060595254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f356409ad20 con 0x7f35700735a0 2024-09-17T05:19:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.764+0000 7f357513c640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f355c078b90 0x7f355c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:24.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.764+0000 7f357513c640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f355c078b90 0x7f355c07b050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3560007fd0 tx=0x7f3560009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:24.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.768+0000 7f356dffb640 1 -- 172.21.15.81:0/4060595254 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f35700b1a70 con 0x7f35700735a0 2024-09-17T05:19:24.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.945+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f35700cea90 con 0x7f35700735a0 2024-09-17T05:19:24.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.945+0000 7f356dffb640 1 -- 172.21.15.81:0/4060595254 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v30) ==== 84+0+65 (secure 0 0 0) 0x7f35640635d0 con 0x7f35700735a0 2024-09-17T05:19:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:24.947 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:19:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:19:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:19:24.947 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:24.947 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f355c078b90 msgr2=0x7f355c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f355c078b90 0x7f355c07b050 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3560007fd0 tx=0x7f3560009040 comp rx=0 tx=0).stop 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35700735a0 msgr2=0x7f357013fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35700735a0 0x7f357013fda0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f356400d950 tx=0x7f356400de10 comp rx=0 tx=0).stop 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 shutdown_connections 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f355c078b90 0x7f355c07b050 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f357015aa70 0x7f357013e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f35700735a0 0x7f357013fda0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 --2- 172.21.15.81:0/4060595254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f357006ff80 0x7f357013de10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:24.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.947+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 >> 172.21.15.81:0/4060595254 conn(0x7f35700b1690 msgr2=0x7f3570075820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.948+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 shutdown_connections 2024-09-17T05:19:24.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:24.948+0000 7f35773a0640 1 -- 172.21.15.81:0/4060595254 wait complete. 2024-09-17T05:19:24.959 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:19:24.959 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:19:25.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.064+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/2981071515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a00005210 msgr2=0x7f4a0000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.064+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/2981071515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a00005210 0x7f4a0000b9c0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f4a0c005fd0 tx=0x7f4a00005830 comp rx=0 tx=0).stop 2024-09-17T05:19:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.064+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/2981071515 shutdown_connections 2024-09-17T05:19:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.064+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/2981071515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a00005210 0x7f4a0000b9c0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.064+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/2981071515 >> 172.21.15.81:0/2981071515 conn(0x7f4a140b1620 msgr2=0x7f4a140b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.064+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/2981071515 shutdown_connections 2024-09-17T05:19:25.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.064+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/2981071515 wait complete. 2024-09-17T05:19:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 Processor -- start 2024-09-17T05:19:25.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 -- start start 2024-09-17T05:19:25.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a00005210 0x7f4a1415b300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a14156a80 0x7f4a14144e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a141592e0 0x7f4a14159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4a141564a0 con 0x7f4a14156a80 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4a14156320 con 0x7f4a141592e0 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1b9c2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4a14070160 con 0x7f4a00005210 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a18f5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a14156a80 0x7f4a14144e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a18f5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a14156a80 0x7f4a14144e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53094/0 (socket says 172.21.15.81:53094) 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a18f5d640 1 -- 172.21.15.81:0/1048671399 learned_addr learned my addr 172.21.15.81:0/1048671399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.066+0000 7f4a1975e640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a00005210 0x7f4a1415b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a19f5f640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a141592e0 0x7f4a14159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a18f5d640 1 -- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a00005210 msgr2=0x7f4a1415b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:25.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a18f5d640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a00005210 0x7f4a1415b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a18f5d640 1 -- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a141592e0 msgr2=0x7f4a14159770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a18f5d640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a141592e0 0x7f4a14159770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a18f5d640 1 -- 172.21.15.81:0/1048671399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a1415b9a0 con 0x7f4a14156a80 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a18f5d640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a14156a80 0x7f4a14144e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4a04001860 tx=0x7f4a040039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a09ffb640 1 -- 172.21.15.81:0/1048671399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04015070 con 0x7f4a14156a80 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a09ffb640 1 -- 172.21.15.81:0/1048671399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4a04011840 con 0x7f4a14156a80 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a140ad150 con 0x7f4a14156a80 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a09ffb640 1 -- 172.21.15.81:0/1048671399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4a04011c70 con 0x7f4a14156a80 2024-09-17T05:19:25.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.067+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a140ad710 con 0x7f4a14156a80 2024-09-17T05:19:25.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.068+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a1415f9e0 con 0x7f4a14156a80 2024-09-17T05:19:25.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.069+0000 7f4a09ffb640 1 -- 172.21.15.81:0/1048671399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4a04018070 con 0x7f4a14156a80 2024-09-17T05:19:25.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.069+0000 7f4a09ffb640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f49f8078b90 0x7f49f807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:25.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.070+0000 7f4a09ffb640 1 -- 172.21.15.81:0/1048671399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(30..30 src has 1..30) ==== 4857+0+0 (secure 0 0 0) 0x7f4a0409b5f0 con 0x7f4a14156a80 2024-09-17T05:19:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.070+0000 7f4a1975e640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f49f8078b90 0x7f49f807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:25.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.070+0000 7f4a1975e640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f49f8078b90 0x7f49f807b050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a100012b0 tx=0x7f4a10006b10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:25.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.074+0000 7f4a09ffb640 1 -- 172.21.15.81:0/1048671399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4a040637d0 con 0x7f4a14156a80 2024-09-17T05:19:25.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:25.248+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f4a140ad8e0 con 0x7f4a14156a80 2024-09-17T05:19:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.171+0000 7f4a09ffb640 1 -- 172.21.15.81:0/1048671399 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v31) ==== 138+0+0 (secure 0 0 0) 0x7f4a04068200 con 0x7f4a14156a80 2024-09-17T05:19:26.172 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:19:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f49f8078b90 msgr2=0x7f49f807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f49f8078b90 0x7f49f807b050 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f4a100012b0 tx=0x7f4a10006b10 comp rx=0 tx=0).stop 2024-09-17T05:19:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a14156a80 msgr2=0x7f4a14144e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a14156a80 0x7f4a14144e30 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f4a04001860 tx=0x7f4a040039c0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 shutdown_connections 2024-09-17T05:19:26.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f49f8078b90 0x7f49f807b050 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4a141592e0 0x7f4a14159770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4a14156a80 0x7f4a14144e30 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 --2- 172.21.15.81:0/1048671399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4a00005210 0x7f4a1415b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 >> 172.21.15.81:0/1048671399 conn(0x7f4a140b1620 msgr2=0x7f4a140af830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:26.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 shutdown_connections 2024-09-17T05:19:26.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.174+0000 7f4a1b9c2640 1 -- 172.21.15.81:0/1048671399 wait complete. 2024-09-17T05:19:26.192 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 -- 172.21.15.81:0/2233144973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 msgr2=0x7fab7c0b2a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 --2- 172.21.15.81:0/2233144973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 0x7fab7c0b2a00 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fab78009830 tx=0x7fab7802a510 comp rx=0 tx=0).stop 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 -- 172.21.15.81:0/2233144973 shutdown_connections 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 --2- 172.21.15.81:0/2233144973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab7c0ce2a0 0x7fab7c0cede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 --2- 172.21.15.81:0/2233144973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 0x7fab7c0b2a00 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 -- 172.21.15.81:0/2233144973 >> 172.21.15.81:0/2233144973 conn(0x7fab7c0b1700 msgr2=0x7fab7c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 -- 172.21.15.81:0/2233144973 shutdown_connections 2024-09-17T05:19:26.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.303+0000 7fab84233640 1 -- 172.21.15.81:0/2233144973 wait complete. 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 Processor -- start 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 -- start start 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab7c0b2f40 0x7fab7c0c6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab7c0ce2a0 0x7fab7c0cba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 0x7fab7c0b3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c06fde0 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fab7c06fc60 con 0x7fab7c15bab0 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab84233640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fab7c06ff60 con 0x7fab7c0b2f40 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab817ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab7c0ce2a0 0x7fab7c0cba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab817ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab7c0ce2a0 0x7fab7c0cba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53100/0 (socket says 172.21.15.81:53100) 2024-09-17T05:19:26.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab817ce640 1 -- 172.21.15.81:0/1175407786 learned_addr learned my addr 172.21.15.81:0/1175407786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab81fcf640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab7c0b2f40 0x7fab7c0c6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.305+0000 7fab827d0640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 0x7fab7c0b3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab817ce640 1 -- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab7c0b2f40 msgr2=0x7fab7c0c6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab817ce640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab7c0b2f40 0x7fab7c0c6e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab817ce640 1 -- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 msgr2=0x7fab7c0b3b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab817ce640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 0x7fab7c0b3b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab817ce640 1 -- 172.21.15.81:0/1175407786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab7c1f7f30 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab817ce640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab7c0ce2a0 0x7fab7c0cba70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c430 tx=0x7fab6c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab727fc640 1 -- 172.21.15.81:0/1175407786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011790 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab7c0c9850 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab727fc640 1 -- 172.21.15.81:0/1175407786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fab6c017070 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab727fc640 1 -- 172.21.15.81:0/1175407786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab6c011cc0 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.306+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab7c0c9e10 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.307+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab7c070480 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.308+0000 7fab727fc640 1 -- 172.21.15.81:0/1175407786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fab6c01c460 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.308+0000 7fab727fc640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fab60078b90 0x7fab6007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.308+0000 7fab727fc640 1 -- 172.21.15.81:0/1175407786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 5227+0+0 (secure 0 0 0) 0x7fab6c09a720 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.308+0000 7fab81fcf640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fab60078b90 0x7fab6007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:26.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.309+0000 7fab81fcf640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fab60078b90 0x7fab6007b050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab78034000 tx=0x7fab78004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:26.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.313+0000 7fab727fc640 1 -- 172.21.15.81:0/1175407786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fab6c062de0 con 0x7fab7c0ce2a0 2024-09-17T05:19:26.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:26.489+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fab7c0b4dc0 con 0x7fab7c0ce2a0 2024-09-17T05:19:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.173+0000 7fab727fc640 1 -- 172.21.15.81:0/1175407786 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v32) ==== 170+0+0 (secure 0 0 0) 0x7fab6c0626e0 con 0x7fab7c0ce2a0 2024-09-17T05:19:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:19:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fab60078b90 msgr2=0x7fab6007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fab60078b90 0x7fab6007b050 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fab78034000 tx=0x7fab78004730 comp rx=0 tx=0).stop 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab7c0ce2a0 msgr2=0x7fab7c0cba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab7c0ce2a0 0x7fab7c0cba70 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fab6c00c430 tx=0x7fab6c00c830 comp rx=0 tx=0).stop 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 shutdown_connections 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fab60078b90 0x7fab6007b050 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fab7c15bab0 0x7fab7c0b3b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fab7c0ce2a0 0x7fab7c0cba70 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 --2- 172.21.15.81:0/1175407786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fab7c0b2f40 0x7fab7c0c6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.176+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 >> 172.21.15.81:0/1175407786 conn(0x7fab7c0b1700 msgr2=0x7fab7c0cc410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:27.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.177+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 shutdown_connections 2024-09-17T05:19:27.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.177+0000 7fab84233640 1 -- 172.21.15.81:0/1175407786 wait complete. 2024-09-17T05:19:27.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:19:27.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 -- 172.21.15.81:0/3270870505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000b1810 msgr2=0x7f9d000cd280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:27.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 --2- 172.21.15.81:0/3270870505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000b1810 0x7f9d000cd280 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f9d000761d0 tx=0x7f9cf402a980 comp rx=0 tx=0).stop 2024-09-17T05:19:27.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 -- 172.21.15.81:0/3270870505 shutdown_connections 2024-09-17T05:19:27.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 --2- 172.21.15.81:0/3270870505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d000cd7c0 0x7f9d0015df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 --2- 172.21.15.81:0/3270870505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000b1810 0x7f9d000cd280 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 --2- 172.21.15.81:0/3270870505 >> v2:172.21.15.160:3300/0 conn(0x7f9d0015af60 0x7f9d000ccd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 -- 172.21.15.81:0/3270870505 >> 172.21.15.81:0/3270870505 conn(0x7f9d00074160 msgr2=0x7f9d00074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:27.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 -- 172.21.15.81:0/3270870505 shutdown_connections 2024-09-17T05:19:27.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.303+0000 7f9d06d52640 1 -- 172.21.15.81:0/3270870505 wait complete. 2024-09-17T05:19:27.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.304+0000 7f9d06d52640 1 Processor -- start 2024-09-17T05:19:27.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.304+0000 7f9d06d52640 1 -- start start 2024-09-17T05:19:27.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d06d52640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d000b1810 0x7f9d001581d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:27.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d06d52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000cd7c0 0x7f9d000c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d06d52640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d0015af60 0x7f9d000af280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d06d52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0015e490 con 0x7f9d000cd7c0 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d06d52640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9d0015e610 con 0x7f9d0015af60 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d06d52640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9d0015e790 con 0x7f9d000b1810 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000cd7c0 0x7f9d000c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000cd7c0 0x7f9d000c3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53116/0 (socket says 172.21.15.81:53116) 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 -- 172.21.15.81:0/976409733 learned_addr learned my addr 172.21.15.81:0/976409733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:27.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d04aee640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d000b1810 0x7f9d001581d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 -- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d000b1810 msgr2=0x7f9d001581d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d000b1810 0x7f9d001581d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d052ef640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d0015af60 0x7f9d000af280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 -- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d0015af60 msgr2=0x7f9d000af280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d0015af60 0x7f9d000af280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 -- 172.21.15.81:0/976409733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d000ad170 con 0x7f9d000cd7c0 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfffff640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000cd7c0 0x7f9d000c3e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009d60 tx=0x7f9cf4003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfd7fa640 1 -- 172.21.15.81:0/976409733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4034050 con 0x7f9d000cd7c0 2024-09-17T05:19:27.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfd7fa640 1 -- 172.21.15.81:0/976409733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9cf40045d0 con 0x7f9d000cd7c0 2024-09-17T05:19:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9cfd7fa640 1 -- 172.21.15.81:0/976409733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9cf4043440 con 0x7f9d000cd7c0 2024-09-17T05:19:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.305+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d000b2590 con 0x7f9d000cd7c0 2024-09-17T05:19:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.306+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d000b2850 con 0x7f9d000cd7c0 2024-09-17T05:19:27.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.307+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d0015ed20 con 0x7f9d000cd7c0 2024-09-17T05:19:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.307+0000 7f9cfd7fa640 1 -- 172.21.15.81:0/976409733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9cf4037020 con 0x7f9d000cd7c0 2024-09-17T05:19:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.308+0000 7f9cfd7fa640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9cec078bc0 0x7f9cec07b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.308+0000 7f9cfd7fa640 1 -- 172.21.15.81:0/976409733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(32..32 src has 1..32) ==== 5609+0+0 (secure 0 0 0) 0x7f9cf40bc250 con 0x7f9d000cd7c0 2024-09-17T05:19:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.308+0000 7f9d04aee640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9cec078bc0 0x7f9cec07b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:27.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.309+0000 7f9d04aee640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9cec078bc0 0x7f9cec07b080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000a770 tx=0x7f9cf0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:27.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.312+0000 7f9cfd7fa640 1 -- 172.21.15.81:0/976409733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9cf40846e0 con 0x7f9d000cd7c0 2024-09-17T05:19:27.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:27.524+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9d00068a70 con 0x7f9d000cd7c0 2024-09-17T05:19:28.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.196+0000 7f9cfd7fa640 1 -- 172.21.15.81:0/976409733 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v12) ==== 172+0+0 (secure 0 0 0) 0x7f9cf4083fe0 con 0x7f9d000cd7c0 2024-09-17T05:19:28.199 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 4 and data pool 5 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.207+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9cec078bc0 msgr2=0x7f9cec07b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.207+0000 7f9d06d52640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9cec078bc0 0x7f9cec07b080 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000a770 tx=0x7f9cf0008040 comp rx=0 tx=0).stop 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.207+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000cd7c0 msgr2=0x7f9d000c3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.207+0000 7f9d06d52640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000cd7c0 0x7f9d000c3e60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4009d60 tx=0x7f9cf4003f70 comp rx=0 tx=0).stop 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.208+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 shutdown_connections 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.208+0000 7f9d06d52640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9cec078bc0 0x7f9cec07b080 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.209+0000 7f9d06d52640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9d0015af60 0x7f9d000af280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.209+0000 7f9d06d52640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9d000cd7c0 0x7f9d000c3e60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.209+0000 7f9d06d52640 1 --2- 172.21.15.81:0/976409733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9d000b1810 0x7f9d001581d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.209+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 >> 172.21.15.81:0/976409733 conn(0x7f9d00074160 msgr2=0x7f9d000706f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:28.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.209+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 shutdown_connections 2024-09-17T05:19:28.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.210+0000 7f9d06d52640 1 -- 172.21.15.81:0/976409733 wait complete. 2024-09-17T05:19:28.230 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:28.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 -- 172.21.15.81:0/2578504704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 msgr2=0x7ff30c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 --2- 172.21.15.81:0/2578504704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 0x7ff30c072ae0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7ff304005fd0 tx=0x7ff30402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 -- 172.21.15.81:0/2578504704 shutdown_connections 2024-09-17T05:19:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 --2- 172.21.15.81:0/2578504704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 0x7ff30c072ae0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 --2- 172.21.15.81:0/2578504704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff30c0cf640 0x7ff30c0725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 -- 172.21.15.81:0/2578504704 >> 172.21.15.81:0/2578504704 conn(0x7ff30c0b1690 msgr2=0x7ff30c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 -- 172.21.15.81:0/2578504704 shutdown_connections 2024-09-17T05:19:28.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.334+0000 7ff311da3640 1 -- 172.21.15.81:0/2578504704 wait complete. 2024-09-17T05:19:28.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.335+0000 7ff311da3640 1 Processor -- start 2024-09-17T05:19:28.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.336+0000 7ff311da3640 1 -- start start 2024-09-17T05:19:28.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.336+0000 7ff311da3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 0x7ff30c1404e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.336+0000 7ff311da3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0cf640 0x7ff30c14c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.336+0000 7ff311da3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff30c151370 0x7ff30c13e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.336+0000 7ff311da3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c06ec10 con 0x7ff30c0cf640 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.336+0000 7ff311da3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff30c06ea90 con 0x7ff30c0b3140 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.336+0000 7ff311da3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff30c06f9f0 con 0x7ff30c151370 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0cf640 0x7ff30c14c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff30c151370 0x7ff30c13e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0cf640 0x7ff30c14c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53118/0 (socket says 172.21.15.81:53118) 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30b7fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 0x7ff30c1404e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30affd640 1 -- 172.21.15.81:0/4032147165 learned_addr learned my addr 172.21.15.81:0/4032147165 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30bfff640 1 -- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 msgr2=0x7ff30c1404e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30bfff640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 0x7ff30c1404e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30bfff640 1 -- 172.21.15.81:0/4032147165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0cf640 msgr2=0x7ff30c14c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30bfff640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0cf640 0x7ff30c14c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30bfff640 1 -- 172.21.15.81:0/4032147165 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30c140a20 con 0x7ff30c151370 2024-09-17T05:19:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30affd640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0cf640 0x7ff30c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:19:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff30bfff640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff30c151370 0x7ff30c13e300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff304031000 tx=0x7ff304005760 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff2f3fff640 1 -- 172.21.15.81:0/4032147165 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff30403f070 con 0x7ff30c151370 2024-09-17T05:19:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff2f3fff640 1 -- 172.21.15.81:0/4032147165 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff304003c70 con 0x7ff30c151370 2024-09-17T05:19:28.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30c14cf50 con 0x7ff30c151370 2024-09-17T05:19:28.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff2f3fff640 1 -- 172.21.15.81:0/4032147165 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff304035030 con 0x7ff30c151370 2024-09-17T05:19:28.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.337+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7ff30c13fa00 con 0x7ff30c151370 2024-09-17T05:19:28.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.338+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff30c1401d0 con 0x7ff30c151370 2024-09-17T05:19:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.339+0000 7ff2f3fff640 1 -- 172.21.15.81:0/4032147165 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ff304042070 con 0x7ff30c151370 2024-09-17T05:19:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.340+0000 7ff2f3fff640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2f8078b90 0x7ff2f807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.340+0000 7ff2f3fff640 1 -- 172.21.15.81:0/4032147165 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7ff3040bbe60 con 0x7ff30c151370 2024-09-17T05:19:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.340+0000 7ff30b7fe640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2f8078b90 0x7ff2f807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.340+0000 7ff30b7fe640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2f8078b90 0x7ff2f807b050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc001e20 tx=0x7ff2fc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:28.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.344+0000 7ff2f3fff640 1 -- 172.21.15.81:0/4032147165 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff304003e20 con 0x7ff30c151370 2024-09-17T05:19:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.520+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff30c0b3b10 con 0x7ff30c151370 2024-09-17T05:19:28.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.522+0000 7ff2f3fff640 1 -- 172.21.15.81:0/4032147165 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16742 (secure 0 0 0) 0x7ff304083d90 con 0x7ff30c151370 2024-09-17T05:19:28.523 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:28.523 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:27.525755+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:25.252883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:26.493997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2f8078b90 msgr2=0x7ff2f807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2f8078b90 0x7ff2f807b050 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7ff2fc001e20 tx=0x7ff2fc009040 comp rx=0 tx=0).stop 2024-09-17T05:19:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff30c151370 msgr2=0x7ff30c13e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff30c151370 0x7ff30c13e300 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7ff304031000 tx=0x7ff304005760 comp rx=0 tx=0).stop 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 shutdown_connections 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2f8078b90 0x7ff2f807b050 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff30c151370 0x7ff30c13e300 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff30c0cf640 0x7ff30c14c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 --2- 172.21.15.81:0/4032147165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff30c0b3140 0x7ff30c1404e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 >> 172.21.15.81:0/4032147165 conn(0x7ff30c0b1690 msgr2=0x7ff30c0b4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 shutdown_connections 2024-09-17T05:19:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.524+0000 7ff311da3640 1 -- 172.21.15.81:0/4032147165 wait complete. 2024-09-17T05:19:28.536 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 -- 172.21.15.81:0/3319468656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 msgr2=0x7f8394068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 --2- 172.21.15.81:0/3319468656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394068ac0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f83940cdbd0 tx=0x7f839002a560 comp rx=0 tx=0).stop 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 -- 172.21.15.81:0/3319468656 shutdown_connections 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 --2- 172.21.15.81:0/3319468656 >> v2:172.21.15.160:3300/0 conn(0x7f83940cc4c0 0x7f839415c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 --2- 172.21.15.81:0/3319468656 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394068ac0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 -- 172.21.15.81:0/3319468656 >> 172.21.15.81:0/3319468656 conn(0x7f83940741f0 msgr2=0x7f8394074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 -- 172.21.15.81:0/3319468656 shutdown_connections 2024-09-17T05:19:28.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.636+0000 7f839c008640 1 -- 172.21.15.81:0/3319468656 wait complete. 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.637+0000 7f839c008640 1 Processor -- start 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.637+0000 7f839c008640 1 -- start start 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f839c008640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83940cc4c0 0x7f83940c7bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f839c008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394156680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f839c008640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83940d0b60 0x7f83940b1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f839c008640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f839415c9a0 con 0x7f83940cd760 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f839c008640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f839415cb20 con 0x7f83940cc4c0 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f839c008640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f839415cca0 con 0x7f83940d0b60 2024-09-17T05:19:28.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f83995a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394156680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f83995a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394156680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53126/0 (socket says 172.21.15.81:53126) 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f83995a3640 1 -- 172.21.15.81:0/2814862791 learned_addr learned my addr 172.21.15.81:0/2814862791 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f839a5a5640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83940d0b60 0x7f83940b1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.638+0000 7f8399da4640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83940cc4c0 0x7f83940c7bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83995a3640 1 -- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83940d0b60 msgr2=0x7f83940b1910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83995a3640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83940d0b60 0x7f83940b1910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83995a3640 1 -- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83940cc4c0 msgr2=0x7f83940c7bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83995a3640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83940cc4c0 0x7f83940c7bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83995a3640 1 -- 172.21.15.81:0/2814862791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83940b27d0 con 0x7f83940cd760 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83995a3640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394156680 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8390000c00 tx=0x7f8390003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:28.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83867fc640 1 -- 172.21.15.81:0/2814862791 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f839003f070 con 0x7f83940cd760 2024-09-17T05:19:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83867fc640 1 -- 172.21.15.81:0/2814862791 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83900047a0 con 0x7f83940cd760 2024-09-17T05:19:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83940b3d90 con 0x7f83940cd760 2024-09-17T05:19:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f83867fc640 1 -- 172.21.15.81:0/2814862791 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8390035030 con 0x7f83940cd760 2024-09-17T05:19:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.639+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83940d0000 con 0x7f83940cd760 2024-09-17T05:19:28.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.640+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83940b3b80 con 0x7f83940cd760 2024-09-17T05:19:28.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.641+0000 7f83867fc640 1 -- 172.21.15.81:0/2814862791 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8390042070 con 0x7f83940cd760 2024-09-17T05:19:28.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.641+0000 7f83867fc640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8378078bc0 0x7f837807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.641+0000 7f83867fc640 1 -- 172.21.15.81:0/2814862791 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f83900bb9b0 con 0x7f83940cd760 2024-09-17T05:19:28.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.641+0000 7f8399da4640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8378078bc0 0x7f837807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.642+0000 7f8399da4640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8378078bc0 0x7f837807b080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f83941f6c20 tx=0x7f8388009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:28.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.645+0000 7f83867fc640 1 -- 172.21.15.81:0/2814862791 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8390083830 con 0x7f83940cd760 2024-09-17T05:19:28.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.820+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f839415e2d0 con 0x7f83940cd760 2024-09-17T05:19:28.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.822+0000 7f83867fc640 1 -- 172.21.15.81:0/2814862791 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) ==== 74+0+16742 (secure 0 0 0) 0x7f8390088260 con 0x7f83940cd760 2024-09-17T05:19:28.823 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:28.823 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":33,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:27.525755+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:25.252883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:26.493997+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8378078bc0 msgr2=0x7f837807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8378078bc0 0x7f837807b080 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f83941f6c20 tx=0x7f8388009040 comp rx=0 tx=0).stop 2024-09-17T05:19:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 msgr2=0x7f8394156680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394156680 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8390000c00 tx=0x7f8390003820 comp rx=0 tx=0).stop 2024-09-17T05:19:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 shutdown_connections 2024-09-17T05:19:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8378078bc0 0x7f837807b080 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83940d0b60 0x7f83940b1910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83940cd760 0x7f8394156680 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 --2- 172.21.15.81:0/2814862791 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83940cc4c0 0x7f83940c7bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 >> 172.21.15.81:0/2814862791 conn(0x7f83940741f0 msgr2=0x7f839415c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 shutdown_connections 2024-09-17T05:19:28.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.824+0000 7f839c008640 1 -- 172.21.15.81:0/2814862791 wait complete. 2024-09-17T05:19:28.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:19:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.939+0000 7f68076d6640 1 -- 172.21.15.81:0/2152835898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e8003a30 msgr2=0x7f67e8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.939+0000 7f68076d6640 1 --2- 172.21.15.81:0/2152835898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67e8003a30 0x7f67e8003e50 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f67f000c610 tx=0x7f67e8005830 comp rx=0 tx=0).stop 2024-09-17T05:19:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.939+0000 7f6805c73640 1 -- 172.21.15.81:0/2152835898 reap_dead start 2024-09-17T05:19:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.939+0000 7f68076d6640 1 -- 172.21.15.81:0/2152835898 shutdown_connections 2024-09-17T05:19:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.939+0000 7f68076d6640 1 -- 172.21.15.81:0/2152835898 >> 172.21.15.81:0/2152835898 conn(0x7f680009aa30 msgr2=0x7f680009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.940+0000 7f68076d6640 1 -- 172.21.15.81:0/2152835898 shutdown_connections 2024-09-17T05:19:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.940+0000 7f68076d6640 1 -- 172.21.15.81:0/2152835898 wait complete. 2024-09-17T05:19:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 Processor -- start 2024-09-17T05:19:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 -- start start 2024-09-17T05:19:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67e8003a30 0x7f68000c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68001f4a00 0x7f68000c6250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001609e0 0x7f68000c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68000cfe10 con 0x7f68001609e0 2024-09-17T05:19:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f68000cfc90 con 0x7f68001f4a00 2024-09-17T05:19:28.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.941+0000 7f68076d6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f68000cff90 con 0x7f67e8003a30 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001609e0 0x7f68000c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001609e0 0x7f68000c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53150/0 (socket says 172.21.15.81:53150) 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 -- 172.21.15.81:0/1117690507 learned_addr learned my addr 172.21.15.81:0/1117690507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805472640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67e8003a30 0x7f68000c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6804c71640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68001f4a00 0x7f68000c6250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 -- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67e8003a30 msgr2=0x7f68000c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67e8003a30 0x7f68000c9320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 -- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68001f4a00 msgr2=0x7f68000c6250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68001f4a00 0x7f68000c6250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 -- 172.21.15.81:0/1117690507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68001f52c0 con 0x7f68001609e0 2024-09-17T05:19:28.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6804c71640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68001f4a00 0x7f68000c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f6805c73640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001609e0 0x7f68000c7f80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68000d2a10 tx=0x7f67f800faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f67fdffb640 1 -- 172.21.15.81:0/1117690507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8005220 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f67fdffb640 1 -- 172.21.15.81:0/1117690507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67f80054b0 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68001f55a0 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f67fdffb640 1 -- 172.21.15.81:0/1117690507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67f8004a00 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.942+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68000c5d30 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.943+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f680006dc00 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.944+0000 7f67fdffb640 1 -- 172.21.15.81:0/1117690507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f67f8019030 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.944+0000 7f67fdffb640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67ec078b90 0x7f67ec07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.944+0000 7f67fdffb640 1 -- 172.21.15.81:0/1117690507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(33..33 src has 1..33) ==== 5709+0+0 (secure 0 0 0) 0x7f67f809af70 con 0x7f68001609e0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.945+0000 7f6805472640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67ec078b90 0x7f67ec07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:28.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.945+0000 7f6805472640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67ec078b90 0x7f67ec07b050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67f0033000 tx=0x7f68000d0380 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:28.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:28.948+0000 7f67fdffb640 1 -- 172.21.15.81:0/1117690507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f67f8062e00 con 0x7f68001609e0 2024-09-17T05:19:29.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.160+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f68000c5f00 con 0x7f68001609e0 2024-09-17T05:19:29.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.201+0000 7f67fdffb640 1 -- 172.21.15.81:0/1117690507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v13) ==== 118+0+0 (secure 0 0 0) 0x7f67f8067830 con 0x7f68001609e0 2024-09-17T05:19:29.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67ec078b90 msgr2=0x7f67ec07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67ec078b90 0x7f67ec07b050 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f67f0033000 tx=0x7f68000d0380 comp rx=0 tx=0).stop 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001609e0 msgr2=0x7f68000c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001609e0 0x7f68000c7f80 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f68000d2a10 tx=0x7f67f800faa0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 shutdown_connections 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67ec078b90 0x7f67ec07b050 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68001609e0 0x7f68000c7f80 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68001f4a00 0x7f68000c6250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 --2- 172.21.15.81:0/1117690507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67e8003a30 0x7f68000c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 >> 172.21.15.81:0/1117690507 conn(0x7f680009aa30 msgr2=0x7f68000b4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 shutdown_connections 2024-09-17T05:19:29.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.204+0000 7f68076d6640 1 -- 172.21.15.81:0/1117690507 wait complete. 2024-09-17T05:19:29.217 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:19:29.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:19:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.320+0000 7f8297c2a640 1 -- 172.21.15.81:0/542934540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 msgr2=0x7f827800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.320+0000 7f8297c2a640 1 --2- 172.21.15.81:0/542934540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f827800b9c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f8280009e20 tx=0x7f8278005830 comp rx=0 tx=0).stop 2024-09-17T05:19:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.320+0000 7f8297c2a640 1 -- 172.21.15.81:0/542934540 shutdown_connections 2024-09-17T05:19:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.320+0000 7f8297c2a640 1 --2- 172.21.15.81:0/542934540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f827800b9c0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.320+0000 7f8297c2a640 1 -- 172.21.15.81:0/542934540 >> 172.21.15.81:0/542934540 conn(0x7f82900d3e30 msgr2=0x7f82900d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:29.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.320+0000 7f8297c2a640 1 -- 172.21.15.81:0/542934540 shutdown_connections 2024-09-17T05:19:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.320+0000 7f8297c2a640 1 -- 172.21.15.81:0/542934540 wait complete. 2024-09-17T05:19:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.321+0000 7f8297c2a640 1 Processor -- start 2024-09-17T05:19:29.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.321+0000 7f8297c2a640 1 -- start start 2024-09-17T05:19:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f8297c2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f82901f84b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:29.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f8297c2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900cd630 0x7f82901eed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f8297c2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82901f55f0 0x7f82901f5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f8297c2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82900d20c0 con 0x7f8278005290 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f8297c2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f82900d1f40 con 0x7f82900cd630 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f8297c2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f82900d2240 con 0x7f82901f55f0 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f82901f84b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f82901f84b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53176/0 (socket says 172.21.15.81:53176) 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 -- 172.21.15.81:0/2586951074 learned_addr learned my addr 172.21.15.81:0/2586951074 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82951c5640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900cd630 0x7f82901eed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82961c7640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82901f55f0 0x7f82901f5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 -- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82901f55f0 msgr2=0x7f82901f5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82901f55f0 0x7f82901f5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 -- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900cd630 msgr2=0x7f82901eed30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900cd630 0x7f82901eed30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 -- 172.21.15.81:0/2586951074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82901f8bb0 con 0x7f8278005290 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82951c5640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900cd630 0x7f82901eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f82959c6640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f82901f84b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f828800f680 tx=0x7f828800fb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f828e7fc640 1 -- 172.21.15.81:0/2586951074 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8288015070 con 0x7f8278005290 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f828e7fc640 1 -- 172.21.15.81:0/2586951074 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8288006170 con 0x7f8278005290 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82901f8e90 con 0x7f8278005290 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.322+0000 7f828e7fc640 1 -- 172.21.15.81:0/2586951074 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828800c840 con 0x7f8278005290 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.323+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82901f50d0 con 0x7f8278005290 2024-09-17T05:19:29.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.324+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f82901f93b0 con 0x7f8278005290 2024-09-17T05:19:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.324+0000 7f828e7fc640 1 -- 172.21.15.81:0/2586951074 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8288018070 con 0x7f8278005290 2024-09-17T05:19:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.325+0000 7f828e7fc640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f827c078b90 0x7f827c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.325+0000 7f828e7fc640 1 -- 172.21.15.81:0/2586951074 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f828809ae40 con 0x7f8278005290 2024-09-17T05:19:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.325+0000 7f82951c5640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f827c078b90 0x7f827c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:29.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.326+0000 7f82951c5640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f827c078b90 0x7f827c07b050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c00 tx=0x7f82840014b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:29.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.329+0000 7f828e7fc640 1 -- 172.21.15.81:0/2586951074 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f82901f93b0 con 0x7f8278005290 2024-09-17T05:19:29.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:29.541+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f82901f4ec0 con 0x7f8278005290 2024-09-17T05:19:30.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.206+0000 7f828e7fc640 1 -- 172.21.15.81:0/2586951074 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v14) ==== 122+0+0 (secure 0 0 0) 0x7f82880633a0 con 0x7f8278005290 2024-09-17T05:19:30.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f827c078b90 msgr2=0x7f827c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f827c078b90 0x7f827c07b050 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f8284000c00 tx=0x7f82840014b0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 msgr2=0x7f82901f84b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f82901f84b0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f828800f680 tx=0x7f828800fb40 comp rx=0 tx=0).stop 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 shutdown_connections 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f827c078b90 0x7f827c07b050 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f82901f55f0 0x7f82901f5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f82900cd630 0x7f82901eed30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 --2- 172.21.15.81:0/2586951074 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8278005290 0x7f82901f84b0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.208+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 >> 172.21.15.81:0/2586951074 conn(0x7f82900d3e30 msgr2=0x7f82900b1140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.209+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 shutdown_connections 2024-09-17T05:19:30.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.209+0000 7f8297c2a640 1 -- 172.21.15.81:0/2586951074 wait complete. 2024-09-17T05:19:30.222 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:19:30.223 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:30.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 -- 172.21.15.81:0/785525490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d0d40 msgr2=0x7f72e40cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 --2- 172.21.15.81:0/785525490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d0d40 0x7f72e40cf9b0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f72d8009830 tx=0x7f72d802a510 comp rx=0 tx=0).stop 2024-09-17T05:19:30.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 -- 172.21.15.81:0/785525490 shutdown_connections 2024-09-17T05:19:30.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 --2- 172.21.15.81:0/785525490 >> v2:172.21.15.160:3300/0 conn(0x7f72e40d49c0 0x7f72e40b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 --2- 172.21.15.81:0/785525490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d0d40 0x7f72e40cf9b0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 -- 172.21.15.81:0/785525490 >> 172.21.15.81:0/785525490 conn(0x7f72e40d3ea0 msgr2=0x7f72e40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:30.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 -- 172.21.15.81:0/785525490 shutdown_connections 2024-09-17T05:19:30.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.328+0000 7f72ea18a640 1 -- 172.21.15.81:0/785525490 wait complete. 2024-09-17T05:19:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.329+0000 7f72ea18a640 1 Processor -- start 2024-09-17T05:19:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.329+0000 7f72ea18a640 1 -- start start 2024-09-17T05:19:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72ea18a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72e40d0d40 0x7f72e40ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72ea18a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d49c0 0x7f72e40b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72ea18a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e415df90 0x7f72e41f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72ea18a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72e40b3d40 con 0x7f72e415df90 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72ea18a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f72e4162710 con 0x7f72e40d0d40 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72ea18a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f72e40b3ec0 con 0x7f72e40d49c0 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e415df90 0x7f72e41f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e415df90 0x7f72e41f8270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53188/0 (socket says 172.21.15.81:53188) 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 -- 172.21.15.81:0/923910645 learned_addr learned my addr 172.21.15.81:0/923910645 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e37fe640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72e40d0d40 0x7f72e40ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e2ffd640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d49c0 0x7f72e40b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 -- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d49c0 msgr2=0x7f72e40b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d49c0 0x7f72e40b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 -- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72e40d0d40 msgr2=0x7f72e40ca310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72e40d0d40 0x7f72e40ca310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 -- 172.21.15.81:0/923910645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e40b8260 con 0x7f72e415df90 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.330+0000 7f72e3fff640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e415df90 0x7f72e41f8270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00efd0 tx=0x7f72dc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.331+0000 7f72cbfff640 1 -- 172.21.15.81:0/923910645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc003b70 con 0x7f72e415df90 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.331+0000 7f72cbfff640 1 -- 172.21.15.81:0/923910645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f72dc003e00 con 0x7f72e415df90 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.331+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e4160480 con 0x7f72e415df90 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.331+0000 7f72cbfff640 1 -- 172.21.15.81:0/923910645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72dc004280 con 0x7f72e415df90 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.331+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e41f8f30 con 0x7f72e415df90 2024-09-17T05:19:30.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.332+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e40b4310 con 0x7f72e415df90 2024-09-17T05:19:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.332+0000 7f72cbfff640 1 -- 172.21.15.81:0/923910645 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f72dc004420 con 0x7f72e415df90 2024-09-17T05:19:30.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.333+0000 7f72cbfff640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d0078bc0 0x7f72d007b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.333+0000 7f72cbfff640 1 -- 172.21.15.81:0/923910645 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f72dc09bbc0 con 0x7f72e415df90 2024-09-17T05:19:30.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.333+0000 7f72e37fe640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d0078bc0 0x7f72d007b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.334+0000 7f72e37fe640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d0078bc0 0x7f72d007b080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007d60 tx=0x7f72d4007cf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:30.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.337+0000 7f72cbfff640 1 -- 172.21.15.81:0/923910645 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f72dc063a40 con 0x7f72e415df90 2024-09-17T05:19:30.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.549+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f72e408d590 con 0x7f72e415df90 2024-09-17T05:19:30.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.549+0000 7f72cbfff640 1 -- 172.21.15.81:0/923910645 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5226 (secure 0 0 0) 0x7f72dc068470 con 0x7f72e415df90 2024-09-17T05:19:30.551 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:30.551 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"btime":"2024-09-17T05:19:30:202844+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1349280669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1349280669},{"type":"v1","addr":"172.21.15.81:6835","nonce":1349280669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4116874676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4116874676},{"type":"v1","addr":"172.21.15.81:6834","nonce":4116874676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3419973321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3419973321},{"type":"v1","addr":"172.21.15.160:6836","nonce":3419973321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:27.525714+0000","modified":"2024-09-17T05:19:29.543405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/974638720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":974638720},{"type":"v1","addr":"172.21.15.160:6837","nonce":974638720}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-17T05:19:30.551 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d0078bc0 msgr2=0x7f72d007b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d0078bc0 0x7f72d007b080 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f72d4007d60 tx=0x7f72d4007cf0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e415df90 msgr2=0x7f72e41f8270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e415df90 0x7f72e41f8270 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f72dc00efd0 tx=0x7f72dc00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 shutdown_connections 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f72d0078bc0 0x7f72d007b080 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72e415df90 0x7f72e41f8270 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72e40d49c0 0x7f72e40b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 --2- 172.21.15.81:0/923910645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72e40d0d40 0x7f72e40ca310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 >> 172.21.15.81:0/923910645 conn(0x7f72e40d3ea0 msgr2=0x7f72e40b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.551+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 shutdown_connections 2024-09-17T05:19:30.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.552+0000 7f72ea18a640 1 -- 172.21.15.81:0/923910645 wait complete. 2024-09-17T05:19:30.564 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 -- 172.21.15.81:0/484650585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 msgr2=0x7f29180739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 --2- 172.21.15.81:0/484650585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29180739a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f2900005fd0 tx=0x7f290002a530 comp rx=0 tx=0).stop 2024-09-17T05:19:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 -- 172.21.15.81:0/484650585 shutdown_connections 2024-09-17T05:19:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 --2- 172.21.15.81:0/484650585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29180739a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 --2- 172.21.15.81:0/484650585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291815aa70 0x7f29180b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 -- 172.21.15.81:0/484650585 >> 172.21.15.81:0/484650585 conn(0x7f29180b1690 msgr2=0x7f29180b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 -- 172.21.15.81:0/484650585 shutdown_connections 2024-09-17T05:19:30.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.663+0000 7f291e12b640 1 -- 172.21.15.81:0/484650585 wait complete. 2024-09-17T05:19:30.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.664+0000 7f291e12b640 1 Processor -- start 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.665+0000 7f291e12b640 1 -- start start 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.665+0000 7f291e12b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291806ff80 0x7f2918150c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.665+0000 7f291e12b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29181431a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.665+0000 7f291e12b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291815aa70 0x7f291813f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.665+0000 7f291e12b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29180707c0 con 0x7f29180735a0 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.665+0000 7f291e12b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2918070640 con 0x7f291815aa70 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.665+0000 7f291e12b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f29180cd5f0 con 0x7f291806ff80 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29181431a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29181431a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53206/0 (socket says 172.21.15.81:53206) 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 -- 172.21.15.81:0/1926946550 learned_addr learned my addr 172.21.15.81:0/1926946550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:30.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f29177fe640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291806ff80 0x7f2918150c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f2917fff640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291815aa70 0x7f291813f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 -- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291806ff80 msgr2=0x7f2918150c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291806ff80 0x7f2918150c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 -- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291815aa70 msgr2=0x7f291813f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291815aa70 0x7f291813f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 -- 172.21.15.81:0/1926946550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2918140090 con 0x7f29180735a0 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f29177fe640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291806ff80 0x7f2918150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f290effd640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29181431a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2900009850 tx=0x7f29000039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f2914ff9640 1 -- 172.21.15.81:0/1926946550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f290003f070 con 0x7f29180735a0 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f2914ff9640 1 -- 172.21.15.81:0/1926946550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2900004890 con 0x7f29180735a0 2024-09-17T05:19:30.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f291813fdb0 con 0x7f29180735a0 2024-09-17T05:19:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f2914ff9640 1 -- 172.21.15.81:0/1926946550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2900035030 con 0x7f29180735a0 2024-09-17T05:19:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.666+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29181f5d40 con 0x7f29180735a0 2024-09-17T05:19:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.667+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29180739a0 con 0x7f29180735a0 2024-09-17T05:19:30.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.668+0000 7f2914ff9640 1 -- 172.21.15.81:0/1926946550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f2900042070 con 0x7f29180735a0 2024-09-17T05:19:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.668+0000 7f2914ff9640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28f8078b90 0x7f28f807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.668+0000 7f2914ff9640 1 -- 172.21.15.81:0/1926946550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f29000bbc00 con 0x7f29180735a0 2024-09-17T05:19:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.668+0000 7f29177fe640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28f8078b90 0x7f28f807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.669+0000 7f29177fe640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28f8078b90 0x7f28f807b050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2908009890 tx=0x7f2908008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:30.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.672+0000 7f2914ff9640 1 -- 172.21.15.81:0/1926946550 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f29000c2080 con 0x7f29180735a0 2024-09-17T05:19:30.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.848+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f2918155e80 con 0x7f29180735a0 2024-09-17T05:19:30.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.849+0000 7f2914ff9640 1 -- 172.21.15.81:0/1926946550 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16729 (secure 0 0 0) 0x7f29000840d0 con 0x7f29180735a0 2024-09-17T05:19:30.850 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:30.850 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:29.186400+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:25.252883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:26.493997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.851+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28f8078b90 msgr2=0x7f28f807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.851+0000 7f291e12b640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28f8078b90 0x7f28f807b050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2908009890 tx=0x7f2908008040 comp rx=0 tx=0).stop 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.851+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 msgr2=0x7f29181431a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.851+0000 7f291e12b640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29181431a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f2900009850 tx=0x7f29000039e0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 shutdown_connections 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f28f8078b90 0x7f28f807b050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f291815aa70 0x7f291813f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29180735a0 0x7f29181431a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 --2- 172.21.15.81:0/1926946550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f291806ff80 0x7f2918150c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 >> 172.21.15.81:0/1926946550 conn(0x7f29180b1690 msgr2=0x7f29181550f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 shutdown_connections 2024-09-17T05:19:30.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.852+0000 7f291e12b640 1 -- 172.21.15.81:0/1926946550 wait complete. 2024-09-17T05:19:30.863 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:19:30.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.963+0000 7fee13fff640 1 -- 172.21.15.81:0/3213203581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee140d1ea0 msgr2=0x7fee141611a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.963+0000 7fee13fff640 1 --2- 172.21.15.81:0/3213203581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee140d1ea0 0x7fee141611a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7fee1408d490 tx=0x7fee0402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.963+0000 7fee13fff640 1 -- 172.21.15.81:0/3213203581 shutdown_connections 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.963+0000 7fee13fff640 1 --2- 172.21.15.81:0/3213203581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee140d27c0 0x7fee140d0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.963+0000 7fee13fff640 1 --2- 172.21.15.81:0/3213203581 >> v2:172.21.15.160:3300/0 conn(0x7fee141616e0 0x7fee140d2280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.963+0000 7fee13fff640 1 --2- 172.21.15.81:0/3213203581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee140d1ea0 0x7fee141611a0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.964+0000 7fee13fff640 1 -- 172.21.15.81:0/3213203581 >> 172.21.15.81:0/3213203581 conn(0x7fee140d3d30 msgr2=0x7fee140d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.964+0000 7fee13fff640 1 -- 172.21.15.81:0/3213203581 shutdown_connections 2024-09-17T05:19:30.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.964+0000 7fee13fff640 1 -- 172.21.15.81:0/3213203581 wait complete. 2024-09-17T05:19:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.965+0000 7fee13fff640 1 Processor -- start 2024-09-17T05:19:30.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.965+0000 7fee13fff640 1 -- start start 2024-09-17T05:19:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee13fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee140d1ea0 0x7fee141f57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee13fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee140d27c0 0x7fee141f21f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee141616e0 0x7fee140b7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee13fff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee140d2db0 con 0x7fee141616e0 2024-09-17T05:19:30.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee13fff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fee140d2c30 con 0x7fee140d27c0 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee13fff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fee140d0740 con 0x7fee140d1ea0 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee141616e0 0x7fee140b7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee141616e0 0x7fee140b7550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53212/0 (socket says 172.21.15.81:53212) 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 -- 172.21.15.81:0/3839874715 learned_addr learned my addr 172.21.15.81:0/3839874715 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee12ffd640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee140d1ea0 0x7fee141f57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee127fc640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee140d27c0 0x7fee141f21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 -- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee140d1ea0 msgr2=0x7fee141f57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee140d1ea0 0x7fee141f57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 -- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee140d27c0 msgr2=0x7fee141f21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee140d27c0 0x7fee141f21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:30.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 -- 172.21.15.81:0/3839874715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee140b66e0 con 0x7fee141616e0 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee12ffd640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee140d1ea0 0x7fee141f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fee137fe640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee141616e0 0x7fee140b7550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00eaa0 tx=0x7fee0c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.966+0000 7fedfbfff640 1 -- 172.21.15.81:0/3839874715 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c004b20 con 0x7fee141616e0 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.967+0000 7fedfbfff640 1 -- 172.21.15.81:0/3839874715 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee0c004db0 con 0x7fee141616e0 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.967+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee140b5920 con 0x7fee141616e0 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.967+0000 7fedfbfff640 1 -- 172.21.15.81:0/3839874715 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee0c005280 con 0x7fee141616e0 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.967+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee140b5ee0 con 0x7fee141616e0 2024-09-17T05:19:30.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.968+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee1406d930 con 0x7fee141616e0 2024-09-17T05:19:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.968+0000 7fedfbfff640 1 -- 172.21.15.81:0/3839874715 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fee0c005420 con 0x7fee141616e0 2024-09-17T05:19:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.969+0000 7fedfbfff640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee00078b90 0x7fee0007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.969+0000 7fedfbfff640 1 -- 172.21.15.81:0/3839874715 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fee0c09bb40 con 0x7fee141616e0 2024-09-17T05:19:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.969+0000 7fee12ffd640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee00078b90 0x7fee0007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:30.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.969+0000 7fee12ffd640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee00078b90 0x7fee0007b050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee04033000 tx=0x7fee04004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:30.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:30.973+0000 7fedfbfff640 1 -- 172.21.15.81:0/3839874715 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fee1406d930 con 0x7fee141616e0 2024-09-17T05:19:31.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.166+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fee140d0200 con 0x7fee00078b90 2024-09-17T05:19:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.170+0000 7fedfbfff640 1 -- 172.21.15.81:0/3839874715 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240931 (secure 0 0 0) 0x7fee140d0200 con 0x7fee00078b90 2024-09-17T05:19:31.173 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:31.175 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:19:31.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee00078b90 msgr2=0x7fee0007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee00078b90 0x7fee0007b050 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fee04033000 tx=0x7fee04004730 comp rx=0 tx=0).stop 2024-09-17T05:19:31.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee141616e0 msgr2=0x7fee140b7550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee141616e0 0x7fee140b7550 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fee0c00eaa0 tx=0x7fee0c00ef60 comp rx=0 tx=0).stop 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 shutdown_connections 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee00078b90 0x7fee0007b050 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee141616e0 0x7fee140b7550 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee140d27c0 0x7fee141f21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 --2- 172.21.15.81:0/3839874715 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee140d1ea0 0x7fee141f57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 >> 172.21.15.81:0/3839874715 conn(0x7fee140d3d30 msgr2=0x7fee1406d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 shutdown_connections 2024-09-17T05:19:31.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.173+0000 7fee13fff640 1 -- 172.21.15.81:0/3839874715 wait complete. 2024-09-17T05:19:31.187 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-09-17T05:19:29.382794+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":102,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":74,"acting":74,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220036,"kb_used_data":3744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754684,"statfs":{"total":773094113280,"available":772868796416,"internally_reserved":0,"allocated":3833856,"data_stored":2146964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000815"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.209687+0000","last_change":"2024-09-17T05:19:28.208077+0000","last_active":"2024-09-17T05:19:28.209687+0000","last_peered":"2024-09-17T05:19:28.209687+0000","last_clean":"2024-09-17T05:19:28.209687+0000","last_became_active":"2024-09-17T05:19:28.207755+0000","last_became_peered":"2024-09-17T05:19:28.207755+0000","last_unstale":"2024-09-17T05:19:28.209687+0000","last_undegraded":"2024-09-17T05:19:28.209687+0000","last_fullsized":"2024-09-17T05:19:28.209687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:41.548780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.205712+0000","last_change":"2024-09-17T05:19:28.203798+0000","last_active":"2024-09-17T05:19:28.205712+0000","last_peered":"2024-09-17T05:19:28.205712+0000","last_clean":"2024-09-17T05:19:28.205712+0000","last_became_active":"2024-09-17T05:19:28.203515+0000","last_became_peered":"2024-09-17T05:19:28.203515+0000","last_unstale":"2024-09-17T05:19:28.205712+0000","last_undegraded":"2024-09-17T05:19:28.205712+0000","last_fullsized":"2024-09-17T05:19:28.205712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:28.573680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179754+0000","last_change":"2024-09-17T05:19:26.179754+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179754+0000","last_undegraded":"2024-09-17T05:19:26.179754+0000","last_fullsized":"2024-09-17T05:19:26.179754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.218749+0000","last_change":"2024-09-17T05:19:27.197891+0000","last_active":"2024-09-17T05:19:28.218749+0000","last_peered":"2024-09-17T05:19:28.218749+0000","last_clean":"2024-09-17T05:19:28.218749+0000","last_became_active":"2024-09-17T05:19:27.197627+0000","last_became_peered":"2024-09-17T05:19:27.197627+0000","last_unstale":"2024-09-17T05:19:28.218749+0000","last_undegraded":"2024-09-17T05:19:28.218749+0000","last_fullsized":"2024-09-17T05:19:28.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:30.979081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181479+0000","last_change":"2024-09-17T05:19:26.181479+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181479+0000","last_undegraded":"2024-09-17T05:19:26.181479+0000","last_fullsized":"2024-09-17T05:19:26.181479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.183673+0000","last_change":"2024-09-17T05:19:26.183673+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.183673+0000","last_undegraded":"2024-09-17T05:19:26.183673+0000","last_fullsized":"2024-09-17T05:19:26.183673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177736+0000","last_change":"2024-09-17T05:19:26.177736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177736+0000","last_undegraded":"2024-09-17T05:19:26.177736+0000","last_fullsized":"2024-09-17T05:19:26.177736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177091+0000","last_change":"2024-09-17T05:19:26.177091+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177091+0000","last_undegraded":"2024-09-17T05:19:26.177091+0000","last_fullsized":"2024-09-17T05:19:26.177091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181733+0000","last_change":"2024-09-17T05:19:26.181733+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181733+0000","last_undegraded":"2024-09-17T05:19:26.181733+0000","last_fullsized":"2024-09-17T05:19:26.181733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176794+0000","last_change":"2024-09-17T05:19:26.176794+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176794+0000","last_undegraded":"2024-09-17T05:19:26.176794+0000","last_fullsized":"2024-09-17T05:19:26.176794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181902+0000","last_change":"2024-09-17T05:19:26.181902+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181902+0000","last_undegraded":"2024-09-17T05:19:26.181902+0000","last_fullsized":"2024-09-17T05:19:26.181902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.188949+0000","last_change":"2024-09-17T05:19:27.190473+0000","last_active":"2024-09-17T05:19:28.188949+0000","last_peered":"2024-09-17T05:19:28.188949+0000","last_clean":"2024-09-17T05:19:28.188949+0000","last_became_active":"2024-09-17T05:19:27.190024+0000","last_became_peered":"2024-09-17T05:19:27.190024+0000","last_unstale":"2024-09-17T05:19:28.188949+0000","last_undegraded":"2024-09-17T05:19:28.188949+0000","last_fullsized":"2024-09-17T05:19:28.188949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:50.891630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181736+0000","last_change":"2024-09-17T05:19:26.181736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181736+0000","last_undegraded":"2024-09-17T05:19:26.181736+0000","last_fullsized":"2024-09-17T05:19:26.181736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181287+0000","last_change":"2024-09-17T05:19:26.181287+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181287+0000","last_undegraded":"2024-09-17T05:19:26.181287+0000","last_fullsized":"2024-09-17T05:19:26.181287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176901+0000","last_change":"2024-09-17T05:19:26.176901+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176901+0000","last_undegraded":"2024-09-17T05:19:26.176901+0000","last_fullsized":"2024-09-17T05:19:26.176901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177148+0000","last_change":"2024-09-17T05:19:26.177148+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177148+0000","last_undegraded":"2024-09-17T05:19:26.177148+0000","last_fullsized":"2024-09-17T05:19:26.177148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181245+0000","last_change":"2024-09-17T05:19:26.181245+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181245+0000","last_undegraded":"2024-09-17T05:19:26.181245+0000","last_fullsized":"2024-09-17T05:19:26.181245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181797+0000","last_change":"2024-09-17T05:19:26.181797+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181797+0000","last_undegraded":"2024-09-17T05:19:26.181797+0000","last_fullsized":"2024-09-17T05:19:26.181797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177239+0000","last_change":"2024-09-17T05:19:26.177239+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177239+0000","last_undegraded":"2024-09-17T05:19:26.177239+0000","last_fullsized":"2024-09-17T05:19:26.177239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177130+0000","last_change":"2024-09-17T05:19:26.177130+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177130+0000","last_undegraded":"2024-09-17T05:19:26.177130+0000","last_fullsized":"2024-09-17T05:19:26.177130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176798+0000","last_change":"2024-09-17T05:19:26.176798+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176798+0000","last_undegraded":"2024-09-17T05:19:26.176798+0000","last_fullsized":"2024-09-17T05:19:26.176798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176893+0000","last_change":"2024-09-17T05:19:26.176893+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176893+0000","last_undegraded":"2024-09-17T05:19:26.176893+0000","last_fullsized":"2024-09-17T05:19:26.176893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.220596+0000","last_change":"2024-09-17T05:19:27.194506+0000","last_active":"2024-09-17T05:19:28.220596+0000","last_peered":"2024-09-17T05:19:28.220596+0000","last_clean":"2024-09-17T05:19:28.220596+0000","last_became_active":"2024-09-17T05:19:27.194231+0000","last_became_peered":"2024-09-17T05:19:27.194231+0000","last_unstale":"2024-09-17T05:19:28.220596+0000","last_undegraded":"2024-09-17T05:19:28.220596+0000","last_fullsized":"2024-09-17T05:19:28.220596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:18.652935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179669+0000","last_change":"2024-09-17T05:19:26.179669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179669+0000","last_undegraded":"2024-09-17T05:19:26.179669+0000","last_fullsized":"2024-09-17T05:19:26.179669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177999+0000","last_change":"2024-09-17T05:19:26.177999+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177999+0000","last_undegraded":"2024-09-17T05:19:26.177999+0000","last_fullsized":"2024-09-17T05:19:26.177999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181669+0000","last_change":"2024-09-17T05:19:26.181669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181669+0000","last_undegraded":"2024-09-17T05:19:26.181669+0000","last_fullsized":"2024-09-17T05:19:26.181669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176498+0000","last_change":"2024-09-17T05:19:26.176498+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176498+0000","last_undegraded":"2024-09-17T05:19:26.176498+0000","last_fullsized":"2024-09-17T05:19:26.176498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189169+0000","last_change":"2024-09-17T05:19:27.194601+0000","last_active":"2024-09-17T05:19:28.189169+0000","last_peered":"2024-09-17T05:19:28.189169+0000","last_clean":"2024-09-17T05:19:28.189169+0000","last_became_active":"2024-09-17T05:19:27.194321+0000","last_became_peered":"2024-09-17T05:19:27.194321+0000","last_unstale":"2024-09-17T05:19:28.189169+0000","last_undegraded":"2024-09-17T05:19:28.189169+0000","last_fullsized":"2024-09-17T05:19:28.189169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:00.182063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.196591+0000","last_change":"2024-09-17T05:19:28.194603+0000","last_active":"2024-09-17T05:19:28.196591+0000","last_peered":"2024-09-17T05:19:28.196591+0000","last_clean":"2024-09-17T05:19:28.196591+0000","last_became_active":"2024-09-17T05:19:28.194205+0000","last_became_peered":"2024-09-17T05:19:28.194205+0000","last_unstale":"2024-09-17T05:19:28.196591+0000","last_undegraded":"2024-09-17T05:19:28.196591+0000","last_fullsized":"2024-09-17T05:19:28.196591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:51.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176506+0000","last_change":"2024-09-17T05:19:26.176506+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176506+0000","last_undegraded":"2024-09-17T05:19:26.176506+0000","last_fullsized":"2024-09-17T05:19:26.176506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189283+0000","last_change":"2024-09-17T05:19:27.192401+0000","last_active":"2024-09-17T05:19:28.189283+0000","last_peered":"2024-09-17T05:19:28.189283+0000","last_clean":"2024-09-17T05:19:28.189283+0000","last_became_active":"2024-09-17T05:19:27.191978+0000","last_became_peered":"2024-09-17T05:19:27.191978+0000","last_unstale":"2024-09-17T05:19:28.189283+0000","last_undegraded":"2024-09-17T05:19:28.189283+0000","last_fullsized":"2024-09-17T05:19:28.189283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:22.842606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.208339+0000","last_change":"2024-09-17T05:19:28.205962+0000","last_active":"2024-09-17T05:19:28.208339+0000","last_peered":"2024-09-17T05:19:28.208339+0000","last_clean":"2024-09-17T05:19:28.208339+0000","last_became_active":"2024-09-17T05:19:28.205676+0000","last_became_peered":"2024-09-17T05:19:28.205676+0000","last_unstale":"2024-09-17T05:19:28.208339+0000","last_undegraded":"2024-09-17T05:19:28.208339+0000","last_fullsized":"2024-09-17T05:19:28.208339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.921170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176438+0000","last_change":"2024-09-17T05:19:26.176438+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176438+0000","last_undegraded":"2024-09-17T05:19:26.176438+0000","last_fullsized":"2024-09-17T05:19:26.176438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177049+0000","last_change":"2024-09-17T05:19:26.177049+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177049+0000","last_undegraded":"2024-09-17T05:19:26.177049+0000","last_fullsized":"2024-09-17T05:19:26.177049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181229+0000","last_change":"2024-09-17T05:19:26.181229+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181229+0000","last_undegraded":"2024-09-17T05:19:26.181229+0000","last_fullsized":"2024-09-17T05:19:26.181229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179660+0000","last_change":"2024-09-17T05:19:26.179660+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179660+0000","last_undegraded":"2024-09-17T05:19:26.179660+0000","last_fullsized":"2024-09-17T05:19:26.179660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:19:26.180559+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:19:26.180559+0000","last_peered":"2024-09-17T05:19:26.180559+0000","last_clean":"2024-09-17T05:19:26.180559+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:19:26.180559+0000","last_undegraded":"2024-09-17T05:19:26.180559+0000","last_fullsized":"2024-09-17T05:19:26.180559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":721720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:19:31.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:19:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.328+0000 7f4ea4524640 1 -- 172.21.15.81:0/4192546272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e84004800 msgr2=0x7f4e84004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.328+0000 7f4ea4524640 1 --2- 172.21.15.81:0/4192546272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e84004800 0x7f4e84004c80 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4e9c073690 tx=0x7f4e84005830 comp rx=0 tx=0).stop 2024-09-17T05:19:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.328+0000 7f4ea2ac1640 1 -- 172.21.15.81:0/4192546272 reap_dead start 2024-09-17T05:19:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.328+0000 7f4ea4524640 1 -- 172.21.15.81:0/4192546272 shutdown_connections 2024-09-17T05:19:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.328+0000 7f4ea4524640 1 -- 172.21.15.81:0/4192546272 >> 172.21.15.81:0/4192546272 conn(0x7f4e9c0d0c20 msgr2=0x7f4e9c0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.328+0000 7f4ea4524640 1 -- 172.21.15.81:0/4192546272 shutdown_connections 2024-09-17T05:19:31.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.328+0000 7f4ea4524640 1 -- 172.21.15.81:0/4192546272 wait complete. 2024-09-17T05:19:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.329+0000 7f4ea4524640 1 Processor -- start 2024-09-17T05:19:31.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.329+0000 7f4ea4524640 1 -- start start 2024-09-17T05:19:31.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e84004800 0x7f4e9c1f8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c1f7b90 0x7f4e9c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e9c0b0a30 0x7f4e9c0a1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c0d0820 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4e9c0d06a0 con 0x7f4e9c0b0a30 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4e9c0cb350 con 0x7f4e84004800 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c1f7b90 0x7f4e9c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c1f7b90 0x7f4e9c0b04f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53234/0 (socket says 172.21.15.81:53234) 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 -- 172.21.15.81:0/725990315 learned_addr learned my addr 172.21.15.81:0/725990315 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 -- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e84004800 msgr2=0x7f4e9c1f8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e84004800 0x7f4e9c1f8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 -- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e9c0b0a30 msgr2=0x7f4e9c0a1330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e9c0b0a30 0x7f4e9c0a1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 -- 172.21.15.81:0/725990315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e9c1f8fb0 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea1abf640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c1f7b90 0x7f4e9c0b04f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e90036040 tx=0x7f4e90033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4e9affd640 1 -- 172.21.15.81:0/725990315 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90038040 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4e9affd640 1 -- 172.21.15.81:0/725990315 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e90004020 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e9c0b3260 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4e9affd640 1 -- 172.21.15.81:0/725990315 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e90004470 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.330+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e9c0a0b30 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.331+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e9c0736e0 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.332+0000 7f4e9affd640 1 -- 172.21.15.81:0/725990315 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f4e90045020 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.332+0000 7f4e9affd640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4e88078bc0 0x7f4e8807b080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.332+0000 7f4e9affd640 1 -- 172.21.15.81:0/725990315 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f4e900bb540 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.333+0000 7f4ea22c0640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4e88078bc0 0x7f4e8807b080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:31.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.333+0000 7f4ea22c0640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4e88078bc0 0x7f4e8807b080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c002230 tx=0x7f4e8c0021a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:31.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.337+0000 7f4e9affd640 1 -- 172.21.15.81:0/725990315 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4e9002b940 con 0x7f4e9c1f7b90 2024-09-17T05:19:31.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.510+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e9c0a0690 con 0x7f4e88078bc0 2024-09-17T05:19:31.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.515+0000 7f4e9affd640 1 -- 172.21.15.81:0/725990315 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240931 (secure 0 0 0) 0x7f4e8c00ea10 con 0x7f4e88078bc0 2024-09-17T05:19:31.520 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:31.521 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:19:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.517+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4e88078bc0 msgr2=0x7f4e8807b080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.517+0000 7f4ea4524640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4e88078bc0 0x7f4e8807b080 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4e8c002230 tx=0x7f4e8c0021a0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.517+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c1f7b90 msgr2=0x7f4e9c0b04f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.517+0000 7f4ea4524640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c1f7b90 0x7f4e9c0b04f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f4e90036040 tx=0x7f4e90033670 comp rx=0 tx=0).stop 2024-09-17T05:19:31.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 shutdown_connections 2024-09-17T05:19:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4e88078bc0 0x7f4e8807b080 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e9c0b0a30 0x7f4e9c0a1330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e9c1f7b90 0x7f4e9c0b04f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 --2- 172.21.15.81:0/725990315 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e84004800 0x7f4e9c1f8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 >> 172.21.15.81:0/725990315 conn(0x7f4e9c0d0c20 msgr2=0x7f4e9c0b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 shutdown_connections 2024-09-17T05:19:31.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.518+0000 7f4ea4524640 1 -- 172.21.15.81:0/725990315 wait complete. 2024-09-17T05:19:31.529 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T05:19:31.383220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":102,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":74,"acting":74,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220036,"kb_used_data":3744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754684,"statfs":{"total":773094113280,"available":772868796416,"internally_reserved":0,"allocated":3833856,"data_stored":2146964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.208277"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.209687+0000","last_change":"2024-09-17T05:19:28.208077+0000","last_active":"2024-09-17T05:19:28.209687+0000","last_peered":"2024-09-17T05:19:28.209687+0000","last_clean":"2024-09-17T05:19:28.209687+0000","last_became_active":"2024-09-17T05:19:28.207755+0000","last_became_peered":"2024-09-17T05:19:28.207755+0000","last_unstale":"2024-09-17T05:19:28.209687+0000","last_undegraded":"2024-09-17T05:19:28.209687+0000","last_fullsized":"2024-09-17T05:19:28.209687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:41.548780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.205712+0000","last_change":"2024-09-17T05:19:28.203798+0000","last_active":"2024-09-17T05:19:28.205712+0000","last_peered":"2024-09-17T05:19:28.205712+0000","last_clean":"2024-09-17T05:19:28.205712+0000","last_became_active":"2024-09-17T05:19:28.203515+0000","last_became_peered":"2024-09-17T05:19:28.203515+0000","last_unstale":"2024-09-17T05:19:28.205712+0000","last_undegraded":"2024-09-17T05:19:28.205712+0000","last_fullsized":"2024-09-17T05:19:28.205712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:28.573680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179754+0000","last_change":"2024-09-17T05:19:26.179754+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179754+0000","last_undegraded":"2024-09-17T05:19:26.179754+0000","last_fullsized":"2024-09-17T05:19:26.179754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.218749+0000","last_change":"2024-09-17T05:19:27.197891+0000","last_active":"2024-09-17T05:19:28.218749+0000","last_peered":"2024-09-17T05:19:28.218749+0000","last_clean":"2024-09-17T05:19:28.218749+0000","last_became_active":"2024-09-17T05:19:27.197627+0000","last_became_peered":"2024-09-17T05:19:27.197627+0000","last_unstale":"2024-09-17T05:19:28.218749+0000","last_undegraded":"2024-09-17T05:19:28.218749+0000","last_fullsized":"2024-09-17T05:19:28.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:30.979081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181479+0000","last_change":"2024-09-17T05:19:26.181479+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181479+0000","last_undegraded":"2024-09-17T05:19:26.181479+0000","last_fullsized":"2024-09-17T05:19:26.181479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.183673+0000","last_change":"2024-09-17T05:19:26.183673+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.183673+0000","last_undegraded":"2024-09-17T05:19:26.183673+0000","last_fullsized":"2024-09-17T05:19:26.183673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177736+0000","last_change":"2024-09-17T05:19:26.177736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177736+0000","last_undegraded":"2024-09-17T05:19:26.177736+0000","last_fullsized":"2024-09-17T05:19:26.177736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177091+0000","last_change":"2024-09-17T05:19:26.177091+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177091+0000","last_undegraded":"2024-09-17T05:19:26.177091+0000","last_fullsized":"2024-09-17T05:19:26.177091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181733+0000","last_change":"2024-09-17T05:19:26.181733+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181733+0000","last_undegraded":"2024-09-17T05:19:26.181733+0000","last_fullsized":"2024-09-17T05:19:26.181733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176794+0000","last_change":"2024-09-17T05:19:26.176794+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176794+0000","last_undegraded":"2024-09-17T05:19:26.176794+0000","last_fullsized":"2024-09-17T05:19:26.176794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181902+0000","last_change":"2024-09-17T05:19:26.181902+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181902+0000","last_undegraded":"2024-09-17T05:19:26.181902+0000","last_fullsized":"2024-09-17T05:19:26.181902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.188949+0000","last_change":"2024-09-17T05:19:27.190473+0000","last_active":"2024-09-17T05:19:28.188949+0000","last_peered":"2024-09-17T05:19:28.188949+0000","last_clean":"2024-09-17T05:19:28.188949+0000","last_became_active":"2024-09-17T05:19:27.190024+0000","last_became_peered":"2024-09-17T05:19:27.190024+0000","last_unstale":"2024-09-17T05:19:28.188949+0000","last_undegraded":"2024-09-17T05:19:28.188949+0000","last_fullsized":"2024-09-17T05:19:28.188949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:50.891630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181736+0000","last_change":"2024-09-17T05:19:26.181736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181736+0000","last_undegraded":"2024-09-17T05:19:26.181736+0000","last_fullsized":"2024-09-17T05:19:26.181736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181287+0000","last_change":"2024-09-17T05:19:26.181287+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181287+0000","last_undegraded":"2024-09-17T05:19:26.181287+0000","last_fullsized":"2024-09-17T05:19:26.181287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176901+0000","last_change":"2024-09-17T05:19:26.176901+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176901+0000","last_undegraded":"2024-09-17T05:19:26.176901+0000","last_fullsized":"2024-09-17T05:19:26.176901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177148+0000","last_change":"2024-09-17T05:19:26.177148+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177148+0000","last_undegraded":"2024-09-17T05:19:26.177148+0000","last_fullsized":"2024-09-17T05:19:26.177148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181245+0000","last_change":"2024-09-17T05:19:26.181245+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181245+0000","last_undegraded":"2024-09-17T05:19:26.181245+0000","last_fullsized":"2024-09-17T05:19:26.181245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181797+0000","last_change":"2024-09-17T05:19:26.181797+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181797+0000","last_undegraded":"2024-09-17T05:19:26.181797+0000","last_fullsized":"2024-09-17T05:19:26.181797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177239+0000","last_change":"2024-09-17T05:19:26.177239+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177239+0000","last_undegraded":"2024-09-17T05:19:26.177239+0000","last_fullsized":"2024-09-17T05:19:26.177239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177130+0000","last_change":"2024-09-17T05:19:26.177130+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177130+0000","last_undegraded":"2024-09-17T05:19:26.177130+0000","last_fullsized":"2024-09-17T05:19:26.177130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176798+0000","last_change":"2024-09-17T05:19:26.176798+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176798+0000","last_undegraded":"2024-09-17T05:19:26.176798+0000","last_fullsized":"2024-09-17T05:19:26.176798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176893+0000","last_change":"2024-09-17T05:19:26.176893+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176893+0000","last_undegraded":"2024-09-17T05:19:26.176893+0000","last_fullsized":"2024-09-17T05:19:26.176893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.220596+0000","last_change":"2024-09-17T05:19:27.194506+0000","last_active":"2024-09-17T05:19:28.220596+0000","last_peered":"2024-09-17T05:19:28.220596+0000","last_clean":"2024-09-17T05:19:28.220596+0000","last_became_active":"2024-09-17T05:19:27.194231+0000","last_became_peered":"2024-09-17T05:19:27.194231+0000","last_unstale":"2024-09-17T05:19:28.220596+0000","last_undegraded":"2024-09-17T05:19:28.220596+0000","last_fullsized":"2024-09-17T05:19:28.220596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:18.652935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179669+0000","last_change":"2024-09-17T05:19:26.179669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179669+0000","last_undegraded":"2024-09-17T05:19:26.179669+0000","last_fullsized":"2024-09-17T05:19:26.179669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177999+0000","last_change":"2024-09-17T05:19:26.177999+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177999+0000","last_undegraded":"2024-09-17T05:19:26.177999+0000","last_fullsized":"2024-09-17T05:19:26.177999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181669+0000","last_change":"2024-09-17T05:19:26.181669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181669+0000","last_undegraded":"2024-09-17T05:19:26.181669+0000","last_fullsized":"2024-09-17T05:19:26.181669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176498+0000","last_change":"2024-09-17T05:19:26.176498+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176498+0000","last_undegraded":"2024-09-17T05:19:26.176498+0000","last_fullsized":"2024-09-17T05:19:26.176498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189169+0000","last_change":"2024-09-17T05:19:27.194601+0000","last_active":"2024-09-17T05:19:28.189169+0000","last_peered":"2024-09-17T05:19:28.189169+0000","last_clean":"2024-09-17T05:19:28.189169+0000","last_became_active":"2024-09-17T05:19:27.194321+0000","last_became_peered":"2024-09-17T05:19:27.194321+0000","last_unstale":"2024-09-17T05:19:28.189169+0000","last_undegraded":"2024-09-17T05:19:28.189169+0000","last_fullsized":"2024-09-17T05:19:28.189169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:00.182063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.196591+0000","last_change":"2024-09-17T05:19:28.194603+0000","last_active":"2024-09-17T05:19:28.196591+0000","last_peered":"2024-09-17T05:19:28.196591+0000","last_clean":"2024-09-17T05:19:28.196591+0000","last_became_active":"2024-09-17T05:19:28.194205+0000","last_became_peered":"2024-09-17T05:19:28.194205+0000","last_unstale":"2024-09-17T05:19:28.196591+0000","last_undegraded":"2024-09-17T05:19:28.196591+0000","last_fullsized":"2024-09-17T05:19:28.196591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:51.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176506+0000","last_change":"2024-09-17T05:19:26.176506+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176506+0000","last_undegraded":"2024-09-17T05:19:26.176506+0000","last_fullsized":"2024-09-17T05:19:26.176506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189283+0000","last_change":"2024-09-17T05:19:27.192401+0000","last_active":"2024-09-17T05:19:28.189283+0000","last_peered":"2024-09-17T05:19:28.189283+0000","last_clean":"2024-09-17T05:19:28.189283+0000","last_became_active":"2024-09-17T05:19:27.191978+0000","last_became_peered":"2024-09-17T05:19:27.191978+0000","last_unstale":"2024-09-17T05:19:28.189283+0000","last_undegraded":"2024-09-17T05:19:28.189283+0000","last_fullsized":"2024-09-17T05:19:28.189283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:22.842606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.208339+0000","last_change":"2024-09-17T05:19:28.205962+0000","last_active":"2024-09-17T05:19:28.208339+0000","last_peered":"2024-09-17T05:19:28.208339+0000","last_clean":"2024-09-17T05:19:28.208339+0000","last_became_active":"2024-09-17T05:19:28.205676+0000","last_became_peered":"2024-09-17T05:19:28.205676+0000","last_unstale":"2024-09-17T05:19:28.208339+0000","last_undegraded":"2024-09-17T05:19:28.208339+0000","last_fullsized":"2024-09-17T05:19:28.208339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.921170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176438+0000","last_change":"2024-09-17T05:19:26.176438+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176438+0000","last_undegraded":"2024-09-17T05:19:26.176438+0000","last_fullsized":"2024-09-17T05:19:26.176438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177049+0000","last_change":"2024-09-17T05:19:26.177049+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177049+0000","last_undegraded":"2024-09-17T05:19:26.177049+0000","last_fullsized":"2024-09-17T05:19:26.177049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181229+0000","last_change":"2024-09-17T05:19:26.181229+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181229+0000","last_undegraded":"2024-09-17T05:19:26.181229+0000","last_fullsized":"2024-09-17T05:19:26.181229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179660+0000","last_change":"2024-09-17T05:19:26.179660+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179660+0000","last_undegraded":"2024-09-17T05:19:26.179660+0000","last_fullsized":"2024-09-17T05:19:26.179660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:19:26.180559+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:19:26.180559+0000","last_peered":"2024-09-17T05:19:26.180559+0000","last_clean":"2024-09-17T05:19:26.180559+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:19:26.180559+0000","last_undegraded":"2024-09-17T05:19:26.180559+0000","last_fullsized":"2024-09-17T05:19:26.180559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":721720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:19:31.535 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:19:31.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 -- 172.21.15.81:0/3268968007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 msgr2=0x7fd6880b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 --2- 172.21.15.81:0/3268968007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b3090 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fd6880ce590 tx=0x7fd67802aac0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 -- 172.21.15.81:0/3268968007 shutdown_connections 2024-09-17T05:19:31.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 --2- 172.21.15.81:0/3268968007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd68815cdc0 0x7fd6880cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 --2- 172.21.15.81:0/3268968007 >> v2:172.21.15.160:3300/0 conn(0x7fd68815f6d0 0x7fd68815c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 --2- 172.21.15.81:0/3268968007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b3090 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 -- 172.21.15.81:0/3268968007 >> 172.21.15.81:0/3268968007 conn(0x7fd68809aa30 msgr2=0x7fd68809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 -- 172.21.15.81:0/3268968007 shutdown_connections 2024-09-17T05:19:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.670+0000 7fd68d30e640 1 -- 172.21.15.81:0/3268968007 wait complete. 2024-09-17T05:19:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.671+0000 7fd68d30e640 1 Processor -- start 2024-09-17T05:19:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.671+0000 7fd68d30e640 1 -- start start 2024-09-17T05:19:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd68d30e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b74b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd68d30e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd68815cdc0 0x7fd6881f6090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd68d30e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd68815f6d0 0x7fd6881f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd68d30e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6880b1240 con 0x7fd6880d2410 2024-09-17T05:19:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd68d30e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6880d05d0 con 0x7fd68815cdc0 2024-09-17T05:19:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd68d30e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd6880b13c0 con 0x7fd68815f6d0 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53254/0 (socket says 172.21.15.81:53254) 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 -- 172.21.15.81:0/2463347799 learned_addr learned my addr 172.21.15.81:0/2463347799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 -- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd68815f6d0 msgr2=0x7fd6881f65d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd68815f6d0 0x7fd6881f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 -- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd68815cdc0 msgr2=0x7fd6881f6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd68815cdc0 0x7fd6881f6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 -- 172.21.15.81:0/2463347799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd68815b570 con 0x7fd6880d2410 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.672+0000 7fd686ffd640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b74b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd678009d60 tx=0x7fd678003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.673+0000 7fd67f7fe640 1 -- 172.21.15.81:0/2463347799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678044070 con 0x7fd6880d2410 2024-09-17T05:19:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.673+0000 7fd67f7fe640 1 -- 172.21.15.81:0/2463347799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd678004250 con 0x7fd6880d2410 2024-09-17T05:19:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.673+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6880b79f0 con 0x7fd6880d2410 2024-09-17T05:19:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.673+0000 7fd67f7fe640 1 -- 172.21.15.81:0/2463347799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd678004660 con 0x7fd6880d2410 2024-09-17T05:19:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.673+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd68815aa90 con 0x7fd6880d2410 2024-09-17T05:19:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.674+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6880b18b0 con 0x7fd6880d2410 2024-09-17T05:19:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.674+0000 7fd67f7fe640 1 -- 172.21.15.81:0/2463347799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd67802c940 con 0x7fd6880d2410 2024-09-17T05:19:31.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.675+0000 7fd67f7fe640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd668078b90 0x7fd66807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:31.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.675+0000 7fd67f7fe640 1 -- 172.21.15.81:0/2463347799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd6780bb840 con 0x7fd6880d2410 2024-09-17T05:19:31.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.675+0000 7fd6867fc640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd668078b90 0x7fd66807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:31.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.676+0000 7fd6867fc640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd668078b90 0x7fd66807b050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd68815be50 tx=0x7fd670006bf0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:31.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.679+0000 7fd67f7fe640 1 -- 172.21.15.81:0/2463347799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd678032030 con 0x7fd6880d2410 2024-09-17T05:19:31.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.857+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd6880d29a0 con 0x7fd668078b90 2024-09-17T05:19:31.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.861+0000 7fd67f7fe640 1 -- 172.21.15.81:0/2463347799 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240931 (secure 0 0 0) 0x7fd6880d29a0 con 0x7fd668078b90 2024-09-17T05:19:31.865 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:31.866 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd668078b90 msgr2=0x7fd66807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd668078b90 0x7fd66807b050 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fd68815be50 tx=0x7fd670006bf0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 msgr2=0x7fd6880b74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b74b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd678009d60 tx=0x7fd678003f10 comp rx=0 tx=0).stop 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 shutdown_connections 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd668078b90 0x7fd66807b050 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd68815f6d0 0x7fd6881f65d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd68815cdc0 0x7fd6881f6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 --2- 172.21.15.81:0/2463347799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6880d2410 0x7fd6880b74b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.864+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 >> 172.21.15.81:0/2463347799 conn(0x7fd68809aa30 msgr2=0x7fd6880cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:31.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.865+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 shutdown_connections 2024-09-17T05:19:31.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:31.865+0000 7fd68d30e640 1 -- 172.21.15.81:0/2463347799 wait complete. 2024-09-17T05:19:31.876 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T05:19:31.383220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":102,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":74,"acting":74,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220036,"kb_used_data":3744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754684,"statfs":{"total":773094113280,"available":772868796416,"internally_reserved":0,"allocated":3833856,"data_stored":2146964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.208277"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.209687+0000","last_change":"2024-09-17T05:19:28.208077+0000","last_active":"2024-09-17T05:19:28.209687+0000","last_peered":"2024-09-17T05:19:28.209687+0000","last_clean":"2024-09-17T05:19:28.209687+0000","last_became_active":"2024-09-17T05:19:28.207755+0000","last_became_peered":"2024-09-17T05:19:28.207755+0000","last_unstale":"2024-09-17T05:19:28.209687+0000","last_undegraded":"2024-09-17T05:19:28.209687+0000","last_fullsized":"2024-09-17T05:19:28.209687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:41.548780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.205712+0000","last_change":"2024-09-17T05:19:28.203798+0000","last_active":"2024-09-17T05:19:28.205712+0000","last_peered":"2024-09-17T05:19:28.205712+0000","last_clean":"2024-09-17T05:19:28.205712+0000","last_became_active":"2024-09-17T05:19:28.203515+0000","last_became_peered":"2024-09-17T05:19:28.203515+0000","last_unstale":"2024-09-17T05:19:28.205712+0000","last_undegraded":"2024-09-17T05:19:28.205712+0000","last_fullsized":"2024-09-17T05:19:28.205712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:28.573680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179754+0000","last_change":"2024-09-17T05:19:26.179754+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179754+0000","last_undegraded":"2024-09-17T05:19:26.179754+0000","last_fullsized":"2024-09-17T05:19:26.179754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.218749+0000","last_change":"2024-09-17T05:19:27.197891+0000","last_active":"2024-09-17T05:19:28.218749+0000","last_peered":"2024-09-17T05:19:28.218749+0000","last_clean":"2024-09-17T05:19:28.218749+0000","last_became_active":"2024-09-17T05:19:27.197627+0000","last_became_peered":"2024-09-17T05:19:27.197627+0000","last_unstale":"2024-09-17T05:19:28.218749+0000","last_undegraded":"2024-09-17T05:19:28.218749+0000","last_fullsized":"2024-09-17T05:19:28.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:30.979081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181479+0000","last_change":"2024-09-17T05:19:26.181479+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181479+0000","last_undegraded":"2024-09-17T05:19:26.181479+0000","last_fullsized":"2024-09-17T05:19:26.181479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.183673+0000","last_change":"2024-09-17T05:19:26.183673+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.183673+0000","last_undegraded":"2024-09-17T05:19:26.183673+0000","last_fullsized":"2024-09-17T05:19:26.183673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177736+0000","last_change":"2024-09-17T05:19:26.177736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177736+0000","last_undegraded":"2024-09-17T05:19:26.177736+0000","last_fullsized":"2024-09-17T05:19:26.177736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177091+0000","last_change":"2024-09-17T05:19:26.177091+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177091+0000","last_undegraded":"2024-09-17T05:19:26.177091+0000","last_fullsized":"2024-09-17T05:19:26.177091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181733+0000","last_change":"2024-09-17T05:19:26.181733+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181733+0000","last_undegraded":"2024-09-17T05:19:26.181733+0000","last_fullsized":"2024-09-17T05:19:26.181733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176794+0000","last_change":"2024-09-17T05:19:26.176794+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176794+0000","last_undegraded":"2024-09-17T05:19:26.176794+0000","last_fullsized":"2024-09-17T05:19:26.176794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181902+0000","last_change":"2024-09-17T05:19:26.181902+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181902+0000","last_undegraded":"2024-09-17T05:19:26.181902+0000","last_fullsized":"2024-09-17T05:19:26.181902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.188949+0000","last_change":"2024-09-17T05:19:27.190473+0000","last_active":"2024-09-17T05:19:28.188949+0000","last_peered":"2024-09-17T05:19:28.188949+0000","last_clean":"2024-09-17T05:19:28.188949+0000","last_became_active":"2024-09-17T05:19:27.190024+0000","last_became_peered":"2024-09-17T05:19:27.190024+0000","last_unstale":"2024-09-17T05:19:28.188949+0000","last_undegraded":"2024-09-17T05:19:28.188949+0000","last_fullsized":"2024-09-17T05:19:28.188949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:50.891630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181736+0000","last_change":"2024-09-17T05:19:26.181736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181736+0000","last_undegraded":"2024-09-17T05:19:26.181736+0000","last_fullsized":"2024-09-17T05:19:26.181736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181287+0000","last_change":"2024-09-17T05:19:26.181287+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181287+0000","last_undegraded":"2024-09-17T05:19:26.181287+0000","last_fullsized":"2024-09-17T05:19:26.181287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176901+0000","last_change":"2024-09-17T05:19:26.176901+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176901+0000","last_undegraded":"2024-09-17T05:19:26.176901+0000","last_fullsized":"2024-09-17T05:19:26.176901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177148+0000","last_change":"2024-09-17T05:19:26.177148+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177148+0000","last_undegraded":"2024-09-17T05:19:26.177148+0000","last_fullsized":"2024-09-17T05:19:26.177148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181245+0000","last_change":"2024-09-17T05:19:26.181245+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181245+0000","last_undegraded":"2024-09-17T05:19:26.181245+0000","last_fullsized":"2024-09-17T05:19:26.181245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181797+0000","last_change":"2024-09-17T05:19:26.181797+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181797+0000","last_undegraded":"2024-09-17T05:19:26.181797+0000","last_fullsized":"2024-09-17T05:19:26.181797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177239+0000","last_change":"2024-09-17T05:19:26.177239+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177239+0000","last_undegraded":"2024-09-17T05:19:26.177239+0000","last_fullsized":"2024-09-17T05:19:26.177239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177130+0000","last_change":"2024-09-17T05:19:26.177130+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177130+0000","last_undegraded":"2024-09-17T05:19:26.177130+0000","last_fullsized":"2024-09-17T05:19:26.177130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176798+0000","last_change":"2024-09-17T05:19:26.176798+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176798+0000","last_undegraded":"2024-09-17T05:19:26.176798+0000","last_fullsized":"2024-09-17T05:19:26.176798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176893+0000","last_change":"2024-09-17T05:19:26.176893+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176893+0000","last_undegraded":"2024-09-17T05:19:26.176893+0000","last_fullsized":"2024-09-17T05:19:26.176893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.220596+0000","last_change":"2024-09-17T05:19:27.194506+0000","last_active":"2024-09-17T05:19:28.220596+0000","last_peered":"2024-09-17T05:19:28.220596+0000","last_clean":"2024-09-17T05:19:28.220596+0000","last_became_active":"2024-09-17T05:19:27.194231+0000","last_became_peered":"2024-09-17T05:19:27.194231+0000","last_unstale":"2024-09-17T05:19:28.220596+0000","last_undegraded":"2024-09-17T05:19:28.220596+0000","last_fullsized":"2024-09-17T05:19:28.220596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:18.652935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179669+0000","last_change":"2024-09-17T05:19:26.179669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179669+0000","last_undegraded":"2024-09-17T05:19:26.179669+0000","last_fullsized":"2024-09-17T05:19:26.179669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177999+0000","last_change":"2024-09-17T05:19:26.177999+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177999+0000","last_undegraded":"2024-09-17T05:19:26.177999+0000","last_fullsized":"2024-09-17T05:19:26.177999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181669+0000","last_change":"2024-09-17T05:19:26.181669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181669+0000","last_undegraded":"2024-09-17T05:19:26.181669+0000","last_fullsized":"2024-09-17T05:19:26.181669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176498+0000","last_change":"2024-09-17T05:19:26.176498+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176498+0000","last_undegraded":"2024-09-17T05:19:26.176498+0000","last_fullsized":"2024-09-17T05:19:26.176498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189169+0000","last_change":"2024-09-17T05:19:27.194601+0000","last_active":"2024-09-17T05:19:28.189169+0000","last_peered":"2024-09-17T05:19:28.189169+0000","last_clean":"2024-09-17T05:19:28.189169+0000","last_became_active":"2024-09-17T05:19:27.194321+0000","last_became_peered":"2024-09-17T05:19:27.194321+0000","last_unstale":"2024-09-17T05:19:28.189169+0000","last_undegraded":"2024-09-17T05:19:28.189169+0000","last_fullsized":"2024-09-17T05:19:28.189169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:00.182063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.196591+0000","last_change":"2024-09-17T05:19:28.194603+0000","last_active":"2024-09-17T05:19:28.196591+0000","last_peered":"2024-09-17T05:19:28.196591+0000","last_clean":"2024-09-17T05:19:28.196591+0000","last_became_active":"2024-09-17T05:19:28.194205+0000","last_became_peered":"2024-09-17T05:19:28.194205+0000","last_unstale":"2024-09-17T05:19:28.196591+0000","last_undegraded":"2024-09-17T05:19:28.196591+0000","last_fullsized":"2024-09-17T05:19:28.196591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:51.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176506+0000","last_change":"2024-09-17T05:19:26.176506+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176506+0000","last_undegraded":"2024-09-17T05:19:26.176506+0000","last_fullsized":"2024-09-17T05:19:26.176506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189283+0000","last_change":"2024-09-17T05:19:27.192401+0000","last_active":"2024-09-17T05:19:28.189283+0000","last_peered":"2024-09-17T05:19:28.189283+0000","last_clean":"2024-09-17T05:19:28.189283+0000","last_became_active":"2024-09-17T05:19:27.191978+0000","last_became_peered":"2024-09-17T05:19:27.191978+0000","last_unstale":"2024-09-17T05:19:28.189283+0000","last_undegraded":"2024-09-17T05:19:28.189283+0000","last_fullsized":"2024-09-17T05:19:28.189283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:22.842606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.208339+0000","last_change":"2024-09-17T05:19:28.205962+0000","last_active":"2024-09-17T05:19:28.208339+0000","last_peered":"2024-09-17T05:19:28.208339+0000","last_clean":"2024-09-17T05:19:28.208339+0000","last_became_active":"2024-09-17T05:19:28.205676+0000","last_became_peered":"2024-09-17T05:19:28.205676+0000","last_unstale":"2024-09-17T05:19:28.208339+0000","last_undegraded":"2024-09-17T05:19:28.208339+0000","last_fullsized":"2024-09-17T05:19:28.208339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.921170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176438+0000","last_change":"2024-09-17T05:19:26.176438+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176438+0000","last_undegraded":"2024-09-17T05:19:26.176438+0000","last_fullsized":"2024-09-17T05:19:26.176438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177049+0000","last_change":"2024-09-17T05:19:26.177049+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177049+0000","last_undegraded":"2024-09-17T05:19:26.177049+0000","last_fullsized":"2024-09-17T05:19:26.177049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181229+0000","last_change":"2024-09-17T05:19:26.181229+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181229+0000","last_undegraded":"2024-09-17T05:19:26.181229+0000","last_fullsized":"2024-09-17T05:19:26.181229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179660+0000","last_change":"2024-09-17T05:19:26.179660+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179660+0000","last_undegraded":"2024-09-17T05:19:26.179660+0000","last_fullsized":"2024-09-17T05:19:26.179660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:19:26.180559+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:19:26.180559+0000","last_peered":"2024-09-17T05:19:26.180559+0000","last_clean":"2024-09-17T05:19:26.180559+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:19:26.180559+0000","last_undegraded":"2024-09-17T05:19:26.180559+0000","last_fullsized":"2024-09-17T05:19:26.180559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":721720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:19:31.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3f is not active+clean 2024-09-17T05:19:31.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3e is not active+clean 2024-09-17T05:19:31.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.880 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3d is not active+clean 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3c is not active+clean 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3b is not active+clean 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.3a is not active+clean 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.39 is not active+clean 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.881 INFO:tasks.ceph.ceph_manager.ceph:PG 5.38 is not active+clean 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.37 is not active+clean 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.36 is not active+clean 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.35 is not active+clean 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.34 is not active+clean 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.882 INFO:tasks.ceph.ceph_manager.ceph:PG 5.33 is not active+clean 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.32 is not active+clean 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.31 is not active+clean 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.30 is not active+clean 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2f is not active+clean 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2e is not active+clean 2024-09-17T05:19:31.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2d is not active+clean 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2c is not active+clean 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2b is not active+clean 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2a is not active+clean 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:PG 5.28 is not active+clean 2024-09-17T05:19:31.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.27 is not active+clean 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.26 is not active+clean 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.25 is not active+clean 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.24 is not active+clean 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:PG 5.23 is not active+clean 2024-09-17T05:19:31.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:PG 5.22 is not active+clean 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:PG 5.21 is not active+clean 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:PG 5.20 is not active+clean 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1f is not active+clean 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.179754+0000', 'last_change': '2024-09-17T05:19:26.179754+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.179754+0000', 'last_undegraded': '2024-09-17T05:19:26.179754+0000', 'last_fullsized': '2024-09-17T05:19:26.179754+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1f is not active+clean 2024-09-17T05:19:31.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1c is not active+clean 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1d is not active+clean 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181479+0000', 'last_change': '2024-09-17T05:19:26.181479+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181479+0000', 'last_undegraded': '2024-09-17T05:19:26.181479+0000', 'last_fullsized': '2024-09-17T05:19:26.181479+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1d is not active+clean 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1c is not active+clean 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.183673+0000', 'last_change': '2024-09-17T05:19:26.183673+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.183673+0000', 'last_undegraded': '2024-09-17T05:19:26.183673+0000', 'last_fullsized': '2024-09-17T05:19:26.183673+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1a is not active+clean 2024-09-17T05:19:31.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1b is not active+clean 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.177736+0000', 'last_change': '2024-09-17T05:19:26.177736+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.177736+0000', 'last_undegraded': '2024-09-17T05:19:26.177736+0000', 'last_fullsized': '2024-09-17T05:19:26.177736+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1b is not active+clean 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1a is not active+clean 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.177091+0000', 'last_change': '2024-09-17T05:19:26.177091+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.177091+0000', 'last_undegraded': '2024-09-17T05:19:26.177091+0000', 'last_fullsized': '2024-09-17T05:19:26.177091+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:PG 5.18 is not active+clean 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:PG 4.19 is not active+clean 2024-09-17T05:19:31.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181733+0000', 'last_change': '2024-09-17T05:19:26.181733+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181733+0000', 'last_undegraded': '2024-09-17T05:19:26.181733+0000', 'last_fullsized': '2024-09-17T05:19:26.181733+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:PG 5.19 is not active+clean 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:PG 4.18 is not active+clean 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.176794+0000', 'last_change': '2024-09-17T05:19:26.176794+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.176794+0000', 'last_undegraded': '2024-09-17T05:19:26.176794+0000', 'last_fullsized': '2024-09-17T05:19:26.176794+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:PG 5.16 is not active+clean 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:PG 4.17 is not active+clean 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181902+0000', 'last_change': '2024-09-17T05:19:26.181902+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181902+0000', 'last_undegraded': '2024-09-17T05:19:26.181902+0000', 'last_fullsized': '2024-09-17T05:19:26.181902+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:PG 5.17 is not active+clean 2024-09-17T05:19:31.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:PG 5.14 is not active+clean 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:PG 4.15 is not active+clean 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181736+0000', 'last_change': '2024-09-17T05:19:26.181736+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181736+0000', 'last_undegraded': '2024-09-17T05:19:26.181736+0000', 'last_fullsized': '2024-09-17T05:19:26.181736+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:PG 5.15 is not active+clean 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:PG 4.14 is not active+clean 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181287+0000', 'last_change': '2024-09-17T05:19:26.181287+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181287+0000', 'last_undegraded': '2024-09-17T05:19:26.181287+0000', 'last_fullsized': '2024-09-17T05:19:26.181287+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:PG 5.12 is not active+clean 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.890 INFO:tasks.ceph.ceph_manager.ceph:PG 4.13 is not active+clean 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.176901+0000', 'last_change': '2024-09-17T05:19:26.176901+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.176901+0000', 'last_undegraded': '2024-09-17T05:19:26.176901+0000', 'last_fullsized': '2024-09-17T05:19:26.176901+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:PG 5.13 is not active+clean 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:PG 4.12 is not active+clean 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.177148+0000', 'last_change': '2024-09-17T05:19:26.177148+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.177148+0000', 'last_undegraded': '2024-09-17T05:19:26.177148+0000', 'last_fullsized': '2024-09-17T05:19:26.177148+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:PG 5.10 is not active+clean 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:PG 4.11 is not active+clean 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181245+0000', 'last_change': '2024-09-17T05:19:26.181245+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181245+0000', 'last_undegraded': '2024-09-17T05:19:26.181245+0000', 'last_fullsized': '2024-09-17T05:19:26.181245+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:19:31.891 INFO:tasks.ceph.ceph_manager.ceph:PG 5.11 is not active+clean 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:PG 4.10 is not active+clean 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181797+0000', 'last_change': '2024-09-17T05:19:26.181797+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181797+0000', 'last_undegraded': '2024-09-17T05:19:26.181797+0000', 'last_fullsized': '2024-09-17T05:19:26.181797+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:PG 5.e is not active+clean 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:PG 4.f is not active+clean 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.177239+0000', 'last_change': '2024-09-17T05:19:26.177239+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.177239+0000', 'last_undegraded': '2024-09-17T05:19:26.177239+0000', 'last_fullsized': '2024-09-17T05:19:26.177239+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:PG 5.f is not active+clean 2024-09-17T05:19:31.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:PG 4.e is not active+clean 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.177130+0000', 'last_change': '2024-09-17T05:19:26.177130+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.177130+0000', 'last_undegraded': '2024-09-17T05:19:26.177130+0000', 'last_fullsized': '2024-09-17T05:19:26.177130+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:PG 5.c is not active+clean 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:PG 4.d is not active+clean 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.176798+0000', 'last_change': '2024-09-17T05:19:26.176798+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.176798+0000', 'last_undegraded': '2024-09-17T05:19:26.176798+0000', 'last_fullsized': '2024-09-17T05:19:26.176798+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:PG 5.d is not active+clean 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:PG 4.c is not active+clean 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.176893+0000', 'last_change': '2024-09-17T05:19:26.176893+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.176893+0000', 'last_undegraded': '2024-09-17T05:19:26.176893+0000', 'last_fullsized': '2024-09-17T05:19:26.176893+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.893 INFO:tasks.ceph.ceph_manager.ceph:PG 5.a is not active+clean 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:PG 5.b is not active+clean 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:PG 4.a is not active+clean 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.179669+0000', 'last_change': '2024-09-17T05:19:26.179669+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.179669+0000', 'last_undegraded': '2024-09-17T05:19:26.179669+0000', 'last_fullsized': '2024-09-17T05:19:26.179669+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:PG 5.8 is not active+clean 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:PG 4.9 is not active+clean 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.177999+0000', 'last_change': '2024-09-17T05:19:26.177999+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.177999+0000', 'last_undegraded': '2024-09-17T05:19:26.177999+0000', 'last_fullsized': '2024-09-17T05:19:26.177999+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.894 INFO:tasks.ceph.ceph_manager.ceph:PG 5.9 is not active+clean 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:PG 4.8 is not active+clean 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181669+0000', 'last_change': '2024-09-17T05:19:26.181669+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181669+0000', 'last_undegraded': '2024-09-17T05:19:26.181669+0000', 'last_fullsized': '2024-09-17T05:19:26.181669+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:PG 5.6 is not active+clean 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:PG 4.7 is not active+clean 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.176498+0000', 'last_change': '2024-09-17T05:19:26.176498+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.176498+0000', 'last_undegraded': '2024-09-17T05:19:26.176498+0000', 'last_fullsized': '2024-09-17T05:19:26.176498+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:PG 5.7 is not active+clean 2024-09-17T05:19:31.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:PG 4.4 is not active+clean 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.176506+0000', 'last_change': '2024-09-17T05:19:26.176506+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.176506+0000', 'last_undegraded': '2024-09-17T05:19:26.176506+0000', 'last_fullsized': '2024-09-17T05:19:26.176506+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:PG 5.2 is not active+clean 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:PG 4.2 is not active+clean 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.176438+0000', 'last_change': '2024-09-17T05:19:26.176438+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.176438+0000', 'last_undegraded': '2024-09-17T05:19:26.176438+0000', 'last_fullsized': '2024-09-17T05:19:26.176438+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:PG 5.0 is not active+clean 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:PG 4.1 is not active+clean 2024-09-17T05:19:31.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.177049+0000', 'last_change': '2024-09-17T05:19:26.177049+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.177049+0000', 'last_undegraded': '2024-09-17T05:19:26.177049+0000', 'last_fullsized': '2024-09-17T05:19:26.177049+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:PG 5.1 is not active+clean 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:PG 4.0 is not active+clean 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.181229+0000', 'last_change': '2024-09-17T05:19:26.181229+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.181229+0000', 'last_undegraded': '2024-09-17T05:19:26.181229+0000', 'last_fullsized': '2024-09-17T05:19:26.181229+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:PG 5.4 is not active+clean 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '5.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:27.172540+0000', 'last_change': '2024-09-17T05:19:27.172540+0000', 'last_active': '2024-09-17T05:19:27.172540+0000', 'last_peered': '2024-09-17T05:19:27.172540+0000', 'last_clean': '2024-09-17T05:19:27.172540+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:27.172540+0000', 'last_undegraded': '2024-09-17T05:19:27.172540+0000', 'last_fullsized': '2024-09-17T05:19:27.172540+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:27.172540+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:PG 4.5 is not active+clean 2024-09-17T05:19:31.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '4.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 31, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:19:26.179660+0000', 'last_change': '2024-09-17T05:19:26.179660+0000', 'last_active': '2024-09-17T05:19:26.168287+0000', 'last_peered': '2024-09-17T05:19:26.168287+0000', 'last_clean': '2024-09-17T05:19:26.168287+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:26.179660+0000', 'last_undegraded': '2024-09-17T05:19:26.179660+0000', 'last_fullsized': '2024-09-17T05:19:26.179660+0000', 'mapping_epoch': 31, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 31, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:26.168287+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:19:31.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:19:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 -- 172.21.15.81:0/4269197678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208161380 msgr2=0x7f22080b5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 --2- 172.21.15.81:0/4269197678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208161380 0x7f22080b5440 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f21f8009830 tx=0x7f21f802a510 comp rx=0 tx=0).stop 2024-09-17T05:19:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 -- 172.21.15.81:0/4269197678 shutdown_connections 2024-09-17T05:19:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 --2- 172.21.15.81:0/4269197678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22080d24b0 0x7f22080d2900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 --2- 172.21.15.81:0/4269197678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208161380 0x7f22080b5440 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 -- 172.21.15.81:0/4269197678 >> 172.21.15.81:0/4269197678 conn(0x7f22080d3ea0 msgr2=0x7f22080d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 -- 172.21.15.81:0/4269197678 shutdown_connections 2024-09-17T05:19:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.016+0000 7f220e364640 1 -- 172.21.15.81:0/4269197678 wait complete. 2024-09-17T05:19:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.018+0000 7f220e364640 1 Processor -- start 2024-09-17T05:19:32.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.018+0000 7f220e364640 1 -- start start 2024-09-17T05:19:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22080d24b0 0x7f22080cd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208161380 0x7f2208155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2208161760 0x7f2208156400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22080b1fb0 con 0x7f22080d24b0 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f22080b1e30 con 0x7f2208161380 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f22080b2130 con 0x7f2208161760 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22080d24b0 0x7f22080cd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22080d24b0 0x7f22080cd310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53270/0 (socket says 172.21.15.81:53270) 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 -- 172.21.15.81:0/3720862782 learned_addr learned my addr 172.21.15.81:0/3720862782 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 -- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2208161760 msgr2=0x7f2208156400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2208161760 0x7f2208156400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 -- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208161380 msgr2=0x7f2208155ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208161380 0x7f2208155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 -- 172.21.15.81:0/3720862782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22081f5450 con 0x7f22080d24b0 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2207fff640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22080d24b0 0x7f22080cd310 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21f802ab00 tx=0x7f21f8032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2204ff9640 1 -- 172.21.15.81:0/3720862782 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f8040070 con 0x7f22080d24b0 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2204ff9640 1 -- 172.21.15.81:0/3720862782 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f21f8005310 con 0x7f22080d24b0 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22080cc830 con 0x7f22080d24b0 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f2204ff9640 1 -- 172.21.15.81:0/3720862782 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f21f80047a0 con 0x7f22080d24b0 2024-09-17T05:19:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.019+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22080ccdf0 con 0x7f22080d24b0 2024-09-17T05:19:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.020+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22080d2900 con 0x7f22080d24b0 2024-09-17T05:19:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.021+0000 7f2204ff9640 1 -- 172.21.15.81:0/3720862782 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f21f8039040 con 0x7f22080d24b0 2024-09-17T05:19:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.022+0000 7f2204ff9640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21f4078b90 0x7f21f407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.022+0000 7f2204ff9640 1 -- 172.21.15.81:0/3720862782 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f21f80bbd50 con 0x7f22080d24b0 2024-09-17T05:19:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.022+0000 7f22077fe640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21f4078b90 0x7f21f407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:32.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.022+0000 7f22077fe640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21f4078b90 0x7f21f407b050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0046b0 tx=0x7f21fc007a70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:32.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.026+0000 7f2204ff9640 1 -- 172.21.15.81:0/3720862782 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f21f8084230 con 0x7f22080d24b0 2024-09-17T05:19:32.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.272+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f2208160ae0 con 0x7f22080d24b0 2024-09-17T05:19:32.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.273+0000 7f2204ff9640 1 -- 172.21.15.81:0/3720862782 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+2824 (secure 0 0 0) 0x7f21f8083b30 con 0x7f22080d24b0 2024-09-17T05:19:32.274 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:32.274 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":69,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":34,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550316,"num_in_osds":8,"osd_in_since":1726550306,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":60},{"state_name":"creating+peering","count":27},{"state_name":"active+clean","count":10}],"num_pgs":97,"num_pools":3,"num_objects":3,"data_bytes":590368,"bytes_used":225316864,"bytes_avail":772868796416,"bytes_total":773094113280,"unknown_pgs_ratio":0.6185566782951355,"inactive_pgs_ratio":0.27835050225257874,"write_bytes_sec":0,"read_op_per_sec":0,"write_op_per_sec":0},"fsmap":{"epoch":14,"btime":"2024-09-17T05:19:30:202844+0000","id":2,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":2,"rank":0,"name":"d","status":"up:active","gid":4884}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2024-09-17T05:19:29.382851+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}},"osd":{"daemons":{"summary":"","0":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"1":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"2":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"3":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"4":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"5":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"6":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"7":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:19:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21f4078b90 msgr2=0x7f21f407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21f4078b90 0x7f21f407b050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f21fc0046b0 tx=0x7f21fc007a70 comp rx=0 tx=0).stop 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22080d24b0 msgr2=0x7f22080cd310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22080d24b0 0x7f22080cd310 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f21f802ab00 tx=0x7f21f8032c10 comp rx=0 tx=0).stop 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 shutdown_connections 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f21f4078b90 0x7f21f407b050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2208161760 0x7f2208156400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2208161380 0x7f2208155ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 --2- 172.21.15.81:0/3720862782 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22080d24b0 0x7f22080cd310 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 >> 172.21.15.81:0/3720862782 conn(0x7f22080d3ea0 msgr2=0x7f22081586e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 shutdown_connections 2024-09-17T05:19:32.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.275+0000 7f220e364640 1 -- 172.21.15.81:0/3720862782 wait complete. 2024-09-17T05:19:32.287 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:19:32.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:19:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.388+0000 7fd905c71640 1 -- 172.21.15.81:0/1614442449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 msgr2=0x7fd8ec00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.388+0000 7fd905c71640 1 --2- 172.21.15.81:0/1614442449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd8ec00b9c0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fd8f800c750 tx=0x7fd8ec005830 comp rx=0 tx=0).stop 2024-09-17T05:19:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.388+0000 7fd905c71640 1 -- 172.21.15.81:0/1614442449 shutdown_connections 2024-09-17T05:19:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.388+0000 7fd905c71640 1 --2- 172.21.15.81:0/1614442449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd8ec00b9c0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.388+0000 7fd905c71640 1 -- 172.21.15.81:0/1614442449 >> 172.21.15.81:0/1614442449 conn(0x7fd9000d3ea0 msgr2=0x7fd9000d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.388+0000 7fd905c71640 1 -- 172.21.15.81:0/1614442449 shutdown_connections 2024-09-17T05:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.388+0000 7fd905c71640 1 -- 172.21.15.81:0/1614442449 wait complete. 2024-09-17T05:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.389+0000 7fd905c71640 1 Processor -- start 2024-09-17T05:19:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.389+0000 7fd905c71640 1 -- start start 2024-09-17T05:19:32.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd905c71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd9000cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd905c71640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd90015fb90 0x7fd9001f4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd905c71640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd900160010 0x7fd9001f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd905c71640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9000cf9b0 con 0x7fd8ec0052e0 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd905c71640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001627a0 con 0x7fd90015fb90 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd905c71640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd9000cfb30 con 0x7fd900160010 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd9000cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd9000cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53282/0 (socket says 172.21.15.81:53282) 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 -- 172.21.15.81:0/2761514252 learned_addr learned my addr 172.21.15.81:0/2761514252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8fffff640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd900160010 0x7fd9001f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:32.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8f7fff640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd90015fb90 0x7fd9001f4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 -- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd900160010 msgr2=0x7fd9001f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd900160010 0x7fd9001f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 -- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd90015fb90 msgr2=0x7fd9001f4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd90015fb90 0x7fd9001f4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 -- 172.21.15.81:0/2761514252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9000b4980 con 0x7fd8ec0052e0 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.390+0000 7fd8ff7fe640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd9000cda90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0003f80 tx=0x7fd8f000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.391+0000 7fd8fcff9640 1 -- 172.21.15.81:0/2761514252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0010a00 con 0x7fd8ec0052e0 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.391+0000 7fd8fcff9640 1 -- 172.21.15.81:0/2761514252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd8f0015070 con 0x7fd8ec0052e0 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.391+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9000b4c60 con 0x7fd8ec0052e0 2024-09-17T05:19:32.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.391+0000 7fd8fcff9640 1 -- 172.21.15.81:0/2761514252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f0010e20 con 0x7fd8ec0052e0 2024-09-17T05:19:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.391+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9000cdfd0 con 0x7fd8ec0052e0 2024-09-17T05:19:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.392+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9000d07a0 con 0x7fd8ec0052e0 2024-09-17T05:19:32.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.392+0000 7fd8fcff9640 1 -- 172.21.15.81:0/2761514252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd8f001a470 con 0x7fd8ec0052e0 2024-09-17T05:19:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.393+0000 7fd8fcff9640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd8e0078b90 0x7fd8e007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.393+0000 7fd8fcff9640 1 -- 172.21.15.81:0/2761514252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd8f009b900 con 0x7fd8ec0052e0 2024-09-17T05:19:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.393+0000 7fd8f7fff640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd8e0078b90 0x7fd8e007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.393+0000 7fd8f7fff640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd8e0078b90 0x7fd8e007b050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd9000d4840 tx=0x7fd8e8006b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:32.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.397+0000 7fd8fcff9640 1 -- 172.21.15.81:0/2761514252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd8f0063de0 con 0x7fd8ec0052e0 2024-09-17T05:19:32.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.568+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd90008d590 con 0x7fd8e0078b90 2024-09-17T05:19:32.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.573+0000 7fd8fcff9640 1 -- 172.21.15.81:0/2761514252 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240931 (secure 0 0 0) 0x7fd90008d590 con 0x7fd8e0078b90 2024-09-17T05:19:32.576 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:32.577 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:19:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd8e0078b90 msgr2=0x7fd8e007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd8e0078b90 0x7fd8e007b050 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd9000d4840 tx=0x7fd8e8006b70 comp rx=0 tx=0).stop 2024-09-17T05:19:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 msgr2=0x7fd9000cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:32.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd9000cda90 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0003f80 tx=0x7fd8f000ba40 comp rx=0 tx=0).stop 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 shutdown_connections 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd8e0078b90 0x7fd8e007b050 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd900160010 0x7fd9001f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd90015fb90 0x7fd9001f4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 --2- 172.21.15.81:0/2761514252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd8ec0052e0 0x7fd9000cda90 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 >> 172.21.15.81:0/2761514252 conn(0x7fd9000d3ea0 msgr2=0x7fd9000b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 shutdown_connections 2024-09-17T05:19:32.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:32.576+0000 7fd905c71640 1 -- 172.21.15.81:0/2761514252 wait complete. 2024-09-17T05:19:32.588 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T05:19:31.383220+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":102,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":74,"acting":74,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220036,"kb_used_data":3744,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754684,"statfs":{"total":773094113280,"available":772868796416,"internally_reserved":0,"allocated":3833856,"data_stored":2146964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":13,"apply_latency_ms":13,"commit_latency_ns":13000000,"apply_latency_ns":13000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.208277"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.209687+0000","last_change":"2024-09-17T05:19:28.208077+0000","last_active":"2024-09-17T05:19:28.209687+0000","last_peered":"2024-09-17T05:19:28.209687+0000","last_clean":"2024-09-17T05:19:28.209687+0000","last_became_active":"2024-09-17T05:19:28.207755+0000","last_became_peered":"2024-09-17T05:19:28.207755+0000","last_unstale":"2024-09-17T05:19:28.209687+0000","last_undegraded":"2024-09-17T05:19:28.209687+0000","last_fullsized":"2024-09-17T05:19:28.209687+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:31:41.548780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.205712+0000","last_change":"2024-09-17T05:19:28.203798+0000","last_active":"2024-09-17T05:19:28.205712+0000","last_peered":"2024-09-17T05:19:28.205712+0000","last_clean":"2024-09-17T05:19:28.205712+0000","last_became_active":"2024-09-17T05:19:28.203515+0000","last_became_peered":"2024-09-17T05:19:28.203515+0000","last_unstale":"2024-09-17T05:19:28.205712+0000","last_undegraded":"2024-09-17T05:19:28.205712+0000","last_fullsized":"2024-09-17T05:19:28.205712+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:28.573680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179754+0000","last_change":"2024-09-17T05:19:26.179754+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179754+0000","last_undegraded":"2024-09-17T05:19:26.179754+0000","last_fullsized":"2024-09-17T05:19:26.179754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":14,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.218749+0000","last_change":"2024-09-17T05:19:27.197891+0000","last_active":"2024-09-17T05:19:28.218749+0000","last_peered":"2024-09-17T05:19:28.218749+0000","last_clean":"2024-09-17T05:19:28.218749+0000","last_became_active":"2024-09-17T05:19:27.197627+0000","last_became_peered":"2024-09-17T05:19:27.197627+0000","last_unstale":"2024-09-17T05:19:28.218749+0000","last_undegraded":"2024-09-17T05:19:28.218749+0000","last_fullsized":"2024-09-17T05:19:28.218749+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:30.979081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181479+0000","last_change":"2024-09-17T05:19:26.181479+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181479+0000","last_undegraded":"2024-09-17T05:19:26.181479+0000","last_fullsized":"2024-09-17T05:19:26.181479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.183673+0000","last_change":"2024-09-17T05:19:26.183673+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.183673+0000","last_undegraded":"2024-09-17T05:19:26.183673+0000","last_fullsized":"2024-09-17T05:19:26.183673+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177736+0000","last_change":"2024-09-17T05:19:26.177736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177736+0000","last_undegraded":"2024-09-17T05:19:26.177736+0000","last_fullsized":"2024-09-17T05:19:26.177736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177091+0000","last_change":"2024-09-17T05:19:26.177091+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177091+0000","last_undegraded":"2024-09-17T05:19:26.177091+0000","last_fullsized":"2024-09-17T05:19:26.177091+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181733+0000","last_change":"2024-09-17T05:19:26.181733+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181733+0000","last_undegraded":"2024-09-17T05:19:26.181733+0000","last_fullsized":"2024-09-17T05:19:26.181733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176794+0000","last_change":"2024-09-17T05:19:26.176794+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176794+0000","last_undegraded":"2024-09-17T05:19:26.176794+0000","last_fullsized":"2024-09-17T05:19:26.176794+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181902+0000","last_change":"2024-09-17T05:19:26.181902+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181902+0000","last_undegraded":"2024-09-17T05:19:26.181902+0000","last_fullsized":"2024-09-17T05:19:26.181902+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.188949+0000","last_change":"2024-09-17T05:19:27.190473+0000","last_active":"2024-09-17T05:19:28.188949+0000","last_peered":"2024-09-17T05:19:28.188949+0000","last_clean":"2024-09-17T05:19:28.188949+0000","last_became_active":"2024-09-17T05:19:27.190024+0000","last_became_peered":"2024-09-17T05:19:27.190024+0000","last_unstale":"2024-09-17T05:19:28.188949+0000","last_undegraded":"2024-09-17T05:19:28.188949+0000","last_fullsized":"2024-09-17T05:19:28.188949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:50.891630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181736+0000","last_change":"2024-09-17T05:19:26.181736+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181736+0000","last_undegraded":"2024-09-17T05:19:26.181736+0000","last_fullsized":"2024-09-17T05:19:26.181736+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181287+0000","last_change":"2024-09-17T05:19:26.181287+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181287+0000","last_undegraded":"2024-09-17T05:19:26.181287+0000","last_fullsized":"2024-09-17T05:19:26.181287+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176901+0000","last_change":"2024-09-17T05:19:26.176901+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176901+0000","last_undegraded":"2024-09-17T05:19:26.176901+0000","last_fullsized":"2024-09-17T05:19:26.176901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177148+0000","last_change":"2024-09-17T05:19:26.177148+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177148+0000","last_undegraded":"2024-09-17T05:19:26.177148+0000","last_fullsized":"2024-09-17T05:19:26.177148+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181245+0000","last_change":"2024-09-17T05:19:26.181245+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181245+0000","last_undegraded":"2024-09-17T05:19:26.181245+0000","last_fullsized":"2024-09-17T05:19:26.181245+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181797+0000","last_change":"2024-09-17T05:19:26.181797+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181797+0000","last_undegraded":"2024-09-17T05:19:26.181797+0000","last_fullsized":"2024-09-17T05:19:26.181797+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177239+0000","last_change":"2024-09-17T05:19:26.177239+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177239+0000","last_undegraded":"2024-09-17T05:19:26.177239+0000","last_fullsized":"2024-09-17T05:19:26.177239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177130+0000","last_change":"2024-09-17T05:19:26.177130+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177130+0000","last_undegraded":"2024-09-17T05:19:26.177130+0000","last_fullsized":"2024-09-17T05:19:26.177130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176798+0000","last_change":"2024-09-17T05:19:26.176798+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176798+0000","last_undegraded":"2024-09-17T05:19:26.176798+0000","last_fullsized":"2024-09-17T05:19:26.176798+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176893+0000","last_change":"2024-09-17T05:19:26.176893+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176893+0000","last_undegraded":"2024-09-17T05:19:26.176893+0000","last_fullsized":"2024-09-17T05:19:26.176893+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.220596+0000","last_change":"2024-09-17T05:19:27.194506+0000","last_active":"2024-09-17T05:19:28.220596+0000","last_peered":"2024-09-17T05:19:28.220596+0000","last_clean":"2024-09-17T05:19:28.220596+0000","last_became_active":"2024-09-17T05:19:27.194231+0000","last_became_peered":"2024-09-17T05:19:27.194231+0000","last_unstale":"2024-09-17T05:19:28.220596+0000","last_undegraded":"2024-09-17T05:19:28.220596+0000","last_fullsized":"2024-09-17T05:19:28.220596+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:18.652935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179669+0000","last_change":"2024-09-17T05:19:26.179669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179669+0000","last_undegraded":"2024-09-17T05:19:26.179669+0000","last_fullsized":"2024-09-17T05:19:26.179669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177999+0000","last_change":"2024-09-17T05:19:26.177999+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177999+0000","last_undegraded":"2024-09-17T05:19:26.177999+0000","last_fullsized":"2024-09-17T05:19:26.177999+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181669+0000","last_change":"2024-09-17T05:19:26.181669+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181669+0000","last_undegraded":"2024-09-17T05:19:26.181669+0000","last_fullsized":"2024-09-17T05:19:26.181669+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176498+0000","last_change":"2024-09-17T05:19:26.176498+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176498+0000","last_undegraded":"2024-09-17T05:19:26.176498+0000","last_fullsized":"2024-09-17T05:19:26.176498+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189169+0000","last_change":"2024-09-17T05:19:27.194601+0000","last_active":"2024-09-17T05:19:28.189169+0000","last_peered":"2024-09-17T05:19:28.189169+0000","last_clean":"2024-09-17T05:19:28.189169+0000","last_became_active":"2024-09-17T05:19:27.194321+0000","last_became_peered":"2024-09-17T05:19:27.194321+0000","last_unstale":"2024-09-17T05:19:28.189169+0000","last_undegraded":"2024-09-17T05:19:28.189169+0000","last_fullsized":"2024-09-17T05:19:28.189169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:00.182063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.196591+0000","last_change":"2024-09-17T05:19:28.194603+0000","last_active":"2024-09-17T05:19:28.196591+0000","last_peered":"2024-09-17T05:19:28.196591+0000","last_clean":"2024-09-17T05:19:28.196591+0000","last_became_active":"2024-09-17T05:19:28.194205+0000","last_became_peered":"2024-09-17T05:19:28.194205+0000","last_unstale":"2024-09-17T05:19:28.196591+0000","last_undegraded":"2024-09-17T05:19:28.196591+0000","last_fullsized":"2024-09-17T05:19:28.196591+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:51.961885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176506+0000","last_change":"2024-09-17T05:19:26.176506+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176506+0000","last_undegraded":"2024-09-17T05:19:26.176506+0000","last_fullsized":"2024-09-17T05:19:26.176506+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.189283+0000","last_change":"2024-09-17T05:19:27.192401+0000","last_active":"2024-09-17T05:19:28.189283+0000","last_peered":"2024-09-17T05:19:28.189283+0000","last_clean":"2024-09-17T05:19:28.189283+0000","last_became_active":"2024-09-17T05:19:27.191978+0000","last_became_peered":"2024-09-17T05:19:27.191978+0000","last_unstale":"2024-09-17T05:19:28.189283+0000","last_undegraded":"2024-09-17T05:19:28.189283+0000","last_fullsized":"2024-09-17T05:19:28.189283+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:22.842606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.208339+0000","last_change":"2024-09-17T05:19:28.205962+0000","last_active":"2024-09-17T05:19:28.208339+0000","last_peered":"2024-09-17T05:19:28.208339+0000","last_clean":"2024-09-17T05:19:28.208339+0000","last_became_active":"2024-09-17T05:19:28.205676+0000","last_became_peered":"2024-09-17T05:19:28.205676+0000","last_unstale":"2024-09-17T05:19:28.208339+0000","last_undegraded":"2024-09-17T05:19:28.208339+0000","last_fullsized":"2024-09-17T05:19:28.208339+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:00.921170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.176438+0000","last_change":"2024-09-17T05:19:26.176438+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.176438+0000","last_undegraded":"2024-09-17T05:19:26.176438+0000","last_fullsized":"2024-09-17T05:19:26.176438+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.177049+0000","last_change":"2024-09-17T05:19:26.177049+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.177049+0000","last_undegraded":"2024-09-17T05:19:26.177049+0000","last_fullsized":"2024-09-17T05:19:26.177049+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.181229+0000","last_change":"2024-09-17T05:19:26.181229+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.181229+0000","last_undegraded":"2024-09-17T05:19:26.181229+0000","last_fullsized":"2024-09-17T05:19:26.181229+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:27.172540+0000","last_change":"2024-09-17T05:19:27.172540+0000","last_active":"2024-09-17T05:19:27.172540+0000","last_peered":"2024-09-17T05:19:27.172540+0000","last_clean":"2024-09-17T05:19:27.172540+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:27.172540+0000","last_undegraded":"2024-09-17T05:19:27.172540+0000","last_fullsized":"2024-09-17T05:19:27.172540+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":1,"reported_epoch":31,"state":"creating+peering","last_fresh":"2024-09-17T05:19:26.179660+0000","last_change":"2024-09-17T05:19:26.179660+0000","last_active":"2024-09-17T05:19:26.168287+0000","last_peered":"2024-09-17T05:19:26.168287+0000","last_clean":"2024-09-17T05:19:26.168287+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:26.179660+0000","last_undegraded":"2024-09-17T05:19:26.179660+0000","last_fullsized":"2024-09-17T05:19:26.179660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":123,"reported_epoch":31,"state":"active+clean","last_fresh":"2024-09-17T05:19:26.180559+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:19:26.180559+0000","last_peered":"2024-09-17T05:19:26.180559+0000","last_clean":"2024-09-17T05:19:26.180559+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:19:26.180559+0000","last_undegraded":"2024-09-17T05:19:26.180559+0000","last_fullsized":"2024-09-17T05:19:26.180559+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":8,"acting":8,"num_store_stats":1},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":64,"acting":64,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509454,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":921600,"data_stored":709636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27368,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344472,"statfs":{"total":96636764160,"available":96608739328,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27364,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344476,"statfs":{"total":96636764160,"available":96608743424,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509454,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509453,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":327680,"data_stored":119268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574862,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27956,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343884,"statfs":{"total":96636764160,"available":96608137216,"internally_reserved":0,"allocated":946176,"data_stored":721720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:19:33.033 INFO:tasks.ceph.mds.d.smithi160.stderr:2024-09-17T05:19:33.033+0000 7fce6845c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:19:35.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:19:35.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.707+0000 7f468bf56640 1 -- 172.21.15.81:0/4208337242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c004800 msgr2=0x7f466c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:35.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.707+0000 7f468bf56640 1 --2- 172.21.15.81:0/4208337242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c004800 0x7f466c004c80 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4678009b50 tx=0x7f466c005830 comp rx=0 tx=0).stop 2024-09-17T05:19:35.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.707+0000 7f468bf56640 1 -- 172.21.15.81:0/4208337242 shutdown_connections 2024-09-17T05:19:35.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.707+0000 7f468bf56640 1 --2- 172.21.15.81:0/4208337242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f466c004800 0x7f466c004c80 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:35.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.707+0000 7f468bf56640 1 -- 172.21.15.81:0/4208337242 >> 172.21.15.81:0/4208337242 conn(0x7f46840d3ea0 msgr2=0x7f46840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:35.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.707+0000 7f468bf56640 1 -- 172.21.15.81:0/4208337242 shutdown_connections 2024-09-17T05:19:35.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.707+0000 7f468bf56640 1 -- 172.21.15.81:0/4208337242 wait complete. 2024-09-17T05:19:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.708+0000 7f468bf56640 1 Processor -- start 2024-09-17T05:19:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.708+0000 7f468bf56640 1 -- start start 2024-09-17T05:19:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468bf56640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f466c004800 0x7f468415c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468bf56640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46840b90b0 0x7f4684157f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:35.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468bf56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46840b9530 0x7f4684158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468bf56640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f46840cf9b0 con 0x7f46840b9530 2024-09-17T05:19:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468bf56640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f46841627a0 con 0x7f46840b90b0 2024-09-17T05:19:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468bf56640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f46840cfb30 con 0x7f466c004800 2024-09-17T05:19:35.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46840b9530 0x7f4684158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46840b9530 0x7f4684158490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54058/0 (socket says 172.21.15.81:54058) 2024-09-17T05:19:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 -- 172.21.15.81:0/1244474625 learned_addr learned my addr 172.21.15.81:0/1244474625 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f4689cf2640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f466c004800 0x7f468415c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f46894f1640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46840b90b0 0x7f4684157f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:35.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 -- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f466c004800 msgr2=0x7f468415c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f466c004800 0x7f468415c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 -- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46840b90b0 msgr2=0x7f4684157f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46840b90b0 0x7f4684157f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.709+0000 7f468a4f3640 1 -- 172.21.15.81:0/1244474625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46840b9ae0 con 0x7f46840b9530 2024-09-17T05:19:35.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.710+0000 7f468a4f3640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46840b9530 0x7f4684158490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46840d1c90 tx=0x7f467c001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.710+0000 7f46827fc640 1 -- 172.21.15.81:0/1244474625 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c015020 con 0x7f46840b9530 2024-09-17T05:19:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.710+0000 7f46827fc640 1 -- 172.21.15.81:0/1244474625 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f467c004e50 con 0x7f46840b9530 2024-09-17T05:19:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.710+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46841f83c0 con 0x7f46840b9530 2024-09-17T05:19:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.710+0000 7f46827fc640 1 -- 172.21.15.81:0/1244474625 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f467c0119d0 con 0x7f46840b9530 2024-09-17T05:19:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.710+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46841f8980 con 0x7f46840b9530 2024-09-17T05:19:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.711+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46840d07a0 con 0x7f46840b9530 2024-09-17T05:19:35.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.711+0000 7f46827fc640 1 -- 172.21.15.81:0/1244474625 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f467c018020 con 0x7f46840b9530 2024-09-17T05:19:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.712+0000 7f46827fc640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4670078b90 0x7f467007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.712+0000 7f46827fc640 1 -- 172.21.15.81:0/1244474625 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f467c09b300 con 0x7f46840b9530 2024-09-17T05:19:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.712+0000 7f4689cf2640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4670078b90 0x7f467007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.713+0000 7f4689cf2640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4670078b90 0x7f467007b050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f468406b7a0 tx=0x7f4674001b30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:35.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.716+0000 7f46827fc640 1 -- 172.21.15.81:0/1244474625 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f467c01f020 con 0x7f46840b9530 2024-09-17T05:19:35.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.888+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f46840b3e60 con 0x7f4670078b90 2024-09-17T05:19:35.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.892+0000 7f46827fc640 1 -- 172.21.15.81:0/1244474625 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251925 (secure 0 0 0) 0x7f46840b3e60 con 0x7f4670078b90 2024-09-17T05:19:35.896 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:35.898 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:19:35.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4670078b90 msgr2=0x7f467007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:35.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4670078b90 0x7f467007b050 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f468406b7a0 tx=0x7f4674001b30 comp rx=0 tx=0).stop 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46840b9530 msgr2=0x7f4684158490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46840b9530 0x7f4684158490 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f46840d1c90 tx=0x7f467c001670 comp rx=0 tx=0).stop 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 shutdown_connections 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4670078b90 0x7f467007b050 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f46840b9530 0x7f4684158490 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f46840b90b0 0x7f4684157f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 --2- 172.21.15.81:0/1244474625 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f466c004800 0x7f468415c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:35.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 >> 172.21.15.81:0/1244474625 conn(0x7f46840d3ea0 msgr2=0x7f46840d2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:35.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 shutdown_connections 2024-09-17T05:19:35.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:35.895+0000 7f468bf56640 1 -- 172.21.15.81:0/1244474625 wait complete. 2024-09-17T05:19:35.908 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":58,"stamp":"2024-09-17T05:19:35.384186+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":118,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220388,"kb_used_data":4144,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754332,"statfs":{"total":773094113280,"available":772868435968,"internally_reserved":0,"allocated":4243456,"data_stored":2328372,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":221236784},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001803"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.212102+0000","last_change":"2024-09-17T05:19:28.208241+0000","last_active":"2024-09-17T05:19:28.212102+0000","last_peered":"2024-09-17T05:19:28.212102+0000","last_clean":"2024-09-17T05:19:28.212102+0000","last_became_active":"2024-09-17T05:19:28.207984+0000","last_became_peered":"2024-09-17T05:19:28.207984+0000","last_unstale":"2024-09-17T05:19:28.212102+0000","last_undegraded":"2024-09-17T05:19:28.212102+0000","last_fullsized":"2024-09-17T05:19:28.212102+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:24.743378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190711+0000","last_change":"2024-09-17T05:19:28.201085+0000","last_active":"2024-09-17T05:19:29.190711+0000","last_peered":"2024-09-17T05:19:29.190711+0000","last_clean":"2024-09-17T05:19:29.190711+0000","last_became_active":"2024-09-17T05:19:28.200807+0000","last_became_peered":"2024-09-17T05:19:28.200807+0000","last_unstale":"2024-09-17T05:19:29.190711+0000","last_undegraded":"2024-09-17T05:19:29.190711+0000","last_fullsized":"2024-09-17T05:19:29.190711+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:51.613581+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082889+0000","last_change":"2024-09-17T05:19:28.212286+0000","last_active":"2024-09-17T05:19:30.082889+0000","last_peered":"2024-09-17T05:19:30.082889+0000","last_clean":"2024-09-17T05:19:30.082889+0000","last_became_active":"2024-09-17T05:19:28.209894+0000","last_became_peered":"2024-09-17T05:19:28.209894+0000","last_unstale":"2024-09-17T05:19:30.082889+0000","last_undegraded":"2024-09-17T05:19:30.082889+0000","last_fullsized":"2024-09-17T05:19:30.082889+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:39.817891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.208677+0000","last_change":"2024-09-17T05:19:28.203490+0000","last_active":"2024-09-17T05:19:29.208677+0000","last_peered":"2024-09-17T05:19:29.208677+0000","last_clean":"2024-09-17T05:19:29.208677+0000","last_became_active":"2024-09-17T05:19:28.200605+0000","last_became_peered":"2024-09-17T05:19:28.200605+0000","last_unstale":"2024-09-17T05:19:29.208677+0000","last_undegraded":"2024-09-17T05:19:29.208677+0000","last_fullsized":"2024-09-17T05:19:29.208677+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:28.039059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.209771+0000","last_change":"2024-09-17T05:19:28.208380+0000","last_active":"2024-09-17T05:19:28.209771+0000","last_peered":"2024-09-17T05:19:28.209771+0000","last_clean":"2024-09-17T05:19:28.209771+0000","last_became_active":"2024-09-17T05:19:28.208108+0000","last_became_peered":"2024-09-17T05:19:28.208108+0000","last_unstale":"2024-09-17T05:19:28.209771+0000","last_undegraded":"2024-09-17T05:19:28.209771+0000","last_fullsized":"2024-09-17T05:19:28.209771+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:13.911888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190313+0000","last_change":"2024-09-17T05:19:28.212409+0000","last_active":"2024-09-17T05:19:29.190313+0000","last_peered":"2024-09-17T05:19:29.190313+0000","last_clean":"2024-09-17T05:19:29.190313+0000","last_became_active":"2024-09-17T05:19:28.211440+0000","last_became_peered":"2024-09-17T05:19:28.211440+0000","last_unstale":"2024-09-17T05:19:29.190313+0000","last_undegraded":"2024-09-17T05:19:29.190313+0000","last_fullsized":"2024-09-17T05:19:29.190313+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:15.590285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194187+0000","last_change":"2024-09-17T05:19:28.210575+0000","last_active":"2024-09-17T05:19:29.194187+0000","last_peered":"2024-09-17T05:19:29.194187+0000","last_clean":"2024-09-17T05:19:29.194187+0000","last_became_active":"2024-09-17T05:19:28.208952+0000","last_became_peered":"2024-09-17T05:19:28.208952+0000","last_unstale":"2024-09-17T05:19:29.194187+0000","last_undegraded":"2024-09-17T05:19:29.194187+0000","last_fullsized":"2024-09-17T05:19:29.194187+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:38.678313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.193866+0000","last_change":"2024-09-17T05:19:28.206802+0000","last_active":"2024-09-17T05:19:29.193866+0000","last_peered":"2024-09-17T05:19:29.193866+0000","last_clean":"2024-09-17T05:19:29.193866+0000","last_became_active":"2024-09-17T05:19:28.206499+0000","last_became_peered":"2024-09-17T05:19:28.206499+0000","last_unstale":"2024-09-17T05:19:29.193866+0000","last_undegraded":"2024-09-17T05:19:29.193866+0000","last_fullsized":"2024-09-17T05:19:29.193866+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:22.920536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194798+0000","last_change":"2024-09-17T05:19:28.201279+0000","last_active":"2024-09-17T05:19:29.194798+0000","last_peered":"2024-09-17T05:19:29.194798+0000","last_clean":"2024-09-17T05:19:29.194798+0000","last_became_active":"2024-09-17T05:19:28.197067+0000","last_became_peered":"2024-09-17T05:19:28.197067+0000","last_unstale":"2024-09-17T05:19:29.194798+0000","last_undegraded":"2024-09-17T05:19:29.194798+0000","last_fullsized":"2024-09-17T05:19:29.194798+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:45.170602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.209079+0000","last_change":"2024-09-17T05:19:28.203035+0000","last_active":"2024-09-17T05:19:29.209079+0000","last_peered":"2024-09-17T05:19:29.209079+0000","last_clean":"2024-09-17T05:19:29.209079+0000","last_became_active":"2024-09-17T05:19:28.202550+0000","last_became_peered":"2024-09-17T05:19:28.202550+0000","last_unstale":"2024-09-17T05:19:29.209079+0000","last_undegraded":"2024-09-17T05:19:29.209079+0000","last_fullsized":"2024-09-17T05:19:29.209079+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:22.920536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194735+0000","last_change":"2024-09-17T05:19:28.208138+0000","last_active":"2024-09-17T05:19:29.194735+0000","last_peered":"2024-09-17T05:19:29.194735+0000","last_clean":"2024-09-17T05:19:29.194735+0000","last_became_active":"2024-09-17T05:19:28.207890+0000","last_became_peered":"2024-09-17T05:19:28.207890+0000","last_unstale":"2024-09-17T05:19:29.194735+0000","last_undegraded":"2024-09-17T05:19:29.194735+0000","last_fullsized":"2024-09-17T05:19:29.194735+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:02.357073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082894+0000","last_change":"2024-09-17T05:19:28.209309+0000","last_active":"2024-09-17T05:19:30.082894+0000","last_peered":"2024-09-17T05:19:30.082894+0000","last_clean":"2024-09-17T05:19:30.082894+0000","last_became_active":"2024-09-17T05:19:28.208723+0000","last_became_peered":"2024-09-17T05:19:28.208723+0000","last_unstale":"2024-09-17T05:19:30.082894+0000","last_undegraded":"2024-09-17T05:19:30.082894+0000","last_fullsized":"2024-09-17T05:19:30.082894+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:50:38.678313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.205253+0000","last_change":"2024-09-17T05:19:28.203762+0000","last_active":"2024-09-17T05:19:28.205253+0000","last_peered":"2024-09-17T05:19:28.205253+0000","last_clean":"2024-09-17T05:19:28.205253+0000","last_became_active":"2024-09-17T05:19:28.203464+0000","last_became_peered":"2024-09-17T05:19:28.203464+0000","last_unstale":"2024-09-17T05:19:28.205253+0000","last_undegraded":"2024-09-17T05:19:28.205253+0000","last_fullsized":"2024-09-17T05:19:28.205253+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:59:24.176749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190379+0000","last_change":"2024-09-17T05:19:28.205923+0000","last_active":"2024-09-17T05:19:29.190379+0000","last_peered":"2024-09-17T05:19:29.190379+0000","last_clean":"2024-09-17T05:19:29.190379+0000","last_became_active":"2024-09-17T05:19:28.205643+0000","last_became_peered":"2024-09-17T05:19:28.205643+0000","last_unstale":"2024-09-17T05:19:29.190379+0000","last_undegraded":"2024-09-17T05:19:29.190379+0000","last_fullsized":"2024-09-17T05:19:29.190379+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:02.357073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082923+0000","last_change":"2024-09-17T05:19:28.207273+0000","last_active":"2024-09-17T05:19:30.082923+0000","last_peered":"2024-09-17T05:19:30.082923+0000","last_clean":"2024-09-17T05:19:30.082923+0000","last_became_active":"2024-09-17T05:19:28.206998+0000","last_became_peered":"2024-09-17T05:19:28.206998+0000","last_unstale":"2024-09-17T05:19:30.082923+0000","last_undegraded":"2024-09-17T05:19:30.082923+0000","last_fullsized":"2024-09-17T05:19:30.082923+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:02.420956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194896+0000","last_change":"2024-09-17T05:19:28.213510+0000","last_active":"2024-09-17T05:19:29.194896+0000","last_peered":"2024-09-17T05:19:29.194896+0000","last_clean":"2024-09-17T05:19:29.194896+0000","last_became_active":"2024-09-17T05:19:28.212908+0000","last_became_peered":"2024-09-17T05:19:28.212908+0000","last_unstale":"2024-09-17T05:19:29.194896+0000","last_undegraded":"2024-09-17T05:19:29.194896+0000","last_fullsized":"2024-09-17T05:19:29.194896+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:56.310223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194243+0000","last_change":"2024-09-17T05:19:28.204514+0000","last_active":"2024-09-17T05:19:29.194243+0000","last_peered":"2024-09-17T05:19:29.194243+0000","last_clean":"2024-09-17T05:19:29.194243+0000","last_became_active":"2024-09-17T05:19:28.204251+0000","last_became_peered":"2024-09-17T05:19:28.204251+0000","last_unstale":"2024-09-17T05:19:29.194243+0000","last_undegraded":"2024-09-17T05:19:29.194243+0000","last_fullsized":"2024-09-17T05:19:29.194243+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:35:39.817891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190757+0000","last_change":"2024-09-17T05:19:28.203635+0000","last_active":"2024-09-17T05:19:29.190757+0000","last_peered":"2024-09-17T05:19:29.190757+0000","last_clean":"2024-09-17T05:19:29.190757+0000","last_became_active":"2024-09-17T05:19:28.202557+0000","last_became_peered":"2024-09-17T05:19:28.202557+0000","last_unstale":"2024-09-17T05:19:29.190757+0000","last_undegraded":"2024-09-17T05:19:29.190757+0000","last_fullsized":"2024-09-17T05:19:29.190757+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:27:05.512872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190443+0000","last_change":"2024-09-17T05:19:28.200351+0000","last_active":"2024-09-17T05:19:29.190443+0000","last_peered":"2024-09-17T05:19:29.190443+0000","last_clean":"2024-09-17T05:19:29.190443+0000","last_became_active":"2024-09-17T05:19:28.200082+0000","last_became_peered":"2024-09-17T05:19:28.200082+0000","last_unstale":"2024-09-17T05:19:29.190443+0000","last_undegraded":"2024-09-17T05:19:29.190443+0000","last_fullsized":"2024-09-17T05:19:29.190443+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:56.310223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.213694+0000","last_change":"2024-09-17T05:19:28.209443+0000","last_active":"2024-09-17T05:19:28.213694+0000","last_peered":"2024-09-17T05:19:28.213694+0000","last_clean":"2024-09-17T05:19:28.213694+0000","last_became_active":"2024-09-17T05:19:28.209158+0000","last_became_peered":"2024-09-17T05:19:28.209158+0000","last_unstale":"2024-09-17T05:19:28.213694+0000","last_undegraded":"2024-09-17T05:19:28.213694+0000","last_fullsized":"2024-09-17T05:19:28.213694+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:31:07.904802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.195105+0000","last_change":"2024-09-17T05:19:28.194208+0000","last_active":"2024-09-17T05:19:29.195105+0000","last_peered":"2024-09-17T05:19:29.195105+0000","last_clean":"2024-09-17T05:19:29.195105+0000","last_became_active":"2024-09-17T05:19:28.193907+0000","last_became_peered":"2024-09-17T05:19:28.193907+0000","last_unstale":"2024-09-17T05:19:29.195105+0000","last_undegraded":"2024-09-17T05:19:29.195105+0000","last_fullsized":"2024-09-17T05:19:29.195105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:28.225835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194683+0000","last_change":"2024-09-17T05:19:28.209461+0000","last_active":"2024-09-17T05:19:29.194683+0000","last_peered":"2024-09-17T05:19:29.194683+0000","last_clean":"2024-09-17T05:19:29.194683+0000","last_became_active":"2024-09-17T05:19:28.204871+0000","last_became_peered":"2024-09-17T05:19:28.204871+0000","last_unstale":"2024-09-17T05:19:29.194683+0000","last_undegraded":"2024-09-17T05:19:29.194683+0000","last_fullsized":"2024-09-17T05:19:29.194683+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:25.777556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206378+0000","last_change":"2024-09-17T05:19:28.208077+0000","last_active":"2024-09-17T05:19:29.206378+0000","last_peered":"2024-09-17T05:19:29.206378+0000","last_clean":"2024-09-17T05:19:29.206378+0000","last_became_active":"2024-09-17T05:19:28.207755+0000","last_became_peered":"2024-09-17T05:19:28.207755+0000","last_unstale":"2024-09-17T05:19:29.206378+0000","last_undegraded":"2024-09-17T05:19:29.206378+0000","last_fullsized":"2024-09-17T05:19:29.206378+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:25.760396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082620+0000","last_change":"2024-09-17T05:19:28.207800+0000","last_active":"2024-09-17T05:19:30.082620+0000","last_peered":"2024-09-17T05:19:30.082620+0000","last_clean":"2024-09-17T05:19:30.082620+0000","last_became_active":"2024-09-17T05:19:28.207502+0000","last_became_peered":"2024-09-17T05:19:28.207502+0000","last_unstale":"2024-09-17T05:19:30.082620+0000","last_undegraded":"2024-09-17T05:19:30.082620+0000","last_fullsized":"2024-09-17T05:19:30.082620+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:20.491374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.209109+0000","last_change":"2024-09-17T05:19:28.205795+0000","last_active":"2024-09-17T05:19:29.209109+0000","last_peered":"2024-09-17T05:19:29.209109+0000","last_clean":"2024-09-17T05:19:29.209109+0000","last_became_active":"2024-09-17T05:19:28.205257+0000","last_became_peered":"2024-09-17T05:19:28.205257+0000","last_unstale":"2024-09-17T05:19:29.209109+0000","last_undegraded":"2024-09-17T05:19:29.209109+0000","last_fullsized":"2024-09-17T05:19:29.209109+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:23.357554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190880+0000","last_change":"2024-09-17T05:19:28.204479+0000","last_active":"2024-09-17T05:19:29.190880+0000","last_peered":"2024-09-17T05:19:29.190880+0000","last_clean":"2024-09-17T05:19:29.190880+0000","last_became_active":"2024-09-17T05:19:28.204019+0000","last_became_peered":"2024-09-17T05:19:28.204019+0000","last_unstale":"2024-09-17T05:19:29.190880+0000","last_undegraded":"2024-09-17T05:19:29.190880+0000","last_fullsized":"2024-09-17T05:19:29.190880+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:00.348218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.209082+0000","last_change":"2024-09-17T05:19:28.202835+0000","last_active":"2024-09-17T05:19:29.209082+0000","last_peered":"2024-09-17T05:19:29.209082+0000","last_clean":"2024-09-17T05:19:29.209082+0000","last_became_active":"2024-09-17T05:19:28.200259+0000","last_became_peered":"2024-09-17T05:19:28.200259+0000","last_unstale":"2024-09-17T05:19:29.209082+0000","last_undegraded":"2024-09-17T05:19:29.209082+0000","last_fullsized":"2024-09-17T05:19:29.209082+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:48.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082799+0000","last_change":"2024-09-17T05:19:28.205015+0000","last_active":"2024-09-17T05:19:30.082799+0000","last_peered":"2024-09-17T05:19:30.082799+0000","last_clean":"2024-09-17T05:19:30.082799+0000","last_became_active":"2024-09-17T05:19:28.204729+0000","last_became_peered":"2024-09-17T05:19:28.204729+0000","last_unstale":"2024-09-17T05:19:30.082799+0000","last_undegraded":"2024-09-17T05:19:30.082799+0000","last_fullsized":"2024-09-17T05:19:30.082799+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:04.197688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.195168+0000","last_change":"2024-09-17T05:19:28.204425+0000","last_active":"2024-09-17T05:19:29.195168+0000","last_peered":"2024-09-17T05:19:29.195168+0000","last_clean":"2024-09-17T05:19:29.195168+0000","last_became_active":"2024-09-17T05:19:28.204164+0000","last_became_peered":"2024-09-17T05:19:28.204164+0000","last_unstale":"2024-09-17T05:19:29.195168+0000","last_undegraded":"2024-09-17T05:19:29.195168+0000","last_fullsized":"2024-09-17T05:19:29.195168+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:40.212138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.193842+0000","last_change":"2024-09-17T05:19:28.209533+0000","last_active":"2024-09-17T05:19:29.193842+0000","last_peered":"2024-09-17T05:19:29.193842+0000","last_clean":"2024-09-17T05:19:29.193842+0000","last_became_active":"2024-09-17T05:19:28.209283+0000","last_became_peered":"2024-09-17T05:19:28.209283+0000","last_unstale":"2024-09-17T05:19:29.193842+0000","last_undegraded":"2024-09-17T05:19:29.193842+0000","last_fullsized":"2024-09-17T05:19:29.193842+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:58:48.128453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.209409+0000","last_change":"2024-09-17T05:19:28.205701+0000","last_active":"2024-09-17T05:19:28.209409+0000","last_peered":"2024-09-17T05:19:28.209409+0000","last_clean":"2024-09-17T05:19:28.209409+0000","last_became_active":"2024-09-17T05:19:28.205409+0000","last_became_peered":"2024-09-17T05:19:28.205409+0000","last_unstale":"2024-09-17T05:19:28.209409+0000","last_undegraded":"2024-09-17T05:19:28.209409+0000","last_fullsized":"2024-09-17T05:19:28.209409+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:27.359336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194101+0000","last_change":"2024-09-17T05:19:28.213215+0000","last_active":"2024-09-17T05:19:29.194101+0000","last_peered":"2024-09-17T05:19:29.194101+0000","last_clean":"2024-09-17T05:19:29.194101+0000","last_became_active":"2024-09-17T05:19:28.212607+0000","last_became_peered":"2024-09-17T05:19:28.212607+0000","last_unstale":"2024-09-17T05:19:29.194101+0000","last_undegraded":"2024-09-17T05:19:29.194101+0000","last_fullsized":"2024-09-17T05:19:29.194101+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:04.197688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206509+0000","last_change":"2024-09-17T05:19:28.203798+0000","last_active":"2024-09-17T05:19:29.206509+0000","last_peered":"2024-09-17T05:19:29.206509+0000","last_clean":"2024-09-17T05:19:29.206509+0000","last_became_active":"2024-09-17T05:19:28.203515+0000","last_became_peered":"2024-09-17T05:19:28.203515+0000","last_unstale":"2024-09-17T05:19:29.206509+0000","last_undegraded":"2024-09-17T05:19:29.206509+0000","last_fullsized":"2024-09-17T05:19:29.206509+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:37.036075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"33'4","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.219080+0000","last_change":"2024-09-17T05:19:27.185300+0000","last_active":"2024-09-17T05:19:28.219080+0000","last_peered":"2024-09-17T05:19:28.219080+0000","last_clean":"2024-09-17T05:19:28.219080+0000","last_became_active":"2024-09-17T05:19:27.184994+0000","last_became_peered":"2024-09-17T05:19:27.184994+0000","last_unstale":"2024-09-17T05:19:28.219080+0000","last_undegraded":"2024-09-17T05:19:28.219080+0000","last_fullsized":"2024-09-17T05:19:28.219080+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:08.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.215565+0000","last_change":"2024-09-17T05:19:28.213002+0000","last_active":"2024-09-17T05:19:28.215565+0000","last_peered":"2024-09-17T05:19:28.215565+0000","last_clean":"2024-09-17T05:19:28.215565+0000","last_became_active":"2024-09-17T05:19:28.212743+0000","last_became_peered":"2024-09-17T05:19:28.212743+0000","last_unstale":"2024-09-17T05:19:28.215565+0000","last_undegraded":"2024-09-17T05:19:28.215565+0000","last_fullsized":"2024-09-17T05:19:28.215565+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:02.401641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206481+0000","last_change":"2024-09-17T05:19:27.197891+0000","last_active":"2024-09-17T05:19:29.206481+0000","last_peered":"2024-09-17T05:19:29.206481+0000","last_clean":"2024-09-17T05:19:29.206481+0000","last_became_active":"2024-09-17T05:19:27.197627+0000","last_became_peered":"2024-09-17T05:19:27.197627+0000","last_unstale":"2024-09-17T05:19:29.206481+0000","last_undegraded":"2024-09-17T05:19:29.206481+0000","last_fullsized":"2024-09-17T05:19:29.206481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:30.979081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.195114+0000","last_change":"2024-09-17T05:19:28.210181+0000","last_active":"2024-09-17T05:19:29.195114+0000","last_peered":"2024-09-17T05:19:29.195114+0000","last_clean":"2024-09-17T05:19:29.195114+0000","last_became_active":"2024-09-17T05:19:28.209708+0000","last_became_peered":"2024-09-17T05:19:28.209708+0000","last_unstale":"2024-09-17T05:19:29.195114+0000","last_undegraded":"2024-09-17T05:19:29.195114+0000","last_fullsized":"2024-09-17T05:19:29.195114+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:53.466092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190346+0000","last_change":"2024-09-17T05:19:27.195978+0000","last_active":"2024-09-17T05:19:29.190346+0000","last_peered":"2024-09-17T05:19:29.190346+0000","last_clean":"2024-09-17T05:19:29.190346+0000","last_became_active":"2024-09-17T05:19:27.195724+0000","last_became_peered":"2024-09-17T05:19:27.195724+0000","last_unstale":"2024-09-17T05:19:29.190346+0000","last_undegraded":"2024-09-17T05:19:29.190346+0000","last_fullsized":"2024-09-17T05:19:29.190346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:27.034807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.209105+0000","last_change":"2024-09-17T05:19:28.201303+0000","last_active":"2024-09-17T05:19:29.209105+0000","last_peered":"2024-09-17T05:19:29.209105+0000","last_clean":"2024-09-17T05:19:29.209105+0000","last_became_active":"2024-09-17T05:19:28.199882+0000","last_became_peered":"2024-09-17T05:19:28.199882+0000","last_unstale":"2024-09-17T05:19:29.209105+0000","last_undegraded":"2024-09-17T05:19:29.209105+0000","last_fullsized":"2024-09-17T05:19:29.209105+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:38.288939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"33'2","reported_seq":15,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.219364+0000","last_change":"2024-09-17T05:19:27.196453+0000","last_active":"2024-09-17T05:19:28.219364+0000","last_peered":"2024-09-17T05:19:28.219364+0000","last_clean":"2024-09-17T05:19:28.219364+0000","last_became_active":"2024-09-17T05:19:27.196095+0000","last_became_peered":"2024-09-17T05:19:27.196095+0000","last_unstale":"2024-09-17T05:19:28.219364+0000","last_undegraded":"2024-09-17T05:19:28.219364+0000","last_fullsized":"2024-09-17T05:19:28.219364+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:02:47.838973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194433+0000","last_change":"2024-09-17T05:19:28.213000+0000","last_active":"2024-09-17T05:19:29.194433+0000","last_peered":"2024-09-17T05:19:29.194433+0000","last_clean":"2024-09-17T05:19:29.194433+0000","last_became_active":"2024-09-17T05:19:28.212710+0000","last_became_peered":"2024-09-17T05:19:28.212710+0000","last_unstale":"2024-09-17T05:19:29.194433+0000","last_undegraded":"2024-09-17T05:19:29.194433+0000","last_fullsized":"2024-09-17T05:19:29.194433+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:38.806986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.195167+0000","last_change":"2024-09-17T05:19:27.193603+0000","last_active":"2024-09-17T05:19:29.195167+0000","last_peered":"2024-09-17T05:19:29.195167+0000","last_clean":"2024-09-17T05:19:29.195167+0000","last_became_active":"2024-09-17T05:19:27.193350+0000","last_became_peered":"2024-09-17T05:19:27.193350+0000","last_unstale":"2024-09-17T05:19:29.195167+0000","last_undegraded":"2024-09-17T05:19:29.195167+0000","last_fullsized":"2024-09-17T05:19:29.195167+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:06.861073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082884+0000","last_change":"2024-09-17T05:19:28.211142+0000","last_active":"2024-09-17T05:19:30.082884+0000","last_peered":"2024-09-17T05:19:30.082884+0000","last_clean":"2024-09-17T05:19:30.082884+0000","last_became_active":"2024-09-17T05:19:28.210850+0000","last_became_peered":"2024-09-17T05:19:28.210850+0000","last_unstale":"2024-09-17T05:19:30.082884+0000","last_undegraded":"2024-09-17T05:19:30.082884+0000","last_fullsized":"2024-09-17T05:19:30.082884+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:23.357554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194773+0000","last_change":"2024-09-17T05:19:27.192875+0000","last_active":"2024-09-17T05:19:29.194773+0000","last_peered":"2024-09-17T05:19:29.194773+0000","last_clean":"2024-09-17T05:19:29.194773+0000","last_became_active":"2024-09-17T05:19:27.192543+0000","last_became_peered":"2024-09-17T05:19:27.192543+0000","last_unstale":"2024-09-17T05:19:29.194773+0000","last_undegraded":"2024-09-17T05:19:29.194773+0000","last_fullsized":"2024-09-17T05:19:29.194773+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:06.759104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194184+0000","last_change":"2024-09-17T05:19:28.199203+0000","last_active":"2024-09-17T05:19:29.194184+0000","last_peered":"2024-09-17T05:19:29.194184+0000","last_clean":"2024-09-17T05:19:29.194184+0000","last_became_active":"2024-09-17T05:19:28.198922+0000","last_became_peered":"2024-09-17T05:19:28.198922+0000","last_unstale":"2024-09-17T05:19:29.194184+0000","last_undegraded":"2024-09-17T05:19:29.194184+0000","last_fullsized":"2024-09-17T05:19:29.194184+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:04.182289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190007+0000","last_change":"2024-09-17T05:19:27.186963+0000","last_active":"2024-09-17T05:19:29.190007+0000","last_peered":"2024-09-17T05:19:29.190007+0000","last_clean":"2024-09-17T05:19:29.190007+0000","last_became_active":"2024-09-17T05:19:27.186611+0000","last_became_peered":"2024-09-17T05:19:27.186611+0000","last_unstale":"2024-09-17T05:19:29.190007+0000","last_undegraded":"2024-09-17T05:19:29.190007+0000","last_fullsized":"2024-09-17T05:19:29.190007+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:50.905730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.208541+0000","last_change":"2024-09-17T05:19:28.202966+0000","last_active":"2024-09-17T05:19:29.208541+0000","last_peered":"2024-09-17T05:19:29.208541+0000","last_clean":"2024-09-17T05:19:29.208541+0000","last_became_active":"2024-09-17T05:19:28.202204+0000","last_became_peered":"2024-09-17T05:19:28.202204+0000","last_unstale":"2024-09-17T05:19:29.208541+0000","last_undegraded":"2024-09-17T05:19:29.208541+0000","last_fullsized":"2024-09-17T05:19:29.208541+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:25.777556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194251+0000","last_change":"2024-09-17T05:19:27.197957+0000","last_active":"2024-09-17T05:19:29.194251+0000","last_peered":"2024-09-17T05:19:29.194251+0000","last_clean":"2024-09-17T05:19:29.194251+0000","last_became_active":"2024-09-17T05:19:27.197562+0000","last_became_peered":"2024-09-17T05:19:27.197562+0000","last_unstale":"2024-09-17T05:19:29.194251+0000","last_undegraded":"2024-09-17T05:19:29.194251+0000","last_fullsized":"2024-09-17T05:19:29.194251+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:20:26.075186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.083028+0000","last_change":"2024-09-17T05:19:28.209617+0000","last_active":"2024-09-17T05:19:30.083028+0000","last_peered":"2024-09-17T05:19:30.083028+0000","last_clean":"2024-09-17T05:19:30.083028+0000","last_became_active":"2024-09-17T05:19:28.209335+0000","last_became_peered":"2024-09-17T05:19:28.209335+0000","last_unstale":"2024-09-17T05:19:30.083028+0000","last_undegraded":"2024-09-17T05:19:30.083028+0000","last_fullsized":"2024-09-17T05:19:30.083028+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:19.300494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190689+0000","last_change":"2024-09-17T05:19:27.192139+0000","last_active":"2024-09-17T05:19:29.190689+0000","last_peered":"2024-09-17T05:19:29.190689+0000","last_clean":"2024-09-17T05:19:29.190689+0000","last_became_active":"2024-09-17T05:19:27.191864+0000","last_became_peered":"2024-09-17T05:19:27.191864+0000","last_unstale":"2024-09-17T05:19:29.190689+0000","last_undegraded":"2024-09-17T05:19:29.190689+0000","last_fullsized":"2024-09-17T05:19:29.190689+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:21.400022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190826+0000","last_change":"2024-09-17T05:19:28.202117+0000","last_active":"2024-09-17T05:19:29.190826+0000","last_peered":"2024-09-17T05:19:29.190826+0000","last_clean":"2024-09-17T05:19:29.190826+0000","last_became_active":"2024-09-17T05:19:28.201731+0000","last_became_peered":"2024-09-17T05:19:28.201731+0000","last_unstale":"2024-09-17T05:19:29.190826+0000","last_undegraded":"2024-09-17T05:19:29.190826+0000","last_fullsized":"2024-09-17T05:19:29.190826+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:20.896084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206580+0000","last_change":"2024-09-17T05:19:27.190473+0000","last_active":"2024-09-17T05:19:29.206580+0000","last_peered":"2024-09-17T05:19:29.206580+0000","last_clean":"2024-09-17T05:19:29.206580+0000","last_became_active":"2024-09-17T05:19:27.190024+0000","last_became_peered":"2024-09-17T05:19:27.190024+0000","last_unstale":"2024-09-17T05:19:29.206580+0000","last_undegraded":"2024-09-17T05:19:29.206580+0000","last_fullsized":"2024-09-17T05:19:29.206580+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:32:50.891630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190557+0000","last_change":"2024-09-17T05:19:28.209416+0000","last_active":"2024-09-17T05:19:29.190557+0000","last_peered":"2024-09-17T05:19:29.190557+0000","last_clean":"2024-09-17T05:19:29.190557+0000","last_became_active":"2024-09-17T05:19:28.208923+0000","last_became_peered":"2024-09-17T05:19:28.208923+0000","last_unstale":"2024-09-17T05:19:29.190557+0000","last_undegraded":"2024-09-17T05:19:29.190557+0000","last_fullsized":"2024-09-17T05:19:29.190557+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:55.640883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"33'3","reported_seq":18,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082974+0000","last_change":"2024-09-17T05:19:27.192466+0000","last_active":"2024-09-17T05:19:30.082974+0000","last_peered":"2024-09-17T05:19:30.082974+0000","last_clean":"2024-09-17T05:19:30.082974+0000","last_became_active":"2024-09-17T05:19:27.192182+0000","last_became_peered":"2024-09-17T05:19:27.192182+0000","last_unstale":"2024-09-17T05:19:30.082974+0000","last_undegraded":"2024-09-17T05:19:30.082974+0000","last_fullsized":"2024-09-17T05:19:30.082974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:43.860873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082898+0000","last_change":"2024-09-17T05:19:28.211985+0000","last_active":"2024-09-17T05:19:30.082898+0000","last_peered":"2024-09-17T05:19:30.082898+0000","last_clean":"2024-09-17T05:19:30.082898+0000","last_became_active":"2024-09-17T05:19:28.210118+0000","last_became_peered":"2024-09-17T05:19:28.210118+0000","last_unstale":"2024-09-17T05:19:30.082898+0000","last_undegraded":"2024-09-17T05:19:30.082898+0000","last_fullsized":"2024-09-17T05:19:30.082898+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:44.728391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"33'6","reported_seq":21,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190435+0000","last_change":"2024-09-17T05:19:27.196395+0000","last_active":"2024-09-17T05:19:29.190435+0000","last_peered":"2024-09-17T05:19:29.190435+0000","last_clean":"2024-09-17T05:19:29.190435+0000","last_became_active":"2024-09-17T05:19:27.195683+0000","last_became_peered":"2024-09-17T05:19:27.195683+0000","last_unstale":"2024-09-17T05:19:29.190435+0000","last_undegraded":"2024-09-17T05:19:29.190435+0000","last_fullsized":"2024-09-17T05:19:29.190435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:09.746744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.208537+0000","last_change":"2024-09-17T05:19:28.211659+0000","last_active":"2024-09-17T05:19:29.208537+0000","last_peered":"2024-09-17T05:19:29.208537+0000","last_clean":"2024-09-17T05:19:29.208537+0000","last_became_active":"2024-09-17T05:19:28.211017+0000","last_became_peered":"2024-09-17T05:19:28.211017+0000","last_unstale":"2024-09-17T05:19:29.208537+0000","last_undegraded":"2024-09-17T05:19:29.208537+0000","last_fullsized":"2024-09-17T05:19:29.208537+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:04.477836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.195210+0000","last_change":"2024-09-17T05:19:27.192759+0000","last_active":"2024-09-17T05:19:29.195210+0000","last_peered":"2024-09-17T05:19:29.195210+0000","last_clean":"2024-09-17T05:19:29.195210+0000","last_became_active":"2024-09-17T05:19:27.192385+0000","last_became_peered":"2024-09-17T05:19:27.192385+0000","last_unstale":"2024-09-17T05:19:29.195210+0000","last_undegraded":"2024-09-17T05:19:29.195210+0000","last_fullsized":"2024-09-17T05:19:29.195210+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:31.270545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190625+0000","last_change":"2024-09-17T05:19:28.196131+0000","last_active":"2024-09-17T05:19:29.190625+0000","last_peered":"2024-09-17T05:19:29.190625+0000","last_clean":"2024-09-17T05:19:29.190625+0000","last_became_active":"2024-09-17T05:19:28.195676+0000","last_became_peered":"2024-09-17T05:19:28.195676+0000","last_unstale":"2024-09-17T05:19:29.190625+0000","last_undegraded":"2024-09-17T05:19:29.190625+0000","last_fullsized":"2024-09-17T05:19:29.190625+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:18.976268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.208451+0000","last_change":"2024-09-17T05:19:27.194228+0000","last_active":"2024-09-17T05:19:29.208451+0000","last_peered":"2024-09-17T05:19:29.208451+0000","last_clean":"2024-09-17T05:19:29.208451+0000","last_became_active":"2024-09-17T05:19:27.193209+0000","last_became_peered":"2024-09-17T05:19:27.193209+0000","last_unstale":"2024-09-17T05:19:29.208451+0000","last_undegraded":"2024-09-17T05:19:29.208451+0000","last_fullsized":"2024-09-17T05:19:29.208451+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:43.512826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194272+0000","last_change":"2024-09-17T05:19:28.213764+0000","last_active":"2024-09-17T05:19:29.194272+0000","last_peered":"2024-09-17T05:19:29.194272+0000","last_clean":"2024-09-17T05:19:29.194272+0000","last_became_active":"2024-09-17T05:19:28.212959+0000","last_became_peered":"2024-09-17T05:19:28.212959+0000","last_unstale":"2024-09-17T05:19:29.194272+0000","last_undegraded":"2024-09-17T05:19:29.194272+0000","last_fullsized":"2024-09-17T05:19:29.194272+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:44.728391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190071+0000","last_change":"2024-09-17T05:19:27.192058+0000","last_active":"2024-09-17T05:19:29.190071+0000","last_peered":"2024-09-17T05:19:29.190071+0000","last_clean":"2024-09-17T05:19:29.190071+0000","last_became_active":"2024-09-17T05:19:27.191778+0000","last_became_peered":"2024-09-17T05:19:27.191778+0000","last_unstale":"2024-09-17T05:19:29.190071+0000","last_undegraded":"2024-09-17T05:19:29.190071+0000","last_fullsized":"2024-09-17T05:19:29.190071+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:26:37.657820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.215693+0000","last_change":"2024-09-17T05:19:28.214254+0000","last_active":"2024-09-17T05:19:28.215693+0000","last_peered":"2024-09-17T05:19:28.215693+0000","last_clean":"2024-09-17T05:19:28.215693+0000","last_became_active":"2024-09-17T05:19:28.213973+0000","last_became_peered":"2024-09-17T05:19:28.213973+0000","last_unstale":"2024-09-17T05:19:28.215693+0000","last_undegraded":"2024-09-17T05:19:28.215693+0000","last_fullsized":"2024-09-17T05:19:28.215693+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:53.168105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"33'8","reported_seq":23,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190026+0000","last_change":"2024-09-17T05:19:27.197099+0000","last_active":"2024-09-17T05:19:29.190026+0000","last_peered":"2024-09-17T05:19:29.190026+0000","last_clean":"2024-09-17T05:19:29.190026+0000","last_became_active":"2024-09-17T05:19:27.196789+0000","last_became_peered":"2024-09-17T05:19:27.196789+0000","last_unstale":"2024-09-17T05:19:29.190026+0000","last_undegraded":"2024-09-17T05:19:29.190026+0000","last_fullsized":"2024-09-17T05:19:29.190026+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:43.860873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194465+0000","last_change":"2024-09-17T05:19:28.202495+0000","last_active":"2024-09-17T05:19:29.194465+0000","last_peered":"2024-09-17T05:19:29.194465+0000","last_clean":"2024-09-17T05:19:29.194465+0000","last_became_active":"2024-09-17T05:19:28.202229+0000","last_became_peered":"2024-09-17T05:19:28.202229+0000","last_unstale":"2024-09-17T05:19:29.194465+0000","last_undegraded":"2024-09-17T05:19:29.194465+0000","last_fullsized":"2024-09-17T05:19:29.194465+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:22:11.991422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.209098+0000","last_change":"2024-09-17T05:19:27.193919+0000","last_active":"2024-09-17T05:19:29.209098+0000","last_peered":"2024-09-17T05:19:29.209098+0000","last_clean":"2024-09-17T05:19:29.209098+0000","last_became_active":"2024-09-17T05:19:27.193500+0000","last_became_peered":"2024-09-17T05:19:27.193500+0000","last_unstale":"2024-09-17T05:19:29.209098+0000","last_undegraded":"2024-09-17T05:19:29.209098+0000","last_fullsized":"2024-09-17T05:19:29.209098+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:08.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.083134+0000","last_change":"2024-09-17T05:19:28.216389+0000","last_active":"2024-09-17T05:19:30.083134+0000","last_peered":"2024-09-17T05:19:30.083134+0000","last_clean":"2024-09-17T05:19:30.083134+0000","last_became_active":"2024-09-17T05:19:28.216058+0000","last_became_peered":"2024-09-17T05:19:28.216058+0000","last_unstale":"2024-09-17T05:19:30.083134+0000","last_undegraded":"2024-09-17T05:19:30.083134+0000","last_fullsized":"2024-09-17T05:19:30.083134+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:10.822021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194537+0000","last_change":"2024-09-17T05:19:27.198125+0000","last_active":"2024-09-17T05:19:29.194537+0000","last_peered":"2024-09-17T05:19:29.194537+0000","last_clean":"2024-09-17T05:19:29.194537+0000","last_became_active":"2024-09-17T05:19:27.197807+0000","last_became_peered":"2024-09-17T05:19:27.197807+0000","last_unstale":"2024-09-17T05:19:29.194537+0000","last_undegraded":"2024-09-17T05:19:29.194537+0000","last_fullsized":"2024-09-17T05:19:29.194537+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:55:08.883382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.208707+0000","last_change":"2024-09-17T05:19:28.203432+0000","last_active":"2024-09-17T05:19:29.208707+0000","last_peered":"2024-09-17T05:19:29.208707+0000","last_clean":"2024-09-17T05:19:29.208707+0000","last_became_active":"2024-09-17T05:19:28.200205+0000","last_became_peered":"2024-09-17T05:19:28.200205+0000","last_unstale":"2024-09-17T05:19:29.208707+0000","last_undegraded":"2024-09-17T05:19:29.208707+0000","last_fullsized":"2024-09-17T05:19:29.208707+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:22.867598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"33'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194551+0000","last_change":"2024-09-17T05:19:27.191196+0000","last_active":"2024-09-17T05:19:29.194551+0000","last_peered":"2024-09-17T05:19:29.194551+0000","last_clean":"2024-09-17T05:19:29.194551+0000","last_became_active":"2024-09-17T05:19:27.190939+0000","last_became_peered":"2024-09-17T05:19:27.190939+0000","last_unstale":"2024-09-17T05:19:29.194551+0000","last_undegraded":"2024-09-17T05:19:29.194551+0000","last_fullsized":"2024-09-17T05:19:29.194551+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:26.355083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.213510+0000","last_change":"2024-09-17T05:19:28.208886+0000","last_active":"2024-09-17T05:19:28.213510+0000","last_peered":"2024-09-17T05:19:28.213510+0000","last_clean":"2024-09-17T05:19:28.213510+0000","last_became_active":"2024-09-17T05:19:28.208603+0000","last_became_peered":"2024-09-17T05:19:28.208603+0000","last_unstale":"2024-09-17T05:19:28.213510+0000","last_undegraded":"2024-09-17T05:19:28.213510+0000","last_fullsized":"2024-09-17T05:19:28.213510+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:46.888362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194904+0000","last_change":"2024-09-17T05:19:27.193055+0000","last_active":"2024-09-17T05:19:29.194904+0000","last_peered":"2024-09-17T05:19:29.194904+0000","last_clean":"2024-09-17T05:19:29.194904+0000","last_became_active":"2024-09-17T05:19:27.192740+0000","last_became_peered":"2024-09-17T05:19:27.192740+0000","last_unstale":"2024-09-17T05:19:29.194904+0000","last_undegraded":"2024-09-17T05:19:29.194904+0000","last_fullsized":"2024-09-17T05:19:29.194904+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:57.117161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.215370+0000","last_change":"2024-09-17T05:19:28.214259+0000","last_active":"2024-09-17T05:19:28.215370+0000","last_peered":"2024-09-17T05:19:28.215370+0000","last_clean":"2024-09-17T05:19:28.215370+0000","last_became_active":"2024-09-17T05:19:28.213951+0000","last_became_peered":"2024-09-17T05:19:28.213951+0000","last_unstale":"2024-09-17T05:19:28.215370+0000","last_undegraded":"2024-09-17T05:19:28.215370+0000","last_fullsized":"2024-09-17T05:19:28.215370+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:36.710401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206516+0000","last_change":"2024-09-17T05:19:27.194506+0000","last_active":"2024-09-17T05:19:29.206516+0000","last_peered":"2024-09-17T05:19:29.206516+0000","last_clean":"2024-09-17T05:19:29.206516+0000","last_became_active":"2024-09-17T05:19:27.194231+0000","last_became_peered":"2024-09-17T05:19:27.194231+0000","last_unstale":"2024-09-17T05:19:29.206516+0000","last_undegraded":"2024-09-17T05:19:29.206516+0000","last_fullsized":"2024-09-17T05:19:29.206516+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:09:18.652935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.214118+0000","last_change":"2024-09-17T05:19:28.211048+0000","last_active":"2024-09-17T05:19:28.214118+0000","last_peered":"2024-09-17T05:19:28.214118+0000","last_clean":"2024-09-17T05:19:28.214118+0000","last_became_active":"2024-09-17T05:19:28.210782+0000","last_became_peered":"2024-09-17T05:19:28.210782+0000","last_unstale":"2024-09-17T05:19:28.214118+0000","last_undegraded":"2024-09-17T05:19:28.214118+0000","last_fullsized":"2024-09-17T05:19:28.214118+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:07.264218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.196177+0000","last_change":"2024-09-17T05:19:27.194599+0000","last_active":"2024-09-17T05:19:28.196177+0000","last_peered":"2024-09-17T05:19:28.196177+0000","last_clean":"2024-09-17T05:19:28.196177+0000","last_became_active":"2024-09-17T05:19:27.194318+0000","last_became_peered":"2024-09-17T05:19:27.194318+0000","last_unstale":"2024-09-17T05:19:28.196177+0000","last_undegraded":"2024-09-17T05:19:28.196177+0000","last_fullsized":"2024-09-17T05:19:28.196177+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:06.861073+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.214078+0000","last_change":"2024-09-17T05:19:28.210924+0000","last_active":"2024-09-17T05:19:28.214078+0000","last_peered":"2024-09-17T05:19:28.214078+0000","last_clean":"2024-09-17T05:19:28.214078+0000","last_became_active":"2024-09-17T05:19:28.210657+0000","last_became_peered":"2024-09-17T05:19:28.210657+0000","last_unstale":"2024-09-17T05:19:28.214078+0000","last_undegraded":"2024-09-17T05:19:28.214078+0000","last_fullsized":"2024-09-17T05:19:28.214078+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:13.308054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194063+0000","last_change":"2024-09-17T05:19:27.194641+0000","last_active":"2024-09-17T05:19:29.194063+0000","last_peered":"2024-09-17T05:19:29.194063+0000","last_clean":"2024-09-17T05:19:29.194063+0000","last_became_active":"2024-09-17T05:19:27.194303+0000","last_became_peered":"2024-09-17T05:19:27.194303+0000","last_unstale":"2024-09-17T05:19:29.194063+0000","last_undegraded":"2024-09-17T05:19:29.194063+0000","last_fullsized":"2024-09-17T05:19:29.194063+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:36.822093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.193947+0000","last_change":"2024-09-17T05:19:28.210314+0000","last_active":"2024-09-17T05:19:29.193947+0000","last_peered":"2024-09-17T05:19:29.193947+0000","last_clean":"2024-09-17T05:19:29.193947+0000","last_became_active":"2024-09-17T05:19:28.208611+0000","last_became_peered":"2024-09-17T05:19:28.208611+0000","last_unstale":"2024-09-17T05:19:29.193947+0000","last_undegraded":"2024-09-17T05:19:29.193947+0000","last_fullsized":"2024-09-17T05:19:29.193947+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:38.288939+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.082397+0000","last_change":"2024-09-17T05:19:27.193226+0000","last_active":"2024-09-17T05:19:30.082397+0000","last_peered":"2024-09-17T05:19:30.082397+0000","last_clean":"2024-09-17T05:19:30.082397+0000","last_became_active":"2024-09-17T05:19:27.192955+0000","last_became_peered":"2024-09-17T05:19:27.192955+0000","last_unstale":"2024-09-17T05:19:30.082397+0000","last_undegraded":"2024-09-17T05:19:30.082397+0000","last_fullsized":"2024-09-17T05:19:30.082397+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:50.905730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.218983+0000","last_change":"2024-09-17T05:19:28.215894+0000","last_active":"2024-09-17T05:19:28.218983+0000","last_peered":"2024-09-17T05:19:28.218983+0000","last_clean":"2024-09-17T05:19:28.218983+0000","last_became_active":"2024-09-17T05:19:28.215644+0000","last_became_peered":"2024-09-17T05:19:28.215644+0000","last_unstale":"2024-09-17T05:19:28.218983+0000","last_undegraded":"2024-09-17T05:19:28.218983+0000","last_fullsized":"2024-09-17T05:19:28.218983+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:22.213231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"33'2","reported_seq":17,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.209153+0000","last_change":"2024-09-17T05:19:27.193704+0000","last_active":"2024-09-17T05:19:29.209153+0000","last_peered":"2024-09-17T05:19:29.209153+0000","last_clean":"2024-09-17T05:19:29.209153+0000","last_became_active":"2024-09-17T05:19:27.193314+0000","last_became_peered":"2024-09-17T05:19:27.193314+0000","last_unstale":"2024-09-17T05:19:29.209153+0000","last_undegraded":"2024-09-17T05:19:29.209153+0000","last_fullsized":"2024-09-17T05:19:29.209153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:26.355083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:30.083188+0000","last_change":"2024-09-17T05:19:28.203330+0000","last_active":"2024-09-17T05:19:30.083188+0000","last_peered":"2024-09-17T05:19:30.083188+0000","last_clean":"2024-09-17T05:19:30.083188+0000","last_became_active":"2024-09-17T05:19:28.202708+0000","last_became_peered":"2024-09-17T05:19:28.202708+0000","last_unstale":"2024-09-17T05:19:30.083188+0000","last_undegraded":"2024-09-17T05:19:30.083188+0000","last_fullsized":"2024-09-17T05:19:30.083188+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:20.371272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"34'1","reported_seq":16,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206631+0000","last_change":"2024-09-17T05:19:27.194601+0000","last_active":"2024-09-17T05:19:29.206631+0000","last_peered":"2024-09-17T05:19:29.206631+0000","last_clean":"2024-09-17T05:19:29.206631+0000","last_became_active":"2024-09-17T05:19:27.194321+0000","last_became_peered":"2024-09-17T05:19:27.194321+0000","last_unstale":"2024-09-17T05:19:29.206631+0000","last_undegraded":"2024-09-17T05:19:29.206631+0000","last_fullsized":"2024-09-17T05:19:29.206631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:30:00.182063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206441+0000","last_change":"2024-09-17T05:19:28.194603+0000","last_active":"2024-09-17T05:19:29.206441+0000","last_peered":"2024-09-17T05:19:29.206441+0000","last_clean":"2024-09-17T05:19:29.206441+0000","last_became_active":"2024-09-17T05:19:28.194205+0000","last_became_peered":"2024-09-17T05:19:28.194205+0000","last_unstale":"2024-09-17T05:19:29.206441+0000","last_undegraded":"2024-09-17T05:19:29.206441+0000","last_fullsized":"2024-09-17T05:19:29.206441+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:05:49.014412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.208754+0000","last_change":"2024-09-17T05:19:27.194291+0000","last_active":"2024-09-17T05:19:29.208754+0000","last_peered":"2024-09-17T05:19:29.208754+0000","last_clean":"2024-09-17T05:19:29.208754+0000","last_became_active":"2024-09-17T05:19:27.193540+0000","last_became_peered":"2024-09-17T05:19:27.193540+0000","last_unstale":"2024-09-17T05:19:29.208754+0000","last_undegraded":"2024-09-17T05:19:29.208754+0000","last_fullsized":"2024-09-17T05:19:29.208754+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:26:01.397388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.212331+0000","last_change":"2024-09-17T05:19:28.206227+0000","last_active":"2024-09-17T05:19:28.212331+0000","last_peered":"2024-09-17T05:19:28.212331+0000","last_clean":"2024-09-17T05:19:28.212331+0000","last_became_active":"2024-09-17T05:19:28.205914+0000","last_became_peered":"2024-09-17T05:19:28.205914+0000","last_unstale":"2024-09-17T05:19:28.212331+0000","last_undegraded":"2024-09-17T05:19:28.212331+0000","last_fullsized":"2024-09-17T05:19:28.212331+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:44.517079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206681+0000","last_change":"2024-09-17T05:19:27.192401+0000","last_active":"2024-09-17T05:19:29.206681+0000","last_peered":"2024-09-17T05:19:29.206681+0000","last_clean":"2024-09-17T05:19:29.206681+0000","last_became_active":"2024-09-17T05:19:27.191978+0000","last_became_peered":"2024-09-17T05:19:27.191978+0000","last_unstale":"2024-09-17T05:19:29.206681+0000","last_undegraded":"2024-09-17T05:19:29.206681+0000","last_fullsized":"2024-09-17T05:19:29.206681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:22.842606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.206566+0000","last_change":"2024-09-17T05:19:28.205962+0000","last_active":"2024-09-17T05:19:29.206566+0000","last_peered":"2024-09-17T05:19:29.206566+0000","last_clean":"2024-09-17T05:19:29.206566+0000","last_became_active":"2024-09-17T05:19:28.205676+0000","last_became_peered":"2024-09-17T05:19:28.205676+0000","last_unstale":"2024-09-17T05:19:29.206566+0000","last_undegraded":"2024-09-17T05:19:29.206566+0000","last_fullsized":"2024-09-17T05:19:29.206566+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:18.248594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.208554+0000","last_change":"2024-09-17T05:19:27.195079+0000","last_active":"2024-09-17T05:19:29.208554+0000","last_peered":"2024-09-17T05:19:29.208554+0000","last_clean":"2024-09-17T05:19:29.208554+0000","last_became_active":"2024-09-17T05:19:27.194876+0000","last_became_peered":"2024-09-17T05:19:27.194876+0000","last_unstale":"2024-09-17T05:19:29.208554+0000","last_undegraded":"2024-09-17T05:19:29.208554+0000","last_fullsized":"2024-09-17T05:19:29.208554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:03:23.739126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190108+0000","last_change":"2024-09-17T05:19:28.196865+0000","last_active":"2024-09-17T05:19:29.190108+0000","last_peered":"2024-09-17T05:19:29.190108+0000","last_clean":"2024-09-17T05:19:29.190108+0000","last_became_active":"2024-09-17T05:19:28.196531+0000","last_became_peered":"2024-09-17T05:19:28.196531+0000","last_unstale":"2024-09-17T05:19:29.190108+0000","last_undegraded":"2024-09-17T05:19:29.190108+0000","last_fullsized":"2024-09-17T05:19:29.190108+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:04:38.806986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194168+0000","last_change":"2024-09-17T05:19:27.195178+0000","last_active":"2024-09-17T05:19:29.194168+0000","last_peered":"2024-09-17T05:19:29.194168+0000","last_clean":"2024-09-17T05:19:29.194168+0000","last_became_active":"2024-09-17T05:19:27.194852+0000","last_became_peered":"2024-09-17T05:19:27.194852+0000","last_unstale":"2024-09-17T05:19:29.194168+0000","last_undegraded":"2024-09-17T05:19:29.194168+0000","last_fullsized":"2024-09-17T05:19:29.194168+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:44.246389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.193995+0000","last_change":"2024-09-17T05:19:28.206906+0000","last_active":"2024-09-17T05:19:29.193995+0000","last_peered":"2024-09-17T05:19:29.193995+0000","last_clean":"2024-09-17T05:19:29.193995+0000","last_became_active":"2024-09-17T05:19:28.206626+0000","last_became_peered":"2024-09-17T05:19:28.206626+0000","last_unstale":"2024-09-17T05:19:29.193995+0000","last_undegraded":"2024-09-17T05:19:29.193995+0000","last_fullsized":"2024-09-17T05:19:29.193995+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:27.108637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":15,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.190134+0000","last_change":"2024-09-17T05:19:27.193490+0000","last_active":"2024-09-17T05:19:29.190134+0000","last_peered":"2024-09-17T05:19:29.190134+0000","last_clean":"2024-09-17T05:19:29.190134+0000","last_became_active":"2024-09-17T05:19:27.192802+0000","last_became_peered":"2024-09-17T05:19:27.192802+0000","last_unstale":"2024-09-17T05:19:29.190134+0000","last_undegraded":"2024-09-17T05:19:29.190134+0000","last_fullsized":"2024-09-17T05:19:29.190134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:06.661794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":13,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194594+0000","last_change":"2024-09-17T05:19:28.210046+0000","last_active":"2024-09-17T05:19:29.194594+0000","last_peered":"2024-09-17T05:19:29.194594+0000","last_clean":"2024-09-17T05:19:29.194594+0000","last_became_active":"2024-09-17T05:19:28.209782+0000","last_became_peered":"2024-09-17T05:19:28.209782+0000","last_unstale":"2024-09-17T05:19:29.194594+0000","last_undegraded":"2024-09-17T05:19:29.194594+0000","last_fullsized":"2024-09-17T05:19:29.194594+0000","mapping_epoch":32,"log_start":"0'0","ondisk_log_start":"0'0","created":32,"last_epoch_clean":33,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:27.172540+0000","last_clean_scrub_stamp":"2024-09-17T05:19:27.172540+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:17:15.590285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2024-09-17T05:19:28.196112+0000","last_change":"2024-09-17T05:19:27.189861+0000","last_active":"2024-09-17T05:19:28.196112+0000","last_peered":"2024-09-17T05:19:28.196112+0000","last_clean":"2024-09-17T05:19:28.196112+0000","last_became_active":"2024-09-17T05:19:27.189557+0000","last_became_peered":"2024-09-17T05:19:27.189557+0000","last_unstale":"2024-09-17T05:19:28.196112+0000","last_undegraded":"2024-09-17T05:19:28.196112+0000","last_fullsized":"2024-09-17T05:19:28.196112+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:26.168287+0000","last_clean_scrub_stamp":"2024-09-17T05:19:26.168287+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:06.759104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":129,"reported_epoch":34,"state":"active+clean","last_fresh":"2024-09-17T05:19:29.194773+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:19:29.194773+0000","last_peered":"2024-09-17T05:19:29.194773+0000","last_clean":"2024-09-17T05:19:29.194773+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:19:29.194773+0000","last_undegraded":"2024-09-17T05:19:29.194773+0000","last_fullsized":"2024-09-17T05:19:29.194773+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509455,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27988,"kb_used_data":952,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343852,"statfs":{"total":96636764160,"available":96608104448,"internally_reserved":0,"allocated":974848,"data_stored":734885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509455,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27400,"kb_used_data":364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344440,"statfs":{"total":96636764160,"available":96608706560,"internally_reserved":0,"allocated":372736,"data_stored":138743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509454,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":145099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509454,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27404,"kb_used_data":376,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344436,"statfs":{"total":96636764160,"available":96608702464,"internally_reserved":0,"allocated":385024,"data_stored":144531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509454,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509455,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27388,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344452,"statfs":{"total":96636764160,"available":96608718848,"internally_reserved":0,"allocated":368640,"data_stored":138197,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509454,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27416,"kb_used_data":384,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344424,"statfs":{"total":96636764160,"available":96608690176,"internally_reserved":0,"allocated":393216,"data_stored":146061,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574863,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":970752,"data_stored":734795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:19:35.913 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:19:35.913 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:19:36.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 -- 172.21.15.81:0/2024464569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680b3de0 msgr2=0x7fec680b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 --2- 172.21.15.81:0/2024464569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680b3de0 0x7fec680b41f0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fec680b69d0 tx=0x7fec6002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 -- 172.21.15.81:0/2024464569 shutdown_connections 2024-09-17T05:19:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 --2- 172.21.15.81:0/2024464569 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680b3de0 0x7fec680b41f0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 --2- 172.21.15.81:0/2024464569 >> v2:172.21.15.160:3300/0 conn(0x7fec681617f0 0x7fec680d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 -- 172.21.15.81:0/2024464569 >> 172.21.15.81:0/2024464569 conn(0x7fec680d3e30 msgr2=0x7fec680d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:36.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 -- 172.21.15.81:0/2024464569 shutdown_connections 2024-09-17T05:19:36.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.055+0000 7fec7032b640 1 -- 172.21.15.81:0/2024464569 wait complete. 2024-09-17T05:19:36.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 Processor -- start 2024-09-17T05:19:36.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 -- start start 2024-09-17T05:19:36.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3de0 0x7fec681f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680d01b0 0x7fec680c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec681617f0 0x7fec6806e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec680b48b0 con 0x7fec680d01b0 2024-09-17T05:19:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fec680b4730 con 0x7fec680b3de0 2024-09-17T05:19:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec7032b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fec680b4a30 con 0x7fec681617f0 2024-09-17T05:19:36.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.057+0000 7fec6d8c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680d01b0 0x7fec680c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680d01b0 0x7fec680c8fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54078/0 (socket says 172.21.15.81:54078) 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 -- 172.21.15.81:0/724293554 learned_addr learned my addr 172.21.15.81:0/724293554 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6e0c7640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3de0 0x7fec681f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6e8c8640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec681617f0 0x7fec6806e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 -- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec681617f0 msgr2=0x7fec6806e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec681617f0 0x7fec6806e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 -- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3de0 msgr2=0x7fec681f8cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3de0 0x7fec681f8cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 -- 172.21.15.81:0/724293554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec681f9210 con 0x7fec680d01b0 2024-09-17T05:19:36.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec6d8c6640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680d01b0 0x7fec680c8fb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c400 tx=0x7fec5c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec66ffd640 1 -- 172.21.15.81:0/724293554 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011790 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec66ffd640 1 -- 172.21.15.81:0/724293554 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec5c017070 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec6814b410 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec66ffd640 1 -- 172.21.15.81:0/724293554 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec5c011cc0 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.058+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec6814b9d0 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.059+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec680b4f50 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.060+0000 7fec66ffd640 1 -- 172.21.15.81:0/724293554 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fec5c01c460 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.060+0000 7fec66ffd640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fec54078b90 0x7fec5407b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.060+0000 7fec66ffd640 1 -- 172.21.15.81:0/724293554 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fec5c09a9c0 con 0x7fec680d01b0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.060+0000 7fec6e0c7640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fec54078b90 0x7fec5407b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.061+0000 7fec6e0c7640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fec54078b90 0x7fec5407b050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec58005fd0 tx=0x7fec58009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:36.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.064+0000 7fec66ffd640 1 -- 172.21.15.81:0/724293554 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fec5c09ce20 con 0x7fec680d01b0 2024-09-17T05:19:36.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.312+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fec680b3570 con 0x7fec680d01b0 2024-09-17T05:19:36.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.314+0000 7fec66ffd640 1 -- 172.21.15.81:0/724293554 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) ==== 190+0+147 (secure 0 0 0) 0x7fec5c062840 con 0x7fec680d01b0 2024-09-17T05:19:36.315 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:19:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:19:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:19:36.315 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:19:36.316 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:19:36.316 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.316+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fec54078b90 msgr2=0x7fec5407b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.316+0000 7fec7032b640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fec54078b90 0x7fec5407b050 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fec58005fd0 tx=0x7fec58009500 comp rx=0 tx=0).stop 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.316+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680d01b0 msgr2=0x7fec680c8fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.316+0000 7fec7032b640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680d01b0 0x7fec680c8fb0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fec5c00c400 tx=0x7fec5c00c8c0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 shutdown_connections 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fec54078b90 0x7fec5407b050 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec681617f0 0x7fec6806e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec680d01b0 0x7fec680c8fb0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 --2- 172.21.15.81:0/724293554 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3de0 0x7fec681f8cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 >> 172.21.15.81:0/724293554 conn(0x7fec680d3e30 msgr2=0x7fec680b2b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 shutdown_connections 2024-09-17T05:19:36.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.317+0000 7fec7032b640 1 -- 172.21.15.81:0/724293554 wait complete. 2024-09-17T05:19:36.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:36.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 -- 172.21.15.81:0/3495769486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 msgr2=0x7f8d3c15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 --2- 172.21.15.81:0/3495769486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c15f750 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f8d3c15f6b0 tx=0x7f8d2c02a580 comp rx=0 tx=0).stop 2024-09-17T05:19:36.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 -- 172.21.15.81:0/3495769486 shutdown_connections 2024-09-17T05:19:36.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 --2- 172.21.15.81:0/3495769486 >> v2:172.21.15.160:3300/0 conn(0x7f8d3c0cc900 0x7f8d3c15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 --2- 172.21.15.81:0/3495769486 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c15f750 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 -- 172.21.15.81:0/3495769486 >> 172.21.15.81:0/3495769486 conn(0x7f8d3c0b1690 msgr2=0x7f8d3c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:36.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 -- 172.21.15.81:0/3495769486 shutdown_connections 2024-09-17T05:19:36.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.429+0000 7f8d43732640 1 -- 172.21.15.81:0/3495769486 wait complete. 2024-09-17T05:19:36.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.430+0000 7f8d43732640 1 Processor -- start 2024-09-17T05:19:36.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.430+0000 7f8d43732640 1 -- start start 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d43732640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c14ead0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d43732640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d3c0cc900 0x7f8d3c0ae280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d43732640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3c159680 0x7f8d3c1474b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d43732640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c0cec40 con 0x7f8d3c0cc490 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d43732640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3c0ceac0 con 0x7f8d3c0cc900 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d43732640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8d3c0cedc0 con 0x7f8d3c159680 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c14ead0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c14ead0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54090/0 (socket says 172.21.15.81:54090) 2024-09-17T05:19:36.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 -- 172.21.15.81:0/3648382620 learned_addr learned my addr 172.21.15.81:0/3648382620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d40ccd640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d3c0cc900 0x7f8d3c0ae280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d41ccf640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3c159680 0x7f8d3c1474b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 -- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3c159680 msgr2=0x7f8d3c1474b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3c159680 0x7f8d3c1474b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 -- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d3c0cc900 msgr2=0x7f8d3c0ae280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d3c0cc900 0x7f8d3c0ae280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 -- 172.21.15.81:0/3648382620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d3c14e8b0 con 0x7f8d3c0cc490 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d40ccd640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d3c0cc900 0x7f8d3c0ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d41ccf640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3c159680 0x7f8d3c1474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d414ce640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c14ead0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800b410 tx=0x7f8d3800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:36.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d31ffb640 1 -- 172.21.15.81:0/3648382620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38015020 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d31ffb640 1 -- 172.21.15.81:0/3648382620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d38011920 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d3c0ae940 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.431+0000 7f8d31ffb640 1 -- 172.21.15.81:0/3648382620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38011d70 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.432+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d3c0aef00 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.433+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d3c0cf280 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.433+0000 7f8d31ffb640 1 -- 172.21.15.81:0/3648382620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f8d38018020 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.434+0000 7f8d31ffb640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8d20078b90 0x7f8d2007b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.434+0000 7f8d31ffb640 1 -- 172.21.15.81:0/3648382620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f8d3809ac20 con 0x7f8d3c0cc490 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.434+0000 7f8d40ccd640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8d20078b90 0x7f8d2007b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:36.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.435+0000 7f8d40ccd640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8d20078b90 0x7f8d2007b050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c033000 tx=0x7f8d2c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:36.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.438+0000 7f8d31ffb640 1 -- 172.21.15.81:0/3648382620 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8d3801f020 con 0x7f8d3c0cc490 2024-09-17T05:19:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.650+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d3c15ae60 con 0x7f8d3c0cc490 2024-09-17T05:19:36.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.650+0000 7f8d31ffb640 1 -- 172.21.15.81:0/3648382620 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 14 v14) ==== 94+0+5226 (secure 0 0 0) 0x7f8d3c14e8b0 con 0x7f8d3c0cc490 2024-09-17T05:19:36.651 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:36.651 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":14,"btime":"2024-09-17T05:19:30:202844+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1349280669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1349280669},{"type":"v1","addr":"172.21.15.81:6835","nonce":1349280669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4116874676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4116874676},{"type":"v1","addr":"172.21.15.81:6834","nonce":4116874676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3419973321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3419973321},{"type":"v1","addr":"172.21.15.160:6836","nonce":3419973321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:27.525714+0000","modified":"2024-09-17T05:19:29.543405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/974638720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":974638720},{"type":"v1","addr":"172.21.15.160:6837","nonce":974638720}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-17T05:19:36.652 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 14 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8d20078b90 msgr2=0x7f8d2007b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8d20078b90 0x7f8d2007b050 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f8d2c033000 tx=0x7f8d2c004730 comp rx=0 tx=0).stop 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 msgr2=0x7f8d3c14ead0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c14ead0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800b410 tx=0x7f8d3800b8d0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 shutdown_connections 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8d20078b90 0x7f8d2007b050 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3c159680 0x7f8d3c1474b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d3c0cc900 0x7f8d3c0ae280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 --2- 172.21.15.81:0/3648382620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3c0cc490 0x7f8d3c14ead0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 >> 172.21.15.81:0/3648382620 conn(0x7f8d3c0b1690 msgr2=0x7f8d3c0b0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 shutdown_connections 2024-09-17T05:19:36.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:36.653+0000 7f8d43732640 1 -- 172.21.15.81:0/3648382620 wait complete. 2024-09-17T05:19:37.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 14, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:19:27.525714+0000', 'modified': '2024-09-17T05:19:29.543405+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4884}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4884': {'gid': 4884, 'name': 'd', 'rank': 0, 'incarnation': 12, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.160:6837/974638720', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6835', 'nonce': 974638720}, {'type': 'v1', 'addr': '172.21.15.160:6837', 'nonce': 974638720}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4884, 'qdb_cluster': [4884]} 2024-09-17T05:19:37.069 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:19:37.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 -- 172.21.15.81:0/319289403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 msgr2=0x7f00c415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/319289403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c415f750 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f00b4009900 tx=0x7f00b402a560 comp rx=0 tx=0).stop 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 -- 172.21.15.81:0/319289403 shutdown_connections 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/319289403 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00c40cc900 0x7f00c415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/319289403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c415f750 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 -- 172.21.15.81:0/319289403 >> 172.21.15.81:0/319289403 conn(0x7f00c40b1690 msgr2=0x7f00c40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 -- 172.21.15.81:0/319289403 shutdown_connections 2024-09-17T05:19:37.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.173+0000 7f00cb6dd640 1 -- 172.21.15.81:0/319289403 wait complete. 2024-09-17T05:19:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.174+0000 7f00cb6dd640 1 Processor -- start 2024-09-17T05:19:37.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.174+0000 7f00cb6dd640 1 -- start start 2024-09-17T05:19:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00cb6dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c41f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00cb6dd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00c40cc900 0x7f00c40b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00cb6dd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00c4159680 0x7f00c40aede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00cb6dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00c40cec40 con 0x7f00c40cc490 2024-09-17T05:19:37.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00cb6dd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f00c40ceac0 con 0x7f00c40cc900 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00cb6dd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f00c40cedc0 con 0x7f00c4159680 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c41f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c41f5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54100/0 (socket says 172.21.15.81:54100) 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 -- 172.21.15.81:0/3677671950 learned_addr learned my addr 172.21.15.81:0/3677671950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00c4159680 0x7f00c40aede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00c40cc900 0x7f00c40b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 -- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00c4159680 msgr2=0x7f00c40aede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00c4159680 0x7f00c40aede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 -- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00c40cc900 msgr2=0x7f00c40b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00c40cc900 0x7f00c40b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 -- 172.21.15.81:0/3677671950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00c40b2c30 con 0x7f00c40cc490 2024-09-17T05:19:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00c40cc900 0x7f00c40b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00c9479640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c41f5360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b3f0 tx=0x7f00c000b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00b9ffb640 1 -- 172.21.15.81:0/3677671950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0015020 con 0x7f00c40cc490 2024-09-17T05:19:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00b9ffb640 1 -- 172.21.15.81:0/3677671950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00c0011920 con 0x7f00c40cc490 2024-09-17T05:19:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00c40b4880 con 0x7f00c40cc490 2024-09-17T05:19:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.175+0000 7f00b9ffb640 1 -- 172.21.15.81:0/3677671950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0011d70 con 0x7f00c40cc490 2024-09-17T05:19:37.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.176+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00c40b31b0 con 0x7f00c40cc490 2024-09-17T05:19:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.177+0000 7f00b9ffb640 1 -- 172.21.15.81:0/3677671950 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f00c0018020 con 0x7f00c40cc490 2024-09-17T05:19:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.178+0000 7f00b9ffb640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f00a8078b90 0x7f00a807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.178+0000 7f00b9ffb640 1 -- 172.21.15.81:0/3677671950 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f00c009a8f0 con 0x7f00c40cc490 2024-09-17T05:19:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.178+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f00a8078b90 0x7f00a807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.178+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f00a8078b90 0x7f00a807b050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00b4033000 tx=0x7f00b4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.178+0000 7f00ce4ac740 1 Processor -- start 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00ce4ac740 1 -- start start 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d801b0 0x558937d57b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937da01f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d555f0 0x558937d55a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558937ccc820 con 0x558937d555f0 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558937cbbc50 con 0x558937d801b0 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x558937cbfa60 con 0x558937d9fdf0 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00c9c7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d555f0 0x558937d55a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00c9c7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d555f0 0x558937d55a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54110/0 (socket says 172.21.15.81:54110) 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00c9c7a640 1 -- 172.21.15.81:0/1034095763 learned_addr learned my addr 172.21.15.81:0/1034095763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00c9479640 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d801b0 0x558937d57b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.179+0000 7f00c8c78640 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937da01f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00c9c7a640 1 -- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 msgr2=0x558937da01f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937da01f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00c9c7a640 1 -- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d801b0 msgr2=0x558937d57b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d801b0 0x558937d57b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00c9c7a640 1 -- 172.21.15.81:0/1034095763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558937a1d850 con 0x558937d555f0 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d555f0 0x558937d55a40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f00bc007ee0 tx=0x7f00bc00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac90407fb2f67d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00aeffd640 1 -- 172.21.15.81:0/1034095763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc010840 con 0x558937d555f0 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00aeffd640 1 -- 172.21.15.81:0/1034095763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00bc010ad0 con 0x558937d555f0 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00aeffd640 1 -- 172.21.15.81:0/1034095763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc0183f0 con 0x558937d555f0 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.180+0000 7f00ce4ac740 1 -- 172.21.15.81:0/1034095763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d555f0 msgr2=0x558937d55a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d555f0 0x558937d55a40 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f00bc007ee0 tx=0x7f00bc00f790 comp rx=0 tx=0).stop 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 -- 172.21.15.81:0/1034095763 shutdown_connections 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d555f0 0x558937d55a40 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937da01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/1034095763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d801b0 0x558937d57b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 -- 172.21.15.81:0/1034095763 >> 172.21.15.81:0/1034095763 conn(0x558937d566a0 msgr2=0x558937d5a0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 -- 172.21.15.81:0/1034095763 shutdown_connections 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 -- 172.21.15.81:0/1034095763 wait complete. 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 -- start start 2024-09-17T05:19:37.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.181+0000 7f00ce4ac740 1 Processor -- start 2024-09-17T05:19:37.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d99b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937d7f380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937db2170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558937a2c620 con 0x558937d801b0 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558937c615f0 con 0x558937d7f8c0 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x558937d54b30 con 0x558937d9fdf0 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00ce4ac740 10 client.0 _ll_register_callbacks cb 0x558937c650a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00c9479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d99b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00c9479640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d99b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54116/0 (socket says 172.21.15.81:54116) 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00c9479640 1 -- 172.21.15.81:0/3491981281 learned_addr learned my addr 172.21.15.81:0/3491981281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937d7f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.182+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937db2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00c9479640 1 -- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 msgr2=0x558937d7f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00c9479640 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937d7f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00c9479640 1 -- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 msgr2=0x558937db2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00c9479640 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937db2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00c9479640 1 -- 172.21.15.81:0/3491981281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558937a946b0 con 0x558937d801b0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00c9479640 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d99b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00c005f940 tx=0x7f00c00621e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77cfdf7a0173ca68 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00a3fff640 1 -- 172.21.15.81:0/3491981281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00c0088070 con 0x558937d801b0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00a3fff640 1 -- 172.21.15.81:0/3491981281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f00c00693b0 con 0x558937d801b0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00bc010ad0 con 0x558937d801b0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00a3fff640 1 -- 172.21.15.81:0/3491981281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f00c00626d0 con 0x558937d801b0 2024-09-17T05:19:37.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 10 client.5052 fetch_fsmap learned FSMap version 14 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x558937d9d040 con 0x558937d801b0 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00a3fff640 1 -- 172.21.15.81:0/3491981281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00bc010ad0 con 0x558937d801b0 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00a3fff640 1 -- 172.21.15.81:0/3491981281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f00c0081070 con 0x558937d801b0 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 10 client.5052 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 10 client.5052 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 20 client.5052 populate_metadata read hostname 'smithi081' 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9c640 0x558937d9ca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 4 client.5052 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 --> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558937cce770 con 0x558937d9c640 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.183+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9c640 0x558937d9ca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.184+0000 7f00a3fff640 10 client.5052 ms_handle_connect on v2:172.21.15.160:6835/974638720 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.184+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9c640 0x558937d9ca20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25cb40c86ee7fd86 server_cookie=451647dddf386bfd in_seq=0 out_seq=0 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00a3fff640 1 -- 172.21.15.81:0/3491981281 <== mds.0 v2:172.21.15.160:6835/974638720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x558937cce770 con 0x558937d9c640 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00a3fff640 10 client.5052 handle_command_reply: tid=0 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 client.5052 shutdown 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 msgr2=0x558937d99b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d99b90 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f00c005f940 tx=0x7f00c00621e0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 shutdown_connections 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9c640 0x558937d9ca20 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937db2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9fdf0 0x558937d7f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00a3fff640 0 client.5052 ms_handle_reset on v2:172.21.15.160:6835/974638720 2024-09-17T05:19:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3491981281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d99b90 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 >> 172.21.15.81:0/3491981281 conn(0x558937d555f0 msgr2=0x558937d5a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 shutdown_connections 2024-09-17T05:19:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3491981281 wait complete. 2024-09-17T05:19:37.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.185+0000 7f00ce4ac740 20 client.5052 trim_cache size 0 max 16384 2024-09-17T05:19:37.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 Processor -- start 2024-09-17T05:19:37.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 -- start start 2024-09-17T05:19:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d77f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d801b0 0x558937d79290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d9c640 0x558937d797d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00c42001d0 con 0x558937d9c640 2024-09-17T05:19:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f00c41f89b0 con 0x558937d7f8c0 2024-09-17T05:19:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f00c41555a0 con 0x558937d801b0 2024-09-17T05:19:37.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00c9c7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d9c640 0x558937d797d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00c9c7a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d9c640 0x558937d797d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54130/0 (socket says 172.21.15.81:54130) 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.203+0000 7f00c9c7a640 1 -- 172.21.15.81:0/3569577171 learned_addr learned my addr 172.21.15.81:0/3569577171 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c8c78640 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d801b0 0x558937d79290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c9479640 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d77f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c9c7a640 1 -- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d801b0 msgr2=0x558937d79290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d801b0 0x558937d79290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c9c7a640 1 -- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 msgr2=0x558937d77f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d77f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c9c7a640 1 -- 172.21.15.81:0/3569577171 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558937d990e0 con 0x558937d9c640 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d9c640 0x558937d797d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f00bc01a040 tx=0x7f00bc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fcde8c30fa3c27a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00ae7fc640 1 -- 172.21.15.81:0/3569577171 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc027070 con 0x558937d9c640 2024-09-17T05:19:37.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00ae7fc640 1 -- 172.21.15.81:0/3569577171 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00bc010730 con 0x558937d9c640 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00ae7fc640 1 -- 172.21.15.81:0/3569577171 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00bc004d80 con 0x558937d9c640 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.204+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3569577171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d9c640 msgr2=0x558937d797d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d9c640 0x558937d797d0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f00bc01a040 tx=0x7f00bc004a40 comp rx=0 tx=0).stop 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3569577171 shutdown_connections 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d9c640 0x558937d797d0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d801b0 0x558937d79290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/3569577171 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d77f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3569577171 >> 172.21.15.81:0/3569577171 conn(0x558937d555f0 msgr2=0x558937d981b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3569577171 shutdown_connections 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 -- 172.21.15.81:0/3569577171 wait complete. 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 -- start start 2024-09-17T05:19:37.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.205+0000 7f00ce4ac740 1 Processor -- start 2024-09-17T05:19:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d78fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d794f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00ce4ac740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9c640 0x558937e20750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x558937db2cc0 con 0x558937d801b0 2024-09-17T05:19:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x558937d6daf0 con 0x558937d7f8c0 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00ce4ac740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x558937d9e5a0 con 0x558937d9c640 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00ce4ac740 10 client.0 _ll_register_callbacks cb 0x7f00c0062500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d794f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d794f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54146/0 (socket says 172.21.15.81:54146) 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 -- 172.21.15.81:0/2802406588 learned_addr learned my addr 172.21.15.81:0/2802406588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c9479640 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d78fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c9c7a640 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9c640 0x558937e20750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 -- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9c640 msgr2=0x558937e20750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9c640 0x558937e20750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 -- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 msgr2=0x558937d78fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d78fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.206+0000 7f00c8c78640 1 -- 172.21.15.81:0/2802406588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558937e20250 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00c8c78640 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d794f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c00 tx=0x7f00b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3d90d84eeab6b0e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00a3fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00a3fff640 1 -- 172.21.15.81:0/2802406588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00b4035050 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00a3fff640 1 -- 172.21.15.81:0/2802406588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f00b404a500 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00bc010730 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00a3fff640 1 -- 172.21.15.81:0/2802406588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=14) ==== 24+0+0 (secure 0 0 0) 0x7f00b4062050 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 10 client.5058 fetch_fsmap learned FSMap version 14 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=14,monmap=2+}) -- 0x558937dc3240 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00a3fff640 1 -- 172.21.15.81:0/2802406588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00bc010730 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00a3fff640 1 -- 172.21.15.81:0/2802406588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 14) ==== 3502+0+0 (secure 0 0 0) 0x7f00b404a7f0 con 0x558937d801b0 2024-09-17T05:19:37.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 10 client.5058 fetch_fsmap finished waiting for FSMap version 14 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 10 client.5058 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 20 client.5058 populate_metadata read hostname 'smithi081' 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9fdf0 0x558937d96d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 4 client.5058 mds_command: new command op to 4884 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 --> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] -- command(tid 0: {"prefix": "status"}) -- 0x558937cca220 con 0x558937d9fdf0 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.207+0000 7f00c9479640 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9fdf0 0x558937d96d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00a3fff640 10 client.5058 ms_handle_connect on v2:172.21.15.160:6835/974638720 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00c9479640 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9fdf0 0x558937d96d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13dd81ae97641df8 server_cookie=ed256f7a34e16ca7 in_seq=0 out_seq=0 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00a3fff640 1 -- 172.21.15.81:0/2802406588 <== mds.0 v2:172.21.15.160:6835/974638720 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x558937cca220 con 0x558937d9fdf0 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00a3fff640 10 client.5058 handle_command_reply: tid=0 2024-09-17T05:19:37.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 client.5058 shutdown 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 msgr2=0x558937d794f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d794f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f00b4000c00 tx=0x7f00b4009260 comp rx=0 tx=0).stop 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 shutdown_connections 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:6835/974638720,v1:172.21.15.160:6837/974638720] conn(0x558937d9fdf0 0x558937d96d70 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x558937d9c640 0x558937e20750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x558937d801b0 0x558937d794f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00a3fff640 0 client.5058 ms_handle_reset on v2:172.21.15.160:6835/974638720 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 --2- 172.21.15.81:0/2802406588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x558937d7f8c0 0x558937d78fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 >> 172.21.15.81:0/2802406588 conn(0x558937d555f0 msgr2=0x558937d5a610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 shutdown_connections 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 1 -- 172.21.15.81:0/2802406588 wait complete. 2024-09-17T05:19:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.208+0000 7f00ce4ac740 20 client.5058 trim_cache size 0 max 16384 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 4884, 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:19:37.217 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 9.0116501729999996, 2024-09-17T05:19:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 14, 2024-09-17T05:19:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 34, 2024-09-17T05:19:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 34, 2024-09-17T05:19:37.218 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 16.035877445000001 2024-09-17T05:19:37.218 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f00a8078b90 msgr2=0x7f00a807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f00a8078b90 0x7f00a807b050 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f00b4033000 tx=0x7f00b4004730 comp rx=0 tx=0).stop 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 msgr2=0x7f00c41f5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c41f5360 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f00c000b3f0 tx=0x7f00c000b8b0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 shutdown_connections 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f00a8078b90 0x7f00a807b050 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00c4159680 0x7f00c40aede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00c40cc900 0x7f00c40b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 --2- 172.21.15.81:0/3677671950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00c40cc490 0x7f00c41f5360 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 >> 172.21.15.81:0/3677671950 conn(0x7f00c40b1690 msgr2=0x7f00c40b0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 shutdown_connections 2024-09-17T05:19:37.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.209+0000 7f00cb6dd640 1 -- 172.21.15.81:0/3677671950 wait complete. 2024-09-17T05:19:37.221 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 -- 172.21.15.81:0/1495231119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 msgr2=0x7f9e080b13e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/1495231119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080b13e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f9df8005fd0 tx=0x7f9df802a970 comp rx=0 tx=0).stop 2024-09-17T05:19:37.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 -- 172.21.15.81:0/1495231119 shutdown_connections 2024-09-17T05:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/1495231119 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e080d2420 0x7f9e080b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/1495231119 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080b13e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 -- 172.21.15.81:0/1495231119 >> 172.21.15.81:0/1495231119 conn(0x7f9e08074cb0 msgr2=0x7f9e0809b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 -- 172.21.15.81:0/1495231119 shutdown_connections 2024-09-17T05:19:37.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.321+0000 7f9e0d72b640 1 -- 172.21.15.81:0/1495231119 wait complete. 2024-09-17T05:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.322+0000 7f9e0d72b640 1 Processor -- start 2024-09-17T05:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.322+0000 7f9e0d72b640 1 -- start start 2024-09-17T05:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e0d72b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e080b1920 0x7f9e0814eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e0d72b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e080d2420 0x7f9e0814ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e0d72b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080cbcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e0d72b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9e080cdc40 con 0x7f9e0815bdc0 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e0d72b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9e080cdac0 con 0x7f9e080d2420 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e0d72b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9e080b2370 con 0x7f9e080b1920 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080cbcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080cbcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54172/0 (socket says 172.21.15.81:54172) 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e077fe640 1 -- 172.21.15.81:0/2445549691 learned_addr learned my addr 172.21.15.81:0/2445549691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e06ffd640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e080b1920 0x7f9e0814eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e067fc640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e080d2420 0x7f9e0814ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e077fe640 1 -- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e080b1920 msgr2=0x7f9e0814eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e077fe640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e080b1920 0x7f9e0814eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e077fe640 1 -- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e080d2420 msgr2=0x7f9e0814ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.323+0000 7f9e077fe640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e080d2420 0x7f9e0814ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.324+0000 7f9e077fe640 1 -- 172.21.15.81:0/2445549691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e0814f2e0 con 0x7f9e0815bdc0 2024-09-17T05:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.324+0000 7f9e077fe640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080cbcf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000c7c0 tx=0x7f9e0000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.324+0000 7f9dff7fe640 1 -- 172.21.15.81:0/2445549691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00007bb0 con 0x7f9e0815bdc0 2024-09-17T05:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.324+0000 7f9dff7fe640 1 -- 172.21.15.81:0/2445549691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9e0000f450 con 0x7f9e0815bdc0 2024-09-17T05:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.324+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e080cac50 con 0x7f9e0815bdc0 2024-09-17T05:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.324+0000 7f9dff7fe640 1 -- 172.21.15.81:0/2445549691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e00007e60 con 0x7f9e0815bdc0 2024-09-17T05:19:37.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.324+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e080cb4f0 con 0x7f9e0815bdc0 2024-09-17T05:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.325+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e080b2890 con 0x7f9e0815bdc0 2024-09-17T05:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.326+0000 7f9dff7fe640 1 -- 172.21.15.81:0/2445549691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9e0000f8e0 con 0x7f9e0815bdc0 2024-09-17T05:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.326+0000 7f9dff7fe640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9de8078b90 0x7f9de807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.326+0000 7f9dff7fe640 1 -- 172.21.15.81:0/2445549691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f9e0009b400 con 0x7f9e0815bdc0 2024-09-17T05:19:37.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.326+0000 7f9e06ffd640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9de8078b90 0x7f9de807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:37.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.327+0000 7f9e06ffd640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9de8078b90 0x7f9de807b050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9df8035000 tx=0x7f9df8004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.330+0000 7f9dff7fe640 1 -- 172.21.15.81:0/2445549691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9e00014030 con 0x7f9e0815bdc0 2024-09-17T05:19:37.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.546+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9e080b1160 con 0x7f9e0815bdc0 2024-09-17T05:19:37.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.546+0000 7f9dff7fe640 1 -- 172.21.15.81:0/2445549691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7f9e00063960 con 0x7f9e0815bdc0 2024-09-17T05:19:37.547 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:19:37.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9de8078b90 msgr2=0x7f9de807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9de8078b90 0x7f9de807b050 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9df8035000 tx=0x7f9df8004ab0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 msgr2=0x7f9e080cbcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:37.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080cbcf0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f9e0000c7c0 tx=0x7f9e0000cc80 comp rx=0 tx=0).stop 2024-09-17T05:19:37.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 shutdown_connections 2024-09-17T05:19:37.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9de8078b90 0x7f9de807b050 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9e0815bdc0 0x7f9e080cbcf0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9e080d2420 0x7f9e0814ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 --2- 172.21.15.81:0/2445549691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9e080b1920 0x7f9e0814eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:37.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 >> 172.21.15.81:0/2445549691 conn(0x7f9e08074cb0 msgr2=0x7f9e080aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:37.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 shutdown_connections 2024-09-17T05:19:37.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37.548+0000 7f9e0d72b640 1 -- 172.21.15.81:0/2445549691 wait complete. 2024-09-17T05:19:37.560 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:19:37.560 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:19:37.560 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:19:37.560 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:19:37.560 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:37.560 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:19:37.560 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:19:37.561 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:19:37.561 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:19:37.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:37.561 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:37.577 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42740sec preferred_lft 42740sec 2024-09-17T05:19:37.578 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:37.579 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:19:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:19:37.580 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:37.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:37.580 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:19:37.641 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:19:37.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:37.642 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:19:37.699 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:19:37.699 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:19:37.699 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:19:37.699 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:19:37.699 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:19:37.699 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:37.699 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:19:37.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:19:37.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:19:37.700 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:19:37.700 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:19:37.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:37.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:37.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:37.825 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:19:37.839 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:19:37.840 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:19:37.840 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:19:37.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:37.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:19:37.905 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:19:37.905 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:37.905 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:37.961 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:19:37.962 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:37.962 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:38.017 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:19:38.082 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:38.138 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:19:38.138 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:19:38.138 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:19:38.138 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:19:38.139 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:19:38.140 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:19:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:19:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:19:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:38.141 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:38.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:38.141 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:19:38.194 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:19:38.194 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:19:38.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:19:38.261 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:19:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:19:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:19:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:19:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:19:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:19:38.317 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:19:38.318 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:19:38.319 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:19:38.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:19:38.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:38.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:19:38.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:38.320 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:19:38.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:38.320 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:19:38.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:19:38.316+0000 7f81ab523480 -1 init, newargv = 0x55ea9c1bc7b0 newargc=15 2024-09-17T05:19:38.321 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48735]: starting ceph client 2024-09-17T05:19:38.322 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48735]: starting fuse 2024-09-17T05:19:38.337 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:19:38.337 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:19:38.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:19:38.337 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:19:38.338 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:19:38.339 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:19:38.340 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:19:38.340 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:19:38.457 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.48735.asok 2024-09-17T05:19:38.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:38.468 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.48735.asok 2024-09-17T05:19:38.468 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:38.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.48735.asok status 2024-09-17T05:19:38.601 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:19:38.601 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:19:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:19:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:19:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:19:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:19:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:19:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "48735", 2024-09-17T05:19:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:19:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:19:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:19:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5070, 2024-09-17T05:19:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:19:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:19:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:19:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5070 2024-09-17T05:19:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:19:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:19:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3910009392 2024-09-17T05:19:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:19:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:19:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3910009392 2024-09-17T05:19:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.5070 192.168.0.1:0/3910009392", 2024-09-17T05:19:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/3910009392", 2024-09-17T05:19:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:19:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 14, 2024-09-17T05:19:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 34, 2024-09-17T05:19:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:19:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:19:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:19:38.607 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:19:38.610 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:38.610 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:19:38.610 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:38.627 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:19:38.627 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:38.628 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:38.628 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:38.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:19:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.834+0000 7fe4c6085640 1 -- 172.21.15.81:0/297968747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4a8003a00 msgr2=0x7fe4a8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.834+0000 7fe4c6085640 1 --2- 172.21.15.81:0/297968747 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4a8003a00 0x7fe4a8003e20 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0005fd0 tx=0x7fe4a8005830 comp rx=0 tx=0).stop 2024-09-17T05:19:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.834+0000 7fe4bffff640 1 -- 172.21.15.81:0/297968747 reap_dead start 2024-09-17T05:19:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.834+0000 7fe4c6085640 1 -- 172.21.15.81:0/297968747 shutdown_connections 2024-09-17T05:19:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.834+0000 7fe4c6085640 1 -- 172.21.15.81:0/297968747 >> 172.21.15.81:0/297968747 conn(0x7fe4c00b1690 msgr2=0x7fe4c00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.834+0000 7fe4c6085640 1 -- 172.21.15.81:0/297968747 shutdown_connections 2024-09-17T05:19:38.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.834+0000 7fe4c6085640 1 -- 172.21.15.81:0/297968747 wait complete. 2024-09-17T05:19:38.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.835+0000 7fe4c6085640 1 Processor -- start 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4c6085640 1 -- start start 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4c6085640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4a8003a00 0x7fe4c006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4c6085640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c0159020 0x7fe4c0159a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4c6085640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0159f70 0x7fe4c01f4720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4c6085640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00b4b00 con 0x7fe4c0159f70 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4c6085640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe4c00b4980 con 0x7fe4c0159020 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4c6085640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe4c00b4c80 con 0x7fe4a8003a00 2024-09-17T05:19:38.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0159f70 0x7fe4c01f4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0159f70 0x7fe4c01f4720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54186/0 (socket says 172.21.15.81:54186) 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.836+0000 7fe4bffff640 1 -- 172.21.15.81:0/2798082574 learned_addr learned my addr 172.21.15.81:0/2798082574 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4beffd640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c0159020 0x7fe4c0159a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bf7fe640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4a8003a00 0x7fe4c006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bffff640 1 -- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4a8003a00 msgr2=0x7fe4c006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bffff640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4a8003a00 0x7fe4c006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bffff640 1 -- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c0159020 msgr2=0x7fe4c0159a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bffff640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c0159020 0x7fe4c0159a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bffff640 1 -- 172.21.15.81:0/2798082574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4c0157f80 con 0x7fe4c0159f70 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bf7fe640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4a8003a00 0x7fe4c006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4bffff640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0159f70 0x7fe4c01f4720 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00cc740 tx=0x7fe4b8011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:38.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4a7fff640 1 -- 172.21.15.81:0/2798082574 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b801f070 con 0x7fe4c0159f70 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4a7fff640 1 -- 172.21.15.81:0/2798082574 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe4b800fa50 con 0x7fe4c0159f70 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4c0158260 con 0x7fe4c0159f70 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4a7fff640 1 -- 172.21.15.81:0/2798082574 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4b800fea0 con 0x7fe4c0159f70 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.837+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4c0158b00 con 0x7fe4c0159f70 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.838+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4c00739a0 con 0x7fe4c0159f70 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.839+0000 7fe4a7fff640 1 -- 172.21.15.81:0/2798082574 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fe4b8022070 con 0x7fe4c0159f70 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.839+0000 7fe4a7fff640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4ac078b90 0x7fe4ac07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:38.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.839+0000 7fe4a7fff640 1 -- 172.21.15.81:0/2798082574 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe4b809b2d0 con 0x7fe4c0159f70 2024-09-17T05:19:38.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.839+0000 7fe4bf7fe640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4ac078b90 0x7fe4ac07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:38.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.840+0000 7fe4bf7fe640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4ac078b90 0x7fe4ac07b050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0035000 tx=0x7fe4b002d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:38.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:38.843+0000 7fe4a7fff640 1 -- 172.21.15.81:0/2798082574 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe4b80630d0 con 0x7fe4c0159f70 2024-09-17T05:19:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.054+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fe4c0158430 con 0x7fe4c0159f70 2024-09-17T05:19:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.055+0000 7fe4a7fff640 1 -- 172.21.15.81:0/2798082574 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v14) ==== 53+0+73 (secure 0 0 0) 0x7fe4b8067b00 con 0x7fe4c0159f70 2024-09-17T05:19:39.056 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:19:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4ac078b90 msgr2=0x7fe4ac07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4ac078b90 0x7fe4ac07b050 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fe4b0035000 tx=0x7fe4b002d040 comp rx=0 tx=0).stop 2024-09-17T05:19:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0159f70 msgr2=0x7fe4c01f4720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0159f70 0x7fe4c01f4720 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fe4c00cc740 tx=0x7fe4b8011b10 comp rx=0 tx=0).stop 2024-09-17T05:19:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 shutdown_connections 2024-09-17T05:19:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe4ac078b90 0x7fe4ac07b050 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4c0159f70 0x7fe4c01f4720 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4c0159020 0x7fe4c0159a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 --2- 172.21.15.81:0/2798082574 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4a8003a00 0x7fe4c006f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 >> 172.21.15.81:0/2798082574 conn(0x7fe4c00b1690 msgr2=0x7fe4c00af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 shutdown_connections 2024-09-17T05:19:39.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:39.057+0000 7fe4c6085640 1 -- 172.21.15.81:0/2798082574 wait complete. 2024-09-17T05:19:39.068 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:19:39.068 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:19:39.069 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:19:39.069 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:19:39.069 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:39.069 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:19:39.069 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:19:39.069 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:19:39.069 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:19:39.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.069 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:19:39.089 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:19:39.089 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:19:39.090 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42736sec preferred_lft 42736sec 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:19:39.091 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:19:39.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.093 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:19:39.158 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:19:39.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.160 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:19:39.219 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:19:39.219 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:19:39.219 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:19:39.220 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:19:39.220 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:19:39.220 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:19:39.220 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:19:39.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:19:39.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:19:39.220 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:19:39.221 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:19:39.316 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:19:39.351 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:39.357 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.358 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:19:39.373 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:19:39.373 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:19:39.374 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:19:39.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.374 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:19:39.439 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:19:39.440 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:39.440 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:39.495 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:19:39.496 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:19:39.496 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:39.551 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:19:39.616 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:19:39.673 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:39.674 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:39.675 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:39.676 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:39.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.676 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:19:39.729 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:19:39.729 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:19:39.772 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:19:39.795 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:19:39.851 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:19:39.851 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:19:39.852 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:19:39.853 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:19:39.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.855 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:19:39.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:19:39.852+0000 7f671de12480 -1 init, newargv = 0x564afe2d0480 newargc=15 2024-09-17T05:19:39.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[43970]: starting ceph client 2024-09-17T05:19:39.857 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[43970]: starting fuse 2024-09-17T05:19:39.870 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:19:39.871 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:19:39.871 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:19:39.872 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:19:39.873 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:19:39.873 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:19:39.873 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:19:39.873 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:19:39.873 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:19:39.987 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.43970.asok 2024-09-17T05:19:39.990 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:19:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:39.997 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.43970.asok 2024-09-17T05:19:39.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:39.997 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.43970.asok status 2024-09-17T05:19:40.131 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:19:40.131 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:19:40.131 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:19:40.131 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:19:40.131 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:19:40.131 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:19:40.131 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "43970", 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 4936, 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 4936 2024-09-17T05:19:40.132 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1290415922 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1290415922 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:19:40.133 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.4936 192.168.0.1:0/1290415922", 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/1290415922", 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 14, 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 34, 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:19:40.134 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:19:40.139 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:40.140 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:19:40.140 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:40.155 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:19:40.155 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:40.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:40.156 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:40.220 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:19:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 -- 172.21.15.81:0/4097265821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac15ad30 msgr2=0x7f28ac0cdf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:40.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 --2- 172.21.15.81:0/4097265821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac15ad30 0x7f28ac0cdf40 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f2894005fd0 tx=0x7f289402a540 comp rx=0 tx=0).stop 2024-09-17T05:19:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 -- 172.21.15.81:0/4097265821 shutdown_connections 2024-09-17T05:19:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 --2- 172.21.15.81:0/4097265821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac15ad30 0x7f28ac0cdf40 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 --2- 172.21.15.81:0/4097265821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28ac15a950 0x7f28ac0b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 -- 172.21.15.81:0/4097265821 >> 172.21.15.81:0/4097265821 conn(0x7f28ac0d0b90 msgr2=0x7f28ac0d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 -- 172.21.15.81:0/4097265821 shutdown_connections 2024-09-17T05:19:40.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.338+0000 7f28b1e18640 1 -- 172.21.15.81:0/4097265821 wait complete. 2024-09-17T05:19:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.339+0000 7f28b1e18640 1 Processor -- start 2024-09-17T05:19:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.339+0000 7f28b1e18640 1 -- start start 2024-09-17T05:19:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28b1e18640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac0ce480 0x7f28ac150740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28b1e18640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28ac15a950 0x7f28ac06cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28b1e18640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac15ad30 0x7f28ac06d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:40.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28b1e18640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac0b5220 con 0x7f28ac0ce480 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28b1e18640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28ac070840 con 0x7f28ac15ad30 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28b1e18640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f28ac0b53a0 con 0x7f28ac15a950 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac0ce480 0x7f28ac150740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac0ce480 0x7f28ac150740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54198/0 (socket says 172.21.15.81:54198) 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28ab7fe640 1 -- 172.21.15.81:0/1611814814 learned_addr learned my addr 172.21.15.81:0/1611814814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28a3fff640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28ac15a950 0x7f28ac06cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.340+0000 7f28abfff640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac15ad30 0x7f28ac06d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28ab7fe640 1 -- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28ac15a950 msgr2=0x7f28ac06cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28ab7fe640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28ac15a950 0x7f28ac06cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28ab7fe640 1 -- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac15ad30 msgr2=0x7f28ac06d080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28ab7fe640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac15ad30 0x7f28ac06d080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:40.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28ab7fe640 1 -- 172.21.15.81:0/1611814814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28ac1553b0 con 0x7f28ac0ce480 2024-09-17T05:19:40.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28ab7fe640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac0ce480 0x7f28ac150740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f289c00d950 tx=0x7f289c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:40.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28a8ff9640 1 -- 172.21.15.81:0/1611814814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c017070 con 0x7f28ac0ce480 2024-09-17T05:19:40.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28a8ff9640 1 -- 172.21.15.81:0/1611814814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f289c009d20 con 0x7f28ac0ce480 2024-09-17T05:19:40.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28a8ff9640 1 -- 172.21.15.81:0/1611814814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f289c004280 con 0x7f28ac0ce480 2024-09-17T05:19:40.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28ac155690 con 0x7f28ac0ce480 2024-09-17T05:19:40.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.341+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28ac155c50 con 0x7f28ac0ce480 2024-09-17T05:19:40.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.342+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f28ac0b3a80 con 0x7f28ac0ce480 2024-09-17T05:19:40.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.343+0000 7f28a8ff9640 1 -- 172.21.15.81:0/1611814814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f289c0035f0 con 0x7f28ac0ce480 2024-09-17T05:19:40.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.343+0000 7f28a8ff9640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f288c078b90 0x7f288c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.343+0000 7f28a8ff9640 1 -- 172.21.15.81:0/1611814814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f289c09ad90 con 0x7f28ac0ce480 2024-09-17T05:19:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.343+0000 7f28a3fff640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f288c078b90 0x7f288c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:40.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.344+0000 7f28a3fff640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f288c078b90 0x7f288c07b050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2894033000 tx=0x7f2894004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:40.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.347+0000 7f28a8ff9640 1 -- 172.21.15.81:0/1611814814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f289c062c10 con 0x7f28ac0ce480 2024-09-17T05:19:40.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:40.563+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f28ac070f70 con 0x7f28ac0ce480 2024-09-17T05:19:41.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.465+0000 7f28a8ff9640 1 -- 172.21.15.81:0/1611814814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v15) ==== 136+0+0 (secure 0 0 0) 0x7f289c067640 con 0x7f28ac0ce480 2024-09-17T05:19:41.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f288c078b90 msgr2=0x7f288c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f288c078b90 0x7f288c07b050 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f2894033000 tx=0x7f2894004730 comp rx=0 tx=0).stop 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac0ce480 msgr2=0x7f28ac150740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac0ce480 0x7f28ac150740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f289c00d950 tx=0x7f289c00de10 comp rx=0 tx=0).stop 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 shutdown_connections 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f288c078b90 0x7f288c07b050 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28ac15ad30 0x7f28ac06d080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28ac15a950 0x7f28ac06cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 --2- 172.21.15.81:0/1611814814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f28ac0ce480 0x7f28ac150740 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 >> 172.21.15.81:0/1611814814 conn(0x7f28ac0d0b90 msgr2=0x7f28ac0ce8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 shutdown_connections 2024-09-17T05:19:41.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.468+0000 7f28b1e18640 1 -- 172.21.15.81:0/1611814814 wait complete. 2024-09-17T05:19:41.483 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:19:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.590+0000 7ffb72b17640 1 -- 172.21.15.81:0/3044680852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 msgr2=0x7ffb58004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.590+0000 7ffb72b17640 1 --2- 172.21.15.81:0/3044680852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 0x7ffb58004800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7ffb54009b80 tx=0x7ffb58005830 comp rx=0 tx=0).stop 2024-09-17T05:19:41.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.590+0000 7ffb710b4640 1 -- 172.21.15.81:0/3044680852 reap_dead start 2024-09-17T05:19:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.590+0000 7ffb72b17640 1 -- 172.21.15.81:0/3044680852 shutdown_connections 2024-09-17T05:19:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.590+0000 7ffb72b17640 1 -- 172.21.15.81:0/3044680852 >> 172.21.15.81:0/3044680852 conn(0x7ffb6c0d3ea0 msgr2=0x7ffb6c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.590+0000 7ffb72b17640 1 -- 172.21.15.81:0/3044680852 shutdown_connections 2024-09-17T05:19:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.590+0000 7ffb72b17640 1 -- 172.21.15.81:0/3044680852 wait complete. 2024-09-17T05:19:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.591+0000 7ffb72b17640 1 Processor -- start 2024-09-17T05:19:41.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.591+0000 7ffb72b17640 1 -- start start 2024-09-17T05:19:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb72b17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 0x7ffb6c0cb090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb72b17640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb6c1f5240 0x7ffb6c1f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb72b17640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb6c0cd800 0x7ffb6c0cdc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb72b17640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b42a0 con 0x7ffb58003fd0 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb72b17640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b4120 con 0x7ffb6c1f5240 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb72b17640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ffb6c0b4420 con 0x7ffb6c0cd800 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 0x7ffb6c0cb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 0x7ffb6c0cb090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54224/0 (socket says 172.21.15.81:54224) 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 -- 172.21.15.81:0/1766151639 learned_addr learned my addr 172.21.15.81:0/1766151639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb710b4640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb6c0cd800 0x7ffb6c0cdc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 -- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb6c0cd800 msgr2=0x7ffb6c0cdc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb6c0cd800 0x7ffb6c0cdc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb6bfff640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb6c1f5240 0x7ffb6c1f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 -- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb6c1f5240 msgr2=0x7ffb6c1f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb6c1f5240 0x7ffb6c1f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 -- 172.21.15.81:0/1766151639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb6c0ccbb0 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.592+0000 7ffb708b3640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 0x7ffb6c0cb090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c011da0 tx=0x7ffb5c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.593+0000 7ffb697fa640 1 -- 172.21.15.81:0/1766151639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c003d80 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.593+0000 7ffb697fa640 1 -- 172.21.15.81:0/1766151639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb5c004b20 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.593+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb6c0cbb10 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.593+0000 7ffb697fa640 1 -- 172.21.15.81:0/1766151639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb5c004050 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.593+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb6c0cc0d0 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.594+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb6c0d0170 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.594+0000 7ffb697fa640 1 -- 172.21.15.81:0/1766151639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7ffb5c0041f0 con 0x7ffb58003fd0 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.595+0000 7ffb697fa640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffb4c078b90 0x7ffb4c07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.595+0000 7ffb697fa640 1 -- 172.21.15.81:0/1766151639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7ffb5c09be50 con 0x7ffb58003fd0 2024-09-17T05:19:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.595+0000 7ffb6bfff640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffb4c078b90 0x7ffb4c07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.595+0000 7ffb6bfff640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffb4c078b90 0x7ffb4c07b050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffb54035000 tx=0x7ffb540046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:41.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.599+0000 7ffb697fa640 1 -- 172.21.15.81:0/1766151639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ffb5c0643b0 con 0x7ffb58003fd0 2024-09-17T05:19:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.797+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7ffb6c08d590 con 0x7ffb4c078b90 2024-09-17T05:19:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.800+0000 7ffb697fa640 1 -- 172.21.15.81:0/1766151639 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7ffb6c08d590 con 0x7ffb4c078b90 2024-09-17T05:19:41.800 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:19:41.800 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:41.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:19:41.800 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:41.800 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:19:41.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffb4c078b90 msgr2=0x7ffb4c07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffb4c078b90 0x7ffb4c07b050 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7ffb54035000 tx=0x7ffb540046c0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 msgr2=0x7ffb6c0cb090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 0x7ffb6c0cb090 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7ffb5c011da0 tx=0x7ffb5c00f790 comp rx=0 tx=0).stop 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 shutdown_connections 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffb4c078b90 0x7ffb4c07b050 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb6c0cd800 0x7ffb6c0cdc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb6c1f5240 0x7ffb6c1f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 --2- 172.21.15.81:0/1766151639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb58003fd0 0x7ffb6c0cb090 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 >> 172.21.15.81:0/1766151639 conn(0x7ffb6c0d3ea0 msgr2=0x7ffb6c0b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 shutdown_connections 2024-09-17T05:19:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.801+0000 7ffb72b17640 1 -- 172.21.15.81:0/1766151639 wait complete. 2024-09-17T05:19:41.813 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:19:41.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 -- 172.21.15.81:0/3385005458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c0d01b0 msgr2=0x7fd84c0d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 --2- 172.21.15.81:0/3385005458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c0d01b0 0x7fd84c0d2440 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fd84c06a240 tx=0x7fd84002a560 comp rx=0 tx=0).stop 2024-09-17T05:19:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 -- 172.21.15.81:0/3385005458 shutdown_connections 2024-09-17T05:19:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 --2- 172.21.15.81:0/3385005458 >> v2:172.21.15.160:3300/0 conn(0x7fd84c0b3de0 0x7fd84c0b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 --2- 172.21.15.81:0/3385005458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c0d01b0 0x7fd84c0d2440 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 -- 172.21.15.81:0/3385005458 >> 172.21.15.81:0/3385005458 conn(0x7fd84c0d3e30 msgr2=0x7fd84c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 -- 172.21.15.81:0/3385005458 shutdown_connections 2024-09-17T05:19:41.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.916+0000 7fd85346a640 1 -- 172.21.15.81:0/3385005458 wait complete. 2024-09-17T05:19:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.917+0000 7fd85346a640 1 Processor -- start 2024-09-17T05:19:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd85346a640 1 -- start start 2024-09-17T05:19:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd85346a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd84c0b3de0 0x7fd84c1f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd85346a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd84c0d01b0 0x7fd84c0b77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd85346a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1617f0 0x7fd84c06d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd85346a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c0b48b0 con 0x7fd84c1617f0 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd85346a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd84c0b4730 con 0x7fd84c0d01b0 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd85346a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd84c0b4a30 con 0x7fd84c0b3de0 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd851a07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1617f0 0x7fd84c06d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd851a07640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1617f0 0x7fd84c06d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54234/0 (socket says 172.21.15.81:54234) 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd851a07640 1 -- 172.21.15.81:0/1410407455 learned_addr learned my addr 172.21.15.81:0/1410407455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd850a05640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd84c0d01b0 0x7fd84c0b77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.918+0000 7fd851206640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd84c0b3de0 0x7fd84c1f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd851a07640 1 -- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd84c0b3de0 msgr2=0x7fd84c1f7860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd851a07640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd84c0b3de0 0x7fd84c1f7860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd851a07640 1 -- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd84c0d01b0 msgr2=0x7fd84c0b77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd851a07640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd84c0d01b0 0x7fd84c0b77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd851a07640 1 -- 172.21.15.81:0/1410407455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd84c159da0 con 0x7fd84c1617f0 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd851a07640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1617f0 0x7fd84c06d610 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e970 tx=0x7fd84400ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd849ffb640 1 -- 172.21.15.81:0/1410407455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84400ccc0 con 0x7fd84c1617f0 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd849ffb640 1 -- 172.21.15.81:0/1410407455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd84400ce60 con 0x7fd84c1617f0 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd84c15a080 con 0x7fd84c1617f0 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd849ffb640 1 -- 172.21.15.81:0/1410407455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd844005280 con 0x7fd84c1617f0 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.919+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd84c0b8990 con 0x7fd84c1617f0 2024-09-17T05:19:41.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.920+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd84c0b87a0 con 0x7fd84c1617f0 2024-09-17T05:19:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.921+0000 7fd849ffb640 1 -- 172.21.15.81:0/1410407455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7fd844005420 con 0x7fd84c1617f0 2024-09-17T05:19:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.921+0000 7fd849ffb640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd838078b90 0x7fd83807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.921+0000 7fd849ffb640 1 -- 172.21.15.81:0/1410407455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd84409b630 con 0x7fd84c1617f0 2024-09-17T05:19:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.922+0000 7fd851206640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd838078b90 0x7fd83807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:41.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.922+0000 7fd851206640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd838078b90 0x7fd83807b050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0cf750 tx=0x7fd83c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:41.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:41.925+0000 7fd849ffb640 1 -- 172.21.15.81:0/1410407455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd844063540 con 0x7fd84c1617f0 2024-09-17T05:19:42.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.100+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd84c0b5700 con 0x7fd84c1617f0 2024-09-17T05:19:42.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.101+0000 7fd849ffb640 1 -- 172.21.15.81:0/1410407455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v28)=0 v28) ==== 122+0+0 (secure 0 0 0) 0x7fd844067f70 con 0x7fd84c1617f0 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd838078b90 msgr2=0x7fd83807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd838078b90 0x7fd83807b050 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fd84c0cf750 tx=0x7fd83c009040 comp rx=0 tx=0).stop 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1617f0 msgr2=0x7fd84c06d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1617f0 0x7fd84c06d610 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fd84400e970 tx=0x7fd84400ed70 comp rx=0 tx=0).stop 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 shutdown_connections 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd838078b90 0x7fd83807b050 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd84c1617f0 0x7fd84c06d610 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd84c0d01b0 0x7fd84c0b77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 --2- 172.21.15.81:0/1410407455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd84c0b3de0 0x7fd84c1f7860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 >> 172.21.15.81:0/1410407455 conn(0x7fd84c0d3e30 msgr2=0x7fd84c0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 shutdown_connections 2024-09-17T05:19:42.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.103+0000 7fd85346a640 1 -- 172.21.15.81:0/1410407455 wait complete. 2024-09-17T05:19:42.115 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:42.115 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp72380/subvol26250) 2024-09-17T05:19:42.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:42.149 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:19:42.209 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:19:42.209 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:42.209 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp72380/subvol26250) 2024-09-17T05:19:42.285 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:42.285 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp72380/subvol26250/.meta 2024-09-17T05:19:42.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol26250 subvol_grp72380 2024-09-17T05:19:42.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 -- 172.21.15.81:0/2249821102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d00d25b0 msgr2=0x7f27d00b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 --2- 172.21.15.81:0/2249821102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d00d25b0 0x7f27d00b73e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f27c0005fd0 tx=0x7f27c002ab20 comp rx=0 tx=0).stop 2024-09-17T05:19:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 -- 172.21.15.81:0/2249821102 shutdown_connections 2024-09-17T05:19:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 --2- 172.21.15.81:0/2249821102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d00d25b0 0x7f27d00b73e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 --2- 172.21.15.81:0/2249821102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27d01616e0 0x7f27d00d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 -- 172.21.15.81:0/2249821102 >> 172.21.15.81:0/2249821102 conn(0x7f27d00d3e20 msgr2=0x7f27d00d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 -- 172.21.15.81:0/2249821102 shutdown_connections 2024-09-17T05:19:42.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.502+0000 7f27d87e2640 1 -- 172.21.15.81:0/2249821102 wait complete. 2024-09-17T05:19:42.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.503+0000 7f27d87e2640 1 Processor -- start 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d87e2640 1 -- start start 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d87e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27d00d25b0 0x7f27d00ca680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d87e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d0161300 0x7f27d015a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d87e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d01616e0 0x7f27d015a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d87e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27d00b7cb0 con 0x7f27d01616e0 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d87e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f27d00b7b30 con 0x7f27d0161300 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d87e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f27d00b7e30 con 0x7f27d00d25b0 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d6d7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d01616e0 0x7f27d015a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d6d7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d01616e0 0x7f27d015a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54260/0 (socket says 172.21.15.81:54260) 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d6d7f640 1 -- 172.21.15.81:0/170553598 learned_addr learned my addr 172.21.15.81:0/170553598 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:42.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d5d7d640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d0161300 0x7f27d015a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.504+0000 7f27d657e640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27d00d25b0 0x7f27d00ca680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d6d7f640 1 -- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27d00d25b0 msgr2=0x7f27d00ca680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d6d7f640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27d00d25b0 0x7f27d00ca680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d6d7f640 1 -- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d0161300 msgr2=0x7f27d015a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d6d7f640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d0161300 0x7f27d015a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d6d7f640 1 -- 172.21.15.81:0/170553598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27d0158390 con 0x7f27d01616e0 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d6d7f640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d01616e0 0x7f27d015a6b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006010 tx=0x7f27c0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27ceffd640 1 -- 172.21.15.81:0/170553598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c0044070 con 0x7f27d01616e0 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27ceffd640 1 -- 172.21.15.81:0/170553598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f27c002c820 con 0x7f27d01616e0 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27d0158650 con 0x7f27d01616e0 2024-09-17T05:19:42.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27ceffd640 1 -- 172.21.15.81:0/170553598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27c00044b0 con 0x7f27d01616e0 2024-09-17T05:19:42.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.505+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27d0158c10 con 0x7f27d01616e0 2024-09-17T05:19:42.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.506+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27d00b73e0 con 0x7f27d01616e0 2024-09-17T05:19:42.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.507+0000 7f27ceffd640 1 -- 172.21.15.81:0/170553598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f27c0004650 con 0x7f27d01616e0 2024-09-17T05:19:42.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.507+0000 7f27ceffd640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f27bc078b90 0x7f27bc07b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.507+0000 7f27ceffd640 1 -- 172.21.15.81:0/170553598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f27c00bb320 con 0x7f27d01616e0 2024-09-17T05:19:42.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.507+0000 7f27d657e640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f27bc078b90 0x7f27bc07b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.508+0000 7f27d657e640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f27bc078b90 0x7f27bc07b050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27d00c9460 tx=0x7f27c8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:42.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.511+0000 7f27ceffd640 1 -- 172.21.15.81:0/170553598 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f27c0032030 con 0x7f27d01616e0 2024-09-17T05:19:42.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.717+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol26250", "group_name": "subvol_grp72380", "target": ["mon-mgr", ""]}) -- 0x7f27d00b9a10 con 0x7f27bc078b90 2024-09-17T05:19:42.723 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:42.723+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:42.723 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:42.723+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:42.723 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:42.723+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:42.723 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:42.723+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:42.723 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:42.723+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:42.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.762+0000 7f27ceffd640 1 -- 172.21.15.81:0/170553598 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f27d00b9a10 con 0x7f27bc078b90 2024-09-17T05:19:42.764 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp72380/subvol26250 2024-09-17T05:19:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f27bc078b90 msgr2=0x7f27bc07b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f27bc078b90 0x7f27bc07b050 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f27d00c9460 tx=0x7f27c8009040 comp rx=0 tx=0).stop 2024-09-17T05:19:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d01616e0 msgr2=0x7f27d015a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d01616e0 0x7f27d015a6b0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f27c0006010 tx=0x7f27c0003f10 comp rx=0 tx=0).stop 2024-09-17T05:19:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 shutdown_connections 2024-09-17T05:19:42.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f27bc078b90 0x7f27bc07b050 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27d01616e0 0x7f27d015a6b0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27d0161300 0x7f27d015a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 --2- 172.21.15.81:0/170553598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27d00d25b0 0x7f27d00ca680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 >> 172.21.15.81:0/170553598 conn(0x7f27d00d3e20 msgr2=0x7f27d006ddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 shutdown_connections 2024-09-17T05:19:42.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.765+0000 7f27d87e2640 1 -- 172.21.15.81:0/170553598 wait complete. 2024-09-17T05:19:42.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol26250 subvol_grp72380 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.881+0000 7f979c4cd640 1 -- 172.21.15.81:0/478580456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 msgr2=0x7f979415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.881+0000 7f979c4cd640 1 --2- 172.21.15.81:0/478580456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 0x7f979415ba50 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f9784009830 tx=0x7f978402a480 comp rx=0 tx=0).stop 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.881+0000 7f979c4cd640 1 -- 172.21.15.81:0/478580456 shutdown_connections 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.881+0000 7f979c4cd640 1 --2- 172.21.15.81:0/478580456 >> v2:172.21.15.160:3300/0 conn(0x7f9794073190 0x7f97941595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.881+0000 7f979c4cd640 1 --2- 172.21.15.81:0/478580456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 0x7f979415ba50 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.881+0000 7f979c4cd640 1 -- 172.21.15.81:0/478580456 >> 172.21.15.81:0/478580456 conn(0x7f97940b1620 msgr2=0x7f97940b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.881+0000 7f979c4cd640 1 -- 172.21.15.81:0/478580456 shutdown_connections 2024-09-17T05:19:42.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.882+0000 7f979c4cd640 1 -- 172.21.15.81:0/478580456 wait complete. 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 Processor -- start 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 -- start start 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 0x7f9794143360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9794073190 0x7f97940b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b3c60 0x7f97940c7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f979415a180 con 0x7f9794073190 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f979415a000 con 0x7f97940b3c60 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.883+0000 7f979c4cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f979415a300 con 0x7f9794070590 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9794073190 0x7f97940b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9794073190 0x7f97940b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54270/0 (socket says 172.21.15.81:54270) 2024-09-17T05:19:42.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 -- 172.21.15.81:0/2351288084 learned_addr learned my addr 172.21.15.81:0/2351288084 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f979a269640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 0x7f9794143360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f979aa6a640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b3c60 0x7f97940c7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 -- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 msgr2=0x7f9794143360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 0x7f9794143360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 -- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b3c60 msgr2=0x7f97940c7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b3c60 0x7f97940c7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 -- 172.21.15.81:0/2351288084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97941f23f0 con 0x7f9794073190 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f979a269640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 0x7f9794143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f9799a68640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9794073190 0x7f97940b3720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9784000c00 tx=0x7f9784032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f978affd640 1 -- 172.21.15.81:0/2351288084 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784040070 con 0x7f9794073190 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f978affd640 1 -- 172.21.15.81:0/2351288084 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97840038e0 con 0x7f9794073190 2024-09-17T05:19:42.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97941f26d0 con 0x7f9794073190 2024-09-17T05:19:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f978affd640 1 -- 172.21.15.81:0/2351288084 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9784003d30 con 0x7f9794073190 2024-09-17T05:19:42.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.884+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97941f2c90 con 0x7f9794073190 2024-09-17T05:19:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.885+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f979415a820 con 0x7f9794073190 2024-09-17T05:19:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.886+0000 7f978affd640 1 -- 172.21.15.81:0/2351288084 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 5) ==== 101441+0+0 (secure 0 0 0) 0x7f9784039040 con 0x7f9794073190 2024-09-17T05:19:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.887+0000 7f978affd640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9778078b90 0x7f977807b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.887+0000 7f978affd640 1 -- 172.21.15.81:0/2351288084 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f97840bbff0 con 0x7f9794073190 2024-09-17T05:19:42.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.887+0000 7f979a269640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9778078b90 0x7f977807b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:42.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.887+0000 7f979a269640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9778078b90 0x7f977807b050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9790001b10 tx=0x7f9790007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:42.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:42.891+0000 7f978affd640 1 -- 172.21.15.81:0/2351288084 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9784083e70 con 0x7f9794073190 2024-09-17T05:19:43.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.094+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol26250", "group_name": "subvol_grp72380", "target": ["mon-mgr", ""]}) -- 0x7f97941598f0 con 0x7f9778078b90 2024-09-17T05:19:43.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.099+0000 7f978affd640 1 -- 172.21.15.81:0/2351288084 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f97941598f0 con 0x7f9778078b90 2024-09-17T05:19:43.101 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp72380/subvol26250 2024-09-17T05:19:43.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9778078b90 msgr2=0x7f977807b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:43.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9778078b90 0x7f977807b050 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9790001b10 tx=0x7f9790007e90 comp rx=0 tx=0).stop 2024-09-17T05:19:43.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9794073190 msgr2=0x7f97940b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:43.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9794073190 0x7f97940b3720 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9784000c00 tx=0x7f9784032c10 comp rx=0 tx=0).stop 2024-09-17T05:19:43.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 shutdown_connections 2024-09-17T05:19:43.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9778078b90 0x7f977807b050 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:43.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97940b3c60 0x7f97940c7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:43.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9794073190 0x7f97940b3720 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:43.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 --2- 172.21.15.81:0/2351288084 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9794070590 0x7f9794143360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:43.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 >> 172.21.15.81:0/2351288084 conn(0x7f97940b1620 msgr2=0x7f97940b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:43.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 shutdown_connections 2024-09-17T05:19:43.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:43.102+0000 7f979c4cd640 1 -- 172.21.15.81:0/2351288084 wait complete. 2024-09-17T05:19:43.114 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:43.114 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/ffb1232bf8a7d4b6d2448671f32c8888.meta) 2024-09-17T05:19:44.658 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:19:44.661 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:19:46.180 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:19:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:19:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:19:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/subvol_grp72380/subvol26250 2024-09-17T05:19:46.181 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:19:46.181 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:46.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol26250 subvol_grp72380 2024-09-17T05:19:46.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.300+0000 7f0a80eb8640 1 -- 172.21.15.81:0/999172326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c15f600 msgr2=0x7f0a7c072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.300+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/999172326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c15f600 0x7f0a7c072530 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009900 tx=0x7f0a6c02a580 comp rx=0 tx=0).stop 2024-09-17T05:19:46.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.300+0000 7f0a80eb8640 1 -- 172.21.15.81:0/999172326 shutdown_connections 2024-09-17T05:19:46.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.300+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/999172326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c15f600 0x7f0a7c072530 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.300+0000 7f0a80eb8640 1 -- 172.21.15.81:0/999172326 >> 172.21.15.81:0/999172326 conn(0x7f0a7c0b1620 msgr2=0x7f0a7c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:46.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.300+0000 7f0a80eb8640 1 -- 172.21.15.81:0/999172326 shutdown_connections 2024-09-17T05:19:46.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.300+0000 7f0a80eb8640 1 -- 172.21.15.81:0/999172326 wait complete. 2024-09-17T05:19:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.301+0000 7f0a80eb8640 1 Processor -- start 2024-09-17T05:19:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a80eb8640 1 -- start start 2024-09-17T05:19:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a80eb8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0ceb70 0x7f0a7c1f5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a80eb8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c15f600 0x7f0a7c15ab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a80eb8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a7c15f9e0 0x7f0a7c1f8340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a80eb8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0cf6d0 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a80eb8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c15ff50 con 0x7f0a7c15f9e0 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a80eb8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0cf850 con 0x7f0a7c15f600 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a7a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0ceb70 0x7f0a7c1f5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a7a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0ceb70 0x7f0a7c1f5810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57086/0 (socket says 172.21.15.81:57086) 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.302+0000 7f0a7a59c640 1 -- 172.21.15.81:0/3874876830 learned_addr learned my addr 172.21.15.81:0/3874876830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a7ad9d640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a7c15f9e0 0x7f0a7c1f8340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a79d9b640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c15f600 0x7f0a7c15ab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a7a59c640 1 -- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c15f600 msgr2=0x7f0a7c15ab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a7a59c640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c15f600 0x7f0a7c15ab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a7a59c640 1 -- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a7c15f9e0 msgr2=0x7f0a7c1f8340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a7a59c640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a7c15f9e0 0x7f0a7c1f8340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a7a59c640 1 -- 172.21.15.81:0/3874876830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c1f4d50 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a79d9b640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c15f600 0x7f0a7c15ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a7a59c640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0ceb70 0x7f0a7c1f5810 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c000c00 tx=0x7f0a6c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:46.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a6affd640 1 -- 172.21.15.81:0/3874876830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c03f070 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a6affd640 1 -- 172.21.15.81:0/3874876830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a6c0048b0 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a6affd640 1 -- 172.21.15.81:0/3874876830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a6c035030 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c1f8e40 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.303+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c1f52f0 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.304+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7c072530 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.305+0000 7f0a6affd640 1 -- 172.21.15.81:0/3874876830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7f0a6c042070 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.305+0000 7f0a6affd640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a5c078c50 0x7f0a5c07b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.306+0000 7f0a6affd640 1 -- 172.21.15.81:0/3874876830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f0a6c0bbc10 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.306+0000 7f0a79d9b640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a5c078c50 0x7f0a5c07b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:46.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.306+0000 7f0a79d9b640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a5c078c50 0x7f0a5c07b110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c150950 tx=0x7f0a70009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:46.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.310+0000 7f0a6affd640 1 -- 172.21.15.81:0/3874876830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0a6c083a20 con 0x7f0a7c0ceb70 2024-09-17T05:19:46.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.513+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol26250", "group_name": "subvol_grp72380", "target": ["mon-mgr", ""]}) -- 0x7f0a7c073770 con 0x7f0a5c078c50 2024-09-17T05:19:46.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.530+0000 7f0a6affd640 1 -- 172.21.15.81:0/3874876830 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0a7c073770 con 0x7f0a5c078c50 2024-09-17T05:19:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a5c078c50 msgr2=0x7f0a5c07b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a5c078c50 0x7f0a5c07b110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c150950 tx=0x7f0a70009040 comp rx=0 tx=0).stop 2024-09-17T05:19:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0ceb70 msgr2=0x7f0a7c1f5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0ceb70 0x7f0a7c1f5810 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c000c00 tx=0x7f0a6c0039e0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 shutdown_connections 2024-09-17T05:19:46.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0a5c078c50 0x7f0a5c07b110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a7c15f9e0 0x7f0a7c1f8340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c15f600 0x7f0a7c15ab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 --2- 172.21.15.81:0/3874876830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0ceb70 0x7f0a7c1f5810 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 >> 172.21.15.81:0/3874876830 conn(0x7f0a7c0b1620 msgr2=0x7f0a7c15b5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 shutdown_connections 2024-09-17T05:19:46.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.533+0000 7f0a80eb8640 1 -- 172.21.15.81:0/3874876830 wait complete. 2024-09-17T05:19:46.535 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.534+0000 7f03cb7d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.536 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.534+0000 7f03cb7d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.536 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.534+0000 7f03cb7d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.536 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.534+0000 7f03cb7d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.536 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.534+0000 7f03cb7d0640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.545 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:19:46.549 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.548+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.549 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.549+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.550 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.549+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.550 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.549+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.550 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:19:46.549+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:19:46.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:19:46.598 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-17T05:19:46.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:19:46.604 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp72380 2024-09-17T05:19:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.707+0000 7efed2f2b640 1 -- 172.21.15.81:0/2882021354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc15b380 msgr2=0x7efecc072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.707+0000 7efed2f2b640 1 --2- 172.21.15.81:0/2882021354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc15b380 0x7efecc072b50 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7efebc009830 tx=0x7efebc02a510 comp rx=0 tx=0).stop 2024-09-17T05:19:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.708+0000 7efed2f2b640 1 -- 172.21.15.81:0/2882021354 shutdown_connections 2024-09-17T05:19:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.708+0000 7efed2f2b640 1 --2- 172.21.15.81:0/2882021354 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc15b380 0x7efecc072b50 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.708+0000 7efed2f2b640 1 -- 172.21.15.81:0/2882021354 >> 172.21.15.81:0/2882021354 conn(0x7efecc0b1700 msgr2=0x7efecc0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.708+0000 7efed2f2b640 1 -- 172.21.15.81:0/2882021354 shutdown_connections 2024-09-17T05:19:46.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.708+0000 7efed2f2b640 1 -- 172.21.15.81:0/2882021354 wait complete. 2024-09-17T05:19:46.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.709+0000 7efed2f2b640 1 Processor -- start 2024-09-17T05:19:46.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.709+0000 7efed2f2b640 1 -- start start 2024-09-17T05:19:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc073090 0x7efecc151030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efecc0ce120 0x7efecc0c75a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efecc15b380 0x7efecc06f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efecc0cb660 con 0x7efecc073090 2024-09-17T05:19:46.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efecc0cb4e0 con 0x7efecc15b380 2024-09-17T05:19:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efecc0cb7e0 con 0x7efecc0ce120 2024-09-17T05:19:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc073090 0x7efecc151030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc073090 0x7efecc151030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57104/0 (socket says 172.21.15.81:57104) 2024-09-17T05:19:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 -- 172.21.15.81:0/490708571 learned_addr learned my addr 172.21.15.81:0/490708571 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed14c8640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efecc15b380 0x7efecc06f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 -- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efecc0ce120 msgr2=0x7efecc0c75a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efecc0ce120 0x7efecc0c75a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 -- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efecc15b380 msgr2=0x7efecc06f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efecc15b380 0x7efecc06f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 -- 172.21.15.81:0/490708571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efecc151570 con 0x7efecc073090 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed14c8640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efecc15b380 0x7efecc06f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed0cc7640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc073090 0x7efecc151030 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efebc000c00 tx=0x7efebc033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efec97fa640 1 -- 172.21.15.81:0/490708571 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc031d60 con 0x7efecc073090 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efec97fa640 1 -- 172.21.15.81:0/490708571 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efebc0330d0 con 0x7efecc073090 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efecc0c6fe0 con 0x7efecc073090 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efec97fa640 1 -- 172.21.15.81:0/490708571 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efebc033520 con 0x7efecc073090 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.710+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efecc1f2ac0 con 0x7efecc073090 2024-09-17T05:19:46.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.711+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efecc1f25d0 con 0x7efecc073090 2024-09-17T05:19:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.712+0000 7efec97fa640 1 -- 172.21.15.81:0/490708571 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7efebc0035f0 con 0x7efecc073090 2024-09-17T05:19:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.712+0000 7efec97fa640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efeb8078c50 0x7efeb807b110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.713+0000 7efec97fa640 1 -- 172.21.15.81:0/490708571 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7efebc0bc270 con 0x7efecc073090 2024-09-17T05:19:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.713+0000 7efecbfff640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efeb8078c50 0x7efeb807b110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:46.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.713+0000 7efecbfff640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efeb8078c50 0x7efeb807b110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efecc15e130 tx=0x7efec0007990 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:46.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.717+0000 7efec97fa640 1 -- 172.21.15.81:0/490708571 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7efebc03f030 con 0x7efecc073090 2024-09-17T05:19:46.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.916+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp72380", "target": ["mon-mgr", ""]}) -- 0x7efecc15eb00 con 0x7efeb8078c50 2024-09-17T05:19:46.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.921+0000 7efec97fa640 1 -- 172.21.15.81:0/490708571 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efec00050d0 con 0x7efeb8078c50 2024-09-17T05:19:46.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efeb8078c50 msgr2=0x7efeb807b110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efeb8078c50 0x7efeb807b110 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7efecc15e130 tx=0x7efec0007990 comp rx=0 tx=0).stop 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc073090 msgr2=0x7efecc151030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc073090 0x7efecc151030 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7efebc000c00 tx=0x7efebc033d60 comp rx=0 tx=0).stop 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 shutdown_connections 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efeb8078c50 0x7efeb807b110 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efecc15b380 0x7efecc06f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efecc0ce120 0x7efecc0c75a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 --2- 172.21.15.81:0/490708571 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efecc073090 0x7efecc151030 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 >> 172.21.15.81:0/490708571 conn(0x7efecc0b1700 msgr2=0x7efecc06e780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 shutdown_connections 2024-09-17T05:19:46.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:46.923+0000 7efed2f2b640 1 -- 172.21.15.81:0/490708571 wait complete. 2024-09-17T05:19:46.935 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:19:46.935 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:19:46.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:19:47.029 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:19:47.029 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:19:47.029 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:47.030 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:47.045 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:47.046 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:47.102 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:47.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 -- 172.21.15.81:0/2949753177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 msgr2=0x7fe68c0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2949753177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c0739a0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fe684005fd0 tx=0x7fe68402a530 comp rx=0 tx=0).stop 2024-09-17T05:19:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 -- 172.21.15.81:0/2949753177 shutdown_connections 2024-09-17T05:19:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2949753177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c0739a0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2949753177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe68c15aa70 0x7fe68c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 -- 172.21.15.81:0/2949753177 >> 172.21.15.81:0/2949753177 conn(0x7fe68c0b1690 msgr2=0x7fe68c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:47.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 -- 172.21.15.81:0/2949753177 shutdown_connections 2024-09-17T05:19:47.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.242+0000 7fe692e7f640 1 -- 172.21.15.81:0/2949753177 wait complete. 2024-09-17T05:19:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.244+0000 7fe692e7f640 1 Processor -- start 2024-09-17T05:19:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.244+0000 7fe692e7f640 1 -- start start 2024-09-17T05:19:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.244+0000 7fe692e7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c1e7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.244+0000 7fe692e7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe68c0735a0 0x7fe68c158d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe692e7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe68c15aa70 0x7fe68c1e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe692e7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c0cd270 con 0x7fe68c070690 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe692e7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe68c0cd0f0 con 0x7fe68c0735a0 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe692e7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe68c0cd3f0 con 0x7fe68c15aa70 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c1e7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c1e7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57136/0 (socket says 172.21.15.81:57136) 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 -- 172.21.15.81:0/2987685202 learned_addr learned my addr 172.21.15.81:0/2987685202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe68bfff640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe68c0735a0 0x7fe68c158d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe69141c640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe68c15aa70 0x7fe68c1e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 -- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe68c15aa70 msgr2=0x7fe68c1e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe68c15aa70 0x7fe68c1e3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 -- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe68c0735a0 msgr2=0x7fe68c158d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe68c0735a0 0x7fe68c158d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 -- 172.21.15.81:0/2987685202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe68c1597e0 con 0x7fe68c070690 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe69141c640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe68c15aa70 0x7fe68c1e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe690c1b640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c1e7cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe67400b410 tx=0x7fe67400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe6897fa640 1 -- 172.21.15.81:0/2987685202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674015020 con 0x7fe68c070690 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe6897fa640 1 -- 172.21.15.81:0/2987685202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe674011940 con 0x7fe68c070690 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe68c159ac0 con 0x7fe68c070690 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe6897fa640 1 -- 172.21.15.81:0/2987685202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe674011d90 con 0x7fe68c070690 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.245+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe68c15bee0 con 0x7fe68c070690 2024-09-17T05:19:47.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.246+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe68c159d00 con 0x7fe68c070690 2024-09-17T05:19:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.247+0000 7fe6897fa640 1 -- 172.21.15.81:0/2987685202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 6) ==== 101492+0+0 (secure 0 0 0) 0x7fe674018020 con 0x7fe68c070690 2024-09-17T05:19:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.247+0000 7fe6897fa640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe66c078c20 0x7fe66c07b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.248+0000 7fe6897fa640 1 -- 172.21.15.81:0/2987685202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe67409adf0 con 0x7fe68c070690 2024-09-17T05:19:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.248+0000 7fe68bfff640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe66c078c20 0x7fe66c07b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.248+0000 7fe68bfff640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe66c078c20 0x7fe66c07b0e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe68c143fb0 tx=0x7fe67c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:47.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.252+0000 7fe6897fa640 1 -- 172.21.15.81:0/2987685202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe68c159d00 con 0x7fe68c070690 2024-09-17T05:19:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.438+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fe68c0cd970 con 0x7fe68c070690 2024-09-17T05:19:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.438+0000 7fe6897fa640 1 -- 172.21.15.81:0/2987685202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fe67401f020 con 0x7fe68c070690 2024-09-17T05:19:47.439 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe66c078c20 msgr2=0x7fe66c07b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe66c078c20 0x7fe66c07b0e0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fe68c143fb0 tx=0x7fe67c009040 comp rx=0 tx=0).stop 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 msgr2=0x7fe68c1e7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c1e7cd0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fe67400b410 tx=0x7fe67400b8d0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 shutdown_connections 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe66c078c20 0x7fe66c07b0e0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe68c15aa70 0x7fe68c1e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe68c0735a0 0x7fe68c158d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 --2- 172.21.15.81:0/2987685202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe68c070690 0x7fe68c1e7cd0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 >> 172.21.15.81:0/2987685202 conn(0x7fe68c0b1690 msgr2=0x7fe68c0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 shutdown_connections 2024-09-17T05:19:47.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.440+0000 7fe692e7f640 1 -- 172.21.15.81:0/2987685202 wait complete. 2024-09-17T05:19:47.452 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:19:47.452 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:47.453 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:19:47.475 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[48735]: fuse finished with error 0 and tester_r 0 2024-09-17T05:19:47.477 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:19:47.477 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:47.477 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:19:47.535 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:19:47.535 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:47.535 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:47.552 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:47.552 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:47.609 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:19:47.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 -- 172.21.15.81:0/4171368841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f0b0 msgr2=0x7fca2c0cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 --2- 172.21.15.81:0/4171368841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f0b0 0x7fca2c0cd3e0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fca28009830 tx=0x7fca2802a510 comp rx=0 tx=0).stop 2024-09-17T05:19:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 -- 172.21.15.81:0/4171368841 shutdown_connections 2024-09-17T05:19:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 --2- 172.21.15.81:0/4171368841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca2c0ce950 0x7fca2c0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 --2- 172.21.15.81:0/4171368841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f0b0 0x7fca2c0cd3e0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 -- 172.21.15.81:0/4171368841 >> 172.21.15.81:0/4171368841 conn(0x7fca2c0741f0 msgr2=0x7fca2c074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 -- 172.21.15.81:0/4171368841 shutdown_connections 2024-09-17T05:19:47.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.710+0000 7fca33a79640 1 -- 172.21.15.81:0/4171368841 wait complete. 2024-09-17T05:19:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.711+0000 7fca33a79640 1 Processor -- start 2024-09-17T05:19:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca33a79640 1 -- start start 2024-09-17T05:19:47.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca33a79640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca2c06f0b0 0x7fca2c099850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca33a79640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f490 0x7fca2c09dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca33a79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2c0ce950 0x7fca2c156210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca33a79640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c0cc0c0 con 0x7fca2c0ce950 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca33a79640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca2c15e670 con 0x7fca2c06f490 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca33a79640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fca2c0cc240 con 0x7fca2c06f0b0 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca32016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2c0ce950 0x7fca2c156210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca31815640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca2c06f0b0 0x7fca2c099850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca32016640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2c0ce950 0x7fca2c156210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57142/0 (socket says 172.21.15.81:57142) 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca32016640 1 -- 172.21.15.81:0/3788263153 learned_addr learned my addr 172.21.15.81:0/3788263153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.712+0000 7fca31014640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f490 0x7fca2c09dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca32016640 1 -- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca2c06f0b0 msgr2=0x7fca2c099850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca32016640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca2c06f0b0 0x7fca2c099850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca32016640 1 -- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f490 msgr2=0x7fca2c09dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca32016640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f490 0x7fca2c09dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca32016640 1 -- 172.21.15.81:0/3788263153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca2c09a890 con 0x7fca2c0ce950 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca31815640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca2c06f0b0 0x7fca2c099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca31014640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f490 0x7fca2c09dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca32016640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2c0ce950 0x7fca2c156210 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca2400ec20 tx=0x7fca2400c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca227fc640 1 -- 172.21.15.81:0/3788263153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24003b70 con 0x7fca2c0ce950 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca2c1551d0 con 0x7fca2c0ce950 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca227fc640 1 -- 172.21.15.81:0/3788263153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca24003e00 con 0x7fca2c0ce950 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca227fc640 1 -- 172.21.15.81:0/3788263153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca24004280 con 0x7fca2c0ce950 2024-09-17T05:19:47.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.713+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca2c09a5b0 con 0x7fca2c0ce950 2024-09-17T05:19:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.714+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca2c0cd3e0 con 0x7fca2c0ce950 2024-09-17T05:19:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.715+0000 7fca227fc640 1 -- 172.21.15.81:0/3788263153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fca24004420 con 0x7fca2c0ce950 2024-09-17T05:19:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.715+0000 7fca227fc640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca10078d70 0x7fca1007b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:47.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.715+0000 7fca227fc640 1 -- 172.21.15.81:0/3788263153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fca2409be30 con 0x7fca2c0ce950 2024-09-17T05:19:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.715+0000 7fca31815640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca10078d70 0x7fca1007b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:47.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.716+0000 7fca31815640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca10078d70 0x7fca1007b230 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca28004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:47.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.719+0000 7fca227fc640 1 -- 172.21.15.81:0/3788263153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fca24063930 con 0x7fca2c0ce950 2024-09-17T05:19:47.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.905+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fca2c074d10 con 0x7fca2c0ce950 2024-09-17T05:19:47.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.906+0000 7fca227fc640 1 -- 172.21.15.81:0/3788263153 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v34) ==== 80+0+0 (secure 0 0 0) 0x7fca24068360 con 0x7fca2c0ce950 2024-09-17T05:19:47.907 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:19:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca10078d70 msgr2=0x7fca1007b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca10078d70 0x7fca1007b230 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fca28034000 tx=0x7fca28004730 comp rx=0 tx=0).stop 2024-09-17T05:19:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2c0ce950 msgr2=0x7fca2c156210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2c0ce950 0x7fca2c156210 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fca2400ec20 tx=0x7fca2400c6a0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 shutdown_connections 2024-09-17T05:19:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fca10078d70 0x7fca1007b230 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca2c0ce950 0x7fca2c156210 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca2c06f490 0x7fca2c09dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 --2- 172.21.15.81:0/3788263153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca2c06f0b0 0x7fca2c099850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 >> 172.21.15.81:0/3788263153 conn(0x7fca2c0741f0 msgr2=0x7fca2c158dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 shutdown_connections 2024-09-17T05:19:47.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:47.908+0000 7fca33a79640 1 -- 172.21.15.81:0/3788263153 wait complete. 2024-09-17T05:19:47.919 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:19:47.919 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:47.920 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:19:47.947 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[43970]: fuse finished with error 0 and tester_r 0 2024-09-17T05:19:47.949 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:19:47.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:19:47.949 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:19:48.052 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:19:48.052 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:48.052 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:48.068 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:19:48.068 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:19:48.068 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:48.068 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:48.085 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:19:48.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:48.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 -- 172.21.15.81:0/1926039857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc162480 msgr2=0x7f42dc0d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 --2- 172.21.15.81:0/1926039857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc162480 0x7f42dc0d0b70 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f42dc08cf10 tx=0x7f42d402aa30 comp rx=0 tx=0).stop 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 -- 172.21.15.81:0/1926039857 shutdown_connections 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 --2- 172.21.15.81:0/1926039857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc162480 0x7f42dc0d0b70 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 --2- 172.21.15.81:0/1926039857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42dc0d49c0 0x7f42dc0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 --2- 172.21.15.81:0/1926039857 >> v2:172.21.15.160:3300/0 conn(0x7f42dc15df90 0x7f42dc0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 -- 172.21.15.81:0/1926039857 >> 172.21.15.81:0/1926039857 conn(0x7f42dc0d3ea0 msgr2=0x7f42dc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 -- 172.21.15.81:0/1926039857 shutdown_connections 2024-09-17T05:19:48.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.208+0000 7f42e2d24640 1 -- 172.21.15.81:0/1926039857 wait complete. 2024-09-17T05:19:48.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.209+0000 7f42e2d24640 1 Processor -- start 2024-09-17T05:19:48.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.210+0000 7f42e2d24640 1 -- start start 2024-09-17T05:19:48.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.210+0000 7f42e2d24640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42dc0d49c0 0x7f42dc0b8600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.210+0000 7f42e2d24640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc15df90 0x7f42dc1f5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.210+0000 7f42e2d24640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42dc162480 0x7f42dc0cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.210+0000 7f42e2d24640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc0b3b90 con 0x7f42dc15df90 2024-09-17T05:19:48.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.210+0000 7f42e2d24640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f42dc0b3a10 con 0x7f42dc162480 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.210+0000 7f42e2d24640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f42dc0b3d10 con 0x7f42dc0d49c0 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc15df90 0x7f42dc1f5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc15df90 0x7f42dc1f5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57154/0 (socket says 172.21.15.81:57154) 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 -- 172.21.15.81:0/805050586 learned_addr learned my addr 172.21.15.81:0/805050586 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42e0ac0640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42dc0d49c0 0x7f42dc0b8600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42e12c1640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42dc162480 0x7f42dc0cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 -- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42dc0d49c0 msgr2=0x7f42dc0b8600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42dc0d49c0 0x7f42dc0b8600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 -- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42dc162480 msgr2=0x7f42dc0cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42dc162480 0x7f42dc0cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 -- 172.21.15.81:0/805050586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42dc0b9190 con 0x7f42dc15df90 2024-09-17T05:19:48.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42e12c1640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42dc162480 0x7f42dc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:48.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42dbfff640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc15df90 0x7f42dc1f5110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42d000e9f0 tx=0x7f42d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:48.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42d97fa640 1 -- 172.21.15.81:0/805050586 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d000cd80 con 0x7f42dc15df90 2024-09-17T05:19:48.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42d97fa640 1 -- 172.21.15.81:0/805050586 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f42d0005020 con 0x7f42dc15df90 2024-09-17T05:19:48.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42d97fa640 1 -- 172.21.15.81:0/805050586 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42d0005450 con 0x7f42dc15df90 2024-09-17T05:19:48.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42dc0cb450 con 0x7f42dc15df90 2024-09-17T05:19:48.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.211+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42dc0cba10 con 0x7f42dc15df90 2024-09-17T05:19:48.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.213+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42dc0cf9b0 con 0x7f42dc15df90 2024-09-17T05:19:48.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.213+0000 7f42d97fa640 1 -- 172.21.15.81:0/805050586 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f42d00047a0 con 0x7f42dc15df90 2024-09-17T05:19:48.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.214+0000 7f42d97fa640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f42c8078d40 0x7f42c807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.214+0000 7f42d97fa640 1 -- 172.21.15.81:0/805050586 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f42d009bb50 con 0x7f42dc15df90 2024-09-17T05:19:48.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.214+0000 7f42e0ac0640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f42c8078d40 0x7f42c807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.214+0000 7f42e0ac0640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f42c8078d40 0x7f42c807b200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f42cc005e00 tx=0x7f42cc005c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:48.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.218+0000 7f42d97fa640 1 -- 172.21.15.81:0/805050586 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f42d0063de0 con 0x7f42dc15df90 2024-09-17T05:19:48.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.428+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f42dc08d590 con 0x7f42dc15df90 2024-09-17T05:19:48.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.429+0000 7f42d97fa640 1 -- 172.21.15.81:0/805050586 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7f42d00636e0 con 0x7f42dc15df90 2024-09-17T05:19:48.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:48.430 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"btime":"2024-09-17T05:19:41:459879+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1349280669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1349280669},{"type":"v1","addr":"172.21.15.81:6835","nonce":1349280669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4116874676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4116874676},{"type":"v1","addr":"172.21.15.81:6834","nonce":4116874676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3419973321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3419973321},{"type":"v1","addr":"172.21.15.160:6836","nonce":3419973321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:27.525714+0000","modified":"2024-09-17T05:19:29.543405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/974638720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":974638720},{"type":"v1","addr":"172.21.15.160:6837","nonce":974638720}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-17T05:19:48.430 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f42c8078d40 msgr2=0x7f42c807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f42c8078d40 0x7f42c807b200 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f42cc005e00 tx=0x7f42cc005c70 comp rx=0 tx=0).stop 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc15df90 msgr2=0x7f42dc1f5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc15df90 0x7f42dc1f5110 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f42d000e9f0 tx=0x7f42d000edf0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 shutdown_connections 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f42c8078d40 0x7f42c807b200 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f42dc162480 0x7f42dc0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42dc15df90 0x7f42dc1f5110 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 --2- 172.21.15.81:0/805050586 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42dc0d49c0 0x7f42dc0b8600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 >> 172.21.15.81:0/805050586 conn(0x7f42dc0d3ea0 msgr2=0x7f42dc06e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 shutdown_connections 2024-09-17T05:19:48.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.431+0000 7f42e2d24640 1 -- 172.21.15.81:0/805050586 wait complete. 2024-09-17T05:19:48.443 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:48.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 -- 172.21.15.81:0/3128180332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f80b3140 msgr2=0x7fe7f8072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 --2- 172.21.15.81:0/3128180332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f80b3140 0x7fe7f8072ae0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe7f0005fd0 tx=0x7fe7f002c800 comp rx=0 tx=0).stop 2024-09-17T05:19:48.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 -- 172.21.15.81:0/3128180332 shutdown_connections 2024-09-17T05:19:48.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 --2- 172.21.15.81:0/3128180332 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f80b3140 0x7fe7f8072ae0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 --2- 172.21.15.81:0/3128180332 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7f80cf640 0x7fe7f80725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 -- 172.21.15.81:0/3128180332 >> 172.21.15.81:0/3128180332 conn(0x7fe7f80b1690 msgr2=0x7fe7f80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:48.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 -- 172.21.15.81:0/3128180332 shutdown_connections 2024-09-17T05:19:48.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.543+0000 7fe7fde47640 1 -- 172.21.15.81:0/3128180332 wait complete. 2024-09-17T05:19:48.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.544+0000 7fe7fde47640 1 Processor -- start 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7fde47640 1 -- start start 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7fde47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80b3140 0x7fe7f8144680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7fde47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7f80cf640 0x7fe7f80cd630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7fde47640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f8151370 0x7fe7f80cdb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7fde47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f806ec10 con 0x7fe7f80b3140 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7fde47640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe7f806ea90 con 0x7fe7f8151370 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7fde47640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe7f806f9f0 con 0x7fe7f80cf640 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80b3140 0x7fe7f8144680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7f77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80b3140 0x7fe7f8144680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57168/0 (socket says 172.21.15.81:57168) 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.545+0000 7fe7f77fe640 1 -- 172.21.15.81:0/2815235490 learned_addr learned my addr 172.21.15.81:0/2815235490 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f6ffd640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7f80cf640 0x7fe7f80cd630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f7fff640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f8151370 0x7fe7f80cdb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f77fe640 1 -- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7f80cf640 msgr2=0x7fe7f80cd630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f77fe640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7f80cf640 0x7fe7f80cd630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f77fe640 1 -- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f8151370 msgr2=0x7fe7f80cdb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f77fe640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f8151370 0x7fe7f80cdb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f77fe640 1 -- 172.21.15.81:0/2815235490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7f8147680 con 0x7fe7f80b3140 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f7fff640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f8151370 0x7fe7f80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f6ffd640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7f80cf640 0x7fe7f80cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7f77fe640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80b3140 0x7fe7f8144680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800c730 tx=0x7fe7e800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7dffff640 1 -- 172.21.15.81:0/2815235490 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e8003b70 con 0x7fe7f80b3140 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7dffff640 1 -- 172.21.15.81:0/2815235490 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7e8003d30 con 0x7fe7f80b3140 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7dffff640 1 -- 172.21.15.81:0/2815235490 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e800aab0 con 0x7fe7f80b3140 2024-09-17T05:19:48.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7f8148870 con 0x7fe7f80b3140 2024-09-17T05:19:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.546+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7f8147f00 con 0x7fe7f80b3140 2024-09-17T05:19:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.547+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7f80cef30 con 0x7fe7f80b3140 2024-09-17T05:19:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.548+0000 7fe7dffff640 1 -- 172.21.15.81:0/2815235490 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fe7e800ac50 con 0x7fe7f80b3140 2024-09-17T05:19:48.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.548+0000 7fe7dffff640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7e4078d70 0x7fe7e407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.548+0000 7fe7dffff640 1 -- 172.21.15.81:0/2815235490 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fe7e809aec0 con 0x7fe7f80b3140 2024-09-17T05:19:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.548+0000 7fe7f6ffd640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7e4078d70 0x7fe7e407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.549+0000 7fe7f6ffd640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7e4078d70 0x7fe7e407b230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80d06c0 tx=0x7fe7ec005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:48.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.552+0000 7fe7dffff640 1 -- 172.21.15.81:0/2815235490 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe7e8063000 con 0x7fe7f80b3140 2024-09-17T05:19:48.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.765+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7f815a1c0 con 0x7fe7f80b3140 2024-09-17T05:19:48.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.765+0000 7fe7dffff640 1 -- 172.21.15.81:0/2815235490 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7fe7e8062900 con 0x7fe7f80b3140 2024-09-17T05:19:48.766 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:48.766 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"btime":"2024-09-17T05:19:41:459879+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1349280669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1349280669},{"type":"v1","addr":"172.21.15.81:6835","nonce":1349280669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4116874676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4116874676},{"type":"v1","addr":"172.21.15.81:6834","nonce":4116874676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3419973321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3419973321},{"type":"v1","addr":"172.21.15.160:6836","nonce":3419973321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:27.525714+0000","modified":"2024-09-17T05:19:29.543405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/974638720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":974638720},{"type":"v1","addr":"172.21.15.160:6837","nonce":974638720}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-17T05:19:48.767 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7e4078d70 msgr2=0x7fe7e407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7e4078d70 0x7fe7e407b230 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80d06c0 tx=0x7fe7ec005f90 comp rx=0 tx=0).stop 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80b3140 msgr2=0x7fe7f8144680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80b3140 0x7fe7f8144680 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7fe7e800c730 tx=0x7fe7e800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 shutdown_connections 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7e4078d70 0x7fe7e407b230 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7f8151370 0x7fe7f80cdb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7f80cf640 0x7fe7f80cd630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 --2- 172.21.15.81:0/2815235490 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7f80b3140 0x7fe7f8144680 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.767+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 >> 172.21.15.81:0/2815235490 conn(0x7fe7f80b1690 msgr2=0x7fe7f80cbc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.768+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 shutdown_connections 2024-09-17T05:19:48.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.768+0000 7fe7fde47640 1 -- 172.21.15.81:0/2815235490 wait complete. 2024-09-17T05:19:48.780 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:48.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 -- 172.21.15.81:0/3834996970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 msgr2=0x7fd30015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 --2- 172.21.15.81:0/3834996970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd30015d270 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fd3000ce5a0 tx=0x7fd2f002aa30 comp rx=0 tx=0).stop 2024-09-17T05:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 -- 172.21.15.81:0/3834996970 shutdown_connections 2024-09-17T05:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 --2- 172.21.15.81:0/3834996970 >> v2:172.21.15.160:3300/0 conn(0x7fd3000cc8d0 0x7fd30015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 --2- 172.21.15.81:0/3834996970 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3000cc490 0x7fd30015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 --2- 172.21.15.81:0/3834996970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd30015d270 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 -- 172.21.15.81:0/3834996970 >> 172.21.15.81:0/3834996970 conn(0x7fd3000b1690 msgr2=0x7fd3000b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 -- 172.21.15.81:0/3834996970 shutdown_connections 2024-09-17T05:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.879+0000 7fd3048b8640 1 -- 172.21.15.81:0/3834996970 wait complete. 2024-09-17T05:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.880+0000 7fd3048b8640 1 Processor -- start 2024-09-17T05:19:48.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd3048b8640 1 -- start start 2024-09-17T05:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd3048b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3000cc490 0x7fd30015dc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd3048b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3000cc8d0 0x7fd3000a9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd3048b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd3000ae660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd3048b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000cec40 con 0x7fd300159680 2024-09-17T05:19:48.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd3048b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd3000ceac0 con 0x7fd3000cc490 2024-09-17T05:19:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd3048b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd3000cedc0 con 0x7fd3000cc8d0 2024-09-17T05:19:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd2fed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd3000ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd2fed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd3000ae660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57194/0 (socket says 172.21.15.81:57194) 2024-09-17T05:19:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd2fed9d640 1 -- 172.21.15.81:0/142941484 learned_addr learned my addr 172.21.15.81:0/142941484 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:48.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd2fe59c640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3000cc490 0x7fd30015dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.881+0000 7fd2fdd9b640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3000cc8d0 0x7fd3000a9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2fed9d640 1 -- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3000cc8d0 msgr2=0x7fd3000a9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2fed9d640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3000cc8d0 0x7fd3000a9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2fed9d640 1 -- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3000cc490 msgr2=0x7fd30015dc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2fed9d640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3000cc490 0x7fd30015dc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:48.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2fed9d640 1 -- 172.21.15.81:0/142941484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3000a9f10 con 0x7fd300159680 2024-09-17T05:19:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2fdd9b640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3000cc8d0 0x7fd3000a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2fed9d640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd3000ae660 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800d750 tx=0x7fd2f800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2eeffd640 1 -- 172.21.15.81:0/142941484 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f8017070 con 0x7fd300159680 2024-09-17T05:19:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2eeffd640 1 -- 172.21.15.81:0/142941484 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2f8009cc0 con 0x7fd300159680 2024-09-17T05:19:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3001f26c0 con 0x7fd300159680 2024-09-17T05:19:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd2eeffd640 1 -- 172.21.15.81:0/142941484 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2f800de60 con 0x7fd300159680 2024-09-17T05:19:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.882+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3001f2300 con 0x7fd300159680 2024-09-17T05:19:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.883+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3000cf2e0 con 0x7fd300159680 2024-09-17T05:19:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.883+0000 7fd2eeffd640 1 -- 172.21.15.81:0/142941484 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fd2f8005280 con 0x7fd300159680 2024-09-17T05:19:48.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.884+0000 7fd2eeffd640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd2e0078d40 0x7fd2e007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.884+0000 7fd2eeffd640 1 -- 172.21.15.81:0/142941484 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fd2f809b190 con 0x7fd300159680 2024-09-17T05:19:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.884+0000 7fd2fe59c640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd2e0078d40 0x7fd2e007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:48.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.885+0000 7fd2fe59c640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd2e0078d40 0x7fd2e007b200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0035000 tx=0x7fd2f003b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:48.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:48.888+0000 7fd2eeffd640 1 -- 172.21.15.81:0/142941484 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd3001f26c0 con 0x7fd300159680 2024-09-17T05:19:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.063+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd3000b0750 con 0x7fd300159680 2024-09-17T05:19:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.064+0000 7fd2eeffd640 1 -- 172.21.15.81:0/142941484 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16729 (secure 0 0 0) 0x7fd2f8062d10 con 0x7fd300159680 2024-09-17T05:19:49.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:49.066 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:29.186400+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:25.252883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:26.493997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd2e0078d40 msgr2=0x7fd2e007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd2e0078d40 0x7fd2e007b200 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd2f0035000 tx=0x7fd2f003b040 comp rx=0 tx=0).stop 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 msgr2=0x7fd3000ae660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd3000ae660 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fd2f800d750 tx=0x7fd2f800dc10 comp rx=0 tx=0).stop 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 shutdown_connections 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd2e0078d40 0x7fd2e007b200 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd300159680 0x7fd3000ae660 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd3000cc8d0 0x7fd3000a9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 --2- 172.21.15.81:0/142941484 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3000cc490 0x7fd30015dc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 >> 172.21.15.81:0/142941484 conn(0x7fd3000b1690 msgr2=0x7fd3000af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.066+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 shutdown_connections 2024-09-17T05:19:49.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.067+0000 7fd3048b8640 1 -- 172.21.15.81:0/142941484 wait complete. 2024-09-17T05:19:49.079 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:19:49.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.179+0000 7f7e2c285640 1 -- 172.21.15.81:0/3039493471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2415e370 msgr2=0x7f7e240725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.179+0000 7f7e2c285640 1 --2- 172.21.15.81:0/3039493471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2415e370 0x7f7e240725a0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7e20005fd0 tx=0x7f7e2002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.180+0000 7f7e2c285640 1 -- 172.21.15.81:0/3039493471 shutdown_connections 2024-09-17T05:19:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.180+0000 7f7e2c285640 1 --2- 172.21.15.81:0/3039493471 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e240b42b0 0x7f7e24167920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.180+0000 7f7e2c285640 1 --2- 172.21.15.81:0/3039493471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e2415e370 0x7f7e240725a0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.180+0000 7f7e2c285640 1 -- 172.21.15.81:0/3039493471 >> 172.21.15.81:0/3039493471 conn(0x7f7e240b1690 msgr2=0x7f7e240b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.180+0000 7f7e2c285640 1 -- 172.21.15.81:0/3039493471 shutdown_connections 2024-09-17T05:19:49.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.180+0000 7f7e2c285640 1 -- 172.21.15.81:0/3039493471 wait complete. 2024-09-17T05:19:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 Processor -- start 2024-09-17T05:19:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 -- start start 2024-09-17T05:19:49.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e240b42b0 0x7f7e2414ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e2415e370 0x7f7e241609b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e2415e750 0x7f7e241f7d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e24167fe0 con 0x7f7e240b42b0 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7e24167e60 con 0x7f7e2415e370 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.181+0000 7f7e2c285640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7e24168160 con 0x7f7e2415e750 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e240b42b0 0x7f7e2414ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e240b42b0 0x7f7e2414ff10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57222/0 (socket says 172.21.15.81:57222) 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 -- 172.21.15.81:0/2897648893 learned_addr learned my addr 172.21.15.81:0/2897648893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a822640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e2415e750 0x7f7e241f7d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e29820640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e2415e370 0x7f7e241609b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 -- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e2415e750 msgr2=0x7f7e241f7d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e2415e750 0x7f7e241f7d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 -- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e2415e370 msgr2=0x7f7e241609b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e2415e370 0x7f7e241609b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 -- 172.21.15.81:0/2897648893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e2414c2d0 con 0x7f7e240b42b0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2a021640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e240b42b0 0x7f7e2414ff10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009850 tx=0x7f7e200039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e1affd640 1 -- 172.21.15.81:0/2897648893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e2003f070 con 0x7f7e240b42b0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e1affd640 1 -- 172.21.15.81:0/2897648893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e20004890 con 0x7f7e240b42b0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e24150560 con 0x7f7e240b42b0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e1affd640 1 -- 172.21.15.81:0/2897648893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e20035030 con 0x7f7e240b42b0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.182+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e240ce2d0 con 0x7f7e240b42b0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.183+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e240cdde0 con 0x7f7e240b42b0 2024-09-17T05:19:49.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.184+0000 7f7e1affd640 1 -- 172.21.15.81:0/2897648893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f7e20042070 con 0x7f7e240b42b0 2024-09-17T05:19:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.184+0000 7f7e1affd640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7e08078d40 0x7f7e0807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.184+0000 7f7e1affd640 1 -- 172.21.15.81:0/2897648893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f7e200bbf90 con 0x7f7e240b42b0 2024-09-17T05:19:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.185+0000 7f7e29820640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7e08078d40 0x7f7e0807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.185+0000 7f7e29820640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7e08078d40 0x7f7e0807b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e24158900 tx=0x7f7e14009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:49.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.188+0000 7f7e1affd640 1 -- 172.21.15.81:0/2897648893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7e20084160 con 0x7f7e240b42b0 2024-09-17T05:19:49.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.403+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7e240b0c10 con 0x7f7e240b42b0 2024-09-17T05:19:49.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.403+0000 7f7e1affd640 1 -- 172.21.15.81:0/2897648893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7f7e20083a60 con 0x7f7e240b42b0 2024-09-17T05:19:49.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:49.405 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"btime":"2024-09-17T05:19:41:459879+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1349280669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1349280669},{"type":"v1","addr":"172.21.15.81:6835","nonce":1349280669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4116874676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4116874676},{"type":"v1","addr":"172.21.15.81:6834","nonce":4116874676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3419973321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3419973321},{"type":"v1","addr":"172.21.15.160:6836","nonce":3419973321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:27.525714+0000","modified":"2024-09-17T05:19:29.543405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/974638720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":974638720},{"type":"v1","addr":"172.21.15.160:6837","nonce":974638720}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-17T05:19:49.405 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7e08078d40 msgr2=0x7f7e0807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7e08078d40 0x7f7e0807b200 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f7e24158900 tx=0x7f7e14009040 comp rx=0 tx=0).stop 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e240b42b0 msgr2=0x7f7e2414ff10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e240b42b0 0x7f7e2414ff10 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7e20009850 tx=0x7f7e200039e0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 shutdown_connections 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7e08078d40 0x7f7e0807b200 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e2415e750 0x7f7e241f7d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e2415e370 0x7f7e241609b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 --2- 172.21.15.81:0/2897648893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e240b42b0 0x7f7e2414ff10 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 >> 172.21.15.81:0/2897648893 conn(0x7f7e240b1690 msgr2=0x7f7e240b02b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:49.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 shutdown_connections 2024-09-17T05:19:49.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.406+0000 7f7e2c285640 1 -- 172.21.15.81:0/2897648893 wait complete. 2024-09-17T05:19:49.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 -- 172.21.15.81:0/3163770137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c40735a0 msgr2=0x7f52c40739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 --2- 172.21.15.81:0/3163770137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c40735a0 0x7f52c40739a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f52c40cf960 tx=0x7f52b802a560 comp rx=0 tx=0).stop 2024-09-17T05:19:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 -- 172.21.15.81:0/3163770137 shutdown_connections 2024-09-17T05:19:49.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 --2- 172.21.15.81:0/3163770137 >> v2:172.21.15.160:3300/0 conn(0x7f52c406ff80 0x7f52c4070430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 --2- 172.21.15.81:0/3163770137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c40735a0 0x7f52c40739a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 --2- 172.21.15.81:0/3163770137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52c415aa70 0x7f52c40b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 -- 172.21.15.81:0/3163770137 >> 172.21.15.81:0/3163770137 conn(0x7f52c40b1690 msgr2=0x7f52c40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 -- 172.21.15.81:0/3163770137 shutdown_connections 2024-09-17T05:19:49.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.519+0000 7f52c9c39640 1 -- 172.21.15.81:0/3163770137 wait complete. 2024-09-17T05:19:49.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.520+0000 7f52c9c39640 1 Processor -- start 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.520+0000 7f52c9c39640 1 -- start start 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c9c39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c406ff80 0x7f52c406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c9c39640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52c40735a0 0x7f52c4141b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c9c39640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52c415aa70 0x7f52c413ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c9c39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52c40cd060 con 0x7f52c406ff80 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c9c39640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f52c40ccee0 con 0x7f52c40735a0 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c9c39640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f52c40cd1e0 con 0x7f52c415aa70 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c406ff80 0x7f52c406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c406ff80 0x7f52c406f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57250/0 (socket says 172.21.15.81:57250) 2024-09-17T05:19:49.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 -- 172.21.15.81:0/970863295 learned_addr learned my addr 172.21.15.81:0/970863295 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c3fff640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52c415aa70 0x7f52c413ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c2ffd640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52c40735a0 0x7f52c4141b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 -- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52c415aa70 msgr2=0x7f52c413ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52c415aa70 0x7f52c413ee50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 -- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52c40735a0 msgr2=0x7f52c4141b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52c40735a0 0x7f52c4141b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c37fe640 1 -- 172.21.15.81:0/970863295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c41425f0 con 0x7f52c406ff80 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.521+0000 7f52c3fff640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52c415aa70 0x7f52c413ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:49.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.522+0000 7f52c37fe640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c406ff80 0x7f52c406f0e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f52b400ba50 tx=0x7f52b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.522+0000 7f52abfff640 1 -- 172.21.15.81:0/970863295 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b4019070 con 0x7f52c406ff80 2024-09-17T05:19:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.522+0000 7f52abfff640 1 -- 172.21.15.81:0/970863295 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f52b400ccf0 con 0x7f52c406ff80 2024-09-17T05:19:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.522+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c41428d0 con 0x7f52c406ff80 2024-09-17T05:19:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.522+0000 7f52abfff640 1 -- 172.21.15.81:0/970863295 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52b40146a0 con 0x7f52c406ff80 2024-09-17T05:19:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.522+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c415a0b0 con 0x7f52c406ff80 2024-09-17T05:19:49.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.523+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c413faf0 con 0x7f52c406ff80 2024-09-17T05:19:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.523+0000 7f52abfff640 1 -- 172.21.15.81:0/970863295 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f52b401c070 con 0x7f52c406ff80 2024-09-17T05:19:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.524+0000 7f52abfff640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f52b0078d40 0x7f52b007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.524+0000 7f52abfff640 1 -- 172.21.15.81:0/970863295 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7f52b409aea0 con 0x7f52c406ff80 2024-09-17T05:19:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.524+0000 7f52c2ffd640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f52b0078d40 0x7f52b007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.525+0000 7f52c2ffd640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f52b0078d40 0x7f52b007b200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f52b8033000 tx=0x7f52b8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:49.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.528+0000 7f52abfff640 1 -- 172.21.15.81:0/970863295 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f52c413faf0 con 0x7f52c406ff80 2024-09-17T05:19:49.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.739+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f52c40739a0 con 0x7f52c406ff80 2024-09-17T05:19:49.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.739+0000 7f52abfff640 1 -- 172.21.15.81:0/970863295 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) ==== 94+0+5226 (secure 0 0 0) 0x7f52b4062fe0 con 0x7f52c406ff80 2024-09-17T05:19:49.740 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:49.740 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":15,"btime":"2024-09-17T05:19:41:459879+0000","default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1349280669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1349280669},{"type":"v1","addr":"172.21.15.81:6835","nonce":1349280669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4116874676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4116874676},{"type":"v1","addr":"172.21.15.81:6834","nonce":4116874676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3419973321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3419973321},{"type":"v1","addr":"172.21.15.160:6836","nonce":3419973321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:27.525714+0000","modified":"2024-09-17T05:19:29.543405+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4884},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4884":{"gid":4884,"name":"d","rank":0,"incarnation":12,"state":"up:active","state_seq":3,"addr":"172.21.15.160:6837/974638720","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":974638720},{"type":"v1","addr":"172.21.15.160:6837","nonce":974638720}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4884,"qdb_cluster":[4884]},"id":2}]} 2024-09-17T05:19:49.741 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 15 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f52b0078d40 msgr2=0x7f52b007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f52b0078d40 0x7f52b007b200 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f52b8033000 tx=0x7f52b8004730 comp rx=0 tx=0).stop 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c406ff80 msgr2=0x7f52c406f0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c406ff80 0x7f52c406f0e0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f52b400ba50 tx=0x7f52b400bf10 comp rx=0 tx=0).stop 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 shutdown_connections 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f52b0078d40 0x7f52b007b200 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f52c415aa70 0x7f52c413ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52c40735a0 0x7f52c4141b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 --2- 172.21.15.81:0/970863295 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52c406ff80 0x7f52c406f0e0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.741+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 >> 172.21.15.81:0/970863295 conn(0x7f52c40b1690 msgr2=0x7f52c40b2c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.742+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 shutdown_connections 2024-09-17T05:19:49.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.742+0000 7f52c9c39640 1 -- 172.21.15.81:0/970863295 wait complete. 2024-09-17T05:19:49.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 -- 172.21.15.81:0/1104445849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15f6d0 msgr2=0x7fc04c15c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 --2- 172.21.15.81:0/1104445849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15f6d0 0x7fc04c15c880 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fc04c0d09d0 tx=0x7fc04002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 -- 172.21.15.81:0/1104445849 shutdown_connections 2024-09-17T05:19:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 --2- 172.21.15.81:0/1104445849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc04c15cdc0 0x7fc04c0cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 --2- 172.21.15.81:0/1104445849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15f6d0 0x7fc04c15c880 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 --2- 172.21.15.81:0/1104445849 >> v2:172.21.15.160:3300/0 conn(0x7fc04c0d2410 0x7fc04c0b3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 -- 172.21.15.81:0/1104445849 >> 172.21.15.81:0/1104445849 conn(0x7fc04c09aa30 msgr2=0x7fc04c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 -- 172.21.15.81:0/1104445849 shutdown_connections 2024-09-17T05:19:49.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.854+0000 7fc052070640 1 -- 172.21.15.81:0/1104445849 wait complete. 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.855+0000 7fc052070640 1 Processor -- start 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.855+0000 7fc052070640 1 -- start start 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc052070640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc04c0d2410 0x7fc04c1f8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc052070640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15cdc0 0x7fc04c1593c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc052070640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc04c15f6d0 0x7fc04c0b6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc052070640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c0b1240 con 0x7fc04c15cdc0 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc052070640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc04c0d0570 con 0x7fc04c15f6d0 2024-09-17T05:19:49.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc052070640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc04c0b13c0 con 0x7fc04c0d2410 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15cdc0 0x7fc04c1593c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15cdc0 0x7fc04c1593c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57272/0 (socket says 172.21.15.81:57272) 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 -- 172.21.15.81:0/2248372609 learned_addr learned my addr 172.21.15.81:0/2248372609 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04b7fe640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc04c0d2410 0x7fc04c1f8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04bfff640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc04c15f6d0 0x7fc04c0b6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 -- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc04c0d2410 msgr2=0x7fc04c1f8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc04c0d2410 0x7fc04c1f8ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 -- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc04c15f6d0 msgr2=0x7fc04c0b6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc04c15f6d0 0x7fc04c0b6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:49.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04affd640 1 -- 172.21.15.81:0/2248372609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc04c1f9000 con 0x7fc04c15cdc0 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.856+0000 7fc04bfff640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc04c15f6d0 0x7fc04c0b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.857+0000 7fc04affd640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15cdc0 0x7fc04c1593c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc040034040 tx=0x7fc040003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.857+0000 7fc033fff640 1 -- 172.21.15.81:0/2248372609 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc04003e030 con 0x7fc04c15cdc0 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.857+0000 7fc033fff640 1 -- 172.21.15.81:0/2248372609 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc040003e00 con 0x7fc04c15cdc0 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.857+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc04c159900 con 0x7fc04c15cdc0 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.857+0000 7fc033fff640 1 -- 172.21.15.81:0/2248372609 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc040035040 con 0x7fc04c15cdc0 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.857+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc04c0b7050 con 0x7fc04c15cdc0 2024-09-17T05:19:49.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.858+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc04c0b18e0 con 0x7fc04c15cdc0 2024-09-17T05:19:49.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.859+0000 7fc033fff640 1 -- 172.21.15.81:0/2248372609 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fc040041030 con 0x7fc04c15cdc0 2024-09-17T05:19:49.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.859+0000 7fc033fff640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc038078d40 0x7fc03807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:49.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.859+0000 7fc033fff640 1 -- 172.21.15.81:0/2248372609 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fc0400bb7f0 con 0x7fc04c15cdc0 2024-09-17T05:19:49.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.859+0000 7fc04b7fe640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc038078d40 0x7fc03807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:49.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.860+0000 7fc04b7fe640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc038078d40 0x7fc03807b200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc03c005fd0 tx=0x7fc03c009600 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:49.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:49.863+0000 7fc033fff640 1 -- 172.21.15.81:0/2248372609 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc0400832f0 con 0x7fc04c15cdc0 2024-09-17T05:19:50.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.041+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc04c0c5500 con 0x7fc04c15cdc0 2024-09-17T05:19:50.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.041+0000 7fc033fff640 1 -- 172.21.15.81:0/2248372609 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v34) ==== 74+0+16729 (secure 0 0 0) 0x7fc040087d20 con 0x7fc04c15cdc0 2024-09-17T05:19:50.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:50.043 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:29.186400+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:25.252883+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:26.493997+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"34","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc038078d40 msgr2=0x7fc03807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc038078d40 0x7fc03807b200 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc03c005fd0 tx=0x7fc03c009600 comp rx=0 tx=0).stop 2024-09-17T05:19:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15cdc0 msgr2=0x7fc04c1593c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15cdc0 0x7fc04c1593c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fc040034040 tx=0x7fc040003910 comp rx=0 tx=0).stop 2024-09-17T05:19:50.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 shutdown_connections 2024-09-17T05:19:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc038078d40 0x7fc03807b200 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc04c15f6d0 0x7fc04c0b6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc04c15cdc0 0x7fc04c1593c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 --2- 172.21.15.81:0/2248372609 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc04c0d2410 0x7fc04c1f8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 >> 172.21.15.81:0/2248372609 conn(0x7fc04c09aa30 msgr2=0x7fc04c15d210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 shutdown_connections 2024-09-17T05:19:50.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.044+0000 7fc052070640 1 -- 172.21.15.81:0/2248372609 wait complete. 2024-09-17T05:19:50.057 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:19:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.157+0000 7fa2684c6640 1 -- 172.21.15.81:0/3106408912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 msgr2=0x7fa248004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.157+0000 7fa2684c6640 1 --2- 172.21.15.81:0/3106408912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa248004c80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fa25400c2e0 tx=0x7fa248005830 comp rx=0 tx=0).stop 2024-09-17T05:19:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.158+0000 7fa2684c6640 1 -- 172.21.15.81:0/3106408912 shutdown_connections 2024-09-17T05:19:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.158+0000 7fa2684c6640 1 --2- 172.21.15.81:0/3106408912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa248004c80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.158+0000 7fa2684c6640 1 -- 172.21.15.81:0/3106408912 >> 172.21.15.81:0/3106408912 conn(0x7fa2600741f0 msgr2=0x7fa260074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.158+0000 7fa2684c6640 1 -- 172.21.15.81:0/3106408912 shutdown_connections 2024-09-17T05:19:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.158+0000 7fa2684c6640 1 -- 172.21.15.81:0/3106408912 wait complete. 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 Processor -- start 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 -- start start 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa2600b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa260156e30 0x7fa2601572b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2600c7480 0x7fa2600c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa26006f610 con 0x7fa248004800 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa26006f490 con 0x7fa2600c7480 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.159+0000 7fa2684c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa26006f790 con 0x7fa260156e30 2024-09-17T05:19:50.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa2600b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa2600b1f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57286/0 (socket says 172.21.15.81:57286) 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 -- 172.21.15.81:0/2813358145 learned_addr learned my addr 172.21.15.81:0/2813358145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa265a61640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa260156e30 0x7fa2601572b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266a63640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2600c7480 0x7fa2600c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 -- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa260156e30 msgr2=0x7fa2601572b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa260156e30 0x7fa2601572b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 -- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2600c7480 msgr2=0x7fa2600c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2600c7480 0x7fa2600c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 -- 172.21.15.81:0/2813358145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2600c81f0 con 0x7fa248004800 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa265a61640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa260156e30 0x7fa2601572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266a63640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2600c7480 0x7fa2600c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:50.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa266262640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa2600b1f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa2500018c0 tx=0x7fa250001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa25effd640 1 -- 172.21.15.81:0/2813358145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa250015070 con 0x7fa248004800 2024-09-17T05:19:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa25effd640 1 -- 172.21.15.81:0/2813358145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa25000ebb0 con 0x7fa248004800 2024-09-17T05:19:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa25effd640 1 -- 172.21.15.81:0/2813358145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2500020c0 con 0x7fa248004800 2024-09-17T05:19:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2601f09c0 con 0x7fa248004800 2024-09-17T05:19:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.160+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2601f0f80 con 0x7fa248004800 2024-09-17T05:19:50.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.161+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa260069f80 con 0x7fa248004800 2024-09-17T05:19:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.162+0000 7fa25effd640 1 -- 172.21.15.81:0/2813358145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fa250018070 con 0x7fa248004800 2024-09-17T05:19:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.162+0000 7fa25effd640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa24c078d40 0x7fa24c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.163+0000 7fa25effd640 1 -- 172.21.15.81:0/2813358145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 5709+0+0 (secure 0 0 0) 0x7fa25009b990 con 0x7fa248004800 2024-09-17T05:19:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.163+0000 7fa265a61640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa24c078d40 0x7fa24c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.163+0000 7fa265a61640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa24c078d40 0x7fa24c07b200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa254033000 tx=0x7fa2540019f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:50.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.167+0000 7fa25effd640 1 -- 172.21.15.81:0/2813358145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa260069f80 con 0x7fa248004800 2024-09-17T05:19:50.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.382+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fa2600ce240 con 0x7fa248004800 2024-09-17T05:19:50.383 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:19:50.383+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:19:50.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.384+0000 7fa25effd640 1 -- 172.21.15.81:0/2813358145 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v16) ==== 161+0+0 (secure 0 0 0) 0x7fa250063ad0 con 0x7fa248004800 2024-09-17T05:19:50.385 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:19:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa24c078d40 msgr2=0x7fa24c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa24c078d40 0x7fa24c07b200 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa254033000 tx=0x7fa2540019f0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 msgr2=0x7fa2600b1f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa2600b1f80 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fa2500018c0 tx=0x7fa250001d80 comp rx=0 tx=0).stop 2024-09-17T05:19:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 shutdown_connections 2024-09-17T05:19:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa24c078d40 0x7fa24c07b200 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2600c7480 0x7fa2600c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa260156e30 0x7fa2601572b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 --2- 172.21.15.81:0/2813358145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa248004800 0x7fa2600b1f80 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 >> 172.21.15.81:0/2813358145 conn(0x7fa2600741f0 msgr2=0x7fa2600ae500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 shutdown_connections 2024-09-17T05:19:50.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.387+0000 7fa2684c6640 1 -- 172.21.15.81:0/2813358145 wait complete. 2024-09-17T05:19:50.399 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:19:50.429 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.501+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/4158093931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b581619c0 msgr2=0x7f9b580ce910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.501+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/4158093931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b581619c0 0x7f9b580ce910 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f9b50009830 tx=0x7f9b5002a510 comp rx=0 tx=0).stop 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.501+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/4158093931 shutdown_connections 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.501+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/4158093931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b581619c0 0x7f9b580ce910 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.501+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/4158093931 >> v2:172.21.15.160:3300/0 conn(0x7f9b580d0bd0 0x7f9b580b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.501+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/4158093931 >> 172.21.15.81:0/4158093931 conn(0x7f9b5809d3c0 msgr2=0x7f9b580d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.501+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/4158093931 shutdown_connections 2024-09-17T05:19:50.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.502+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/4158093931 wait complete. 2024-09-17T05:19:50.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 Processor -- start 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 -- start start 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b580d0bd0 0x7f9b58157940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b580d0fb0 0x7f9b5815acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b581619c0 0x7f9b580b1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580cf1e0 con 0x7f9b580d0fb0 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9b580cf060 con 0x7f9b581619c0 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.503+0000 7f9b5fcb1640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9b580cf360 con 0x7f9b580d0bd0 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b580d0fb0 0x7f9b5815acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b580d0fb0 0x7f9b5815acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57298/0 (socket says 172.21.15.81:57298) 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 -- 172.21.15.81:0/2541871812 learned_addr learned my addr 172.21.15.81:0/2541871812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:50.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5da4d640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b580d0bd0 0x7f9b58157940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5e24e640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b581619c0 0x7f9b580b1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 -- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b580d0bd0 msgr2=0x7f9b58157940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b580d0bd0 0x7f9b58157940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 -- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b581619c0 msgr2=0x7f9b580b1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b581619c0 0x7f9b580b1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 -- 172.21.15.81:0/2541871812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b580b84c0 con 0x7f9b580d0fb0 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5d24c640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b580d0fb0 0x7f9b5815acb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c730 tx=0x7f9b4c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b567fc640 1 -- 172.21.15.81:0/2541871812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c006a90 con 0x7f9b580d0fb0 2024-09-17T05:19:50.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b567fc640 1 -- 172.21.15.81:0/2541871812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b4c006c30 con 0x7f9b580d0fb0 2024-09-17T05:19:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b580b87a0 con 0x7f9b580d0fb0 2024-09-17T05:19:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b567fc640 1 -- 172.21.15.81:0/2541871812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b4c007030 con 0x7f9b580d0fb0 2024-09-17T05:19:50.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.504+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b580b8d60 con 0x7f9b580d0fb0 2024-09-17T05:19:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.505+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b580b40d0 con 0x7f9b580d0fb0 2024-09-17T05:19:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.506+0000 7f9b567fc640 1 -- 172.21.15.81:0/2541871812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f9b4c0071d0 con 0x7f9b580d0fb0 2024-09-17T05:19:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.506+0000 7f9b567fc640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9b44078d40 0x7f9b4407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:50.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.507+0000 7f9b567fc640 1 -- 172.21.15.81:0/2541871812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f9b4c09ac90 con 0x7f9b580d0fb0 2024-09-17T05:19:50.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.507+0000 7f9b5da4d640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9b44078d40 0x7f9b4407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.507+0000 7f9b5da4d640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9b44078d40 0x7f9b4407b200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005fd0 tx=0x7f9b48009500 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:50.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.511+0000 7f9b567fc640 1 -- 172.21.15.81:0/2541871812 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9b5809d910 con 0x7f9b580d0fb0 2024-09-17T05:19:50.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:50.724+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f9b580d4740 con 0x7f9b580d0fb0 2024-09-17T05:19:51.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.386+0000 7f9b567fc640 1 -- 172.21.15.81:0/2541871812 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v17) ==== 104+0+0 (secure 0 0 0) 0x7f9b4c062d70 con 0x7f9b580d0fb0 2024-09-17T05:19:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9b44078d40 msgr2=0x7f9b4407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9b44078d40 0x7f9b4407b200 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f9b48005fd0 tx=0x7f9b48009500 comp rx=0 tx=0).stop 2024-09-17T05:19:51.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b580d0fb0 msgr2=0x7f9b5815acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b580d0fb0 0x7f9b5815acb0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f9b4c00c730 tx=0x7f9b4c00cbf0 comp rx=0 tx=0).stop 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 shutdown_connections 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9b44078d40 0x7f9b4407b200 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b581619c0 0x7f9b580b1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b580d0fb0 0x7f9b5815acb0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 --2- 172.21.15.81:0/2541871812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b580d0bd0 0x7f9b58157940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 >> 172.21.15.81:0/2541871812 conn(0x7f9b5809d3c0 msgr2=0x7f9b58161080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 shutdown_connections 2024-09-17T05:19:51.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.389+0000 7f9b5fcb1640 1 -- 172.21.15.81:0/2541871812 wait complete. 2024-09-17T05:19:51.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:19:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.509+0000 7f37e31e2640 1 -- 172.21.15.81:0/3379040198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c4003a00 msgr2=0x7f37c4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.509+0000 7f37e31e2640 1 --2- 172.21.15.81:0/3379040198 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37c4003a00 0x7f37c4003e20 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f37cc00aae0 tx=0x7f37c4005830 comp rx=0 tx=0).stop 2024-09-17T05:19:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.509+0000 7f37e177f640 1 -- 172.21.15.81:0/3379040198 reap_dead start 2024-09-17T05:19:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.509+0000 7f37e31e2640 1 -- 172.21.15.81:0/3379040198 shutdown_connections 2024-09-17T05:19:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.509+0000 7f37e31e2640 1 -- 172.21.15.81:0/3379040198 >> 172.21.15.81:0/3379040198 conn(0x7f37dc09aa30 msgr2=0x7f37dc09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.509+0000 7f37e31e2640 1 -- 172.21.15.81:0/3379040198 shutdown_connections 2024-09-17T05:19:51.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.509+0000 7f37e31e2640 1 -- 172.21.15.81:0/3379040198 wait complete. 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.510+0000 7f37e31e2640 1 Processor -- start 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.511+0000 7f37e31e2640 1 -- start start 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.511+0000 7f37e31e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c4003a00 0x7f37dc14e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.511+0000 7f37e31e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37dc0c7cc0 0x7f37dc0b6980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.511+0000 7f37e31e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37dc0c8140 0x7f37dc0b6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.511+0000 7f37e31e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0b34a0 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.511+0000 7f37e31e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f37dc0b3320 con 0x7f37c4003a00 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.511+0000 7f37e31e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f37dc0b26d0 con 0x7f37dc0c8140 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37dc0c7cc0 0x7f37dc0b6980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:51.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37dc0c7cc0 0x7f37dc0b6980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57318/0 (socket says 172.21.15.81:57318) 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 -- 172.21.15.81:0/495041409 learned_addr learned my addr 172.21.15.81:0/495041409 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37e0f7e640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c4003a00 0x7f37dc14e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37e177f640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37dc0c8140 0x7f37dc0b6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 -- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37dc0c8140 msgr2=0x7f37dc0b6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37dc0c8140 0x7f37dc0b6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 -- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c4003a00 msgr2=0x7f37dc14e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c4003a00 0x7f37dc14e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 -- 172.21.15.81:0/495041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37dc0b4e30 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37dbfff640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37dc0c7cc0 0x7f37dc0b6980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f37d0010c40 tx=0x7f37d000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37d97fa640 1 -- 172.21.15.81:0/495041409 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0003b70 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37d97fa640 1 -- 172.21.15.81:0/495041409 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f37d0003d10 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37dc0b5110 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37d97fa640 1 -- 172.21.15.81:0/495041409 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f37d0004280 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.512+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37dc0b56d0 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.513+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37dc0b4630 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.514+0000 7f37d97fa640 1 -- 172.21.15.81:0/495041409 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f37d001a030 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.514+0000 7f37d97fa640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37c8078d70 0x7f37c807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:51.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.514+0000 7f37d97fa640 1 -- 172.21.15.81:0/495041409 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 5795+0+0 (secure 0 0 0) 0x7f37d009be80 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.514+0000 7f37e0f7e640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37c8078d70 0x7f37c807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:51.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.515+0000 7f37e0f7e640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37c8078d70 0x7f37c807b230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f37cc033000 tx=0x7f37cc0046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:51.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.518+0000 7f37d97fa640 1 -- 172.21.15.81:0/495041409 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f37dc0b4630 con 0x7f37dc0c7cc0 2024-09-17T05:19:51.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:51.694+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f37dc160140 con 0x7f37dc0c7cc0 2024-09-17T05:19:52.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.497+0000 7f37d97fa640 1 -- 172.21.15.81:0/495041409 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v36) ==== 181+0+0 (secure 0 0 0) 0x7f37d0063890 con 0x7f37dc0c7cc0 2024-09-17T05:19:52.498 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:19:52.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37c8078d70 msgr2=0x7f37c807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:52.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37c8078d70 0x7f37c807b230 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f37cc033000 tx=0x7f37cc0046c0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37dc0c7cc0 msgr2=0x7f37dc0b6980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:52.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37dc0c7cc0 0x7f37dc0b6980 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f37d0010c40 tx=0x7f37d000e6c0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 shutdown_connections 2024-09-17T05:19:52.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37c8078d70 0x7f37c807b230 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f37dc0c8140 0x7f37dc0b6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f37dc0c7cc0 0x7f37dc0b6980 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 --2- 172.21.15.81:0/495041409 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f37c4003a00 0x7f37dc14e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 >> 172.21.15.81:0/495041409 conn(0x7f37dc09aa30 msgr2=0x7f37dc071d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:52.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 shutdown_connections 2024-09-17T05:19:52.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.500+0000 7f37e31e2640 1 -- 172.21.15.81:0/495041409 wait complete. 2024-09-17T05:19:52.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:19:52.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 -- 172.21.15.81:0/34382735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900703c0 msgr2=0x7f3f90157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:52.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 --2- 172.21.15.81:0/34382735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900703c0 0x7f3f90157cf0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3f9006dd90 tx=0x7f3f8802a560 comp rx=0 tx=0).stop 2024-09-17T05:19:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 -- 172.21.15.81:0/34382735 shutdown_connections 2024-09-17T05:19:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 --2- 172.21.15.81:0/34382735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900703c0 0x7f3f90157cf0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 --2- 172.21.15.81:0/34382735 >> v2:172.21.15.160:3300/0 conn(0x7f3f9006e940 0x7f3f9006fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 --2- 172.21.15.81:0/34382735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f900aee40 0x7f3f9015b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 -- 172.21.15.81:0/34382735 >> 172.21.15.81:0/34382735 conn(0x7f3f900b1620 msgr2=0x7f3f900b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 -- 172.21.15.81:0/34382735 shutdown_connections 2024-09-17T05:19:52.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.619+0000 7f3f9847f640 1 -- 172.21.15.81:0/34382735 wait complete. 2024-09-17T05:19:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.620+0000 7f3f9847f640 1 Processor -- start 2024-09-17T05:19:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.620+0000 7f3f9847f640 1 -- start start 2024-09-17T05:19:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f9847f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9006e940 0x7f3f900ace20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:52.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f9847f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f900703c0 0x7f3f900af590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f9847f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900aee40 0x7f3f900afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f9847f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f901585c0 con 0x7f3f900aee40 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f9847f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3f90158440 con 0x7f3f900703c0 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f9847f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3f90158740 con 0x7f3f9006e940 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900aee40 0x7f3f900afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900aee40 0x7f3f900afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57336/0 (socket says 172.21.15.81:57336) 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 -- 172.21.15.81:0/2102702046 learned_addr learned my addr 172.21.15.81:0/2102702046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f9621b640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9006e940 0x7f3f900ace20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f95a1a640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f900703c0 0x7f3f900af590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 -- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9006e940 msgr2=0x7f3f900ace20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:52.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9006e940 0x7f3f900ace20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 -- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f900703c0 msgr2=0x7f3f900af590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f900703c0 0x7f3f900af590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 -- 172.21.15.81:0/2102702046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f900ad650 con 0x7f3f900aee40 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.621+0000 7f3f96a1c640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900aee40 0x7f3f900afad0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009230 tx=0x7f3f88003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.622+0000 7f3f8effd640 1 -- 172.21.15.81:0/2102702046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f8803f070 con 0x7f3f900aee40 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.622+0000 7f3f8effd640 1 -- 172.21.15.81:0/2102702046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f880047a0 con 0x7f3f900aee40 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.622+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f900ad930 con 0x7f3f900aee40 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.622+0000 7f3f8effd640 1 -- 172.21.15.81:0/2102702046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f88035030 con 0x7f3f900aee40 2024-09-17T05:19:52.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.622+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f900adef0 con 0x7f3f900aee40 2024-09-17T05:19:52.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.623+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f90157cf0 con 0x7f3f900aee40 2024-09-17T05:19:52.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.623+0000 7f3f8effd640 1 -- 172.21.15.81:0/2102702046 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f3f88042070 con 0x7f3f900aee40 2024-09-17T05:19:52.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.624+0000 7f3f8effd640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f7c078d40 0x7f3f7c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:52.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.624+0000 7f3f8effd640 1 -- 172.21.15.81:0/2102702046 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(36..36 src has 1..36) ==== 5357+0+0 (secure 0 0 0) 0x7f3f880bbc80 con 0x7f3f900aee40 2024-09-17T05:19:52.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.624+0000 7f3f9621b640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f7c078d40 0x7f3f7c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:52.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.625+0000 7f3f9621b640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f7c078d40 0x7f3f7c07b200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3f90156d60 tx=0x7f3f8000a6c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:52.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.628+0000 7f3f8effd640 1 -- 172.21.15.81:0/2102702046 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3f88083960 con 0x7f3f900aee40 2024-09-17T05:19:52.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:52.814+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f3f9006e720 con 0x7f3f900aee40 2024-09-17T05:19:53.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.502+0000 7f3f8effd640 1 -- 172.21.15.81:0/2102702046 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v37) ==== 169+0+0 (secure 0 0 0) 0x7f3f88088390 con 0x7f3f900aee40 2024-09-17T05:19:53.503 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:19:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f7c078d40 msgr2=0x7f3f7c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f7c078d40 0x7f3f7c07b200 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f3f90156d60 tx=0x7f3f8000a6c0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900aee40 msgr2=0x7f3f900afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900aee40 0x7f3f900afad0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f3f88009230 tx=0x7f3f88003960 comp rx=0 tx=0).stop 2024-09-17T05:19:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 shutdown_connections 2024-09-17T05:19:53.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f7c078d40 0x7f3f7c07b200 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f900aee40 0x7f3f900afad0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f900703c0 0x7f3f900af590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 --2- 172.21.15.81:0/2102702046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f9006e940 0x7f3f900ace20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 >> 172.21.15.81:0/2102702046 conn(0x7f3f900b1620 msgr2=0x7f3f901563d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 shutdown_connections 2024-09-17T05:19:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.506+0000 7f3f9847f640 1 -- 172.21.15.81:0/2102702046 wait complete. 2024-09-17T05:19:53.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:19:53.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 -- 172.21.15.81:0/3024924668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 msgr2=0x7f29cc0cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 --2- 172.21.15.81:0/3024924668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc0cf470 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f29c0005fd0 tx=0x7f29c002a580 comp rx=0 tx=0).stop 2024-09-17T05:19:53.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 -- 172.21.15.81:0/3024924668 shutdown_connections 2024-09-17T05:19:53.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 --2- 172.21.15.81:0/3024924668 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc0cf470 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 --2- 172.21.15.81:0/3024924668 >> v2:172.21.15.160:3300/0 conn(0x7f29cc151370 0x7f29cc0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 -- 172.21.15.81:0/3024924668 >> 172.21.15.81:0/3024924668 conn(0x7f29cc0b1690 msgr2=0x7f29cc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 -- 172.21.15.81:0/3024924668 shutdown_connections 2024-09-17T05:19:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.625+0000 7f29d0917640 1 -- 172.21.15.81:0/3024924668 wait complete. 2024-09-17T05:19:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.626+0000 7f29d0917640 1 Processor -- start 2024-09-17T05:19:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.626+0000 7f29d0917640 1 -- start start 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29d0917640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29cc0725a0 0x7f29cc0b44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29d0917640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc1f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29d0917640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29cc151370 0x7f29cc1f5690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29d0917640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc06ebe0 con 0x7f29cc0b3140 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29d0917640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f29cc06ea60 con 0x7f29cc0725a0 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29d0917640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f29cc06f9f0 con 0x7f29cc151370 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc1f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc1f5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56068/0 (socket says 172.21.15.81:56068) 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 -- 172.21.15.81:0/1720927695 learned_addr learned my addr 172.21.15.81:0/1720927695 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29ca59c640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29cc0725a0 0x7f29cc0b44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29cad9d640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29cc151370 0x7f29cc1f5690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 -- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29cc151370 msgr2=0x7f29cc1f5690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29cc151370 0x7f29cc1f5690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 -- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29cc0725a0 msgr2=0x7f29cc0b44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29cc0725a0 0x7f29cc0b44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29c9d9b640 1 -- 172.21.15.81:0/1720927695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f29cc1f8370 con 0x7f29cc0b3140 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29ca59c640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29cc0725a0 0x7f29cc0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.627+0000 7f29cad9d640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29cc151370 0x7f29cc1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.628+0000 7f29c9d9b640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc1f5150 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f29c0000c00 tx=0x7f29c00039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.628+0000 7f29baffd640 1 -- 172.21.15.81:0/1720927695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c003f070 con 0x7f29cc0b3140 2024-09-17T05:19:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.628+0000 7f29baffd640 1 -- 172.21.15.81:0/1720927695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f29c0004890 con 0x7f29cc0b3140 2024-09-17T05:19:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.628+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f29cc1f8650 con 0x7f29cc0b3140 2024-09-17T05:19:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.628+0000 7f29baffd640 1 -- 172.21.15.81:0/1720927695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f29c0035030 con 0x7f29cc0b3140 2024-09-17T05:19:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.628+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29cc1f8c10 con 0x7f29cc0b3140 2024-09-17T05:19:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.629+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29cc072a10 con 0x7f29cc0b3140 2024-09-17T05:19:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.629+0000 7f29baffd640 1 -- 172.21.15.81:0/1720927695 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f29c0042070 con 0x7f29cc0b3140 2024-09-17T05:19:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.630+0000 7f29baffd640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f29ac078d70 0x7f29ac07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.630+0000 7f29baffd640 1 -- 172.21.15.81:0/1720927695 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f29c00bbd70 con 0x7f29cc0b3140 2024-09-17T05:19:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.630+0000 7f29ca59c640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f29ac078d70 0x7f29ac07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.630+0000 7f29ca59c640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f29ac078d70 0x7f29ac07b230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f29bc005c40 tx=0x7f29bc005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.634+0000 7f29baffd640 1 -- 172.21.15.81:0/1720927695 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f29c00841b0 con 0x7f29cc0b3140 2024-09-17T05:19:53.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.810+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f29cc0b1300 con 0x7f29cc0b3140 2024-09-17T05:19:53.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.813+0000 7f29baffd640 1 -- 172.21.15.81:0/1720927695 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v29) ==== 71+0+0 (secure 0 0 0) 0x7f29c0083ab0 con 0x7f29cc0b3140 2024-09-17T05:19:53.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.815+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f29ac078d70 msgr2=0x7f29ac07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.815+0000 7f29d0917640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f29ac078d70 0x7f29ac07b230 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f29bc005c40 tx=0x7f29bc005f90 comp rx=0 tx=0).stop 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.815+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 msgr2=0x7f29cc1f5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.815+0000 7f29d0917640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc1f5150 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f29c0000c00 tx=0x7f29c00039e0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 shutdown_connections 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f29ac078d70 0x7f29ac07b230 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29cc151370 0x7f29cc1f5690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29cc0b3140 0x7f29cc1f5150 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 --2- 172.21.15.81:0/1720927695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f29cc0725a0 0x7f29cc0b44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 >> 172.21.15.81:0/1720927695 conn(0x7f29cc0b1690 msgr2=0x7f29cc0b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 shutdown_connections 2024-09-17T05:19:53.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.816+0000 7f29d0917640 1 -- 172.21.15.81:0/1720927695 wait complete. 2024-09-17T05:19:53.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:19:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.927+0000 7fed9e5a0640 1 -- 172.21.15.81:0/1287365381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 msgr2=0x7fed980739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.927+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/1287365381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed980739d0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009830 tx=0x7fed8c02a470 comp rx=0 tx=0).stop 2024-09-17T05:19:53.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.927+0000 7fed9e5a0640 1 -- 172.21.15.81:0/1287365381 shutdown_connections 2024-09-17T05:19:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.928+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/1287365381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed9806ff80 0x7fed98070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.928+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/1287365381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed980739d0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.928+0000 7fed9e5a0640 1 -- 172.21.15.81:0/1287365381 >> 172.21.15.81:0/1287365381 conn(0x7fed980b1690 msgr2=0x7fed980b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.928+0000 7fed9e5a0640 1 -- 172.21.15.81:0/1287365381 shutdown_connections 2024-09-17T05:19:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.928+0000 7fed9e5a0640 1 -- 172.21.15.81:0/1287365381 wait complete. 2024-09-17T05:19:53.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.929+0000 7fed9e5a0640 1 Processor -- start 2024-09-17T05:19:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.929+0000 7fed9e5a0640 1 -- start start 2024-09-17T05:19:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed9806ff80 0x7fed9814b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed981455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9815aa70 0x7fed98156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fed980cd270 con 0x7fed980735a0 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fed980cd0f0 con 0x7fed9815aa70 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fed980cd3f0 con 0x7fed9806ff80 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed981455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed981455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56076/0 (socket says 172.21.15.81:56076) 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 -- 172.21.15.81:0/2060735566 learned_addr learned my addr 172.21.15.81:0/2060735566 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9cb3d640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9815aa70 0x7fed98156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 -- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed9806ff80 msgr2=0x7fed9814b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed97fff640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed9806ff80 0x7fed9814b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed9806ff80 0x7fed9814b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 -- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9815aa70 msgr2=0x7fed98156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9815aa70 0x7fed98156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 -- 172.21.15.81:0/2060735566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed9814a090 con 0x7fed980735a0 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9cb3d640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9815aa70 0x7fed98156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed97fff640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed9806ff80 0x7fed9814b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed977fe640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed981455e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009950 tx=0x7fed8c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed94ff9640 1 -- 172.21.15.81:0/2060735566 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c040070 con 0x7fed980735a0 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed94ff9640 1 -- 172.21.15.81:0/2060735566 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed8c005310 con 0x7fed980735a0 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed9814a370 con 0x7fed980735a0 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed94ff9640 1 -- 172.21.15.81:0/2060735566 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed8c0047a0 con 0x7fed980735a0 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.930+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed9814a930 con 0x7fed980735a0 2024-09-17T05:19:53.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.931+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed9815e0b0 con 0x7fed980735a0 2024-09-17T05:19:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.932+0000 7fed94ff9640 1 -- 172.21.15.81:0/2060735566 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fed8c039040 con 0x7fed980735a0 2024-09-17T05:19:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.933+0000 7fed94ff9640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fed84078d40 0x7fed8407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:53.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.933+0000 7fed94ff9640 1 -- 172.21.15.81:0/2060735566 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fed8c0bc160 con 0x7fed980735a0 2024-09-17T05:19:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.933+0000 7fed97fff640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fed84078d40 0x7fed8407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:53.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.933+0000 7fed97fff640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fed84078d40 0x7fed8407b200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed88000f60 tx=0x7fed88009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:53.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:53.937+0000 7fed94ff9640 1 -- 172.21.15.81:0/2060735566 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fed9815e0b0 con 0x7fed980735a0 2024-09-17T05:19:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.179+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fed980697e0 con 0x7fed980735a0 2024-09-17T05:19:54.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.504+0000 7fed94ff9640 1 -- 172.21.15.81:0/2060735566 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_binary_metafile_on_legacy_to_v1_upgrade"]}]=0 v85) ==== 158+0+0 (secure 0 0 0) 0x7fed8c084630 con 0x7fed980735a0 2024-09-17T05:19:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fed84078d40 msgr2=0x7fed8407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fed84078d40 0x7fed8407b200 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fed88000f60 tx=0x7fed88009040 comp rx=0 tx=0).stop 2024-09-17T05:19:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 msgr2=0x7fed981455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed981455e0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fed8c009950 tx=0x7fed8c032c10 comp rx=0 tx=0).stop 2024-09-17T05:19:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 shutdown_connections 2024-09-17T05:19:54.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fed84078d40 0x7fed8407b200 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fed9815aa70 0x7fed98156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed980735a0 0x7fed981455e0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 --2- 172.21.15.81:0/2060735566 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed9806ff80 0x7fed9814b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 >> 172.21.15.81:0/2060735566 conn(0x7fed980b1690 msgr2=0x7fed980b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 shutdown_connections 2024-09-17T05:19:54.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.506+0000 7fed9e5a0640 1 -- 172.21.15.81:0/2060735566 wait complete. 2024-09-17T05:19:54.518 INFO:tasks.cephfs_test_runner:Validate binary .meta file on legacy subvol root doesn't break the system ... ok 2024-09-17T05:19:54.518 INFO:tasks.cephfs_test_runner:Starting test: test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:19:54.519 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:19:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.620+0000 7f93df92b640 1 -- 172.21.15.81:0/209851064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c0004d90 msgr2=0x7f93c0005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.621+0000 7f93df92b640 1 --2- 172.21.15.81:0/209851064 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93c0004d90 0x7f93c0005210 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f93d0001050 tx=0x7f93c0005830 comp rx=0 tx=0).stop 2024-09-17T05:19:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.621+0000 7f93ddec8640 1 -- 172.21.15.81:0/209851064 reap_dead start 2024-09-17T05:19:54.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.621+0000 7f93df92b640 1 -- 172.21.15.81:0/209851064 shutdown_connections 2024-09-17T05:19:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.621+0000 7f93df92b640 1 -- 172.21.15.81:0/209851064 >> 172.21.15.81:0/209851064 conn(0x7f93d80b1690 msgr2=0x7f93d80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.621+0000 7f93df92b640 1 -- 172.21.15.81:0/209851064 shutdown_connections 2024-09-17T05:19:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.621+0000 7f93df92b640 1 -- 172.21.15.81:0/209851064 wait complete. 2024-09-17T05:19:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.622+0000 7f93df92b640 1 Processor -- start 2024-09-17T05:19:54.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.622+0000 7f93df92b640 1 -- start start 2024-09-17T05:19:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93df92b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d8145120 0x7f93d80ae790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93df92b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d8145500 0x7f93d80aecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93df92b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80a9490 0x7f93d80a9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93df92b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f93d80739a0 con 0x7f93d8145500 2024-09-17T05:19:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93df92b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f93d80cdb00 con 0x7f93d8145120 2024-09-17T05:19:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93df92b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f93d8073b20 con 0x7f93d80a9490 2024-09-17T05:19:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d8145500 0x7f93d80aecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d8145500 0x7f93d80aecd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56098/0 (socket says 172.21.15.81:56098) 2024-09-17T05:19:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 -- 172.21.15.81:0/677487915 learned_addr learned my addr 172.21.15.81:0/677487915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:54.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dd6c7640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d8145120 0x7f93d80ae790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93ddec8640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80a9490 0x7f93d80a9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 -- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80a9490 msgr2=0x7f93d80a9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80a9490 0x7f93d80a9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 -- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d8145120 msgr2=0x7f93d80ae790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d8145120 0x7f93d80ae790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 -- 172.21.15.81:0/677487915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f93d80aad80 con 0x7f93d8145500 2024-09-17T05:19:54.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93dcec6640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d8145500 0x7f93d80aecd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f93cc003ea0 tx=0x7f93cc003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:54.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93d5ffb640 1 -- 172.21.15.81:0/677487915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc015070 con 0x7f93d8145500 2024-09-17T05:19:54.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93d5ffb640 1 -- 172.21.15.81:0/677487915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f93cc011840 con 0x7f93d8145500 2024-09-17T05:19:54.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f93d80aa200 con 0x7f93d8145500 2024-09-17T05:19:54.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.623+0000 7f93d5ffb640 1 -- 172.21.15.81:0/677487915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f93cc011c50 con 0x7f93d8145500 2024-09-17T05:19:54.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.624+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f93d80aa7c0 con 0x7f93d8145500 2024-09-17T05:19:54.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.625+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f93d80ccee0 con 0x7f93d8145500 2024-09-17T05:19:54.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.625+0000 7f93d5ffb640 1 -- 172.21.15.81:0/677487915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f93cc018070 con 0x7f93d8145500 2024-09-17T05:19:54.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.626+0000 7f93d5ffb640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f93c4078d40 0x7f93c407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.626+0000 7f93d5ffb640 1 -- 172.21.15.81:0/677487915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f93cc09b8b0 con 0x7f93d8145500 2024-09-17T05:19:54.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.626+0000 7f93dd6c7640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f93c4078d40 0x7f93c407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.627+0000 7f93dd6c7640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f93c4078d40 0x7f93c407b200 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f93c8005fd0 tx=0x7f93c80096c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:54.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.630+0000 7f93d5ffb640 1 -- 172.21.15.81:0/677487915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f93cc063750 con 0x7f93d8145500 2024-09-17T05:19:54.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.814+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f93d8073000 con 0x7f93d8145500 2024-09-17T05:19:54.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.815+0000 7f93d5ffb640 1 -- 172.21.15.81:0/677487915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+13032 (secure 0 0 0) 0x7f93cc068180 con 0x7f93d8145500 2024-09-17T05:19:54.816 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:54.816 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":37,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:53.498819+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":32,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6837/974638720":"2024-09-18T05:19:50.383984+0000","172.21.15.160:6835/974638720":"2024-09-18T05:19:50.383984+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:19:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f93c4078d40 msgr2=0x7f93c407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f93c4078d40 0x7f93c407b200 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f93c8005fd0 tx=0x7f93c80096c0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d8145500 msgr2=0x7f93d80aecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d8145500 0x7f93d80aecd0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f93cc003ea0 tx=0x7f93cc003f90 comp rx=0 tx=0).stop 2024-09-17T05:19:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 shutdown_connections 2024-09-17T05:19:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f93c4078d40 0x7f93c407b200 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f93d80a9490 0x7f93d80a9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f93d8145500 0x7f93d80aecd0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 --2- 172.21.15.81:0/677487915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f93d8145120 0x7f93d80ae790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 >> 172.21.15.81:0/677487915 conn(0x7f93d80b1690 msgr2=0x7f93d806ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 shutdown_connections 2024-09-17T05:19:54.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.817+0000 7f93df92b640 1 -- 172.21.15.81:0/677487915 wait complete. 2024-09-17T05:19:54.829 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:19:54.829 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.932+0000 7faa1d59c640 1 -- 172.21.15.81:0/1177355555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 msgr2=0x7faa180b3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.932+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1177355555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa180b3880 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7faa10005fd0 tx=0x7faa1002a9c0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.933+0000 7faa1d59c640 1 -- 172.21.15.81:0/1177355555 shutdown_connections 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.933+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1177355555 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa180b3880 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.933+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1177355555 >> v2:172.21.15.160:3300/0 conn(0x7faa18161500 0x7faa180cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.933+0000 7faa1d59c640 1 -- 172.21.15.81:0/1177355555 >> 172.21.15.81:0/1177355555 conn(0x7faa1809d190 msgr2=0x7faa180d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.933+0000 7faa1d59c640 1 -- 172.21.15.81:0/1177355555 shutdown_connections 2024-09-17T05:19:54.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.933+0000 7faa1d59c640 1 -- 172.21.15.81:0/1177355555 wait complete. 2024-09-17T05:19:54.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.934+0000 7faa1d59c640 1 Processor -- start 2024-09-17T05:19:54.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.934+0000 7faa1d59c640 1 -- start start 2024-09-17T05:19:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.934+0000 7faa1d59c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa180b4c20 0x7faa1815e940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa1d59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa181f45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa1d59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18161500 0x7faa180a1060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa1d59c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa18161a60 con 0x7faa180d2200 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa1d59c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faa181618e0 con 0x7faa18161500 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa1d59c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faa180b3dc0 con 0x7faa180b4c20 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa181f45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa181f45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56118/0 (socket says 172.21.15.81:56118) 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 -- 172.21.15.81:0/1922884043 learned_addr learned my addr 172.21.15.81:0/1922884043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa177fe640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18161500 0x7faa180a1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa16ffd640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa180b4c20 0x7faa1815e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 -- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa180b4c20 msgr2=0x7faa1815e940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa180b4c20 0x7faa1815e940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 -- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18161500 msgr2=0x7faa180a1060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:54.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18161500 0x7faa180a1060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 -- 172.21.15.81:0/1922884043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa181f4f50 con 0x7faa180d2200 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0ffff640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa181f45e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c430 tx=0x7faa0000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0f7fe640 1 -- 172.21.15.81:0/1922884043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00011790 con 0x7faa180d2200 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0f7fe640 1 -- 172.21.15.81:0/1922884043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa00017070 con 0x7faa180d2200 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa181f5230 con 0x7faa180d2200 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa0f7fe640 1 -- 172.21.15.81:0/1922884043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa00011d00 con 0x7faa180d2200 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.935+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa180b6df0 con 0x7faa180d2200 2024-09-17T05:19:54.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.936+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa180ce250 con 0x7faa180d2200 2024-09-17T05:19:54.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.937+0000 7faa0f7fe640 1 -- 172.21.15.81:0/1922884043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7faa0001c460 con 0x7faa180d2200 2024-09-17T05:19:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.937+0000 7faa0f7fe640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa9f8078d40 0x7fa9f807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.938+0000 7faa0f7fe640 1 -- 172.21.15.81:0/1922884043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7faa0009ab90 con 0x7faa180d2200 2024-09-17T05:19:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.938+0000 7faa16ffd640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa9f8078d40 0x7fa9f807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:54.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.938+0000 7faa16ffd640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa9f8078d40 0x7fa9f807b200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa08004630 tx=0x7faa0800b2e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:54.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:54.942+0000 7faa0f7fe640 1 -- 172.21.15.81:0/1922884043 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7faa00062980 con 0x7faa180d2200 2024-09-17T05:19:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.116+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7faa180b3800 con 0x7faa180d2200 2024-09-17T05:19:55.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.116+0000 7faa0f7fe640 1 -- 172.21.15.81:0/1922884043 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v37) ==== 93+0+10 (secure 0 0 0) 0x7faa000673b0 con 0x7faa180d2200 2024-09-17T05:19:55.117 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:19:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa9f8078d40 msgr2=0x7fa9f807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa9f8078d40 0x7fa9f807b200 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7faa08004630 tx=0x7faa0800b2e0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 msgr2=0x7faa181f45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa181f45e0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7faa0000c430 tx=0x7faa0000c8f0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 shutdown_connections 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa9f8078d40 0x7fa9f807b200 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa18161500 0x7faa180a1060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa180d2200 0x7faa181f45e0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 --2- 172.21.15.81:0/1922884043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa180b4c20 0x7faa1815e940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.118+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 >> 172.21.15.81:0/1922884043 conn(0x7faa1809d190 msgr2=0x7faa180d4890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.119+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 shutdown_connections 2024-09-17T05:19:55.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.119+0000 7faa1d59c640 1 -- 172.21.15.81:0/1922884043 wait complete. 2024-09-17T05:19:55.130 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-17T05:19:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 -- 172.21.15.81:0/4046068788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b80746e0 msgr2=0x7fa2b80cb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/4046068788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b80746e0 0x7fa2b80cb890 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fa2b0005fd0 tx=0x7fa2b002aa10 comp rx=0 tx=0).stop 2024-09-17T05:19:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 -- 172.21.15.81:0/4046068788 shutdown_connections 2024-09-17T05:19:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/4046068788 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b80746e0 0x7fa2b80cb890 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/4046068788 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2b8074280 0x7fa2b80cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 -- 172.21.15.81:0/4046068788 >> 172.21.15.81:0/4046068788 conn(0x7fa2b80d0c20 msgr2=0x7fa2b80d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 -- 172.21.15.81:0/4046068788 shutdown_connections 2024-09-17T05:19:55.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.229+0000 7fa2be8ef640 1 -- 172.21.15.81:0/4046068788 wait complete. 2024-09-17T05:19:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.230+0000 7fa2be8ef640 1 Processor -- start 2024-09-17T05:19:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.230+0000 7fa2be8ef640 1 -- start start 2024-09-17T05:19:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2be8ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b8074280 0x7fa2b80c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2be8ef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2b80746e0 0x7fa2b80c9130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2be8ef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2b815ad00 0x7fa2b80b1d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2be8ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80d0820 con 0x7fa2b8074280 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2be8ef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa2b80d06a0 con 0x7fa2b80746e0 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2be8ef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa2b80cbdd0 con 0x7fa2b815ad00 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b8074280 0x7fa2b80c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b8074280 0x7fa2b80c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56140/0 (socket says 172.21.15.81:56140) 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2b7fff640 1 -- 172.21.15.81:0/1961064079 learned_addr learned my addr 172.21.15.81:0/1961064079 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2bce8c640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2b815ad00 0x7fa2b80b1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.231+0000 7fa2b77fe640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2b80746e0 0x7fa2b80c9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b7fff640 1 -- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2b815ad00 msgr2=0x7fa2b80b1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b7fff640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2b815ad00 0x7fa2b80b1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b7fff640 1 -- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2b80746e0 msgr2=0x7fa2b80c9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b7fff640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2b80746e0 0x7fa2b80c9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b7fff640 1 -- 172.21.15.81:0/1961064079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2b80c98a0 con 0x7fa2b8074280 2024-09-17T05:19:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b7fff640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b8074280 0x7fa2b80c88c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c3a0 tx=0x7fa2a800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b4ff9640 1 -- 172.21.15.81:0/1961064079 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a80052d0 con 0x7fa2b8074280 2024-09-17T05:19:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b4ff9640 1 -- 172.21.15.81:0/1961064079 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2a8007020 con 0x7fa2b8074280 2024-09-17T05:19:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2b80c9b80 con 0x7fa2b8074280 2024-09-17T05:19:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2b4ff9640 1 -- 172.21.15.81:0/1961064079 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2a8007470 con 0x7fa2b8074280 2024-09-17T05:19:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.232+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2b80ca140 con 0x7fa2b8074280 2024-09-17T05:19:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.233+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2b80cc280 con 0x7fa2b8074280 2024-09-17T05:19:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.233+0000 7fa2b4ff9640 1 -- 172.21.15.81:0/1961064079 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fa2a80067d0 con 0x7fa2b8074280 2024-09-17T05:19:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.234+0000 7fa2b4ff9640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2a4078d40 0x7fa2a407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.234+0000 7fa2b4ff9640 1 -- 172.21.15.81:0/1961064079 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fa2a809a150 con 0x7fa2b8074280 2024-09-17T05:19:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.234+0000 7fa2b77fe640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2a4078d40 0x7fa2a407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.235+0000 7fa2b77fe640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2a4078d40 0x7fa2a407b200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80b2a30 tx=0x7fa2ac00b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:55.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.238+0000 7fa2b4ff9640 1 -- 172.21.15.81:0/1961064079 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa2a8061ff0 con 0x7fa2b8074280 2024-09-17T05:19:55.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.481+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7fa2b80b6ba0 con 0x7fa2b8074280 2024-09-17T05:19:55.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.510+0000 7fa2b4ff9640 1 -- 172.21.15.81:0/1961064079 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v86) ==== 143+0+0 (secure 0 0 0) 0x7fa2a8066a20 con 0x7fa2b8074280 2024-09-17T05:19:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2a4078d40 msgr2=0x7fa2a407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2a4078d40 0x7fa2a407b200 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fa2b80b2a30 tx=0x7fa2ac00b390 comp rx=0 tx=0).stop 2024-09-17T05:19:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b8074280 msgr2=0x7fa2b80c88c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b8074280 0x7fa2b80c88c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fa2a800c3a0 tx=0x7fa2a800c860 comp rx=0 tx=0).stop 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 shutdown_connections 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2a4078d40 0x7fa2a407b200 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2b815ad00 0x7fa2b80b1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2b80746e0 0x7fa2b80c9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 --2- 172.21.15.81:0/1961064079 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2b8074280 0x7fa2b80c88c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 >> 172.21.15.81:0/1961064079 conn(0x7fa2b80d0c20 msgr2=0x7fa2b80704c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 shutdown_connections 2024-09-17T05:19:55.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.512+0000 7fa2be8ef640 1 -- 172.21.15.81:0/1961064079 wait complete. 2024-09-17T05:19:55.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:19:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.623+0000 7f5ad8dad640 1 -- 172.21.15.81:0/3945538815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad415aa70 msgr2=0x7f5ad40b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.623+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/3945538815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad415aa70 0x7f5ad40b4690 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f5ad40b3520 tx=0x7f5ac402a5c0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.623+0000 7f5ad8dad640 1 -- 172.21.15.81:0/3945538815 shutdown_connections 2024-09-17T05:19:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.623+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/3945538815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad415aa70 0x7f5ad40b4690 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.623+0000 7f5ad8dad640 1 -- 172.21.15.81:0/3945538815 >> 172.21.15.81:0/3945538815 conn(0x7f5ad40b1690 msgr2=0x7f5ad40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.623+0000 7f5ad8dad640 1 -- 172.21.15.81:0/3945538815 shutdown_connections 2024-09-17T05:19:55.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.623+0000 7f5ad8dad640 1 -- 172.21.15.81:0/3945538815 wait complete. 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.625+0000 7f5ad8dad640 1 Processor -- start 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.625+0000 7f5ad8dad640 1 -- start start 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4070690 0x7f5ad40b0ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ad40735a0 0x7f5ad41f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ad415aa70 0x7f5ad40cdf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad4073d60 con 0x7f5ad4070690 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5ad4073be0 con 0x7f5ad415aa70 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5ad4073ee0 con 0x7f5ad40735a0 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4070690 0x7f5ad40b0ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4070690 0x7f5ad40b0ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56158/0 (socket says 172.21.15.81:56158) 2024-09-17T05:19:55.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 -- 172.21.15.81:0/1083404093 learned_addr learned my addr 172.21.15.81:0/1083404093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad2d9d640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ad415aa70 0x7f5ad40cdf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad1d9b640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ad40735a0 0x7f5ad41f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 -- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ad40735a0 msgr2=0x7f5ad41f82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ad40735a0 0x7f5ad41f82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 -- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ad415aa70 msgr2=0x7f5ad40cdf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ad415aa70 0x7f5ad40cdf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 -- 172.21.15.81:0/1083404093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ad41f44e0 con 0x7f5ad4070690 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad259c640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4070690 0x7f5ad40b0ff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009920 tx=0x7f5ac4033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5acaffd640 1 -- 172.21.15.81:0/1083404093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4031d60 con 0x7f5ad4070690 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5acaffd640 1 -- 172.21.15.81:0/1083404093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ac4005020 con 0x7f5ad4070690 2024-09-17T05:19:55.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5acaffd640 1 -- 172.21.15.81:0/1083404093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ac4005470 con 0x7f5ad4070690 2024-09-17T05:19:55.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ad41f47c0 con 0x7f5ad4070690 2024-09-17T05:19:55.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.626+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ad41f4d80 con 0x7f5ad4070690 2024-09-17T05:19:55.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.627+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ad40cd920 con 0x7f5ad4070690 2024-09-17T05:19:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.628+0000 7f5acaffd640 1 -- 172.21.15.81:0/1083404093 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f5ac40047a0 con 0x7f5ad4070690 2024-09-17T05:19:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.628+0000 7f5acaffd640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ab4078d40 0x7f5ab407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.629+0000 7f5acaffd640 1 -- 172.21.15.81:0/1083404093 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f5ac40bbf10 con 0x7f5ad4070690 2024-09-17T05:19:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.629+0000 7f5ad1d9b640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ab4078d40 0x7f5ab407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.629+0000 7f5ad1d9b640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ab4078d40 0x7f5ab407b200 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ad415c290 tx=0x7f5abc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:55.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.633+0000 7f5acaffd640 1 -- 172.21.15.81:0/1083404093 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5ac403f030 con 0x7f5ad4070690 2024-09-17T05:19:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.808+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f5ad40b2f20 con 0x7f5ad4070690 2024-09-17T05:19:55.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.808+0000 7f5acaffd640 1 -- 172.21.15.81:0/1083404093 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v29) ==== 59+0+1998 (secure 0 0 0) 0x7f5ac40843e0 con 0x7f5ad4070690 2024-09-17T05:19:55.809 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:19:55.810 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:19:55.811 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:19:55.812 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:19:55.812 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:19:55.812 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:19:55.812 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:19:55.812 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:19:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ab4078d40 msgr2=0x7f5ab407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ab4078d40 0x7f5ab407b200 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f5ad415c290 tx=0x7f5abc009040 comp rx=0 tx=0).stop 2024-09-17T05:19:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4070690 msgr2=0x7f5ad40b0ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4070690 0x7f5ad40b0ff0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f5ac4009920 tx=0x7f5ac4033d60 comp rx=0 tx=0).stop 2024-09-17T05:19:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 shutdown_connections 2024-09-17T05:19:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ab4078d40 0x7f5ab407b200 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ad415aa70 0x7f5ad40cdf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ad40735a0 0x7f5ad41f82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 --2- 172.21.15.81:0/1083404093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ad4070690 0x7f5ad40b0ff0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 >> 172.21.15.81:0/1083404093 conn(0x7f5ad40b1690 msgr2=0x7f5ad4158f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:55.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 shutdown_connections 2024-09-17T05:19:55.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.810+0000 7f5ad8dad640 1 -- 172.21.15.81:0/1083404093 wait complete. 2024-09-17T05:19:55.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:19:55.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 -- 172.21.15.81:0/1955018343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 msgr2=0x7fd98c06fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 --2- 172.21.15.81:0/1955018343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 0x7fd98c06fb90 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fd97c009830 tx=0x7fd97c02a510 comp rx=0 tx=0).stop 2024-09-17T05:19:55.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 -- 172.21.15.81:0/1955018343 shutdown_connections 2024-09-17T05:19:55.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 --2- 172.21.15.81:0/1955018343 >> v2:172.21.15.160:3300/0 conn(0x7fd98c0cc540 0x7fd98c0cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 --2- 172.21.15.81:0/1955018343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 0x7fd98c06fb90 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 -- 172.21.15.81:0/1955018343 >> 172.21.15.81:0/1955018343 conn(0x7fd98c0b1700 msgr2=0x7fd98c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:55.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 -- 172.21.15.81:0/1955018343 shutdown_connections 2024-09-17T05:19:55.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.926+0000 7fd994389640 1 -- 172.21.15.81:0/1955018343 wait complete. 2024-09-17T05:19:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.927+0000 7fd994389640 1 Processor -- start 2024-09-17T05:19:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.927+0000 7fd994389640 1 -- start start 2024-09-17T05:19:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd994389640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98c0cc540 0x7fd98c0c3660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd994389640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 0x7fd98c155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd994389640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98c15b3d0 0x7fd98c150260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd994389640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c0cb0e0 con 0x7fd98c15b3d0 2024-09-17T05:19:55.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd994389640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd98c0caf60 con 0x7fd98c0cc540 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd994389640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd98c0cb260 con 0x7fd98c151e30 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd992926640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98c15b3d0 0x7fd98c150260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd992926640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98c15b3d0 0x7fd98c150260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56164/0 (socket says 172.21.15.81:56164) 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd992926640 1 -- 172.21.15.81:0/3635472964 learned_addr learned my addr 172.21.15.81:0/3635472964 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd992125640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98c0cc540 0x7fd98c0c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.928+0000 7fd991924640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 0x7fd98c155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd992926640 1 -- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 msgr2=0x7fd98c155000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd992926640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 0x7fd98c155000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd992926640 1 -- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98c0cc540 msgr2=0x7fd98c0c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd992926640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98c0cc540 0x7fd98c0c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:55.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd992926640 1 -- 172.21.15.81:0/3635472964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd98c0c3c40 con 0x7fd98c15b3d0 2024-09-17T05:19:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd992926640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98c15b3d0 0x7fd98c150260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd98400cb40 tx=0x7fd98400a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd98affd640 1 -- 172.21.15.81:0/3635472964 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984016020 con 0x7fd98c15b3d0 2024-09-17T05:19:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd98affd640 1 -- 172.21.15.81:0/3635472964 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd98400adb0 con 0x7fd98c15b3d0 2024-09-17T05:19:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd98c0c3f20 con 0x7fd98c15b3d0 2024-09-17T05:19:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd98affd640 1 -- 172.21.15.81:0/3635472964 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd984012680 con 0x7fd98c15b3d0 2024-09-17T05:19:55.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.929+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd98c0c44e0 con 0x7fd98c15b3d0 2024-09-17T05:19:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.930+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd98c0cb780 con 0x7fd98c15b3d0 2024-09-17T05:19:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.931+0000 7fd98affd640 1 -- 172.21.15.81:0/3635472964 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fd984019020 con 0x7fd98c15b3d0 2024-09-17T05:19:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.931+0000 7fd98affd640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd978078d40 0x7fd97807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.931+0000 7fd98affd640 1 -- 172.21.15.81:0/3635472964 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fd98409b3a0 con 0x7fd98c15b3d0 2024-09-17T05:19:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.932+0000 7fd992125640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd978078d40 0x7fd97807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:55.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.932+0000 7fd992125640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd978078d40 0x7fd97807b200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd97c034000 tx=0x7fd97c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:55.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:55.936+0000 7fd98affd640 1 -- 172.21.15.81:0/3635472964 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd984020020 con 0x7fd98c15b3d0 2024-09-17T05:19:56.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.111+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd98c0c3440 con 0x7fd98c15b3d0 2024-09-17T05:19:56.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.114+0000 7fd98affd640 1 -- 172.21.15.81:0/3635472964 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7fd984063110 con 0x7fd98c15b3d0 2024-09-17T05:19:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd978078d40 msgr2=0x7fd97807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd978078d40 0x7fd97807b200 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd97c034000 tx=0x7fd97c004730 comp rx=0 tx=0).stop 2024-09-17T05:19:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98c15b3d0 msgr2=0x7fd98c150260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98c15b3d0 0x7fd98c150260 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7fd98400cb40 tx=0x7fd98400a060 comp rx=0 tx=0).stop 2024-09-17T05:19:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 shutdown_connections 2024-09-17T05:19:56.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd978078d40 0x7fd97807b200 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd98c15b3d0 0x7fd98c150260 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd98c151e30 0x7fd98c155000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 --2- 172.21.15.81:0/3635472964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd98c0cc540 0x7fd98c0c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 >> 172.21.15.81:0/3635472964 conn(0x7fd98c0b1700 msgr2=0x7fd98c0d01f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 shutdown_connections 2024-09-17T05:19:56.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.116+0000 7fd994389640 1 -- 172.21.15.81:0/3635472964 wait complete. 2024-09-17T05:19:56.128 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:19:56.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:19:56.163 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:19:56.211 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:19:56.211 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:56.211 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:56.227 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:19:56.227 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:56.227 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:56.244 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:19:56.245 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:19:56.245 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:56.283 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:19:56.283 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:19:56.283 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:19:56.302 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:19:56.302 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:19:56.302 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:19:56.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.422+0000 7f4ce2ced640 1 -- 172.21.15.81:0/4275318011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 msgr2=0x7f4cc8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.422+0000 7f4ce2ced640 1 --2- 172.21.15.81:0/4275318011 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 0x7f4cc8003e70 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009b50 tx=0x7f4cc8005830 comp rx=0 tx=0).stop 2024-09-17T05:19:56.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.422+0000 7f4ce128a640 1 -- 172.21.15.81:0/4275318011 reap_dead start 2024-09-17T05:19:56.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.422+0000 7f4ce2ced640 1 -- 172.21.15.81:0/4275318011 shutdown_connections 2024-09-17T05:19:56.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.422+0000 7f4ce2ced640 1 -- 172.21.15.81:0/4275318011 >> 172.21.15.81:0/4275318011 conn(0x7f4cdc0b1690 msgr2=0x7f4cdc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:56.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.422+0000 7f4ce2ced640 1 -- 172.21.15.81:0/4275318011 shutdown_connections 2024-09-17T05:19:56.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.422+0000 7f4ce2ced640 1 -- 172.21.15.81:0/4275318011 wait complete. 2024-09-17T05:19:56.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.423+0000 7f4ce2ced640 1 Processor -- start 2024-09-17T05:19:56.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.423+0000 7f4ce2ced640 1 -- start start 2024-09-17T05:19:56.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce2ced640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 0x7f4cdc152650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce2ced640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cdc150ff0 0x7f4cdc1508c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce2ced640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cdc153ce0 0x7f4cdc1f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce2ced640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0b4bc0 con 0x7f4cc8003a50 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce2ced640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4cdc0b4a40 con 0x7f4cdc153ce0 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce2ced640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4cdc0ccee0 con 0x7f4cdc150ff0 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 0x7f4cdc152650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 0x7f4cdc152650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56188/0 (socket says 172.21.15.81:56188) 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 -- 172.21.15.81:0/546930386 learned_addr learned my addr 172.21.15.81:0/546930386 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce128a640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cdc153ce0 0x7f4cdc1f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4cdbfff640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cdc150ff0 0x7f4cdc1508c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 -- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cdc150ff0 msgr2=0x7f4cdc1508c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cdc150ff0 0x7f4cdc1508c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 -- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cdc153ce0 msgr2=0x7f4cdc1f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cdc153ce0 0x7f4cdc1f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce0a89640 1 -- 172.21.15.81:0/546930386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cdc1515b0 con 0x7f4cc8003a50 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.424+0000 7f4ce128a640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cdc153ce0 0x7f4cdc1f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.425+0000 7f4ce0a89640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 0x7f4cdc152650 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009a70 tx=0x7f4cc4033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.425+0000 7f4cd97fa640 1 -- 172.21.15.81:0/546930386 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4038040 con 0x7f4cc8003a50 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.425+0000 7f4cd97fa640 1 -- 172.21.15.81:0/546930386 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cc4004020 con 0x7f4cc8003a50 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.425+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cdc151890 con 0x7f4cc8003a50 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.425+0000 7f4cd97fa640 1 -- 172.21.15.81:0/546930386 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc4004470 con 0x7f4cc8003a50 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.425+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cdc151e50 con 0x7f4cc8003a50 2024-09-17T05:19:56.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.426+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cdc0739a0 con 0x7f4cc8003a50 2024-09-17T05:19:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.426+0000 7f4cd97fa640 1 -- 172.21.15.81:0/546930386 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f4cc4045020 con 0x7f4cc8003a50 2024-09-17T05:19:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.427+0000 7f4cd97fa640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cbc078d40 0x7f4cbc07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.427+0000 7f4cd97fa640 1 -- 172.21.15.81:0/546930386 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7f4cc40bb630 con 0x7f4cc8003a50 2024-09-17T05:19:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.427+0000 7f4cdbfff640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cbc078d40 0x7f4cbc07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.428+0000 7f4cdbfff640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cbc078d40 0x7f4cbc07b200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc15a480 tx=0x7f4ccc006aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:56.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.431+0000 7f4cd97fa640 1 -- 172.21.15.81:0/546930386 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4cc4083a80 con 0x7f4cc8003a50 2024-09-17T05:19:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.646+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cdc156770 con 0x7f4cc8003a50 2024-09-17T05:19:56.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.646+0000 7f4cd97fa640 1 -- 172.21.15.81:0/546930386 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+3917 (secure 0 0 0) 0x7f4cc4083380 con 0x7f4cc8003a50 2024-09-17T05:19:56.648 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:56.648 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":17,"btime":"2024-09-17T05:19:51:385722+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4637,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1349280669","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1349280669},{"type":"v1","addr":"172.21.15.81:6835","nonce":1349280669}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":4875,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4116874676","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4116874676},{"type":"v1","addr":"172.21.15.81:6834","nonce":4116874676}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":4881,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/3419973321","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3419973321},{"type":"v1","addr":"172.21.15.160:6836","nonce":3419973321}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":5041,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3983670151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3983670151},{"type":"v1","addr":"172.21.15.160:6837","nonce":3983670151}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":17}],"filesystems":[]} 2024-09-17T05:19:56.648 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 17 2024-09-17T05:19:56.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.648+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cbc078d40 msgr2=0x7f4cbc07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.648+0000 7f4ce2ced640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cbc078d40 0x7f4cbc07b200 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc15a480 tx=0x7f4ccc006aa0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.648+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 msgr2=0x7f4cdc152650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.648+0000 7f4ce2ced640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 0x7f4cdc152650 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4cc4009a70 tx=0x7f4cc4033670 comp rx=0 tx=0).stop 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 shutdown_connections 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cbc078d40 0x7f4cbc07b200 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cdc153ce0 0x7f4cdc1f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cdc150ff0 0x7f4cdc1508c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 --2- 172.21.15.81:0/546930386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc8003a50 0x7f4cdc152650 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 >> 172.21.15.81:0/546930386 conn(0x7f4cdc0b1690 msgr2=0x7f4cdc06ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 shutdown_connections 2024-09-17T05:19:56.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.649+0000 7f4ce2ced640 1 -- 172.21.15.81:0/546930386 wait complete. 2024-09-17T05:19:56.660 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:19:56.661 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:19:56.661 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:19:56.661 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:56.661 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:19:56.661 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:19:56.661 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:19:56.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:56.662 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:19:56.662 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:19:56.662 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:19:56.662 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:56.662 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:19:56.662 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:19:56.663 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:19:56.663 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:19:56.671 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:19:56.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:19:56.672 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:19:56.672 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:19:56.674 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:19:56.675 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:19:56.676 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:19:56.676 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:19:56.713 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:19:56.714 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:56.715 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:19:56.715 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:56.717 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:19:56.717 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:56.718 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:19:56.718 DEBUG:teuthology.parallel:result is None 2024-09-17T05:19:56.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:19:56.788 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:19:56.788 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:19:56.799 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:19:56.799 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:19:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 -- 172.21.15.81:0/2402834148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe0162480 msgr2=0x7fafe00d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 --2- 172.21.15.81:0/2402834148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe0162480 0x7fafe00d0b70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fafe006d080 tx=0x7fafd802aa30 comp rx=0 tx=0).stop 2024-09-17T05:19:56.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 -- 172.21.15.81:0/2402834148 shutdown_connections 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 --2- 172.21.15.81:0/2402834148 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe0162480 0x7fafe00d0b70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 --2- 172.21.15.81:0/2402834148 >> v2:172.21.15.160:3300/0 conn(0x7fafe00d49c0 0x7fafe00d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 --2- 172.21.15.81:0/2402834148 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafe015df90 0x7fafe00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 -- 172.21.15.81:0/2402834148 >> 172.21.15.81:0/2402834148 conn(0x7fafe00d3ea0 msgr2=0x7fafe00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 -- 172.21.15.81:0/2402834148 shutdown_connections 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.825+0000 7fafe61b5640 1 -- 172.21.15.81:0/2402834148 wait complete. 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.826+0000 7fafe61b5640 1 Processor -- start 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.826+0000 7fafe61b5640 1 -- start start 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafe61b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe00d49c0 0x7fafe0154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafe61b5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafe015df90 0x7fafe015f580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafe61b5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafe0162480 0x7fafe009db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafe61b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafe00b3b90 con 0x7fafe00d49c0 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafe61b5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fafe00b3a10 con 0x7fafe015df90 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafe61b5640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fafe00b3d10 con 0x7fafe0162480 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe00d49c0 0x7fafe0154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe00d49c0 0x7fafe0154210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56244/0 (socket says 172.21.15.81:56244) 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 -- 172.21.15.81:0/529759149 learned_addr learned my addr 172.21.15.81:0/529759149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdffff640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafe0162480 0x7fafe009db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdeffd640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafe015df90 0x7fafe015f580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 -- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafe0162480 msgr2=0x7fafe009db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafe0162480 0x7fafe009db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 -- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafe015df90 msgr2=0x7fafe015f580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:56.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafe015df90 0x7fafe015f580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.827+0000 7fafdf7fe640 1 -- 172.21.15.81:0/529759149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafe0154750 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.828+0000 7fafdf7fe640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe00d49c0 0x7fafe0154210 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fafd000b4d0 tx=0x7fafd000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.828+0000 7fafc7fff640 1 -- 172.21.15.81:0/529759149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0014070 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.828+0000 7fafc7fff640 1 -- 172.21.15.81:0/529759149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafd0010960 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.828+0000 7fafc7fff640 1 -- 172.21.15.81:0/529759149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafd0010db0 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.828+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafe00b8fb0 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.828+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafe00b9570 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.829+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafe009fc30 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.829+0000 7fafc7fff640 1 -- 172.21.15.81:0/529759149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fafd0017070 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.830+0000 7fafc7fff640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fafcc078d70 0x7fafcc07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.830+0000 7fafc7fff640 1 -- 172.21.15.81:0/529759149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 4943+0+0 (secure 0 0 0) 0x7fafd009ab10 con 0x7fafe00d49c0 2024-09-17T05:19:56.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.830+0000 7fafdeffd640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fafcc078d70 0x7fafcc07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:56.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.830+0000 7fafdeffd640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fafcc078d70 0x7fafcc07b230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fafe015d390 tx=0x7fafd400a4c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:56.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:56.834+0000 7fafc7fff640 1 -- 172.21.15.81:0/529759149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fafe009fc30 con 0x7fafe00d49c0 2024-09-17T05:19:57.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.021+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fafe008d590 con 0x7fafe00d49c0 2024-09-17T05:19:57.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.523+0000 7fafc7fff640 1 -- 172.21.15.81:0/529759149 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v39) ==== 97+0+0 (secure 0 0 0) 0x7fafd0062fe0 con 0x7fafe00d49c0 2024-09-17T05:19:57.524 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:19:57.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fafcc078d70 msgr2=0x7fafcc07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:57.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fafcc078d70 0x7fafcc07b230 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fafe015d390 tx=0x7fafd400a4c0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe00d49c0 msgr2=0x7fafe0154210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:57.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe00d49c0 0x7fafe0154210 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fafd000b4d0 tx=0x7fafd000b990 comp rx=0 tx=0).stop 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 shutdown_connections 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fafcc078d70 0x7fafcc07b230 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafe0162480 0x7fafe009db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafe015df90 0x7fafe015f580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 --2- 172.21.15.81:0/529759149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafe00d49c0 0x7fafe0154210 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 >> 172.21.15.81:0/529759149 conn(0x7fafe00d3ea0 msgr2=0x7fafe00b2340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 shutdown_connections 2024-09-17T05:19:57.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.526+0000 7fafe61b5640 1 -- 172.21.15.81:0/529759149 wait complete. 2024-09-17T05:19:57.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:19:57.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 -- 172.21.15.81:0/122801703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c15fe60 msgr2=0x7f559c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/122801703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c15fe60 0x7f559c0ceac0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f5594005fd0 tx=0x7f559402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 -- 172.21.15.81:0/122801703 shutdown_connections 2024-09-17T05:19:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/122801703 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c15fe60 0x7f559c0ceac0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/122801703 >> v2:172.21.15.160:3300/0 conn(0x7f559c159680 0x7f559c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 -- 172.21.15.81:0/122801703 >> 172.21.15.81:0/122801703 conn(0x7f559c0b1690 msgr2=0x7f559c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 -- 172.21.15.81:0/122801703 shutdown_connections 2024-09-17T05:19:57.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.640+0000 7f55a2e2a640 1 -- 172.21.15.81:0/122801703 wait complete. 2024-09-17T05:19:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.641+0000 7f55a2e2a640 1 Processor -- start 2024-09-17T05:19:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.641+0000 7f55a2e2a640 1 -- start start 2024-09-17T05:19:57.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a2e2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f559c0cc490 0x7f559c148390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a2e2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c159680 0x7f559c0aac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a2e2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15fe60 0x7f559c0c4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a2e2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0cca80 con 0x7f559c15fe60 2024-09-17T05:19:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a2e2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f559c0cc900 con 0x7f559c0cc490 2024-09-17T05:19:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a2e2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f559c0ccc00 con 0x7f559c159680 2024-09-17T05:19:57.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a13c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15fe60 0x7f559c0c4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a13c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15fe60 0x7f559c0c4c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56246/0 (socket says 172.21.15.81:56246) 2024-09-17T05:19:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a13c7640 1 -- 172.21.15.81:0/3876982280 learned_addr learned my addr 172.21.15.81:0/3876982280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f55a0bc6640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f559c0cc490 0x7f559c148390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.642+0000 7f5593fff640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c159680 0x7f559c0aac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:57.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a13c7640 1 -- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c159680 msgr2=0x7f559c0aac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a13c7640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c159680 0x7f559c0aac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a13c7640 1 -- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f559c0cc490 msgr2=0x7f559c148390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a13c7640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f559c0cc490 0x7f559c148390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a13c7640 1 -- 172.21.15.81:0/3876982280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f559c0ab5e0 con 0x7f559c15fe60 2024-09-17T05:19:57.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a13c7640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15fe60 0x7f559c0c4c10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f559402aea0 tx=0x7f5594033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55917fa640 1 -- 172.21.15.81:0/3876982280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5594031990 con 0x7f559c15fe60 2024-09-17T05:19:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55917fa640 1 -- 172.21.15.81:0/3876982280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5594031c20 con 0x7f559c15fe60 2024-09-17T05:19:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f559c0ab8c0 con 0x7f559c15fe60 2024-09-17T05:19:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55917fa640 1 -- 172.21.15.81:0/3876982280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55940330d0 con 0x7f559c15fe60 2024-09-17T05:19:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.643+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f559c148b30 con 0x7f559c15fe60 2024-09-17T05:19:57.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.644+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f559c0ceac0 con 0x7f559c15fe60 2024-09-17T05:19:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.645+0000 7f55917fa640 1 -- 172.21.15.81:0/3876982280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f5594033270 con 0x7f559c15fe60 2024-09-17T05:19:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.645+0000 7f55917fa640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5588078d40 0x7f558807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.645+0000 7f55917fa640 1 -- 172.21.15.81:0/3876982280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f55940bbfe0 con 0x7f559c15fe60 2024-09-17T05:19:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.645+0000 7f55a0bc6640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5588078d40 0x7f558807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:57.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.646+0000 7f55a0bc6640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5588078d40 0x7f558807b200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55980095f0 tx=0x7f5598005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:57.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.650+0000 7f55917fa640 1 -- 172.21.15.81:0/3876982280 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f559403f030 con 0x7f559c15fe60 2024-09-17T05:19:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.891+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f559c0738f0 con 0x7f559c15fe60 2024-09-17T05:19:57.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.892+0000 7f55917fa640 1 -- 172.21.15.81:0/3876982280 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) ==== 80+0+5304 (secure 0 0 0) 0x7f55940317b0 con 0x7f559c15fe60 2024-09-17T05:19:57.892 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:57.892 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:19:57.892 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:19:57.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.892 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:19:57.893 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:19:57.894 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.895 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.896 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.897 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.898 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.899 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.900 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.901 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:19:57.902 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:19:57.904 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.905 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.906 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:19:57.907 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:19:57.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5588078d40 msgr2=0x7f558807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:57.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5588078d40 0x7f558807b200 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f55980095f0 tx=0x7f5598005f90 comp rx=0 tx=0).stop 2024-09-17T05:19:57.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15fe60 msgr2=0x7f559c0c4c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:57.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15fe60 0x7f559c0c4c10 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f559402aea0 tx=0x7f5594033f70 comp rx=0 tx=0).stop 2024-09-17T05:19:57.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 shutdown_connections 2024-09-17T05:19:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5588078d40 0x7f558807b200 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f559c15fe60 0x7f559c0c4c10 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f559c159680 0x7f559c0aac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 --2- 172.21.15.81:0/3876982280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f559c0cc490 0x7f559c148390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 >> 172.21.15.81:0/3876982280 conn(0x7f559c0b1690 msgr2=0x7f559c0afe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 shutdown_connections 2024-09-17T05:19:57.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:57.894+0000 7f55a2e2a640 1 -- 172.21.15.81:0/3876982280 wait complete. 2024-09-17T05:19:57.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:19:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 -- 172.21.15.81:0/2763718134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc490 msgr2=0x7f5b2415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 --2- 172.21.15.81:0/2763718134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc490 0x7f5b2415f750 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009860 tx=0x7f5b1402a540 comp rx=0 tx=0).stop 2024-09-17T05:19:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 -- 172.21.15.81:0/2763718134 shutdown_connections 2024-09-17T05:19:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 --2- 172.21.15.81:0/2763718134 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b240cc900 0x7f5b2415fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 --2- 172.21.15.81:0/2763718134 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc490 0x7f5b2415f750 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 -- 172.21.15.81:0/2763718134 >> 172.21.15.81:0/2763718134 conn(0x7f5b240b1690 msgr2=0x7f5b240b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 -- 172.21.15.81:0/2763718134 shutdown_connections 2024-09-17T05:19:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.010+0000 7f5b289a3640 1 -- 172.21.15.81:0/2763718134 wait complete. 2024-09-17T05:19:58.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 Processor -- start 2024-09-17T05:19:58.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 -- start start 2024-09-17T05:19:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240cc490 0x7f5b24157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc900 0x7f5b241f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b24159680 0x7f5b24150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240cec40 con 0x7f5b240cc900 2024-09-17T05:19:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b240ceac0 con 0x7f5b240cc490 2024-09-17T05:19:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.012+0000 7f5b289a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5b240cedc0 con 0x7f5b24159680 2024-09-17T05:19:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc900 0x7f5b241f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc900 0x7f5b241f2470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56264/0 (socket says 172.21.15.81:56264) 2024-09-17T05:19:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 -- 172.21.15.81:0/3261708771 learned_addr learned my addr 172.21.15.81:0/3261708771 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:58.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b22d9d640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b24159680 0x7f5b24150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b2259c640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240cc490 0x7f5b24157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 -- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b24159680 msgr2=0x7f5b24150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b24159680 0x7f5b24150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 -- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240cc490 msgr2=0x7f5b24157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240cc490 0x7f5b24157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 -- 172.21.15.81:0/3261708771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b241f29b0 con 0x7f5b240cc900 2024-09-17T05:19:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b22d9d640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b24159680 0x7f5b24150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b2259c640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240cc490 0x7f5b24157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:19:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b21d9b640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc900 0x7f5b241f2470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009980 tx=0x7f5b14032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b1affd640 1 -- 172.21.15.81:0/3261708771 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b14040070 con 0x7f5b240cc900 2024-09-17T05:19:58.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b1affd640 1 -- 172.21.15.81:0/3261708771 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b14005310 con 0x7f5b240cc900 2024-09-17T05:19:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b1affd640 1 -- 172.21.15.81:0/3261708771 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b140047a0 con 0x7f5b240cc900 2024-09-17T05:19:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b241f2c30 con 0x7f5b240cc900 2024-09-17T05:19:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.013+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b241f31f0 con 0x7f5b240cc900 2024-09-17T05:19:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.014+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b240cf270 con 0x7f5b240cc900 2024-09-17T05:19:58.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.015+0000 7f5b1affd640 1 -- 172.21.15.81:0/3261708771 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f5b14039040 con 0x7f5b240cc900 2024-09-17T05:19:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.015+0000 7f5b1affd640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b04078d40 0x7f5b0407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.015+0000 7f5b1affd640 1 -- 172.21.15.81:0/3261708771 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7f5b140bc1a0 con 0x7f5b240cc900 2024-09-17T05:19:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.016+0000 7f5b2259c640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b04078d40 0x7f5b0407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.016+0000 7f5b2259c640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b04078d40 0x7f5b0407b200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000f60 tx=0x7f5b0c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:58.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.020+0000 7f5b1affd640 1 -- 172.21.15.81:0/3261708771 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5b241f29b0 con 0x7f5b240cc900 2024-09-17T05:19:58.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.196+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f5b240d0490 con 0x7f5b240cc900 2024-09-17T05:19:58.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.197+0000 7f5b1affd640 1 -- 172.21.15.81:0/3261708771 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v41) ==== 84+0+65 (secure 0 0 0) 0x7f5b140846c0 con 0x7f5b240cc900 2024-09-17T05:19:58.197 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:19:58.197 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:19:58.197 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:19:58.197 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:19:58.197 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:19:58.197 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:19:58.198 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:19:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b04078d40 msgr2=0x7f5b0407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b04078d40 0x7f5b0407b200 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c000f60 tx=0x7f5b0c009040 comp rx=0 tx=0).stop 2024-09-17T05:19:58.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc900 msgr2=0x7f5b241f2470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc900 0x7f5b241f2470 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f5b14009980 tx=0x7f5b14032c10 comp rx=0 tx=0).stop 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 shutdown_connections 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b04078d40 0x7f5b0407b200 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b24159680 0x7f5b24150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b240cc900 0x7f5b241f2470 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 --2- 172.21.15.81:0/3261708771 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b240cc490 0x7f5b24157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 >> 172.21.15.81:0/3261708771 conn(0x7f5b240b1690 msgr2=0x7f5b24158970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 shutdown_connections 2024-09-17T05:19:58.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.199+0000 7f5b289a3640 1 -- 172.21.15.81:0/3261708771 wait complete. 2024-09-17T05:19:58.210 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:19:58.210 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:19:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 -- 172.21.15.81:0/2358214475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c161300 msgr2=0x7faa6c0d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 --2- 172.21.15.81:0/2358214475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c161300 0x7faa6c0d4940 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7faa6c0d4e80 tx=0x7faa6002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 -- 172.21.15.81:0/2358214475 shutdown_connections 2024-09-17T05:19:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 --2- 172.21.15.81:0/2358214475 >> v2:172.21.15.160:3300/0 conn(0x7faa6c0d23e0 0x7faa6c0d2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 --2- 172.21.15.81:0/2358214475 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa6c1616e0 0x7faa6c0d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 --2- 172.21.15.81:0/2358214475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c161300 0x7faa6c0d4940 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 -- 172.21.15.81:0/2358214475 >> 172.21.15.81:0/2358214475 conn(0x7faa6c0d3e20 msgr2=0x7faa6c0d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:58.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 -- 172.21.15.81:0/2358214475 shutdown_connections 2024-09-17T05:19:58.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.315+0000 7faa72de2640 1 -- 172.21.15.81:0/2358214475 wait complete. 2024-09-17T05:19:58.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.316+0000 7faa72de2640 1 Processor -- start 2024-09-17T05:19:58.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.316+0000 7faa72de2640 1 -- start start 2024-09-17T05:19:58.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa72de2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa6c0d23e0 0x7faa6c0b7eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa72de2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa6c161300 0x7faa6c0cca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa72de2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c1616e0 0x7faa6c1f7980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa72de2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0d0be0 con 0x7faa6c1616e0 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa72de2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faa6c0d0a60 con 0x7faa6c161300 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa72de2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faa6c0d0d60 con 0x7faa6c0d23e0 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa7137f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c1616e0 0x7faa6c1f7980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa7137f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c1616e0 0x7faa6c1f7980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56282/0 (socket says 172.21.15.81:56282) 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa7137f640 1 -- 172.21.15.81:0/3979902026 learned_addr learned my addr 172.21.15.81:0/3979902026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa6bfff640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa6c161300 0x7faa6c0cca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.317+0000 7faa70b7e640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa6c0d23e0 0x7faa6c0b7eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa7137f640 1 -- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa6c0d23e0 msgr2=0x7faa6c0b7eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa7137f640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa6c0d23e0 0x7faa6c0b7eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa7137f640 1 -- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa6c161300 msgr2=0x7faa6c0cca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa7137f640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa6c161300 0x7faa6c0cca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa7137f640 1 -- 172.21.15.81:0/3979902026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faa6c0cd180 con 0x7faa6c1616e0 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa6bfff640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa6c161300 0x7faa6c0cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa7137f640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c1616e0 0x7faa6c1f7980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faa6400cce0 tx=0x7faa6400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa697fa640 1 -- 172.21.15.81:0/3979902026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6400f450 con 0x7faa6c1616e0 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa697fa640 1 -- 172.21.15.81:0/3979902026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faa6400f6e0 con 0x7faa6c1616e0 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa697fa640 1 -- 172.21.15.81:0/3979902026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faa6400fb30 con 0x7faa6c1616e0 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faa6c0cd460 con 0x7faa6c1616e0 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.318+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faa6c0cda20 con 0x7faa6c1616e0 2024-09-17T05:19:58.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.319+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faa6c0d1280 con 0x7faa6c1616e0 2024-09-17T05:19:58.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.320+0000 7faa697fa640 1 -- 172.21.15.81:0/3979902026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7faa6400fcd0 con 0x7faa6c1616e0 2024-09-17T05:19:58.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.320+0000 7faa697fa640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faa50078d40 0x7faa5007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.320+0000 7faa697fa640 1 -- 172.21.15.81:0/3979902026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(41..41 src has 1..41) ==== 4857+0+0 (secure 0 0 0) 0x7faa6409b820 con 0x7faa6c1616e0 2024-09-17T05:19:58.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.320+0000 7faa70b7e640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faa50078d40 0x7faa5007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.321+0000 7faa70b7e640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faa50078d40 0x7faa5007b200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa60033000 tx=0x7faa60004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:58.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.324+0000 7faa697fa640 1 -- 172.21.15.81:0/3979902026 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7faa64014030 con 0x7faa6c1616e0 2024-09-17T05:19:58.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.502+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7faa6c076040 con 0x7faa6c1616e0 2024-09-17T05:19:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.535+0000 7faa697fa640 1 -- 172.21.15.81:0/3979902026 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v42) ==== 138+0+0 (secure 0 0 0) 0x7faa64063d40 con 0x7faa6c1616e0 2024-09-17T05:19:58.535 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faa50078d40 msgr2=0x7faa5007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faa50078d40 0x7faa5007b200 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7faa60033000 tx=0x7faa60004730 comp rx=0 tx=0).stop 2024-09-17T05:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c1616e0 msgr2=0x7faa6c1f7980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c1616e0 0x7faa6c1f7980 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7faa6400cce0 tx=0x7faa6400a620 comp rx=0 tx=0).stop 2024-09-17T05:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 shutdown_connections 2024-09-17T05:19:58.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faa50078d40 0x7faa5007b200 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faa6c1616e0 0x7faa6c1f7980 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faa6c161300 0x7faa6c0cca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 --2- 172.21.15.81:0/3979902026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faa6c0d23e0 0x7faa6c0b7eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 >> 172.21.15.81:0/3979902026 conn(0x7faa6c0d3e20 msgr2=0x7faa6c06e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 shutdown_connections 2024-09-17T05:19:58.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.537+0000 7faa72de2640 1 -- 172.21.15.81:0/3979902026 wait complete. 2024-09-17T05:19:58.551 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:19:58.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 -- 172.21.15.81:0/28696374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c15adb0 msgr2=0x7f381c0ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 --2- 172.21.15.81:0/28696374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c15adb0 0x7f381c0ccd20 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f381c072a30 tx=0x7f380c02a560 comp rx=0 tx=0).stop 2024-09-17T05:19:58.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 -- 172.21.15.81:0/28696374 shutdown_connections 2024-09-17T05:19:58.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 --2- 172.21.15.81:0/28696374 >> v2:172.21.15.160:3300/0 conn(0x7f381c0cbd00 0x7f381c0ce230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 --2- 172.21.15.81:0/28696374 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381c0cd260 0x7f381c0cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 --2- 172.21.15.81:0/28696374 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c15adb0 0x7f381c0ccd20 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 -- 172.21.15.81:0/28696374 >> 172.21.15.81:0/28696374 conn(0x7f381c074160 msgr2=0x7f381c074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:58.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 -- 172.21.15.81:0/28696374 shutdown_connections 2024-09-17T05:19:58.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.661+0000 7f3821b9b640 1 -- 172.21.15.81:0/28696374 wait complete. 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.662+0000 7f3821b9b640 1 Processor -- start 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.662+0000 7f3821b9b640 1 -- start start 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3821b9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f381c0cbd00 0x7f381c158690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3821b9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c0cd260 0x7f381c0d0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3821b9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381c15adb0 0x7f381c0d0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3821b9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f381c0ceb00 con 0x7f381c0cd260 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3821b9b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f381c0ce980 con 0x7f381c0cbd00 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3821b9b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f381c0cec80 con 0x7f381c15adb0 2024-09-17T05:19:58.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c0cd260 0x7f381c0d0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c0cd260 0x7f381c0d0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56302/0 (socket says 172.21.15.81:56302) 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 -- 172.21.15.81:0/2885411996 learned_addr learned my addr 172.21.15.81:0/2885411996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f381b7fe640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f381c0cbd00 0x7f381c158690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f381bfff640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381c15adb0 0x7f381c0d0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 -- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381c15adb0 msgr2=0x7f381c0d0870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381c15adb0 0x7f381c0d0870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 -- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f381c0cbd00 msgr2=0x7f381c158690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f381c0cbd00 0x7f381c158690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 -- 172.21.15.81:0/2885411996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f381c0d1270 con 0x7f381c0cd260 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3813fff640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c0cd260 0x7f381c0d0330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f380400d770 tx=0x7f380400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:58.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3818ff9640 1 -- 172.21.15.81:0/2885411996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804017070 con 0x7f381c0cd260 2024-09-17T05:19:58.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3818ff9640 1 -- 172.21.15.81:0/2885411996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3804009d20 con 0x7f381c0cd260 2024-09-17T05:19:58.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f381c070980 con 0x7f381c0cd260 2024-09-17T05:19:58.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.663+0000 7f3818ff9640 1 -- 172.21.15.81:0/2885411996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3804005280 con 0x7f381c0cd260 2024-09-17T05:19:58.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.664+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f381c0c5fa0 con 0x7f381c0cd260 2024-09-17T05:19:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.664+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f381c0cb7c0 con 0x7f381c0cd260 2024-09-17T05:19:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.665+0000 7f3818ff9640 1 -- 172.21.15.81:0/2885411996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f3804005420 con 0x7f381c0cd260 2024-09-17T05:19:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.666+0000 7f3818ff9640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37fc078d70 0x7f37fc07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.666+0000 7f3818ff9640 1 -- 172.21.15.81:0/2885411996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 5227+0+0 (secure 0 0 0) 0x7f380409aeb0 con 0x7f381c0cd260 2024-09-17T05:19:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.666+0000 7f381b7fe640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37fc078d70 0x7f37fc07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.666+0000 7f381b7fe640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37fc078d70 0x7f37fc07b230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f380c033000 tx=0x7f380c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.670+0000 7f3818ff9640 1 -- 172.21.15.81:0/2885411996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3804062cc0 con 0x7f381c0cd260 2024-09-17T05:19:58.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:58.846+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f381c0cb3e0 con 0x7f381c0cd260 2024-09-17T05:19:59.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.543+0000 7f3818ff9640 1 -- 172.21.15.81:0/2885411996 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v43) ==== 170+0+0 (secure 0 0 0) 0x7f38040676f0 con 0x7f381c0cd260 2024-09-17T05:19:59.544 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37fc078d70 msgr2=0x7f37fc07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37fc078d70 0x7f37fc07b230 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f380c033000 tx=0x7f380c004730 comp rx=0 tx=0).stop 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c0cd260 msgr2=0x7f381c0d0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c0cd260 0x7f381c0d0330 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f380400d770 tx=0x7f380400dc30 comp rx=0 tx=0).stop 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 shutdown_connections 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f37fc078d70 0x7f37fc07b230 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f381c15adb0 0x7f381c0d0870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f381c0cd260 0x7f381c0d0330 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 --2- 172.21.15.81:0/2885411996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f381c0cbd00 0x7f381c158690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 >> 172.21.15.81:0/2885411996 conn(0x7f381c074160 msgr2=0x7f381c15d4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 shutdown_connections 2024-09-17T05:19:59.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.547+0000 7f3821b9b640 1 -- 172.21.15.81:0/2885411996 wait complete. 2024-09-17T05:19:59.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:19:59.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.675+0000 7f9602471640 1 -- 172.21.15.81:0/22599415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e40039e0 msgr2=0x7f95e4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:59.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.675+0000 7f9602471640 1 --2- 172.21.15.81:0/22599415 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95e40039e0 0x7f95e4003de0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00c310 tx=0x7f95e4005830 comp rx=0 tx=0).stop 2024-09-17T05:19:59.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.675+0000 7f9600a0e640 1 -- 172.21.15.81:0/22599415 reap_dead start 2024-09-17T05:19:59.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.675+0000 7f9602471640 1 -- 172.21.15.81:0/22599415 shutdown_connections 2024-09-17T05:19:59.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.675+0000 7f9602471640 1 -- 172.21.15.81:0/22599415 >> 172.21.15.81:0/22599415 conn(0x7f95fc09aa30 msgr2=0x7f95fc09ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:19:59.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.675+0000 7f9602471640 1 -- 172.21.15.81:0/22599415 shutdown_connections 2024-09-17T05:19:59.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.675+0000 7f9602471640 1 -- 172.21.15.81:0/22599415 wait complete. 2024-09-17T05:19:59.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.676+0000 7f9602471640 1 Processor -- start 2024-09-17T05:19:59.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.677+0000 7f9602471640 1 -- start start 2024-09-17T05:19:59.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.677+0000 7f9602471640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95e40039e0 0x7f95fc0c61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:59.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.677+0000 7f9602471640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95fc159250 0x7f95fc0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:59.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.677+0000 7f9602471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cbbe0 0x7f95fc1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:59.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.677+0000 7f9602471640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0ccda0 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.677+0000 7f9602471640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f95fc0d1f70 con 0x7f95fc159250 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.677+0000 7f9602471640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f95fc0ccf20 con 0x7f95e40039e0 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cbbe0 0x7f95fc1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cbbe0 0x7f95fc1f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56326/0 (socket says 172.21.15.81:56326) 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 -- 172.21.15.81:0/1543745113 learned_addr learned my addr 172.21.15.81:0/1543745113 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f95fbfff640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95e40039e0 0x7f95fc0c61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f95fb7fe640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95fc159250 0x7f95fc0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 -- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95e40039e0 msgr2=0x7f95fc0c61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95e40039e0 0x7f95fc0c61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 -- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95fc159250 msgr2=0x7f95fc0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95fc159250 0x7f95fc0cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 -- 172.21.15.81:0/1543745113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95fc1f3560 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9600a0e640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cbbe0 0x7f95fc1f27c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0701b0 tx=0x7f95f400d9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:59.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f95f8ff9640 1 -- 172.21.15.81:0/1543745113 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f400f880 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f95f8ff9640 1 -- 172.21.15.81:0/1543745113 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95f4017070 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95fc0c5420 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f95f8ff9640 1 -- 172.21.15.81:0/1543745113 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f400fdb0 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.678+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95fc0c59e0 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.679+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95fc0cd440 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.680+0000 7f95f8ff9640 1 -- 172.21.15.81:0/1543745113 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f95f401c460 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.680+0000 7f95f8ff9640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f95e8078d70 0x7f95e807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:19:59.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.680+0000 7f95f8ff9640 1 -- 172.21.15.81:0/1543745113 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(43..43 src has 1..43) ==== 5609+0+0 (secure 0 0 0) 0x7f95f409b140 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.680+0000 7f95fbfff640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f95e8078d70 0x7f95e807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:19:59.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.681+0000 7f95fbfff640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f95e8078d70 0x7f95e807b230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f95ec033000 tx=0x7f95ec001aa0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:19:59.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.685+0000 7f95f8ff9640 1 -- 172.21.15.81:0/1543745113 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f95f4062ca0 con 0x7f95fc0cbbe0 2024-09-17T05:19:59.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:19:59.899+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f95fc15a700 con 0x7f95fc0cbbe0 2024-09-17T05:20:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.550+0000 7f95f8ff9640 1 -- 172.21.15.81:0/1543745113 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v20) ==== 172+0+0 (secure 0 0 0) 0x7f95f40676d0 con 0x7f95fc0cbbe0 2024-09-17T05:20:00.550 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 6 and data pool 7 2024-09-17T05:20:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.553+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f95e8078d70 msgr2=0x7f95e807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.553+0000 7f9602471640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f95e8078d70 0x7f95e807b230 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f95ec033000 tx=0x7f95ec001aa0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.553+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cbbe0 msgr2=0x7f95fc1f27c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.553+0000 7f9602471640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cbbe0 0x7f95fc1f27c0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f95fc0701b0 tx=0x7f95f400d9f0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.553+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 shutdown_connections 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.554+0000 7f9602471640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f95e8078d70 0x7f95e807b230 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.554+0000 7f9602471640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95fc0cbbe0 0x7f95fc1f27c0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.554+0000 7f9602471640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95fc159250 0x7f95fc0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.554+0000 7f9602471640 1 --2- 172.21.15.81:0/1543745113 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95e40039e0 0x7f95fc0c61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.554+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 >> 172.21.15.81:0/1543745113 conn(0x7f95fc09aa30 msgr2=0x7f95fc0ae930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.554+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 shutdown_connections 2024-09-17T05:20:00.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.554+0000 7f9602471640 1 -- 172.21.15.81:0/1543745113 wait complete. 2024-09-17T05:20:00.570 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:20:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.679+0000 7faac657c640 1 -- 172.21.15.81:0/1812455694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaac0039e0 msgr2=0x7faaac003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.679+0000 7faac657c640 1 --2- 172.21.15.81:0/1812455694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaac0039e0 0x7faaac003e00 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7faaa800c710 tx=0x7faaac005830 comp rx=0 tx=0).stop 2024-09-17T05:20:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.679+0000 7faac4b19640 1 -- 172.21.15.81:0/1812455694 reap_dead start 2024-09-17T05:20:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.679+0000 7faac657c640 1 -- 172.21.15.81:0/1812455694 shutdown_connections 2024-09-17T05:20:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.679+0000 7faac657c640 1 -- 172.21.15.81:0/1812455694 >> 172.21.15.81:0/1812455694 conn(0x7faac00d3ea0 msgr2=0x7faac00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.679+0000 7faac657c640 1 -- 172.21.15.81:0/1812455694 shutdown_connections 2024-09-17T05:20:00.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.680+0000 7faac657c640 1 -- 172.21.15.81:0/1812455694 wait complete. 2024-09-17T05:20:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.681+0000 7faac657c640 1 Processor -- start 2024-09-17T05:20:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.681+0000 7faac657c640 1 -- start start 2024-09-17T05:20:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaac0039e0 0x7faac00c9c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac00b9500 0x7faac015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faac0157690 0x7faac0157b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faac00cf9b0 con 0x7faac00b9500 2024-09-17T05:20:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faac01626e0 con 0x7faaac0039e0 2024-09-17T05:20:00.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faac00cfb30 con 0x7faac0157690 2024-09-17T05:20:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac00b9500 0x7faac015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac00b9500 0x7faac015a3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56330/0 (socket says 172.21.15.81:56330) 2024-09-17T05:20:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 -- 172.21.15.81:0/205000122 learned_addr learned my addr 172.21.15.81:0/205000122 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabffff640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaac0039e0 0x7faac00c9c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac4b19640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faac0157690 0x7faac0157b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:00.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 -- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faac0157690 msgr2=0x7faac0157b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faac0157690 0x7faac0157b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 -- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaac0039e0 msgr2=0x7faac00c9c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaac0039e0 0x7faac00c9c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 -- 172.21.15.81:0/205000122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faac00ca170 con 0x7faac00b9500 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabf7fe640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac00b9500 0x7faac015a3c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faab0006680 tx=0x7faab00039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabcff9640 1 -- 172.21.15.81:0/205000122 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0015070 con 0x7faac00b9500 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabcff9640 1 -- 172.21.15.81:0/205000122 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faab0011920 con 0x7faac00b9500 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faac00b8460 con 0x7faac00b9500 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faabcff9640 1 -- 172.21.15.81:0/205000122 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faab0011d70 con 0x7faac00b9500 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.682+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faac00b8a20 con 0x7faac00b9500 2024-09-17T05:20:00.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.683+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faac008d590 con 0x7faac00b9500 2024-09-17T05:20:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.684+0000 7faabcff9640 1 -- 172.21.15.81:0/205000122 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7faab000f430 con 0x7faac00b9500 2024-09-17T05:20:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.685+0000 7faabcff9640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faaa0078d40 0x7faaa007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.685+0000 7faabcff9640 1 -- 172.21.15.81:0/205000122 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7faab009be30 con 0x7faac00b9500 2024-09-17T05:20:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.685+0000 7faabffff640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faaa0078d40 0x7faaa007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:00.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.686+0000 7faabffff640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faaa0078d40 0x7faaa007b200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faaa8032000 tx=0x7faaa8003760 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:00.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.689+0000 7faabcff9640 1 -- 172.21.15.81:0/205000122 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7faac00ca170 con 0x7faac00b9500 2024-09-17T05:20:00.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.870+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7faac00b4e70 con 0x7faac00b9500 2024-09-17T05:20:00.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.871+0000 7faabcff9640 1 -- 172.21.15.81:0/205000122 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16686 (secure 0 0 0) 0x7faac00ce970 con 0x7faac00b9500 2024-09-17T05:20:00.871 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:00.871 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:59.900281+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:58.505536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:58.850270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:20:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faaa0078d40 msgr2=0x7faaa007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faaa0078d40 0x7faaa007b200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7faaa8032000 tx=0x7faaa8003760 comp rx=0 tx=0).stop 2024-09-17T05:20:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac00b9500 msgr2=0x7faac015a3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac00b9500 0x7faac015a3c0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7faab0006680 tx=0x7faab00039c0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 shutdown_connections 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faaa0078d40 0x7faaa007b200 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faac0157690 0x7faac0157b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faac00b9500 0x7faac015a3c0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 --2- 172.21.15.81:0/205000122 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaac0039e0 0x7faac00c9c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 >> 172.21.15.81:0/205000122 conn(0x7faac00d3ea0 msgr2=0x7faac00b4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 shutdown_connections 2024-09-17T05:20:00.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.873+0000 7faac657c640 1 -- 172.21.15.81:0/205000122 wait complete. 2024-09-17T05:20:00.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:20:00.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.984+0000 7fc417d4b640 1 -- 172.21.15.81:0/1252440060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 msgr2=0x7fc4100ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.984+0000 7fc417d4b640 1 --2- 172.21.15.81:0/1252440060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100ce240 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fc404005fd0 tx=0x7fc40402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.984+0000 7fc417d4b640 1 -- 172.21.15.81:0/1252440060 shutdown_connections 2024-09-17T05:20:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.984+0000 7fc417d4b640 1 --2- 172.21.15.81:0/1252440060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100ce240 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.984+0000 7fc417d4b640 1 -- 172.21.15.81:0/1252440060 >> 172.21.15.81:0/1252440060 conn(0x7fc4100741f0 msgr2=0x7fc410074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.984+0000 7fc417d4b640 1 -- 172.21.15.81:0/1252440060 shutdown_connections 2024-09-17T05:20:00.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.984+0000 7fc417d4b640 1 -- 172.21.15.81:0/1252440060 wait complete. 2024-09-17T05:20:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.985+0000 7fc417d4b640 1 Processor -- start 2024-09-17T05:20:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.985+0000 7fc417d4b640 1 -- start start 2024-09-17T05:20:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc417d4b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41006f0b0 0x7fc4101f81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc417d4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc417d4b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4100ce780 0x7fc4100af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc417d4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4100cc290 con 0x7fc4100cd3e0 2024-09-17T05:20:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc417d4b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc41015e670 con 0x7fc4100ce780 2024-09-17T05:20:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc417d4b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc4100cc410 con 0x7fc41006f0b0 2024-09-17T05:20:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc4152e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:00.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc4152e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56346/0 (socket says 172.21.15.81:56346) 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc4152e6640 1 -- 172.21.15.81:0/522692281 learned_addr learned my addr 172.21.15.81:0/522692281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc4152e6640 1 -- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41006f0b0 msgr2=0x7fc4101f81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc4152e6640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41006f0b0 0x7fc4101f81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc4152e6640 1 -- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4100ce780 msgr2=0x7fc4100af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.986+0000 7fc4152e6640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4100ce780 0x7fc4100af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.987+0000 7fc4152e6640 1 -- 172.21.15.81:0/522692281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4101f8710 con 0x7fc4100cd3e0 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.987+0000 7fc4152e6640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100c7dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc404009850 tx=0x7fc4040038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.987+0000 7fc40e7fc640 1 -- 172.21.15.81:0/522692281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc40403f070 con 0x7fc4100cd3e0 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.987+0000 7fc40e7fc640 1 -- 172.21.15.81:0/522692281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4040047a0 con 0x7fc4100cd3e0 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.987+0000 7fc40e7fc640 1 -- 172.21.15.81:0/522692281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc404035030 con 0x7fc4100cd3e0 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.987+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4101f5050 con 0x7fc4100cd3e0 2024-09-17T05:20:00.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.987+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4101f5610 con 0x7fc4100cd3e0 2024-09-17T05:20:00.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.988+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4100ce240 con 0x7fc4100cd3e0 2024-09-17T05:20:00.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.988+0000 7fc40e7fc640 1 -- 172.21.15.81:0/522692281 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fc404042070 con 0x7fc4100cd3e0 2024-09-17T05:20:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.989+0000 7fc40e7fc640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc3fc078d40 0x7fc3fc07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.989+0000 7fc40e7fc640 1 -- 172.21.15.81:0/522692281 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7fc4040bbd90 con 0x7fc4100cd3e0 2024-09-17T05:20:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.989+0000 7fc415ae7640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc3fc078d40 0x7fc3fc07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:00.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.990+0000 7fc415ae7640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc3fc078d40 0x7fc3fc07b200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc400001cb0 tx=0x7fc400007c50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:00.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:00.993+0000 7fc40e7fc640 1 -- 172.21.15.81:0/522692281 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc404083f60 con 0x7fc4100cd3e0 2024-09-17T05:20:01.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.169+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc410075070 con 0x7fc4100cd3e0 2024-09-17T05:20:01.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.170+0000 7fc40e7fc640 1 -- 172.21.15.81:0/522692281 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v44) ==== 74+0+16686 (secure 0 0 0) 0x7fc404083860 con 0x7fc4100cd3e0 2024-09-17T05:20:01.170 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:01.170 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":44,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:19:59.900281+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:58.505536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:58.850270+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:20:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc3fc078d40 msgr2=0x7fc3fc07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc3fc078d40 0x7fc3fc07b200 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc400001cb0 tx=0x7fc400007c50 comp rx=0 tx=0).stop 2024-09-17T05:20:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 msgr2=0x7fc4100c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100c7dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fc404009850 tx=0x7fc4040038a0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 shutdown_connections 2024-09-17T05:20:01.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc3fc078d40 0x7fc3fc07b200 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4100ce780 0x7fc4100af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4100cd3e0 0x7fc4100c7dc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 --2- 172.21.15.81:0/522692281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc41006f0b0 0x7fc4101f81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 >> 172.21.15.81:0/522692281 conn(0x7fc4100741f0 msgr2=0x7fc4100ad090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 shutdown_connections 2024-09-17T05:20:01.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.172+0000 7fc417d4b640 1 -- 172.21.15.81:0/522692281 wait complete. 2024-09-17T05:20:01.183 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:20:01.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.288+0000 7f691b33d640 1 -- 172.21.15.81:0/562933994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 msgr2=0x7f69000062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.288+0000 7f691b33d640 1 --2- 172.21.15.81:0/562933994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 0x7f69000062d0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f690c0043b0 tx=0x7f6900006940 comp rx=0 tx=0).stop 2024-09-17T05:20:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.288+0000 7f69198da640 1 -- 172.21.15.81:0/562933994 reap_dead start 2024-09-17T05:20:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.288+0000 7f691b33d640 1 -- 172.21.15.81:0/562933994 shutdown_connections 2024-09-17T05:20:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.288+0000 7f691b33d640 1 -- 172.21.15.81:0/562933994 >> 172.21.15.81:0/562933994 conn(0x7f69140b1700 msgr2=0x7f69140b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.288+0000 7f691b33d640 1 -- 172.21.15.81:0/562933994 shutdown_connections 2024-09-17T05:20:01.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.288+0000 7f691b33d640 1 -- 172.21.15.81:0/562933994 wait complete. 2024-09-17T05:20:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 Processor -- start 2024-09-17T05:20:01.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 -- start start 2024-09-17T05:20:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 0x7f69141f8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6914158c60 0x7f69141e4e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f691414ba80 0x7f691414bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f691415a7d0 con 0x7f6900005e50 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f691415a650 con 0x7f6914158c60 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f691b33d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f691415f9d0 con 0x7f691414ba80 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f69190d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 0x7f69141f8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f69190d9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 0x7f69141f8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56368/0 (socket says 172.21.15.81:56368) 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.290+0000 7f69190d9640 1 -- 172.21.15.81:0/189059559 learned_addr learned my addr 172.21.15.81:0/189059559 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69188d8640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6914158c60 0x7f69141e4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69198da640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f691414ba80 0x7f691414bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69190d9640 1 -- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f691414ba80 msgr2=0x7f691414bf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69190d9640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f691414ba80 0x7f691414bf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69190d9640 1 -- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6914158c60 msgr2=0x7f69141e4e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69190d9640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6914158c60 0x7f69141e4e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69190d9640 1 -- 172.21.15.81:0/189059559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69141f8da0 con 0x7f6900005e50 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69198da640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f691414ba80 0x7f691414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f69190d9640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 0x7f69141f8860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f691000e6d0 tx=0x7f691000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f6909ffb640 1 -- 172.21.15.81:0/189059559 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6910004230 con 0x7f6900005e50 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f6909ffb640 1 -- 172.21.15.81:0/189059559 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6910016070 con 0x7f6900005e50 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f6909ffb640 1 -- 172.21.15.81:0/189059559 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f691000c840 con 0x7f6900005e50 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69141f4a00 con 0x7f6900005e50 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.291+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69141f4fc0 con 0x7f6900005e50 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.292+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69140cc540 con 0x7f6900005e50 2024-09-17T05:20:01.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.293+0000 7f6909ffb640 1 -- 172.21.15.81:0/189059559 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f691000ca00 con 0x7f6900005e50 2024-09-17T05:20:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.293+0000 7f6909ffb640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68f8078d70 0x7f68f807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.293+0000 7f6909ffb640 1 -- 172.21.15.81:0/189059559 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 5709+0+0 (secure 0 0 0) 0x7f691009b570 con 0x7f6900005e50 2024-09-17T05:20:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.294+0000 7f69188d8640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68f8078d70 0x7f68f807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.294+0000 7f69188d8640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68f8078d70 0x7f68f807b230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69140b5c30 tx=0x7f690400d390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:01.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.298+0000 7f6909ffb640 1 -- 172.21.15.81:0/189059559 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f69141f8da0 con 0x7f6900005e50 2024-09-17T05:20:01.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.511+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f69141505c0 con 0x7f6900005e50 2024-09-17T05:20:01.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.554+0000 7f6909ffb640 1 -- 172.21.15.81:0/189059559 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v21) ==== 118+0+0 (secure 0 0 0) 0x7f69100636b0 con 0x7f6900005e50 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.556+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68f8078d70 msgr2=0x7f68f807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.556+0000 7f691b33d640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68f8078d70 0x7f68f807b230 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f69140b5c30 tx=0x7f690400d390 comp rx=0 tx=0).stop 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 msgr2=0x7f69141f8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 0x7f69141f8860 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f691000e6d0 tx=0x7f691000eb90 comp rx=0 tx=0).stop 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 shutdown_connections 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f68f8078d70 0x7f68f807b230 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f691414ba80 0x7f691414bf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6914158c60 0x7f69141e4e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 --2- 172.21.15.81:0/189059559 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6900005e50 0x7f69141f8860 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 >> 172.21.15.81:0/189059559 conn(0x7f69140b1700 msgr2=0x7f691415d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 shutdown_connections 2024-09-17T05:20:01.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.557+0000 7f691b33d640 1 -- 172.21.15.81:0/189059559 wait complete. 2024-09-17T05:20:01.567 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:20:01.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:20:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.673+0000 7fe93d30e640 1 -- 172.21.15.81:0/1480402906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 msgr2=0x7fe92400b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.673+0000 7fe93d30e640 1 --2- 172.21.15.81:0/1480402906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe92400b9e0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fe930001c80 tx=0x7fe924005830 comp rx=0 tx=0).stop 2024-09-17T05:20:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.673+0000 7fe93d30e640 1 -- 172.21.15.81:0/1480402906 shutdown_connections 2024-09-17T05:20:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.673+0000 7fe93d30e640 1 --2- 172.21.15.81:0/1480402906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe92400b9e0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.673+0000 7fe93d30e640 1 -- 172.21.15.81:0/1480402906 >> 172.21.15.81:0/1480402906 conn(0x7fe9380d3e30 msgr2=0x7fe9380d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.673+0000 7fe93d30e640 1 -- 172.21.15.81:0/1480402906 shutdown_connections 2024-09-17T05:20:01.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.673+0000 7fe93d30e640 1 -- 172.21.15.81:0/1480402906 wait complete. 2024-09-17T05:20:01.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.674+0000 7fe93d30e640 1 Processor -- start 2024-09-17T05:20:01.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.674+0000 7fe93d30e640 1 -- start start 2024-09-17T05:20:01.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe93d30e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe9380b9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe93d30e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe938159300 0x7fe9381f54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe93d30e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9380b7460 0x7fe9380b84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe93d30e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9380d2170 con 0x7fe924005370 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe93d30e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe9380d1ff0 con 0x7fe938159300 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe93d30e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe9380d22f0 con 0x7fe9380b7460 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe936ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe9380b9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe936ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe9380b9940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56384/0 (socket says 172.21.15.81:56384) 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe936ffd640 1 -- 172.21.15.81:0/500281131 learned_addr learned my addr 172.21.15.81:0/500281131 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe9377fe640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9380b7460 0x7fe9380b84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.675+0000 7fe92e7fc640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe938159300 0x7fe9381f54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe936ffd640 1 -- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9380b7460 msgr2=0x7fe9380b84c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe936ffd640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9380b7460 0x7fe9380b84c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe936ffd640 1 -- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe938159300 msgr2=0x7fe9381f54f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:01.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe936ffd640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe938159300 0x7fe9381f54f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe936ffd640 1 -- 172.21.15.81:0/500281131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9381f5a30 con 0x7fe924005370 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe9377fe640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9380b7460 0x7fe9380b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe936ffd640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe9380b9940 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe92800e7c0 tx=0x7fe92800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe92ffff640 1 -- 172.21.15.81:0/500281131 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe92800ca50 con 0x7fe924005370 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe92ffff640 1 -- 172.21.15.81:0/500281131 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe92800cbf0 con 0x7fe924005370 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9381598a0 con 0x7fe924005370 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe92ffff640 1 -- 172.21.15.81:0/500281131 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe928010430 con 0x7fe924005370 2024-09-17T05:20:01.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.676+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe938159e60 con 0x7fe924005370 2024-09-17T05:20:01.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.677+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe93815a060 con 0x7fe924005370 2024-09-17T05:20:01.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.678+0000 7fe92ffff640 1 -- 172.21.15.81:0/500281131 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fe9280105d0 con 0x7fe924005370 2024-09-17T05:20:01.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.678+0000 7fe92ffff640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe918078d70 0x7fe91807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:01.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.678+0000 7fe92ffff640 1 -- 172.21.15.81:0/500281131 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe92809b990 con 0x7fe924005370 2024-09-17T05:20:01.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.678+0000 7fe92e7fc640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe918078d70 0x7fe91807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:01.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.679+0000 7fe92e7fc640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe918078d70 0x7fe91807b230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe9381588e0 tx=0x7fe920001bd0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:01.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.682+0000 7fe92ffff640 1 -- 172.21.15.81:0/500281131 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe93815a060 con 0x7fe924005370 2024-09-17T05:20:01.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:01.897+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fe9380d2850 con 0x7fe924005370 2024-09-17T05:20:02.524 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-17T05:20:02.524+0000 7fcd4e63d640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:20:02.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.555+0000 7fe92ffff640 1 -- 172.21.15.81:0/500281131 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v22) ==== 122+0+0 (secure 0 0 0) 0x7fe9381f5a30 con 0x7fe924005370 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe918078d70 msgr2=0x7fe91807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe918078d70 0x7fe91807b230 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe9381588e0 tx=0x7fe920001bd0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 msgr2=0x7fe9380b9940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe9380b9940 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fe92800e7c0 tx=0x7fe92800ebc0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 shutdown_connections 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe918078d70 0x7fe91807b230 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9380b7460 0x7fe9380b84c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe938159300 0x7fe9381f54f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 --2- 172.21.15.81:0/500281131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe924005370 0x7fe9380b9940 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 >> 172.21.15.81:0/500281131 conn(0x7fe9380d3e30 msgr2=0x7fe9380b2de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:02.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 shutdown_connections 2024-09-17T05:20:02.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.558+0000 7fe93d30e640 1 -- 172.21.15.81:0/500281131 wait complete. 2024-09-17T05:20:02.573 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:20:02.573 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.679+0000 7fe2034ed640 1 -- 172.21.15.81:0/1228409537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc070690 msgr2=0x7fe1fc0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.679+0000 7fe2034ed640 1 --2- 172.21.15.81:0/1228409537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc070690 0x7fe1fc0739d0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fe1f4009830 tx=0x7fe1f402a480 comp rx=0 tx=0).stop 2024-09-17T05:20:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.679+0000 7fe2034ed640 1 -- 172.21.15.81:0/1228409537 shutdown_connections 2024-09-17T05:20:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.679+0000 7fe2034ed640 1 --2- 172.21.15.81:0/1228409537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc070690 0x7fe1fc0739d0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.679+0000 7fe2034ed640 1 -- 172.21.15.81:0/1228409537 >> 172.21.15.81:0/1228409537 conn(0x7fe1fc0b1690 msgr2=0x7fe1fc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.679+0000 7fe2034ed640 1 -- 172.21.15.81:0/1228409537 shutdown_connections 2024-09-17T05:20:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.679+0000 7fe2034ed640 1 -- 172.21.15.81:0/1228409537 wait complete. 2024-09-17T05:20:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.680+0000 7fe2034ed640 1 Processor -- start 2024-09-17T05:20:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.680+0000 7fe2034ed640 1 -- start start 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe2034ed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1fc070690 0x7fe1fc13fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe2034ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc0735a0 0x7fe1fc140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe2034ed640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1fc15aa70 0x7fe1fc142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe2034ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc0cd2c0 con 0x7fe1fc0735a0 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe2034ed640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe1fc0cd140 con 0x7fe1fc070690 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe2034ed640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe1fc0cd440 con 0x7fe1fc15aa70 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe200a88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc0735a0 0x7fe1fc140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe200a88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc0735a0 0x7fe1fc140530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56402/0 (socket says 172.21.15.81:56402) 2024-09-17T05:20:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe200a88640 1 -- 172.21.15.81:0/412077827 learned_addr learned my addr 172.21.15.81:0/412077827 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe201289640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1fc070690 0x7fe1fc13fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.681+0000 7fe201a8a640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1fc15aa70 0x7fe1fc142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe200a88640 1 -- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1fc15aa70 msgr2=0x7fe1fc142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe200a88640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1fc15aa70 0x7fe1fc142f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe200a88640 1 -- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1fc070690 msgr2=0x7fe1fc13fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe200a88640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1fc070690 0x7fe1fc13fff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe200a88640 1 -- 172.21.15.81:0/412077827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1fc1e6860 con 0x7fe1fc0735a0 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe201a8a640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1fc15aa70 0x7fe1fc142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe200a88640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc0735a0 0x7fe1fc140530 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c440 tx=0x7fe1f000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe1f9ffb640 1 -- 172.21.15.81:0/412077827 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0017070 con 0x7fe1fc0735a0 2024-09-17T05:20:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe1f9ffb640 1 -- 172.21.15.81:0/412077827 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe1f00035f0 con 0x7fe1fc0735a0 2024-09-17T05:20:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1fc0c4a80 con 0x7fe1fc0735a0 2024-09-17T05:20:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe1f9ffb640 1 -- 172.21.15.81:0/412077827 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1f0003a40 con 0x7fe1fc0735a0 2024-09-17T05:20:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.682+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1fc0c5040 con 0x7fe1fc0735a0 2024-09-17T05:20:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.683+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1fc0cd950 con 0x7fe1fc0735a0 2024-09-17T05:20:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.684+0000 7fe1f9ffb640 1 -- 172.21.15.81:0/412077827 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fe1f001a070 con 0x7fe1fc0735a0 2024-09-17T05:20:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.684+0000 7fe1f9ffb640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe1e8078d40 0x7fe1e807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.685+0000 7fe1f9ffb640 1 -- 172.21.15.81:0/412077827 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe1f009a330 con 0x7fe1fc0735a0 2024-09-17T05:20:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.685+0000 7fe201289640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe1e8078d40 0x7fe1e807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.685+0000 7fe201289640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe1e8078d40 0x7fe1e807b200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00b450 tx=0x7fe1ec00d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:02.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.689+0000 7fe1f9ffb640 1 -- 172.21.15.81:0/412077827 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe1f0061e20 con 0x7fe1fc0735a0 2024-09-17T05:20:02.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.900+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1fc073cf0 con 0x7fe1fc0735a0 2024-09-17T05:20:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.901+0000 7fe1f9ffb640 1 -- 172.21.15.81:0/412077827 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5223 (secure 0 0 0) 0x7fe1f0066850 con 0x7fe1fc0735a0 2024-09-17T05:20:02.901 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:02.901 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-17T05:20:02:554678+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:02.901 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-17T05:20:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe1e8078d40 msgr2=0x7fe1e807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe1e8078d40 0x7fe1e807b200 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec00b450 tx=0x7fe1ec00d040 comp rx=0 tx=0).stop 2024-09-17T05:20:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc0735a0 msgr2=0x7fe1fc140530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc0735a0 0x7fe1fc140530 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fe1f000c440 tx=0x7fe1f000c900 comp rx=0 tx=0).stop 2024-09-17T05:20:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 shutdown_connections 2024-09-17T05:20:02.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe1e8078d40 0x7fe1e807b200 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1fc15aa70 0x7fe1fc142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1fc0735a0 0x7fe1fc140530 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 --2- 172.21.15.81:0/412077827 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1fc070690 0x7fe1fc13fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 >> 172.21.15.81:0/412077827 conn(0x7fe1fc0b1690 msgr2=0x7fe1fc0cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 shutdown_connections 2024-09-17T05:20:02.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:02.903+0000 7fe2034ed640 1 -- 172.21.15.81:0/412077827 wait complete. 2024-09-17T05:20:02.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:20:03.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.015+0000 7f8cb9470640 1 -- 172.21.15.81:0/262345498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca0004080 msgr2=0x7f8ca0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.015+0000 7f8cb9470640 1 --2- 172.21.15.81:0/262345498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ca0004080 0x7f8ca0004800 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00bb20 tx=0x7f8ca0005830 comp rx=0 tx=0).stop 2024-09-17T05:20:03.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.015+0000 7f8cb37fe640 1 -- 172.21.15.81:0/262345498 reap_dead start 2024-09-17T05:20:03.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.015+0000 7f8cb9470640 1 -- 172.21.15.81:0/262345498 shutdown_connections 2024-09-17T05:20:03.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.015+0000 7f8cb9470640 1 -- 172.21.15.81:0/262345498 >> 172.21.15.81:0/262345498 conn(0x7f8cb40d3ea0 msgr2=0x7f8cb40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:03.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.015+0000 7f8cb9470640 1 -- 172.21.15.81:0/262345498 shutdown_connections 2024-09-17T05:20:03.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.015+0000 7f8cb9470640 1 -- 172.21.15.81:0/262345498 wait complete. 2024-09-17T05:20:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.016+0000 7f8cb9470640 1 Processor -- start 2024-09-17T05:20:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.016+0000 7f8cb9470640 1 -- start start 2024-09-17T05:20:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb9470640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ca0004080 0x7f8cb40cdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb9470640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb40cd280 0x7f8cb40b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb9470640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8cb40cb090 0x7f8cb40cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb9470640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb4162690 con 0x7f8cb40cd280 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb9470640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8cb40b3800 con 0x7f8ca0004080 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb9470640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8cb40cba60 con 0x7f8cb40cb090 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb40cd280 0x7f8cb40b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb40cd280 0x7f8cb40b7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56432/0 (socket says 172.21.15.81:56432) 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb27fc640 1 -- 172.21.15.81:0/3837770453 learned_addr learned my addr 172.21.15.81:0/3837770453 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.017+0000 7f8cb2ffd640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ca0004080 0x7f8cb40cdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb37fe640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8cb40cb090 0x7f8cb40cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb27fc640 1 -- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8cb40cb090 msgr2=0x7f8cb40cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb27fc640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8cb40cb090 0x7f8cb40cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb27fc640 1 -- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ca0004080 msgr2=0x7f8cb40cdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb27fc640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ca0004080 0x7f8cb40cdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb27fc640 1 -- 172.21.15.81:0/3837770453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cb40b8670 con 0x7f8cb40cd280 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb37fe640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8cb40cb090 0x7f8cb40cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb2ffd640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ca0004080 0x7f8cb40cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb27fc640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb40cd280 0x7f8cb40b7d20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00bb20 tx=0x7f8c9c00b770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cab7fe640 1 -- 172.21.15.81:0/3837770453 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c040070 con 0x7f8cb40cd280 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cab7fe640 1 -- 172.21.15.81:0/3837770453 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c9c03a920 con 0x7f8cb40cd280 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cb40b8950 con 0x7f8cb40cd280 2024-09-17T05:20:03.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cab7fe640 1 -- 172.21.15.81:0/3837770453 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c035040 con 0x7f8cb40cd280 2024-09-17T05:20:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.018+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cb40b8f10 con 0x7f8cb40cd280 2024-09-17T05:20:03.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.019+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8cb40cf9b0 con 0x7f8cb40cd280 2024-09-17T05:20:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.020+0000 7f8cab7fe640 1 -- 172.21.15.81:0/3837770453 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f8c9c038020 con 0x7f8cb40cd280 2024-09-17T05:20:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.020+0000 7f8cab7fe640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c94078d40 0x7f8c9407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.020+0000 7f8cab7fe640 1 -- 172.21.15.81:0/3837770453 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8c9c0bbe70 con 0x7f8cb40cd280 2024-09-17T05:20:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.020+0000 7f8cb2ffd640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c94078d40 0x7f8c9407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.021+0000 7f8cb2ffd640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c94078d40 0x7f8c9407b200 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8cb41f80f0 tx=0x7f8cac001190 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:03.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.024+0000 7f8cab7fe640 1 -- 172.21.15.81:0/3837770453 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8c9c083f20 con 0x7f8cb40cd280 2024-09-17T05:20:03.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.201+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8cb408d590 con 0x7f8cb40cd280 2024-09-17T05:20:03.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.202+0000 7f8cab7fe640 1 -- 172.21.15.81:0/3837770453 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v45) ==== 74+0+16673 (secure 0 0 0) 0x7f8c9c083820 con 0x7f8cb40cd280 2024-09-17T05:20:03.203 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:03.203 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":45,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:20:01.526540+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:58.505536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:58.850270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:20:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c94078d40 msgr2=0x7f8c9407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c94078d40 0x7f8c9407b200 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f8cb41f80f0 tx=0x7f8cac001190 comp rx=0 tx=0).stop 2024-09-17T05:20:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb40cd280 msgr2=0x7f8cb40b7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb40cd280 0x7f8cb40b7d20 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c00bb20 tx=0x7f8c9c00b770 comp rx=0 tx=0).stop 2024-09-17T05:20:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 shutdown_connections 2024-09-17T05:20:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c94078d40 0x7f8c9407b200 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8cb40cb090 0x7f8cb40cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8cb40cd280 0x7f8cb40b7d20 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 --2- 172.21.15.81:0/3837770453 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ca0004080 0x7f8cb40cdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 >> 172.21.15.81:0/3837770453 conn(0x7f8cb40d3ea0 msgr2=0x7f8cb40b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 shutdown_connections 2024-09-17T05:20:03.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.205+0000 7f8cb9470640 1 -- 172.21.15.81:0/3837770453 wait complete. 2024-09-17T05:20:03.216 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:20:03.216 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:20:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.318+0000 7f639e665640 1 -- 172.21.15.81:0/3258221133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980ced40 msgr2=0x7f63980cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.318+0000 7f639e665640 1 --2- 172.21.15.81:0/3258221133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980ced40 0x7f63980cd1f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f6390005fd0 tx=0x7f639002a820 comp rx=0 tx=0).stop 2024-09-17T05:20:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.318+0000 7f639e665640 1 -- 172.21.15.81:0/3258221133 shutdown_connections 2024-09-17T05:20:03.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.318+0000 7f639e665640 1 --2- 172.21.15.81:0/3258221133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980ced40 0x7f63980cd1f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.318+0000 7f639e665640 1 -- 172.21.15.81:0/3258221133 >> 172.21.15.81:0/3258221133 conn(0x7f63980d1c40 msgr2=0x7f63980d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:03.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.318+0000 7f639e665640 1 -- 172.21.15.81:0/3258221133 shutdown_connections 2024-09-17T05:20:03.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.318+0000 7f639e665640 1 -- 172.21.15.81:0/3258221133 wait complete. 2024-09-17T05:20:03.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.319+0000 7f639e665640 1 Processor -- start 2024-09-17T05:20:03.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639e665640 1 -- start start 2024-09-17T05:20:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639e665640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63980ced40 0x7f63981f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639e665640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980d2760 0x7f6398152ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639e665640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f639815bd30 0x7f63980cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639e665640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63980cf590 con 0x7f63980d2760 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639e665640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f63980cf410 con 0x7f63980ced40 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639e665640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f63980cd730 con 0x7f639815bd30 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f63977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980d2760 0x7f6398152ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f63977fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980d2760 0x7f6398152ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38642/0 (socket says 172.21.15.81:38642) 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f63977fe640 1 -- 172.21.15.81:0/4066144444 learned_addr learned my addr 172.21.15.81:0/4066144444 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f639cc02640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f639815bd30 0x7f63980cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.320+0000 7f6397fff640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63980ced40 0x7f63981f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f63977fe640 1 -- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f639815bd30 msgr2=0x7f63980cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f63977fe640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f639815bd30 0x7f63980cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f63977fe640 1 -- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63980ced40 msgr2=0x7f63981f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f63977fe640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63980ced40 0x7f63981f3500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f63977fe640 1 -- 172.21.15.81:0/4066144444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63981f2a40 con 0x7f63980d2760 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f6397fff640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63980ced40 0x7f63981f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f63977fe640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980d2760 0x7f6398152ca0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c460 tx=0x7f638c00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f6394ff9640 1 -- 172.21.15.81:0/4066144444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c016020 con 0x7f63980d2760 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f6394ff9640 1 -- 172.21.15.81:0/4066144444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f638c012960 con 0x7f63980d2760 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f6394ff9640 1 -- 172.21.15.81:0/4066144444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f638c012db0 con 0x7f63980d2760 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63980c7210 con 0x7f63980d2760 2024-09-17T05:20:03.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.321+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63981f2d00 con 0x7f63980d2760 2024-09-17T05:20:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.322+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63980cdb80 con 0x7f63980d2760 2024-09-17T05:20:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.323+0000 7f6394ff9640 1 -- 172.21.15.81:0/4066144444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f638c019020 con 0x7f63980d2760 2024-09-17T05:20:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.323+0000 7f6394ff9640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6384078d40 0x7f638407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.323+0000 7f6394ff9640 1 -- 172.21.15.81:0/4066144444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f638c09aab0 con 0x7f63980d2760 2024-09-17T05:20:03.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.324+0000 7f6397fff640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6384078d40 0x7f638407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.325+0000 7f6397fff640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6384078d40 0x7f638407b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6388007a50 tx=0x7f6388009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:03.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.327+0000 7f6394ff9640 1 -- 172.21.15.81:0/4066144444 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f638c020070 con 0x7f63980d2760 2024-09-17T05:20:03.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.501+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f63980cf1f0 con 0x7f6384078d40 2024-09-17T05:20:03.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.507+0000 7f6394ff9640 1 -- 172.21.15.81:0/4066144444 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249291 (secure 0 0 0) 0x7f63980cf1f0 con 0x7f6384078d40 2024-09-17T05:20:03.509 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:03.511 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:20:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6384078d40 msgr2=0x7f638407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6384078d40 0x7f638407b200 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f6388007a50 tx=0x7f6388009040 comp rx=0 tx=0).stop 2024-09-17T05:20:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980d2760 msgr2=0x7f6398152ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980d2760 0x7f6398152ca0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f638c00c460 tx=0x7f638c00c920 comp rx=0 tx=0).stop 2024-09-17T05:20:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 shutdown_connections 2024-09-17T05:20:03.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6384078d40 0x7f638407b200 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f639815bd30 0x7f63980cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63980d2760 0x7f6398152ca0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 --2- 172.21.15.81:0/4066144444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63980ced40 0x7f63981f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 >> 172.21.15.81:0/4066144444 conn(0x7f63980d1c40 msgr2=0x7f63980af5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 shutdown_connections 2024-09-17T05:20:03.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.510+0000 7f639e665640 1 -- 172.21.15.81:0/4066144444 wait complete. 2024-09-17T05:20:03.521 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-17T05:20:03.391110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225552,"kb_used_data":5124,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749168,"statfs":{"total":773094113280,"available":772863148032,"internally_reserved":0,"allocated":5246976,"data_stored":2768806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.851058"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549824+0000","last_change":"2024-09-17T05:20:00.547326+0000","last_active":"2024-09-17T05:20:00.549824+0000","last_peered":"2024-09-17T05:20:00.549824+0000","last_clean":"2024-09-17T05:20:00.549824+0000","last_became_active":"2024-09-17T05:20:00.547030+0000","last_became_peered":"2024-09-17T05:20:00.547030+0000","last_unstale":"2024-09-17T05:20:00.549824+0000","last_undegraded":"2024-09-17T05:20:00.549824+0000","last_fullsized":"2024-09-17T05:20:00.549824+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:58.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548075+0000","last_change":"2024-09-17T05:20:00.546476+0000","last_active":"2024-09-17T05:20:00.548075+0000","last_peered":"2024-09-17T05:20:00.548075+0000","last_clean":"2024-09-17T05:20:00.548075+0000","last_became_active":"2024-09-17T05:20:00.544353+0000","last_became_peered":"2024-09-17T05:20:00.544353+0000","last_unstale":"2024-09-17T05:20:00.548075+0000","last_undegraded":"2024-09-17T05:20:00.548075+0000","last_fullsized":"2024-09-17T05:20:00.548075+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:37.491888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535274+0000","last_change":"2024-09-17T05:20:00.533096+0000","last_active":"2024-09-17T05:20:00.535274+0000","last_peered":"2024-09-17T05:20:00.535274+0000","last_clean":"2024-09-17T05:20:00.535274+0000","last_became_active":"2024-09-17T05:20:00.532800+0000","last_became_peered":"2024-09-17T05:20:00.532800+0000","last_unstale":"2024-09-17T05:20:00.535274+0000","last_undegraded":"2024-09-17T05:20:00.535274+0000","last_fullsized":"2024-09-17T05:20:00.535274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:19.671543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546535+0000","last_change":"2024-09-17T05:20:00.543656+0000","last_active":"2024-09-17T05:20:00.546535+0000","last_peered":"2024-09-17T05:20:00.546535+0000","last_clean":"2024-09-17T05:20:00.546535+0000","last_became_active":"2024-09-17T05:20:00.543350+0000","last_became_peered":"2024-09-17T05:20:00.543350+0000","last_unstale":"2024-09-17T05:20:00.546535+0000","last_undegraded":"2024-09-17T05:20:00.546535+0000","last_fullsized":"2024-09-17T05:20:00.546535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:29.786887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552498+0000","last_change":"2024-09-17T05:20:00.548503+0000","last_active":"2024-09-17T05:20:00.552498+0000","last_peered":"2024-09-17T05:20:00.552498+0000","last_clean":"2024-09-17T05:20:00.552498+0000","last_became_active":"2024-09-17T05:20:00.547870+0000","last_became_peered":"2024-09-17T05:20:00.547870+0000","last_unstale":"2024-09-17T05:20:00.552498+0000","last_undegraded":"2024-09-17T05:20:00.552498+0000","last_fullsized":"2024-09-17T05:20:00.552498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:11.743975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551943+0000","last_change":"2024-09-17T05:20:00.548256+0000","last_active":"2024-09-17T05:20:00.551943+0000","last_peered":"2024-09-17T05:20:00.551943+0000","last_clean":"2024-09-17T05:20:00.551943+0000","last_became_active":"2024-09-17T05:20:00.547935+0000","last_became_peered":"2024-09-17T05:20:00.547935+0000","last_unstale":"2024-09-17T05:20:00.551943+0000","last_undegraded":"2024-09-17T05:20:00.551943+0000","last_fullsized":"2024-09-17T05:20:00.551943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:16.729139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542947+0000","last_change":"2024-09-17T05:20:00.541383+0000","last_active":"2024-09-17T05:20:00.542947+0000","last_peered":"2024-09-17T05:20:00.542947+0000","last_clean":"2024-09-17T05:20:00.542947+0000","last_became_active":"2024-09-17T05:20:00.540989+0000","last_became_peered":"2024-09-17T05:20:00.540989+0000","last_unstale":"2024-09-17T05:20:00.542947+0000","last_undegraded":"2024-09-17T05:20:00.542947+0000","last_fullsized":"2024-09-17T05:20:00.542947+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:01.911225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546696+0000","last_change":"2024-09-17T05:20:00.539569+0000","last_active":"2024-09-17T05:20:00.546696+0000","last_peered":"2024-09-17T05:20:00.546696+0000","last_clean":"2024-09-17T05:20:00.546696+0000","last_became_active":"2024-09-17T05:20:00.539334+0000","last_became_peered":"2024-09-17T05:20:00.539334+0000","last_unstale":"2024-09-17T05:20:00.546696+0000","last_undegraded":"2024-09-17T05:20:00.546696+0000","last_fullsized":"2024-09-17T05:20:00.546696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:54.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540962+0000","last_change":"2024-09-17T05:20:00.538481+0000","last_active":"2024-09-17T05:20:00.540962+0000","last_peered":"2024-09-17T05:20:00.540962+0000","last_clean":"2024-09-17T05:20:00.540962+0000","last_became_active":"2024-09-17T05:20:00.538224+0000","last_became_peered":"2024-09-17T05:20:00.538224+0000","last_unstale":"2024-09-17T05:20:00.540962+0000","last_undegraded":"2024-09-17T05:20:00.540962+0000","last_fullsized":"2024-09-17T05:20:00.540962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:58.772520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548997+0000","last_change":"2024-09-17T05:20:00.545333+0000","last_active":"2024-09-17T05:20:00.548997+0000","last_peered":"2024-09-17T05:20:00.548997+0000","last_clean":"2024-09-17T05:20:00.548997+0000","last_became_active":"2024-09-17T05:20:00.545083+0000","last_became_peered":"2024-09-17T05:20:00.545083+0000","last_unstale":"2024-09-17T05:20:00.548997+0000","last_undegraded":"2024-09-17T05:20:00.548997+0000","last_fullsized":"2024-09-17T05:20:00.548997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:35.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539931+0000","last_change":"2024-09-17T05:20:00.538315+0000","last_active":"2024-09-17T05:20:00.539931+0000","last_peered":"2024-09-17T05:20:00.539931+0000","last_clean":"2024-09-17T05:20:00.539931+0000","last_became_active":"2024-09-17T05:20:00.537973+0000","last_became_peered":"2024-09-17T05:20:00.537973+0000","last_unstale":"2024-09-17T05:20:00.539931+0000","last_undegraded":"2024-09-17T05:20:00.539931+0000","last_fullsized":"2024-09-17T05:20:00.539931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545590+0000","last_change":"2024-09-17T05:20:00.541799+0000","last_active":"2024-09-17T05:20:00.545590+0000","last_peered":"2024-09-17T05:20:00.545590+0000","last_clean":"2024-09-17T05:20:00.545590+0000","last_became_active":"2024-09-17T05:20:00.541529+0000","last_became_peered":"2024-09-17T05:20:00.541529+0000","last_unstale":"2024-09-17T05:20:00.545590+0000","last_undegraded":"2024-09-17T05:20:00.545590+0000","last_fullsized":"2024-09-17T05:20:00.545590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:03.967733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544389+0000","last_change":"2024-09-17T05:20:00.542069+0000","last_active":"2024-09-17T05:20:00.544389+0000","last_peered":"2024-09-17T05:20:00.544389+0000","last_clean":"2024-09-17T05:20:00.544389+0000","last_became_active":"2024-09-17T05:20:00.541760+0000","last_became_peered":"2024-09-17T05:20:00.541760+0000","last_unstale":"2024-09-17T05:20:00.544389+0000","last_undegraded":"2024-09-17T05:20:00.544389+0000","last_fullsized":"2024-09-17T05:20:00.544389+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:00.588738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547432+0000","last_change":"2024-09-17T05:20:00.543451+0000","last_active":"2024-09-17T05:20:00.547432+0000","last_peered":"2024-09-17T05:20:00.547432+0000","last_clean":"2024-09-17T05:20:00.547432+0000","last_became_active":"2024-09-17T05:20:00.542502+0000","last_became_peered":"2024-09-17T05:20:00.542502+0000","last_unstale":"2024-09-17T05:20:00.547432+0000","last_undegraded":"2024-09-17T05:20:00.547432+0000","last_fullsized":"2024-09-17T05:20:00.547432+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:36.840738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543766+0000","last_change":"2024-09-17T05:20:00.540658+0000","last_active":"2024-09-17T05:20:00.543766+0000","last_peered":"2024-09-17T05:20:00.543766+0000","last_clean":"2024-09-17T05:20:00.543766+0000","last_became_active":"2024-09-17T05:20:00.540374+0000","last_became_peered":"2024-09-17T05:20:00.540374+0000","last_unstale":"2024-09-17T05:20:00.543766+0000","last_undegraded":"2024-09-17T05:20:00.543766+0000","last_fullsized":"2024-09-17T05:20:00.543766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549769+0000","last_change":"2024-09-17T05:20:00.547853+0000","last_active":"2024-09-17T05:20:00.549769+0000","last_peered":"2024-09-17T05:20:00.549769+0000","last_clean":"2024-09-17T05:20:00.549769+0000","last_became_active":"2024-09-17T05:20:00.547005+0000","last_became_peered":"2024-09-17T05:20:00.547005+0000","last_unstale":"2024-09-17T05:20:00.549769+0000","last_undegraded":"2024-09-17T05:20:00.549769+0000","last_fullsized":"2024-09-17T05:20:00.549769+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:51.663396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549807+0000","last_change":"2024-09-17T05:20:00.547374+0000","last_active":"2024-09-17T05:20:00.549807+0000","last_peered":"2024-09-17T05:20:00.549807+0000","last_clean":"2024-09-17T05:20:00.549807+0000","last_became_active":"2024-09-17T05:20:00.547086+0000","last_became_peered":"2024-09-17T05:20:00.547086+0000","last_unstale":"2024-09-17T05:20:00.549807+0000","last_undegraded":"2024-09-17T05:20:00.549807+0000","last_fullsized":"2024-09-17T05:20:00.549807+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546316+0000","last_change":"2024-09-17T05:20:00.542690+0000","last_active":"2024-09-17T05:20:00.546316+0000","last_peered":"2024-09-17T05:20:00.546316+0000","last_clean":"2024-09-17T05:20:00.546316+0000","last_became_active":"2024-09-17T05:20:00.542349+0000","last_became_peered":"2024-09-17T05:20:00.542349+0000","last_unstale":"2024-09-17T05:20:00.546316+0000","last_undegraded":"2024-09-17T05:20:00.546316+0000","last_fullsized":"2024-09-17T05:20:00.546316+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:52.854277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546642+0000","last_change":"2024-09-17T05:20:00.539389+0000","last_active":"2024-09-17T05:20:00.546642+0000","last_peered":"2024-09-17T05:20:00.546642+0000","last_clean":"2024-09-17T05:20:00.546642+0000","last_became_active":"2024-09-17T05:20:00.539098+0000","last_became_peered":"2024-09-17T05:20:00.539098+0000","last_unstale":"2024-09-17T05:20:00.546642+0000","last_undegraded":"2024-09-17T05:20:00.546642+0000","last_fullsized":"2024-09-17T05:20:00.546642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:40.028949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545763+0000","last_change":"2024-09-17T05:20:00.543003+0000","last_active":"2024-09-17T05:20:00.545763+0000","last_peered":"2024-09-17T05:20:00.545763+0000","last_clean":"2024-09-17T05:20:00.545763+0000","last_became_active":"2024-09-17T05:20:00.542562+0000","last_became_peered":"2024-09-17T05:20:00.542562+0000","last_unstale":"2024-09-17T05:20:00.545763+0000","last_undegraded":"2024-09-17T05:20:00.545763+0000","last_fullsized":"2024-09-17T05:20:00.545763+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:33.584816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542766+0000","last_change":"2024-09-17T05:20:00.540456+0000","last_active":"2024-09-17T05:20:00.542766+0000","last_peered":"2024-09-17T05:20:00.542766+0000","last_clean":"2024-09-17T05:20:00.542766+0000","last_became_active":"2024-09-17T05:20:00.540089+0000","last_became_peered":"2024-09-17T05:20:00.540089+0000","last_unstale":"2024-09-17T05:20:00.542766+0000","last_undegraded":"2024-09-17T05:20:00.542766+0000","last_fullsized":"2024-09-17T05:20:00.542766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:56.542144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543457+0000","last_change":"2024-09-17T05:20:00.542080+0000","last_active":"2024-09-17T05:20:00.543457+0000","last_peered":"2024-09-17T05:20:00.543457+0000","last_clean":"2024-09-17T05:20:00.543457+0000","last_became_active":"2024-09-17T05:20:00.541796+0000","last_became_peered":"2024-09-17T05:20:00.541796+0000","last_unstale":"2024-09-17T05:20:00.543457+0000","last_undegraded":"2024-09-17T05:20:00.543457+0000","last_fullsized":"2024-09-17T05:20:00.543457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:55.283438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550421+0000","last_change":"2024-09-17T05:20:00.549564+0000","last_active":"2024-09-17T05:20:00.550421+0000","last_peered":"2024-09-17T05:20:00.550421+0000","last_clean":"2024-09-17T05:20:00.550421+0000","last_became_active":"2024-09-17T05:20:00.549300+0000","last_became_peered":"2024-09-17T05:20:00.549300+0000","last_unstale":"2024-09-17T05:20:00.550421+0000","last_undegraded":"2024-09-17T05:20:00.550421+0000","last_fullsized":"2024-09-17T05:20:00.550421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.293708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550099+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550099+0000","last_peered":"2024-09-17T05:20:00.550099+0000","last_clean":"2024-09-17T05:20:00.550099+0000","last_became_active":"2024-09-17T05:20:00.544913+0000","last_became_peered":"2024-09-17T05:20:00.544913+0000","last_unstale":"2024-09-17T05:20:00.550099+0000","last_undegraded":"2024-09-17T05:20:00.550099+0000","last_fullsized":"2024-09-17T05:20:00.550099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:15.118672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550008+0000","last_change":"2024-09-17T05:20:00.548447+0000","last_active":"2024-09-17T05:20:00.550008+0000","last_peered":"2024-09-17T05:20:00.550008+0000","last_clean":"2024-09-17T05:20:00.550008+0000","last_became_active":"2024-09-17T05:20:00.548097+0000","last_became_peered":"2024-09-17T05:20:00.548097+0000","last_unstale":"2024-09-17T05:20:00.550008+0000","last_undegraded":"2024-09-17T05:20:00.550008+0000","last_fullsized":"2024-09-17T05:20:00.550008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:00.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552550+0000","last_change":"2024-09-17T05:20:00.547293+0000","last_active":"2024-09-17T05:20:00.552550+0000","last_peered":"2024-09-17T05:20:00.552550+0000","last_clean":"2024-09-17T05:20:00.552550+0000","last_became_active":"2024-09-17T05:20:00.547026+0000","last_became_peered":"2024-09-17T05:20:00.547026+0000","last_unstale":"2024-09-17T05:20:00.552550+0000","last_undegraded":"2024-09-17T05:20:00.552550+0000","last_fullsized":"2024-09-17T05:20:00.552550+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561768+0000","last_change":"2024-09-17T05:19:59.558973+0000","last_active":"2024-09-17T05:20:00.561768+0000","last_peered":"2024-09-17T05:20:00.561768+0000","last_clean":"2024-09-17T05:20:00.561768+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.561768+0000","last_undegraded":"2024-09-17T05:20:00.561768+0000","last_fullsized":"2024-09-17T05:20:00.561768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:00.930635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542569+0000","last_change":"2024-09-17T05:20:00.538883+0000","last_active":"2024-09-17T05:20:00.542569+0000","last_peered":"2024-09-17T05:20:00.542569+0000","last_clean":"2024-09-17T05:20:00.542569+0000","last_became_active":"2024-09-17T05:20:00.538502+0000","last_became_peered":"2024-09-17T05:20:00.538502+0000","last_unstale":"2024-09-17T05:20:00.542569+0000","last_undegraded":"2024-09-17T05:20:00.542569+0000","last_fullsized":"2024-09-17T05:20:00.542569+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:25.828995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559950+0000","last_change":"2024-09-17T05:19:59.559007+0000","last_active":"2024-09-17T05:20:00.559950+0000","last_peered":"2024-09-17T05:20:00.559950+0000","last_clean":"2024-09-17T05:20:00.559950+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.559950+0000","last_undegraded":"2024-09-17T05:20:00.559950+0000","last_fullsized":"2024-09-17T05:20:00.559950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548169+0000","last_change":"2024-09-17T05:20:00.545138+0000","last_active":"2024-09-17T05:20:00.548169+0000","last_peered":"2024-09-17T05:20:00.548169+0000","last_clean":"2024-09-17T05:20:00.548169+0000","last_became_active":"2024-09-17T05:20:00.544865+0000","last_became_peered":"2024-09-17T05:20:00.544865+0000","last_unstale":"2024-09-17T05:20:00.548169+0000","last_undegraded":"2024-09-17T05:20:00.548169+0000","last_fullsized":"2024-09-17T05:20:00.548169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:24.925391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560906+0000","last_change":"2024-09-17T05:19:59.563623+0000","last_active":"2024-09-17T05:20:00.560906+0000","last_peered":"2024-09-17T05:20:00.560906+0000","last_clean":"2024-09-17T05:20:00.560906+0000","last_became_active":"2024-09-17T05:19:59.563315+0000","last_became_peered":"2024-09-17T05:19:59.563315+0000","last_unstale":"2024-09-17T05:20:00.560906+0000","last_undegraded":"2024-09-17T05:20:00.560906+0000","last_fullsized":"2024-09-17T05:20:00.560906+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:18.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551313+0000","last_change":"2024-09-17T05:20:00.544721+0000","last_active":"2024-09-17T05:20:00.551313+0000","last_peered":"2024-09-17T05:20:00.551313+0000","last_clean":"2024-09-17T05:20:00.551313+0000","last_became_active":"2024-09-17T05:20:00.544443+0000","last_became_peered":"2024-09-17T05:20:00.544443+0000","last_unstale":"2024-09-17T05:20:00.551313+0000","last_undegraded":"2024-09-17T05:20:00.551313+0000","last_fullsized":"2024-09-17T05:20:00.551313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560899+0000","last_change":"2024-09-17T05:19:59.564861+0000","last_active":"2024-09-17T05:20:00.560899+0000","last_peered":"2024-09-17T05:20:00.560899+0000","last_clean":"2024-09-17T05:20:00.560899+0000","last_became_active":"2024-09-17T05:19:59.564565+0000","last_became_peered":"2024-09-17T05:19:59.564565+0000","last_unstale":"2024-09-17T05:20:00.560899+0000","last_undegraded":"2024-09-17T05:20:00.560899+0000","last_fullsized":"2024-09-17T05:20:00.560899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549902+0000","last_change":"2024-09-17T05:20:00.539449+0000","last_active":"2024-09-17T05:20:00.549902+0000","last_peered":"2024-09-17T05:20:00.549902+0000","last_clean":"2024-09-17T05:20:00.549902+0000","last_became_active":"2024-09-17T05:20:00.539171+0000","last_became_peered":"2024-09-17T05:20:00.539171+0000","last_unstale":"2024-09-17T05:20:00.549902+0000","last_undegraded":"2024-09-17T05:20:00.549902+0000","last_fullsized":"2024-09-17T05:20:00.549902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:43.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561116+0000","last_change":"2024-09-17T05:19:59.562556+0000","last_active":"2024-09-17T05:20:00.561116+0000","last_peered":"2024-09-17T05:20:00.561116+0000","last_clean":"2024-09-17T05:20:00.561116+0000","last_became_active":"2024-09-17T05:19:59.562255+0000","last_became_peered":"2024-09-17T05:19:59.562255+0000","last_unstale":"2024-09-17T05:20:00.561116+0000","last_undegraded":"2024-09-17T05:20:00.561116+0000","last_fullsized":"2024-09-17T05:20:00.561116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:47.640069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.558324+0000","last_change":"2024-09-17T05:19:59.558825+0000","last_active":"2024-09-17T05:20:00.558324+0000","last_peered":"2024-09-17T05:20:00.558324+0000","last_clean":"2024-09-17T05:20:00.558324+0000","last_became_active":"2024-09-17T05:19:59.558529+0000","last_became_peered":"2024-09-17T05:19:59.558529+0000","last_unstale":"2024-09-17T05:20:00.558324+0000","last_undegraded":"2024-09-17T05:20:00.558324+0000","last_fullsized":"2024-09-17T05:20:00.558324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:42.182629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534516+0000","last_change":"2024-09-17T05:19:59.563788+0000","last_active":"2024-09-17T05:20:00.534516+0000","last_peered":"2024-09-17T05:20:00.534516+0000","last_clean":"2024-09-17T05:20:00.534516+0000","last_became_active":"2024-09-17T05:19:59.563534+0000","last_became_peered":"2024-09-17T05:19:59.563534+0000","last_unstale":"2024-09-17T05:20:00.534516+0000","last_undegraded":"2024-09-17T05:20:00.534516+0000","last_fullsized":"2024-09-17T05:20:00.534516+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.937150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549799+0000","last_change":"2024-09-17T05:20:00.548448+0000","last_active":"2024-09-17T05:20:00.549799+0000","last_peered":"2024-09-17T05:20:00.549799+0000","last_clean":"2024-09-17T05:20:00.549799+0000","last_became_active":"2024-09-17T05:20:00.547380+0000","last_became_peered":"2024-09-17T05:20:00.547380+0000","last_unstale":"2024-09-17T05:20:00.549799+0000","last_undegraded":"2024-09-17T05:20:00.549799+0000","last_fullsized":"2024-09-17T05:20:00.549799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:43.184923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545623+0000","last_change":"2024-09-17T05:20:00.542588+0000","last_active":"2024-09-17T05:20:00.545623+0000","last_peered":"2024-09-17T05:20:00.545623+0000","last_clean":"2024-09-17T05:20:00.545623+0000","last_became_active":"2024-09-17T05:20:00.542297+0000","last_became_peered":"2024-09-17T05:20:00.542297+0000","last_unstale":"2024-09-17T05:20:00.545623+0000","last_undegraded":"2024-09-17T05:20:00.545623+0000","last_fullsized":"2024-09-17T05:20:00.545623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:21.905648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530770+0000","last_change":"2024-09-17T05:19:59.558968+0000","last_active":"2024-09-17T05:20:00.530770+0000","last_peered":"2024-09-17T05:20:00.530770+0000","last_clean":"2024-09-17T05:20:00.530770+0000","last_became_active":"2024-09-17T05:19:59.558447+0000","last_became_peered":"2024-09-17T05:19:59.558447+0000","last_unstale":"2024-09-17T05:20:00.530770+0000","last_undegraded":"2024-09-17T05:20:00.530770+0000","last_fullsized":"2024-09-17T05:20:00.530770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552010+0000","last_change":"2024-09-17T05:20:00.548751+0000","last_active":"2024-09-17T05:20:00.552010+0000","last_peered":"2024-09-17T05:20:00.552010+0000","last_clean":"2024-09-17T05:20:00.552010+0000","last_became_active":"2024-09-17T05:20:00.548410+0000","last_became_peered":"2024-09-17T05:20:00.548410+0000","last_unstale":"2024-09-17T05:20:00.552010+0000","last_undegraded":"2024-09-17T05:20:00.552010+0000","last_fullsized":"2024-09-17T05:20:00.552010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:48.642363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546853+0000","last_change":"2024-09-17T05:20:00.543079+0000","last_active":"2024-09-17T05:20:00.546853+0000","last_peered":"2024-09-17T05:20:00.546853+0000","last_clean":"2024-09-17T05:20:00.546853+0000","last_became_active":"2024-09-17T05:20:00.542816+0000","last_became_peered":"2024-09-17T05:20:00.542816+0000","last_unstale":"2024-09-17T05:20:00.546853+0000","last_undegraded":"2024-09-17T05:20:00.546853+0000","last_fullsized":"2024-09-17T05:20:00.546853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:02.274063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560749+0000","last_change":"2024-09-17T05:19:59.565867+0000","last_active":"2024-09-17T05:20:00.560749+0000","last_peered":"2024-09-17T05:20:00.560749+0000","last_clean":"2024-09-17T05:20:00.560749+0000","last_became_active":"2024-09-17T05:19:59.565572+0000","last_became_peered":"2024-09-17T05:19:59.565572+0000","last_unstale":"2024-09-17T05:20:00.560749+0000","last_undegraded":"2024-09-17T05:20:00.560749+0000","last_fullsized":"2024-09-17T05:20:00.560749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:30.724384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551879+0000","last_change":"2024-09-17T05:20:00.548336+0000","last_active":"2024-09-17T05:20:00.551879+0000","last_peered":"2024-09-17T05:20:00.551879+0000","last_clean":"2024-09-17T05:20:00.551879+0000","last_became_active":"2024-09-17T05:20:00.548016+0000","last_became_peered":"2024-09-17T05:20:00.548016+0000","last_unstale":"2024-09-17T05:20:00.551879+0000","last_undegraded":"2024-09-17T05:20:00.551879+0000","last_fullsized":"2024-09-17T05:20:00.551879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:01.932930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.562965+0000","last_change":"2024-09-17T05:19:59.559093+0000","last_active":"2024-09-17T05:20:00.562965+0000","last_peered":"2024-09-17T05:20:00.562965+0000","last_clean":"2024-09-17T05:20:00.562965+0000","last_became_active":"2024-09-17T05:19:59.558796+0000","last_became_peered":"2024-09-17T05:19:59.558796+0000","last_unstale":"2024-09-17T05:20:00.562965+0000","last_undegraded":"2024-09-17T05:20:00.562965+0000","last_fullsized":"2024-09-17T05:20:00.562965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:10.022680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543996+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.542577+0000","last_became_peered":"2024-09-17T05:20:00.542577+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:59.305586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560577+0000","last_change":"2024-09-17T05:19:59.559096+0000","last_active":"2024-09-17T05:20:00.560577+0000","last_peered":"2024-09-17T05:20:00.560577+0000","last_clean":"2024-09-17T05:20:00.560577+0000","last_became_active":"2024-09-17T05:19:59.558466+0000","last_became_peered":"2024-09-17T05:19:59.558466+0000","last_unstale":"2024-09-17T05:20:00.560577+0000","last_undegraded":"2024-09-17T05:20:00.560577+0000","last_fullsized":"2024-09-17T05:20:00.560577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:02.120617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539497+0000","last_change":"2024-09-17T05:19:59.563984+0000","last_active":"2024-09-17T05:20:00.539497+0000","last_peered":"2024-09-17T05:20:00.539497+0000","last_clean":"2024-09-17T05:20:00.539497+0000","last_became_active":"2024-09-17T05:19:59.563645+0000","last_became_peered":"2024-09-17T05:19:59.563645+0000","last_unstale":"2024-09-17T05:20:00.539497+0000","last_undegraded":"2024-09-17T05:20:00.539497+0000","last_fullsized":"2024-09-17T05:20:00.539497+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:32.582522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546729+0000","last_change":"2024-09-17T05:20:00.541286+0000","last_active":"2024-09-17T05:20:00.546729+0000","last_peered":"2024-09-17T05:20:00.546729+0000","last_clean":"2024-09-17T05:20:00.546729+0000","last_became_active":"2024-09-17T05:20:00.541020+0000","last_became_peered":"2024-09-17T05:20:00.541020+0000","last_unstale":"2024-09-17T05:20:00.546729+0000","last_undegraded":"2024-09-17T05:20:00.546729+0000","last_fullsized":"2024-09-17T05:20:00.546729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:17.537507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534738+0000","last_change":"2024-09-17T05:19:59.563576+0000","last_active":"2024-09-17T05:20:00.534738+0000","last_peered":"2024-09-17T05:20:00.534738+0000","last_clean":"2024-09-17T05:20:00.534738+0000","last_became_active":"2024-09-17T05:19:59.563297+0000","last_became_peered":"2024-09-17T05:19:59.563297+0000","last_unstale":"2024-09-17T05:20:00.534738+0000","last_undegraded":"2024-09-17T05:20:00.534738+0000","last_fullsized":"2024-09-17T05:20:00.534738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:16.800054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552885+0000","last_change":"2024-09-17T05:20:00.550850+0000","last_active":"2024-09-17T05:20:00.552885+0000","last_peered":"2024-09-17T05:20:00.552885+0000","last_clean":"2024-09-17T05:20:00.552885+0000","last_became_active":"2024-09-17T05:20:00.550558+0000","last_became_peered":"2024-09-17T05:20:00.550558+0000","last_unstale":"2024-09-17T05:20:00.552885+0000","last_undegraded":"2024-09-17T05:20:00.552885+0000","last_fullsized":"2024-09-17T05:20:00.552885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:55.244688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546737+0000","last_change":"2024-09-17T05:20:00.541991+0000","last_active":"2024-09-17T05:20:00.546737+0000","last_peered":"2024-09-17T05:20:00.546737+0000","last_clean":"2024-09-17T05:20:00.546737+0000","last_became_active":"2024-09-17T05:20:00.541748+0000","last_became_peered":"2024-09-17T05:20:00.541748+0000","last_unstale":"2024-09-17T05:20:00.546737+0000","last_undegraded":"2024-09-17T05:20:00.546737+0000","last_fullsized":"2024-09-17T05:20:00.546737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:17.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560320+0000","last_change":"2024-09-17T05:19:59.556315+0000","last_active":"2024-09-17T05:20:00.560320+0000","last_peered":"2024-09-17T05:20:00.560320+0000","last_clean":"2024-09-17T05:20:00.560320+0000","last_became_active":"2024-09-17T05:19:59.556024+0000","last_became_peered":"2024-09-17T05:19:59.556024+0000","last_unstale":"2024-09-17T05:20:00.560320+0000","last_undegraded":"2024-09-17T05:20:00.560320+0000","last_fullsized":"2024-09-17T05:20:00.560320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:16.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559848+0000","last_change":"2024-09-17T05:19:59.560582+0000","last_active":"2024-09-17T05:20:00.559848+0000","last_peered":"2024-09-17T05:20:00.559848+0000","last_clean":"2024-09-17T05:20:00.559848+0000","last_became_active":"2024-09-17T05:19:59.560282+0000","last_became_peered":"2024-09-17T05:19:59.560282+0000","last_unstale":"2024-09-17T05:20:00.559848+0000","last_undegraded":"2024-09-17T05:20:00.559848+0000","last_fullsized":"2024-09-17T05:20:00.559848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.203376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543830+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.543210+0000","last_became_peered":"2024-09-17T05:20:00.543210+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:55.720457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560488+0000","last_change":"2024-09-17T05:19:59.564268+0000","last_active":"2024-09-17T05:20:00.560488+0000","last_peered":"2024-09-17T05:20:00.560488+0000","last_clean":"2024-09-17T05:20:00.560488+0000","last_became_active":"2024-09-17T05:19:59.563909+0000","last_became_peered":"2024-09-17T05:19:59.563909+0000","last_unstale":"2024-09-17T05:20:00.560488+0000","last_undegraded":"2024-09-17T05:20:00.560488+0000","last_fullsized":"2024-09-17T05:20:00.560488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:56.717406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549012+0000","last_change":"2024-09-17T05:20:00.544504+0000","last_active":"2024-09-17T05:20:00.549012+0000","last_peered":"2024-09-17T05:20:00.549012+0000","last_clean":"2024-09-17T05:20:00.549012+0000","last_became_active":"2024-09-17T05:20:00.544123+0000","last_became_peered":"2024-09-17T05:20:00.544123+0000","last_unstale":"2024-09-17T05:20:00.549012+0000","last_undegraded":"2024-09-17T05:20:00.549012+0000","last_fullsized":"2024-09-17T05:20:00.549012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:36.647387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535470+0000","last_change":"2024-09-17T05:19:59.558812+0000","last_active":"2024-09-17T05:20:00.535470+0000","last_peered":"2024-09-17T05:20:00.535470+0000","last_clean":"2024-09-17T05:20:00.535470+0000","last_became_active":"2024-09-17T05:19:59.558524+0000","last_became_peered":"2024-09-17T05:19:59.558524+0000","last_unstale":"2024-09-17T05:20:00.535470+0000","last_undegraded":"2024-09-17T05:20:00.535470+0000","last_fullsized":"2024-09-17T05:20:00.535470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:59.938453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543730+0000","last_change":"2024-09-17T05:20:00.540236+0000","last_active":"2024-09-17T05:20:00.543730+0000","last_peered":"2024-09-17T05:20:00.543730+0000","last_clean":"2024-09-17T05:20:00.543730+0000","last_became_active":"2024-09-17T05:20:00.539968+0000","last_became_peered":"2024-09-17T05:20:00.539968+0000","last_unstale":"2024-09-17T05:20:00.543730+0000","last_undegraded":"2024-09-17T05:20:00.543730+0000","last_fullsized":"2024-09-17T05:20:00.543730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:49.650410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561737+0000","last_change":"2024-09-17T05:19:59.562482+0000","last_active":"2024-09-17T05:20:00.561737+0000","last_peered":"2024-09-17T05:20:00.561737+0000","last_clean":"2024-09-17T05:20:00.561737+0000","last_became_active":"2024-09-17T05:19:59.562197+0000","last_became_peered":"2024-09-17T05:19:59.562197+0000","last_unstale":"2024-09-17T05:20:00.561737+0000","last_undegraded":"2024-09-17T05:20:00.561737+0000","last_fullsized":"2024-09-17T05:20:00.561737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:54.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547002+0000","last_change":"2024-09-17T05:20:00.542587+0000","last_active":"2024-09-17T05:20:00.547002+0000","last_peered":"2024-09-17T05:20:00.547002+0000","last_clean":"2024-09-17T05:20:00.547002+0000","last_became_active":"2024-09-17T05:20:00.542114+0000","last_became_peered":"2024-09-17T05:20:00.542114+0000","last_unstale":"2024-09-17T05:20:00.547002+0000","last_undegraded":"2024-09-17T05:20:00.547002+0000","last_fullsized":"2024-09-17T05:20:00.547002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:52.205670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534742+0000","last_change":"2024-09-17T05:19:59.559159+0000","last_active":"2024-09-17T05:20:00.534742+0000","last_peered":"2024-09-17T05:20:00.534742+0000","last_clean":"2024-09-17T05:20:00.534742+0000","last_became_active":"2024-09-17T05:19:59.558919+0000","last_became_peered":"2024-09-17T05:19:59.558919+0000","last_unstale":"2024-09-17T05:20:00.534742+0000","last_undegraded":"2024-09-17T05:20:00.534742+0000","last_fullsized":"2024-09-17T05:20:00.534742+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.735582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549982+0000","last_change":"2024-09-17T05:20:00.547679+0000","last_active":"2024-09-17T05:20:00.549982+0000","last_peered":"2024-09-17T05:20:00.549982+0000","last_clean":"2024-09-17T05:20:00.549982+0000","last_became_active":"2024-09-17T05:20:00.547424+0000","last_became_peered":"2024-09-17T05:20:00.547424+0000","last_unstale":"2024-09-17T05:20:00.549982+0000","last_undegraded":"2024-09-17T05:20:00.549982+0000","last_fullsized":"2024-09-17T05:20:00.549982+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:43.113899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539592+0000","last_change":"2024-09-17T05:19:59.566679+0000","last_active":"2024-09-17T05:20:00.539592+0000","last_peered":"2024-09-17T05:20:00.539592+0000","last_clean":"2024-09-17T05:20:00.539592+0000","last_became_active":"2024-09-17T05:19:59.566350+0000","last_became_peered":"2024-09-17T05:19:59.566350+0000","last_unstale":"2024-09-17T05:20:00.539592+0000","last_undegraded":"2024-09-17T05:20:00.539592+0000","last_fullsized":"2024-09-17T05:20:00.539592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.291413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548877+0000","last_change":"2024-09-17T05:20:00.545489+0000","last_active":"2024-09-17T05:20:00.548877+0000","last_peered":"2024-09-17T05:20:00.548877+0000","last_clean":"2024-09-17T05:20:00.548877+0000","last_became_active":"2024-09-17T05:20:00.545052+0000","last_became_peered":"2024-09-17T05:20:00.545052+0000","last_unstale":"2024-09-17T05:20:00.548877+0000","last_undegraded":"2024-09-17T05:20:00.548877+0000","last_fullsized":"2024-09-17T05:20:00.548877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:23.670327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534933+0000","last_change":"2024-09-17T05:19:59.561764+0000","last_active":"2024-09-17T05:20:00.534933+0000","last_peered":"2024-09-17T05:20:00.534933+0000","last_clean":"2024-09-17T05:20:00.534933+0000","last_became_active":"2024-09-17T05:19:59.561368+0000","last_became_peered":"2024-09-17T05:19:59.561368+0000","last_unstale":"2024-09-17T05:20:00.534933+0000","last_undegraded":"2024-09-17T05:20:00.534933+0000","last_fullsized":"2024-09-17T05:20:00.534933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:27.664506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544127+0000","last_change":"2024-09-17T05:19:59.566316+0000","last_active":"2024-09-17T05:20:00.544127+0000","last_peered":"2024-09-17T05:20:00.544127+0000","last_clean":"2024-09-17T05:20:00.544127+0000","last_became_active":"2024-09-17T05:19:59.565973+0000","last_became_peered":"2024-09-17T05:19:59.565973+0000","last_unstale":"2024-09-17T05:20:00.544127+0000","last_undegraded":"2024-09-17T05:20:00.544127+0000","last_fullsized":"2024-09-17T05:20:00.544127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:30.046614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551973+0000","last_change":"2024-09-17T05:20:00.549077+0000","last_active":"2024-09-17T05:20:00.551973+0000","last_peered":"2024-09-17T05:20:00.551973+0000","last_clean":"2024-09-17T05:20:00.551973+0000","last_became_active":"2024-09-17T05:20:00.548735+0000","last_became_peered":"2024-09-17T05:20:00.548735+0000","last_unstale":"2024-09-17T05:20:00.551973+0000","last_undegraded":"2024-09-17T05:20:00.551973+0000","last_fullsized":"2024-09-17T05:20:00.551973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:03.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541878+0000","last_change":"2024-09-17T05:19:59.563528+0000","last_active":"2024-09-17T05:20:00.541878+0000","last_peered":"2024-09-17T05:20:00.541878+0000","last_clean":"2024-09-17T05:20:00.541878+0000","last_became_active":"2024-09-17T05:19:59.563264+0000","last_became_peered":"2024-09-17T05:19:59.563264+0000","last_unstale":"2024-09-17T05:20:00.541878+0000","last_undegraded":"2024-09-17T05:20:00.541878+0000","last_fullsized":"2024-09-17T05:20:00.541878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552526+0000","last_change":"2024-09-17T05:20:00.548525+0000","last_active":"2024-09-17T05:20:00.552526+0000","last_peered":"2024-09-17T05:20:00.552526+0000","last_clean":"2024-09-17T05:20:00.552526+0000","last_became_active":"2024-09-17T05:20:00.548220+0000","last_became_peered":"2024-09-17T05:20:00.548220+0000","last_unstale":"2024-09-17T05:20:00.552526+0000","last_undegraded":"2024-09-17T05:20:00.552526+0000","last_fullsized":"2024-09-17T05:20:00.552526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:59.514166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540949+0000","last_change":"2024-09-17T05:19:59.565271+0000","last_active":"2024-09-17T05:20:00.540949+0000","last_peered":"2024-09-17T05:20:00.540949+0000","last_clean":"2024-09-17T05:20:00.540949+0000","last_became_active":"2024-09-17T05:19:59.565009+0000","last_became_peered":"2024-09-17T05:19:59.565009+0000","last_unstale":"2024-09-17T05:20:00.540949+0000","last_undegraded":"2024-09-17T05:20:00.540949+0000","last_fullsized":"2024-09-17T05:20:00.540949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:45.135132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550082+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550082+0000","last_peered":"2024-09-17T05:20:00.550082+0000","last_clean":"2024-09-17T05:20:00.550082+0000","last_became_active":"2024-09-17T05:20:00.544930+0000","last_became_peered":"2024-09-17T05:20:00.544930+0000","last_unstale":"2024-09-17T05:20:00.550082+0000","last_undegraded":"2024-09-17T05:20:00.550082+0000","last_fullsized":"2024-09-17T05:20:00.550082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:50.027809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530552+0000","last_change":"2024-09-17T05:19:59.561592+0000","last_active":"2024-09-17T05:20:00.530552+0000","last_peered":"2024-09-17T05:20:00.530552+0000","last_clean":"2024-09-17T05:20:00.530552+0000","last_became_active":"2024-09-17T05:19:59.561328+0000","last_became_peered":"2024-09-17T05:19:59.561328+0000","last_unstale":"2024-09-17T05:20:00.530552+0000","last_undegraded":"2024-09-17T05:20:00.530552+0000","last_fullsized":"2024-09-17T05:20:00.530552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:27.670831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552195+0000","last_change":"2024-09-17T05:20:00.550589+0000","last_active":"2024-09-17T05:20:00.552195+0000","last_peered":"2024-09-17T05:20:00.552195+0000","last_clean":"2024-09-17T05:20:00.552195+0000","last_became_active":"2024-09-17T05:20:00.550353+0000","last_became_peered":"2024-09-17T05:20:00.550353+0000","last_unstale":"2024-09-17T05:20:00.552195+0000","last_undegraded":"2024-09-17T05:20:00.552195+0000","last_fullsized":"2024-09-17T05:20:00.552195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:10.302010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541854+0000","last_change":"2024-09-17T05:19:59.560425+0000","last_active":"2024-09-17T05:20:00.541854+0000","last_peered":"2024-09-17T05:20:00.541854+0000","last_clean":"2024-09-17T05:20:00.541854+0000","last_became_active":"2024-09-17T05:19:59.560173+0000","last_became_peered":"2024-09-17T05:19:59.560173+0000","last_unstale":"2024-09-17T05:20:00.541854+0000","last_undegraded":"2024-09-17T05:20:00.541854+0000","last_fullsized":"2024-09-17T05:20:00.541854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540317+0000","last_change":"2024-09-17T05:20:00.539142+0000","last_active":"2024-09-17T05:20:00.540317+0000","last_peered":"2024-09-17T05:20:00.540317+0000","last_clean":"2024-09-17T05:20:00.540317+0000","last_became_active":"2024-09-17T05:20:00.538724+0000","last_became_peered":"2024-09-17T05:20:00.538724+0000","last_unstale":"2024-09-17T05:20:00.540317+0000","last_undegraded":"2024-09-17T05:20:00.540317+0000","last_fullsized":"2024-09-17T05:20:00.540317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561450+0000","last_change":"2024-09-17T05:19:59.560442+0000","last_active":"2024-09-17T05:20:00.561450+0000","last_peered":"2024-09-17T05:20:00.561450+0000","last_clean":"2024-09-17T05:20:00.561450+0000","last_became_active":"2024-09-17T05:19:59.560155+0000","last_became_peered":"2024-09-17T05:19:59.560155+0000","last_unstale":"2024-09-17T05:20:00.561450+0000","last_undegraded":"2024-09-17T05:20:00.561450+0000","last_fullsized":"2024-09-17T05:20:00.561450+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:57.146571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539697+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:20:00.539697+0000","last_peered":"2024-09-17T05:20:00.539697+0000","last_clean":"2024-09-17T05:20:00.539697+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:20:00.539697+0000","last_undegraded":"2024-09-17T05:20:00.539697+0000","last_fullsized":"2024-09-17T05:20:00.539697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":201991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":202931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":194544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1064960,"data_stored":772828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:20:03.527 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:20:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.662+0000 7f11c40a9640 1 -- 172.21.15.81:0/851336871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 msgr2=0x7f11a80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.662+0000 7f11c40a9640 1 --2- 172.21.15.81:0/851336871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 0x7f11a80051c0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f11b400c7b0 tx=0x7f11a8005830 comp rx=0 tx=0).stop 2024-09-17T05:20:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.662+0000 7f11c2646640 1 -- 172.21.15.81:0/851336871 reap_dead start 2024-09-17T05:20:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.662+0000 7f11c40a9640 1 -- 172.21.15.81:0/851336871 shutdown_connections 2024-09-17T05:20:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.662+0000 7f11c40a9640 1 -- 172.21.15.81:0/851336871 >> 172.21.15.81:0/851336871 conn(0x7f11bc0d3ea0 msgr2=0x7f11bc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.662+0000 7f11c40a9640 1 -- 172.21.15.81:0/851336871 shutdown_connections 2024-09-17T05:20:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.662+0000 7f11c40a9640 1 -- 172.21.15.81:0/851336871 wait complete. 2024-09-17T05:20:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 Processor -- start 2024-09-17T05:20:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 -- start start 2024-09-17T05:20:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 0x7f11bc09db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11bc14de00 0x7f11bc150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11bc0cde30 0x7f11bc150990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0b42a0 con 0x7f11a8004d40 2024-09-17T05:20:03.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f11bc0b4120 con 0x7f11bc0cde30 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c40a9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f11bc0b4420 con 0x7f11bc14de00 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.664+0000 7f11c1e45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 0x7f11bc09db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 0x7f11bc09db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38664/0 (socket says 172.21.15.81:38664) 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 -- 172.21.15.81:0/583017268 learned_addr learned my addr 172.21.15.81:0/583017268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c2646640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11bc0cde30 0x7f11bc150990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1644640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11bc14de00 0x7f11bc150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 -- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11bc14de00 msgr2=0x7f11bc150450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11bc14de00 0x7f11bc150450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 -- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11bc0cde30 msgr2=0x7f11bc150990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11bc0cde30 0x7f11bc150990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 -- 172.21.15.81:0/583017268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f11bc0cb690 con 0x7f11a8004d40 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c1e45640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 0x7f11bc09db80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f11b8011ae0 tx=0x7f11b8011ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11b27fc640 1 -- 172.21.15.81:0/583017268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b800fd60 con 0x7f11a8004d40 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11b27fc640 1 -- 172.21.15.81:0/583017268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f11b8004020 con 0x7f11a8004d40 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11b27fc640 1 -- 172.21.15.81:0/583017268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f11b8004470 con 0x7f11a8004d40 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11bc0cb970 con 0x7f11a8004d40 2024-09-17T05:20:03.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.665+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11bc15f6d0 con 0x7f11a8004d40 2024-09-17T05:20:03.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.666+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f11bc0cf9b0 con 0x7f11a8004d40 2024-09-17T05:20:03.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.667+0000 7f11b27fc640 1 -- 172.21.15.81:0/583017268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f11b80035f0 con 0x7f11a8004d40 2024-09-17T05:20:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.667+0000 7f11b27fc640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11a0078d40 0x7f11a007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.667+0000 7f11b27fc640 1 -- 172.21.15.81:0/583017268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f11b809bbd0 con 0x7f11a8004d40 2024-09-17T05:20:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.667+0000 7f11c1644640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11a0078d40 0x7f11a007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:03.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.668+0000 7f11c1644640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11a0078d40 0x7f11a007b200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11bc1f85f0 tx=0x7f11ac005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:03.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.671+0000 7f11b27fc640 1 -- 172.21.15.81:0/583017268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f11b8063770 con 0x7f11a8004d40 2024-09-17T05:20:03.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.844+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f11bc0cb440 con 0x7f11a0078d40 2024-09-17T05:20:03.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.849+0000 7f11b27fc640 1 -- 172.21.15.81:0/583017268 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249291 (secure 0 0 0) 0x7f11ac05dde0 con 0x7f11a0078d40 2024-09-17T05:20:03.854 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:03.856 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:20:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11a0078d40 msgr2=0x7f11a007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11a0078d40 0x7f11a007b200 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f11bc1f85f0 tx=0x7f11ac005f90 comp rx=0 tx=0).stop 2024-09-17T05:20:03.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 msgr2=0x7f11bc09db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 0x7f11bc09db80 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f11b8011ae0 tx=0x7f11b8011ee0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 shutdown_connections 2024-09-17T05:20:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f11a0078d40 0x7f11a007b200 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f11bc0cde30 0x7f11bc150990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f11bc14de00 0x7f11bc150450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 --2- 172.21.15.81:0/583017268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f11a8004d40 0x7f11bc09db80 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 >> 172.21.15.81:0/583017268 conn(0x7f11bc0d3ea0 msgr2=0x7f11bc0d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 shutdown_connections 2024-09-17T05:20:03.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:03.852+0000 7f11c40a9640 1 -- 172.21.15.81:0/583017268 wait complete. 2024-09-17T05:20:03.863 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-17T05:20:03.391110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225552,"kb_used_data":5124,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749168,"statfs":{"total":773094113280,"available":772863148032,"internally_reserved":0,"allocated":5246976,"data_stored":2768806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.851058"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549824+0000","last_change":"2024-09-17T05:20:00.547326+0000","last_active":"2024-09-17T05:20:00.549824+0000","last_peered":"2024-09-17T05:20:00.549824+0000","last_clean":"2024-09-17T05:20:00.549824+0000","last_became_active":"2024-09-17T05:20:00.547030+0000","last_became_peered":"2024-09-17T05:20:00.547030+0000","last_unstale":"2024-09-17T05:20:00.549824+0000","last_undegraded":"2024-09-17T05:20:00.549824+0000","last_fullsized":"2024-09-17T05:20:00.549824+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:58.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548075+0000","last_change":"2024-09-17T05:20:00.546476+0000","last_active":"2024-09-17T05:20:00.548075+0000","last_peered":"2024-09-17T05:20:00.548075+0000","last_clean":"2024-09-17T05:20:00.548075+0000","last_became_active":"2024-09-17T05:20:00.544353+0000","last_became_peered":"2024-09-17T05:20:00.544353+0000","last_unstale":"2024-09-17T05:20:00.548075+0000","last_undegraded":"2024-09-17T05:20:00.548075+0000","last_fullsized":"2024-09-17T05:20:00.548075+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:37.491888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535274+0000","last_change":"2024-09-17T05:20:00.533096+0000","last_active":"2024-09-17T05:20:00.535274+0000","last_peered":"2024-09-17T05:20:00.535274+0000","last_clean":"2024-09-17T05:20:00.535274+0000","last_became_active":"2024-09-17T05:20:00.532800+0000","last_became_peered":"2024-09-17T05:20:00.532800+0000","last_unstale":"2024-09-17T05:20:00.535274+0000","last_undegraded":"2024-09-17T05:20:00.535274+0000","last_fullsized":"2024-09-17T05:20:00.535274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:19.671543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546535+0000","last_change":"2024-09-17T05:20:00.543656+0000","last_active":"2024-09-17T05:20:00.546535+0000","last_peered":"2024-09-17T05:20:00.546535+0000","last_clean":"2024-09-17T05:20:00.546535+0000","last_became_active":"2024-09-17T05:20:00.543350+0000","last_became_peered":"2024-09-17T05:20:00.543350+0000","last_unstale":"2024-09-17T05:20:00.546535+0000","last_undegraded":"2024-09-17T05:20:00.546535+0000","last_fullsized":"2024-09-17T05:20:00.546535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:29.786887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552498+0000","last_change":"2024-09-17T05:20:00.548503+0000","last_active":"2024-09-17T05:20:00.552498+0000","last_peered":"2024-09-17T05:20:00.552498+0000","last_clean":"2024-09-17T05:20:00.552498+0000","last_became_active":"2024-09-17T05:20:00.547870+0000","last_became_peered":"2024-09-17T05:20:00.547870+0000","last_unstale":"2024-09-17T05:20:00.552498+0000","last_undegraded":"2024-09-17T05:20:00.552498+0000","last_fullsized":"2024-09-17T05:20:00.552498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:11.743975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551943+0000","last_change":"2024-09-17T05:20:00.548256+0000","last_active":"2024-09-17T05:20:00.551943+0000","last_peered":"2024-09-17T05:20:00.551943+0000","last_clean":"2024-09-17T05:20:00.551943+0000","last_became_active":"2024-09-17T05:20:00.547935+0000","last_became_peered":"2024-09-17T05:20:00.547935+0000","last_unstale":"2024-09-17T05:20:00.551943+0000","last_undegraded":"2024-09-17T05:20:00.551943+0000","last_fullsized":"2024-09-17T05:20:00.551943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:16.729139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542947+0000","last_change":"2024-09-17T05:20:00.541383+0000","last_active":"2024-09-17T05:20:00.542947+0000","last_peered":"2024-09-17T05:20:00.542947+0000","last_clean":"2024-09-17T05:20:00.542947+0000","last_became_active":"2024-09-17T05:20:00.540989+0000","last_became_peered":"2024-09-17T05:20:00.540989+0000","last_unstale":"2024-09-17T05:20:00.542947+0000","last_undegraded":"2024-09-17T05:20:00.542947+0000","last_fullsized":"2024-09-17T05:20:00.542947+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:01.911225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546696+0000","last_change":"2024-09-17T05:20:00.539569+0000","last_active":"2024-09-17T05:20:00.546696+0000","last_peered":"2024-09-17T05:20:00.546696+0000","last_clean":"2024-09-17T05:20:00.546696+0000","last_became_active":"2024-09-17T05:20:00.539334+0000","last_became_peered":"2024-09-17T05:20:00.539334+0000","last_unstale":"2024-09-17T05:20:00.546696+0000","last_undegraded":"2024-09-17T05:20:00.546696+0000","last_fullsized":"2024-09-17T05:20:00.546696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:54.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540962+0000","last_change":"2024-09-17T05:20:00.538481+0000","last_active":"2024-09-17T05:20:00.540962+0000","last_peered":"2024-09-17T05:20:00.540962+0000","last_clean":"2024-09-17T05:20:00.540962+0000","last_became_active":"2024-09-17T05:20:00.538224+0000","last_became_peered":"2024-09-17T05:20:00.538224+0000","last_unstale":"2024-09-17T05:20:00.540962+0000","last_undegraded":"2024-09-17T05:20:00.540962+0000","last_fullsized":"2024-09-17T05:20:00.540962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:58.772520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548997+0000","last_change":"2024-09-17T05:20:00.545333+0000","last_active":"2024-09-17T05:20:00.548997+0000","last_peered":"2024-09-17T05:20:00.548997+0000","last_clean":"2024-09-17T05:20:00.548997+0000","last_became_active":"2024-09-17T05:20:00.545083+0000","last_became_peered":"2024-09-17T05:20:00.545083+0000","last_unstale":"2024-09-17T05:20:00.548997+0000","last_undegraded":"2024-09-17T05:20:00.548997+0000","last_fullsized":"2024-09-17T05:20:00.548997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:35.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539931+0000","last_change":"2024-09-17T05:20:00.538315+0000","last_active":"2024-09-17T05:20:00.539931+0000","last_peered":"2024-09-17T05:20:00.539931+0000","last_clean":"2024-09-17T05:20:00.539931+0000","last_became_active":"2024-09-17T05:20:00.537973+0000","last_became_peered":"2024-09-17T05:20:00.537973+0000","last_unstale":"2024-09-17T05:20:00.539931+0000","last_undegraded":"2024-09-17T05:20:00.539931+0000","last_fullsized":"2024-09-17T05:20:00.539931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545590+0000","last_change":"2024-09-17T05:20:00.541799+0000","last_active":"2024-09-17T05:20:00.545590+0000","last_peered":"2024-09-17T05:20:00.545590+0000","last_clean":"2024-09-17T05:20:00.545590+0000","last_became_active":"2024-09-17T05:20:00.541529+0000","last_became_peered":"2024-09-17T05:20:00.541529+0000","last_unstale":"2024-09-17T05:20:00.545590+0000","last_undegraded":"2024-09-17T05:20:00.545590+0000","last_fullsized":"2024-09-17T05:20:00.545590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:03.967733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544389+0000","last_change":"2024-09-17T05:20:00.542069+0000","last_active":"2024-09-17T05:20:00.544389+0000","last_peered":"2024-09-17T05:20:00.544389+0000","last_clean":"2024-09-17T05:20:00.544389+0000","last_became_active":"2024-09-17T05:20:00.541760+0000","last_became_peered":"2024-09-17T05:20:00.541760+0000","last_unstale":"2024-09-17T05:20:00.544389+0000","last_undegraded":"2024-09-17T05:20:00.544389+0000","last_fullsized":"2024-09-17T05:20:00.544389+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:00.588738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547432+0000","last_change":"2024-09-17T05:20:00.543451+0000","last_active":"2024-09-17T05:20:00.547432+0000","last_peered":"2024-09-17T05:20:00.547432+0000","last_clean":"2024-09-17T05:20:00.547432+0000","last_became_active":"2024-09-17T05:20:00.542502+0000","last_became_peered":"2024-09-17T05:20:00.542502+0000","last_unstale":"2024-09-17T05:20:00.547432+0000","last_undegraded":"2024-09-17T05:20:00.547432+0000","last_fullsized":"2024-09-17T05:20:00.547432+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:36.840738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543766+0000","last_change":"2024-09-17T05:20:00.540658+0000","last_active":"2024-09-17T05:20:00.543766+0000","last_peered":"2024-09-17T05:20:00.543766+0000","last_clean":"2024-09-17T05:20:00.543766+0000","last_became_active":"2024-09-17T05:20:00.540374+0000","last_became_peered":"2024-09-17T05:20:00.540374+0000","last_unstale":"2024-09-17T05:20:00.543766+0000","last_undegraded":"2024-09-17T05:20:00.543766+0000","last_fullsized":"2024-09-17T05:20:00.543766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549769+0000","last_change":"2024-09-17T05:20:00.547853+0000","last_active":"2024-09-17T05:20:00.549769+0000","last_peered":"2024-09-17T05:20:00.549769+0000","last_clean":"2024-09-17T05:20:00.549769+0000","last_became_active":"2024-09-17T05:20:00.547005+0000","last_became_peered":"2024-09-17T05:20:00.547005+0000","last_unstale":"2024-09-17T05:20:00.549769+0000","last_undegraded":"2024-09-17T05:20:00.549769+0000","last_fullsized":"2024-09-17T05:20:00.549769+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:51.663396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549807+0000","last_change":"2024-09-17T05:20:00.547374+0000","last_active":"2024-09-17T05:20:00.549807+0000","last_peered":"2024-09-17T05:20:00.549807+0000","last_clean":"2024-09-17T05:20:00.549807+0000","last_became_active":"2024-09-17T05:20:00.547086+0000","last_became_peered":"2024-09-17T05:20:00.547086+0000","last_unstale":"2024-09-17T05:20:00.549807+0000","last_undegraded":"2024-09-17T05:20:00.549807+0000","last_fullsized":"2024-09-17T05:20:00.549807+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546316+0000","last_change":"2024-09-17T05:20:00.542690+0000","last_active":"2024-09-17T05:20:00.546316+0000","last_peered":"2024-09-17T05:20:00.546316+0000","last_clean":"2024-09-17T05:20:00.546316+0000","last_became_active":"2024-09-17T05:20:00.542349+0000","last_became_peered":"2024-09-17T05:20:00.542349+0000","last_unstale":"2024-09-17T05:20:00.546316+0000","last_undegraded":"2024-09-17T05:20:00.546316+0000","last_fullsized":"2024-09-17T05:20:00.546316+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:52.854277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546642+0000","last_change":"2024-09-17T05:20:00.539389+0000","last_active":"2024-09-17T05:20:00.546642+0000","last_peered":"2024-09-17T05:20:00.546642+0000","last_clean":"2024-09-17T05:20:00.546642+0000","last_became_active":"2024-09-17T05:20:00.539098+0000","last_became_peered":"2024-09-17T05:20:00.539098+0000","last_unstale":"2024-09-17T05:20:00.546642+0000","last_undegraded":"2024-09-17T05:20:00.546642+0000","last_fullsized":"2024-09-17T05:20:00.546642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:40.028949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545763+0000","last_change":"2024-09-17T05:20:00.543003+0000","last_active":"2024-09-17T05:20:00.545763+0000","last_peered":"2024-09-17T05:20:00.545763+0000","last_clean":"2024-09-17T05:20:00.545763+0000","last_became_active":"2024-09-17T05:20:00.542562+0000","last_became_peered":"2024-09-17T05:20:00.542562+0000","last_unstale":"2024-09-17T05:20:00.545763+0000","last_undegraded":"2024-09-17T05:20:00.545763+0000","last_fullsized":"2024-09-17T05:20:00.545763+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:33.584816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542766+0000","last_change":"2024-09-17T05:20:00.540456+0000","last_active":"2024-09-17T05:20:00.542766+0000","last_peered":"2024-09-17T05:20:00.542766+0000","last_clean":"2024-09-17T05:20:00.542766+0000","last_became_active":"2024-09-17T05:20:00.540089+0000","last_became_peered":"2024-09-17T05:20:00.540089+0000","last_unstale":"2024-09-17T05:20:00.542766+0000","last_undegraded":"2024-09-17T05:20:00.542766+0000","last_fullsized":"2024-09-17T05:20:00.542766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:56.542144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543457+0000","last_change":"2024-09-17T05:20:00.542080+0000","last_active":"2024-09-17T05:20:00.543457+0000","last_peered":"2024-09-17T05:20:00.543457+0000","last_clean":"2024-09-17T05:20:00.543457+0000","last_became_active":"2024-09-17T05:20:00.541796+0000","last_became_peered":"2024-09-17T05:20:00.541796+0000","last_unstale":"2024-09-17T05:20:00.543457+0000","last_undegraded":"2024-09-17T05:20:00.543457+0000","last_fullsized":"2024-09-17T05:20:00.543457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:55.283438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550421+0000","last_change":"2024-09-17T05:20:00.549564+0000","last_active":"2024-09-17T05:20:00.550421+0000","last_peered":"2024-09-17T05:20:00.550421+0000","last_clean":"2024-09-17T05:20:00.550421+0000","last_became_active":"2024-09-17T05:20:00.549300+0000","last_became_peered":"2024-09-17T05:20:00.549300+0000","last_unstale":"2024-09-17T05:20:00.550421+0000","last_undegraded":"2024-09-17T05:20:00.550421+0000","last_fullsized":"2024-09-17T05:20:00.550421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.293708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550099+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550099+0000","last_peered":"2024-09-17T05:20:00.550099+0000","last_clean":"2024-09-17T05:20:00.550099+0000","last_became_active":"2024-09-17T05:20:00.544913+0000","last_became_peered":"2024-09-17T05:20:00.544913+0000","last_unstale":"2024-09-17T05:20:00.550099+0000","last_undegraded":"2024-09-17T05:20:00.550099+0000","last_fullsized":"2024-09-17T05:20:00.550099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:15.118672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550008+0000","last_change":"2024-09-17T05:20:00.548447+0000","last_active":"2024-09-17T05:20:00.550008+0000","last_peered":"2024-09-17T05:20:00.550008+0000","last_clean":"2024-09-17T05:20:00.550008+0000","last_became_active":"2024-09-17T05:20:00.548097+0000","last_became_peered":"2024-09-17T05:20:00.548097+0000","last_unstale":"2024-09-17T05:20:00.550008+0000","last_undegraded":"2024-09-17T05:20:00.550008+0000","last_fullsized":"2024-09-17T05:20:00.550008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:00.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552550+0000","last_change":"2024-09-17T05:20:00.547293+0000","last_active":"2024-09-17T05:20:00.552550+0000","last_peered":"2024-09-17T05:20:00.552550+0000","last_clean":"2024-09-17T05:20:00.552550+0000","last_became_active":"2024-09-17T05:20:00.547026+0000","last_became_peered":"2024-09-17T05:20:00.547026+0000","last_unstale":"2024-09-17T05:20:00.552550+0000","last_undegraded":"2024-09-17T05:20:00.552550+0000","last_fullsized":"2024-09-17T05:20:00.552550+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561768+0000","last_change":"2024-09-17T05:19:59.558973+0000","last_active":"2024-09-17T05:20:00.561768+0000","last_peered":"2024-09-17T05:20:00.561768+0000","last_clean":"2024-09-17T05:20:00.561768+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.561768+0000","last_undegraded":"2024-09-17T05:20:00.561768+0000","last_fullsized":"2024-09-17T05:20:00.561768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:00.930635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542569+0000","last_change":"2024-09-17T05:20:00.538883+0000","last_active":"2024-09-17T05:20:00.542569+0000","last_peered":"2024-09-17T05:20:00.542569+0000","last_clean":"2024-09-17T05:20:00.542569+0000","last_became_active":"2024-09-17T05:20:00.538502+0000","last_became_peered":"2024-09-17T05:20:00.538502+0000","last_unstale":"2024-09-17T05:20:00.542569+0000","last_undegraded":"2024-09-17T05:20:00.542569+0000","last_fullsized":"2024-09-17T05:20:00.542569+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:25.828995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559950+0000","last_change":"2024-09-17T05:19:59.559007+0000","last_active":"2024-09-17T05:20:00.559950+0000","last_peered":"2024-09-17T05:20:00.559950+0000","last_clean":"2024-09-17T05:20:00.559950+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.559950+0000","last_undegraded":"2024-09-17T05:20:00.559950+0000","last_fullsized":"2024-09-17T05:20:00.559950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548169+0000","last_change":"2024-09-17T05:20:00.545138+0000","last_active":"2024-09-17T05:20:00.548169+0000","last_peered":"2024-09-17T05:20:00.548169+0000","last_clean":"2024-09-17T05:20:00.548169+0000","last_became_active":"2024-09-17T05:20:00.544865+0000","last_became_peered":"2024-09-17T05:20:00.544865+0000","last_unstale":"2024-09-17T05:20:00.548169+0000","last_undegraded":"2024-09-17T05:20:00.548169+0000","last_fullsized":"2024-09-17T05:20:00.548169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:24.925391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560906+0000","last_change":"2024-09-17T05:19:59.563623+0000","last_active":"2024-09-17T05:20:00.560906+0000","last_peered":"2024-09-17T05:20:00.560906+0000","last_clean":"2024-09-17T05:20:00.560906+0000","last_became_active":"2024-09-17T05:19:59.563315+0000","last_became_peered":"2024-09-17T05:19:59.563315+0000","last_unstale":"2024-09-17T05:20:00.560906+0000","last_undegraded":"2024-09-17T05:20:00.560906+0000","last_fullsized":"2024-09-17T05:20:00.560906+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:18.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551313+0000","last_change":"2024-09-17T05:20:00.544721+0000","last_active":"2024-09-17T05:20:00.551313+0000","last_peered":"2024-09-17T05:20:00.551313+0000","last_clean":"2024-09-17T05:20:00.551313+0000","last_became_active":"2024-09-17T05:20:00.544443+0000","last_became_peered":"2024-09-17T05:20:00.544443+0000","last_unstale":"2024-09-17T05:20:00.551313+0000","last_undegraded":"2024-09-17T05:20:00.551313+0000","last_fullsized":"2024-09-17T05:20:00.551313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560899+0000","last_change":"2024-09-17T05:19:59.564861+0000","last_active":"2024-09-17T05:20:00.560899+0000","last_peered":"2024-09-17T05:20:00.560899+0000","last_clean":"2024-09-17T05:20:00.560899+0000","last_became_active":"2024-09-17T05:19:59.564565+0000","last_became_peered":"2024-09-17T05:19:59.564565+0000","last_unstale":"2024-09-17T05:20:00.560899+0000","last_undegraded":"2024-09-17T05:20:00.560899+0000","last_fullsized":"2024-09-17T05:20:00.560899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549902+0000","last_change":"2024-09-17T05:20:00.539449+0000","last_active":"2024-09-17T05:20:00.549902+0000","last_peered":"2024-09-17T05:20:00.549902+0000","last_clean":"2024-09-17T05:20:00.549902+0000","last_became_active":"2024-09-17T05:20:00.539171+0000","last_became_peered":"2024-09-17T05:20:00.539171+0000","last_unstale":"2024-09-17T05:20:00.549902+0000","last_undegraded":"2024-09-17T05:20:00.549902+0000","last_fullsized":"2024-09-17T05:20:00.549902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:43.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561116+0000","last_change":"2024-09-17T05:19:59.562556+0000","last_active":"2024-09-17T05:20:00.561116+0000","last_peered":"2024-09-17T05:20:00.561116+0000","last_clean":"2024-09-17T05:20:00.561116+0000","last_became_active":"2024-09-17T05:19:59.562255+0000","last_became_peered":"2024-09-17T05:19:59.562255+0000","last_unstale":"2024-09-17T05:20:00.561116+0000","last_undegraded":"2024-09-17T05:20:00.561116+0000","last_fullsized":"2024-09-17T05:20:00.561116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:47.640069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.558324+0000","last_change":"2024-09-17T05:19:59.558825+0000","last_active":"2024-09-17T05:20:00.558324+0000","last_peered":"2024-09-17T05:20:00.558324+0000","last_clean":"2024-09-17T05:20:00.558324+0000","last_became_active":"2024-09-17T05:19:59.558529+0000","last_became_peered":"2024-09-17T05:19:59.558529+0000","last_unstale":"2024-09-17T05:20:00.558324+0000","last_undegraded":"2024-09-17T05:20:00.558324+0000","last_fullsized":"2024-09-17T05:20:00.558324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:42.182629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534516+0000","last_change":"2024-09-17T05:19:59.563788+0000","last_active":"2024-09-17T05:20:00.534516+0000","last_peered":"2024-09-17T05:20:00.534516+0000","last_clean":"2024-09-17T05:20:00.534516+0000","last_became_active":"2024-09-17T05:19:59.563534+0000","last_became_peered":"2024-09-17T05:19:59.563534+0000","last_unstale":"2024-09-17T05:20:00.534516+0000","last_undegraded":"2024-09-17T05:20:00.534516+0000","last_fullsized":"2024-09-17T05:20:00.534516+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.937150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549799+0000","last_change":"2024-09-17T05:20:00.548448+0000","last_active":"2024-09-17T05:20:00.549799+0000","last_peered":"2024-09-17T05:20:00.549799+0000","last_clean":"2024-09-17T05:20:00.549799+0000","last_became_active":"2024-09-17T05:20:00.547380+0000","last_became_peered":"2024-09-17T05:20:00.547380+0000","last_unstale":"2024-09-17T05:20:00.549799+0000","last_undegraded":"2024-09-17T05:20:00.549799+0000","last_fullsized":"2024-09-17T05:20:00.549799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:43.184923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545623+0000","last_change":"2024-09-17T05:20:00.542588+0000","last_active":"2024-09-17T05:20:00.545623+0000","last_peered":"2024-09-17T05:20:00.545623+0000","last_clean":"2024-09-17T05:20:00.545623+0000","last_became_active":"2024-09-17T05:20:00.542297+0000","last_became_peered":"2024-09-17T05:20:00.542297+0000","last_unstale":"2024-09-17T05:20:00.545623+0000","last_undegraded":"2024-09-17T05:20:00.545623+0000","last_fullsized":"2024-09-17T05:20:00.545623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:21.905648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530770+0000","last_change":"2024-09-17T05:19:59.558968+0000","last_active":"2024-09-17T05:20:00.530770+0000","last_peered":"2024-09-17T05:20:00.530770+0000","last_clean":"2024-09-17T05:20:00.530770+0000","last_became_active":"2024-09-17T05:19:59.558447+0000","last_became_peered":"2024-09-17T05:19:59.558447+0000","last_unstale":"2024-09-17T05:20:00.530770+0000","last_undegraded":"2024-09-17T05:20:00.530770+0000","last_fullsized":"2024-09-17T05:20:00.530770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552010+0000","last_change":"2024-09-17T05:20:00.548751+0000","last_active":"2024-09-17T05:20:00.552010+0000","last_peered":"2024-09-17T05:20:00.552010+0000","last_clean":"2024-09-17T05:20:00.552010+0000","last_became_active":"2024-09-17T05:20:00.548410+0000","last_became_peered":"2024-09-17T05:20:00.548410+0000","last_unstale":"2024-09-17T05:20:00.552010+0000","last_undegraded":"2024-09-17T05:20:00.552010+0000","last_fullsized":"2024-09-17T05:20:00.552010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:48.642363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546853+0000","last_change":"2024-09-17T05:20:00.543079+0000","last_active":"2024-09-17T05:20:00.546853+0000","last_peered":"2024-09-17T05:20:00.546853+0000","last_clean":"2024-09-17T05:20:00.546853+0000","last_became_active":"2024-09-17T05:20:00.542816+0000","last_became_peered":"2024-09-17T05:20:00.542816+0000","last_unstale":"2024-09-17T05:20:00.546853+0000","last_undegraded":"2024-09-17T05:20:00.546853+0000","last_fullsized":"2024-09-17T05:20:00.546853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:02.274063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560749+0000","last_change":"2024-09-17T05:19:59.565867+0000","last_active":"2024-09-17T05:20:00.560749+0000","last_peered":"2024-09-17T05:20:00.560749+0000","last_clean":"2024-09-17T05:20:00.560749+0000","last_became_active":"2024-09-17T05:19:59.565572+0000","last_became_peered":"2024-09-17T05:19:59.565572+0000","last_unstale":"2024-09-17T05:20:00.560749+0000","last_undegraded":"2024-09-17T05:20:00.560749+0000","last_fullsized":"2024-09-17T05:20:00.560749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:30.724384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551879+0000","last_change":"2024-09-17T05:20:00.548336+0000","last_active":"2024-09-17T05:20:00.551879+0000","last_peered":"2024-09-17T05:20:00.551879+0000","last_clean":"2024-09-17T05:20:00.551879+0000","last_became_active":"2024-09-17T05:20:00.548016+0000","last_became_peered":"2024-09-17T05:20:00.548016+0000","last_unstale":"2024-09-17T05:20:00.551879+0000","last_undegraded":"2024-09-17T05:20:00.551879+0000","last_fullsized":"2024-09-17T05:20:00.551879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:01.932930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.562965+0000","last_change":"2024-09-17T05:19:59.559093+0000","last_active":"2024-09-17T05:20:00.562965+0000","last_peered":"2024-09-17T05:20:00.562965+0000","last_clean":"2024-09-17T05:20:00.562965+0000","last_became_active":"2024-09-17T05:19:59.558796+0000","last_became_peered":"2024-09-17T05:19:59.558796+0000","last_unstale":"2024-09-17T05:20:00.562965+0000","last_undegraded":"2024-09-17T05:20:00.562965+0000","last_fullsized":"2024-09-17T05:20:00.562965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:10.022680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543996+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.542577+0000","last_became_peered":"2024-09-17T05:20:00.542577+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:59.305586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560577+0000","last_change":"2024-09-17T05:19:59.559096+0000","last_active":"2024-09-17T05:20:00.560577+0000","last_peered":"2024-09-17T05:20:00.560577+0000","last_clean":"2024-09-17T05:20:00.560577+0000","last_became_active":"2024-09-17T05:19:59.558466+0000","last_became_peered":"2024-09-17T05:19:59.558466+0000","last_unstale":"2024-09-17T05:20:00.560577+0000","last_undegraded":"2024-09-17T05:20:00.560577+0000","last_fullsized":"2024-09-17T05:20:00.560577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:02.120617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539497+0000","last_change":"2024-09-17T05:19:59.563984+0000","last_active":"2024-09-17T05:20:00.539497+0000","last_peered":"2024-09-17T05:20:00.539497+0000","last_clean":"2024-09-17T05:20:00.539497+0000","last_became_active":"2024-09-17T05:19:59.563645+0000","last_became_peered":"2024-09-17T05:19:59.563645+0000","last_unstale":"2024-09-17T05:20:00.539497+0000","last_undegraded":"2024-09-17T05:20:00.539497+0000","last_fullsized":"2024-09-17T05:20:00.539497+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:32.582522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546729+0000","last_change":"2024-09-17T05:20:00.541286+0000","last_active":"2024-09-17T05:20:00.546729+0000","last_peered":"2024-09-17T05:20:00.546729+0000","last_clean":"2024-09-17T05:20:00.546729+0000","last_became_active":"2024-09-17T05:20:00.541020+0000","last_became_peered":"2024-09-17T05:20:00.541020+0000","last_unstale":"2024-09-17T05:20:00.546729+0000","last_undegraded":"2024-09-17T05:20:00.546729+0000","last_fullsized":"2024-09-17T05:20:00.546729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:17.537507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534738+0000","last_change":"2024-09-17T05:19:59.563576+0000","last_active":"2024-09-17T05:20:00.534738+0000","last_peered":"2024-09-17T05:20:00.534738+0000","last_clean":"2024-09-17T05:20:00.534738+0000","last_became_active":"2024-09-17T05:19:59.563297+0000","last_became_peered":"2024-09-17T05:19:59.563297+0000","last_unstale":"2024-09-17T05:20:00.534738+0000","last_undegraded":"2024-09-17T05:20:00.534738+0000","last_fullsized":"2024-09-17T05:20:00.534738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:16.800054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552885+0000","last_change":"2024-09-17T05:20:00.550850+0000","last_active":"2024-09-17T05:20:00.552885+0000","last_peered":"2024-09-17T05:20:00.552885+0000","last_clean":"2024-09-17T05:20:00.552885+0000","last_became_active":"2024-09-17T05:20:00.550558+0000","last_became_peered":"2024-09-17T05:20:00.550558+0000","last_unstale":"2024-09-17T05:20:00.552885+0000","last_undegraded":"2024-09-17T05:20:00.552885+0000","last_fullsized":"2024-09-17T05:20:00.552885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:55.244688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546737+0000","last_change":"2024-09-17T05:20:00.541991+0000","last_active":"2024-09-17T05:20:00.546737+0000","last_peered":"2024-09-17T05:20:00.546737+0000","last_clean":"2024-09-17T05:20:00.546737+0000","last_became_active":"2024-09-17T05:20:00.541748+0000","last_became_peered":"2024-09-17T05:20:00.541748+0000","last_unstale":"2024-09-17T05:20:00.546737+0000","last_undegraded":"2024-09-17T05:20:00.546737+0000","last_fullsized":"2024-09-17T05:20:00.546737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:17.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560320+0000","last_change":"2024-09-17T05:19:59.556315+0000","last_active":"2024-09-17T05:20:00.560320+0000","last_peered":"2024-09-17T05:20:00.560320+0000","last_clean":"2024-09-17T05:20:00.560320+0000","last_became_active":"2024-09-17T05:19:59.556024+0000","last_became_peered":"2024-09-17T05:19:59.556024+0000","last_unstale":"2024-09-17T05:20:00.560320+0000","last_undegraded":"2024-09-17T05:20:00.560320+0000","last_fullsized":"2024-09-17T05:20:00.560320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:16.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559848+0000","last_change":"2024-09-17T05:19:59.560582+0000","last_active":"2024-09-17T05:20:00.559848+0000","last_peered":"2024-09-17T05:20:00.559848+0000","last_clean":"2024-09-17T05:20:00.559848+0000","last_became_active":"2024-09-17T05:19:59.560282+0000","last_became_peered":"2024-09-17T05:19:59.560282+0000","last_unstale":"2024-09-17T05:20:00.559848+0000","last_undegraded":"2024-09-17T05:20:00.559848+0000","last_fullsized":"2024-09-17T05:20:00.559848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.203376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543830+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.543210+0000","last_became_peered":"2024-09-17T05:20:00.543210+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:55.720457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560488+0000","last_change":"2024-09-17T05:19:59.564268+0000","last_active":"2024-09-17T05:20:00.560488+0000","last_peered":"2024-09-17T05:20:00.560488+0000","last_clean":"2024-09-17T05:20:00.560488+0000","last_became_active":"2024-09-17T05:19:59.563909+0000","last_became_peered":"2024-09-17T05:19:59.563909+0000","last_unstale":"2024-09-17T05:20:00.560488+0000","last_undegraded":"2024-09-17T05:20:00.560488+0000","last_fullsized":"2024-09-17T05:20:00.560488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:56.717406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549012+0000","last_change":"2024-09-17T05:20:00.544504+0000","last_active":"2024-09-17T05:20:00.549012+0000","last_peered":"2024-09-17T05:20:00.549012+0000","last_clean":"2024-09-17T05:20:00.549012+0000","last_became_active":"2024-09-17T05:20:00.544123+0000","last_became_peered":"2024-09-17T05:20:00.544123+0000","last_unstale":"2024-09-17T05:20:00.549012+0000","last_undegraded":"2024-09-17T05:20:00.549012+0000","last_fullsized":"2024-09-17T05:20:00.549012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:36.647387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535470+0000","last_change":"2024-09-17T05:19:59.558812+0000","last_active":"2024-09-17T05:20:00.535470+0000","last_peered":"2024-09-17T05:20:00.535470+0000","last_clean":"2024-09-17T05:20:00.535470+0000","last_became_active":"2024-09-17T05:19:59.558524+0000","last_became_peered":"2024-09-17T05:19:59.558524+0000","last_unstale":"2024-09-17T05:20:00.535470+0000","last_undegraded":"2024-09-17T05:20:00.535470+0000","last_fullsized":"2024-09-17T05:20:00.535470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:59.938453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543730+0000","last_change":"2024-09-17T05:20:00.540236+0000","last_active":"2024-09-17T05:20:00.543730+0000","last_peered":"2024-09-17T05:20:00.543730+0000","last_clean":"2024-09-17T05:20:00.543730+0000","last_became_active":"2024-09-17T05:20:00.539968+0000","last_became_peered":"2024-09-17T05:20:00.539968+0000","last_unstale":"2024-09-17T05:20:00.543730+0000","last_undegraded":"2024-09-17T05:20:00.543730+0000","last_fullsized":"2024-09-17T05:20:00.543730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:49.650410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561737+0000","last_change":"2024-09-17T05:19:59.562482+0000","last_active":"2024-09-17T05:20:00.561737+0000","last_peered":"2024-09-17T05:20:00.561737+0000","last_clean":"2024-09-17T05:20:00.561737+0000","last_became_active":"2024-09-17T05:19:59.562197+0000","last_became_peered":"2024-09-17T05:19:59.562197+0000","last_unstale":"2024-09-17T05:20:00.561737+0000","last_undegraded":"2024-09-17T05:20:00.561737+0000","last_fullsized":"2024-09-17T05:20:00.561737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:54.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547002+0000","last_change":"2024-09-17T05:20:00.542587+0000","last_active":"2024-09-17T05:20:00.547002+0000","last_peered":"2024-09-17T05:20:00.547002+0000","last_clean":"2024-09-17T05:20:00.547002+0000","last_became_active":"2024-09-17T05:20:00.542114+0000","last_became_peered":"2024-09-17T05:20:00.542114+0000","last_unstale":"2024-09-17T05:20:00.547002+0000","last_undegraded":"2024-09-17T05:20:00.547002+0000","last_fullsized":"2024-09-17T05:20:00.547002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:52.205670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534742+0000","last_change":"2024-09-17T05:19:59.559159+0000","last_active":"2024-09-17T05:20:00.534742+0000","last_peered":"2024-09-17T05:20:00.534742+0000","last_clean":"2024-09-17T05:20:00.534742+0000","last_became_active":"2024-09-17T05:19:59.558919+0000","last_became_peered":"2024-09-17T05:19:59.558919+0000","last_unstale":"2024-09-17T05:20:00.534742+0000","last_undegraded":"2024-09-17T05:20:00.534742+0000","last_fullsized":"2024-09-17T05:20:00.534742+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.735582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549982+0000","last_change":"2024-09-17T05:20:00.547679+0000","last_active":"2024-09-17T05:20:00.549982+0000","last_peered":"2024-09-17T05:20:00.549982+0000","last_clean":"2024-09-17T05:20:00.549982+0000","last_became_active":"2024-09-17T05:20:00.547424+0000","last_became_peered":"2024-09-17T05:20:00.547424+0000","last_unstale":"2024-09-17T05:20:00.549982+0000","last_undegraded":"2024-09-17T05:20:00.549982+0000","last_fullsized":"2024-09-17T05:20:00.549982+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:43.113899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539592+0000","last_change":"2024-09-17T05:19:59.566679+0000","last_active":"2024-09-17T05:20:00.539592+0000","last_peered":"2024-09-17T05:20:00.539592+0000","last_clean":"2024-09-17T05:20:00.539592+0000","last_became_active":"2024-09-17T05:19:59.566350+0000","last_became_peered":"2024-09-17T05:19:59.566350+0000","last_unstale":"2024-09-17T05:20:00.539592+0000","last_undegraded":"2024-09-17T05:20:00.539592+0000","last_fullsized":"2024-09-17T05:20:00.539592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.291413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548877+0000","last_change":"2024-09-17T05:20:00.545489+0000","last_active":"2024-09-17T05:20:00.548877+0000","last_peered":"2024-09-17T05:20:00.548877+0000","last_clean":"2024-09-17T05:20:00.548877+0000","last_became_active":"2024-09-17T05:20:00.545052+0000","last_became_peered":"2024-09-17T05:20:00.545052+0000","last_unstale":"2024-09-17T05:20:00.548877+0000","last_undegraded":"2024-09-17T05:20:00.548877+0000","last_fullsized":"2024-09-17T05:20:00.548877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:23.670327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534933+0000","last_change":"2024-09-17T05:19:59.561764+0000","last_active":"2024-09-17T05:20:00.534933+0000","last_peered":"2024-09-17T05:20:00.534933+0000","last_clean":"2024-09-17T05:20:00.534933+0000","last_became_active":"2024-09-17T05:19:59.561368+0000","last_became_peered":"2024-09-17T05:19:59.561368+0000","last_unstale":"2024-09-17T05:20:00.534933+0000","last_undegraded":"2024-09-17T05:20:00.534933+0000","last_fullsized":"2024-09-17T05:20:00.534933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:27.664506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544127+0000","last_change":"2024-09-17T05:19:59.566316+0000","last_active":"2024-09-17T05:20:00.544127+0000","last_peered":"2024-09-17T05:20:00.544127+0000","last_clean":"2024-09-17T05:20:00.544127+0000","last_became_active":"2024-09-17T05:19:59.565973+0000","last_became_peered":"2024-09-17T05:19:59.565973+0000","last_unstale":"2024-09-17T05:20:00.544127+0000","last_undegraded":"2024-09-17T05:20:00.544127+0000","last_fullsized":"2024-09-17T05:20:00.544127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:30.046614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551973+0000","last_change":"2024-09-17T05:20:00.549077+0000","last_active":"2024-09-17T05:20:00.551973+0000","last_peered":"2024-09-17T05:20:00.551973+0000","last_clean":"2024-09-17T05:20:00.551973+0000","last_became_active":"2024-09-17T05:20:00.548735+0000","last_became_peered":"2024-09-17T05:20:00.548735+0000","last_unstale":"2024-09-17T05:20:00.551973+0000","last_undegraded":"2024-09-17T05:20:00.551973+0000","last_fullsized":"2024-09-17T05:20:00.551973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:03.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541878+0000","last_change":"2024-09-17T05:19:59.563528+0000","last_active":"2024-09-17T05:20:00.541878+0000","last_peered":"2024-09-17T05:20:00.541878+0000","last_clean":"2024-09-17T05:20:00.541878+0000","last_became_active":"2024-09-17T05:19:59.563264+0000","last_became_peered":"2024-09-17T05:19:59.563264+0000","last_unstale":"2024-09-17T05:20:00.541878+0000","last_undegraded":"2024-09-17T05:20:00.541878+0000","last_fullsized":"2024-09-17T05:20:00.541878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552526+0000","last_change":"2024-09-17T05:20:00.548525+0000","last_active":"2024-09-17T05:20:00.552526+0000","last_peered":"2024-09-17T05:20:00.552526+0000","last_clean":"2024-09-17T05:20:00.552526+0000","last_became_active":"2024-09-17T05:20:00.548220+0000","last_became_peered":"2024-09-17T05:20:00.548220+0000","last_unstale":"2024-09-17T05:20:00.552526+0000","last_undegraded":"2024-09-17T05:20:00.552526+0000","last_fullsized":"2024-09-17T05:20:00.552526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:59.514166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540949+0000","last_change":"2024-09-17T05:19:59.565271+0000","last_active":"2024-09-17T05:20:00.540949+0000","last_peered":"2024-09-17T05:20:00.540949+0000","last_clean":"2024-09-17T05:20:00.540949+0000","last_became_active":"2024-09-17T05:19:59.565009+0000","last_became_peered":"2024-09-17T05:19:59.565009+0000","last_unstale":"2024-09-17T05:20:00.540949+0000","last_undegraded":"2024-09-17T05:20:00.540949+0000","last_fullsized":"2024-09-17T05:20:00.540949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:45.135132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550082+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550082+0000","last_peered":"2024-09-17T05:20:00.550082+0000","last_clean":"2024-09-17T05:20:00.550082+0000","last_became_active":"2024-09-17T05:20:00.544930+0000","last_became_peered":"2024-09-17T05:20:00.544930+0000","last_unstale":"2024-09-17T05:20:00.550082+0000","last_undegraded":"2024-09-17T05:20:00.550082+0000","last_fullsized":"2024-09-17T05:20:00.550082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:50.027809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530552+0000","last_change":"2024-09-17T05:19:59.561592+0000","last_active":"2024-09-17T05:20:00.530552+0000","last_peered":"2024-09-17T05:20:00.530552+0000","last_clean":"2024-09-17T05:20:00.530552+0000","last_became_active":"2024-09-17T05:19:59.561328+0000","last_became_peered":"2024-09-17T05:19:59.561328+0000","last_unstale":"2024-09-17T05:20:00.530552+0000","last_undegraded":"2024-09-17T05:20:00.530552+0000","last_fullsized":"2024-09-17T05:20:00.530552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:27.670831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552195+0000","last_change":"2024-09-17T05:20:00.550589+0000","last_active":"2024-09-17T05:20:00.552195+0000","last_peered":"2024-09-17T05:20:00.552195+0000","last_clean":"2024-09-17T05:20:00.552195+0000","last_became_active":"2024-09-17T05:20:00.550353+0000","last_became_peered":"2024-09-17T05:20:00.550353+0000","last_unstale":"2024-09-17T05:20:00.552195+0000","last_undegraded":"2024-09-17T05:20:00.552195+0000","last_fullsized":"2024-09-17T05:20:00.552195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:10.302010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541854+0000","last_change":"2024-09-17T05:19:59.560425+0000","last_active":"2024-09-17T05:20:00.541854+0000","last_peered":"2024-09-17T05:20:00.541854+0000","last_clean":"2024-09-17T05:20:00.541854+0000","last_became_active":"2024-09-17T05:19:59.560173+0000","last_became_peered":"2024-09-17T05:19:59.560173+0000","last_unstale":"2024-09-17T05:20:00.541854+0000","last_undegraded":"2024-09-17T05:20:00.541854+0000","last_fullsized":"2024-09-17T05:20:00.541854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540317+0000","last_change":"2024-09-17T05:20:00.539142+0000","last_active":"2024-09-17T05:20:00.540317+0000","last_peered":"2024-09-17T05:20:00.540317+0000","last_clean":"2024-09-17T05:20:00.540317+0000","last_became_active":"2024-09-17T05:20:00.538724+0000","last_became_peered":"2024-09-17T05:20:00.538724+0000","last_unstale":"2024-09-17T05:20:00.540317+0000","last_undegraded":"2024-09-17T05:20:00.540317+0000","last_fullsized":"2024-09-17T05:20:00.540317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561450+0000","last_change":"2024-09-17T05:19:59.560442+0000","last_active":"2024-09-17T05:20:00.561450+0000","last_peered":"2024-09-17T05:20:00.561450+0000","last_clean":"2024-09-17T05:20:00.561450+0000","last_became_active":"2024-09-17T05:19:59.560155+0000","last_became_peered":"2024-09-17T05:19:59.560155+0000","last_unstale":"2024-09-17T05:20:00.561450+0000","last_undegraded":"2024-09-17T05:20:00.561450+0000","last_fullsized":"2024-09-17T05:20:00.561450+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:57.146571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539697+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:20:00.539697+0000","last_peered":"2024-09-17T05:20:00.539697+0000","last_clean":"2024-09-17T05:20:00.539697+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:20:00.539697+0000","last_undegraded":"2024-09-17T05:20:00.539697+0000","last_fullsized":"2024-09-17T05:20:00.539697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":201991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":202931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":194544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1064960,"data_stored":772828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:20:03.867 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:20:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.004+0000 7f21375d3640 1 -- 172.21.15.81:0/1108309449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f211c004800 msgr2=0x7f211c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.004+0000 7f21375d3640 1 --2- 172.21.15.81:0/1108309449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f211c004800 0x7f211c004c80 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f2120006fa0 tx=0x7f211c005830 comp rx=0 tx=0).stop 2024-09-17T05:20:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.004+0000 7f21375d3640 1 -- 172.21.15.81:0/1108309449 shutdown_connections 2024-09-17T05:20:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.004+0000 7f21375d3640 1 --2- 172.21.15.81:0/1108309449 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f211c004800 0x7f211c004c80 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.004+0000 7f21375d3640 1 -- 172.21.15.81:0/1108309449 >> 172.21.15.81:0/1108309449 conn(0x7f21300b1690 msgr2=0x7f21300b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.005+0000 7f21375d3640 1 -- 172.21.15.81:0/1108309449 shutdown_connections 2024-09-17T05:20:04.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.005+0000 7f21375d3640 1 -- 172.21.15.81:0/1108309449 wait complete. 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 Processor -- start 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 -- start start 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211c004800 0x7f2130153b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21301596a0 0x7f2130159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21300b09b0 0x7f21300b0e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2130073d60 con 0x7f21300b09b0 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2130073be0 con 0x7f21301596a0 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.006+0000 7f21375d3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f213006ff80 con 0x7f211c004800 2024-09-17T05:20:04.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21300b09b0 0x7f21300b0e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21300b09b0 0x7f21300b0e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38692/0 (socket says 172.21.15.81:38692) 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 -- 172.21.15.81:0/3704345380 learned_addr learned my addr 172.21.15.81:0/3704345380 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2134b6e640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21301596a0 0x7f2130159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f213536f640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211c004800 0x7f2130153b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 -- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211c004800 msgr2=0x7f2130153b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211c004800 0x7f2130153b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 -- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21301596a0 msgr2=0x7f2130159b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21301596a0 0x7f2130159b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 -- 172.21.15.81:0/3704345380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21301f4800 con 0x7f21300b09b0 2024-09-17T05:20:04.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2135b70640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21300b09b0 0x7f21300b0e30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2128005fd0 tx=0x7f2128010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2125ffb640 1 -- 172.21.15.81:0/3704345380 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212800ee70 con 0x7f21300b09b0 2024-09-17T05:20:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2125ffb640 1 -- 172.21.15.81:0/3704345380 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2128015070 con 0x7f21300b09b0 2024-09-17T05:20:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f213015a100 con 0x7f21300b09b0 2024-09-17T05:20:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f2125ffb640 1 -- 172.21.15.81:0/3704345380 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2128003970 con 0x7f21300b09b0 2024-09-17T05:20:04.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.007+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21301f4d60 con 0x7f21300b09b0 2024-09-17T05:20:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.008+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21300b4690 con 0x7f21300b09b0 2024-09-17T05:20:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.009+0000 7f2125ffb640 1 -- 172.21.15.81:0/3704345380 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f2128003b10 con 0x7f21300b09b0 2024-09-17T05:20:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.009+0000 7f2125ffb640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2114078d70 0x7f211407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.009+0000 7f2125ffb640 1 -- 172.21.15.81:0/3704345380 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f212809b6a0 con 0x7f21300b09b0 2024-09-17T05:20:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.010+0000 7f213536f640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2114078d70 0x7f211407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.010+0000 7f213536f640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2114078d70 0x7f211407b230 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f212c006fd0 tx=0x7f212c006d90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:04.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.014+0000 7f2125ffb640 1 -- 172.21.15.81:0/3704345380 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f21301f4800 con 0x7f21300b09b0 2024-09-17T05:20:04.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.186+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f213015b130 con 0x7f2114078d70 2024-09-17T05:20:04.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.190+0000 7f2125ffb640 1 -- 172.21.15.81:0/3704345380 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249291 (secure 0 0 0) 0x7f213015b130 con 0x7f2114078d70 2024-09-17T05:20:04.194 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:04.195 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:20:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2114078d70 msgr2=0x7f211407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2114078d70 0x7f211407b230 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f212c006fd0 tx=0x7f212c006d90 comp rx=0 tx=0).stop 2024-09-17T05:20:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21300b09b0 msgr2=0x7f21300b0e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21300b09b0 0x7f21300b0e30 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f2128005fd0 tx=0x7f2128010f40 comp rx=0 tx=0).stop 2024-09-17T05:20:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 shutdown_connections 2024-09-17T05:20:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2114078d70 0x7f211407b230 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21300b09b0 0x7f21300b0e30 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f21301596a0 0x7f2130159b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 --2- 172.21.15.81:0/3704345380 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211c004800 0x7f2130153b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 >> 172.21.15.81:0/3704345380 conn(0x7f21300b1690 msgr2=0x7f21300ce880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 shutdown_connections 2024-09-17T05:20:04.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.194+0000 7f21375d3640 1 -- 172.21.15.81:0/3704345380 wait complete. 2024-09-17T05:20:04.205 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-17T05:20:03.391110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225552,"kb_used_data":5124,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749168,"statfs":{"total":773094113280,"available":772863148032,"internally_reserved":0,"allocated":5246976,"data_stored":2768806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.851058"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549824+0000","last_change":"2024-09-17T05:20:00.547326+0000","last_active":"2024-09-17T05:20:00.549824+0000","last_peered":"2024-09-17T05:20:00.549824+0000","last_clean":"2024-09-17T05:20:00.549824+0000","last_became_active":"2024-09-17T05:20:00.547030+0000","last_became_peered":"2024-09-17T05:20:00.547030+0000","last_unstale":"2024-09-17T05:20:00.549824+0000","last_undegraded":"2024-09-17T05:20:00.549824+0000","last_fullsized":"2024-09-17T05:20:00.549824+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:58.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548075+0000","last_change":"2024-09-17T05:20:00.546476+0000","last_active":"2024-09-17T05:20:00.548075+0000","last_peered":"2024-09-17T05:20:00.548075+0000","last_clean":"2024-09-17T05:20:00.548075+0000","last_became_active":"2024-09-17T05:20:00.544353+0000","last_became_peered":"2024-09-17T05:20:00.544353+0000","last_unstale":"2024-09-17T05:20:00.548075+0000","last_undegraded":"2024-09-17T05:20:00.548075+0000","last_fullsized":"2024-09-17T05:20:00.548075+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:37.491888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535274+0000","last_change":"2024-09-17T05:20:00.533096+0000","last_active":"2024-09-17T05:20:00.535274+0000","last_peered":"2024-09-17T05:20:00.535274+0000","last_clean":"2024-09-17T05:20:00.535274+0000","last_became_active":"2024-09-17T05:20:00.532800+0000","last_became_peered":"2024-09-17T05:20:00.532800+0000","last_unstale":"2024-09-17T05:20:00.535274+0000","last_undegraded":"2024-09-17T05:20:00.535274+0000","last_fullsized":"2024-09-17T05:20:00.535274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:19.671543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546535+0000","last_change":"2024-09-17T05:20:00.543656+0000","last_active":"2024-09-17T05:20:00.546535+0000","last_peered":"2024-09-17T05:20:00.546535+0000","last_clean":"2024-09-17T05:20:00.546535+0000","last_became_active":"2024-09-17T05:20:00.543350+0000","last_became_peered":"2024-09-17T05:20:00.543350+0000","last_unstale":"2024-09-17T05:20:00.546535+0000","last_undegraded":"2024-09-17T05:20:00.546535+0000","last_fullsized":"2024-09-17T05:20:00.546535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:29.786887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552498+0000","last_change":"2024-09-17T05:20:00.548503+0000","last_active":"2024-09-17T05:20:00.552498+0000","last_peered":"2024-09-17T05:20:00.552498+0000","last_clean":"2024-09-17T05:20:00.552498+0000","last_became_active":"2024-09-17T05:20:00.547870+0000","last_became_peered":"2024-09-17T05:20:00.547870+0000","last_unstale":"2024-09-17T05:20:00.552498+0000","last_undegraded":"2024-09-17T05:20:00.552498+0000","last_fullsized":"2024-09-17T05:20:00.552498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:11.743975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551943+0000","last_change":"2024-09-17T05:20:00.548256+0000","last_active":"2024-09-17T05:20:00.551943+0000","last_peered":"2024-09-17T05:20:00.551943+0000","last_clean":"2024-09-17T05:20:00.551943+0000","last_became_active":"2024-09-17T05:20:00.547935+0000","last_became_peered":"2024-09-17T05:20:00.547935+0000","last_unstale":"2024-09-17T05:20:00.551943+0000","last_undegraded":"2024-09-17T05:20:00.551943+0000","last_fullsized":"2024-09-17T05:20:00.551943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:16.729139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542947+0000","last_change":"2024-09-17T05:20:00.541383+0000","last_active":"2024-09-17T05:20:00.542947+0000","last_peered":"2024-09-17T05:20:00.542947+0000","last_clean":"2024-09-17T05:20:00.542947+0000","last_became_active":"2024-09-17T05:20:00.540989+0000","last_became_peered":"2024-09-17T05:20:00.540989+0000","last_unstale":"2024-09-17T05:20:00.542947+0000","last_undegraded":"2024-09-17T05:20:00.542947+0000","last_fullsized":"2024-09-17T05:20:00.542947+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:01.911225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546696+0000","last_change":"2024-09-17T05:20:00.539569+0000","last_active":"2024-09-17T05:20:00.546696+0000","last_peered":"2024-09-17T05:20:00.546696+0000","last_clean":"2024-09-17T05:20:00.546696+0000","last_became_active":"2024-09-17T05:20:00.539334+0000","last_became_peered":"2024-09-17T05:20:00.539334+0000","last_unstale":"2024-09-17T05:20:00.546696+0000","last_undegraded":"2024-09-17T05:20:00.546696+0000","last_fullsized":"2024-09-17T05:20:00.546696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:54.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540962+0000","last_change":"2024-09-17T05:20:00.538481+0000","last_active":"2024-09-17T05:20:00.540962+0000","last_peered":"2024-09-17T05:20:00.540962+0000","last_clean":"2024-09-17T05:20:00.540962+0000","last_became_active":"2024-09-17T05:20:00.538224+0000","last_became_peered":"2024-09-17T05:20:00.538224+0000","last_unstale":"2024-09-17T05:20:00.540962+0000","last_undegraded":"2024-09-17T05:20:00.540962+0000","last_fullsized":"2024-09-17T05:20:00.540962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:58.772520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548997+0000","last_change":"2024-09-17T05:20:00.545333+0000","last_active":"2024-09-17T05:20:00.548997+0000","last_peered":"2024-09-17T05:20:00.548997+0000","last_clean":"2024-09-17T05:20:00.548997+0000","last_became_active":"2024-09-17T05:20:00.545083+0000","last_became_peered":"2024-09-17T05:20:00.545083+0000","last_unstale":"2024-09-17T05:20:00.548997+0000","last_undegraded":"2024-09-17T05:20:00.548997+0000","last_fullsized":"2024-09-17T05:20:00.548997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:35.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539931+0000","last_change":"2024-09-17T05:20:00.538315+0000","last_active":"2024-09-17T05:20:00.539931+0000","last_peered":"2024-09-17T05:20:00.539931+0000","last_clean":"2024-09-17T05:20:00.539931+0000","last_became_active":"2024-09-17T05:20:00.537973+0000","last_became_peered":"2024-09-17T05:20:00.537973+0000","last_unstale":"2024-09-17T05:20:00.539931+0000","last_undegraded":"2024-09-17T05:20:00.539931+0000","last_fullsized":"2024-09-17T05:20:00.539931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545590+0000","last_change":"2024-09-17T05:20:00.541799+0000","last_active":"2024-09-17T05:20:00.545590+0000","last_peered":"2024-09-17T05:20:00.545590+0000","last_clean":"2024-09-17T05:20:00.545590+0000","last_became_active":"2024-09-17T05:20:00.541529+0000","last_became_peered":"2024-09-17T05:20:00.541529+0000","last_unstale":"2024-09-17T05:20:00.545590+0000","last_undegraded":"2024-09-17T05:20:00.545590+0000","last_fullsized":"2024-09-17T05:20:00.545590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:03.967733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544389+0000","last_change":"2024-09-17T05:20:00.542069+0000","last_active":"2024-09-17T05:20:00.544389+0000","last_peered":"2024-09-17T05:20:00.544389+0000","last_clean":"2024-09-17T05:20:00.544389+0000","last_became_active":"2024-09-17T05:20:00.541760+0000","last_became_peered":"2024-09-17T05:20:00.541760+0000","last_unstale":"2024-09-17T05:20:00.544389+0000","last_undegraded":"2024-09-17T05:20:00.544389+0000","last_fullsized":"2024-09-17T05:20:00.544389+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:00.588738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547432+0000","last_change":"2024-09-17T05:20:00.543451+0000","last_active":"2024-09-17T05:20:00.547432+0000","last_peered":"2024-09-17T05:20:00.547432+0000","last_clean":"2024-09-17T05:20:00.547432+0000","last_became_active":"2024-09-17T05:20:00.542502+0000","last_became_peered":"2024-09-17T05:20:00.542502+0000","last_unstale":"2024-09-17T05:20:00.547432+0000","last_undegraded":"2024-09-17T05:20:00.547432+0000","last_fullsized":"2024-09-17T05:20:00.547432+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:36.840738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543766+0000","last_change":"2024-09-17T05:20:00.540658+0000","last_active":"2024-09-17T05:20:00.543766+0000","last_peered":"2024-09-17T05:20:00.543766+0000","last_clean":"2024-09-17T05:20:00.543766+0000","last_became_active":"2024-09-17T05:20:00.540374+0000","last_became_peered":"2024-09-17T05:20:00.540374+0000","last_unstale":"2024-09-17T05:20:00.543766+0000","last_undegraded":"2024-09-17T05:20:00.543766+0000","last_fullsized":"2024-09-17T05:20:00.543766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549769+0000","last_change":"2024-09-17T05:20:00.547853+0000","last_active":"2024-09-17T05:20:00.549769+0000","last_peered":"2024-09-17T05:20:00.549769+0000","last_clean":"2024-09-17T05:20:00.549769+0000","last_became_active":"2024-09-17T05:20:00.547005+0000","last_became_peered":"2024-09-17T05:20:00.547005+0000","last_unstale":"2024-09-17T05:20:00.549769+0000","last_undegraded":"2024-09-17T05:20:00.549769+0000","last_fullsized":"2024-09-17T05:20:00.549769+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:51.663396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549807+0000","last_change":"2024-09-17T05:20:00.547374+0000","last_active":"2024-09-17T05:20:00.549807+0000","last_peered":"2024-09-17T05:20:00.549807+0000","last_clean":"2024-09-17T05:20:00.549807+0000","last_became_active":"2024-09-17T05:20:00.547086+0000","last_became_peered":"2024-09-17T05:20:00.547086+0000","last_unstale":"2024-09-17T05:20:00.549807+0000","last_undegraded":"2024-09-17T05:20:00.549807+0000","last_fullsized":"2024-09-17T05:20:00.549807+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546316+0000","last_change":"2024-09-17T05:20:00.542690+0000","last_active":"2024-09-17T05:20:00.546316+0000","last_peered":"2024-09-17T05:20:00.546316+0000","last_clean":"2024-09-17T05:20:00.546316+0000","last_became_active":"2024-09-17T05:20:00.542349+0000","last_became_peered":"2024-09-17T05:20:00.542349+0000","last_unstale":"2024-09-17T05:20:00.546316+0000","last_undegraded":"2024-09-17T05:20:00.546316+0000","last_fullsized":"2024-09-17T05:20:00.546316+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:52.854277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546642+0000","last_change":"2024-09-17T05:20:00.539389+0000","last_active":"2024-09-17T05:20:00.546642+0000","last_peered":"2024-09-17T05:20:00.546642+0000","last_clean":"2024-09-17T05:20:00.546642+0000","last_became_active":"2024-09-17T05:20:00.539098+0000","last_became_peered":"2024-09-17T05:20:00.539098+0000","last_unstale":"2024-09-17T05:20:00.546642+0000","last_undegraded":"2024-09-17T05:20:00.546642+0000","last_fullsized":"2024-09-17T05:20:00.546642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:40.028949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545763+0000","last_change":"2024-09-17T05:20:00.543003+0000","last_active":"2024-09-17T05:20:00.545763+0000","last_peered":"2024-09-17T05:20:00.545763+0000","last_clean":"2024-09-17T05:20:00.545763+0000","last_became_active":"2024-09-17T05:20:00.542562+0000","last_became_peered":"2024-09-17T05:20:00.542562+0000","last_unstale":"2024-09-17T05:20:00.545763+0000","last_undegraded":"2024-09-17T05:20:00.545763+0000","last_fullsized":"2024-09-17T05:20:00.545763+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:33.584816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542766+0000","last_change":"2024-09-17T05:20:00.540456+0000","last_active":"2024-09-17T05:20:00.542766+0000","last_peered":"2024-09-17T05:20:00.542766+0000","last_clean":"2024-09-17T05:20:00.542766+0000","last_became_active":"2024-09-17T05:20:00.540089+0000","last_became_peered":"2024-09-17T05:20:00.540089+0000","last_unstale":"2024-09-17T05:20:00.542766+0000","last_undegraded":"2024-09-17T05:20:00.542766+0000","last_fullsized":"2024-09-17T05:20:00.542766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:56.542144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543457+0000","last_change":"2024-09-17T05:20:00.542080+0000","last_active":"2024-09-17T05:20:00.543457+0000","last_peered":"2024-09-17T05:20:00.543457+0000","last_clean":"2024-09-17T05:20:00.543457+0000","last_became_active":"2024-09-17T05:20:00.541796+0000","last_became_peered":"2024-09-17T05:20:00.541796+0000","last_unstale":"2024-09-17T05:20:00.543457+0000","last_undegraded":"2024-09-17T05:20:00.543457+0000","last_fullsized":"2024-09-17T05:20:00.543457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:55.283438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550421+0000","last_change":"2024-09-17T05:20:00.549564+0000","last_active":"2024-09-17T05:20:00.550421+0000","last_peered":"2024-09-17T05:20:00.550421+0000","last_clean":"2024-09-17T05:20:00.550421+0000","last_became_active":"2024-09-17T05:20:00.549300+0000","last_became_peered":"2024-09-17T05:20:00.549300+0000","last_unstale":"2024-09-17T05:20:00.550421+0000","last_undegraded":"2024-09-17T05:20:00.550421+0000","last_fullsized":"2024-09-17T05:20:00.550421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.293708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550099+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550099+0000","last_peered":"2024-09-17T05:20:00.550099+0000","last_clean":"2024-09-17T05:20:00.550099+0000","last_became_active":"2024-09-17T05:20:00.544913+0000","last_became_peered":"2024-09-17T05:20:00.544913+0000","last_unstale":"2024-09-17T05:20:00.550099+0000","last_undegraded":"2024-09-17T05:20:00.550099+0000","last_fullsized":"2024-09-17T05:20:00.550099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:15.118672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550008+0000","last_change":"2024-09-17T05:20:00.548447+0000","last_active":"2024-09-17T05:20:00.550008+0000","last_peered":"2024-09-17T05:20:00.550008+0000","last_clean":"2024-09-17T05:20:00.550008+0000","last_became_active":"2024-09-17T05:20:00.548097+0000","last_became_peered":"2024-09-17T05:20:00.548097+0000","last_unstale":"2024-09-17T05:20:00.550008+0000","last_undegraded":"2024-09-17T05:20:00.550008+0000","last_fullsized":"2024-09-17T05:20:00.550008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:00.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552550+0000","last_change":"2024-09-17T05:20:00.547293+0000","last_active":"2024-09-17T05:20:00.552550+0000","last_peered":"2024-09-17T05:20:00.552550+0000","last_clean":"2024-09-17T05:20:00.552550+0000","last_became_active":"2024-09-17T05:20:00.547026+0000","last_became_peered":"2024-09-17T05:20:00.547026+0000","last_unstale":"2024-09-17T05:20:00.552550+0000","last_undegraded":"2024-09-17T05:20:00.552550+0000","last_fullsized":"2024-09-17T05:20:00.552550+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561768+0000","last_change":"2024-09-17T05:19:59.558973+0000","last_active":"2024-09-17T05:20:00.561768+0000","last_peered":"2024-09-17T05:20:00.561768+0000","last_clean":"2024-09-17T05:20:00.561768+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.561768+0000","last_undegraded":"2024-09-17T05:20:00.561768+0000","last_fullsized":"2024-09-17T05:20:00.561768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:00.930635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542569+0000","last_change":"2024-09-17T05:20:00.538883+0000","last_active":"2024-09-17T05:20:00.542569+0000","last_peered":"2024-09-17T05:20:00.542569+0000","last_clean":"2024-09-17T05:20:00.542569+0000","last_became_active":"2024-09-17T05:20:00.538502+0000","last_became_peered":"2024-09-17T05:20:00.538502+0000","last_unstale":"2024-09-17T05:20:00.542569+0000","last_undegraded":"2024-09-17T05:20:00.542569+0000","last_fullsized":"2024-09-17T05:20:00.542569+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:25.828995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559950+0000","last_change":"2024-09-17T05:19:59.559007+0000","last_active":"2024-09-17T05:20:00.559950+0000","last_peered":"2024-09-17T05:20:00.559950+0000","last_clean":"2024-09-17T05:20:00.559950+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.559950+0000","last_undegraded":"2024-09-17T05:20:00.559950+0000","last_fullsized":"2024-09-17T05:20:00.559950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548169+0000","last_change":"2024-09-17T05:20:00.545138+0000","last_active":"2024-09-17T05:20:00.548169+0000","last_peered":"2024-09-17T05:20:00.548169+0000","last_clean":"2024-09-17T05:20:00.548169+0000","last_became_active":"2024-09-17T05:20:00.544865+0000","last_became_peered":"2024-09-17T05:20:00.544865+0000","last_unstale":"2024-09-17T05:20:00.548169+0000","last_undegraded":"2024-09-17T05:20:00.548169+0000","last_fullsized":"2024-09-17T05:20:00.548169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:24.925391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560906+0000","last_change":"2024-09-17T05:19:59.563623+0000","last_active":"2024-09-17T05:20:00.560906+0000","last_peered":"2024-09-17T05:20:00.560906+0000","last_clean":"2024-09-17T05:20:00.560906+0000","last_became_active":"2024-09-17T05:19:59.563315+0000","last_became_peered":"2024-09-17T05:19:59.563315+0000","last_unstale":"2024-09-17T05:20:00.560906+0000","last_undegraded":"2024-09-17T05:20:00.560906+0000","last_fullsized":"2024-09-17T05:20:00.560906+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:18.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551313+0000","last_change":"2024-09-17T05:20:00.544721+0000","last_active":"2024-09-17T05:20:00.551313+0000","last_peered":"2024-09-17T05:20:00.551313+0000","last_clean":"2024-09-17T05:20:00.551313+0000","last_became_active":"2024-09-17T05:20:00.544443+0000","last_became_peered":"2024-09-17T05:20:00.544443+0000","last_unstale":"2024-09-17T05:20:00.551313+0000","last_undegraded":"2024-09-17T05:20:00.551313+0000","last_fullsized":"2024-09-17T05:20:00.551313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560899+0000","last_change":"2024-09-17T05:19:59.564861+0000","last_active":"2024-09-17T05:20:00.560899+0000","last_peered":"2024-09-17T05:20:00.560899+0000","last_clean":"2024-09-17T05:20:00.560899+0000","last_became_active":"2024-09-17T05:19:59.564565+0000","last_became_peered":"2024-09-17T05:19:59.564565+0000","last_unstale":"2024-09-17T05:20:00.560899+0000","last_undegraded":"2024-09-17T05:20:00.560899+0000","last_fullsized":"2024-09-17T05:20:00.560899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549902+0000","last_change":"2024-09-17T05:20:00.539449+0000","last_active":"2024-09-17T05:20:00.549902+0000","last_peered":"2024-09-17T05:20:00.549902+0000","last_clean":"2024-09-17T05:20:00.549902+0000","last_became_active":"2024-09-17T05:20:00.539171+0000","last_became_peered":"2024-09-17T05:20:00.539171+0000","last_unstale":"2024-09-17T05:20:00.549902+0000","last_undegraded":"2024-09-17T05:20:00.549902+0000","last_fullsized":"2024-09-17T05:20:00.549902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:43.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561116+0000","last_change":"2024-09-17T05:19:59.562556+0000","last_active":"2024-09-17T05:20:00.561116+0000","last_peered":"2024-09-17T05:20:00.561116+0000","last_clean":"2024-09-17T05:20:00.561116+0000","last_became_active":"2024-09-17T05:19:59.562255+0000","last_became_peered":"2024-09-17T05:19:59.562255+0000","last_unstale":"2024-09-17T05:20:00.561116+0000","last_undegraded":"2024-09-17T05:20:00.561116+0000","last_fullsized":"2024-09-17T05:20:00.561116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:47.640069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.558324+0000","last_change":"2024-09-17T05:19:59.558825+0000","last_active":"2024-09-17T05:20:00.558324+0000","last_peered":"2024-09-17T05:20:00.558324+0000","last_clean":"2024-09-17T05:20:00.558324+0000","last_became_active":"2024-09-17T05:19:59.558529+0000","last_became_peered":"2024-09-17T05:19:59.558529+0000","last_unstale":"2024-09-17T05:20:00.558324+0000","last_undegraded":"2024-09-17T05:20:00.558324+0000","last_fullsized":"2024-09-17T05:20:00.558324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:42.182629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534516+0000","last_change":"2024-09-17T05:19:59.563788+0000","last_active":"2024-09-17T05:20:00.534516+0000","last_peered":"2024-09-17T05:20:00.534516+0000","last_clean":"2024-09-17T05:20:00.534516+0000","last_became_active":"2024-09-17T05:19:59.563534+0000","last_became_peered":"2024-09-17T05:19:59.563534+0000","last_unstale":"2024-09-17T05:20:00.534516+0000","last_undegraded":"2024-09-17T05:20:00.534516+0000","last_fullsized":"2024-09-17T05:20:00.534516+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.937150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549799+0000","last_change":"2024-09-17T05:20:00.548448+0000","last_active":"2024-09-17T05:20:00.549799+0000","last_peered":"2024-09-17T05:20:00.549799+0000","last_clean":"2024-09-17T05:20:00.549799+0000","last_became_active":"2024-09-17T05:20:00.547380+0000","last_became_peered":"2024-09-17T05:20:00.547380+0000","last_unstale":"2024-09-17T05:20:00.549799+0000","last_undegraded":"2024-09-17T05:20:00.549799+0000","last_fullsized":"2024-09-17T05:20:00.549799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:43.184923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545623+0000","last_change":"2024-09-17T05:20:00.542588+0000","last_active":"2024-09-17T05:20:00.545623+0000","last_peered":"2024-09-17T05:20:00.545623+0000","last_clean":"2024-09-17T05:20:00.545623+0000","last_became_active":"2024-09-17T05:20:00.542297+0000","last_became_peered":"2024-09-17T05:20:00.542297+0000","last_unstale":"2024-09-17T05:20:00.545623+0000","last_undegraded":"2024-09-17T05:20:00.545623+0000","last_fullsized":"2024-09-17T05:20:00.545623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:21.905648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530770+0000","last_change":"2024-09-17T05:19:59.558968+0000","last_active":"2024-09-17T05:20:00.530770+0000","last_peered":"2024-09-17T05:20:00.530770+0000","last_clean":"2024-09-17T05:20:00.530770+0000","last_became_active":"2024-09-17T05:19:59.558447+0000","last_became_peered":"2024-09-17T05:19:59.558447+0000","last_unstale":"2024-09-17T05:20:00.530770+0000","last_undegraded":"2024-09-17T05:20:00.530770+0000","last_fullsized":"2024-09-17T05:20:00.530770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552010+0000","last_change":"2024-09-17T05:20:00.548751+0000","last_active":"2024-09-17T05:20:00.552010+0000","last_peered":"2024-09-17T05:20:00.552010+0000","last_clean":"2024-09-17T05:20:00.552010+0000","last_became_active":"2024-09-17T05:20:00.548410+0000","last_became_peered":"2024-09-17T05:20:00.548410+0000","last_unstale":"2024-09-17T05:20:00.552010+0000","last_undegraded":"2024-09-17T05:20:00.552010+0000","last_fullsized":"2024-09-17T05:20:00.552010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:48.642363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546853+0000","last_change":"2024-09-17T05:20:00.543079+0000","last_active":"2024-09-17T05:20:00.546853+0000","last_peered":"2024-09-17T05:20:00.546853+0000","last_clean":"2024-09-17T05:20:00.546853+0000","last_became_active":"2024-09-17T05:20:00.542816+0000","last_became_peered":"2024-09-17T05:20:00.542816+0000","last_unstale":"2024-09-17T05:20:00.546853+0000","last_undegraded":"2024-09-17T05:20:00.546853+0000","last_fullsized":"2024-09-17T05:20:00.546853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:02.274063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560749+0000","last_change":"2024-09-17T05:19:59.565867+0000","last_active":"2024-09-17T05:20:00.560749+0000","last_peered":"2024-09-17T05:20:00.560749+0000","last_clean":"2024-09-17T05:20:00.560749+0000","last_became_active":"2024-09-17T05:19:59.565572+0000","last_became_peered":"2024-09-17T05:19:59.565572+0000","last_unstale":"2024-09-17T05:20:00.560749+0000","last_undegraded":"2024-09-17T05:20:00.560749+0000","last_fullsized":"2024-09-17T05:20:00.560749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:30.724384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551879+0000","last_change":"2024-09-17T05:20:00.548336+0000","last_active":"2024-09-17T05:20:00.551879+0000","last_peered":"2024-09-17T05:20:00.551879+0000","last_clean":"2024-09-17T05:20:00.551879+0000","last_became_active":"2024-09-17T05:20:00.548016+0000","last_became_peered":"2024-09-17T05:20:00.548016+0000","last_unstale":"2024-09-17T05:20:00.551879+0000","last_undegraded":"2024-09-17T05:20:00.551879+0000","last_fullsized":"2024-09-17T05:20:00.551879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:01.932930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.562965+0000","last_change":"2024-09-17T05:19:59.559093+0000","last_active":"2024-09-17T05:20:00.562965+0000","last_peered":"2024-09-17T05:20:00.562965+0000","last_clean":"2024-09-17T05:20:00.562965+0000","last_became_active":"2024-09-17T05:19:59.558796+0000","last_became_peered":"2024-09-17T05:19:59.558796+0000","last_unstale":"2024-09-17T05:20:00.562965+0000","last_undegraded":"2024-09-17T05:20:00.562965+0000","last_fullsized":"2024-09-17T05:20:00.562965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:10.022680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543996+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.542577+0000","last_became_peered":"2024-09-17T05:20:00.542577+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:59.305586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560577+0000","last_change":"2024-09-17T05:19:59.559096+0000","last_active":"2024-09-17T05:20:00.560577+0000","last_peered":"2024-09-17T05:20:00.560577+0000","last_clean":"2024-09-17T05:20:00.560577+0000","last_became_active":"2024-09-17T05:19:59.558466+0000","last_became_peered":"2024-09-17T05:19:59.558466+0000","last_unstale":"2024-09-17T05:20:00.560577+0000","last_undegraded":"2024-09-17T05:20:00.560577+0000","last_fullsized":"2024-09-17T05:20:00.560577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:02.120617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539497+0000","last_change":"2024-09-17T05:19:59.563984+0000","last_active":"2024-09-17T05:20:00.539497+0000","last_peered":"2024-09-17T05:20:00.539497+0000","last_clean":"2024-09-17T05:20:00.539497+0000","last_became_active":"2024-09-17T05:19:59.563645+0000","last_became_peered":"2024-09-17T05:19:59.563645+0000","last_unstale":"2024-09-17T05:20:00.539497+0000","last_undegraded":"2024-09-17T05:20:00.539497+0000","last_fullsized":"2024-09-17T05:20:00.539497+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:32.582522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546729+0000","last_change":"2024-09-17T05:20:00.541286+0000","last_active":"2024-09-17T05:20:00.546729+0000","last_peered":"2024-09-17T05:20:00.546729+0000","last_clean":"2024-09-17T05:20:00.546729+0000","last_became_active":"2024-09-17T05:20:00.541020+0000","last_became_peered":"2024-09-17T05:20:00.541020+0000","last_unstale":"2024-09-17T05:20:00.546729+0000","last_undegraded":"2024-09-17T05:20:00.546729+0000","last_fullsized":"2024-09-17T05:20:00.546729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:17.537507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534738+0000","last_change":"2024-09-17T05:19:59.563576+0000","last_active":"2024-09-17T05:20:00.534738+0000","last_peered":"2024-09-17T05:20:00.534738+0000","last_clean":"2024-09-17T05:20:00.534738+0000","last_became_active":"2024-09-17T05:19:59.563297+0000","last_became_peered":"2024-09-17T05:19:59.563297+0000","last_unstale":"2024-09-17T05:20:00.534738+0000","last_undegraded":"2024-09-17T05:20:00.534738+0000","last_fullsized":"2024-09-17T05:20:00.534738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:16.800054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552885+0000","last_change":"2024-09-17T05:20:00.550850+0000","last_active":"2024-09-17T05:20:00.552885+0000","last_peered":"2024-09-17T05:20:00.552885+0000","last_clean":"2024-09-17T05:20:00.552885+0000","last_became_active":"2024-09-17T05:20:00.550558+0000","last_became_peered":"2024-09-17T05:20:00.550558+0000","last_unstale":"2024-09-17T05:20:00.552885+0000","last_undegraded":"2024-09-17T05:20:00.552885+0000","last_fullsized":"2024-09-17T05:20:00.552885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:55.244688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546737+0000","last_change":"2024-09-17T05:20:00.541991+0000","last_active":"2024-09-17T05:20:00.546737+0000","last_peered":"2024-09-17T05:20:00.546737+0000","last_clean":"2024-09-17T05:20:00.546737+0000","last_became_active":"2024-09-17T05:20:00.541748+0000","last_became_peered":"2024-09-17T05:20:00.541748+0000","last_unstale":"2024-09-17T05:20:00.546737+0000","last_undegraded":"2024-09-17T05:20:00.546737+0000","last_fullsized":"2024-09-17T05:20:00.546737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:17.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560320+0000","last_change":"2024-09-17T05:19:59.556315+0000","last_active":"2024-09-17T05:20:00.560320+0000","last_peered":"2024-09-17T05:20:00.560320+0000","last_clean":"2024-09-17T05:20:00.560320+0000","last_became_active":"2024-09-17T05:19:59.556024+0000","last_became_peered":"2024-09-17T05:19:59.556024+0000","last_unstale":"2024-09-17T05:20:00.560320+0000","last_undegraded":"2024-09-17T05:20:00.560320+0000","last_fullsized":"2024-09-17T05:20:00.560320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:16.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559848+0000","last_change":"2024-09-17T05:19:59.560582+0000","last_active":"2024-09-17T05:20:00.559848+0000","last_peered":"2024-09-17T05:20:00.559848+0000","last_clean":"2024-09-17T05:20:00.559848+0000","last_became_active":"2024-09-17T05:19:59.560282+0000","last_became_peered":"2024-09-17T05:19:59.560282+0000","last_unstale":"2024-09-17T05:20:00.559848+0000","last_undegraded":"2024-09-17T05:20:00.559848+0000","last_fullsized":"2024-09-17T05:20:00.559848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.203376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543830+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.543210+0000","last_became_peered":"2024-09-17T05:20:00.543210+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:55.720457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560488+0000","last_change":"2024-09-17T05:19:59.564268+0000","last_active":"2024-09-17T05:20:00.560488+0000","last_peered":"2024-09-17T05:20:00.560488+0000","last_clean":"2024-09-17T05:20:00.560488+0000","last_became_active":"2024-09-17T05:19:59.563909+0000","last_became_peered":"2024-09-17T05:19:59.563909+0000","last_unstale":"2024-09-17T05:20:00.560488+0000","last_undegraded":"2024-09-17T05:20:00.560488+0000","last_fullsized":"2024-09-17T05:20:00.560488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:56.717406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549012+0000","last_change":"2024-09-17T05:20:00.544504+0000","last_active":"2024-09-17T05:20:00.549012+0000","last_peered":"2024-09-17T05:20:00.549012+0000","last_clean":"2024-09-17T05:20:00.549012+0000","last_became_active":"2024-09-17T05:20:00.544123+0000","last_became_peered":"2024-09-17T05:20:00.544123+0000","last_unstale":"2024-09-17T05:20:00.549012+0000","last_undegraded":"2024-09-17T05:20:00.549012+0000","last_fullsized":"2024-09-17T05:20:00.549012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:36.647387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535470+0000","last_change":"2024-09-17T05:19:59.558812+0000","last_active":"2024-09-17T05:20:00.535470+0000","last_peered":"2024-09-17T05:20:00.535470+0000","last_clean":"2024-09-17T05:20:00.535470+0000","last_became_active":"2024-09-17T05:19:59.558524+0000","last_became_peered":"2024-09-17T05:19:59.558524+0000","last_unstale":"2024-09-17T05:20:00.535470+0000","last_undegraded":"2024-09-17T05:20:00.535470+0000","last_fullsized":"2024-09-17T05:20:00.535470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:59.938453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543730+0000","last_change":"2024-09-17T05:20:00.540236+0000","last_active":"2024-09-17T05:20:00.543730+0000","last_peered":"2024-09-17T05:20:00.543730+0000","last_clean":"2024-09-17T05:20:00.543730+0000","last_became_active":"2024-09-17T05:20:00.539968+0000","last_became_peered":"2024-09-17T05:20:00.539968+0000","last_unstale":"2024-09-17T05:20:00.543730+0000","last_undegraded":"2024-09-17T05:20:00.543730+0000","last_fullsized":"2024-09-17T05:20:00.543730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:49.650410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561737+0000","last_change":"2024-09-17T05:19:59.562482+0000","last_active":"2024-09-17T05:20:00.561737+0000","last_peered":"2024-09-17T05:20:00.561737+0000","last_clean":"2024-09-17T05:20:00.561737+0000","last_became_active":"2024-09-17T05:19:59.562197+0000","last_became_peered":"2024-09-17T05:19:59.562197+0000","last_unstale":"2024-09-17T05:20:00.561737+0000","last_undegraded":"2024-09-17T05:20:00.561737+0000","last_fullsized":"2024-09-17T05:20:00.561737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:54.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547002+0000","last_change":"2024-09-17T05:20:00.542587+0000","last_active":"2024-09-17T05:20:00.547002+0000","last_peered":"2024-09-17T05:20:00.547002+0000","last_clean":"2024-09-17T05:20:00.547002+0000","last_became_active":"2024-09-17T05:20:00.542114+0000","last_became_peered":"2024-09-17T05:20:00.542114+0000","last_unstale":"2024-09-17T05:20:00.547002+0000","last_undegraded":"2024-09-17T05:20:00.547002+0000","last_fullsized":"2024-09-17T05:20:00.547002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:52.205670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534742+0000","last_change":"2024-09-17T05:19:59.559159+0000","last_active":"2024-09-17T05:20:00.534742+0000","last_peered":"2024-09-17T05:20:00.534742+0000","last_clean":"2024-09-17T05:20:00.534742+0000","last_became_active":"2024-09-17T05:19:59.558919+0000","last_became_peered":"2024-09-17T05:19:59.558919+0000","last_unstale":"2024-09-17T05:20:00.534742+0000","last_undegraded":"2024-09-17T05:20:00.534742+0000","last_fullsized":"2024-09-17T05:20:00.534742+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.735582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549982+0000","last_change":"2024-09-17T05:20:00.547679+0000","last_active":"2024-09-17T05:20:00.549982+0000","last_peered":"2024-09-17T05:20:00.549982+0000","last_clean":"2024-09-17T05:20:00.549982+0000","last_became_active":"2024-09-17T05:20:00.547424+0000","last_became_peered":"2024-09-17T05:20:00.547424+0000","last_unstale":"2024-09-17T05:20:00.549982+0000","last_undegraded":"2024-09-17T05:20:00.549982+0000","last_fullsized":"2024-09-17T05:20:00.549982+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:43.113899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539592+0000","last_change":"2024-09-17T05:19:59.566679+0000","last_active":"2024-09-17T05:20:00.539592+0000","last_peered":"2024-09-17T05:20:00.539592+0000","last_clean":"2024-09-17T05:20:00.539592+0000","last_became_active":"2024-09-17T05:19:59.566350+0000","last_became_peered":"2024-09-17T05:19:59.566350+0000","last_unstale":"2024-09-17T05:20:00.539592+0000","last_undegraded":"2024-09-17T05:20:00.539592+0000","last_fullsized":"2024-09-17T05:20:00.539592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.291413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548877+0000","last_change":"2024-09-17T05:20:00.545489+0000","last_active":"2024-09-17T05:20:00.548877+0000","last_peered":"2024-09-17T05:20:00.548877+0000","last_clean":"2024-09-17T05:20:00.548877+0000","last_became_active":"2024-09-17T05:20:00.545052+0000","last_became_peered":"2024-09-17T05:20:00.545052+0000","last_unstale":"2024-09-17T05:20:00.548877+0000","last_undegraded":"2024-09-17T05:20:00.548877+0000","last_fullsized":"2024-09-17T05:20:00.548877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:23.670327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534933+0000","last_change":"2024-09-17T05:19:59.561764+0000","last_active":"2024-09-17T05:20:00.534933+0000","last_peered":"2024-09-17T05:20:00.534933+0000","last_clean":"2024-09-17T05:20:00.534933+0000","last_became_active":"2024-09-17T05:19:59.561368+0000","last_became_peered":"2024-09-17T05:19:59.561368+0000","last_unstale":"2024-09-17T05:20:00.534933+0000","last_undegraded":"2024-09-17T05:20:00.534933+0000","last_fullsized":"2024-09-17T05:20:00.534933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:27.664506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544127+0000","last_change":"2024-09-17T05:19:59.566316+0000","last_active":"2024-09-17T05:20:00.544127+0000","last_peered":"2024-09-17T05:20:00.544127+0000","last_clean":"2024-09-17T05:20:00.544127+0000","last_became_active":"2024-09-17T05:19:59.565973+0000","last_became_peered":"2024-09-17T05:19:59.565973+0000","last_unstale":"2024-09-17T05:20:00.544127+0000","last_undegraded":"2024-09-17T05:20:00.544127+0000","last_fullsized":"2024-09-17T05:20:00.544127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:30.046614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551973+0000","last_change":"2024-09-17T05:20:00.549077+0000","last_active":"2024-09-17T05:20:00.551973+0000","last_peered":"2024-09-17T05:20:00.551973+0000","last_clean":"2024-09-17T05:20:00.551973+0000","last_became_active":"2024-09-17T05:20:00.548735+0000","last_became_peered":"2024-09-17T05:20:00.548735+0000","last_unstale":"2024-09-17T05:20:00.551973+0000","last_undegraded":"2024-09-17T05:20:00.551973+0000","last_fullsized":"2024-09-17T05:20:00.551973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:03.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541878+0000","last_change":"2024-09-17T05:19:59.563528+0000","last_active":"2024-09-17T05:20:00.541878+0000","last_peered":"2024-09-17T05:20:00.541878+0000","last_clean":"2024-09-17T05:20:00.541878+0000","last_became_active":"2024-09-17T05:19:59.563264+0000","last_became_peered":"2024-09-17T05:19:59.563264+0000","last_unstale":"2024-09-17T05:20:00.541878+0000","last_undegraded":"2024-09-17T05:20:00.541878+0000","last_fullsized":"2024-09-17T05:20:00.541878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552526+0000","last_change":"2024-09-17T05:20:00.548525+0000","last_active":"2024-09-17T05:20:00.552526+0000","last_peered":"2024-09-17T05:20:00.552526+0000","last_clean":"2024-09-17T05:20:00.552526+0000","last_became_active":"2024-09-17T05:20:00.548220+0000","last_became_peered":"2024-09-17T05:20:00.548220+0000","last_unstale":"2024-09-17T05:20:00.552526+0000","last_undegraded":"2024-09-17T05:20:00.552526+0000","last_fullsized":"2024-09-17T05:20:00.552526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:59.514166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540949+0000","last_change":"2024-09-17T05:19:59.565271+0000","last_active":"2024-09-17T05:20:00.540949+0000","last_peered":"2024-09-17T05:20:00.540949+0000","last_clean":"2024-09-17T05:20:00.540949+0000","last_became_active":"2024-09-17T05:19:59.565009+0000","last_became_peered":"2024-09-17T05:19:59.565009+0000","last_unstale":"2024-09-17T05:20:00.540949+0000","last_undegraded":"2024-09-17T05:20:00.540949+0000","last_fullsized":"2024-09-17T05:20:00.540949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:45.135132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550082+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550082+0000","last_peered":"2024-09-17T05:20:00.550082+0000","last_clean":"2024-09-17T05:20:00.550082+0000","last_became_active":"2024-09-17T05:20:00.544930+0000","last_became_peered":"2024-09-17T05:20:00.544930+0000","last_unstale":"2024-09-17T05:20:00.550082+0000","last_undegraded":"2024-09-17T05:20:00.550082+0000","last_fullsized":"2024-09-17T05:20:00.550082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:50.027809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530552+0000","last_change":"2024-09-17T05:19:59.561592+0000","last_active":"2024-09-17T05:20:00.530552+0000","last_peered":"2024-09-17T05:20:00.530552+0000","last_clean":"2024-09-17T05:20:00.530552+0000","last_became_active":"2024-09-17T05:19:59.561328+0000","last_became_peered":"2024-09-17T05:19:59.561328+0000","last_unstale":"2024-09-17T05:20:00.530552+0000","last_undegraded":"2024-09-17T05:20:00.530552+0000","last_fullsized":"2024-09-17T05:20:00.530552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:27.670831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552195+0000","last_change":"2024-09-17T05:20:00.550589+0000","last_active":"2024-09-17T05:20:00.552195+0000","last_peered":"2024-09-17T05:20:00.552195+0000","last_clean":"2024-09-17T05:20:00.552195+0000","last_became_active":"2024-09-17T05:20:00.550353+0000","last_became_peered":"2024-09-17T05:20:00.550353+0000","last_unstale":"2024-09-17T05:20:00.552195+0000","last_undegraded":"2024-09-17T05:20:00.552195+0000","last_fullsized":"2024-09-17T05:20:00.552195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:10.302010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541854+0000","last_change":"2024-09-17T05:19:59.560425+0000","last_active":"2024-09-17T05:20:00.541854+0000","last_peered":"2024-09-17T05:20:00.541854+0000","last_clean":"2024-09-17T05:20:00.541854+0000","last_became_active":"2024-09-17T05:19:59.560173+0000","last_became_peered":"2024-09-17T05:19:59.560173+0000","last_unstale":"2024-09-17T05:20:00.541854+0000","last_undegraded":"2024-09-17T05:20:00.541854+0000","last_fullsized":"2024-09-17T05:20:00.541854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540317+0000","last_change":"2024-09-17T05:20:00.539142+0000","last_active":"2024-09-17T05:20:00.540317+0000","last_peered":"2024-09-17T05:20:00.540317+0000","last_clean":"2024-09-17T05:20:00.540317+0000","last_became_active":"2024-09-17T05:20:00.538724+0000","last_became_peered":"2024-09-17T05:20:00.538724+0000","last_unstale":"2024-09-17T05:20:00.540317+0000","last_undegraded":"2024-09-17T05:20:00.540317+0000","last_fullsized":"2024-09-17T05:20:00.540317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561450+0000","last_change":"2024-09-17T05:19:59.560442+0000","last_active":"2024-09-17T05:20:00.561450+0000","last_peered":"2024-09-17T05:20:00.561450+0000","last_clean":"2024-09-17T05:20:00.561450+0000","last_became_active":"2024-09-17T05:19:59.560155+0000","last_became_peered":"2024-09-17T05:19:59.560155+0000","last_unstale":"2024-09-17T05:20:00.561450+0000","last_undegraded":"2024-09-17T05:20:00.561450+0000","last_fullsized":"2024-09-17T05:20:00.561450+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:57.146571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539697+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:20:00.539697+0000","last_peered":"2024-09-17T05:20:00.539697+0000","last_clean":"2024-09-17T05:20:00.539697+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:20:00.539697+0000","last_undegraded":"2024-09-17T05:20:00.539697+0000","last_fullsized":"2024-09-17T05:20:00.539697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":201991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":202931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":194544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1064960,"data_stored":772828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:20:04.209 INFO:tasks.ceph.ceph_manager.ceph:PG 7.3c is not active+clean 2024-09-17T05:20:04.209 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:PG 7.38 is not active+clean 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:PG 7.37 is not active+clean 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:PG 7.36 is not active+clean 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:PG 7.35 is not active+clean 2024-09-17T05:20:04.210 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:PG 7.32 is not active+clean 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:PG 7.2a is not active+clean 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:PG 7.1b is not active+clean 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:PG 7.18 is not active+clean 2024-09-17T05:20:04.211 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:PG 6.18 is not active+clean 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:58.533148+0000', 'last_change': '2024-09-17T05:19:58.533148+0000', 'last_active': '2024-09-17T05:19:58.533148+0000', 'last_peered': '2024-09-17T05:19:58.533148+0000', 'last_clean': '2024-09-17T05:19:58.533148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:58.533148+0000', 'last_undegraded': '2024-09-17T05:19:58.533148+0000', 'last_fullsized': '2024-09-17T05:19:58.533148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:PG 6.16 is not active+clean 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:58.533148+0000', 'last_change': '2024-09-17T05:19:58.533148+0000', 'last_active': '2024-09-17T05:19:58.533148+0000', 'last_peered': '2024-09-17T05:19:58.533148+0000', 'last_clean': '2024-09-17T05:19:58.533148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:58.533148+0000', 'last_undegraded': '2024-09-17T05:19:58.533148+0000', 'last_fullsized': '2024-09-17T05:19:58.533148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:PG 7.13 is not active+clean 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:PG 6.10 is not active+clean 2024-09-17T05:20:04.212 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:58.533148+0000', 'last_change': '2024-09-17T05:19:58.533148+0000', 'last_active': '2024-09-17T05:19:58.533148+0000', 'last_peered': '2024-09-17T05:19:58.533148+0000', 'last_clean': '2024-09-17T05:19:58.533148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:58.533148+0000', 'last_undegraded': '2024-09-17T05:19:58.533148+0000', 'last_fullsized': '2024-09-17T05:19:58.533148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:PG 7.f is not active+clean 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:PG 6.9 is not active+clean 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:58.533148+0000', 'last_change': '2024-09-17T05:19:58.533148+0000', 'last_active': '2024-09-17T05:19:58.533148+0000', 'last_peered': '2024-09-17T05:19:58.533148+0000', 'last_clean': '2024-09-17T05:19:58.533148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:58.533148+0000', 'last_undegraded': '2024-09-17T05:19:58.533148+0000', 'last_fullsized': '2024-09-17T05:19:58.533148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:PG 7.9 is not active+clean 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:PG 7.4 is not active+clean 2024-09-17T05:20:04.213 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.214 INFO:tasks.ceph.ceph_manager.ceph:PG 6.0 is not active+clean 2024-09-17T05:20:04.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:58.533148+0000', 'last_change': '2024-09-17T05:19:58.533148+0000', 'last_active': '2024-09-17T05:19:58.533148+0000', 'last_peered': '2024-09-17T05:19:58.533148+0000', 'last_clean': '2024-09-17T05:19:58.533148+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:58.533148+0000', 'last_undegraded': '2024-09-17T05:19:58.533148+0000', 'last_fullsized': '2024-09-17T05:19:58.533148+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:58.533148+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.214 INFO:tasks.ceph.ceph_manager.ceph:PG 7.6 is not active+clean 2024-09-17T05:20:04.214 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:19:59.535442+0000', 'last_change': '2024-09-17T05:19:59.535442+0000', 'last_active': '2024-09-17T05:19:59.535442+0000', 'last_peered': '2024-09-17T05:19:59.535442+0000', 'last_clean': '2024-09-17T05:19:59.535442+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:19:59.535442+0000', 'last_undegraded': '2024-09-17T05:19:59.535442+0000', 'last_fullsized': '2024-09-17T05:19:59.535442+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'last_clean_scrub_stamp': '2024-09-17T05:19:59.535442+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:20:04.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:20:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 -- 172.21.15.81:0/2031569494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40b4d20 msgr2=0x7fccd40d1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 --2- 172.21.15.81:0/2031569494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40b4d20 0x7fccd40d1c40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fccd40ce440 tx=0x7fccbc02a580 comp rx=0 tx=0).stop 2024-09-17T05:20:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 -- 172.21.15.81:0/2031569494 shutdown_connections 2024-09-17T05:20:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 --2- 172.21.15.81:0/2031569494 >> v2:172.21.15.160:3300/0 conn(0x7fccd40d2180 0x7fccd40b3460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 --2- 172.21.15.81:0/2031569494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40b4d20 0x7fccd40d1c40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 --2- 172.21.15.81:0/2031569494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fccd41615f0 0x7fccd40b5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 -- 172.21.15.81:0/2031569494 >> 172.21.15.81:0/2031569494 conn(0x7fccd40d3e60 msgr2=0x7fccd40d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 -- 172.21.15.81:0/2031569494 shutdown_connections 2024-09-17T05:20:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.345+0000 7fccd9633640 1 -- 172.21.15.81:0/2031569494 wait complete. 2024-09-17T05:20:04.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.346+0000 7fccd9633640 1 Processor -- start 2024-09-17T05:20:04.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.346+0000 7fccd9633640 1 -- start start 2024-09-17T05:20:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd9633640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccd40b4d20 0x7fccd41553f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd9633640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40d2180 0x7fccd41f45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd9633640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fccd41615f0 0x7fccd40cd240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd9633640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fccd40b3d30 con 0x7fccd40d2180 2024-09-17T05:20:04.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd9633640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fccd40b3bb0 con 0x7fccd40b4d20 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd9633640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fccd40b3eb0 con 0x7fccd41615f0 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40d2180 0x7fccd41f45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40d2180 0x7fccd41f45b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38718/0 (socket says 172.21.15.81:38718) 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 -- 172.21.15.81:0/3359222726 learned_addr learned my addr 172.21.15.81:0/3359222726 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd37fe640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fccd41615f0 0x7fccd40cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd2ffd640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccd40b4d20 0x7fccd41553f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 -- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fccd41615f0 msgr2=0x7fccd40cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fccd41615f0 0x7fccd40cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 -- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccd40b4d20 msgr2=0x7fccd41553f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccd40b4d20 0x7fccd41553f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 -- 172.21.15.81:0/3359222726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fccd41f4f20 con 0x7fccd40d2180 2024-09-17T05:20:04.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd37fe640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fccd41615f0 0x7fccd40cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd2ffd640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccd40b4d20 0x7fccd41553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccca7fc640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40d2180 0x7fccd41f45b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009850 tx=0x7fccbc0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fcccbfff640 1 -- 172.21.15.81:0/3359222726 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc03f070 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fcccbfff640 1 -- 172.21.15.81:0/3359222726 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccbc0047a0 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fcccbfff640 1 -- 172.21.15.81:0/3359222726 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccbc035030 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.347+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fccd41f5200 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.348+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fccd40cca40 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.349+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fccd40b3460 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.349+0000 7fcccbfff640 1 -- 172.21.15.81:0/3359222726 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fccbc042070 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.350+0000 7fcccbfff640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fccb4078d40 0x7fccb407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.350+0000 7fcccbfff640 1 -- 172.21.15.81:0/3359222726 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fccbc0bbf20 con 0x7fccd40d2180 2024-09-17T05:20:04.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.350+0000 7fccd2ffd640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fccb4078d40 0x7fccb407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.350+0000 7fccd2ffd640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fccb4078d40 0x7fccb407b200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fccd40cc710 tx=0x7fccc4005f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:04.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.354+0000 7fcccbfff640 1 -- 172.21.15.81:0/3359222726 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fccbc0840f0 con 0x7fccd40d2180 2024-09-17T05:20:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.600+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fccd40d49a0 con 0x7fccd40d2180 2024-09-17T05:20:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.600+0000 7fcccbfff640 1 -- 172.21.15.81:0/3359222726 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1550 (secure 0 0 0) 0x7fccbc0839f0 con 0x7fccd40d2180 2024-09-17T05:20:04.601 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:04.602 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":101,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":45,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550316,"num_in_osds":8,"osd_in_since":1726550306,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":78},{"state_name":"unknown","count":19}],"num_pgs":97,"num_pools":3,"num_objects":19,"data_bytes":592778,"bytes_used":230965248,"bytes_avail":772863148032,"bytes_total":773094113280,"unknown_pgs_ratio":0.19587628543376923,"write_bytes_sec":2955,"read_op_per_sec":0,"write_op_per_sec":6},"fsmap":{"epoch":22,"btime":"2024-09-17T05:20:02:554678+0000","id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"a","status":"up:active","gid":5277}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2024-09-17T05:19:51.388438+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fccb4078d40 msgr2=0x7fccb407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fccb4078d40 0x7fccb407b200 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7fccd40cc710 tx=0x7fccc4005f10 comp rx=0 tx=0).stop 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40d2180 msgr2=0x7fccd41f45b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40d2180 0x7fccd41f45b0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fccbc009850 tx=0x7fccbc0038a0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 shutdown_connections 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fccb4078d40 0x7fccb407b200 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fccd41615f0 0x7fccd40cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fccd40d2180 0x7fccd41f45b0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 --2- 172.21.15.81:0/3359222726 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fccd40b4d20 0x7fccd41553f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 >> 172.21.15.81:0/3359222726 conn(0x7fccd40d3e60 msgr2=0x7fccd40b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 shutdown_connections 2024-09-17T05:20:04.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.603+0000 7fccd9633640 1 -- 172.21.15.81:0/3359222726 wait complete. 2024-09-17T05:20:04.615 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:20:04.615 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:20:04.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 -- 172.21.15.81:0/251722133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3280d49c0 msgr2=0x7fd3280d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 --2- 172.21.15.81:0/251722133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3280d49c0 0x7fd3280d0630 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fd3280d1380 tx=0x7fd32402a560 comp rx=0 tx=0).stop 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 -- 172.21.15.81:0/251722133 shutdown_connections 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 --2- 172.21.15.81:0/251722133 >> v2:172.21.15.160:3300/0 conn(0x7fd328162480 0x7fd3280d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 --2- 172.21.15.81:0/251722133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd3280d49c0 0x7fd3280d0630 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 --2- 172.21.15.81:0/251722133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd32815df90 0x7fd3280cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 -- 172.21.15.81:0/251722133 >> 172.21.15.81:0/251722133 conn(0x7fd3280d3ea0 msgr2=0x7fd3280d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 -- 172.21.15.81:0/251722133 shutdown_connections 2024-09-17T05:20:04.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.715+0000 7fd32f270640 1 -- 172.21.15.81:0/251722133 wait complete. 2024-09-17T05:20:04.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.716+0000 7fd32f270640 1 Processor -- start 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32f270640 1 -- start start 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32f270640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280d49c0 0x7fd3280a1500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32f270640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32815df90 0x7fd32815f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32f270640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd328162480 0x7fd3281f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32f270640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd3280b3b90 con 0x7fd32815df90 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32f270640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd3280b3a10 con 0x7fd3280d49c0 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32f270640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd3280b3d10 con 0x7fd328162480 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32c80b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32815df90 0x7fd32815f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32c80b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32815df90 0x7fd32815f6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38740/0 (socket says 172.21.15.81:38740) 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32c80b640 1 -- 172.21.15.81:0/1831873956 learned_addr learned my addr 172.21.15.81:0/1831873956 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:04.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.717+0000 7fd32d00c640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280d49c0 0x7fd3280a1500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32d80d640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd328162480 0x7fd3281f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32c80b640 1 -- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd328162480 msgr2=0x7fd3281f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32c80b640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd328162480 0x7fd3281f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32c80b640 1 -- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280d49c0 msgr2=0x7fd3280a1500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32c80b640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280d49c0 0x7fd3280a1500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32c80b640 1 -- 172.21.15.81:0/1831873956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd32815ff40 con 0x7fd32815df90 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32d80d640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd328162480 0x7fd3281f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32c80b640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32815df90 0x7fd32815f6f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd32402ab50 tx=0x7fd3240039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd31dffb640 1 -- 172.21.15.81:0/1831873956 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd32403f070 con 0x7fd32815df90 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd31dffb640 1 -- 172.21.15.81:0/1831873956 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd324004890 con 0x7fd32815df90 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd31dffb640 1 -- 172.21.15.81:0/1831873956 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd324035030 con 0x7fd32815df90 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd328160220 con 0x7fd32815df90 2024-09-17T05:20:04.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.718+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3281607e0 con 0x7fd32815df90 2024-09-17T05:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.719+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3280d0e50 con 0x7fd32815df90 2024-09-17T05:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.720+0000 7fd31dffb640 1 -- 172.21.15.81:0/1831873956 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fd324042070 con 0x7fd32815df90 2024-09-17T05:20:04.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.720+0000 7fd31dffb640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd30c078d40 0x7fd30c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:04.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.720+0000 7fd31dffb640 1 -- 172.21.15.81:0/1831873956 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fd3240bbfa0 con 0x7fd32815df90 2024-09-17T05:20:04.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.721+0000 7fd32d00c640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd30c078d40 0x7fd30c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:04.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.721+0000 7fd32d00c640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd30c078d40 0x7fd30c07b200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd31800abe0 tx=0x7fd31800a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.725+0000 7fd31dffb640 1 -- 172.21.15.81:0/1831873956 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd3280d0e50 con 0x7fd32815df90 2024-09-17T05:20:04.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.899+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd3280cf9b0 con 0x7fd30c078d40 2024-09-17T05:20:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.904+0000 7fd31dffb640 1 -- 172.21.15.81:0/1831873956 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+249291 (secure 0 0 0) 0x7fd3280cf9b0 con 0x7fd30c078d40 2024-09-17T05:20:04.908 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:04.909 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:20:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd30c078d40 msgr2=0x7fd30c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd30c078d40 0x7fd30c07b200 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fd31800abe0 tx=0x7fd31800a2d0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32815df90 msgr2=0x7fd32815f6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32815df90 0x7fd32815f6f0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd32402ab50 tx=0x7fd3240039e0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 shutdown_connections 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd30c078d40 0x7fd30c07b200 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd328162480 0x7fd3281f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd32815df90 0x7fd32815f6f0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 --2- 172.21.15.81:0/1831873956 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd3280d49c0 0x7fd3280a1500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 >> 172.21.15.81:0/1831873956 conn(0x7fd3280d3ea0 msgr2=0x7fd32806dc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 shutdown_connections 2024-09-17T05:20:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:04.907+0000 7fd32f270640 1 -- 172.21.15.81:0/1831873956 wait complete. 2024-09-17T05:20:04.919 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":83,"stamp":"2024-09-17T05:20:03.391110+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":133,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":102,"ondisk_log_size":102,"up":156,"acting":156,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":79,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225552,"kb_used_data":5124,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749168,"statfs":{"total":773094113280,"available":772863148032,"internally_reserved":0,"allocated":5246976,"data_stored":2768806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.851058"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549824+0000","last_change":"2024-09-17T05:20:00.547326+0000","last_active":"2024-09-17T05:20:00.549824+0000","last_peered":"2024-09-17T05:20:00.549824+0000","last_clean":"2024-09-17T05:20:00.549824+0000","last_became_active":"2024-09-17T05:20:00.547030+0000","last_became_peered":"2024-09-17T05:20:00.547030+0000","last_unstale":"2024-09-17T05:20:00.549824+0000","last_undegraded":"2024-09-17T05:20:00.549824+0000","last_fullsized":"2024-09-17T05:20:00.549824+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:58.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548075+0000","last_change":"2024-09-17T05:20:00.546476+0000","last_active":"2024-09-17T05:20:00.548075+0000","last_peered":"2024-09-17T05:20:00.548075+0000","last_clean":"2024-09-17T05:20:00.548075+0000","last_became_active":"2024-09-17T05:20:00.544353+0000","last_became_peered":"2024-09-17T05:20:00.544353+0000","last_unstale":"2024-09-17T05:20:00.548075+0000","last_undegraded":"2024-09-17T05:20:00.548075+0000","last_fullsized":"2024-09-17T05:20:00.548075+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:37.491888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535274+0000","last_change":"2024-09-17T05:20:00.533096+0000","last_active":"2024-09-17T05:20:00.535274+0000","last_peered":"2024-09-17T05:20:00.535274+0000","last_clean":"2024-09-17T05:20:00.535274+0000","last_became_active":"2024-09-17T05:20:00.532800+0000","last_became_peered":"2024-09-17T05:20:00.532800+0000","last_unstale":"2024-09-17T05:20:00.535274+0000","last_undegraded":"2024-09-17T05:20:00.535274+0000","last_fullsized":"2024-09-17T05:20:00.535274+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:19.671543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546535+0000","last_change":"2024-09-17T05:20:00.543656+0000","last_active":"2024-09-17T05:20:00.546535+0000","last_peered":"2024-09-17T05:20:00.546535+0000","last_clean":"2024-09-17T05:20:00.546535+0000","last_became_active":"2024-09-17T05:20:00.543350+0000","last_became_peered":"2024-09-17T05:20:00.543350+0000","last_unstale":"2024-09-17T05:20:00.546535+0000","last_undegraded":"2024-09-17T05:20:00.546535+0000","last_fullsized":"2024-09-17T05:20:00.546535+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:56:29.786887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552498+0000","last_change":"2024-09-17T05:20:00.548503+0000","last_active":"2024-09-17T05:20:00.552498+0000","last_peered":"2024-09-17T05:20:00.552498+0000","last_clean":"2024-09-17T05:20:00.552498+0000","last_became_active":"2024-09-17T05:20:00.547870+0000","last_became_peered":"2024-09-17T05:20:00.547870+0000","last_unstale":"2024-09-17T05:20:00.552498+0000","last_undegraded":"2024-09-17T05:20:00.552498+0000","last_fullsized":"2024-09-17T05:20:00.552498+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:08:11.743975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551943+0000","last_change":"2024-09-17T05:20:00.548256+0000","last_active":"2024-09-17T05:20:00.551943+0000","last_peered":"2024-09-17T05:20:00.551943+0000","last_clean":"2024-09-17T05:20:00.551943+0000","last_became_active":"2024-09-17T05:20:00.547935+0000","last_became_peered":"2024-09-17T05:20:00.547935+0000","last_unstale":"2024-09-17T05:20:00.551943+0000","last_undegraded":"2024-09-17T05:20:00.551943+0000","last_fullsized":"2024-09-17T05:20:00.551943+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:16.729139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542947+0000","last_change":"2024-09-17T05:20:00.541383+0000","last_active":"2024-09-17T05:20:00.542947+0000","last_peered":"2024-09-17T05:20:00.542947+0000","last_clean":"2024-09-17T05:20:00.542947+0000","last_became_active":"2024-09-17T05:20:00.540989+0000","last_became_peered":"2024-09-17T05:20:00.540989+0000","last_unstale":"2024-09-17T05:20:00.542947+0000","last_undegraded":"2024-09-17T05:20:00.542947+0000","last_fullsized":"2024-09-17T05:20:00.542947+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:01.911225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546696+0000","last_change":"2024-09-17T05:20:00.539569+0000","last_active":"2024-09-17T05:20:00.546696+0000","last_peered":"2024-09-17T05:20:00.546696+0000","last_clean":"2024-09-17T05:20:00.546696+0000","last_became_active":"2024-09-17T05:20:00.539334+0000","last_became_peered":"2024-09-17T05:20:00.539334+0000","last_unstale":"2024-09-17T05:20:00.546696+0000","last_undegraded":"2024-09-17T05:20:00.546696+0000","last_fullsized":"2024-09-17T05:20:00.546696+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:54.767177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540962+0000","last_change":"2024-09-17T05:20:00.538481+0000","last_active":"2024-09-17T05:20:00.540962+0000","last_peered":"2024-09-17T05:20:00.540962+0000","last_clean":"2024-09-17T05:20:00.540962+0000","last_became_active":"2024-09-17T05:20:00.538224+0000","last_became_peered":"2024-09-17T05:20:00.538224+0000","last_unstale":"2024-09-17T05:20:00.540962+0000","last_undegraded":"2024-09-17T05:20:00.540962+0000","last_fullsized":"2024-09-17T05:20:00.540962+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:58.772520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548997+0000","last_change":"2024-09-17T05:20:00.545333+0000","last_active":"2024-09-17T05:20:00.548997+0000","last_peered":"2024-09-17T05:20:00.548997+0000","last_clean":"2024-09-17T05:20:00.548997+0000","last_became_active":"2024-09-17T05:20:00.545083+0000","last_became_peered":"2024-09-17T05:20:00.545083+0000","last_unstale":"2024-09-17T05:20:00.548997+0000","last_undegraded":"2024-09-17T05:20:00.548997+0000","last_fullsized":"2024-09-17T05:20:00.548997+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:19:35.778659+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539931+0000","last_change":"2024-09-17T05:20:00.538315+0000","last_active":"2024-09-17T05:20:00.539931+0000","last_peered":"2024-09-17T05:20:00.539931+0000","last_clean":"2024-09-17T05:20:00.539931+0000","last_became_active":"2024-09-17T05:20:00.537973+0000","last_became_peered":"2024-09-17T05:20:00.537973+0000","last_unstale":"2024-09-17T05:20:00.539931+0000","last_undegraded":"2024-09-17T05:20:00.539931+0000","last_fullsized":"2024-09-17T05:20:00.539931+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545590+0000","last_change":"2024-09-17T05:20:00.541799+0000","last_active":"2024-09-17T05:20:00.545590+0000","last_peered":"2024-09-17T05:20:00.545590+0000","last_clean":"2024-09-17T05:20:00.545590+0000","last_became_active":"2024-09-17T05:20:00.541529+0000","last_became_peered":"2024-09-17T05:20:00.541529+0000","last_unstale":"2024-09-17T05:20:00.545590+0000","last_undegraded":"2024-09-17T05:20:00.545590+0000","last_fullsized":"2024-09-17T05:20:00.545590+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:03.967733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544389+0000","last_change":"2024-09-17T05:20:00.542069+0000","last_active":"2024-09-17T05:20:00.544389+0000","last_peered":"2024-09-17T05:20:00.544389+0000","last_clean":"2024-09-17T05:20:00.544389+0000","last_became_active":"2024-09-17T05:20:00.541760+0000","last_became_peered":"2024-09-17T05:20:00.541760+0000","last_unstale":"2024-09-17T05:20:00.544389+0000","last_undegraded":"2024-09-17T05:20:00.544389+0000","last_fullsized":"2024-09-17T05:20:00.544389+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:00.588738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547432+0000","last_change":"2024-09-17T05:20:00.543451+0000","last_active":"2024-09-17T05:20:00.547432+0000","last_peered":"2024-09-17T05:20:00.547432+0000","last_clean":"2024-09-17T05:20:00.547432+0000","last_became_active":"2024-09-17T05:20:00.542502+0000","last_became_peered":"2024-09-17T05:20:00.542502+0000","last_unstale":"2024-09-17T05:20:00.547432+0000","last_undegraded":"2024-09-17T05:20:00.547432+0000","last_fullsized":"2024-09-17T05:20:00.547432+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:36.840738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543766+0000","last_change":"2024-09-17T05:20:00.540658+0000","last_active":"2024-09-17T05:20:00.543766+0000","last_peered":"2024-09-17T05:20:00.543766+0000","last_clean":"2024-09-17T05:20:00.543766+0000","last_became_active":"2024-09-17T05:20:00.540374+0000","last_became_peered":"2024-09-17T05:20:00.540374+0000","last_unstale":"2024-09-17T05:20:00.543766+0000","last_undegraded":"2024-09-17T05:20:00.543766+0000","last_fullsized":"2024-09-17T05:20:00.543766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549769+0000","last_change":"2024-09-17T05:20:00.547853+0000","last_active":"2024-09-17T05:20:00.549769+0000","last_peered":"2024-09-17T05:20:00.549769+0000","last_clean":"2024-09-17T05:20:00.549769+0000","last_became_active":"2024-09-17T05:20:00.547005+0000","last_became_peered":"2024-09-17T05:20:00.547005+0000","last_unstale":"2024-09-17T05:20:00.549769+0000","last_undegraded":"2024-09-17T05:20:00.549769+0000","last_fullsized":"2024-09-17T05:20:00.549769+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:51.663396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549807+0000","last_change":"2024-09-17T05:20:00.547374+0000","last_active":"2024-09-17T05:20:00.549807+0000","last_peered":"2024-09-17T05:20:00.549807+0000","last_clean":"2024-09-17T05:20:00.549807+0000","last_became_active":"2024-09-17T05:20:00.547086+0000","last_became_peered":"2024-09-17T05:20:00.547086+0000","last_unstale":"2024-09-17T05:20:00.549807+0000","last_undegraded":"2024-09-17T05:20:00.549807+0000","last_fullsized":"2024-09-17T05:20:00.549807+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.783859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546316+0000","last_change":"2024-09-17T05:20:00.542690+0000","last_active":"2024-09-17T05:20:00.546316+0000","last_peered":"2024-09-17T05:20:00.546316+0000","last_clean":"2024-09-17T05:20:00.546316+0000","last_became_active":"2024-09-17T05:20:00.542349+0000","last_became_peered":"2024-09-17T05:20:00.542349+0000","last_unstale":"2024-09-17T05:20:00.546316+0000","last_undegraded":"2024-09-17T05:20:00.546316+0000","last_fullsized":"2024-09-17T05:20:00.546316+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:52.854277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546642+0000","last_change":"2024-09-17T05:20:00.539389+0000","last_active":"2024-09-17T05:20:00.546642+0000","last_peered":"2024-09-17T05:20:00.546642+0000","last_clean":"2024-09-17T05:20:00.546642+0000","last_became_active":"2024-09-17T05:20:00.539098+0000","last_became_peered":"2024-09-17T05:20:00.539098+0000","last_unstale":"2024-09-17T05:20:00.546642+0000","last_undegraded":"2024-09-17T05:20:00.546642+0000","last_fullsized":"2024-09-17T05:20:00.546642+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:40.028949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545763+0000","last_change":"2024-09-17T05:20:00.543003+0000","last_active":"2024-09-17T05:20:00.545763+0000","last_peered":"2024-09-17T05:20:00.545763+0000","last_clean":"2024-09-17T05:20:00.545763+0000","last_became_active":"2024-09-17T05:20:00.542562+0000","last_became_peered":"2024-09-17T05:20:00.542562+0000","last_unstale":"2024-09-17T05:20:00.545763+0000","last_undegraded":"2024-09-17T05:20:00.545763+0000","last_fullsized":"2024-09-17T05:20:00.545763+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:33.584816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542766+0000","last_change":"2024-09-17T05:20:00.540456+0000","last_active":"2024-09-17T05:20:00.542766+0000","last_peered":"2024-09-17T05:20:00.542766+0000","last_clean":"2024-09-17T05:20:00.542766+0000","last_became_active":"2024-09-17T05:20:00.540089+0000","last_became_peered":"2024-09-17T05:20:00.540089+0000","last_unstale":"2024-09-17T05:20:00.542766+0000","last_undegraded":"2024-09-17T05:20:00.542766+0000","last_fullsized":"2024-09-17T05:20:00.542766+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:56.542144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543457+0000","last_change":"2024-09-17T05:20:00.542080+0000","last_active":"2024-09-17T05:20:00.543457+0000","last_peered":"2024-09-17T05:20:00.543457+0000","last_clean":"2024-09-17T05:20:00.543457+0000","last_became_active":"2024-09-17T05:20:00.541796+0000","last_became_peered":"2024-09-17T05:20:00.541796+0000","last_unstale":"2024-09-17T05:20:00.543457+0000","last_undegraded":"2024-09-17T05:20:00.543457+0000","last_fullsized":"2024-09-17T05:20:00.543457+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:55.283438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550421+0000","last_change":"2024-09-17T05:20:00.549564+0000","last_active":"2024-09-17T05:20:00.550421+0000","last_peered":"2024-09-17T05:20:00.550421+0000","last_clean":"2024-09-17T05:20:00.550421+0000","last_became_active":"2024-09-17T05:20:00.549300+0000","last_became_peered":"2024-09-17T05:20:00.549300+0000","last_unstale":"2024-09-17T05:20:00.550421+0000","last_undegraded":"2024-09-17T05:20:00.550421+0000","last_fullsized":"2024-09-17T05:20:00.550421+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:21.293708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550099+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550099+0000","last_peered":"2024-09-17T05:20:00.550099+0000","last_clean":"2024-09-17T05:20:00.550099+0000","last_became_active":"2024-09-17T05:20:00.544913+0000","last_became_peered":"2024-09-17T05:20:00.544913+0000","last_unstale":"2024-09-17T05:20:00.550099+0000","last_undegraded":"2024-09-17T05:20:00.550099+0000","last_fullsized":"2024-09-17T05:20:00.550099+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:15.118672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550008+0000","last_change":"2024-09-17T05:20:00.548447+0000","last_active":"2024-09-17T05:20:00.550008+0000","last_peered":"2024-09-17T05:20:00.550008+0000","last_clean":"2024-09-17T05:20:00.550008+0000","last_became_active":"2024-09-17T05:20:00.548097+0000","last_became_peered":"2024-09-17T05:20:00.548097+0000","last_unstale":"2024-09-17T05:20:00.550008+0000","last_undegraded":"2024-09-17T05:20:00.550008+0000","last_fullsized":"2024-09-17T05:20:00.550008+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:00.401962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552550+0000","last_change":"2024-09-17T05:20:00.547293+0000","last_active":"2024-09-17T05:20:00.552550+0000","last_peered":"2024-09-17T05:20:00.552550+0000","last_clean":"2024-09-17T05:20:00.552550+0000","last_became_active":"2024-09-17T05:20:00.547026+0000","last_became_peered":"2024-09-17T05:20:00.547026+0000","last_unstale":"2024-09-17T05:20:00.552550+0000","last_undegraded":"2024-09-17T05:20:00.552550+0000","last_fullsized":"2024-09-17T05:20:00.552550+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":17,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561768+0000","last_change":"2024-09-17T05:19:59.558973+0000","last_active":"2024-09-17T05:20:00.561768+0000","last_peered":"2024-09-17T05:20:00.561768+0000","last_clean":"2024-09-17T05:20:00.561768+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.561768+0000","last_undegraded":"2024-09-17T05:20:00.561768+0000","last_fullsized":"2024-09-17T05:20:00.561768+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:00.930635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.542569+0000","last_change":"2024-09-17T05:20:00.538883+0000","last_active":"2024-09-17T05:20:00.542569+0000","last_peered":"2024-09-17T05:20:00.542569+0000","last_clean":"2024-09-17T05:20:00.542569+0000","last_became_active":"2024-09-17T05:20:00.538502+0000","last_became_peered":"2024-09-17T05:20:00.538502+0000","last_unstale":"2024-09-17T05:20:00.542569+0000","last_undegraded":"2024-09-17T05:20:00.542569+0000","last_fullsized":"2024-09-17T05:20:00.542569+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:25.828995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559950+0000","last_change":"2024-09-17T05:19:59.559007+0000","last_active":"2024-09-17T05:20:00.559950+0000","last_peered":"2024-09-17T05:20:00.559950+0000","last_clean":"2024-09-17T05:20:00.559950+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:00.559950+0000","last_undegraded":"2024-09-17T05:20:00.559950+0000","last_fullsized":"2024-09-17T05:20:00.559950+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548169+0000","last_change":"2024-09-17T05:20:00.545138+0000","last_active":"2024-09-17T05:20:00.548169+0000","last_peered":"2024-09-17T05:20:00.548169+0000","last_clean":"2024-09-17T05:20:00.548169+0000","last_became_active":"2024-09-17T05:20:00.544865+0000","last_became_peered":"2024-09-17T05:20:00.544865+0000","last_unstale":"2024-09-17T05:20:00.548169+0000","last_undegraded":"2024-09-17T05:20:00.548169+0000","last_fullsized":"2024-09-17T05:20:00.548169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:53:24.925391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560906+0000","last_change":"2024-09-17T05:19:59.563623+0000","last_active":"2024-09-17T05:20:00.560906+0000","last_peered":"2024-09-17T05:20:00.560906+0000","last_clean":"2024-09-17T05:20:00.560906+0000","last_became_active":"2024-09-17T05:19:59.563315+0000","last_became_peered":"2024-09-17T05:19:59.563315+0000","last_unstale":"2024-09-17T05:20:00.560906+0000","last_undegraded":"2024-09-17T05:20:00.560906+0000","last_fullsized":"2024-09-17T05:20:00.560906+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:18.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551313+0000","last_change":"2024-09-17T05:20:00.544721+0000","last_active":"2024-09-17T05:20:00.551313+0000","last_peered":"2024-09-17T05:20:00.551313+0000","last_clean":"2024-09-17T05:20:00.551313+0000","last_became_active":"2024-09-17T05:20:00.544443+0000","last_became_peered":"2024-09-17T05:20:00.544443+0000","last_unstale":"2024-09-17T05:20:00.551313+0000","last_undegraded":"2024-09-17T05:20:00.551313+0000","last_fullsized":"2024-09-17T05:20:00.551313+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:29:33.623771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560899+0000","last_change":"2024-09-17T05:19:59.564861+0000","last_active":"2024-09-17T05:20:00.560899+0000","last_peered":"2024-09-17T05:20:00.560899+0000","last_clean":"2024-09-17T05:20:00.560899+0000","last_became_active":"2024-09-17T05:19:59.564565+0000","last_became_peered":"2024-09-17T05:19:59.564565+0000","last_unstale":"2024-09-17T05:20:00.560899+0000","last_undegraded":"2024-09-17T05:20:00.560899+0000","last_fullsized":"2024-09-17T05:20:00.560899+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549902+0000","last_change":"2024-09-17T05:20:00.539449+0000","last_active":"2024-09-17T05:20:00.549902+0000","last_peered":"2024-09-17T05:20:00.549902+0000","last_clean":"2024-09-17T05:20:00.549902+0000","last_became_active":"2024-09-17T05:20:00.539171+0000","last_became_peered":"2024-09-17T05:20:00.539171+0000","last_unstale":"2024-09-17T05:20:00.549902+0000","last_undegraded":"2024-09-17T05:20:00.549902+0000","last_fullsized":"2024-09-17T05:20:00.549902+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:43.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561116+0000","last_change":"2024-09-17T05:19:59.562556+0000","last_active":"2024-09-17T05:20:00.561116+0000","last_peered":"2024-09-17T05:20:00.561116+0000","last_clean":"2024-09-17T05:20:00.561116+0000","last_became_active":"2024-09-17T05:19:59.562255+0000","last_became_peered":"2024-09-17T05:19:59.562255+0000","last_unstale":"2024-09-17T05:20:00.561116+0000","last_undegraded":"2024-09-17T05:20:00.561116+0000","last_fullsized":"2024-09-17T05:20:00.561116+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:47.640069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.558324+0000","last_change":"2024-09-17T05:19:59.558825+0000","last_active":"2024-09-17T05:20:00.558324+0000","last_peered":"2024-09-17T05:20:00.558324+0000","last_clean":"2024-09-17T05:20:00.558324+0000","last_became_active":"2024-09-17T05:19:59.558529+0000","last_became_peered":"2024-09-17T05:19:59.558529+0000","last_unstale":"2024-09-17T05:20:00.558324+0000","last_undegraded":"2024-09-17T05:20:00.558324+0000","last_fullsized":"2024-09-17T05:20:00.558324+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:42.182629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534516+0000","last_change":"2024-09-17T05:19:59.563788+0000","last_active":"2024-09-17T05:20:00.534516+0000","last_peered":"2024-09-17T05:20:00.534516+0000","last_clean":"2024-09-17T05:20:00.534516+0000","last_became_active":"2024-09-17T05:19:59.563534+0000","last_became_peered":"2024-09-17T05:19:59.563534+0000","last_unstale":"2024-09-17T05:20:00.534516+0000","last_undegraded":"2024-09-17T05:20:00.534516+0000","last_fullsized":"2024-09-17T05:20:00.534516+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.937150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549799+0000","last_change":"2024-09-17T05:20:00.548448+0000","last_active":"2024-09-17T05:20:00.549799+0000","last_peered":"2024-09-17T05:20:00.549799+0000","last_clean":"2024-09-17T05:20:00.549799+0000","last_became_active":"2024-09-17T05:20:00.547380+0000","last_became_peered":"2024-09-17T05:20:00.547380+0000","last_unstale":"2024-09-17T05:20:00.549799+0000","last_undegraded":"2024-09-17T05:20:00.549799+0000","last_fullsized":"2024-09-17T05:20:00.549799+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:43.184923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.545623+0000","last_change":"2024-09-17T05:20:00.542588+0000","last_active":"2024-09-17T05:20:00.545623+0000","last_peered":"2024-09-17T05:20:00.545623+0000","last_clean":"2024-09-17T05:20:00.545623+0000","last_became_active":"2024-09-17T05:20:00.542297+0000","last_became_peered":"2024-09-17T05:20:00.542297+0000","last_unstale":"2024-09-17T05:20:00.545623+0000","last_undegraded":"2024-09-17T05:20:00.545623+0000","last_fullsized":"2024-09-17T05:20:00.545623+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:21.905648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530770+0000","last_change":"2024-09-17T05:19:59.558968+0000","last_active":"2024-09-17T05:20:00.530770+0000","last_peered":"2024-09-17T05:20:00.530770+0000","last_clean":"2024-09-17T05:20:00.530770+0000","last_became_active":"2024-09-17T05:19:59.558447+0000","last_became_peered":"2024-09-17T05:19:59.558447+0000","last_unstale":"2024-09-17T05:20:00.530770+0000","last_undegraded":"2024-09-17T05:20:00.530770+0000","last_fullsized":"2024-09-17T05:20:00.530770+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552010+0000","last_change":"2024-09-17T05:20:00.548751+0000","last_active":"2024-09-17T05:20:00.552010+0000","last_peered":"2024-09-17T05:20:00.552010+0000","last_clean":"2024-09-17T05:20:00.552010+0000","last_became_active":"2024-09-17T05:20:00.548410+0000","last_became_peered":"2024-09-17T05:20:00.548410+0000","last_unstale":"2024-09-17T05:20:00.552010+0000","last_undegraded":"2024-09-17T05:20:00.552010+0000","last_fullsized":"2024-09-17T05:20:00.552010+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:48.642363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546853+0000","last_change":"2024-09-17T05:20:00.543079+0000","last_active":"2024-09-17T05:20:00.546853+0000","last_peered":"2024-09-17T05:20:00.546853+0000","last_clean":"2024-09-17T05:20:00.546853+0000","last_became_active":"2024-09-17T05:20:00.542816+0000","last_became_peered":"2024-09-17T05:20:00.542816+0000","last_unstale":"2024-09-17T05:20:00.546853+0000","last_undegraded":"2024-09-17T05:20:00.546853+0000","last_fullsized":"2024-09-17T05:20:00.546853+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:02.274063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":16,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560749+0000","last_change":"2024-09-17T05:19:59.565867+0000","last_active":"2024-09-17T05:20:00.560749+0000","last_peered":"2024-09-17T05:20:00.560749+0000","last_clean":"2024-09-17T05:20:00.560749+0000","last_became_active":"2024-09-17T05:19:59.565572+0000","last_became_peered":"2024-09-17T05:19:59.565572+0000","last_unstale":"2024-09-17T05:20:00.560749+0000","last_undegraded":"2024-09-17T05:20:00.560749+0000","last_fullsized":"2024-09-17T05:20:00.560749+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:30.724384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551879+0000","last_change":"2024-09-17T05:20:00.548336+0000","last_active":"2024-09-17T05:20:00.551879+0000","last_peered":"2024-09-17T05:20:00.551879+0000","last_clean":"2024-09-17T05:20:00.551879+0000","last_became_active":"2024-09-17T05:20:00.548016+0000","last_became_peered":"2024-09-17T05:20:00.548016+0000","last_unstale":"2024-09-17T05:20:00.551879+0000","last_undegraded":"2024-09-17T05:20:00.551879+0000","last_fullsized":"2024-09-17T05:20:00.551879+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:01.932930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":19,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.562965+0000","last_change":"2024-09-17T05:19:59.559093+0000","last_active":"2024-09-17T05:20:00.562965+0000","last_peered":"2024-09-17T05:20:00.562965+0000","last_clean":"2024-09-17T05:20:00.562965+0000","last_became_active":"2024-09-17T05:19:59.558796+0000","last_became_peered":"2024-09-17T05:19:59.558796+0000","last_unstale":"2024-09-17T05:20:00.562965+0000","last_undegraded":"2024-09-17T05:20:00.562965+0000","last_fullsized":"2024-09-17T05:20:00.562965+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:10.022680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543996+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.542577+0000","last_became_peered":"2024-09-17T05:20:00.542577+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:59.305586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560577+0000","last_change":"2024-09-17T05:19:59.559096+0000","last_active":"2024-09-17T05:20:00.560577+0000","last_peered":"2024-09-17T05:20:00.560577+0000","last_clean":"2024-09-17T05:20:00.560577+0000","last_became_active":"2024-09-17T05:19:59.558466+0000","last_became_peered":"2024-09-17T05:19:59.558466+0000","last_unstale":"2024-09-17T05:20:00.560577+0000","last_undegraded":"2024-09-17T05:20:00.560577+0000","last_fullsized":"2024-09-17T05:20:00.560577+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:02.120617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539497+0000","last_change":"2024-09-17T05:19:59.563984+0000","last_active":"2024-09-17T05:20:00.539497+0000","last_peered":"2024-09-17T05:20:00.539497+0000","last_clean":"2024-09-17T05:20:00.539497+0000","last_became_active":"2024-09-17T05:19:59.563645+0000","last_became_peered":"2024-09-17T05:19:59.563645+0000","last_unstale":"2024-09-17T05:20:00.539497+0000","last_undegraded":"2024-09-17T05:20:00.539497+0000","last_fullsized":"2024-09-17T05:20:00.539497+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:32.582522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546729+0000","last_change":"2024-09-17T05:20:00.541286+0000","last_active":"2024-09-17T05:20:00.546729+0000","last_peered":"2024-09-17T05:20:00.546729+0000","last_clean":"2024-09-17T05:20:00.546729+0000","last_became_active":"2024-09-17T05:20:00.541020+0000","last_became_peered":"2024-09-17T05:20:00.541020+0000","last_unstale":"2024-09-17T05:20:00.546729+0000","last_undegraded":"2024-09-17T05:20:00.546729+0000","last_fullsized":"2024-09-17T05:20:00.546729+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:17.537507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534738+0000","last_change":"2024-09-17T05:19:59.563576+0000","last_active":"2024-09-17T05:20:00.534738+0000","last_peered":"2024-09-17T05:20:00.534738+0000","last_clean":"2024-09-17T05:20:00.534738+0000","last_became_active":"2024-09-17T05:19:59.563297+0000","last_became_peered":"2024-09-17T05:19:59.563297+0000","last_unstale":"2024-09-17T05:20:00.534738+0000","last_undegraded":"2024-09-17T05:20:00.534738+0000","last_fullsized":"2024-09-17T05:20:00.534738+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:16.800054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552885+0000","last_change":"2024-09-17T05:20:00.550850+0000","last_active":"2024-09-17T05:20:00.552885+0000","last_peered":"2024-09-17T05:20:00.552885+0000","last_clean":"2024-09-17T05:20:00.552885+0000","last_became_active":"2024-09-17T05:20:00.550558+0000","last_became_peered":"2024-09-17T05:20:00.550558+0000","last_unstale":"2024-09-17T05:20:00.552885+0000","last_undegraded":"2024-09-17T05:20:00.552885+0000","last_fullsized":"2024-09-17T05:20:00.552885+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:55.244688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.546737+0000","last_change":"2024-09-17T05:20:00.541991+0000","last_active":"2024-09-17T05:20:00.546737+0000","last_peered":"2024-09-17T05:20:00.546737+0000","last_clean":"2024-09-17T05:20:00.546737+0000","last_became_active":"2024-09-17T05:20:00.541748+0000","last_became_peered":"2024-09-17T05:20:00.541748+0000","last_unstale":"2024-09-17T05:20:00.546737+0000","last_undegraded":"2024-09-17T05:20:00.546737+0000","last_fullsized":"2024-09-17T05:20:00.546737+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:17.549641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560320+0000","last_change":"2024-09-17T05:19:59.556315+0000","last_active":"2024-09-17T05:20:00.560320+0000","last_peered":"2024-09-17T05:20:00.560320+0000","last_clean":"2024-09-17T05:20:00.560320+0000","last_became_active":"2024-09-17T05:19:59.556024+0000","last_became_peered":"2024-09-17T05:19:59.556024+0000","last_unstale":"2024-09-17T05:20:00.560320+0000","last_undegraded":"2024-09-17T05:20:00.560320+0000","last_fullsized":"2024-09-17T05:20:00.560320+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:16.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.559848+0000","last_change":"2024-09-17T05:19:59.560582+0000","last_active":"2024-09-17T05:20:00.559848+0000","last_peered":"2024-09-17T05:20:00.559848+0000","last_clean":"2024-09-17T05:20:00.559848+0000","last_became_active":"2024-09-17T05:19:59.560282+0000","last_became_peered":"2024-09-17T05:19:59.560282+0000","last_unstale":"2024-09-17T05:20:00.559848+0000","last_undegraded":"2024-09-17T05:20:00.559848+0000","last_fullsized":"2024-09-17T05:20:00.559848+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.203376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548974+0000","last_change":"2024-09-17T05:20:00.543830+0000","last_active":"2024-09-17T05:20:00.548974+0000","last_peered":"2024-09-17T05:20:00.548974+0000","last_clean":"2024-09-17T05:20:00.548974+0000","last_became_active":"2024-09-17T05:20:00.543210+0000","last_became_peered":"2024-09-17T05:20:00.543210+0000","last_unstale":"2024-09-17T05:20:00.548974+0000","last_undegraded":"2024-09-17T05:20:00.548974+0000","last_fullsized":"2024-09-17T05:20:00.548974+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:55.720457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":14,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.560488+0000","last_change":"2024-09-17T05:19:59.564268+0000","last_active":"2024-09-17T05:20:00.560488+0000","last_peered":"2024-09-17T05:20:00.560488+0000","last_clean":"2024-09-17T05:20:00.560488+0000","last_became_active":"2024-09-17T05:19:59.563909+0000","last_became_peered":"2024-09-17T05:19:59.563909+0000","last_unstale":"2024-09-17T05:20:00.560488+0000","last_undegraded":"2024-09-17T05:20:00.560488+0000","last_fullsized":"2024-09-17T05:20:00.560488+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:56.717406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549012+0000","last_change":"2024-09-17T05:20:00.544504+0000","last_active":"2024-09-17T05:20:00.549012+0000","last_peered":"2024-09-17T05:20:00.549012+0000","last_clean":"2024-09-17T05:20:00.549012+0000","last_became_active":"2024-09-17T05:20:00.544123+0000","last_became_peered":"2024-09-17T05:20:00.544123+0000","last_unstale":"2024-09-17T05:20:00.549012+0000","last_undegraded":"2024-09-17T05:20:00.549012+0000","last_fullsized":"2024-09-17T05:20:00.549012+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:36.647387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.535470+0000","last_change":"2024-09-17T05:19:59.558812+0000","last_active":"2024-09-17T05:20:00.535470+0000","last_peered":"2024-09-17T05:20:00.535470+0000","last_clean":"2024-09-17T05:20:00.535470+0000","last_became_active":"2024-09-17T05:19:59.558524+0000","last_became_peered":"2024-09-17T05:19:59.558524+0000","last_unstale":"2024-09-17T05:20:00.535470+0000","last_undegraded":"2024-09-17T05:20:00.535470+0000","last_fullsized":"2024-09-17T05:20:00.535470+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:59.938453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.543730+0000","last_change":"2024-09-17T05:20:00.540236+0000","last_active":"2024-09-17T05:20:00.543730+0000","last_peered":"2024-09-17T05:20:00.543730+0000","last_clean":"2024-09-17T05:20:00.543730+0000","last_became_active":"2024-09-17T05:20:00.539968+0000","last_became_peered":"2024-09-17T05:20:00.539968+0000","last_unstale":"2024-09-17T05:20:00.543730+0000","last_undegraded":"2024-09-17T05:20:00.543730+0000","last_fullsized":"2024-09-17T05:20:00.543730+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:49.650410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561737+0000","last_change":"2024-09-17T05:19:59.562482+0000","last_active":"2024-09-17T05:20:00.561737+0000","last_peered":"2024-09-17T05:20:00.561737+0000","last_clean":"2024-09-17T05:20:00.561737+0000","last_became_active":"2024-09-17T05:19:59.562197+0000","last_became_peered":"2024-09-17T05:19:59.562197+0000","last_unstale":"2024-09-17T05:20:00.561737+0000","last_undegraded":"2024-09-17T05:20:00.561737+0000","last_fullsized":"2024-09-17T05:20:00.561737+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:54.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.547002+0000","last_change":"2024-09-17T05:20:00.542587+0000","last_active":"2024-09-17T05:20:00.547002+0000","last_peered":"2024-09-17T05:20:00.547002+0000","last_clean":"2024-09-17T05:20:00.547002+0000","last_became_active":"2024-09-17T05:20:00.542114+0000","last_became_peered":"2024-09-17T05:20:00.542114+0000","last_unstale":"2024-09-17T05:20:00.547002+0000","last_undegraded":"2024-09-17T05:20:00.547002+0000","last_fullsized":"2024-09-17T05:20:00.547002+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:52.205670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534742+0000","last_change":"2024-09-17T05:19:59.559159+0000","last_active":"2024-09-17T05:20:00.534742+0000","last_peered":"2024-09-17T05:20:00.534742+0000","last_clean":"2024-09-17T05:20:00.534742+0000","last_became_active":"2024-09-17T05:19:59.558919+0000","last_became_peered":"2024-09-17T05:19:59.558919+0000","last_unstale":"2024-09-17T05:20:00.534742+0000","last_undegraded":"2024-09-17T05:20:00.534742+0000","last_fullsized":"2024-09-17T05:20:00.534742+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.735582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.549982+0000","last_change":"2024-09-17T05:20:00.547679+0000","last_active":"2024-09-17T05:20:00.549982+0000","last_peered":"2024-09-17T05:20:00.549982+0000","last_clean":"2024-09-17T05:20:00.549982+0000","last_became_active":"2024-09-17T05:20:00.547424+0000","last_became_peered":"2024-09-17T05:20:00.547424+0000","last_unstale":"2024-09-17T05:20:00.549982+0000","last_undegraded":"2024-09-17T05:20:00.549982+0000","last_fullsized":"2024-09-17T05:20:00.549982+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:43.113899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539592+0000","last_change":"2024-09-17T05:19:59.566679+0000","last_active":"2024-09-17T05:20:00.539592+0000","last_peered":"2024-09-17T05:20:00.539592+0000","last_clean":"2024-09-17T05:20:00.539592+0000","last_became_active":"2024-09-17T05:19:59.566350+0000","last_became_peered":"2024-09-17T05:19:59.566350+0000","last_unstale":"2024-09-17T05:20:00.539592+0000","last_undegraded":"2024-09-17T05:20:00.539592+0000","last_fullsized":"2024-09-17T05:20:00.539592+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.291413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.548877+0000","last_change":"2024-09-17T05:20:00.545489+0000","last_active":"2024-09-17T05:20:00.548877+0000","last_peered":"2024-09-17T05:20:00.548877+0000","last_clean":"2024-09-17T05:20:00.548877+0000","last_became_active":"2024-09-17T05:20:00.545052+0000","last_became_peered":"2024-09-17T05:20:00.545052+0000","last_unstale":"2024-09-17T05:20:00.548877+0000","last_undegraded":"2024-09-17T05:20:00.548877+0000","last_fullsized":"2024-09-17T05:20:00.548877+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:23.670327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.534933+0000","last_change":"2024-09-17T05:19:59.561764+0000","last_active":"2024-09-17T05:20:00.534933+0000","last_peered":"2024-09-17T05:20:00.534933+0000","last_clean":"2024-09-17T05:20:00.534933+0000","last_became_active":"2024-09-17T05:19:59.561368+0000","last_became_peered":"2024-09-17T05:19:59.561368+0000","last_unstale":"2024-09-17T05:20:00.534933+0000","last_undegraded":"2024-09-17T05:20:00.534933+0000","last_fullsized":"2024-09-17T05:20:00.534933+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:27.664506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.544127+0000","last_change":"2024-09-17T05:19:59.566316+0000","last_active":"2024-09-17T05:20:00.544127+0000","last_peered":"2024-09-17T05:20:00.544127+0000","last_clean":"2024-09-17T05:20:00.544127+0000","last_became_active":"2024-09-17T05:19:59.565973+0000","last_became_peered":"2024-09-17T05:19:59.565973+0000","last_unstale":"2024-09-17T05:20:00.544127+0000","last_undegraded":"2024-09-17T05:20:00.544127+0000","last_fullsized":"2024-09-17T05:20:00.544127+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:30.046614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.551973+0000","last_change":"2024-09-17T05:20:00.549077+0000","last_active":"2024-09-17T05:20:00.551973+0000","last_peered":"2024-09-17T05:20:00.551973+0000","last_clean":"2024-09-17T05:20:00.551973+0000","last_became_active":"2024-09-17T05:20:00.548735+0000","last_became_peered":"2024-09-17T05:20:00.548735+0000","last_unstale":"2024-09-17T05:20:00.551973+0000","last_undegraded":"2024-09-17T05:20:00.551973+0000","last_fullsized":"2024-09-17T05:20:00.551973+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:03.122911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541878+0000","last_change":"2024-09-17T05:19:59.563528+0000","last_active":"2024-09-17T05:20:00.541878+0000","last_peered":"2024-09-17T05:20:00.541878+0000","last_clean":"2024-09-17T05:20:00.541878+0000","last_became_active":"2024-09-17T05:19:59.563264+0000","last_became_peered":"2024-09-17T05:19:59.563264+0000","last_unstale":"2024-09-17T05:20:00.541878+0000","last_undegraded":"2024-09-17T05:20:00.541878+0000","last_fullsized":"2024-09-17T05:20:00.541878+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552526+0000","last_change":"2024-09-17T05:20:00.548525+0000","last_active":"2024-09-17T05:20:00.552526+0000","last_peered":"2024-09-17T05:20:00.552526+0000","last_clean":"2024-09-17T05:20:00.552526+0000","last_became_active":"2024-09-17T05:20:00.548220+0000","last_became_peered":"2024-09-17T05:20:00.548220+0000","last_unstale":"2024-09-17T05:20:00.552526+0000","last_undegraded":"2024-09-17T05:20:00.552526+0000","last_fullsized":"2024-09-17T05:20:00.552526+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:59.514166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540949+0000","last_change":"2024-09-17T05:19:59.565271+0000","last_active":"2024-09-17T05:20:00.540949+0000","last_peered":"2024-09-17T05:20:00.540949+0000","last_clean":"2024-09-17T05:20:00.540949+0000","last_became_active":"2024-09-17T05:19:59.565009+0000","last_became_peered":"2024-09-17T05:19:59.565009+0000","last_unstale":"2024-09-17T05:20:00.540949+0000","last_undegraded":"2024-09-17T05:20:00.540949+0000","last_fullsized":"2024-09-17T05:20:00.540949+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:45.135132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.550082+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:00.550082+0000","last_peered":"2024-09-17T05:20:00.550082+0000","last_clean":"2024-09-17T05:20:00.550082+0000","last_became_active":"2024-09-17T05:20:00.544930+0000","last_became_peered":"2024-09-17T05:20:00.544930+0000","last_unstale":"2024-09-17T05:20:00.550082+0000","last_undegraded":"2024-09-17T05:20:00.550082+0000","last_fullsized":"2024-09-17T05:20:00.550082+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:43:50.027809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.530552+0000","last_change":"2024-09-17T05:19:59.561592+0000","last_active":"2024-09-17T05:20:00.530552+0000","last_peered":"2024-09-17T05:20:00.530552+0000","last_clean":"2024-09-17T05:20:00.530552+0000","last_became_active":"2024-09-17T05:19:59.561328+0000","last_became_peered":"2024-09-17T05:19:59.561328+0000","last_unstale":"2024-09-17T05:20:00.530552+0000","last_undegraded":"2024-09-17T05:20:00.530552+0000","last_fullsized":"2024-09-17T05:20:00.530552+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:27.670831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.552195+0000","last_change":"2024-09-17T05:20:00.550589+0000","last_active":"2024-09-17T05:20:00.552195+0000","last_peered":"2024-09-17T05:20:00.552195+0000","last_clean":"2024-09-17T05:20:00.552195+0000","last_became_active":"2024-09-17T05:20:00.550353+0000","last_became_peered":"2024-09-17T05:20:00.550353+0000","last_unstale":"2024-09-17T05:20:00.552195+0000","last_undegraded":"2024-09-17T05:20:00.552195+0000","last_fullsized":"2024-09-17T05:20:00.552195+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:10:10.302010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":13,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.541854+0000","last_change":"2024-09-17T05:19:59.560425+0000","last_active":"2024-09-17T05:20:00.541854+0000","last_peered":"2024-09-17T05:20:00.541854+0000","last_clean":"2024-09-17T05:20:00.541854+0000","last_became_active":"2024-09-17T05:19:59.560173+0000","last_became_peered":"2024-09-17T05:19:59.560173+0000","last_unstale":"2024-09-17T05:20:00.541854+0000","last_undegraded":"2024-09-17T05:20:00.541854+0000","last_fullsized":"2024-09-17T05:20:00.541854+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.540317+0000","last_change":"2024-09-17T05:20:00.539142+0000","last_active":"2024-09-17T05:20:00.540317+0000","last_peered":"2024-09-17T05:20:00.540317+0000","last_clean":"2024-09-17T05:20:00.540317+0000","last_became_active":"2024-09-17T05:20:00.538724+0000","last_became_peered":"2024-09-17T05:20:00.538724+0000","last_unstale":"2024-09-17T05:20:00.540317+0000","last_undegraded":"2024-09-17T05:20:00.540317+0000","last_fullsized":"2024-09-17T05:20:00.540317+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:58.533148+0000","last_change":"2024-09-17T05:19:58.533148+0000","last_active":"2024-09-17T05:19:58.533148+0000","last_peered":"2024-09-17T05:19:58.533148+0000","last_clean":"2024-09-17T05:19:58.533148+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:58.533148+0000","last_undegraded":"2024-09-17T05:19:58.533148+0000","last_fullsized":"2024-09-17T05:19:58.533148+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:19:59.535442+0000","last_change":"2024-09-17T05:19:59.535442+0000","last_active":"2024-09-17T05:19:59.535442+0000","last_peered":"2024-09-17T05:19:59.535442+0000","last_clean":"2024-09-17T05:19:59.535442+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:19:59.535442+0000","last_undegraded":"2024-09-17T05:19:59.535442+0000","last_fullsized":"2024-09-17T05:19:59.535442+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":15,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.561450+0000","last_change":"2024-09-17T05:19:59.560442+0000","last_active":"2024-09-17T05:20:00.561450+0000","last_peered":"2024-09-17T05:20:00.561450+0000","last_clean":"2024-09-17T05:20:00.561450+0000","last_became_active":"2024-09-17T05:19:59.560155+0000","last_became_peered":"2024-09-17T05:19:59.560155+0000","last_unstale":"2024-09-17T05:20:00.561450+0000","last_undegraded":"2024-09-17T05:20:00.561450+0000","last_fullsized":"2024-09-17T05:20:00.561450+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:57.146571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":146,"reported_epoch":44,"state":"active+clean","last_fresh":"2024-09-17T05:20:00.539697+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:20:00.539697+0000","last_peered":"2024-09-17T05:20:00.539697+0000","last_clean":"2024-09-17T05:20:00.539697+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:20:00.539697+0000","last_undegraded":"2024-09-17T05:20:00.539697+0000","last_fullsized":"2024-09-17T05:20:00.539697+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":100,"acting":100,"num_store_stats":7},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":32,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":4786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":30,"ondisk_log_size":30,"up":54,"acting":54,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509461,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28112,"kb_used_data":1080,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343728,"statfs":{"total":96636764160,"available":96607977472,"internally_reserved":0,"allocated":1105920,"data_stored":791777,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509461,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27536,"kb_used_data":504,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344304,"statfs":{"total":96636764160,"available":96608567296,"internally_reserved":0,"allocated":516096,"data_stored":201991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509460,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509460,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":202931,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509460,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":520192,"data_stored":201957,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509461,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27520,"kb_used_data":484,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344320,"statfs":{"total":96636764160,"available":96608583680,"internally_reserved":0,"allocated":495616,"data_stored":194544,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509460,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":512000,"data_stored":201389,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574868,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32232,"kb_used_data":1040,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339608,"statfs":{"total":96636764160,"available":96603758592,"internally_reserved":0,"allocated":1064960,"data_stored":772828,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:20:07.925 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:20:08.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 -- 172.21.15.81:0/2351727638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc156110 msgr2=0x7f04bc0cdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 --2- 172.21.15.81:0/2351727638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc156110 0x7f04bc0cdaa0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f04ac009830 tx=0x7f04ac02a510 comp rx=0 tx=0).stop 2024-09-17T05:20:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 -- 172.21.15.81:0/2351727638 shutdown_connections 2024-09-17T05:20:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 --2- 172.21.15.81:0/2351727638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04bc0acd60 0x7f04bc073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 --2- 172.21.15.81:0/2351727638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc156110 0x7f04bc0cdaa0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 -- 172.21.15.81:0/2351727638 >> 172.21.15.81:0/2351727638 conn(0x7f04bc0b19c0 msgr2=0x7f04bc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 -- 172.21.15.81:0/2351727638 shutdown_connections 2024-09-17T05:20:08.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.038+0000 7f04c0e32640 1 -- 172.21.15.81:0/2351727638 wait complete. 2024-09-17T05:20:08.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.040+0000 7f04c0e32640 1 Processor -- start 2024-09-17T05:20:08.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.040+0000 7f04c0e32640 1 -- start start 2024-09-17T05:20:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.040+0000 7f04c0e32640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc0acd60 0x7f04bc09c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04c0e32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04bc0ad1a0 0x7f04bc09aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04c0e32640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04bc156110 0x7f04bc1f8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04c0e32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc0743f0 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04c0e32640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04bc074270 con 0x7f04bc0acd60 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04c0e32640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f04bc160000 con 0x7f04bc156110 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04bc0ad1a0 0x7f04bc09aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04bc0ad1a0 0x7f04bc09aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38756/0 (socket says 172.21.15.81:38756) 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 -- 172.21.15.81:0/674945368 learned_addr learned my addr 172.21.15.81:0/674945368 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04ba59c640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc0acd60 0x7f04bc09c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04bad9d640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04bc156110 0x7f04bc1f8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 -- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04bc156110 msgr2=0x7f04bc1f8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04bc156110 0x7f04bc1f8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 -- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc0acd60 msgr2=0x7f04bc09c970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc0acd60 0x7f04bc09c970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 -- 172.21.15.81:0/674945368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04bc09d230 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04ba59c640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc0acd60 0x7f04bc09c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b1d9b640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04bc0ad1a0 0x7f04bc09aed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f04a400e9f0 tx=0x7f04a400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b37fe640 1 -- 172.21.15.81:0/674945368 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a400cd80 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04bc09d510 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b37fe640 1 -- 172.21.15.81:0/674945368 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04a4004020 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04b37fe640 1 -- 172.21.15.81:0/674945368 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04a4004430 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.041+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04bc09ceb0 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.043+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04bc160480 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.043+0000 7f04b37fe640 1 -- 172.21.15.81:0/674945368 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f04a40035f0 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.044+0000 7f04b37fe640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f049c078d40 0x7f049c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.044+0000 7f04b37fe640 1 -- 172.21.15.81:0/674945368 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f04a409bc10 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.044+0000 7f04ba59c640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f049c078d40 0x7f049c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.044+0000 7f04ba59c640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f049c078d40 0x7f049c07b200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04ac034000 tx=0x7f04ac004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:08.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.048+0000 7f04b37fe640 1 -- 172.21.15.81:0/674945368 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f04a4063e20 con 0x7f04bc0ad1a0 2024-09-17T05:20:08.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.220+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04bc074650 con 0x7f049c078d40 2024-09-17T05:20:08.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.225+0000 7f04b37fe640 1 -- 172.21.15.81:0/674945368 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251895 (secure 0 0 0) 0x7f04bc074650 con 0x7f049c078d40 2024-09-17T05:20:08.229 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:08.231 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:20:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f049c078d40 msgr2=0x7f049c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f049c078d40 0x7f049c07b200 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f04ac034000 tx=0x7f04ac004730 comp rx=0 tx=0).stop 2024-09-17T05:20:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04bc0ad1a0 msgr2=0x7f04bc09aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04bc0ad1a0 0x7f04bc09aed0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f04a400e9f0 tx=0x7f04a400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 shutdown_connections 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f049c078d40 0x7f049c07b200 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04bc156110 0x7f04bc1f8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04bc0ad1a0 0x7f04bc09aed0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 --2- 172.21.15.81:0/674945368 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04bc0acd60 0x7f04bc09c970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 >> 172.21.15.81:0/674945368 conn(0x7f04bc0b19c0 msgr2=0x7f04bc15f8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 shutdown_connections 2024-09-17T05:20:08.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.228+0000 7f04c0e32640 1 -- 172.21.15.81:0/674945368 wait complete. 2024-09-17T05:20:08.240 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":85,"stamp":"2024-09-17T05:20:07.392097+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225720,"kb_used_data":5288,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749000,"statfs":{"total":773094113280,"available":772862976000,"internally_reserved":0,"allocated":5414912,"data_stored":2846508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.846771"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742662+0000","last_change":"2024-09-17T05:20:00.547326+0000","last_active":"2024-09-17T05:20:01.742662+0000","last_peered":"2024-09-17T05:20:01.742662+0000","last_clean":"2024-09-17T05:20:01.742662+0000","last_became_active":"2024-09-17T05:20:00.547030+0000","last_became_peered":"2024-09-17T05:20:00.547030+0000","last_unstale":"2024-09-17T05:20:01.742662+0000","last_undegraded":"2024-09-17T05:20:01.742662+0000","last_fullsized":"2024-09-17T05:20:01.742662+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:28.666801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742620+0000","last_change":"2024-09-17T05:20:00.546476+0000","last_active":"2024-09-17T05:20:01.742620+0000","last_peered":"2024-09-17T05:20:01.742620+0000","last_clean":"2024-09-17T05:20:01.742620+0000","last_became_active":"2024-09-17T05:20:00.544353+0000","last_became_peered":"2024-09-17T05:20:00.544353+0000","last_unstale":"2024-09-17T05:20:01.742620+0000","last_undegraded":"2024-09-17T05:20:01.742620+0000","last_fullsized":"2024-09-17T05:20:01.742620+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:13:22.069010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531121+0000","last_change":"2024-09-17T05:20:00.533096+0000","last_active":"2024-09-17T05:20:01.531121+0000","last_peered":"2024-09-17T05:20:01.531121+0000","last_clean":"2024-09-17T05:20:01.531121+0000","last_became_active":"2024-09-17T05:20:00.532800+0000","last_became_peered":"2024-09-17T05:20:00.532800+0000","last_unstale":"2024-09-17T05:20:01.531121+0000","last_undegraded":"2024-09-17T05:20:01.531121+0000","last_fullsized":"2024-09-17T05:20:01.531121+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:31.048909+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742673+0000","last_change":"2024-09-17T05:20:00.550266+0000","last_active":"2024-09-17T05:20:01.742673+0000","last_peered":"2024-09-17T05:20:01.742673+0000","last_clean":"2024-09-17T05:20:01.742673+0000","last_became_active":"2024-09-17T05:20:00.550035+0000","last_became_peered":"2024-09-17T05:20:00.550035+0000","last_unstale":"2024-09-17T05:20:01.742673+0000","last_undegraded":"2024-09-17T05:20:01.742673+0000","last_fullsized":"2024-09-17T05:20:01.742673+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:01.303305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742933+0000","last_change":"2024-09-17T05:20:00.543656+0000","last_active":"2024-09-17T05:20:01.742933+0000","last_peered":"2024-09-17T05:20:01.742933+0000","last_clean":"2024-09-17T05:20:01.742933+0000","last_became_active":"2024-09-17T05:20:00.543350+0000","last_became_peered":"2024-09-17T05:20:00.543350+0000","last_unstale":"2024-09-17T05:20:01.742933+0000","last_undegraded":"2024-09-17T05:20:01.742933+0000","last_fullsized":"2024-09-17T05:20:01.742933+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:09:54.570105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743536+0000","last_change":"2024-09-17T05:20:00.548503+0000","last_active":"2024-09-17T05:20:01.743536+0000","last_peered":"2024-09-17T05:20:01.743536+0000","last_clean":"2024-09-17T05:20:01.743536+0000","last_became_active":"2024-09-17T05:20:00.547870+0000","last_became_peered":"2024-09-17T05:20:00.547870+0000","last_unstale":"2024-09-17T05:20:01.743536+0000","last_undegraded":"2024-09-17T05:20:01.743536+0000","last_fullsized":"2024-09-17T05:20:01.743536+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:04.030670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742514+0000","last_change":"2024-09-17T05:20:00.548256+0000","last_active":"2024-09-17T05:20:01.742514+0000","last_peered":"2024-09-17T05:20:01.742514+0000","last_clean":"2024-09-17T05:20:01.742514+0000","last_became_active":"2024-09-17T05:20:00.547935+0000","last_became_peered":"2024-09-17T05:20:00.547935+0000","last_unstale":"2024-09-17T05:20:01.742514+0000","last_undegraded":"2024-09-17T05:20:01.742514+0000","last_fullsized":"2024-09-17T05:20:01.742514+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:50.137814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743217+0000","last_change":"2024-09-17T05:20:00.543747+0000","last_active":"2024-09-17T05:20:01.743217+0000","last_peered":"2024-09-17T05:20:01.743217+0000","last_clean":"2024-09-17T05:20:01.743217+0000","last_became_active":"2024-09-17T05:20:00.542820+0000","last_became_peered":"2024-09-17T05:20:00.542820+0000","last_unstale":"2024-09-17T05:20:01.743217+0000","last_undegraded":"2024-09-17T05:20:01.743217+0000","last_fullsized":"2024-09-17T05:20:01.743217+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:46.390657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742793+0000","last_change":"2024-09-17T05:20:00.539882+0000","last_active":"2024-09-17T05:20:01.742793+0000","last_peered":"2024-09-17T05:20:01.742793+0000","last_clean":"2024-09-17T05:20:01.742793+0000","last_became_active":"2024-09-17T05:20:00.539622+0000","last_became_peered":"2024-09-17T05:20:00.539622+0000","last_unstale":"2024-09-17T05:20:01.742793+0000","last_undegraded":"2024-09-17T05:20:01.742793+0000","last_fullsized":"2024-09-17T05:20:01.742793+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:32:56.427774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743282+0000","last_change":"2024-09-17T05:20:00.542425+0000","last_active":"2024-09-17T05:20:01.743282+0000","last_peered":"2024-09-17T05:20:01.743282+0000","last_clean":"2024-09-17T05:20:01.743282+0000","last_became_active":"2024-09-17T05:20:00.542125+0000","last_became_peered":"2024-09-17T05:20:00.542125+0000","last_unstale":"2024-09-17T05:20:01.743282+0000","last_undegraded":"2024-09-17T05:20:01.743282+0000","last_fullsized":"2024-09-17T05:20:01.743282+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:09.623866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742332+0000","last_change":"2024-09-17T05:20:00.547956+0000","last_active":"2024-09-17T05:20:01.742332+0000","last_peered":"2024-09-17T05:20:01.742332+0000","last_clean":"2024-09-17T05:20:01.742332+0000","last_became_active":"2024-09-17T05:20:00.547651+0000","last_became_peered":"2024-09-17T05:20:00.547651+0000","last_unstale":"2024-09-17T05:20:01.742332+0000","last_undegraded":"2024-09-17T05:20:01.742332+0000","last_fullsized":"2024-09-17T05:20:01.742332+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:15.680079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742675+0000","last_change":"2024-09-17T05:20:00.541383+0000","last_active":"2024-09-17T05:20:01.742675+0000","last_peered":"2024-09-17T05:20:01.742675+0000","last_clean":"2024-09-17T05:20:01.742675+0000","last_became_active":"2024-09-17T05:20:00.540989+0000","last_became_peered":"2024-09-17T05:20:00.540989+0000","last_unstale":"2024-09-17T05:20:01.742675+0000","last_undegraded":"2024-09-17T05:20:01.742675+0000","last_fullsized":"2024-09-17T05:20:01.742675+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:22.730671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529604+0000","last_change":"2024-09-17T05:20:00.539569+0000","last_active":"2024-09-17T05:20:01.529604+0000","last_peered":"2024-09-17T05:20:01.529604+0000","last_clean":"2024-09-17T05:20:01.529604+0000","last_became_active":"2024-09-17T05:20:00.539334+0000","last_became_peered":"2024-09-17T05:20:00.539334+0000","last_unstale":"2024-09-17T05:20:01.529604+0000","last_undegraded":"2024-09-17T05:20:01.529604+0000","last_fullsized":"2024-09-17T05:20:01.529604+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:52.854277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742561+0000","last_change":"2024-09-17T05:20:00.542137+0000","last_active":"2024-09-17T05:20:01.742561+0000","last_peered":"2024-09-17T05:20:01.742561+0000","last_clean":"2024-09-17T05:20:01.742561+0000","last_became_active":"2024-09-17T05:20:00.541854+0000","last_became_peered":"2024-09-17T05:20:00.541854+0000","last_unstale":"2024-09-17T05:20:01.742561+0000","last_undegraded":"2024-09-17T05:20:01.742561+0000","last_fullsized":"2024-09-17T05:20:01.742561+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:19.644679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743629+0000","last_change":"2024-09-17T05:20:00.538481+0000","last_active":"2024-09-17T05:20:01.743629+0000","last_peered":"2024-09-17T05:20:01.743629+0000","last_clean":"2024-09-17T05:20:01.743629+0000","last_became_active":"2024-09-17T05:20:00.538224+0000","last_became_peered":"2024-09-17T05:20:00.538224+0000","last_unstale":"2024-09-17T05:20:01.743629+0000","last_undegraded":"2024-09-17T05:20:01.743629+0000","last_fullsized":"2024-09-17T05:20:01.743629+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:17:02.418648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.530791+0000","last_change":"2024-09-17T05:20:00.545333+0000","last_active":"2024-09-17T05:20:01.530791+0000","last_peered":"2024-09-17T05:20:01.530791+0000","last_clean":"2024-09-17T05:20:01.530791+0000","last_became_active":"2024-09-17T05:20:00.545083+0000","last_became_peered":"2024-09-17T05:20:00.545083+0000","last_unstale":"2024-09-17T05:20:01.530791+0000","last_undegraded":"2024-09-17T05:20:01.530791+0000","last_fullsized":"2024-09-17T05:20:01.530791+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:28:52.734175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.532381+0000","last_change":"2024-09-17T05:20:00.538315+0000","last_active":"2024-09-17T05:20:01.532381+0000","last_peered":"2024-09-17T05:20:01.532381+0000","last_clean":"2024-09-17T05:20:01.532381+0000","last_became_active":"2024-09-17T05:20:00.537973+0000","last_became_peered":"2024-09-17T05:20:00.537973+0000","last_unstale":"2024-09-17T05:20:01.532381+0000","last_undegraded":"2024-09-17T05:20:01.532381+0000","last_fullsized":"2024-09-17T05:20:01.532381+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:48.642363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531473+0000","last_change":"2024-09-17T05:20:00.541799+0000","last_active":"2024-09-17T05:20:01.531473+0000","last_peered":"2024-09-17T05:20:01.531473+0000","last_clean":"2024-09-17T05:20:01.531473+0000","last_became_active":"2024-09-17T05:20:00.541529+0000","last_became_peered":"2024-09-17T05:20:00.541529+0000","last_unstale":"2024-09-17T05:20:01.531473+0000","last_undegraded":"2024-09-17T05:20:01.531473+0000","last_fullsized":"2024-09-17T05:20:01.531473+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:16.729139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.532157+0000","last_change":"2024-09-17T05:20:00.542069+0000","last_active":"2024-09-17T05:20:01.532157+0000","last_peered":"2024-09-17T05:20:01.532157+0000","last_clean":"2024-09-17T05:20:01.532157+0000","last_became_active":"2024-09-17T05:20:00.541760+0000","last_became_peered":"2024-09-17T05:20:00.541760+0000","last_unstale":"2024-09-17T05:20:01.532157+0000","last_undegraded":"2024-09-17T05:20:01.532157+0000","last_fullsized":"2024-09-17T05:20:01.532157+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:58.148865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529705+0000","last_change":"2024-09-17T05:20:00.543451+0000","last_active":"2024-09-17T05:20:01.529705+0000","last_peered":"2024-09-17T05:20:01.529705+0000","last_clean":"2024-09-17T05:20:01.529705+0000","last_became_active":"2024-09-17T05:20:00.542502+0000","last_became_peered":"2024-09-17T05:20:00.542502+0000","last_unstale":"2024-09-17T05:20:01.529705+0000","last_undegraded":"2024-09-17T05:20:01.529705+0000","last_fullsized":"2024-09-17T05:20:01.529705+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:05:55.720457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743382+0000","last_change":"2024-09-17T05:20:00.540658+0000","last_active":"2024-09-17T05:20:01.743382+0000","last_peered":"2024-09-17T05:20:01.743382+0000","last_clean":"2024-09-17T05:20:01.743382+0000","last_became_active":"2024-09-17T05:20:00.540374+0000","last_became_peered":"2024-09-17T05:20:00.540374+0000","last_unstale":"2024-09-17T05:20:01.743382+0000","last_undegraded":"2024-09-17T05:20:01.743382+0000","last_fullsized":"2024-09-17T05:20:01.743382+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:45.763763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742607+0000","last_change":"2024-09-17T05:20:00.539828+0000","last_active":"2024-09-17T05:20:01.742607+0000","last_peered":"2024-09-17T05:20:01.742607+0000","last_clean":"2024-09-17T05:20:01.742607+0000","last_became_active":"2024-09-17T05:20:00.539574+0000","last_became_peered":"2024-09-17T05:20:00.539574+0000","last_unstale":"2024-09-17T05:20:01.742607+0000","last_undegraded":"2024-09-17T05:20:01.742607+0000","last_fullsized":"2024-09-17T05:20:01.742607+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:24.410149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531955+0000","last_change":"2024-09-17T05:20:00.547853+0000","last_active":"2024-09-17T05:20:01.531955+0000","last_peered":"2024-09-17T05:20:01.531955+0000","last_clean":"2024-09-17T05:20:01.531955+0000","last_became_active":"2024-09-17T05:20:00.547005+0000","last_became_peered":"2024-09-17T05:20:00.547005+0000","last_unstale":"2024-09-17T05:20:01.531955+0000","last_undegraded":"2024-09-17T05:20:01.531955+0000","last_fullsized":"2024-09-17T05:20:01.531955+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:03.967733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.530873+0000","last_change":"2024-09-17T05:20:00.547374+0000","last_active":"2024-09-17T05:20:01.530873+0000","last_peered":"2024-09-17T05:20:01.530873+0000","last_clean":"2024-09-17T05:20:01.530873+0000","last_became_active":"2024-09-17T05:20:00.547086+0000","last_became_peered":"2024-09-17T05:20:00.547086+0000","last_unstale":"2024-09-17T05:20:01.530873+0000","last_undegraded":"2024-09-17T05:20:01.530873+0000","last_fullsized":"2024-09-17T05:20:01.530873+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:05.978401+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531881+0000","last_change":"2024-09-17T05:20:00.542690+0000","last_active":"2024-09-17T05:20:01.531881+0000","last_peered":"2024-09-17T05:20:01.531881+0000","last_clean":"2024-09-17T05:20:01.531881+0000","last_became_active":"2024-09-17T05:20:00.542349+0000","last_became_peered":"2024-09-17T05:20:00.542349+0000","last_unstale":"2024-09-17T05:20:01.531881+0000","last_undegraded":"2024-09-17T05:20:01.531881+0000","last_fullsized":"2024-09-17T05:20:01.531881+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:43.827520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529813+0000","last_change":"2024-09-17T05:20:00.539389+0000","last_active":"2024-09-17T05:20:01.529813+0000","last_peered":"2024-09-17T05:20:01.529813+0000","last_clean":"2024-09-17T05:20:01.529813+0000","last_became_active":"2024-09-17T05:20:00.539098+0000","last_became_peered":"2024-09-17T05:20:00.539098+0000","last_unstale":"2024-09-17T05:20:01.529813+0000","last_undegraded":"2024-09-17T05:20:01.529813+0000","last_fullsized":"2024-09-17T05:20:01.529813+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:59:59.305586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531326+0000","last_change":"2024-09-17T05:20:00.543003+0000","last_active":"2024-09-17T05:20:01.531326+0000","last_peered":"2024-09-17T05:20:01.531326+0000","last_clean":"2024-09-17T05:20:01.531326+0000","last_became_active":"2024-09-17T05:20:00.542562+0000","last_became_peered":"2024-09-17T05:20:00.542562+0000","last_unstale":"2024-09-17T05:20:01.531326+0000","last_undegraded":"2024-09-17T05:20:01.531326+0000","last_fullsized":"2024-09-17T05:20:01.531326+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:58.255230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742935+0000","last_change":"2024-09-17T05:20:00.540456+0000","last_active":"2024-09-17T05:20:01.742935+0000","last_peered":"2024-09-17T05:20:01.742935+0000","last_clean":"2024-09-17T05:20:01.742935+0000","last_became_active":"2024-09-17T05:20:00.540089+0000","last_became_peered":"2024-09-17T05:20:00.540089+0000","last_unstale":"2024-09-17T05:20:01.742935+0000","last_undegraded":"2024-09-17T05:20:01.742935+0000","last_fullsized":"2024-09-17T05:20:01.742935+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:17.802349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531420+0000","last_change":"2024-09-17T05:20:00.542080+0000","last_active":"2024-09-17T05:20:01.531420+0000","last_peered":"2024-09-17T05:20:01.531420+0000","last_clean":"2024-09-17T05:20:01.531420+0000","last_became_active":"2024-09-17T05:20:00.541796+0000","last_became_peered":"2024-09-17T05:20:00.541796+0000","last_unstale":"2024-09-17T05:20:01.531420+0000","last_undegraded":"2024-09-17T05:20:01.531420+0000","last_fullsized":"2024-09-17T05:20:01.531420+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:52.205670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.530848+0000","last_change":"2024-09-17T05:20:00.549564+0000","last_active":"2024-09-17T05:20:01.530848+0000","last_peered":"2024-09-17T05:20:01.530848+0000","last_clean":"2024-09-17T05:20:01.530848+0000","last_became_active":"2024-09-17T05:20:00.549300+0000","last_became_peered":"2024-09-17T05:20:00.549300+0000","last_unstale":"2024-09-17T05:20:01.530848+0000","last_undegraded":"2024-09-17T05:20:01.530848+0000","last_fullsized":"2024-09-17T05:20:01.530848+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:46.137426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743707+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:01.743707+0000","last_peered":"2024-09-17T05:20:01.743707+0000","last_clean":"2024-09-17T05:20:01.743707+0000","last_became_active":"2024-09-17T05:20:00.544913+0000","last_became_peered":"2024-09-17T05:20:00.544913+0000","last_unstale":"2024-09-17T05:20:01.743707+0000","last_undegraded":"2024-09-17T05:20:01.743707+0000","last_fullsized":"2024-09-17T05:20:01.743707+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:06:57.453291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529529+0000","last_change":"2024-09-17T05:20:00.548447+0000","last_active":"2024-09-17T05:20:01.529529+0000","last_peered":"2024-09-17T05:20:01.529529+0000","last_clean":"2024-09-17T05:20:01.529529+0000","last_became_active":"2024-09-17T05:20:00.548097+0000","last_became_peered":"2024-09-17T05:20:00.548097+0000","last_unstale":"2024-09-17T05:20:01.529529+0000","last_undegraded":"2024-09-17T05:20:01.529529+0000","last_fullsized":"2024-09-17T05:20:01.529529+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:00.588738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742179+0000","last_change":"2024-09-17T05:20:00.547293+0000","last_active":"2024-09-17T05:20:01.742179+0000","last_peered":"2024-09-17T05:20:01.742179+0000","last_clean":"2024-09-17T05:20:01.742179+0000","last_became_active":"2024-09-17T05:20:00.547026+0000","last_became_peered":"2024-09-17T05:20:00.547026+0000","last_unstale":"2024-09-17T05:20:01.742179+0000","last_undegraded":"2024-09-17T05:20:01.742179+0000","last_fullsized":"2024-09-17T05:20:01.742179+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:10.399894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"44'4","reported_seq":19,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743945+0000","last_change":"2024-09-17T05:19:59.558973+0000","last_active":"2024-09-17T05:20:01.743945+0000","last_peered":"2024-09-17T05:20:01.743945+0000","last_clean":"2024-09-17T05:20:01.743945+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:01.743945+0000","last_undegraded":"2024-09-17T05:20:01.743945+0000","last_fullsized":"2024-09-17T05:20:01.743945+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:00.930635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.532107+0000","last_change":"2024-09-17T05:20:00.538883+0000","last_active":"2024-09-17T05:20:01.532107+0000","last_peered":"2024-09-17T05:20:01.532107+0000","last_clean":"2024-09-17T05:20:01.532107+0000","last_became_active":"2024-09-17T05:20:00.538502+0000","last_became_peered":"2024-09-17T05:20:00.538502+0000","last_unstale":"2024-09-17T05:20:01.532107+0000","last_undegraded":"2024-09-17T05:20:01.532107+0000","last_fullsized":"2024-09-17T05:20:01.532107+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:33.584816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.532074+0000","last_change":"2024-09-17T05:19:59.559007+0000","last_active":"2024-09-17T05:20:01.532074+0000","last_peered":"2024-09-17T05:20:01.532074+0000","last_clean":"2024-09-17T05:20:01.532074+0000","last_became_active":"2024-09-17T05:19:59.558696+0000","last_became_peered":"2024-09-17T05:19:59.558696+0000","last_unstale":"2024-09-17T05:20:01.532074+0000","last_undegraded":"2024-09-17T05:20:01.532074+0000","last_fullsized":"2024-09-17T05:20:01.532074+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742964+0000","last_change":"2024-09-17T05:20:00.545138+0000","last_active":"2024-09-17T05:20:01.742964+0000","last_peered":"2024-09-17T05:20:01.742964+0000","last_clean":"2024-09-17T05:20:01.742964+0000","last_became_active":"2024-09-17T05:20:00.544865+0000","last_became_peered":"2024-09-17T05:20:00.544865+0000","last_unstale":"2024-09-17T05:20:01.742964+0000","last_undegraded":"2024-09-17T05:20:01.742964+0000","last_fullsized":"2024-09-17T05:20:01.742964+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:20:39.536766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742583+0000","last_change":"2024-09-17T05:19:59.563623+0000","last_active":"2024-09-17T05:20:01.742583+0000","last_peered":"2024-09-17T05:20:01.742583+0000","last_clean":"2024-09-17T05:20:01.742583+0000","last_became_active":"2024-09-17T05:19:59.563315+0000","last_became_peered":"2024-09-17T05:19:59.563315+0000","last_unstale":"2024-09-17T05:20:01.742583+0000","last_undegraded":"2024-09-17T05:20:01.742583+0000","last_fullsized":"2024-09-17T05:20:01.742583+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:18.669248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742616+0000","last_change":"2024-09-17T05:20:00.544721+0000","last_active":"2024-09-17T05:20:01.742616+0000","last_peered":"2024-09-17T05:20:01.742616+0000","last_clean":"2024-09-17T05:20:01.742616+0000","last_became_active":"2024-09-17T05:20:00.544443+0000","last_became_peered":"2024-09-17T05:20:00.544443+0000","last_unstale":"2024-09-17T05:20:01.742616+0000","last_undegraded":"2024-09-17T05:20:01.742616+0000","last_fullsized":"2024-09-17T05:20:01.742616+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:03.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742441+0000","last_change":"2024-09-17T05:19:59.564861+0000","last_active":"2024-09-17T05:20:01.742441+0000","last_peered":"2024-09-17T05:20:01.742441+0000","last_clean":"2024-09-17T05:20:01.742441+0000","last_became_active":"2024-09-17T05:19:59.564565+0000","last_became_peered":"2024-09-17T05:19:59.564565+0000","last_unstale":"2024-09-17T05:20:01.742441+0000","last_undegraded":"2024-09-17T05:20:01.742441+0000","last_fullsized":"2024-09-17T05:20:01.742441+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:08.780997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531077+0000","last_change":"2024-09-17T05:20:00.539449+0000","last_active":"2024-09-17T05:20:01.531077+0000","last_peered":"2024-09-17T05:20:01.531077+0000","last_clean":"2024-09-17T05:20:01.531077+0000","last_became_active":"2024-09-17T05:20:00.539171+0000","last_became_peered":"2024-09-17T05:20:00.539171+0000","last_unstale":"2024-09-17T05:20:01.531077+0000","last_undegraded":"2024-09-17T05:20:01.531077+0000","last_fullsized":"2024-09-17T05:20:01.531077+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:31.726678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743645+0000","last_change":"2024-09-17T05:19:59.562556+0000","last_active":"2024-09-17T05:20:01.743645+0000","last_peered":"2024-09-17T05:20:01.743645+0000","last_clean":"2024-09-17T05:20:01.743645+0000","last_became_active":"2024-09-17T05:19:59.562255+0000","last_became_peered":"2024-09-17T05:19:59.562255+0000","last_unstale":"2024-09-17T05:20:01.743645+0000","last_undegraded":"2024-09-17T05:20:01.743645+0000","last_fullsized":"2024-09-17T05:20:01.743645+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:47.640069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743463+0000","last_change":"2024-09-17T05:20:00.541466+0000","last_active":"2024-09-17T05:20:01.743463+0000","last_peered":"2024-09-17T05:20:01.743463+0000","last_clean":"2024-09-17T05:20:01.743463+0000","last_became_active":"2024-09-17T05:20:00.541188+0000","last_became_peered":"2024-09-17T05:20:00.541188+0000","last_unstale":"2024-09-17T05:20:01.743463+0000","last_undegraded":"2024-09-17T05:20:01.743463+0000","last_fullsized":"2024-09-17T05:20:01.743463+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:27:03.990595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531248+0000","last_change":"2024-09-17T05:19:59.558825+0000","last_active":"2024-09-17T05:20:01.531248+0000","last_peered":"2024-09-17T05:20:01.531248+0000","last_clean":"2024-09-17T05:20:01.531248+0000","last_became_active":"2024-09-17T05:19:59.558529+0000","last_became_peered":"2024-09-17T05:19:59.558529+0000","last_unstale":"2024-09-17T05:20:01.531248+0000","last_undegraded":"2024-09-17T05:20:01.531248+0000","last_fullsized":"2024-09-17T05:20:01.531248+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:15:42.182629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743226+0000","last_change":"2024-09-17T05:20:00.540530+0000","last_active":"2024-09-17T05:20:01.743226+0000","last_peered":"2024-09-17T05:20:01.743226+0000","last_clean":"2024-09-17T05:20:01.743226+0000","last_became_active":"2024-09-17T05:20:00.540290+0000","last_became_peered":"2024-09-17T05:20:00.540290+0000","last_unstale":"2024-09-17T05:20:01.743226+0000","last_undegraded":"2024-09-17T05:20:01.743226+0000","last_fullsized":"2024-09-17T05:20:01.743226+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:53.772828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742279+0000","last_change":"2024-09-17T05:19:59.563788+0000","last_active":"2024-09-17T05:20:01.742279+0000","last_peered":"2024-09-17T05:20:01.742279+0000","last_clean":"2024-09-17T05:20:01.742279+0000","last_became_active":"2024-09-17T05:19:59.563534+0000","last_became_peered":"2024-09-17T05:19:59.563534+0000","last_unstale":"2024-09-17T05:20:01.742279+0000","last_undegraded":"2024-09-17T05:20:01.742279+0000","last_fullsized":"2024-09-17T05:20:01.742279+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:19.937150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.530952+0000","last_change":"2024-09-17T05:20:00.548448+0000","last_active":"2024-09-17T05:20:01.530952+0000","last_peered":"2024-09-17T05:20:01.530952+0000","last_clean":"2024-09-17T05:20:01.530952+0000","last_became_active":"2024-09-17T05:20:00.547380+0000","last_became_peered":"2024-09-17T05:20:00.547380+0000","last_unstale":"2024-09-17T05:20:01.530952+0000","last_undegraded":"2024-09-17T05:20:01.530952+0000","last_fullsized":"2024-09-17T05:20:01.530952+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:11.582242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743316+0000","last_change":"2024-09-17T05:19:59.559553+0000","last_active":"2024-09-17T05:20:01.743316+0000","last_peered":"2024-09-17T05:20:01.743316+0000","last_clean":"2024-09-17T05:20:01.743316+0000","last_became_active":"2024-09-17T05:19:59.558325+0000","last_became_peered":"2024-09-17T05:19:59.558325+0000","last_unstale":"2024-09-17T05:20:01.743316+0000","last_undegraded":"2024-09-17T05:20:01.743316+0000","last_fullsized":"2024-09-17T05:20:01.743316+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:53.239438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531711+0000","last_change":"2024-09-17T05:20:00.542588+0000","last_active":"2024-09-17T05:20:01.531711+0000","last_peered":"2024-09-17T05:20:01.531711+0000","last_clean":"2024-09-17T05:20:01.531711+0000","last_became_active":"2024-09-17T05:20:00.542297+0000","last_became_peered":"2024-09-17T05:20:00.542297+0000","last_unstale":"2024-09-17T05:20:01.531711+0000","last_undegraded":"2024-09-17T05:20:01.531711+0000","last_fullsized":"2024-09-17T05:20:01.531711+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:01.932930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.532414+0000","last_change":"2024-09-17T05:19:59.558968+0000","last_active":"2024-09-17T05:20:01.532414+0000","last_peered":"2024-09-17T05:20:01.532414+0000","last_clean":"2024-09-17T05:20:01.532414+0000","last_became_active":"2024-09-17T05:19:59.558447+0000","last_became_peered":"2024-09-17T05:19:59.558447+0000","last_unstale":"2024-09-17T05:20:01.532414+0000","last_undegraded":"2024-09-17T05:20:01.532414+0000","last_fullsized":"2024-09-17T05:20:01.532414+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742905+0000","last_change":"2024-09-17T05:20:00.548751+0000","last_active":"2024-09-17T05:20:01.742905+0000","last_peered":"2024-09-17T05:20:01.742905+0000","last_clean":"2024-09-17T05:20:01.742905+0000","last_became_active":"2024-09-17T05:20:00.548410+0000","last_became_peered":"2024-09-17T05:20:00.548410+0000","last_unstale":"2024-09-17T05:20:01.742905+0000","last_undegraded":"2024-09-17T05:20:01.742905+0000","last_fullsized":"2024-09-17T05:20:01.742905+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:58.772520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743472+0000","last_change":"2024-09-17T05:19:59.562295+0000","last_active":"2024-09-17T05:20:01.743472+0000","last_peered":"2024-09-17T05:20:01.743472+0000","last_clean":"2024-09-17T05:20:01.743472+0000","last_became_active":"2024-09-17T05:19:59.562032+0000","last_became_peered":"2024-09-17T05:19:59.562032+0000","last_unstale":"2024-09-17T05:20:01.743472+0000","last_undegraded":"2024-09-17T05:20:01.743472+0000","last_fullsized":"2024-09-17T05:20:01.743472+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:02:28.157179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743858+0000","last_change":"2024-09-17T05:20:00.543079+0000","last_active":"2024-09-17T05:20:01.743858+0000","last_peered":"2024-09-17T05:20:01.743858+0000","last_clean":"2024-09-17T05:20:01.743858+0000","last_became_active":"2024-09-17T05:20:00.542816+0000","last_became_peered":"2024-09-17T05:20:00.542816+0000","last_unstale":"2024-09-17T05:20:01.743858+0000","last_undegraded":"2024-09-17T05:20:01.743858+0000","last_fullsized":"2024-09-17T05:20:01.743858+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:24.663573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"44'3","reported_seq":18,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743323+0000","last_change":"2024-09-17T05:19:59.565867+0000","last_active":"2024-09-17T05:20:01.743323+0000","last_peered":"2024-09-17T05:20:01.743323+0000","last_clean":"2024-09-17T05:20:01.743323+0000","last_became_active":"2024-09-17T05:19:59.565572+0000","last_became_peered":"2024-09-17T05:19:59.565572+0000","last_unstale":"2024-09-17T05:20:01.743323+0000","last_undegraded":"2024-09-17T05:20:01.743323+0000","last_fullsized":"2024-09-17T05:20:01.743323+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:44:30.724384+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743171+0000","last_change":"2024-09-17T05:20:00.548336+0000","last_active":"2024-09-17T05:20:01.743171+0000","last_peered":"2024-09-17T05:20:01.743171+0000","last_clean":"2024-09-17T05:20:01.743171+0000","last_became_active":"2024-09-17T05:20:00.548016+0000","last_became_peered":"2024-09-17T05:20:00.548016+0000","last_unstale":"2024-09-17T05:20:01.743171+0000","last_undegraded":"2024-09-17T05:20:01.743171+0000","last_fullsized":"2024-09-17T05:20:01.743171+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:24:49.650410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"44'6","reported_seq":21,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529676+0000","last_change":"2024-09-17T05:19:59.559093+0000","last_active":"2024-09-17T05:20:01.529676+0000","last_peered":"2024-09-17T05:20:01.529676+0000","last_clean":"2024-09-17T05:20:01.529676+0000","last_became_active":"2024-09-17T05:19:59.558796+0000","last_became_peered":"2024-09-17T05:19:59.558796+0000","last_unstale":"2024-09-17T05:20:01.529676+0000","last_undegraded":"2024-09-17T05:20:01.529676+0000","last_fullsized":"2024-09-17T05:20:01.529676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:10.022680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531536+0000","last_change":"2024-09-17T05:20:00.543996+0000","last_active":"2024-09-17T05:20:01.531536+0000","last_peered":"2024-09-17T05:20:01.531536+0000","last_clean":"2024-09-17T05:20:01.531536+0000","last_became_active":"2024-09-17T05:20:00.542577+0000","last_became_peered":"2024-09-17T05:20:00.542577+0000","last_unstale":"2024-09-17T05:20:01.531536+0000","last_undegraded":"2024-09-17T05:20:01.531536+0000","last_fullsized":"2024-09-17T05:20:01.531536+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:19.671543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743745+0000","last_change":"2024-09-17T05:19:59.559096+0000","last_active":"2024-09-17T05:20:01.743745+0000","last_peered":"2024-09-17T05:20:01.743745+0000","last_clean":"2024-09-17T05:20:01.743745+0000","last_became_active":"2024-09-17T05:19:59.558466+0000","last_became_peered":"2024-09-17T05:19:59.558466+0000","last_unstale":"2024-09-17T05:20:01.743745+0000","last_undegraded":"2024-09-17T05:20:01.743745+0000","last_fullsized":"2024-09-17T05:20:01.743745+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:02.120617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743251+0000","last_change":"2024-09-17T05:20:00.546015+0000","last_active":"2024-09-17T05:20:01.743251+0000","last_peered":"2024-09-17T05:20:01.743251+0000","last_clean":"2024-09-17T05:20:01.743251+0000","last_became_active":"2024-09-17T05:20:00.545772+0000","last_became_peered":"2024-09-17T05:20:00.545772+0000","last_unstale":"2024-09-17T05:20:01.743251+0000","last_undegraded":"2024-09-17T05:20:01.743251+0000","last_fullsized":"2024-09-17T05:20:01.743251+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:41:43.964460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743068+0000","last_change":"2024-09-17T05:19:59.563984+0000","last_active":"2024-09-17T05:20:01.743068+0000","last_peered":"2024-09-17T05:20:01.743068+0000","last_clean":"2024-09-17T05:20:01.743068+0000","last_became_active":"2024-09-17T05:19:59.563645+0000","last_became_peered":"2024-09-17T05:19:59.563645+0000","last_unstale":"2024-09-17T05:20:01.743068+0000","last_undegraded":"2024-09-17T05:20:01.743068+0000","last_fullsized":"2024-09-17T05:20:01.743068+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:32.582522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743383+0000","last_change":"2024-09-17T05:20:00.541286+0000","last_active":"2024-09-17T05:20:01.743383+0000","last_peered":"2024-09-17T05:20:01.743383+0000","last_clean":"2024-09-17T05:20:01.743383+0000","last_became_active":"2024-09-17T05:20:00.541020+0000","last_became_peered":"2024-09-17T05:20:00.541020+0000","last_unstale":"2024-09-17T05:20:01.743383+0000","last_undegraded":"2024-09-17T05:20:01.743383+0000","last_fullsized":"2024-09-17T05:20:01.743383+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:42.176314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743816+0000","last_change":"2024-09-17T05:19:59.563576+0000","last_active":"2024-09-17T05:20:01.743816+0000","last_peered":"2024-09-17T05:20:01.743816+0000","last_clean":"2024-09-17T05:20:01.743816+0000","last_became_active":"2024-09-17T05:19:59.563297+0000","last_became_peered":"2024-09-17T05:19:59.563297+0000","last_unstale":"2024-09-17T05:20:01.743816+0000","last_undegraded":"2024-09-17T05:20:01.743816+0000","last_fullsized":"2024-09-17T05:20:01.743816+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:16.800054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742769+0000","last_change":"2024-09-17T05:20:00.550850+0000","last_active":"2024-09-17T05:20:01.742769+0000","last_peered":"2024-09-17T05:20:01.742769+0000","last_clean":"2024-09-17T05:20:01.742769+0000","last_became_active":"2024-09-17T05:20:00.550558+0000","last_became_peered":"2024-09-17T05:20:00.550558+0000","last_unstale":"2024-09-17T05:20:01.742769+0000","last_undegraded":"2024-09-17T05:20:01.742769+0000","last_fullsized":"2024-09-17T05:20:01.742769+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:00.940748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"44'8","reported_seq":23,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743345+0000","last_change":"2024-09-17T05:19:59.557275+0000","last_active":"2024-09-17T05:20:01.743345+0000","last_peered":"2024-09-17T05:20:01.743345+0000","last_clean":"2024-09-17T05:20:01.743345+0000","last_became_active":"2024-09-17T05:19:59.557011+0000","last_became_peered":"2024-09-17T05:19:59.557011+0000","last_unstale":"2024-09-17T05:20:01.743345+0000","last_undegraded":"2024-09-17T05:20:01.743345+0000","last_fullsized":"2024-09-17T05:20:01.743345+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:36:57.894212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529816+0000","last_change":"2024-09-17T05:20:00.541991+0000","last_active":"2024-09-17T05:20:01.529816+0000","last_peered":"2024-09-17T05:20:01.529816+0000","last_clean":"2024-09-17T05:20:01.529816+0000","last_became_active":"2024-09-17T05:20:00.541748+0000","last_became_peered":"2024-09-17T05:20:00.541748+0000","last_unstale":"2024-09-17T05:20:01.529816+0000","last_undegraded":"2024-09-17T05:20:01.529816+0000","last_fullsized":"2024-09-17T05:20:01.529816+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:36.647387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529803+0000","last_change":"2024-09-17T05:19:59.556315+0000","last_active":"2024-09-17T05:20:01.529803+0000","last_peered":"2024-09-17T05:20:01.529803+0000","last_clean":"2024-09-17T05:20:01.529803+0000","last_became_active":"2024-09-17T05:19:59.556024+0000","last_became_peered":"2024-09-17T05:19:59.556024+0000","last_unstale":"2024-09-17T05:20:01.529803+0000","last_undegraded":"2024-09-17T05:20:01.529803+0000","last_fullsized":"2024-09-17T05:20:01.529803+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:58:16.225734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742893+0000","last_change":"2024-09-17T05:20:00.542941+0000","last_active":"2024-09-17T05:20:01.742893+0000","last_peered":"2024-09-17T05:20:01.742893+0000","last_clean":"2024-09-17T05:20:01.742893+0000","last_became_active":"2024-09-17T05:20:00.542010+0000","last_became_peered":"2024-09-17T05:20:00.542010+0000","last_unstale":"2024-09-17T05:20:01.742893+0000","last_undegraded":"2024-09-17T05:20:01.742893+0000","last_fullsized":"2024-09-17T05:20:01.742893+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:02.009019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.532204+0000","last_change":"2024-09-17T05:19:59.560582+0000","last_active":"2024-09-17T05:20:01.532204+0000","last_peered":"2024-09-17T05:20:01.532204+0000","last_clean":"2024-09-17T05:20:01.532204+0000","last_became_active":"2024-09-17T05:19:59.560282+0000","last_became_peered":"2024-09-17T05:19:59.560282+0000","last_unstale":"2024-09-17T05:20:01.532204+0000","last_undegraded":"2024-09-17T05:20:01.532204+0000","last_fullsized":"2024-09-17T05:20:01.532204+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:51.203376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531560+0000","last_change":"2024-09-17T05:20:00.543830+0000","last_active":"2024-09-17T05:20:01.531560+0000","last_peered":"2024-09-17T05:20:01.531560+0000","last_clean":"2024-09-17T05:20:01.531560+0000","last_became_active":"2024-09-17T05:20:00.543210+0000","last_became_peered":"2024-09-17T05:20:00.543210+0000","last_unstale":"2024-09-17T05:20:01.531560+0000","last_undegraded":"2024-09-17T05:20:01.531560+0000","last_fullsized":"2024-09-17T05:20:01.531560+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:01:53.258986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"44'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742922+0000","last_change":"2024-09-17T05:19:59.564268+0000","last_active":"2024-09-17T05:20:01.742922+0000","last_peered":"2024-09-17T05:20:01.742922+0000","last_clean":"2024-09-17T05:20:01.742922+0000","last_became_active":"2024-09-17T05:19:59.563909+0000","last_became_peered":"2024-09-17T05:19:59.563909+0000","last_unstale":"2024-09-17T05:20:01.742922+0000","last_undegraded":"2024-09-17T05:20:01.742922+0000","last_fullsized":"2024-09-17T05:20:01.742922+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:56.717406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531698+0000","last_change":"2024-09-17T05:20:00.544504+0000","last_active":"2024-09-17T05:20:01.531698+0000","last_peered":"2024-09-17T05:20:01.531698+0000","last_clean":"2024-09-17T05:20:01.531698+0000","last_became_active":"2024-09-17T05:20:00.544123+0000","last_became_peered":"2024-09-17T05:20:00.544123+0000","last_unstale":"2024-09-17T05:20:01.531698+0000","last_undegraded":"2024-09-17T05:20:01.531698+0000","last_fullsized":"2024-09-17T05:20:01.531698+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:14.214900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743873+0000","last_change":"2024-09-17T05:19:59.558812+0000","last_active":"2024-09-17T05:20:01.743873+0000","last_peered":"2024-09-17T05:20:01.743873+0000","last_clean":"2024-09-17T05:20:01.743873+0000","last_became_active":"2024-09-17T05:19:59.558524+0000","last_became_peered":"2024-09-17T05:19:59.558524+0000","last_unstale":"2024-09-17T05:20:01.743873+0000","last_undegraded":"2024-09-17T05:20:01.743873+0000","last_fullsized":"2024-09-17T05:20:01.743873+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:23:59.938453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743901+0000","last_change":"2024-09-17T05:20:00.540236+0000","last_active":"2024-09-17T05:20:01.743901+0000","last_peered":"2024-09-17T05:20:01.743901+0000","last_clean":"2024-09-17T05:20:01.743901+0000","last_became_active":"2024-09-17T05:20:00.539968+0000","last_became_peered":"2024-09-17T05:20:00.539968+0000","last_unstale":"2024-09-17T05:20:01.743901+0000","last_undegraded":"2024-09-17T05:20:01.743901+0000","last_fullsized":"2024-09-17T05:20:01.743901+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:49.245525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743921+0000","last_change":"2024-09-17T05:19:59.562482+0000","last_active":"2024-09-17T05:20:01.743921+0000","last_peered":"2024-09-17T05:20:01.743921+0000","last_clean":"2024-09-17T05:20:01.743921+0000","last_became_active":"2024-09-17T05:19:59.562197+0000","last_became_peered":"2024-09-17T05:19:59.562197+0000","last_unstale":"2024-09-17T05:20:01.743921+0000","last_undegraded":"2024-09-17T05:20:01.743921+0000","last_fullsized":"2024-09-17T05:20:01.743921+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:48:54.242394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742504+0000","last_change":"2024-09-17T05:20:00.542587+0000","last_active":"2024-09-17T05:20:01.742504+0000","last_peered":"2024-09-17T05:20:01.742504+0000","last_clean":"2024-09-17T05:20:01.742504+0000","last_became_active":"2024-09-17T05:20:00.542114+0000","last_became_peered":"2024-09-17T05:20:00.542114+0000","last_unstale":"2024-09-17T05:20:01.742504+0000","last_undegraded":"2024-09-17T05:20:01.742504+0000","last_fullsized":"2024-09-17T05:20:01.742504+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:23:20.939444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743065+0000","last_change":"2024-09-17T05:19:59.559159+0000","last_active":"2024-09-17T05:20:01.743065+0000","last_peered":"2024-09-17T05:20:01.743065+0000","last_clean":"2024-09-17T05:20:01.743065+0000","last_became_active":"2024-09-17T05:19:59.558919+0000","last_became_peered":"2024-09-17T05:19:59.558919+0000","last_unstale":"2024-09-17T05:20:01.743065+0000","last_undegraded":"2024-09-17T05:20:01.743065+0000","last_fullsized":"2024-09-17T05:20:01.743065+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:47:02.735582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.529570+0000","last_change":"2024-09-17T05:20:00.547679+0000","last_active":"2024-09-17T05:20:01.529570+0000","last_peered":"2024-09-17T05:20:01.529570+0000","last_clean":"2024-09-17T05:20:01.529570+0000","last_became_active":"2024-09-17T05:20:00.547424+0000","last_became_peered":"2024-09-17T05:20:00.547424+0000","last_unstale":"2024-09-17T05:20:01.529570+0000","last_undegraded":"2024-09-17T05:20:01.529570+0000","last_fullsized":"2024-09-17T05:20:01.529570+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:53:12.575040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742285+0000","last_change":"2024-09-17T05:19:59.557646+0000","last_active":"2024-09-17T05:20:01.742285+0000","last_peered":"2024-09-17T05:20:01.742285+0000","last_clean":"2024-09-17T05:20:01.742285+0000","last_became_active":"2024-09-17T05:19:59.557222+0000","last_became_peered":"2024-09-17T05:19:59.557222+0000","last_unstale":"2024-09-17T05:20:01.742285+0000","last_undegraded":"2024-09-17T05:20:01.742285+0000","last_fullsized":"2024-09-17T05:20:01.742285+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:31.102126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742192+0000","last_change":"2024-09-17T05:20:00.545696+0000","last_active":"2024-09-17T05:20:01.742192+0000","last_peered":"2024-09-17T05:20:01.742192+0000","last_clean":"2024-09-17T05:20:01.742192+0000","last_became_active":"2024-09-17T05:20:00.545406+0000","last_became_peered":"2024-09-17T05:20:00.545406+0000","last_unstale":"2024-09-17T05:20:01.742192+0000","last_undegraded":"2024-09-17T05:20:01.742192+0000","last_fullsized":"2024-09-17T05:20:01.742192+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:11:49.849241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743144+0000","last_change":"2024-09-17T05:19:59.566679+0000","last_active":"2024-09-17T05:20:01.743144+0000","last_peered":"2024-09-17T05:20:01.743144+0000","last_clean":"2024-09-17T05:20:01.743144+0000","last_became_active":"2024-09-17T05:19:59.566350+0000","last_became_peered":"2024-09-17T05:19:59.566350+0000","last_unstale":"2024-09-17T05:20:01.743144+0000","last_undegraded":"2024-09-17T05:20:01.743144+0000","last_fullsized":"2024-09-17T05:20:01.743144+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:04:20.291413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.532083+0000","last_change":"2024-09-17T05:20:00.545489+0000","last_active":"2024-09-17T05:20:01.532083+0000","last_peered":"2024-09-17T05:20:01.532083+0000","last_clean":"2024-09-17T05:20:01.532083+0000","last_became_active":"2024-09-17T05:20:00.545052+0000","last_became_peered":"2024-09-17T05:20:00.545052+0000","last_unstale":"2024-09-17T05:20:01.532083+0000","last_undegraded":"2024-09-17T05:20:01.532083+0000","last_fullsized":"2024-09-17T05:20:01.532083+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:21.905648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"45'1","reported_seq":16,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743744+0000","last_change":"2024-09-17T05:19:59.561764+0000","last_active":"2024-09-17T05:20:01.743744+0000","last_peered":"2024-09-17T05:20:01.743744+0000","last_clean":"2024-09-17T05:20:01.743744+0000","last_became_active":"2024-09-17T05:19:59.561368+0000","last_became_peered":"2024-09-17T05:19:59.561368+0000","last_unstale":"2024-09-17T05:20:01.743744+0000","last_undegraded":"2024-09-17T05:20:01.743744+0000","last_fullsized":"2024-09-17T05:20:01.743744+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:08:27.664506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742883+0000","last_change":"2024-09-17T05:20:00.538909+0000","last_active":"2024-09-17T05:20:01.742883+0000","last_peered":"2024-09-17T05:20:01.742883+0000","last_clean":"2024-09-17T05:20:01.742883+0000","last_became_active":"2024-09-17T05:20:00.538619+0000","last_became_peered":"2024-09-17T05:20:00.538619+0000","last_unstale":"2024-09-17T05:20:01.742883+0000","last_undegraded":"2024-09-17T05:20:01.742883+0000","last_fullsized":"2024-09-17T05:20:01.742883+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:55:40.905448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743379+0000","last_change":"2024-09-17T05:19:59.566316+0000","last_active":"2024-09-17T05:20:01.743379+0000","last_peered":"2024-09-17T05:20:01.743379+0000","last_clean":"2024-09-17T05:20:01.743379+0000","last_became_active":"2024-09-17T05:19:59.565973+0000","last_became_peered":"2024-09-17T05:19:59.565973+0000","last_unstale":"2024-09-17T05:20:01.743379+0000","last_undegraded":"2024-09-17T05:20:01.743379+0000","last_fullsized":"2024-09-17T05:20:01.743379+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:30.046614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743264+0000","last_change":"2024-09-17T05:20:00.549077+0000","last_active":"2024-09-17T05:20:01.743264+0000","last_peered":"2024-09-17T05:20:01.743264+0000","last_clean":"2024-09-17T05:20:01.743264+0000","last_became_active":"2024-09-17T05:20:00.548735+0000","last_became_peered":"2024-09-17T05:20:00.548735+0000","last_unstale":"2024-09-17T05:20:01.743264+0000","last_undegraded":"2024-09-17T05:20:01.743264+0000","last_fullsized":"2024-09-17T05:20:01.743264+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:33.174380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742405+0000","last_change":"2024-09-17T05:19:59.563528+0000","last_active":"2024-09-17T05:20:01.742405+0000","last_peered":"2024-09-17T05:20:01.742405+0000","last_clean":"2024-09-17T05:20:01.742405+0000","last_became_active":"2024-09-17T05:19:59.563264+0000","last_became_peered":"2024-09-17T05:19:59.563264+0000","last_unstale":"2024-09-17T05:20:01.742405+0000","last_undegraded":"2024-09-17T05:20:01.742405+0000","last_fullsized":"2024-09-17T05:20:01.742405+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:35:10.579948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.744038+0000","last_change":"2024-09-17T05:20:00.548525+0000","last_active":"2024-09-17T05:20:01.744038+0000","last_peered":"2024-09-17T05:20:01.744038+0000","last_clean":"2024-09-17T05:20:01.744038+0000","last_became_active":"2024-09-17T05:20:00.548220+0000","last_became_peered":"2024-09-17T05:20:00.548220+0000","last_unstale":"2024-09-17T05:20:01.744038+0000","last_undegraded":"2024-09-17T05:20:01.744038+0000","last_fullsized":"2024-09-17T05:20:01.744038+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:17.685732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742565+0000","last_change":"2024-09-17T05:19:59.565271+0000","last_active":"2024-09-17T05:20:01.742565+0000","last_peered":"2024-09-17T05:20:01.742565+0000","last_clean":"2024-09-17T05:20:01.742565+0000","last_became_active":"2024-09-17T05:19:59.565009+0000","last_became_peered":"2024-09-17T05:19:59.565009+0000","last_unstale":"2024-09-17T05:20:01.742565+0000","last_undegraded":"2024-09-17T05:20:01.742565+0000","last_fullsized":"2024-09-17T05:20:01.742565+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:45.135132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743490+0000","last_change":"2024-09-17T05:20:00.545202+0000","last_active":"2024-09-17T05:20:01.743490+0000","last_peered":"2024-09-17T05:20:01.743490+0000","last_clean":"2024-09-17T05:20:01.743490+0000","last_became_active":"2024-09-17T05:20:00.544930+0000","last_became_peered":"2024-09-17T05:20:00.544930+0000","last_unstale":"2024-09-17T05:20:01.743490+0000","last_undegraded":"2024-09-17T05:20:01.743490+0000","last_fullsized":"2024-09-17T05:20:01.743490+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:36.675010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.531370+0000","last_change":"2024-09-17T05:19:59.561592+0000","last_active":"2024-09-17T05:20:01.531370+0000","last_peered":"2024-09-17T05:20:01.531370+0000","last_clean":"2024-09-17T05:20:01.531370+0000","last_became_active":"2024-09-17T05:19:59.561328+0000","last_became_peered":"2024-09-17T05:19:59.561328+0000","last_unstale":"2024-09-17T05:20:01.531370+0000","last_undegraded":"2024-09-17T05:20:01.531370+0000","last_fullsized":"2024-09-17T05:20:01.531370+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:11:27.670831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742256+0000","last_change":"2024-09-17T05:20:00.550589+0000","last_active":"2024-09-17T05:20:01.742256+0000","last_peered":"2024-09-17T05:20:01.742256+0000","last_clean":"2024-09-17T05:20:01.742256+0000","last_became_active":"2024-09-17T05:20:00.550353+0000","last_became_peered":"2024-09-17T05:20:00.550353+0000","last_unstale":"2024-09-17T05:20:01.742256+0000","last_undegraded":"2024-09-17T05:20:01.742256+0000","last_fullsized":"2024-09-17T05:20:01.742256+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:09.399367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.742240+0000","last_change":"2024-09-17T05:19:59.560425+0000","last_active":"2024-09-17T05:20:01.742240+0000","last_peered":"2024-09-17T05:20:01.742240+0000","last_clean":"2024-09-17T05:20:01.742240+0000","last_became_active":"2024-09-17T05:19:59.560173+0000","last_became_peered":"2024-09-17T05:19:59.560173+0000","last_unstale":"2024-09-17T05:20:01.742240+0000","last_undegraded":"2024-09-17T05:20:01.742240+0000","last_fullsized":"2024-09-17T05:20:01.742240+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:04.976107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.530795+0000","last_change":"2024-09-17T05:20:00.539142+0000","last_active":"2024-09-17T05:20:01.530795+0000","last_peered":"2024-09-17T05:20:01.530795+0000","last_clean":"2024-09-17T05:20:01.530795+0000","last_became_active":"2024-09-17T05:20:00.538724+0000","last_became_peered":"2024-09-17T05:20:00.538724+0000","last_unstale":"2024-09-17T05:20:01.530795+0000","last_undegraded":"2024-09-17T05:20:01.530795+0000","last_fullsized":"2024-09-17T05:20:01.530795+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:09.783292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":15,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743395+0000","last_change":"2024-09-17T05:19:59.561430+0000","last_active":"2024-09-17T05:20:01.743395+0000","last_peered":"2024-09-17T05:20:01.743395+0000","last_clean":"2024-09-17T05:20:01.743395+0000","last_became_active":"2024-09-17T05:19:59.561150+0000","last_became_peered":"2024-09-17T05:19:59.561150+0000","last_unstale":"2024-09-17T05:20:01.743395+0000","last_undegraded":"2024-09-17T05:20:01.743395+0000","last_fullsized":"2024-09-17T05:20:01.743395+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:41.538490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":13,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743169+0000","last_change":"2024-09-17T05:20:00.546102+0000","last_active":"2024-09-17T05:20:01.743169+0000","last_peered":"2024-09-17T05:20:01.743169+0000","last_clean":"2024-09-17T05:20:01.743169+0000","last_became_active":"2024-09-17T05:20:00.545725+0000","last_became_peered":"2024-09-17T05:20:00.545725+0000","last_unstale":"2024-09-17T05:20:01.743169+0000","last_undegraded":"2024-09-17T05:20:01.743169+0000","last_fullsized":"2024-09-17T05:20:01.743169+0000","mapping_epoch":43,"log_start":"0'0","ondisk_log_start":"0'0","created":43,"last_epoch_clean":44,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:59.535442+0000","last_clean_scrub_stamp":"2024-09-17T05:19:59.535442+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:42.661776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"44'2","reported_seq":17,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743035+0000","last_change":"2024-09-17T05:19:59.560442+0000","last_active":"2024-09-17T05:20:01.743035+0000","last_peered":"2024-09-17T05:20:01.743035+0000","last_clean":"2024-09-17T05:20:01.743035+0000","last_became_active":"2024-09-17T05:19:59.560155+0000","last_became_peered":"2024-09-17T05:19:59.560155+0000","last_unstale":"2024-09-17T05:20:01.743035+0000","last_undegraded":"2024-09-17T05:20:01.743035+0000","last_fullsized":"2024-09-17T05:20:01.743035+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":42,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:19:58.533148+0000","last_clean_scrub_stamp":"2024-09-17T05:19:58.533148+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:57.146571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":148,"reported_epoch":45,"state":"active+clean","last_fresh":"2024-09-17T05:20:01.743242+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:20:01.743242+0000","last_peered":"2024-09-17T05:20:01.743242+0000","last_clean":"2024-09-17T05:20:01.743242+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:20:01.743242+0000","last_undegraded":"2024-09-17T05:20:01.743242+0000","last_fullsized":"2024-09-17T05:20:01.743242+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509462,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28128,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343712,"statfs":{"total":96636764160,"available":96607961088,"internally_reserved":0,"allocated":1118208,"data_stored":798077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509462,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":516,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":528384,"data_stored":208291,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509461,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27548,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344292,"statfs":{"total":96636764160,"available":96608555008,"internally_reserved":0,"allocated":524288,"data_stored":207689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509461,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":532480,"data_stored":209231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509461,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27556,"kb_used_data":520,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344284,"statfs":{"total":96636764160,"available":96608546816,"internally_reserved":0,"allocated":532480,"data_stored":208257,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509462,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27552,"kb_used_data":524,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344288,"statfs":{"total":96636764160,"available":96608550912,"internally_reserved":0,"allocated":536576,"data_stored":209253,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509461,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27540,"kb_used_data":512,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344300,"statfs":{"total":96636764160,"available":96608563200,"internally_reserved":0,"allocated":524288,"data_stored":207689,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574869,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32288,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339552,"statfs":{"total":96636764160,"available":96603701248,"internally_reserved":0,"allocated":1118208,"data_stored":798021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":672,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:20:08.244 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:20:08.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:20:08.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 -- 172.21.15.81:0/1044297305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a68161500 msgr2=0x7f8a680cf950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 --2- 172.21.15.81:0/1044297305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a68161500 0x7f8a680cf950 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f8a58005fd0 tx=0x7f8a5802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 -- 172.21.15.81:0/1044297305 shutdown_connections 2024-09-17T05:20:08.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 --2- 172.21.15.81:0/1044297305 >> v2:172.21.15.160:3300/0 conn(0x7f8a680d2200 0x7f8a680b3880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 --2- 172.21.15.81:0/1044297305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a68161500 0x7f8a680cf950 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 -- 172.21.15.81:0/1044297305 >> 172.21.15.81:0/1044297305 conn(0x7f8a6809d190 msgr2=0x7f8a680d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:08.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 -- 172.21.15.81:0/1044297305 shutdown_connections 2024-09-17T05:20:08.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.388+0000 7f8a6d060640 1 -- 172.21.15.81:0/1044297305 wait complete. 2024-09-17T05:20:08.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.389+0000 7f8a6d060640 1 Processor -- start 2024-09-17T05:20:08.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.389+0000 7f8a6d060640 1 -- start start 2024-09-17T05:20:08.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a6d060640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a680b4c20 0x7f8a6815db10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a6d060640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a680d2200 0x7f8a6809db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a6d060640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a68161500 0x7f8a680b17b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a6d060640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a68161a60 con 0x7f8a680d2200 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a6d060640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a681618e0 con 0x7f8a680b4c20 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a6d060640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8a680b3dc0 con 0x7f8a68161500 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a680d2200 0x7f8a6809db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a5ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a680d2200 0x7f8a6809db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38768/0 (socket says 172.21.15.81:38768) 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a5ffff640 1 -- 172.21.15.81:0/71844871 learned_addr learned my addr 172.21.15.81:0/71844871 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a66d9d640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a680b4c20 0x7f8a6815db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a6759e640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a68161500 0x7f8a680b17b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a5ffff640 1 -- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a68161500 msgr2=0x7f8a680b17b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.390+0000 7f8a5ffff640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a68161500 0x7f8a680b17b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a5ffff640 1 -- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a680b4c20 msgr2=0x7f8a6815db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a5ffff640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a680b4c20 0x7f8a6815db10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a5ffff640 1 -- 172.21.15.81:0/71844871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a6809e5a0 con 0x7f8a680d2200 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a66d9d640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a680b4c20 0x7f8a6815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a6759e640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a68161500 0x7f8a680b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a5ffff640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a680d2200 0x7f8a6809db00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c480 tx=0x7f8a5000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a5f7fe640 1 -- 172.21.15.81:0/71844871 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a500052d0 con 0x7f8a680d2200 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a5f7fe640 1 -- 172.21.15.81:0/71844871 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a50005470 con 0x7f8a680d2200 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a6809e880 con 0x7f8a680d2200 2024-09-17T05:20:08.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a5f7fe640 1 -- 172.21.15.81:0/71844871 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a50012870 con 0x7f8a680d2200 2024-09-17T05:20:08.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.391+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a680a0510 con 0x7f8a680d2200 2024-09-17T05:20:08.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.392+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a680a06e0 con 0x7f8a680d2200 2024-09-17T05:20:08.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.393+0000 7f8a5f7fe640 1 -- 172.21.15.81:0/71844871 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f8a500035f0 con 0x7f8a680d2200 2024-09-17T05:20:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.393+0000 7f8a5f7fe640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a48078d40 0x7f8a4807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.393+0000 7f8a5f7fe640 1 -- 172.21.15.81:0/71844871 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f8a5009ac80 con 0x7f8a680d2200 2024-09-17T05:20:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.393+0000 7f8a66d9d640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a48078d40 0x7f8a4807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.394+0000 7f8a66d9d640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a48078d40 0x7f8a4807b200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a58033000 tx=0x7f8a58004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:08.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.397+0000 7f8a5f7fe640 1 -- 172.21.15.81:0/71844871 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8a50062e50 con 0x7f8a680d2200 2024-09-17T05:20:08.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.647+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f8a6815e1d0 con 0x7f8a680d2200 2024-09-17T05:20:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.651+0000 7f8a5f7fe640 1 -- 172.21.15.81:0/71844871 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) ==== 190+0+147 (secure 0 0 0) 0x7f8a50062750 con 0x7f8a680d2200 2024-09-17T05:20:08.652 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:20:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:20:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:20:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:20:08.652 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:20:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:20:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a48078d40 msgr2=0x7f8a4807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a48078d40 0x7f8a4807b200 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8a58033000 tx=0x7f8a58004730 comp rx=0 tx=0).stop 2024-09-17T05:20:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a680d2200 msgr2=0x7f8a6809db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a680d2200 0x7f8a6809db00 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000c480 tx=0x7f8a5000c940 comp rx=0 tx=0).stop 2024-09-17T05:20:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 shutdown_connections 2024-09-17T05:20:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a48078d40 0x7f8a4807b200 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a68161500 0x7f8a680b17b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a680d2200 0x7f8a6809db00 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 --2- 172.21.15.81:0/71844871 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a680b4c20 0x7f8a6815db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 >> 172.21.15.81:0/71844871 conn(0x7f8a6809d190 msgr2=0x7f8a6806eb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 shutdown_connections 2024-09-17T05:20:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.653+0000 7f8a6d060640 1 -- 172.21.15.81:0/71844871 wait complete. 2024-09-17T05:20:08.665 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 -- 172.21.15.81:0/2507036678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 msgr2=0x7f781015f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 --2- 172.21.15.81:0/2507036678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f781015f750 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f77f8009860 tx=0x7f77f802a540 comp rx=0 tx=0).stop 2024-09-17T05:20:08.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 -- 172.21.15.81:0/2507036678 shutdown_connections 2024-09-17T05:20:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 --2- 172.21.15.81:0/2507036678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78100cc900 0x7f781015fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 --2- 172.21.15.81:0/2507036678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f781015f750 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 -- 172.21.15.81:0/2507036678 >> 172.21.15.81:0/2507036678 conn(0x7f78100b1690 msgr2=0x7f78100b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 -- 172.21.15.81:0/2507036678 shutdown_connections 2024-09-17T05:20:08.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.765+0000 7f7815752640 1 -- 172.21.15.81:0/2507036678 wait complete. 2024-09-17T05:20:08.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.766+0000 7f7815752640 1 Processor -- start 2024-09-17T05:20:08.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.766+0000 7f7815752640 1 -- start start 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f7815752640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f7810157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f7815752640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78100cc900 0x7f78101f2470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f7815752640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7810159680 0x7f7810150a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f7815752640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78100cec40 con 0x7f78100cc490 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f7815752640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f78100ceac0 con 0x7f7810159680 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f7815752640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f78100cedc0 con 0x7f78100cc900 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f7810157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f7810157c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38778/0 (socket says 172.21.15.81:38778) 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 -- 172.21.15.81:0/2698272960 learned_addr learned my addr 172.21.15.81:0/2698272960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780f7fe640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7810159680 0x7f7810150a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780e7fc640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78100cc900 0x7f78101f2470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 -- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78100cc900 msgr2=0x7f78101f2470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78100cc900 0x7f78101f2470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 -- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7810159680 msgr2=0x7f7810150a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7810159680 0x7f7810150a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 -- 172.21.15.81:0/2698272960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f78101f29b0 con 0x7f78100cc490 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780f7fe640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7810159680 0x7f7810150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f780effd640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f7810157c50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f780000c7a0 tx=0x7f780000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.767+0000 7f78077fe640 1 -- 172.21.15.81:0/2698272960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7800017070 con 0x7f78100cc490 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.768+0000 7f78077fe640 1 -- 172.21.15.81:0/2698272960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7800005070 con 0x7f78100cc490 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.768+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78101f2c30 con 0x7f78100cc490 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.768+0000 7f78077fe640 1 -- 172.21.15.81:0/2698272960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78000054a0 con 0x7f78100cc490 2024-09-17T05:20:08.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.768+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78101f31f0 con 0x7f78100cc490 2024-09-17T05:20:08.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.769+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78100cf270 con 0x7f78100cc490 2024-09-17T05:20:08.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.769+0000 7f78077fe640 1 -- 172.21.15.81:0/2698272960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f780001a070 con 0x7f78100cc490 2024-09-17T05:20:08.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.770+0000 7f78077fe640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77f0078d40 0x7f77f007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:08.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.770+0000 7f78077fe640 1 -- 172.21.15.81:0/2698272960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f780009a700 con 0x7f78100cc490 2024-09-17T05:20:08.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.770+0000 7f780e7fc640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77f0078d40 0x7f77f007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:08.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.770+0000 7f780e7fc640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77f0078d40 0x7f77f007b200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77f8034000 tx=0x7f77f8004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:08.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.774+0000 7f78077fe640 1 -- 172.21.15.81:0/2698272960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f78101f29b0 con 0x7f78100cc490 2024-09-17T05:20:08.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.985+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f78100d0770 con 0x7f78100cc490 2024-09-17T05:20:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.985+0000 7f78077fe640 1 -- 172.21.15.81:0/2698272960 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 22 v22) ==== 94+0+5223 (secure 0 0 0) 0x7f78000628d0 con 0x7f78100cc490 2024-09-17T05:20:08.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:08.986 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":22,"btime":"2024-09-17T05:20:02:554678+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 22 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77f0078d40 msgr2=0x7f77f007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77f0078d40 0x7f77f007b200 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f77f8034000 tx=0x7f77f8004730 comp rx=0 tx=0).stop 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 msgr2=0x7f7810157c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f7810157c50 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f780000c7a0 tx=0x7f780000cc60 comp rx=0 tx=0).stop 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 shutdown_connections 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77f0078d40 0x7f77f007b200 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7810159680 0x7f7810150a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78100cc900 0x7f78101f2470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 --2- 172.21.15.81:0/2698272960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f78100cc490 0x7f7810157c50 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:08.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 >> 172.21.15.81:0/2698272960 conn(0x7f78100b1690 msgr2=0x7f7810158970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 shutdown_connections 2024-09-17T05:20:08.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:08.987+0000 7f7815752640 1 -- 172.21.15.81:0/2698272960 wait complete. 2024-09-17T05:20:09.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 22, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:19:59.900244+0000', 'modified': '2024-09-17T05:20:01.898397+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5277}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5277': {'gid': 5277, 'name': 'a', 'rank': 0, 'incarnation': 20, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.81:6835/1152829207', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 1152829207}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1152829207}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5277, 'qdb_cluster': [5277]} 2024-09-17T05:20:09.402 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:20:09.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:20:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.509+0000 7fa1b14cd640 1 -- 172.21.15.81:0/3317737390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 msgr2=0x7fa1980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.509+0000 7fa1b14cd640 1 --2- 172.21.15.81:0/3317737390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 0x7fa1980051c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ed0 tx=0x7fa198005830 comp rx=0 tx=0).stop 2024-09-17T05:20:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.509+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/3317737390 reap_dead start 2024-09-17T05:20:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.509+0000 7fa1b14cd640 1 -- 172.21.15.81:0/3317737390 shutdown_connections 2024-09-17T05:20:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.509+0000 7fa1b14cd640 1 -- 172.21.15.81:0/3317737390 >> 172.21.15.81:0/3317737390 conn(0x7fa1ac0d3ea0 msgr2=0x7fa1ac0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.509+0000 7fa1b14cd640 1 -- 172.21.15.81:0/3317737390 shutdown_connections 2024-09-17T05:20:09.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.509+0000 7fa1b14cd640 1 -- 172.21.15.81:0/3317737390 wait complete. 2024-09-17T05:20:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.510+0000 7fa1b14cd640 1 Processor -- start 2024-09-17T05:20:09.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.510+0000 7fa1b14cd640 1 -- start start 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1b14cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 0x7fa1ac15e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1b14cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1ac0b7e40 0x7fa1ac161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1b14cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1ac0cc5e0 0x7fa1ac0cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1b14cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac162690 con 0x7fa198004d40 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1b14cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac0b3800 con 0x7fa1ac0cc5e0 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1b14cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ac162060 con 0x7fa1ac0b7e40 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 0x7fa1ac15e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 0x7fa1ac15e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38802/0 (socket says 172.21.15.81:38802) 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 -- 172.21.15.81:0/39187222 learned_addr learned my addr 172.21.15.81:0/39187222 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1ac0cc5e0 0x7fa1ac0cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1ac0b7e40 0x7fa1ac161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 -- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1ac0b7e40 msgr2=0x7fa1ac161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1ac0b7e40 0x7fa1ac161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 -- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1ac0cc5e0 msgr2=0x7fa1ac0cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1ac0cc5e0 0x7fa1ac0cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.511+0000 7fa1aaffd640 1 -- 172.21.15.81:0/39187222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1ac1f4b50 con 0x7fa198004d40 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.512+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 0x7fa1ac15e570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa19c011a50 tx=0x7fa19c011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.512+0000 7fa1a37fe640 1 -- 172.21.15.81:0/39187222 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c01f070 con 0x7fa198004d40 2024-09-17T05:20:09.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.512+0000 7fa1a37fe640 1 -- 172.21.15.81:0/39187222 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa19c00fd60 con 0x7fa198004d40 2024-09-17T05:20:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.512+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1ac1f4e30 con 0x7fa198004d40 2024-09-17T05:20:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.512+0000 7fa1a37fe640 1 -- 172.21.15.81:0/39187222 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19c012690 con 0x7fa198004d40 2024-09-17T05:20:09.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.512+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1ac0cac70 con 0x7fa198004d40 2024-09-17T05:20:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.513+0000 7fa1a37fe640 1 -- 172.21.15.81:0/39187222 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fa19c022070 con 0x7fa198004d40 2024-09-17T05:20:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.514+0000 7fa1a37fe640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa18c078d70 0x7fa18c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.514+0000 7fa1a37fe640 1 -- 172.21.15.81:0/39187222 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa19c09b980 con 0x7fa198004d40 2024-09-17T05:20:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.514+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa18c078d70 0x7fa18c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.514+0000 7fa1b429e740 1 Processor -- start 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa18c078d70 0x7fa18c07b230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa194000c00 tx=0x7fa1940012c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1b429e740 1 -- start start 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd021b0 0x563f3bcd9b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd221f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bcd75f0 0x563f3bcd7a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1b429e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563f3bc4e820 con 0x563f3bcd75f0 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563f3bc3dc50 con 0x563f3bd21df0 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.515+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x563f3bc41a60 con 0x563f3bd021b0 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bcd75f0 0x563f3bcd7a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bcd75f0 0x563f3bcd7a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38804/0 (socket says 172.21.15.81:38804) 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2225193183 learned_addr learned my addr 172.21.15.81:0/2225193183 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd021b0 0x563f3bcd9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd221f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd021b0 msgr2=0x563f3bcd9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd021b0 0x563f3bcd9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 msgr2=0x563f3bd221f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd221f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2225193183 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3b99f850 con 0x563f3bcd75f0 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bcd75f0 0x563f3bcd7a40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ed0 tx=0x7fa1a4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111c25b1d96d4ea8 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1a0ff9640 1 -- 172.21.15.81:0/2225193183 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4045070 con 0x563f3bcd75f0 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1a0ff9640 1 -- 172.21.15.81:0/2225193183 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1a402bd20 con 0x563f3bcd75f0 2024-09-17T05:20:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.516+0000 7fa1a0ff9640 1 -- 172.21.15.81:0/2225193183 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4038040 con 0x563f3bcd75f0 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 -- 172.21.15.81:0/2225193183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bcd75f0 msgr2=0x563f3bcd7a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bcd75f0 0x563f3bcd7a40 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ed0 tx=0x7fa1a4004ab0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 -- 172.21.15.81:0/2225193183 shutdown_connections 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bcd75f0 0x563f3bcd7a40 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd221f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2225193183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd021b0 0x563f3bcd9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 -- 172.21.15.81:0/2225193183 >> 172.21.15.81:0/2225193183 conn(0x563f3bcd86a0 msgr2=0x563f3bcdc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 -- 172.21.15.81:0/2225193183 shutdown_connections 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 -- 172.21.15.81:0/2225193183 wait complete. 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.517+0000 7fa1b429e740 1 -- start start 2024-09-17T05:20:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 1 Processor -- start 2024-09-17T05:20:09.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd04e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd21df0 0x563f3bd317d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd31d10 0x563f3bcf9270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563f3b9ae620 con 0x563f3bd31d10 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563f3bbe35f0 con 0x563f3bd021b0 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x563f3bcd6850 con 0x563f3bd21df0 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1b429e740 10 client.0 _ll_register_callbacks cb 0x563f3bbe70a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd31d10 0x563f3bcf9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1ab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd31d10 0x563f3bcf9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38814/0 (socket says 172.21.15.81:38814) 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2050550317 learned_addr learned my addr 172.21.15.81:0/2050550317 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.518+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd04e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd21df0 0x563f3bd317d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd21df0 msgr2=0x563f3bd317d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd21df0 0x563f3bd317d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 msgr2=0x563f3bd04e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd04e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1ab7fe640 1 -- 172.21.15.81:0/2050550317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f3ba166b0 con 0x563f3bd31d10 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd31d10 0x563f3bcf9270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ed0 tx=0x7fa1a4003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5e63859836571db server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa189ffb640 1 -- 172.21.15.81:0/2050550317 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1a4045070 con 0x563f3bd31d10 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa189ffb640 1 -- 172.21.15.81:0/2050550317 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa1a404aab0 con 0x563f3bd31d10 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1a402bd20 con 0x563f3bd31d10 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa189ffb640 1 -- 172.21.15.81:0/2050550317 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa1a4038050 con 0x563f3bd31d10 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 10 client.5433 fetch_fsmap learned FSMap version 22 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x563f3bd04330 con 0x563f3bd31d10 2024-09-17T05:20:09.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa189ffb640 1 -- 172.21.15.81:0/2050550317 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1a402bd20 con 0x563f3bd31d10 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa189ffb640 1 -- 172.21.15.81:0/2050550317 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7fa1a404acb0 con 0x563f3bd31d10 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 10 client.5433 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 10 client.5433 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 20 client.5433 populate_metadata read hostname 'smithi081' 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bcf97b0 0x563f3bd30610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 4 client.5433 mds_command: new command op to 5277 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.519+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 --> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563f3bc50770 con 0x563f3bcf97b0 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.520+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bcf97b0 0x563f3bd30610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.520+0000 7fa189ffb640 10 client.5433 ms_handle_connect on v2:172.21.15.81:6833/1152829207 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.520+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bcf97b0 0x563f3bd30610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=57c746ec58e7ab8 server_cookie=fd0694ea821ee0f6 in_seq=0 out_seq=0 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.520+0000 7fa189ffb640 1 -- 172.21.15.81:0/2050550317 <== mds.0 v2:172.21.15.81:6833/1152829207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x563f3bc50770 con 0x563f3bcf97b0 2024-09-17T05:20:09.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.520+0000 7fa189ffb640 10 client.5433 handle_command_reply: tid=0 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.520+0000 7fa1b429e740 1 client.5433 shutdown 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd31d10 msgr2=0x563f3bcf9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd31d10 0x563f3bcf9270 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fa1a4009ed0 tx=0x7fa1a4003ce0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 shutdown_connections 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bcf97b0 0x563f3bd30610 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd31d10 0x563f3bcf9270 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bd21df0 0x563f3bd317d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa189ffb640 0 client.5433 ms_handle_reset on v2:172.21.15.81:6833/1152829207 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2050550317 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd04e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 >> 172.21.15.81:0/2050550317 conn(0x563f3bcd75f0 msgr2=0x563f3bd02590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 shutdown_connections 2024-09-17T05:20:09.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 1 -- 172.21.15.81:0/2050550317 wait complete. 2024-09-17T05:20:09.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.521+0000 7fa1b429e740 20 client.5433 trim_cache size 0 max 16384 2024-09-17T05:20:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 Processor -- start 2024-09-17T05:20:09.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 -- start start 2024-09-17T05:20:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd221d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd21df0 0x563f3bd22710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac200930 con 0x563f3bd21df0 2024-09-17T05:20:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1ac0b7780 con 0x563f3bd021b0 2024-09-17T05:20:09.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa1ac2002e0 con 0x563f3bcdbb00 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd21df0 0x563f3bd22710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd21df0 0x563f3bd22710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38830/0 (socket says 172.21.15.81:38830) 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.539+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2071110860 learned_addr learned my addr 172.21.15.81:0/2071110860 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd221d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 msgr2=0x563f3bd035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 msgr2=0x563f3bd221d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd221d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2071110860 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563f3bd34110 con 0x563f3bd21df0 2024-09-17T05:20:09.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd21df0 0x563f3bd22710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fc0 tx=0x7fa19400a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10efb86590a790dd server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa18bfff640 1 -- 172.21.15.81:0/2071110860 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa19402e070 con 0x563f3bd21df0 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa18bfff640 1 -- 172.21.15.81:0/2071110860 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa194012500 con 0x563f3bd21df0 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.540+0000 7fa18bfff640 1 -- 172.21.15.81:0/2071110860 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1940128b0 con 0x563f3bd21df0 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 -- 172.21.15.81:0/2071110860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd21df0 msgr2=0x563f3bd22710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd21df0 0x563f3bd22710 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7fa194006fc0 tx=0x7fa19400a000 comp rx=0 tx=0).stop 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 -- 172.21.15.81:0/2071110860 shutdown_connections 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd21df0 0x563f3bd22710 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2071110860 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd021b0 0x563f3bd221d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 -- 172.21.15.81:0/2071110860 >> 172.21.15.81:0/2071110860 conn(0x563f3bcd75f0 msgr2=0x563f3bd315d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 -- 172.21.15.81:0/2071110860 shutdown_connections 2024-09-17T05:20:09.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 -- 172.21.15.81:0/2071110860 wait complete. 2024-09-17T05:20:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 -- start start 2024-09-17T05:20:09.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.541+0000 7fa1b429e740 1 Processor -- start 2024-09-17T05:20:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd02590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd021b0 0x563f3bda0c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1b429e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd035e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1b429e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x563f3b9ae620 con 0x563f3bd021b0 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x563f3bbe35f0 con 0x563f3bd21df0 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1b429e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x563f3bd33ec0 con 0x563f3bcdbb00 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1b429e740 10 client.0 _ll_register_callbacks cb 0x7fa1a4043070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd021b0 0x563f3bda0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd021b0 0x563f3bda0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38840/0 (socket says 172.21.15.81:38840) 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2873016424 learned_addr learned my addr 172.21.15.81:0/2873016424 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1ab7fe640 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd035e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd02590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 msgr2=0x563f3bd02590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd02590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 msgr2=0x563f3bd035e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd035e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 -- 172.21.15.81:0/2873016424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563f3bcd5df0 con 0x563f3bd021b0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa1aa7fc640 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd021b0 0x563f3bda0c00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa194000fb0 tx=0x7fa194006c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c684430910b3525 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.542+0000 7fa189ffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa189ffb640 1 -- 172.21.15.81:0/2873016424 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa194038020 con 0x563f3bd021b0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa189ffb640 1 -- 172.21.15.81:0/2873016424 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fa194012c00 con 0x563f3bd021b0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa194012500 con 0x563f3bd021b0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa189ffb640 1 -- 172.21.15.81:0/2873016424 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=22) ==== 24+0+0 (secure 0 0 0) 0x7fa194042050 con 0x563f3bd021b0 2024-09-17T05:20:09.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 10 client.5439 fetch_fsmap learned FSMap version 22 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=22,monmap=2+}) -- 0x563f3bd3aa80 con 0x563f3bd021b0 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa189ffb640 1 -- 172.21.15.81:0/2873016424 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa194012500 con 0x563f3bd021b0 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa189ffb640 1 -- 172.21.15.81:0/2873016424 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 22) ==== 3502+0+0 (secure 0 0 0) 0x7fa194045020 con 0x563f3bd021b0 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 10 client.5439 fetch_fsmap finished waiting for FSMap version 22 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 10 client.5439 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 20 client.5439 populate_metadata read hostname 'smithi081' 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bd01190 0x563f3bd01570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 4 client.5439 mds_command: new command op to 5277 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 --> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] -- command(tid 0: {"prefix": "status"}) -- 0x563f3bd1b000 con 0x563f3bd01190 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bd01190 0x563f3bd01570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa1aaffd640 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bd01190 0x563f3bd01570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=242f0165034dbe9c server_cookie=5d65843972030b85 in_seq=0 out_seq=0 2024-09-17T05:20:09.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.543+0000 7fa189ffb640 10 client.5439 ms_handle_connect on v2:172.21.15.81:6833/1152829207 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa189ffb640 1 -- 172.21.15.81:0/2873016424 <== mds.0 v2:172.21.15.81:6833/1152829207 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x563f3bd1b000 con 0x563f3bd01190 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa189ffb640 10 client.5439 handle_command_reply: tid=0 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 client.5439 shutdown 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd021b0 msgr2=0x563f3bda0c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd021b0 0x563f3bda0c00 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fa194000fb0 tx=0x7fa194006c70 comp rx=0 tx=0).stop 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 shutdown_connections 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:6833/1152829207,v1:172.21.15.81:6835/1152829207] conn(0x563f3bd01190 0x563f3bd01570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x563f3bd21df0 0x563f3bd035e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa189ffb640 0 client.5439 ms_handle_reset on v2:172.21.15.81:6833/1152829207 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x563f3bd021b0 0x563f3bda0c00 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 --2- 172.21.15.81:0/2873016424 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x563f3bcdbb00 0x563f3bd02590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 >> 172.21.15.81:0/2873016424 conn(0x563f3bcd75f0 msgr2=0x563f3bd04730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 shutdown_connections 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 1 -- 172.21.15.81:0/2873016424 wait complete. 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b429e740 20 client.5439 trim_cache size 0 max 16384 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5277, 2024-09-17T05:20:09.553 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 8.9942607789999993, 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 22, 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 45, 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 45, 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 12.754994998000001 2024-09-17T05:20:09.554 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:20:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa18c078d70 msgr2=0x7fa18c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa18c078d70 0x7fa18c07b230 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa194000c00 tx=0x7fa1940012c0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 msgr2=0x7fa1ac15e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 0x7fa1ac15e570 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fa19c011a50 tx=0x7fa19c011f10 comp rx=0 tx=0).stop 2024-09-17T05:20:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 shutdown_connections 2024-09-17T05:20:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa18c078d70 0x7fa18c07b230 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1ac0cc5e0 0x7fa1ac0cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1ac0b7e40 0x7fa1ac161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 --2- 172.21.15.81:0/39187222 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa198004d40 0x7fa1ac15e570 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 >> 172.21.15.81:0/39187222 conn(0x7fa1ac0d3ea0 msgr2=0x7fa1ac0b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 shutdown_connections 2024-09-17T05:20:09.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.544+0000 7fa1b14cd640 1 -- 172.21.15.81:0/39187222 wait complete. 2024-09-17T05:20:09.557 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:20:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 -- 172.21.15.81:0/3278553386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1415aa10 msgr2=0x7f4e140701a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 --2- 172.21.15.81:0/3278553386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1415aa10 0x7f4e140701a0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f4e1406fa30 tx=0x7f4e1002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 -- 172.21.15.81:0/3278553386 shutdown_connections 2024-09-17T05:20:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 --2- 172.21.15.81:0/3278553386 >> v2:172.21.15.160:3300/0 conn(0x7f4e140cc810 0x7f4e1415e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 --2- 172.21.15.81:0/3278553386 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e1415aa10 0x7f4e140701a0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 -- 172.21.15.81:0/3278553386 >> 172.21.15.81:0/3278553386 conn(0x7f4e140b2680 msgr2=0x7f4e140b2a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 -- 172.21.15.81:0/3278553386 shutdown_connections 2024-09-17T05:20:09.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.658+0000 7f4e1b552640 1 -- 172.21.15.81:0/3278553386 wait complete. 2024-09-17T05:20:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.659+0000 7f4e1b552640 1 Processor -- start 2024-09-17T05:20:09.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.659+0000 7f4e1b552640 1 -- start start 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e1b552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e140cc810 0x7f4e1414b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e1b552640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e1415aa10 0x7f4e141483c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e1b552640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e140c6870 0x7f4e140c6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e1b552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1415ecf0 con 0x7f4e140cc810 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e1b552640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4e1415eb70 con 0x7f4e1415aa10 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e1b552640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4e1415ee70 con 0x7f4e140c6870 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e140cc810 0x7f4e1414b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e140cc810 0x7f4e1414b710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38852/0 (socket says 172.21.15.81:38852) 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 -- 172.21.15.81:0/489770821 learned_addr learned my addr 172.21.15.81:0/489770821 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:09.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e18aed640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e1415aa10 0x7f4e141483c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e19aef640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e140c6870 0x7f4e140c6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 -- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e140c6870 msgr2=0x7f4e140c6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e140c6870 0x7f4e140c6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 -- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e1415aa10 msgr2=0x7f4e141483c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e1415aa10 0x7f4e141483c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e192ee640 1 -- 172.21.15.81:0/489770821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e1414bc50 con 0x7f4e140cc810 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e18aed640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e1415aa10 0x7f4e141483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.660+0000 7f4e19aef640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e140c6870 0x7f4e140c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.661+0000 7f4e192ee640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e140cc810 0x7f4e1414b710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009780 tx=0x7f4e10032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.661+0000 7f4e09ffb640 1 -- 172.21.15.81:0/489770821 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e10040070 con 0x7f4e140cc810 2024-09-17T05:20:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.661+0000 7f4e09ffb640 1 -- 172.21.15.81:0/489770821 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e10005310 con 0x7f4e140cc810 2024-09-17T05:20:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.661+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e141f5fd0 con 0x7f4e140cc810 2024-09-17T05:20:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.661+0000 7f4e09ffb640 1 -- 172.21.15.81:0/489770821 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e100047a0 con 0x7f4e140cc810 2024-09-17T05:20:09.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.661+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e141f6590 con 0x7f4e140cc810 2024-09-17T05:20:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.662+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e1415f390 con 0x7f4e140cc810 2024-09-17T05:20:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.663+0000 7f4e09ffb640 1 -- 172.21.15.81:0/489770821 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f4e10039040 con 0x7f4e140cc810 2024-09-17T05:20:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.663+0000 7f4e09ffb640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4df8078d40 0x7f4df807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.663+0000 7f4e09ffb640 1 -- 172.21.15.81:0/489770821 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f4e100bc1f0 con 0x7f4e140cc810 2024-09-17T05:20:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.663+0000 7f4e18aed640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4df8078d40 0x7f4df807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:09.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.664+0000 7f4e18aed640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4df8078d40 0x7f4df807b200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e14071d10 tx=0x7f4e04009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:09.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.667+0000 7f4e09ffb640 1 -- 172.21.15.81:0/489770821 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4e100843c0 con 0x7f4e140cc810 2024-09-17T05:20:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.883+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4e140b6b10 con 0x7f4e140cc810 2024-09-17T05:20:09.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.884+0000 7f4e09ffb640 1 -- 172.21.15.81:0/489770821 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f4e10083cc0 con 0x7f4e140cc810 2024-09-17T05:20:09.885 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:20:09.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4df8078d40 msgr2=0x7f4df807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4df8078d40 0x7f4df807b200 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f4e14071d10 tx=0x7f4e04009040 comp rx=0 tx=0).stop 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e140cc810 msgr2=0x7f4e1414b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e140cc810 0x7f4e1414b710 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4e10009780 tx=0x7f4e10032c10 comp rx=0 tx=0).stop 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 shutdown_connections 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4df8078d40 0x7f4df807b200 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e140c6870 0x7f4e140c6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e1415aa10 0x7f4e141483c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 --2- 172.21.15.81:0/489770821 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e140cc810 0x7f4e1414b710 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 >> 172.21.15.81:0/489770821 conn(0x7f4e140b2680 msgr2=0x7f4e140b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:09.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 shutdown_connections 2024-09-17T05:20:09.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:09.886+0000 7f4e1b552640 1 -- 172.21.15.81:0/489770821 wait complete. 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:20:09.898 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:20:09.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:09.899 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:20:09.914 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:20:09.914 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:20:09.915 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42708sec preferred_lft 42708sec 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:09.916 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:20:09.917 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:09.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:09.918 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:20:09.978 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:20:09.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:09.979 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:20:10.036 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:20:10.036 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:20:10.037 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:20:10.037 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:20:10.037 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:20:10.037 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:20:10.037 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:20:10.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:20:10.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:20:10.037 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:20:10.038 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:20:10.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:10 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:20:10.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:20:10.163 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:10.163 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:20:10.178 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:20:10.179 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:20:10.179 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:20:10.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:10.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:20:10.244 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:20:10.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:20:10.244 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:20:10.299 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:20:10.300 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:20:10.300 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:20:10.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:20:10.423 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:20:10.480 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:20:10.480 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:20:10.480 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:20:10.480 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:20:10.480 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:20:10.481 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:20:10.482 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:20:10.483 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:20:10.483 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:20:10.483 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:20:10.483 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:20:10.483 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:20:10.483 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:20:10.483 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:10.483 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:20:10.537 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:20:10.537 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:20:10.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:20:10.603 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:20:10.659 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:20:10.660 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:20:10.661 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:20:10.662 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:20:10.662 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:20:10.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:10.662 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:20:10.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:20:10.661+0000 7f1d6ae79480 -1 init, newargv = 0x564a3039f6f0 newargc=15 2024-09-17T05:20:10.663 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[51617]: starting ceph client 2024-09-17T05:20:10.666 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[51617]: starting fuse 2024-09-17T05:20:10.678 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:20:10.678 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:20:10.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:20:10.678 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:20:10.679 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:20:10.680 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:20:10.795 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.51617.asok 2024-09-17T05:20:10.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:10 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:20:10.805 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.51617.asok 2024-09-17T05:20:10.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:10.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.51617.asok status 2024-09-17T05:20:10.938 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:20:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:20:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:20:10.938 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "51617", 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:20:10.939 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5454, 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5454 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1596943761 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:20:10.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1596943761 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.5454 192.168.0.1:0/1596943761", 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/1596943761", 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 22, 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 45, 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:20:10.941 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:20:10.942 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:20:10.947 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:10.947 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:20:10.947 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:20:10.964 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:20:10.964 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:20:10.964 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:10.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:20:11.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:20:11.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.169+0000 7f1fc102b640 1 -- 172.21.15.81:0/2679913230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 msgr2=0x7f1fbc0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:11.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.169+0000 7f1fc102b640 1 --2- 172.21.15.81:0/2679913230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc0cef30 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009860 tx=0x7f1fac02a540 comp rx=0 tx=0).stop 2024-09-17T05:20:11.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.170+0000 7f1fc102b640 1 -- 172.21.15.81:0/2679913230 shutdown_connections 2024-09-17T05:20:11.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.170+0000 7f1fc102b640 1 --2- 172.21.15.81:0/2679913230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc0cef30 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:11.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.170+0000 7f1fc102b640 1 -- 172.21.15.81:0/2679913230 >> 172.21.15.81:0/2679913230 conn(0x7f1fbc0b1690 msgr2=0x7f1fbc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:11.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.170+0000 7f1fc102b640 1 -- 172.21.15.81:0/2679913230 shutdown_connections 2024-09-17T05:20:11.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.170+0000 7f1fc102b640 1 -- 172.21.15.81:0/2679913230 wait complete. 2024-09-17T05:20:11.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.171+0000 7f1fc102b640 1 Processor -- start 2024-09-17T05:20:11.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.171+0000 7f1fc102b640 1 -- start start 2024-09-17T05:20:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fc102b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc072cb0 0x7f1fbc13f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fc102b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0b3140 0x7f1fbc14fa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fc102b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc14ff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fc102b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc070280 con 0x7f1fbc151370 2024-09-17T05:20:11.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fc102b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc070100 con 0x7f1fbc0b3140 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fc102b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc070400 con 0x7f1fbc072cb0 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc14ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc14ff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38860/0 (socket says 172.21.15.81:38860) 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 -- 172.21.15.81:0/3420258419 learned_addr learned my addr 172.21.15.81:0/3420258419 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbad9d640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc072cb0 0x7f1fbc13f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fb259c640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0b3140 0x7f1fbc14fa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 -- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc072cb0 msgr2=0x7f1fbc13f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc072cb0 0x7f1fbc13f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 -- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0b3140 msgr2=0x7f1fbc14fa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0b3140 0x7f1fbc14fa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 -- 172.21.15.81:0/3420258419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc156630 con 0x7f1fbc151370 2024-09-17T05:20:11.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fbb59e640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc14ff40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c7b0 tx=0x7f1fb400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:11.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fb3fff640 1 -- 172.21.15.81:0/3420258419 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb4017070 con 0x7f1fbc151370 2024-09-17T05:20:11.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.172+0000 7f1fb3fff640 1 -- 172.21.15.81:0/3420258419 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fb4005070 con 0x7f1fbc151370 2024-09-17T05:20:11.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.173+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc156910 con 0x7f1fbc151370 2024-09-17T05:20:11.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.173+0000 7f1fb3fff640 1 -- 172.21.15.81:0/3420258419 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fb40054c0 con 0x7f1fbc151370 2024-09-17T05:20:11.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.173+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc156ed0 con 0x7f1fbc151370 2024-09-17T05:20:11.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.174+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc0cef30 con 0x7f1fbc151370 2024-09-17T05:20:11.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.174+0000 7f1fb3fff640 1 -- 172.21.15.81:0/3420258419 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f1fb401a070 con 0x7f1fbc151370 2024-09-17T05:20:11.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.175+0000 7f1fb3fff640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1f9c078d40 0x7f1f9c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:11.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.175+0000 7f1fb3fff640 1 -- 172.21.15.81:0/3420258419 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f1fb409a750 con 0x7f1fbc151370 2024-09-17T05:20:11.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.175+0000 7f1fbad9d640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1f9c078d40 0x7f1f9c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:11.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.176+0000 7f1fbad9d640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1f9c078d40 0x7f1f9c07b200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1fac034000 tx=0x7f1fac004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:11.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.179+0000 7f1fb3fff640 1 -- 172.21.15.81:0/3420258419 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1fb4062890 con 0x7f1fbc151370 2024-09-17T05:20:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.391+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f1fbc0727b0 con 0x7f1fbc151370 2024-09-17T05:20:11.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.391+0000 7f1fb3fff640 1 -- 172.21.15.81:0/3420258419 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v22) ==== 53+0+73 (secure 0 0 0) 0x7f1fb4062190 con 0x7f1fbc151370 2024-09-17T05:20:11.392 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1f9c078d40 msgr2=0x7f1f9c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1f9c078d40 0x7f1f9c07b200 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f1fac034000 tx=0x7f1fac004730 comp rx=0 tx=0).stop 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 msgr2=0x7f1fbc14ff40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc14ff40 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f1fb400c7b0 tx=0x7f1fb400cc70 comp rx=0 tx=0).stop 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 shutdown_connections 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1f9c078d40 0x7f1f9c07b200 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fbc151370 0x7f1fbc14ff40 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0b3140 0x7f1fbc14fa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 --2- 172.21.15.81:0/3420258419 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc072cb0 0x7f1fbc13f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 >> 172.21.15.81:0/3420258419 conn(0x7f1fbc0b1690 msgr2=0x7f1fbc0b0030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:11.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 shutdown_connections 2024-09-17T05:20:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:11.393+0000 7f1fc102b640 1 -- 172.21.15.81:0/3420258419 wait complete. 2024-09-17T05:20:11.405 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:20:11.405 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:20:11.406 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:20:11.406 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:20:11.406 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:20:11.406 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:20:11.406 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:20:11.406 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:20:11.406 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:20:11.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:11.406 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:20:11.426 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:20:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:20:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:20:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:20:11.426 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:11.426 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42704sec preferred_lft 42704sec 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:20:11.427 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:20:11.428 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:20:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:20:11.429 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:20:11.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:11.429 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:20:11.495 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:20:11.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:11.497 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:20:11.557 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:20:11.557 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:20:11.558 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:20:11.558 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:20:11.558 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:20:11.558 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:20:11.558 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:20:11.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:20:11.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:20:11.558 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:20:11.558 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:20:11.650 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:20:11 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:20:11.684 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:20:11 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:20:11.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:11.690 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:20:11.705 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:20:11.705 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:20:11.705 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:20:11.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:11.706 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:20:11.770 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:20:11.770 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:20:11.771 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:20:11.826 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:20:11.826 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:20:11.826 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:20:11.885 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:20:11.951 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:20:12.008 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:20:12.008 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:20:12.008 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:20:12.008 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:20:12.008 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:20:12.008 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:20:12.008 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:20:12.009 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:20:12.010 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:20:12.011 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:20:12.011 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:20:12.011 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:20:12.011 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:12.011 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:20:12.066 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:20:12.067 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:20:12.109 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:20:12.133 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:20:12.190 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:20:12.190 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:20:12.190 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:20:12.190 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:20:12.190 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:20:12.190 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:20:12.191 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:20:12.192 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:20:12.193 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:20:12.193 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:20:12.193 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:20:12.193 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:20:12.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:12.196 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:20:12.197 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:20:12.190+0000 7fa0a1a90480 -1 init, newargv = 0x564bb1e6d690 newargc=15 2024-09-17T05:20:12.198 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[44657]: starting ceph client 2024-09-17T05:20:12.198 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[44657]: starting fuse 2024-09-17T05:20:12.212 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:20:12.212 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:20:12.212 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:20:12.212 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:20:12.212 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:20:12.212 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:20:12.213 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:20:12.214 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:20:12.330 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.44657.asok 2024-09-17T05:20:12.333 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:20:12 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:20:12.340 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.44657.asok 2024-09-17T05:20:12.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:12.340 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.44657.asok status 2024-09-17T05:20:12.473 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:20:12.473 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:20:12.473 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "44657", 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:20:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:20:12.476 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:20:12.476 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 5033, 2024-09-17T05:20:12.476 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:20:12.476 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:20:12.476 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:20:12.476 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 5033 2024-09-17T05:20:12.476 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 3696518240 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 3696518240 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:20:12.477 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.5033 192.168.0.1:0/3696518240", 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/3696518240", 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 22, 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 45, 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:20:12.478 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:20:12.481 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:12.482 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:20:12.482 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:20:12.499 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:20:12.499 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:20:12.499 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:12.500 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:20:12.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:20:12.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.684+0000 7f6659e2a640 1 -- 172.21.15.81:0/365019311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 msgr2=0x7f663c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:12.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.684+0000 7f6659e2a640 1 --2- 172.21.15.81:0/365019311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 0x7f663c0051c0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f664c00c710 tx=0x7f663c005830 comp rx=0 tx=0).stop 2024-09-17T05:20:12.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.684+0000 7f6653fff640 1 -- 172.21.15.81:0/365019311 reap_dead start 2024-09-17T05:20:12.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.685+0000 7f6659e2a640 1 -- 172.21.15.81:0/365019311 shutdown_connections 2024-09-17T05:20:12.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.685+0000 7f6659e2a640 1 -- 172.21.15.81:0/365019311 >> 172.21.15.81:0/365019311 conn(0x7f665409aa30 msgr2=0x7f665409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:12.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.685+0000 7f6659e2a640 1 -- 172.21.15.81:0/365019311 shutdown_connections 2024-09-17T05:20:12.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.685+0000 7f6659e2a640 1 -- 172.21.15.81:0/365019311 wait complete. 2024-09-17T05:20:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.686+0000 7f6659e2a640 1 Processor -- start 2024-09-17T05:20:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.686+0000 7f6659e2a640 1 -- start start 2024-09-17T05:20:12.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 0x7f665406f550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66540c4710 0x7f66540b6c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66541527b0 0x7f66540b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66541602c0 con 0x7f663c004d40 2024-09-17T05:20:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6654160140 con 0x7f66541527b0 2024-09-17T05:20:12.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6654160440 con 0x7f66540c4710 2024-09-17T05:20:12.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 0x7f665406f550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:12.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 0x7f665406f550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38866/0 (socket says 172.21.15.81:38866) 2024-09-17T05:20:12.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 -- 172.21.15.81:0/1158590653 learned_addr learned my addr 172.21.15.81:0/1158590653 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:12.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6652ffd640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66540c4710 0x7f66540b6c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:12.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6653fff640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66541527b0 0x7f66540b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:12.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 -- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66540c4710 msgr2=0x7f66540b6c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66540c4710 0x7f66540b6c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 -- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66541527b0 msgr2=0x7f66540b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66541527b0 0x7f66540b7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 -- 172.21.15.81:0/1158590653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66540c4fb0 con 0x7f663c004d40 2024-09-17T05:20:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6653fff640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66541527b0 0x7f66540b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:12.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f66537fe640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 0x7f665406f550 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6644010c70 tx=0x7f664400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f663bfff640 1 -- 172.21.15.81:0/1158590653 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644003b70 con 0x7f663c004d40 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f663bfff640 1 -- 172.21.15.81:0/1158590653 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6644003d10 con 0x7f663c004d40 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f663bfff640 1 -- 172.21.15.81:0/1158590653 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6644004280 con 0x7f663c004d40 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665406e790 con 0x7f663c004d40 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.687+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f665406ed50 con 0x7f663c004d40 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.688+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66540b26d0 con 0x7f663c004d40 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.689+0000 7f663bfff640 1 -- 172.21.15.81:0/1158590653 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f664401a030 con 0x7f663c004d40 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.690+0000 7f663bfff640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6640078d40 0x7f664007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:12.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.690+0000 7f663bfff640 1 -- 172.21.15.81:0/1158590653 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f664409bdb0 con 0x7f663c004d40 2024-09-17T05:20:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.690+0000 7f6652ffd640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6640078d40 0x7f664007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.690+0000 7f6652ffd640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6640078d40 0x7f664007b200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6654051110 tx=0x7f66480067a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:12.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.694+0000 7f663bfff640 1 -- 172.21.15.81:0/1158590653 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f66440638a0 con 0x7f663c004d40 2024-09-17T05:20:12.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:12.907+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f665406c6e0 con 0x7f663c004d40 2024-09-17T05:20:13.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.667+0000 7f663bfff640 1 -- 172.21.15.81:0/1158590653 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v23) ==== 136+0+0 (secure 0 0 0) 0x7f66440682d0 con 0x7f663c004d40 2024-09-17T05:20:13.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6640078d40 msgr2=0x7f664007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6640078d40 0x7f664007b200 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f6654051110 tx=0x7f66480067a0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 msgr2=0x7f665406f550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 0x7f665406f550 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f6644010c70 tx=0x7f664400e6c0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 shutdown_connections 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6640078d40 0x7f664007b200 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66541527b0 0x7f66540b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66540c4710 0x7f66540b6c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 --2- 172.21.15.81:0/1158590653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f663c004d40 0x7f665406f550 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 >> 172.21.15.81:0/1158590653 conn(0x7f665409aa30 msgr2=0x7f66540719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:13.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 shutdown_connections 2024-09-17T05:20:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.669+0000 7f6659e2a640 1 -- 172.21.15.81:0/1158590653 wait complete. 2024-09-17T05:20:13.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:20:13.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/4047890620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80d2410 msgr2=0x7ffbb80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/4047890620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80d2410 0x7ffbb80b3090 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7ffba8009830 tx=0x7ffba802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/4047890620 shutdown_connections 2024-09-17T05:20:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/4047890620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb80cfce0 0x7ffbb80d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/4047890620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80d2410 0x7ffbb80b3090 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/4047890620 >> 172.21.15.81:0/4047890620 conn(0x7ffbb809aa30 msgr2=0x7ffbb809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/4047890620 shutdown_connections 2024-09-17T05:20:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.784+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/4047890620 wait complete. 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.785+0000 7ffbbf1ec640 1 Processor -- start 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.785+0000 7ffbbf1ec640 1 -- start start 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbf1ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80cfce0 0x7ffbb81f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbf1ec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb80d2410 0x7ffbb80c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbf1ec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815f6d0 0x7ffbb80b39a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbf1ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb80b13c0 con 0x7ffbb80cfce0 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbf1ec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffbb80b1240 con 0x7ffbb80d2410 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbf1ec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ffbb80b1540 con 0x7ffbb815f6d0 2024-09-17T05:20:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbcf88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80cfce0 0x7ffbb81f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbcf88640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80cfce0 0x7ffbb81f3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37312/0 (socket says 172.21.15.81:37312) 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbcf88640 1 -- 172.21.15.81:0/1865168673 learned_addr learned my addr 172.21.15.81:0/1865168673 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbd789640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815f6d0 0x7ffbb80b39a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbb7fff640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb80d2410 0x7ffbb80c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbcf88640 1 -- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815f6d0 msgr2=0x7ffbb80b39a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbcf88640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815f6d0 0x7ffbb80b39a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbcf88640 1 -- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb80d2410 msgr2=0x7ffbb80c93f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.786+0000 7ffbbcf88640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb80d2410 0x7ffbb80c93f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbbcf88640 1 -- 172.21.15.81:0/1865168673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffbb80c9c20 con 0x7ffbb80cfce0 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbbd789640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815f6d0 0x7ffbb80b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbbcf88640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80cfce0 0x7ffbb81f3140 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffba8000c00 tx=0x7ffba8032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbb57fa640 1 -- 172.21.15.81:0/1865168673 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8040070 con 0x7ffbb80cfce0 2024-09-17T05:20:13.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbb57fa640 1 -- 172.21.15.81:0/1865168673 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffba8003af0 con 0x7ffbb80cfce0 2024-09-17T05:20:13.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbb57fa640 1 -- 172.21.15.81:0/1865168673 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffba8045460 con 0x7ffbb80cfce0 2024-09-17T05:20:13.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffbb80c9f60 con 0x7ffbb80cfce0 2024-09-17T05:20:13.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.787+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffbb80b4d80 con 0x7ffbb80cfce0 2024-09-17T05:20:13.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.788+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffbb80c9990 con 0x7ffbb80cfce0 2024-09-17T05:20:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.788+0000 7ffbb57fa640 1 -- 172.21.15.81:0/1865168673 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7ffba8039040 con 0x7ffbb80cfce0 2024-09-17T05:20:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.789+0000 7ffbb57fa640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffba4078d40 0x7ffba407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.789+0000 7ffbb57fa640 1 -- 172.21.15.81:0/1865168673 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7ffba80bc870 con 0x7ffbb80cfce0 2024-09-17T05:20:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.789+0000 7ffbb7fff640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffba4078d40 0x7ffba407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.790+0000 7ffbb7fff640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffba4078d40 0x7ffba407b200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbb806c660 tx=0x7ffbac009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:13.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.793+0000 7ffbb57fa640 1 -- 172.21.15.81:0/1865168673 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ffbb80c9f60 con 0x7ffbb80cfce0 2024-09-17T05:20:13.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.990+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7ffbb80b4fc0 con 0x7ffba4078d40 2024-09-17T05:20:13.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.992+0000 7ffbb57fa640 1 -- 172.21.15.81:0/1865168673 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7ffbb80b4fc0 con 0x7ffba4078d40 2024-09-17T05:20:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:20:13.993 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:20:13.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:20:13.993 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:20:13.993 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:20:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffba4078d40 msgr2=0x7ffba407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffba4078d40 0x7ffba407b200 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ffbb806c660 tx=0x7ffbac009040 comp rx=0 tx=0).stop 2024-09-17T05:20:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80cfce0 msgr2=0x7ffbb81f3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:13.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80cfce0 0x7ffbb81f3140 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7ffba8000c00 tx=0x7ffba8032d50 comp rx=0 tx=0).stop 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 shutdown_connections 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffba4078d40 0x7ffba407b200 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffbb815f6d0 0x7ffbb80b39a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffbb80d2410 0x7ffbb80c93f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 --2- 172.21.15.81:0/1865168673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffbb80cfce0 0x7ffbb81f3140 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 >> 172.21.15.81:0/1865168673 conn(0x7ffbb809aa30 msgr2=0x7ffbb8072000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 shutdown_connections 2024-09-17T05:20:13.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:13.994+0000 7ffbbf1ec640 1 -- 172.21.15.81:0/1865168673 wait complete. 2024-09-17T05:20:14.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:20:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 -- 172.21.15.81:0/219513937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b815b380 msgr2=0x7f67b8072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 --2- 172.21.15.81:0/219513937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b815b380 0x7f67b8072b50 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f67a8005fd0 tx=0x7f67a802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 -- 172.21.15.81:0/219513937 shutdown_connections 2024-09-17T05:20:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 --2- 172.21.15.81:0/219513937 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67b8073090 0x7f67b80cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 --2- 172.21.15.81:0/219513937 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b815b380 0x7f67b8072b50 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 -- 172.21.15.81:0/219513937 >> 172.21.15.81:0/219513937 conn(0x7f67b80b1700 msgr2=0x7f67b80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 -- 172.21.15.81:0/219513937 shutdown_connections 2024-09-17T05:20:14.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.109+0000 7f67bda8c640 1 -- 172.21.15.81:0/219513937 wait complete. 2024-09-17T05:20:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.110+0000 7f67bda8c640 1 Processor -- start 2024-09-17T05:20:14.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.110+0000 7f67bda8c640 1 -- start start 2024-09-17T05:20:14.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67bda8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8073090 0x7f67b814d130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67bda8c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67b80cdf50 0x7f67b80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67bda8c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67b815b380 0x7f67b80b3410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67bda8c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80cbd50 con 0x7f67b8073090 2024-09-17T05:20:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67bda8c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f67b80cbbd0 con 0x7f67b815b380 2024-09-17T05:20:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67bda8c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f67b80cbed0 con 0x7f67b80cdf50 2024-09-17T05:20:14.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8073090 0x7f67b814d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8073090 0x7f67b814d130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37334/0 (socket says 172.21.15.81:37334) 2024-09-17T05:20:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 -- 172.21.15.81:0/2824281628 learned_addr learned my addr 172.21.15.81:0/2824281628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b6ffd640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67b80cdf50 0x7f67b80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b7fff640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67b815b380 0x7f67b80b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 -- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67b80cdf50 msgr2=0x7f67b80c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67b80cdf50 0x7f67b80c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 -- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67b815b380 msgr2=0x7f67b80b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67b815b380 0x7f67b80b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 -- 172.21.15.81:0/2824281628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b80b3e40 con 0x7f67b8073090 2024-09-17T05:20:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.111+0000 7f67b77fe640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8073090 0x7f67b814d130 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000f80 tx=0x7f67a8003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:14.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.112+0000 7f679ffff640 1 -- 172.21.15.81:0/2824281628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8031990 con 0x7f67b8073090 2024-09-17T05:20:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.112+0000 7f679ffff640 1 -- 172.21.15.81:0/2824281628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67a8031c20 con 0x7f67b8073090 2024-09-17T05:20:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.112+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b80c4b60 con 0x7f67b8073090 2024-09-17T05:20:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.112+0000 7f679ffff640 1 -- 172.21.15.81:0/2824281628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67a8033330 con 0x7f67b8073090 2024-09-17T05:20:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.112+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b80c5120 con 0x7f67b8073090 2024-09-17T05:20:14.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.113+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b80cda10 con 0x7f67b8073090 2024-09-17T05:20:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.113+0000 7f679ffff640 1 -- 172.21.15.81:0/2824281628 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f67a80334d0 con 0x7f67b8073090 2024-09-17T05:20:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.114+0000 7f679ffff640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67a4078d40 0x7f67a407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.114+0000 7f679ffff640 1 -- 172.21.15.81:0/2824281628 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f67a80bc450 con 0x7f67b8073090 2024-09-17T05:20:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.114+0000 7f67b6ffd640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67a4078d40 0x7f67a407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.115+0000 7f67b6ffd640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67a4078d40 0x7f67a407b200 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67b80b5b90 tx=0x7f67ac005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:14.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.118+0000 7f679ffff640 1 -- 172.21.15.81:0/2824281628 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f67a803f030 con 0x7f67b8073090 2024-09-17T05:20:14.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.293+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f67b8069700 con 0x7f67b8073090 2024-09-17T05:20:14.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.294+0000 7f679ffff640 1 -- 172.21.15.81:0/2824281628 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v30)=0 v30) ==== 122+0+0 (secure 0 0 0) 0x7f67a8084620 con 0x7f67b8073090 2024-09-17T05:20:14.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67a4078d40 msgr2=0x7f67a407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67a4078d40 0x7f67a407b200 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f67b80b5b90 tx=0x7f67ac005f90 comp rx=0 tx=0).stop 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8073090 msgr2=0x7f67b814d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8073090 0x7f67b814d130 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f67a8000f80 tx=0x7f67a8003970 comp rx=0 tx=0).stop 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 shutdown_connections 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f67a4078d40 0x7f67a407b200 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67b815b380 0x7f67b80b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67b80cdf50 0x7f67b80c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 --2- 172.21.15.81:0/2824281628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67b8073090 0x7f67b814d130 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 >> 172.21.15.81:0/2824281628 conn(0x7f67b80b1700 msgr2=0x7f67b814dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 shutdown_connections 2024-09-17T05:20:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.296+0000 7f67bda8c640 1 -- 172.21.15.81:0/2824281628 wait complete. 2024-09-17T05:20:14.308 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:20:14.309 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:20:14.325 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:20:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 -- 172.21.15.81:0/97192616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 msgr2=0x7fc0640cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/97192616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 0x7fc0640cf9b0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fc058005fd0 tx=0x7fc05802a540 comp rx=0 tx=0).stop 2024-09-17T05:20:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 -- 172.21.15.81:0/97192616 shutdown_connections 2024-09-17T05:20:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/97192616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0640d49c0 0x7fc0640b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/97192616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 0x7fc0640cf9b0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 -- 172.21.15.81:0/97192616 >> 172.21.15.81:0/97192616 conn(0x7fc0640d3ea0 msgr2=0x7fc0640d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 -- 172.21.15.81:0/97192616 shutdown_connections 2024-09-17T05:20:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.467+0000 7fc06ac9b640 1 -- 172.21.15.81:0/97192616 wait complete. 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.468+0000 7fc06ac9b640 1 Processor -- start 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.468+0000 7fc06ac9b640 1 -- start start 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc06ac9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 0x7fc064150300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc06ac9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0640d49c0 0x7fc0640cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc06ac9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc06415df90 0x7fc0640ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc06ac9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0640b3d40 con 0x7fc06415df90 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc06ac9b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc064162710 con 0x7fc0640d0d40 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc06ac9b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc0640b3ec0 con 0x7fc0640d49c0 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc06415df90 0x7fc0640ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc06415df90 0x7fc0640ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37348/0 (socket says 172.21.15.81:37348) 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 -- 172.21.15.81:0/798015497 learned_addr learned my addr 172.21.15.81:0/798015497 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc068a37640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 0x7fc064150300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 -- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0640d49c0 msgr2=0x7fc0640cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0640d49c0 0x7fc0640cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 -- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 msgr2=0x7fc064150300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 0x7fc064150300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 -- 172.21.15.81:0/798015497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0640cc7d0 con 0x7fc06415df90 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc068a37640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 0x7fc064150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.469+0000 7fc069238640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc06415df90 0x7fc0640ca3a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00efd0 tx=0x7fc05c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.470+0000 7fc0617fa640 1 -- 172.21.15.81:0/798015497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c003b70 con 0x7fc06415df90 2024-09-17T05:20:14.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.470+0000 7fc0617fa640 1 -- 172.21.15.81:0/798015497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc05c003e00 con 0x7fc06415df90 2024-09-17T05:20:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.470+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0640ccab0 con 0x7fc06415df90 2024-09-17T05:20:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.470+0000 7fc0617fa640 1 -- 172.21.15.81:0/798015497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc05c004280 con 0x7fc06415df90 2024-09-17T05:20:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.470+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc064150840 con 0x7fc06415df90 2024-09-17T05:20:14.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.470+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc064160000 con 0x7fc06415df90 2024-09-17T05:20:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.471+0000 7fc0617fa640 1 -- 172.21.15.81:0/798015497 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fc05c004420 con 0x7fc06415df90 2024-09-17T05:20:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.472+0000 7fc0617fa640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc050078d70 0x7fc05007b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.472+0000 7fc0617fa640 1 -- 172.21.15.81:0/798015497 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fc05c09c080 con 0x7fc06415df90 2024-09-17T05:20:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.472+0000 7fc068a37640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc050078d70 0x7fc05007b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.472+0000 7fc068a37640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc050078d70 0x7fc05007b230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc054000f60 tx=0x7fc054009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:14.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.476+0000 7fc0617fa640 1 -- 172.21.15.81:0/798015497 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc064160000 con 0x7fc06415df90 2024-09-17T05:20:14.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.663+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc06408d590 con 0x7fc06415df90 2024-09-17T05:20:14.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.664+0000 7fc0617fa640 1 -- 172.21.15.81:0/798015497 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7fc05c0641c0 con 0x7fc06415df90 2024-09-17T05:20:14.665 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:20:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc050078d70 msgr2=0x7fc05007b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc050078d70 0x7fc05007b230 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc054000f60 tx=0x7fc054009040 comp rx=0 tx=0).stop 2024-09-17T05:20:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc06415df90 msgr2=0x7fc0640ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc06415df90 0x7fc0640ca3a0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fc05c00efd0 tx=0x7fc05c00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 shutdown_connections 2024-09-17T05:20:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc050078d70 0x7fc05007b230 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc06415df90 0x7fc0640ca3a0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0640d49c0 0x7fc0640cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 --2- 172.21.15.81:0/798015497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0640d0d40 0x7fc064150300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 >> 172.21.15.81:0/798015497 conn(0x7fc0640d3ea0 msgr2=0x7fc06406ea00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 shutdown_connections 2024-09-17T05:20:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.666+0000 7fc06ac9b640 1 -- 172.21.15.81:0/798015497 wait complete. 2024-09-17T05:20:14.678 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:20:14.678 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:20:14.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:20:14.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:14.737 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 -- 172.21.15.81:0/3851823347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c0cf640 msgr2=0x7f383c0725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 --2- 172.21.15.81:0/3851823347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c0cf640 0x7f383c0725a0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3824009830 tx=0x7f382402a510 comp rx=0 tx=0).stop 2024-09-17T05:20:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 -- 172.21.15.81:0/3851823347 shutdown_connections 2024-09-17T05:20:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 --2- 172.21.15.81:0/3851823347 >> v2:172.21.15.160:3300/0 conn(0x7f383c0b3140 0x7f383c072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 --2- 172.21.15.81:0/3851823347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c0cf640 0x7f383c0725a0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 -- 172.21.15.81:0/3851823347 >> 172.21.15.81:0/3851823347 conn(0x7f383c0b1690 msgr2=0x7f383c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 -- 172.21.15.81:0/3851823347 shutdown_connections 2024-09-17T05:20:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.838+0000 7f3840fdf640 1 -- 172.21.15.81:0/3851823347 wait complete. 2024-09-17T05:20:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.839+0000 7f3840fdf640 1 Processor -- start 2024-09-17T05:20:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.839+0000 7f3840fdf640 1 -- start start 2024-09-17T05:20:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3840fdf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f383c0b3140 0x7f383c0ccf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3840fdf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f383c0cf640 0x7f383c0ce6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3840fdf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c151370 0x7f383c0b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3840fdf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f383c06ec10 con 0x7f383c0cf640 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3840fdf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f383c06ea90 con 0x7f383c0b3140 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3840fdf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f383c06f9f0 con 0x7f383c151370 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f383c0cf640 0x7f383c0ce6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f383c0cf640 0x7f383c0ce6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37350/0 (socket says 172.21.15.81:37350) 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 -- 172.21.15.81:0/2369627292 learned_addr learned my addr 172.21.15.81:0/2369627292 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f383ad9d640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c151370 0x7f383c0b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f383a59c640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f383c0b3140 0x7f383c0ccf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 -- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c151370 msgr2=0x7f383c0b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c151370 0x7f383c0b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 -- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f383c0b3140 msgr2=0x7f383c0ccf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f383c0b3140 0x7f383c0ccf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f3833fff640 1 -- 172.21.15.81:0/2369627292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f383c1f5b60 con 0x7f383c0cf640 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f383a59c640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f383c0b3140 0x7f383c0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.840+0000 7f383ad9d640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c151370 0x7f383c0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.841+0000 7f3833fff640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f383c0cf640 0x7f383c0ce6b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3824009950 tx=0x7f3824032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.841+0000 7f3832ffd640 1 -- 172.21.15.81:0/2369627292 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3824040070 con 0x7f383c0cf640 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.841+0000 7f3832ffd640 1 -- 172.21.15.81:0/2369627292 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3824005310 con 0x7f383c0cf640 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.841+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f383c1f5e00 con 0x7f383c0cf640 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.841+0000 7f3832ffd640 1 -- 172.21.15.81:0/2369627292 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38240047a0 con 0x7f383c0cf640 2024-09-17T05:20:14.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.841+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f383c1f63c0 con 0x7f383c0cf640 2024-09-17T05:20:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.842+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f383c15a1c0 con 0x7f383c0cf640 2024-09-17T05:20:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.842+0000 7f3832ffd640 1 -- 172.21.15.81:0/2369627292 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f3824039040 con 0x7f383c0cf640 2024-09-17T05:20:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.843+0000 7f3832ffd640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f381c078d40 0x7f381c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.843+0000 7f3832ffd640 1 -- 172.21.15.81:0/2369627292 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f38240bc1e0 con 0x7f383c0cf640 2024-09-17T05:20:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.843+0000 7f383a59c640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f381c078d40 0x7f381c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:14.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.844+0000 7f383a59c640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f381c078d40 0x7f381c07b200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f383c0ce1c0 tx=0x7f382c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:14.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:14.847+0000 7f3832ffd640 1 -- 172.21.15.81:0/2369627292 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3824084320 con 0x7f383c0cf640 2024-09-17T05:20:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.033+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f383c15b360 con 0x7f383c0cf640 2024-09-17T05:20:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.033+0000 7f3832ffd640 1 -- 172.21.15.81:0/2369627292 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7f3824083c20 con 0x7f383c0cf640 2024-09-17T05:20:15.034 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f381c078d40 msgr2=0x7f381c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f381c078d40 0x7f381c07b200 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f383c0ce1c0 tx=0x7f382c009040 comp rx=0 tx=0).stop 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f383c0cf640 msgr2=0x7f383c0ce6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f383c0cf640 0x7f383c0ce6b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f3824009950 tx=0x7f3824032c10 comp rx=0 tx=0).stop 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 shutdown_connections 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f381c078d40 0x7f381c07b200 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f383c151370 0x7f383c0b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f383c0cf640 0x7f383c0ce6b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 --2- 172.21.15.81:0/2369627292 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f383c0b3140 0x7f383c0ccf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:15.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.035+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 >> 172.21.15.81:0/2369627292 conn(0x7f383c0b1690 msgr2=0x7f383c15a7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.036+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 shutdown_connections 2024-09-17T05:20:15.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:15.036+0000 7f3840fdf640 1 -- 172.21.15.81:0/2369627292 wait complete. 2024-09-17T05:20:15.047 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:20:15.047 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:15.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:20:15.070 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[51617]: fuse finished with error 0 and tester_r 0 2024-09-17T05:20:15.072 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:20:21.174 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:20:21.174 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:21.174 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:20:21.194 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:20:21.194 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:20:21.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:20:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.344+0000 7f1280a0c640 1 -- 172.21.15.81:0/1610837122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c159680 msgr2=0x7f127c15d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.344+0000 7f1280a0c640 1 --2- 172.21.15.81:0/1610837122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c159680 0x7f127c15d270 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f1274005fd0 tx=0x7f127402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.345+0000 7f1280a0c640 1 -- 172.21.15.81:0/1610837122 shutdown_connections 2024-09-17T05:20:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.345+0000 7f1280a0c640 1 --2- 172.21.15.81:0/1610837122 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f127c0cc490 0x7f127c15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.345+0000 7f1280a0c640 1 --2- 172.21.15.81:0/1610837122 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c159680 0x7f127c15d270 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.345+0000 7f1280a0c640 1 -- 172.21.15.81:0/1610837122 >> 172.21.15.81:0/1610837122 conn(0x7f127c0b1690 msgr2=0x7f127c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.345+0000 7f1280a0c640 1 -- 172.21.15.81:0/1610837122 shutdown_connections 2024-09-17T05:20:21.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.345+0000 7f1280a0c640 1 -- 172.21.15.81:0/1610837122 wait complete. 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.346+0000 7f1280a0c640 1 Processor -- start 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.346+0000 7f1280a0c640 1 -- start start 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1280a0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c0cc490 0x7f127c0cb340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1280a0c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c0cc8d0 0x7f127c073660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1280a0c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f127c159680 0x7f127c073ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1280a0c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0cf350 con 0x7f127c0cc490 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1280a0c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f127c0cf1d0 con 0x7f127c0cc8d0 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1280a0c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f127c0cf4d0 con 0x7f127c159680 2024-09-17T05:20:21.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c0cc490 0x7f127c0cb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c0cc490 0x7f127c0cb340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37358/0 (socket says 172.21.15.81:37358) 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 -- 172.21.15.81:0/2803999641 learned_addr learned my addr 172.21.15.81:0/2803999641 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127ad9d640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f127c159680 0x7f127c073ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 -- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f127c159680 msgr2=0x7f127c073ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1279d9b640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c0cc8d0 0x7f127c073660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f127c159680 0x7f127c073ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 -- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c0cc8d0 msgr2=0x7f127c073660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c0cc8d0 0x7f127c073660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 -- 172.21.15.81:0/2803999641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f127c1493a0 con 0x7f127c0cc490 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127ad9d640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f127c159680 0x7f127c073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:21.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1279d9b640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c0cc8d0 0x7f127c073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f127a59c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c0cc490 0x7f127c0cb340 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1274009cd0 tx=0x7f12740316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.347+0000 7f1272ffd640 1 -- 172.21.15.81:0/2803999641 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274031990 con 0x7f127c0cc490 2024-09-17T05:20:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.348+0000 7f1272ffd640 1 -- 172.21.15.81:0/2803999641 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1274031c20 con 0x7f127c0cc490 2024-09-17T05:20:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.348+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f127c149660 con 0x7f127c0cc490 2024-09-17T05:20:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.348+0000 7f1272ffd640 1 -- 172.21.15.81:0/2803999641 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1274033330 con 0x7f127c0cc490 2024-09-17T05:20:21.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.348+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f127c149c20 con 0x7f127c0cc490 2024-09-17T05:20:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.349+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f127c15fe00 con 0x7f127c0cc490 2024-09-17T05:20:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.349+0000 7f1272ffd640 1 -- 172.21.15.81:0/2803999641 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f12740334d0 con 0x7f127c0cc490 2024-09-17T05:20:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.350+0000 7f1272ffd640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f125c078d70 0x7f125c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.350+0000 7f1272ffd640 1 -- 172.21.15.81:0/2803999641 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f12740bc4e0 con 0x7f127c0cc490 2024-09-17T05:20:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.350+0000 7f1279d9b640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f125c078d70 0x7f125c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.350+0000 7f1279d9b640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f125c078d70 0x7f125c07b230 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f127c1f5720 tx=0x7f1264005d30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:21.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.354+0000 7f1272ffd640 1 -- 172.21.15.81:0/2803999641 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f127403f030 con 0x7f127c0cc490 2024-09-17T05:20:21.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.545+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f127c158860 con 0x7f127c0cc490 2024-09-17T05:20:21.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.545+0000 7f1272ffd640 1 -- 172.21.15.81:0/2803999641 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7f1274084620 con 0x7f127c0cc490 2024-09-17T05:20:21.546 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f125c078d70 msgr2=0x7f125c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f125c078d70 0x7f125c07b230 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f127c1f5720 tx=0x7f1264005d30 comp rx=0 tx=0).stop 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c0cc490 msgr2=0x7f127c0cb340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c0cc490 0x7f127c0cb340 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f1274009cd0 tx=0x7f12740316f0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 shutdown_connections 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f125c078d70 0x7f125c07b230 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f127c159680 0x7f127c073ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f127c0cc8d0 0x7f127c073660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 --2- 172.21.15.81:0/2803999641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f127c0cc490 0x7f127c0cb340 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 >> 172.21.15.81:0/2803999641 conn(0x7f127c0b1690 msgr2=0x7f127c159ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 shutdown_connections 2024-09-17T05:20:21.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.548+0000 7f1280a0c640 1 -- 172.21.15.81:0/2803999641 wait complete. 2024-09-17T05:20:21.560 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:20:21.560 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:20:21.580 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:20:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.685+0000 7f3f3fe40640 1 -- 172.21.15.81:0/697109884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 msgr2=0x7f3f380725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.685+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/697109884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 0x7f3f380725a0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3f28009860 tx=0x7f3f2802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.686+0000 7f3f3fe40640 1 -- 172.21.15.81:0/697109884 shutdown_connections 2024-09-17T05:20:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.686+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/697109884 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 0x7f3f380725a0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.686+0000 7f3f3fe40640 1 -- 172.21.15.81:0/697109884 >> 172.21.15.81:0/697109884 conn(0x7f3f380b1690 msgr2=0x7f3f380b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.686+0000 7f3f3fe40640 1 -- 172.21.15.81:0/697109884 shutdown_connections 2024-09-17T05:20:21.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.686+0000 7f3f3fe40640 1 -- 172.21.15.81:0/697109884 wait complete. 2024-09-17T05:20:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.688+0000 7f3f3fe40640 1 Processor -- start 2024-09-17T05:20:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.688+0000 7f3f3fe40640 1 -- start start 2024-09-17T05:20:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3fe40640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f380b3140 0x7f3f38154010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3fe40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 0x7f3f38143ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3fe40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f38151370 0x7f3f38159a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3fe40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38070280 con 0x7f3f38151370 2024-09-17T05:20:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3fe40640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3f38070100 con 0x7f3f380b3140 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3fe40640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3f38070400 con 0x7f3f380cf640 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f38151370 0x7f3f38159a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f38151370 0x7f3f38159a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37372/0 (socket says 172.21.15.81:37372) 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 -- 172.21.15.81:0/4233829102 learned_addr learned my addr 172.21.15.81:0/4233829102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3d3db640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 0x7f3f38143ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3dbdc640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f380b3140 0x7f3f38154010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 -- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 msgr2=0x7f3f38143ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 0x7f3f38143ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 -- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f380b3140 msgr2=0x7f3f38154010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f380b3140 0x7f3f38154010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.689+0000 7f3f3e3dd640 1 -- 172.21.15.81:0/4233829102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f38144220 con 0x7f3f38151370 2024-09-17T05:20:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.690+0000 7f3f3e3dd640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f38151370 0x7f3f38159a20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c7d0 tx=0x7f3f3000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.690+0000 7f3f2e7fc640 1 -- 172.21.15.81:0/4233829102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f30003b70 con 0x7f3f38151370 2024-09-17T05:20:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.690+0000 7f3f2e7fc640 1 -- 172.21.15.81:0/4233829102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f30003d10 con 0x7f3f38151370 2024-09-17T05:20:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.690+0000 7f3f2e7fc640 1 -- 172.21.15.81:0/4233829102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f3000aab0 con 0x7f3f38151370 2024-09-17T05:20:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.690+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f381f7ef0 con 0x7f3f38151370 2024-09-17T05:20:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.690+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f381f84b0 con 0x7f3f38151370 2024-09-17T05:20:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.691+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f380725a0 con 0x7f3f38151370 2024-09-17T05:20:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.691+0000 7f3f2e7fc640 1 -- 172.21.15.81:0/4233829102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7f3f3000ac50 con 0x7f3f38151370 2024-09-17T05:20:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.692+0000 7f3f2e7fc640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f1c078d40 0x7f3f1c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.692+0000 7f3f2e7fc640 1 -- 172.21.15.81:0/4233829102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7f3f3009ad90 con 0x7f3f38151370 2024-09-17T05:20:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.692+0000 7f3f3dbdc640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f1c078d40 0x7f3f1c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.693+0000 7f3f3dbdc640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f1c078d40 0x7f3f1c07b200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f340046b0 tx=0x7f3f34007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:21.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.696+0000 7f3f2e7fc640 1 -- 172.21.15.81:0/4233829102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3f30062910 con 0x7f3f38151370 2024-09-17T05:20:21.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.893+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3f380b4a50 con 0x7f3f38151370 2024-09-17T05:20:21.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.894+0000 7f3f2e7fc640 1 -- 172.21.15.81:0/4233829102 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v45) ==== 80+0+0 (secure 0 0 0) 0x7f3f30067340 con 0x7f3f38151370 2024-09-17T05:20:21.895 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:20:21.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f1c078d40 msgr2=0x7f3f1c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f1c078d40 0x7f3f1c07b200 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3f340046b0 tx=0x7f3f34007e90 comp rx=0 tx=0).stop 2024-09-17T05:20:21.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f38151370 msgr2=0x7f3f38159a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:21.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f38151370 0x7f3f38159a20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f3f3000c7d0 tx=0x7f3f3000cc90 comp rx=0 tx=0).stop 2024-09-17T05:20:21.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 shutdown_connections 2024-09-17T05:20:21.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3f1c078d40 0x7f3f1c07b200 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f38151370 0x7f3f38159a20 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f380cf640 0x7f3f38143ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 --2- 172.21.15.81:0/4233829102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f380b3140 0x7f3f38154010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 >> 172.21.15.81:0/4233829102 conn(0x7f3f380b1690 msgr2=0x7f3f38147330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 shutdown_connections 2024-09-17T05:20:21.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:21.896+0000 7f3f3fe40640 1 -- 172.21.15.81:0/4233829102 wait complete. 2024-09-17T05:20:21.908 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:20:21.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:21.908 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:20:21.937 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[44657]: fuse finished with error 0 and tester_r 0 2024-09-17T05:20:21.939 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:20:21.993 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:20:21.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:20:21.993 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:20:22.011 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 -- 172.21.15.81:0/3088219147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d49c0 msgr2=0x7fc31c0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 --2- 172.21.15.81:0/3088219147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d49c0 0x7fc31c0b3800 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc314005fd0 tx=0x7fc31402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 -- 172.21.15.81:0/3088219147 shutdown_connections 2024-09-17T05:20:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 --2- 172.21.15.81:0/3088219147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d49c0 0x7fc31c0b3800 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 --2- 172.21.15.81:0/3088219147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc31c0d0d40 0x7fc31c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 -- 172.21.15.81:0/3088219147 >> 172.21.15.81:0/3088219147 conn(0x7fc31c0d3ea0 msgr2=0x7fc31c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 -- 172.21.15.81:0/3088219147 shutdown_connections 2024-09-17T05:20:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.113+0000 7fc322d89640 1 -- 172.21.15.81:0/3088219147 wait complete. 2024-09-17T05:20:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.114+0000 7fc322d89640 1 Processor -- start 2024-09-17T05:20:22.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.114+0000 7fc322d89640 1 -- start start 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc322d89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d0d40 0x7fc31c0cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc322d89640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc31c0d49c0 0x7fc31c1f3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc322d89640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc31c15df90 0x7fc31c0b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc322d89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c162690 con 0x7fc31c0d0d40 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc322d89640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc31c0b3d40 con 0x7fc31c0d49c0 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc322d89640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc31c0ce260 con 0x7fc31c15df90 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d0d40 0x7fc31c0cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d0d40 0x7fc31c0cdc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37380/0 (socket says 172.21.15.81:37380) 2024-09-17T05:20:22.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 -- 172.21.15.81:0/2146047359 learned_addr learned my addr 172.21.15.81:0/2146047359 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc31bfff640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc31c0d49c0 0x7fc31c1f3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 -- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc31c15df90 msgr2=0x7fc31c0b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc321326640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc31c15df90 0x7fc31c0b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc31c15df90 0x7fc31c0b17e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 -- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc31c0d49c0 msgr2=0x7fc31c1f3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc31c0d49c0 0x7fc31c1f3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 -- 172.21.15.81:0/2146047359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc31c0b6d70 con 0x7fc31c0d0d40 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc31bfff640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc31c0d49c0 0x7fc31c1f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.115+0000 7fc320b25640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d0d40 0x7fc31c0cdc10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c3c0 tx=0x7fc31000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.116+0000 7fc3197fa640 1 -- 172.21.15.81:0/2146047359 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310017070 con 0x7fc31c0d0d40 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.116+0000 7fc3197fa640 1 -- 172.21.15.81:0/2146047359 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc3100035f0 con 0x7fc31c0d0d40 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.116+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc31c0b7050 con 0x7fc31c0d0d40 2024-09-17T05:20:22.118 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.116+0000 7fc3197fa640 1 -- 172.21.15.81:0/2146047359 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc310003a80 con 0x7fc31c0d0d40 2024-09-17T05:20:22.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.116+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc31c1f4530 con 0x7fc31c0d0d40 2024-09-17T05:20:22.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.117+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc31c0cf9b0 con 0x7fc31c0d0d40 2024-09-17T05:20:22.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.117+0000 7fc3197fa640 1 -- 172.21.15.81:0/2146047359 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fc31001a070 con 0x7fc31c0d0d40 2024-09-17T05:20:22.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.118+0000 7fc3197fa640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc300078d40 0x7fc30007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.118+0000 7fc3197fa640 1 -- 172.21.15.81:0/2146047359 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fc31009a3d0 con 0x7fc31c0d0d40 2024-09-17T05:20:22.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.118+0000 7fc31bfff640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc300078d40 0x7fc30007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.119+0000 7fc31bfff640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc300078d40 0x7fc30007b200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc31c15bfd0 tx=0x7fc308005d90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:22.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.122+0000 7fc3197fa640 1 -- 172.21.15.81:0/2146047359 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc31c0ce970 con 0x7fc31c0d0d40 2024-09-17T05:20:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.344+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc31c08d590 con 0x7fc31c0d0d40 2024-09-17T05:20:22.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.344+0000 7fc3197fa640 1 -- 172.21.15.81:0/2146047359 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fc310062520 con 0x7fc31c0d0d40 2024-09-17T05:20:22.346 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:22.346 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:22.346 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.346+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc300078d40 msgr2=0x7fc30007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.346+0000 7fc322d89640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc300078d40 0x7fc30007b200 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fc31c15bfd0 tx=0x7fc308005d90 comp rx=0 tx=0).stop 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.346+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d0d40 msgr2=0x7fc31c0cdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.346+0000 7fc322d89640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d0d40 0x7fc31c0cdc10 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc31000c3c0 tx=0x7fc31000c880 comp rx=0 tx=0).stop 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 shutdown_connections 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc300078d40 0x7fc30007b200 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc31c15df90 0x7fc31c0b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc31c0d49c0 0x7fc31c1f3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 --2- 172.21.15.81:0/2146047359 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc31c0d0d40 0x7fc31c0cdc10 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 >> 172.21.15.81:0/2146047359 conn(0x7fc31c0d3ea0 msgr2=0x7fc31c0b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 shutdown_connections 2024-09-17T05:20:22.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.347+0000 7fc322d89640 1 -- 172.21.15.81:0/2146047359 wait complete. 2024-09-17T05:20:22.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:22.477 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-17T05:20:22.477 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T05:20:22.477 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol39510 2024-09-17T05:20:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.582+0000 7fe9c709b640 1 -- 172.21.15.81:0/2519406230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 msgr2=0x7fe9b00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.582+0000 7fe9c709b640 1 --2- 172.21.15.81:0/2519406230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 0x7fe9b00051c0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fe9b800c630 tx=0x7fe9b0005830 comp rx=0 tx=0).stop 2024-09-17T05:20:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.582+0000 7fe9c5638640 1 -- 172.21.15.81:0/2519406230 reap_dead start 2024-09-17T05:20:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.582+0000 7fe9c709b640 1 -- 172.21.15.81:0/2519406230 shutdown_connections 2024-09-17T05:20:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.582+0000 7fe9c709b640 1 -- 172.21.15.81:0/2519406230 >> 172.21.15.81:0/2519406230 conn(0x7fe9c00d1bb0 msgr2=0x7fe9c00d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.583+0000 7fe9c709b640 1 -- 172.21.15.81:0/2519406230 shutdown_connections 2024-09-17T05:20:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.583+0000 7fe9c709b640 1 -- 172.21.15.81:0/2519406230 wait complete. 2024-09-17T05:20:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.584+0000 7fe9c709b640 1 Processor -- start 2024-09-17T05:20:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.584+0000 7fe9c709b640 1 -- start start 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c709b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 0x7fe9c01f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c709b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9c01f5780 0x7fe9c0152050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c709b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9c00c6570 0x7fe9c015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c709b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00b2b10 con 0x7fe9b0004d40 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c709b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe9c00cd760 con 0x7fe9c01f5780 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c709b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe9c00b2c90 con 0x7fe9c00c6570 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 0x7fe9c01f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 0x7fe9c01f2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37398/0 (socket says 172.21.15.81:37398) 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 -- 172.21.15.81:0/1916646383 learned_addr learned my addr 172.21.15.81:0/1916646383 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 -- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9c00c6570 msgr2=0x7fe9c015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9c00c6570 0x7fe9c015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 -- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9c01f5780 msgr2=0x7fe9c0152050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9c01f5780 0x7fe9c0152050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 -- 172.21.15.81:0/1916646383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe9c01f2970 con 0x7fe9b0004d40 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9c4e37640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 0x7fe9c01f2200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4011a60 tx=0x7fe9b4011f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.586+0000 7fe9bd7fa640 1 -- 172.21.15.81:0/1916646383 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b401e070 con 0x7fe9b0004d40 2024-09-17T05:20:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.587+0000 7fe9bd7fa640 1 -- 172.21.15.81:0/1916646383 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9b400fe70 con 0x7fe9b0004d40 2024-09-17T05:20:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.587+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe9c01f2c50 con 0x7fe9b0004d40 2024-09-17T05:20:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.587+0000 7fe9bd7fa640 1 -- 172.21.15.81:0/1916646383 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe9b4004290 con 0x7fe9b0004d40 2024-09-17T05:20:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.587+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe9c00c69f0 con 0x7fe9b0004d40 2024-09-17T05:20:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.588+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe9c00b3220 con 0x7fe9b0004d40 2024-09-17T05:20:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.588+0000 7fe9bd7fa640 1 -- 172.21.15.81:0/1916646383 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fe9b4021070 con 0x7fe9b0004d40 2024-09-17T05:20:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.589+0000 7fe9bd7fa640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9a4078d70 0x7fe9a407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.589+0000 7fe9bd7fa640 1 -- 172.21.15.81:0/1916646383 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe9b409b9b0 con 0x7fe9b0004d40 2024-09-17T05:20:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.589+0000 7fe9bffff640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9a4078d70 0x7fe9a407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.590+0000 7fe9bffff640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9a4078d70 0x7fe9a407b230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00c83c0 tx=0x7fe9ac006180 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:22.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.593+0000 7fe9bd7fa640 1 -- 172.21.15.81:0/1916646383 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe9b40635f0 con 0x7fe9b0004d40 2024-09-17T05:20:22.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.826+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol39510", "target": ["mon-mgr", ""]}) -- 0x7fe9c01f3170 con 0x7fe9a4078d70 2024-09-17T05:20:22.833 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:20:22.831+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:20:22.833 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:20:22.831+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:20:22.833 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:20:22.831+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:20:22.833 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:20:22.831+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:20:22.833 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:20:22.831+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:20:22.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.864+0000 7fe9bd7fa640 1 -- 172.21.15.81:0/1916646383 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe9ac006310 con 0x7fe9a4078d70 2024-09-17T05:20:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9a4078d70 msgr2=0x7fe9a407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9a4078d70 0x7fe9a407b230 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fe9c00c83c0 tx=0x7fe9ac006180 comp rx=0 tx=0).stop 2024-09-17T05:20:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 msgr2=0x7fe9c01f2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 0x7fe9c01f2200 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7fe9b4011a60 tx=0x7fe9b4011f20 comp rx=0 tx=0).stop 2024-09-17T05:20:22.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 shutdown_connections 2024-09-17T05:20:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe9a4078d70 0x7fe9a407b230 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe9c00c6570 0x7fe9c015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe9c01f5780 0x7fe9c0152050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 --2- 172.21.15.81:0/1916646383 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe9b0004d40 0x7fe9c01f2200 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 >> 172.21.15.81:0/1916646383 conn(0x7fe9c00d1bb0 msgr2=0x7fe9c00aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 shutdown_connections 2024-09-17T05:20:22.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.867+0000 7fe9c709b640 1 -- 172.21.15.81:0/1916646383 wait complete. 2024-09-17T05:20:22.878 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 -- 172.21.15.81:0/3076828839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe78806f0b0 msgr2=0x7fe7880cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 --2- 172.21.15.81:0/3076828839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe78806f0b0 0x7fe7880cd3e0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe778009830 tx=0x7fe77802a510 comp rx=0 tx=0).stop 2024-09-17T05:20:22.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 -- 172.21.15.81:0/3076828839 shutdown_connections 2024-09-17T05:20:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 --2- 172.21.15.81:0/3076828839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7880ce950 0x7fe7880cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 --2- 172.21.15.81:0/3076828839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe78806f0b0 0x7fe7880cd3e0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 -- 172.21.15.81:0/3076828839 >> 172.21.15.81:0/3076828839 conn(0x7fe7880741f0 msgr2=0x7fe788074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 -- 172.21.15.81:0/3076828839 shutdown_connections 2024-09-17T05:20:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.978+0000 7fe78d1db640 1 -- 172.21.15.81:0/3076828839 wait complete. 2024-09-17T05:20:22.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.979+0000 7fe78d1db640 1 Processor -- start 2024-09-17T05:20:22.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78d1db640 1 -- start start 2024-09-17T05:20:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78d1db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe78806f0b0 0x7fe78809cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78d1db640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78806f490 0x7fe7881f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78d1db640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7880ce950 0x7fe78815cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78d1db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7880cc0c0 con 0x7fe78806f0b0 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78d1db640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe78815e670 con 0x7fe7880ce950 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78d1db640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe7880cc240 con 0x7fe78806f490 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe786d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe78806f0b0 0x7fe78809cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe786d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe78806f0b0 0x7fe78809cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37404/0 (socket says 172.21.15.81:37404) 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe786d9d640 1 -- 172.21.15.81:0/1546949244 learned_addr learned my addr 172.21.15.81:0/1546949244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78759e640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7880ce950 0x7fe78815cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.980+0000 7fe78659c640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78806f490 0x7fe7881f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe786d9d640 1 -- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78806f490 msgr2=0x7fe7881f8570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe786d9d640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78806f490 0x7fe7881f8570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe786d9d640 1 -- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7880ce950 msgr2=0x7fe78815cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe786d9d640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7880ce950 0x7fe78815cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe786d9d640 1 -- 172.21.15.81:0/1546949244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7881f8c70 con 0x7fe78806f0b0 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe786d9d640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe78806f0b0 0x7fe78809cac0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe778009950 tx=0x7fe778032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe76f7fe640 1 -- 172.21.15.81:0/1546949244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe778040070 con 0x7fe78806f0b0 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe76f7fe640 1 -- 172.21.15.81:0/1546949244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe778005310 con 0x7fe78806f0b0 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7881f8f50 con 0x7fe78806f0b0 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe76f7fe640 1 -- 172.21.15.81:0/1546949244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7780047a0 con 0x7fe78806f0b0 2024-09-17T05:20:22.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.981+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe78815d0f0 con 0x7fe78806f0b0 2024-09-17T05:20:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.982+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7881f4f80 con 0x7fe78806f0b0 2024-09-17T05:20:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.983+0000 7fe76f7fe640 1 -- 172.21.15.81:0/1546949244 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fe778039040 con 0x7fe78806f0b0 2024-09-17T05:20:22.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.983+0000 7fe76f7fe640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe774078d40 0x7fe77407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.983+0000 7fe76f7fe640 1 -- 172.21.15.81:0/1546949244 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fe7780bc140 con 0x7fe78806f0b0 2024-09-17T05:20:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.983+0000 7fe78659c640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe774078d40 0x7fe77407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:22.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.984+0000 7fe78659c640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe774078d40 0x7fe77407b200 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7880d1420 tx=0x7fe77c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:22.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:22.988+0000 7fe76f7fe640 1 -- 172.21.15.81:0/1546949244 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe778083bb0 con 0x7fe78806f0b0 2024-09-17T05:20:23.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.199+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe788075070 con 0x7fe78806f0b0 2024-09-17T05:20:23.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.200+0000 7fe76f7fe640 1 -- 172.21.15.81:0/1546949244 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fe7780885e0 con 0x7fe78806f0b0 2024-09-17T05:20:23.201 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:23.201 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:23.202 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:23.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe774078d40 msgr2=0x7fe77407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe774078d40 0x7fe77407b200 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fe7880d1420 tx=0x7fe77c009040 comp rx=0 tx=0).stop 2024-09-17T05:20:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe78806f0b0 msgr2=0x7fe78809cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe78806f0b0 0x7fe78809cac0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fe778009950 tx=0x7fe778032c10 comp rx=0 tx=0).stop 2024-09-17T05:20:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 shutdown_connections 2024-09-17T05:20:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe774078d40 0x7fe77407b200 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7880ce950 0x7fe78815cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe78806f490 0x7fe7881f8570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 --2- 172.21.15.81:0/1546949244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe78806f0b0 0x7fe78809cac0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 >> 172.21.15.81:0/1546949244 conn(0x7fe7880741f0 msgr2=0x7fe7880c9ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 shutdown_connections 2024-09-17T05:20:23.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.202+0000 7fe78d1db640 1 -- 172.21.15.81:0/1546949244 wait complete. 2024-09-17T05:20:23.214 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:23.330 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":0.485990692,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.975915241161278,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:23.331 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.975915241161278 }, "state": "open", "uptime": 0.485990692 } ] 2024-09-17T05:20:23.331 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 -- 172.21.15.81:0/4260365553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b8159680 msgr2=0x7fb6b815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/4260365553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b8159680 0x7fb6b815d270 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb6b80b2330 tx=0x7fb6a802a530 comp rx=0 tx=0).stop 2024-09-17T05:20:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 -- 172.21.15.81:0/4260365553 shutdown_connections 2024-09-17T05:20:23.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/4260365553 >> v2:172.21.15.160:3300/0 conn(0x7fb6b80cc490 0x7fb6b815f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/4260365553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b8159680 0x7fb6b815d270 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 -- 172.21.15.81:0/4260365553 >> 172.21.15.81:0/4260365553 conn(0x7fb6b80b1690 msgr2=0x7fb6b80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 -- 172.21.15.81:0/4260365553 shutdown_connections 2024-09-17T05:20:23.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.432+0000 7fb6be5f8640 1 -- 172.21.15.81:0/4260365553 wait complete. 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.433+0000 7fb6be5f8640 1 Processor -- start 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.433+0000 7fb6be5f8640 1 -- start start 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b80cc490 0x7fb6b8147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b80cc900 0x7fb6b80b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6b8159680 0x7fb6b80b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b80cf350 con 0x7fb6b80cc490 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb6b80cf1d0 con 0x7fb6b80cc900 2024-09-17T05:20:23.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb6b80cf4d0 con 0x7fb6b8159680 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b80cc490 0x7fb6b8147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b80cc490 0x7fb6b8147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54960/0 (socket says 172.21.15.81:54960) 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 -- 172.21.15.81:0/2263337509 learned_addr learned my addr 172.21.15.81:0/2263337509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b77fe640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b80cc900 0x7fb6b80b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6bcb95640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6b8159680 0x7fb6b80b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 -- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6b8159680 msgr2=0x7fb6b80b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6b8159680 0x7fb6b80b0cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 -- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b80cc900 msgr2=0x7fb6b80b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b80cc900 0x7fb6b80b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 -- 172.21.15.81:0/2263337509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6b8149d60 con 0x7fb6b80cc490 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b7fff640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b80cc490 0x7fb6b8147280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009920 tx=0x7fb6a8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b4ff9640 1 -- 172.21.15.81:0/2263337509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8031e20 con 0x7fb6b80cc490 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b4ff9640 1 -- 172.21.15.81:0/2263337509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6a8005110 con 0x7fb6b80cc490 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6b814a040 con 0x7fb6b80cc490 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6b4ff9640 1 -- 172.21.15.81:0/2263337509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6a8005560 con 0x7fb6b80cc490 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.434+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6b814a600 con 0x7fb6b80cc490 2024-09-17T05:20:23.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.435+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6b815fd70 con 0x7fb6b80cc490 2024-09-17T05:20:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.436+0000 7fb6b4ff9640 1 -- 172.21.15.81:0/2263337509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 7) ==== 101594+0+0 (secure 0 0 0) 0x7fb6a80047a0 con 0x7fb6b80cc490 2024-09-17T05:20:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.436+0000 7fb6b4ff9640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb6a4078d40 0x7fb6a407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.437+0000 7fb6b4ff9640 1 -- 172.21.15.81:0/2263337509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(45..45 src has 1..45) ==== 5709+0+0 (secure 0 0 0) 0x7fb6a80bc260 con 0x7fb6b80cc490 2024-09-17T05:20:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.437+0000 7fb6b77fe640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb6a4078d40 0x7fb6a407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:23.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.437+0000 7fb6b77fe640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb6a4078d40 0x7fb6a407b200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8157bb0 tx=0x7fb6ac008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:23.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.441+0000 7fb6b4ff9640 1 -- 172.21.15.81:0/2263337509 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb6a803f030 con 0x7fb6b80cc490 2024-09-17T05:20:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.654+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6b81477c0 con 0x7fb6b80cc490 2024-09-17T05:20:23.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.654+0000 7fb6b4ff9640 1 -- 172.21.15.81:0/2263337509 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fb6a80843a0 con 0x7fb6b80cc490 2024-09-17T05:20:23.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:23.656 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:23.656 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb6a4078d40 msgr2=0x7fb6a407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb6a4078d40 0x7fb6a407b200 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fb6b8157bb0 tx=0x7fb6ac008040 comp rx=0 tx=0).stop 2024-09-17T05:20:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b80cc490 msgr2=0x7fb6b8147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b80cc490 0x7fb6b8147280 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb6a8009920 tx=0x7fb6a8033d60 comp rx=0 tx=0).stop 2024-09-17T05:20:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 shutdown_connections 2024-09-17T05:20:23.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb6a4078d40 0x7fb6a407b200 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb6b8159680 0x7fb6b80b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb6b80cc900 0x7fb6b80b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 --2- 172.21.15.81:0/2263337509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6b80cc490 0x7fb6b8147280 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 >> 172.21.15.81:0/2263337509 conn(0x7fb6b80b1690 msgr2=0x7fb6b815ed60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 shutdown_connections 2024-09-17T05:20:23.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:23.657+0000 7fb6be5f8640 1 -- 172.21.15.81:0/2263337509 wait complete. 2024-09-17T05:20:23.668 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:23.785 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":0.94198195900000004,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.952774410480611,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:23.786 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.95277441048061 }, "state": "open", "uptime": 0.941981959 } ] 2024-09-17T05:20:23.786 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:20:28.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.898+0000 7f77d1ff3640 1 -- 172.21.15.81:0/2429439102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 msgr2=0x7f77b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.898+0000 7f77d1ff3640 1 --2- 172.21.15.81:0/2429439102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 0x7f77b80051c0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f77c4001f30 tx=0x7f77b8005830 comp rx=0 tx=0).stop 2024-09-17T05:20:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.898+0000 7f77cbfff640 1 -- 172.21.15.81:0/2429439102 reap_dead start 2024-09-17T05:20:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.899+0000 7f77d1ff3640 1 -- 172.21.15.81:0/2429439102 shutdown_connections 2024-09-17T05:20:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.899+0000 7f77d1ff3640 1 -- 172.21.15.81:0/2429439102 >> 172.21.15.81:0/2429439102 conn(0x7f77cc0b1690 msgr2=0x7f77cc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.899+0000 7f77d1ff3640 1 -- 172.21.15.81:0/2429439102 shutdown_connections 2024-09-17T05:20:28.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.899+0000 7f77d1ff3640 1 -- 172.21.15.81:0/2429439102 wait complete. 2024-09-17T05:20:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.900+0000 7f77d1ff3640 1 Processor -- start 2024-09-17T05:20:28.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.900+0000 7f77d1ff3640 1 -- start start 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77d1ff3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 0x7f77cc147520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77d1ff3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77cc156150 0x7f77cc151830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77d1ff3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77cc1565d0 0x7f77cc151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77d1ff3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc0cf1d0 con 0x7f77b8004d40 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77d1ff3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f77cc0ccbc0 con 0x7f77cc1565d0 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77d1ff3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f77cc0cf350 con 0x7f77cc156150 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 0x7f77cc147520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:28.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 0x7f77cc147520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54990/0 (socket says 172.21.15.81:54990) 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 -- 172.21.15.81:0/4098926848 learned_addr learned my addr 172.21.15.81:0/4098926848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cbfff640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77cc1565d0 0x7f77cc151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77c2ffd640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77cc156150 0x7f77cc151830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 -- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77cc156150 msgr2=0x7f77cc151830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77cc156150 0x7f77cc151830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 -- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77cc1565d0 msgr2=0x7f77cc151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77cc1565d0 0x7f77cc151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:28.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 -- 172.21.15.81:0/4098926848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77cc14e8a0 con 0x7f77b8004d40 2024-09-17T05:20:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77cb7fe640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 0x7f77cc147520 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f77bc011ae0 tx=0x7f77bc009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.901+0000 7f77c8ff9640 1 -- 172.21.15.81:0/4098926848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc01e070 con 0x7f77b8004d40 2024-09-17T05:20:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.902+0000 7f77c8ff9640 1 -- 172.21.15.81:0/4098926848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77bc004460 con 0x7f77b8004d40 2024-09-17T05:20:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.902+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77cc150790 con 0x7f77b8004d40 2024-09-17T05:20:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.902+0000 7f77c8ff9640 1 -- 172.21.15.81:0/4098926848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77bc00fc40 con 0x7f77b8004d40 2024-09-17T05:20:28.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.902+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77cc150d50 con 0x7f77b8004d40 2024-09-17T05:20:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.903+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77cc15f750 con 0x7f77b8004d40 2024-09-17T05:20:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.903+0000 7f77c8ff9640 1 -- 172.21.15.81:0/4098926848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f77bc021070 con 0x7f77b8004d40 2024-09-17T05:20:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.904+0000 7f77c8ff9640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77ac078dd0 0x7f77ac07b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.904+0000 7f77c8ff9640 1 -- 172.21.15.81:0/4098926848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f77bc09bc10 con 0x7f77b8004d40 2024-09-17T05:20:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.904+0000 7f77c2ffd640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77ac078dd0 0x7f77ac07b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:28.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.904+0000 7f77c2ffd640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77ac078dd0 0x7f77ac07b290 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77cc156100 tx=0x7f77b40011c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:28.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:28.908+0000 7f77c8ff9640 1 -- 172.21.15.81:0/4098926848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f77bc0636a0 con 0x7f77b8004d40 2024-09-17T05:20:29.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.119+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77cc15a350 con 0x7f77b8004d40 2024-09-17T05:20:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.120+0000 7f77c8ff9640 1 -- 172.21.15.81:0/4098926848 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f77bc0680d0 con 0x7f77b8004d40 2024-09-17T05:20:29.121 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:29.121 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:29.121 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:29.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77ac078dd0 msgr2=0x7f77ac07b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:29.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77ac078dd0 0x7f77ac07b290 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f77cc156100 tx=0x7f77b40011c0 comp rx=0 tx=0).stop 2024-09-17T05:20:29.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 msgr2=0x7f77cc147520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:29.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 0x7f77cc147520 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f77bc011ae0 tx=0x7f77bc009e90 comp rx=0 tx=0).stop 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 shutdown_connections 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f77ac078dd0 0x7f77ac07b290 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77cc1565d0 0x7f77cc151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77cc156150 0x7f77cc151830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 --2- 172.21.15.81:0/4098926848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77b8004d40 0x7f77cc147520 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 >> 172.21.15.81:0/4098926848 conn(0x7f77cc0b1690 msgr2=0x7f77cc0ceaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 shutdown_connections 2024-09-17T05:20:29.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:29.122+0000 7f77d1ff3640 1 -- 172.21.15.81:0/4098926848 wait complete. 2024-09-17T05:20:29.134 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:29.250 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":14,"uptime":6.4058773120000003,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.677378459686722,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:29.251 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 14, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.67737845968672 }, "state": "open", "uptime": 6.405877312 } ] 2024-09-17T05:20:29.251 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:20:34.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 -- 172.21.15.81:0/2994493837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144074280 msgr2=0x7fc1440cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 --2- 172.21.15.81:0/2994493837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144074280 0x7fc1440cb350 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fc1440a2210 tx=0x7fc13802a410 comp rx=0 tx=0).stop 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 -- 172.21.15.81:0/2994493837 shutdown_connections 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 --2- 172.21.15.81:0/2994493837 >> v2:172.21.15.160:3300/0 conn(0x7fc1440746e0 0x7fc1440cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 --2- 172.21.15.81:0/2994493837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc144074280 0x7fc1440cb350 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 -- 172.21.15.81:0/2994493837 >> 172.21.15.81:0/2994493837 conn(0x7fc1440d0c20 msgr2=0x7fc1440d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 -- 172.21.15.81:0/2994493837 shutdown_connections 2024-09-17T05:20:34.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.365+0000 7fc149a23640 1 -- 172.21.15.81:0/2994493837 wait complete. 2024-09-17T05:20:34.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.367+0000 7fc149a23640 1 Processor -- start 2024-09-17T05:20:34.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.367+0000 7fc149a23640 1 -- start start 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144074280 0x7fc1440b42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1440746e0 0x7fc1440b2c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc14415ad00 0x7fc14415b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1440d0820 con 0x7fc1440746e0 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc1440d06a0 con 0x7fc144074280 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc1440cbdd0 con 0x7fc14415ad00 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1440746e0 0x7fc1440b2c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1440746e0 0x7fc1440b2c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42136/0 (socket says 172.21.15.81:42136) 2024-09-17T05:20:34.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 -- 172.21.15.81:0/13348043 learned_addr learned my addr 172.21.15.81:0/13348043 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc142ffd640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144074280 0x7fc1440b42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1437fe640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc14415ad00 0x7fc14415b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 -- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc14415ad00 msgr2=0x7fc14415b2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc14415ad00 0x7fc14415b2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 -- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144074280 msgr2=0x7fc1440b42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144074280 0x7fc1440b42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 -- 172.21.15.81:0/13348043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1440a15c0 con 0x7fc1440746e0 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc1427fc640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1440746e0 0x7fc1440b2c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc138009780 tx=0x7fc138032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc12bfff640 1 -- 172.21.15.81:0/13348043 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc138040070 con 0x7fc1440746e0 2024-09-17T05:20:34.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc12bfff640 1 -- 172.21.15.81:0/13348043 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc138005310 con 0x7fc1440746e0 2024-09-17T05:20:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc14415e190 con 0x7fc1440746e0 2024-09-17T05:20:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc12bfff640 1 -- 172.21.15.81:0/13348043 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1380047a0 con 0x7fc1440746e0 2024-09-17T05:20:34.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.368+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1441f14e0 con 0x7fc1440746e0 2024-09-17T05:20:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.369+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1441f1710 con 0x7fc1440746e0 2024-09-17T05:20:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.370+0000 7fc12bfff640 1 -- 172.21.15.81:0/13348043 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7fc138039040 con 0x7fc1440746e0 2024-09-17T05:20:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.370+0000 7fc12bfff640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc130078e00 0x7fc13007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.371+0000 7fc12bfff640 1 -- 172.21.15.81:0/13348043 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fc1380bc1e0 con 0x7fc1440746e0 2024-09-17T05:20:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.371+0000 7fc142ffd640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc130078e00 0x7fc13007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:34.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.371+0000 7fc142ffd640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc130078e00 0x7fc13007b2c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1340046b0 tx=0x7fc134007eb0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:34.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.375+0000 7fc12bfff640 1 -- 172.21.15.81:0/13348043 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc1441f1710 con 0x7fc1440746e0 2024-09-17T05:20:34.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.586+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc1440cc2f0 con 0x7fc1440746e0 2024-09-17T05:20:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.587+0000 7fc12bfff640 1 -- 172.21.15.81:0/13348043 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fc138084360 con 0x7fc1440746e0 2024-09-17T05:20:34.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:34.588 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:34.588 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc130078e00 msgr2=0x7fc13007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc130078e00 0x7fc13007b2c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fc1340046b0 tx=0x7fc134007eb0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1440746e0 msgr2=0x7fc1440b2c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1440746e0 0x7fc1440b2c80 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fc138009780 tx=0x7fc138032c10 comp rx=0 tx=0).stop 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 shutdown_connections 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc130078e00 0x7fc13007b2c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc14415ad00 0x7fc14415b2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1440746e0 0x7fc1440b2c80 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 --2- 172.21.15.81:0/13348043 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc144074280 0x7fc1440b42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 >> 172.21.15.81:0/13348043 conn(0x7fc1440d0c20 msgr2=0x7fc1440d1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 shutdown_connections 2024-09-17T05:20:34.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:34.589+0000 7fc149a23640 1 -- 172.21.15.81:0/13348043 wait complete. 2024-09-17T05:20:34.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:34.718 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":11.872772612,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.405288962921233,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:34.718 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.405288962921233 }, "state": "open", "uptime": 11.872772612 } ] 2024-09-17T05:20:34.718 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:20:39.719 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:39.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.833+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2239283292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815fe60 msgr2=0x7fbc780ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.833+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2239283292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815fe60 0x7fbc780ceac0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fbc70005fd0 tx=0x7fbc7002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:20:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.833+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2239283292 shutdown_connections 2024-09-17T05:20:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.833+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2239283292 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc7815fe60 0x7fbc780ceac0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.833+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2239283292 >> 172.21.15.81:0/2239283292 conn(0x7fbc780b1690 msgr2=0x7fbc780b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.833+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2239283292 shutdown_connections 2024-09-17T05:20:39.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.833+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2239283292 wait complete. 2024-09-17T05:20:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.834+0000 7fbc7f8b0640 1 Processor -- start 2024-09-17T05:20:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.834+0000 7fbc7f8b0640 1 -- start start 2024-09-17T05:20:39.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7f8b0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc780cc490 0x7fbc7814f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7f8b0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc78159680 0x7fbc781f8300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7f8b0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc7815fe60 0x7fbc78151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7f8b0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc780ccb10 con 0x7fbc780cc490 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7f8b0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc7806f1b0 con 0x7fbc7815fe60 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7f8b0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbc780cf000 con 0x7fbc78159680 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7d64c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc780cc490 0x7fbc7814f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7d64c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc780cc490 0x7fbc7814f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42152/0 (socket says 172.21.15.81:42152) 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.835+0000 7fbc7d64c640 1 -- 172.21.15.81:0/2155074669 learned_addr learned my addr 172.21.15.81:0/2155074669 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7ce4b640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc78159680 0x7fbc781f8300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7de4d640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc7815fe60 0x7fbc78151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7d64c640 1 -- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc78159680 msgr2=0x7fbc781f8300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:39.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7d64c640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc78159680 0x7fbc781f8300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7d64c640 1 -- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc7815fe60 msgr2=0x7fbc78151fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7d64c640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc7815fe60 0x7fbc78151fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7d64c640 1 -- 172.21.15.81:0/2155074669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc781f8a30 con 0x7fbc780cc490 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7d64c640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc780cc490 0x7fbc7814f800 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400c430 tx=0x7fbc7400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc6dffb640 1 -- 172.21.15.81:0/2155074669 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011790 con 0x7fbc780cc490 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc6dffb640 1 -- 172.21.15.81:0/2155074669 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc74017070 con 0x7fbc780cc490 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc6dffb640 1 -- 172.21.15.81:0/2155074669 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc74011d00 con 0x7fbc780cc490 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc781f8d10 con 0x7fbc780cc490 2024-09-17T05:20:39.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.836+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc781f4f00 con 0x7fbc780cc490 2024-09-17T05:20:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.837+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc78070eb0 con 0x7fbc780cc490 2024-09-17T05:20:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.838+0000 7fbc6dffb640 1 -- 172.21.15.81:0/2155074669 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7fbc7401c460 con 0x7fbc780cc490 2024-09-17T05:20:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.838+0000 7fbc6dffb640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbc5c078dd0 0x7fbc5c07b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.838+0000 7fbc6dffb640 1 -- 172.21.15.81:0/2155074669 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fbc7409aff0 con 0x7fbc780cc490 2024-09-17T05:20:39.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.839+0000 7fbc7ce4b640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbc5c078dd0 0x7fbc5c07b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:39.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.839+0000 7fbc7ce4b640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbc5c078dd0 0x7fbc5c07b290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc7815fac0 tx=0x7fbc68009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:39.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:39.843+0000 7fbc6dffb640 1 -- 172.21.15.81:0/2155074669 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbc78070eb0 con 0x7fbc780cc490 2024-09-17T05:20:40.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.055+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc780cf4f0 con 0x7fbc780cc490 2024-09-17T05:20:40.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.056+0000 7fbc6dffb640 1 -- 172.21.15.81:0/2155074669 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fbc74063170 con 0x7fbc780cc490 2024-09-17T05:20:40.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:40.057 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:40.058 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:40.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbc5c078dd0 msgr2=0x7fbc5c07b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:40.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbc5c078dd0 0x7fbc5c07b290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fbc7815fac0 tx=0x7fbc68009040 comp rx=0 tx=0).stop 2024-09-17T05:20:40.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc780cc490 msgr2=0x7fbc7814f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:40.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc780cc490 0x7fbc7814f800 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fbc7400c430 tx=0x7fbc7400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 shutdown_connections 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbc5c078dd0 0x7fbc5c07b290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc7815fe60 0x7fbc78151fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc78159680 0x7fbc781f8300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 --2- 172.21.15.81:0/2155074669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc780cc490 0x7fbc7814f800 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 >> 172.21.15.81:0/2155074669 conn(0x7fbc780b1690 msgr2=0x7fbc78073be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 shutdown_connections 2024-09-17T05:20:40.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:40.058+0000 7fbc7f8b0640 1 -- 172.21.15.81:0/2155074669 wait complete. 2024-09-17T05:20:40.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:40.190 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":13,"uptime":17.344667816000001,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.136370497642584,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:40.190 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 13, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 21.136370497642584 }, "state": "open", "uptime": 17.344667816 } ] 2024-09-17T05:20:40.190 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:20:44.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:44.802 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:20:45.191 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:45.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.303+0000 7fee94871640 1 -- 172.21.15.81:0/2731626380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee9015df90 msgr2=0x7fee900cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:45.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.303+0000 7fee94871640 1 --2- 172.21.15.81:0/2731626380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee9015df90 0x7fee900cf9b0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7fee900d1c90 tx=0x7fee8802aa30 comp rx=0 tx=0).stop 2024-09-17T05:20:45.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.304+0000 7fee94871640 1 -- 172.21.15.81:0/2731626380 shutdown_connections 2024-09-17T05:20:45.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.304+0000 7fee94871640 1 --2- 172.21.15.81:0/2731626380 >> v2:172.21.15.160:3300/0 conn(0x7fee900d49c0 0x7fee900d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.304+0000 7fee94871640 1 --2- 172.21.15.81:0/2731626380 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee9015df90 0x7fee900cf9b0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.304+0000 7fee94871640 1 -- 172.21.15.81:0/2731626380 >> 172.21.15.81:0/2731626380 conn(0x7fee900d3ea0 msgr2=0x7fee900d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:45.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.304+0000 7fee94871640 1 -- 172.21.15.81:0/2731626380 shutdown_connections 2024-09-17T05:20:45.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.304+0000 7fee94871640 1 -- 172.21.15.81:0/2731626380 wait complete. 2024-09-17T05:20:45.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.305+0000 7fee94871640 1 Processor -- start 2024-09-17T05:20:45.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.305+0000 7fee94871640 1 -- start start 2024-09-17T05:20:45.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee94871640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee900d49c0 0x7fee901f8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:45.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee94871640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee9015df90 0x7fee90160ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:45.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee94871640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee90162480 0x7fee9014b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:45.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee94871640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fee900d0f00 con 0x7fee90162480 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee94871640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fee900d0d80 con 0x7fee900d49c0 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee94871640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fee900b3f10 con 0x7fee9015df90 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee90162480 0x7fee9014b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee90162480 0x7fee9014b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43944/0 (socket says 172.21.15.81:43944) 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 -- 172.21.15.81:0/950734687 learned_addr learned my addr 172.21.15.81:0/950734687 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8e59c640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee900d49c0 0x7fee901f8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8dd9b640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee9015df90 0x7fee90160ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 -- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee9015df90 msgr2=0x7fee90160ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee9015df90 0x7fee90160ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 -- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee900d49c0 msgr2=0x7fee901f8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:45.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee900d49c0 0x7fee901f8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 -- 172.21.15.81:0/950734687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee901f9140 con 0x7fee90162480 2024-09-17T05:20:45.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.306+0000 7fee8ed9d640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee90162480 0x7fee9014b480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b490 tx=0x7fee8000b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:45.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.307+0000 7fee86ffd640 1 -- 172.21.15.81:0/950734687 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80015020 con 0x7fee90162480 2024-09-17T05:20:45.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.307+0000 7fee86ffd640 1 -- 172.21.15.81:0/950734687 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fee80011940 con 0x7fee90162480 2024-09-17T05:20:45.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.307+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee9015fa20 con 0x7fee90162480 2024-09-17T05:20:45.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.307+0000 7fee86ffd640 1 -- 172.21.15.81:0/950734687 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee80011d90 con 0x7fee90162480 2024-09-17T05:20:45.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.307+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee901602c0 con 0x7fee90162480 2024-09-17T05:20:45.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.308+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fee900b6820 con 0x7fee90162480 2024-09-17T05:20:45.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.308+0000 7fee86ffd640 1 -- 172.21.15.81:0/950734687 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7fee80018020 con 0x7fee90162480 2024-09-17T05:20:45.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.309+0000 7fee86ffd640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee70078dd0 0x7fee7007b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:45.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.309+0000 7fee86ffd640 1 -- 172.21.15.81:0/950734687 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fee8009af70 con 0x7fee90162480 2024-09-17T05:20:45.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.309+0000 7fee8e59c640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee70078dd0 0x7fee7007b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:45.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.309+0000 7fee8e59c640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee70078dd0 0x7fee7007b290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee88035000 tx=0x7fee8803a040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:45.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.313+0000 7fee86ffd640 1 -- 172.21.15.81:0/950734687 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fee900b6820 con 0x7fee90162480 2024-09-17T05:20:45.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.523+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fee9008d590 con 0x7fee90162480 2024-09-17T05:20:45.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.524+0000 7fee86ffd640 1 -- 172.21.15.81:0/950734687 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fee8001f020 con 0x7fee90162480 2024-09-17T05:20:45.525 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:45.525 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:45.526 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee70078dd0 msgr2=0x7fee7007b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee70078dd0 0x7fee7007b290 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fee88035000 tx=0x7fee8803a040 comp rx=0 tx=0).stop 2024-09-17T05:20:45.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee90162480 msgr2=0x7fee9014b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee90162480 0x7fee9014b480 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fee8000b490 tx=0x7fee8000b890 comp rx=0 tx=0).stop 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 shutdown_connections 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fee70078dd0 0x7fee7007b290 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fee90162480 0x7fee9014b480 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fee9015df90 0x7fee90160ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 --2- 172.21.15.81:0/950734687 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fee900d49c0 0x7fee901f8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 >> 172.21.15.81:0/950734687 conn(0x7fee900d3ea0 msgr2=0x7fee9006eb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 shutdown_connections 2024-09-17T05:20:45.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:45.526+0000 7fee94871640 1 -- 172.21.15.81:0/950734687 wait complete. 2024-09-17T05:20:45.538 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:45.655 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":12,"uptime":22.810563133999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.871119830689558,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:45.655 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 12, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.87111983068956 }, "state": "open", "uptime": 22.810563134 } ] 2024-09-17T05:20:45.655 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:20:50.657 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:50.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 -- 172.21.15.81:0/1727384488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40b3140 msgr2=0x7ff6b4072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/1727384488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40b3140 0x7ff6b4072ae0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40762e0 tx=0x7ff6ac02b860 comp rx=0 tx=0).stop 2024-09-17T05:20:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 -- 172.21.15.81:0/1727384488 shutdown_connections 2024-09-17T05:20:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/1727384488 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40b3140 0x7ff6b4072ae0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/1727384488 >> v2:172.21.15.160:3300/0 conn(0x7ff6b40cf640 0x7ff6b40725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 -- 172.21.15.81:0/1727384488 >> 172.21.15.81:0/1727384488 conn(0x7ff6b40b1690 msgr2=0x7ff6b40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 -- 172.21.15.81:0/1727384488 shutdown_connections 2024-09-17T05:20:50.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.771+0000 7ff6b88ed640 1 -- 172.21.15.81:0/1727384488 wait complete. 2024-09-17T05:20:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 Processor -- start 2024-09-17T05:20:50.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 -- start start 2024-09-17T05:20:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b40b3140 0x7ff6b4154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40cf640 0x7ff6b414cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6b4151370 0x7ff6b413ecc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b406ebc0 con 0x7ff6b40cf640 2024-09-17T05:20:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b406ea40 con 0x7ff6b40b3140 2024-09-17T05:20:50.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.773+0000 7ff6b88ed640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff6b406f9f0 con 0x7ff6b4151370 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40cf640 0x7ff6b414cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40cf640 0x7ff6b414cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43962/0 (socket says 172.21.15.81:43962) 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 -- 172.21.15.81:0/3934009433 learned_addr learned my addr 172.21.15.81:0/3934009433 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b259c640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b40b3140 0x7ff6b4154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b2d9d640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6b4151370 0x7ff6b413ecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 -- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6b4151370 msgr2=0x7ff6b413ecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6b4151370 0x7ff6b413ecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 -- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b40b3140 msgr2=0x7ff6b4154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b40b3140 0x7ff6b4154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 -- 172.21.15.81:0/3934009433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b4155670 con 0x7ff6b40cf640 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b1d9b640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40cf640 0x7ff6b414cc10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00b4d0 tx=0x7ff69c00b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:50.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6aaffd640 1 -- 172.21.15.81:0/3934009433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c014070 con 0x7ff6b40cf640 2024-09-17T05:20:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6aaffd640 1 -- 172.21.15.81:0/3934009433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff69c010960 con 0x7ff6b40cf640 2024-09-17T05:20:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6aaffd640 1 -- 172.21.15.81:0/3934009433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c010db0 con 0x7ff6b40cf640 2024-09-17T05:20:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b4155950 con 0x7ff6b40cf640 2024-09-17T05:20:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.774+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b4155f10 con 0x7ff6b40cf640 2024-09-17T05:20:50.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.775+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b40cef30 con 0x7ff6b40cf640 2024-09-17T05:20:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.776+0000 7ff6aaffd640 1 -- 172.21.15.81:0/3934009433 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7ff69c017070 con 0x7ff6b40cf640 2024-09-17T05:20:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.776+0000 7ff6aaffd640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff694078dd0 0x7ff69407b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.776+0000 7ff6aaffd640 1 -- 172.21.15.81:0/3934009433 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7ff69c09af20 con 0x7ff6b40cf640 2024-09-17T05:20:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.777+0000 7ff6b259c640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff694078dd0 0x7ff69407b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:50.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.777+0000 7ff6b259c640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff694078dd0 0x7ff69407b290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40017a0 tx=0x7ff6a4001730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:50.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.781+0000 7ff6aaffd640 1 -- 172.21.15.81:0/3934009433 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff69c062980 con 0x7ff6b40cf640 2024-09-17T05:20:50.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.991+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6b40cffe0 con 0x7ff6b40cf640 2024-09-17T05:20:50.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.992+0000 7ff6aaffd640 1 -- 172.21.15.81:0/3934009433 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7ff69c0673b0 con 0x7ff6b40cf640 2024-09-17T05:20:50.992 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:50.992 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:50.993 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff694078dd0 msgr2=0x7ff69407b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff694078dd0 0x7ff69407b290 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff6a40017a0 tx=0x7ff6a4001730 comp rx=0 tx=0).stop 2024-09-17T05:20:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40cf640 msgr2=0x7ff6b414cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:50.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40cf640 0x7ff6b414cc10 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7ff69c00b4d0 tx=0x7ff69c00b990 comp rx=0 tx=0).stop 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 shutdown_connections 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff694078dd0 0x7ff69407b290 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6b4151370 0x7ff6b413ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6b40cf640 0x7ff6b414cc10 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 --2- 172.21.15.81:0/3934009433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6b40b3140 0x7ff6b4154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 >> 172.21.15.81:0/3934009433 conn(0x7ff6b40b1690 msgr2=0x7ff6b41505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 shutdown_connections 2024-09-17T05:20:50.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:50.994+0000 7ff6b88ed640 1 -- 172.21.15.81:0/3934009433 wait complete. 2024-09-17T05:20:51.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:51.122 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":11,"uptime":28.278458412999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.609102691649117,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:51.122 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 1, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 11, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.609102691649117 }, "state": "open", "uptime": 28.278458413 } ] 2024-09-17T05:20:51.122 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:20:56.124 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:20:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 -- 172.21.15.81:0/1014834077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 msgr2=0x7fabc80ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 --2- 172.21.15.81:0/1014834077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc80ce240 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fabbc005fd0 tx=0x7fabbc02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 -- 172.21.15.81:0/1014834077 shutdown_connections 2024-09-17T05:20:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 --2- 172.21.15.81:0/1014834077 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabc80ce780 0x7fabc80cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 --2- 172.21.15.81:0/1014834077 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc80ce240 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 -- 172.21.15.81:0/1014834077 >> 172.21.15.81:0/1014834077 conn(0x7fabc80741f0 msgr2=0x7fabc8074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 -- 172.21.15.81:0/1014834077 shutdown_connections 2024-09-17T05:20:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.236+0000 7fabcf317640 1 -- 172.21.15.81:0/1014834077 wait complete. 2024-09-17T05:20:56.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 Processor -- start 2024-09-17T05:20:56.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 -- start start 2024-09-17T05:20:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc806f0b0 0x7fabc80c6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:56.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc815aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabc80ce780 0x7fabc80cee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fabc80cc0c0 con 0x7fabc80cd3e0 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fabc815e670 con 0x7fabc806f0b0 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.238+0000 7fabcf317640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fabc80cc240 con 0x7fabc80ce780 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc815aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc815aee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47782/0 (socket says 172.21.15.81:47782) 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 -- 172.21.15.81:0/2807504694 learned_addr learned my addr 172.21.15.81:0/2807504694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcd8b4640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabc80ce780 0x7fabc80cee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:56.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcd0b3640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc806f0b0 0x7fabc80c6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 -- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabc80ce780 msgr2=0x7fabc80cee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabc80ce780 0x7fabc80cee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 -- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc806f0b0 msgr2=0x7fabc80c6620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc806f0b0 0x7fabc80c6620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 -- 172.21.15.81:0/2807504694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabc81f1230 con 0x7fabc80cd3e0 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcd8b4640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabc80ce780 0x7fabc80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcd0b3640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc806f0b0 0x7fabc80c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcc8b2640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc815aee0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0099f0 tx=0x7fabbc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabc5ffb640 1 -- 172.21.15.81:0/2807504694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc035070 con 0x7fabc80cd3e0 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabc5ffb640 1 -- 172.21.15.81:0/2807504694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fabbc005600 con 0x7fabc80cd3e0 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabc5ffb640 1 -- 172.21.15.81:0/2807504694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fabbc003e60 con 0x7fabc80cd3e0 2024-09-17T05:20:56.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.239+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabc81f14f0 con 0x7fabc80cd3e0 2024-09-17T05:20:56.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.240+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabc81f1ab0 con 0x7fabc80cd3e0 2024-09-17T05:20:56.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.241+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fabc80cc6f0 con 0x7fabc80cd3e0 2024-09-17T05:20:56.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.241+0000 7fabc5ffb640 1 -- 172.21.15.81:0/2807504694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7fabbc038470 con 0x7fabc80cd3e0 2024-09-17T05:20:56.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.242+0000 7fabc5ffb640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fabb4078dd0 0x7fabb407b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:20:56.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.242+0000 7fabc5ffb640 1 -- 172.21.15.81:0/2807504694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fabbc0bd510 con 0x7fabc80cd3e0 2024-09-17T05:20:56.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.242+0000 7fabcd0b3640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fabb4078dd0 0x7fabb407b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:20:56.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.243+0000 7fabcd0b3640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fabb4078dd0 0x7fabb407b290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fabc0000f60 tx=0x7fabc0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:20:56.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.246+0000 7fabc5ffb640 1 -- 172.21.15.81:0/2807504694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fabbc085690 con 0x7fabc80cd3e0 2024-09-17T05:20:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.459+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fabc8074d10 con 0x7fabc80cd3e0 2024-09-17T05:20:56.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.459+0000 7fabc5ffb640 1 -- 172.21.15.81:0/2807504694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fabbc084f90 con 0x7fabc80cd3e0 2024-09-17T05:20:56.460 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:20:56.461 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:20:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fabb4078dd0 msgr2=0x7fabb407b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fabb4078dd0 0x7fabb407b290 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fabc0000f60 tx=0x7fabc0009040 comp rx=0 tx=0).stop 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 msgr2=0x7fabc815aee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc815aee0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fabbc0099f0 tx=0x7fabbc003820 comp rx=0 tx=0).stop 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 shutdown_connections 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fabb4078dd0 0x7fabb407b290 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fabc80ce780 0x7fabc80cee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fabc80cd3e0 0x7fabc815aee0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 --2- 172.21.15.81:0/2807504694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fabc806f0b0 0x7fabc80c6620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:20:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 >> 172.21.15.81:0/2807504694 conn(0x7fabc80741f0 msgr2=0x7fabc80745d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:20:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 shutdown_connections 2024-09-17T05:20:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:20:56.462+0000 7fabcf317640 1 -- 172.21.15.81:0/2807504694 wait complete. 2024-09-17T05:20:56.474 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:20:56.592 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":33.748353653000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.350280892941239,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:20:56.592 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.35028089294124 }, "state": "open", "uptime": 33.748353653 } ] 2024-09-17T05:20:56.593 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:21:01.594 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.709+0000 7fa124c7f640 1 -- 172.21.15.81:0/1360977523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 msgr2=0x7fa10800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.709+0000 7fa124c7f640 1 --2- 172.21.15.81:0/1360977523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa10800b9c0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fa11800c610 tx=0x7fa108005830 comp rx=0 tx=0).stop 2024-09-17T05:21:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.710+0000 7fa124c7f640 1 -- 172.21.15.81:0/1360977523 shutdown_connections 2024-09-17T05:21:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.710+0000 7fa124c7f640 1 --2- 172.21.15.81:0/1360977523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa10800b9c0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.710+0000 7fa124c7f640 1 -- 172.21.15.81:0/1360977523 >> 172.21.15.81:0/1360977523 conn(0x7fa1200b1690 msgr2=0x7fa1200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.710+0000 7fa124c7f640 1 -- 172.21.15.81:0/1360977523 shutdown_connections 2024-09-17T05:21:01.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.710+0000 7fa124c7f640 1 -- 172.21.15.81:0/1360977523 wait complete. 2024-09-17T05:21:01.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.711+0000 7fa124c7f640 1 Processor -- start 2024-09-17T05:21:01.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.711+0000 7fa124c7f640 1 -- start start 2024-09-17T05:21:01.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa124c7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa120155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa124c7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa120144d50 0x7fa120073950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa124c7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa120154060 0x7fa1201544e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa124c7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa12015d3f0 con 0x7fa1080052e0 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa124c7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa12015d270 con 0x7fa120154060 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa124c7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa12015d570 con 0x7fa120144d50 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa120155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa120155910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47786/0 (socket says 172.21.15.81:47786) 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 -- 172.21.15.81:0/3220790139 learned_addr learned my addr 172.21.15.81:0/3220790139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11dd9b640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa120144d50 0x7fa120073950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11ed9d640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa120154060 0x7fa1201544e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 -- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa120144d50 msgr2=0x7fa120073950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:01.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa120144d50 0x7fa120073950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 -- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa120154060 msgr2=0x7fa1201544e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa120154060 0x7fa1201544e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 -- 172.21.15.81:0/3220790139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1201521f0 con 0x7fa1080052e0 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa11e59c640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa120155910 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa110004e50 tx=0x7fa110001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa10effd640 1 -- 172.21.15.81:0/3220790139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110001d40 con 0x7fa1080052e0 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.712+0000 7fa10effd640 1 -- 172.21.15.81:0/3220790139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa110016070 con 0x7fa1080052e0 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.713+0000 7fa10effd640 1 -- 172.21.15.81:0/3220790139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa110010b20 con 0x7fa1080052e0 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.713+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1201524d0 con 0x7fa1080052e0 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.713+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa120073430 con 0x7fa1080052e0 2024-09-17T05:21:01.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.714+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12015f830 con 0x7fa1080052e0 2024-09-17T05:21:01.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.714+0000 7fa10effd640 1 -- 172.21.15.81:0/3220790139 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7fa110010cc0 con 0x7fa1080052e0 2024-09-17T05:21:01.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.715+0000 7fa10effd640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078e00 0x7fa10007b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:01.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.715+0000 7fa10effd640 1 -- 172.21.15.81:0/3220790139 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fa11009b9c0 con 0x7fa1080052e0 2024-09-17T05:21:01.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.715+0000 7fa11dd9b640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078e00 0x7fa10007b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:01.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.716+0000 7fa11dd9b640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078e00 0x7fa10007b2c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa12014ee80 tx=0x7fa11400b260 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:01.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.719+0000 7fa10effd640 1 -- 172.21.15.81:0/3220790139 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa11009de20 con 0x7fa1080052e0 2024-09-17T05:21:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.932+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa12015a190 con 0x7fa1080052e0 2024-09-17T05:21:01.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.932+0000 7fa10effd640 1 -- 172.21.15.81:0/3220790139 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fa1100639e0 con 0x7fa1080052e0 2024-09-17T05:21:01.934 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:01.934 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:01.934 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078e00 msgr2=0x7fa10007b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078e00 0x7fa10007b2c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa12014ee80 tx=0x7fa11400b260 comp rx=0 tx=0).stop 2024-09-17T05:21:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 msgr2=0x7fa120155910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa120155910 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fa110004e50 tx=0x7fa110001630 comp rx=0 tx=0).stop 2024-09-17T05:21:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 shutdown_connections 2024-09-17T05:21:01.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078e00 0x7fa10007b2c0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa120154060 0x7fa1201544e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa120144d50 0x7fa120073950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 --2- 172.21.15.81:0/3220790139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1080052e0 0x7fa120155910 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 >> 172.21.15.81:0/3220790139 conn(0x7fa1200b1690 msgr2=0x7fa120158950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 shutdown_connections 2024-09-17T05:21:01.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:01.935+0000 7fa124c7f640 1 -- 172.21.15.81:0/3220790139 wait complete. 2024-09-17T05:21:01.947 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:21:02.066 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":10,"uptime":39.221248834999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":20.094570254977,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:21:02.067 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 10, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 20.094570254977 }, "state": "open", "uptime": 39.221248835 } ] 2024-09-17T05:21:02.067 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:21:07.069 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 -- 172.21.15.81:0/1502092458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013ce00 msgr2=0x7f61000725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:07.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 --2- 172.21.15.81:0/1502092458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013ce00 0x7f61000725a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009830 tx=0x7f60fc02a510 comp rx=0 tx=0).stop 2024-09-17T05:21:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 -- 172.21.15.81:0/1502092458 shutdown_connections 2024-09-17T05:21:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 --2- 172.21.15.81:0/1502092458 >> v2:172.21.15.160:3300/0 conn(0x7f610013f9a0 0x7f610006f0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 --2- 172.21.15.81:0/1502092458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013ce00 0x7f61000725a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 -- 172.21.15.81:0/1502092458 >> 172.21.15.81:0/1502092458 conn(0x7f61000b1690 msgr2=0x7f61000b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 -- 172.21.15.81:0/1502092458 shutdown_connections 2024-09-17T05:21:07.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.183+0000 7f6108059640 1 -- 172.21.15.81:0/1502092458 wait complete. 2024-09-17T05:21:07.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.184+0000 7f6108059640 1 Processor -- start 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.184+0000 7f6108059640 1 -- start start 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6108059640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100072ae0 0x7f610013be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6108059640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610013ce00 0x7f6100138070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6108059640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013f9a0 0x7f6100138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6108059640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6100070810 con 0x7f6100072ae0 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6108059640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6100070690 con 0x7f610013ce00 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6108059640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f610006f630 con 0x7f610013f9a0 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100072ae0 0x7f610013be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100072ae0 0x7f610013be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38740/0 (socket says 172.21.15.81:38740) 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 -- 172.21.15.81:0/2847295343 learned_addr learned my addr 172.21.15.81:0/2847295343 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:07.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f61065f6640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013f9a0 0x7f6100138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f61055f4640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610013ce00 0x7f6100138070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 -- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013f9a0 msgr2=0x7f6100138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013f9a0 0x7f6100138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 -- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610013ce00 msgr2=0x7f6100138070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610013ce00 0x7f6100138070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 -- 172.21.15.81:0/2847295343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6100150b20 con 0x7f6100072ae0 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.185+0000 7f6105df5640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100072ae0 0x7f610013be00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009950 tx=0x7f60fc032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.186+0000 7f60f67fc640 1 -- 172.21.15.81:0/2847295343 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc040070 con 0x7f6100072ae0 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.186+0000 7f60f67fc640 1 -- 172.21.15.81:0/2847295343 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60fc005310 con 0x7f6100072ae0 2024-09-17T05:21:07.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.186+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6100150e00 con 0x7f6100072ae0 2024-09-17T05:21:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.186+0000 7f60f67fc640 1 -- 172.21.15.81:0/2847295343 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60fc005c90 con 0x7f6100072ae0 2024-09-17T05:21:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.186+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6100156480 con 0x7f6100072ae0 2024-09-17T05:21:07.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.187+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61000725a0 con 0x7f6100072ae0 2024-09-17T05:21:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.187+0000 7f60f67fc640 1 -- 172.21.15.81:0/2847295343 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f60fc039040 con 0x7f6100072ae0 2024-09-17T05:21:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.188+0000 7f60f67fc640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60e4078e00 0x7f60e407b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.188+0000 7f60f67fc640 1 -- 172.21.15.81:0/2847295343 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f60fc0bbf10 con 0x7f6100072ae0 2024-09-17T05:21:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.188+0000 7f61055f4640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60e4078e00 0x7f60e407b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:07.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.189+0000 7f61055f4640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60e4078e00 0x7f60e407b2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f60f0007fd0 tx=0x7f60f0001410 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:07.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.192+0000 7f60f67fc640 1 -- 172.21.15.81:0/2847295343 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f60fc084090 con 0x7f6100072ae0 2024-09-17T05:21:07.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.406+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6100156650 con 0x7f6100072ae0 2024-09-17T05:21:07.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.407+0000 7f60f67fc640 1 -- 172.21.15.81:0/2847295343 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f60fc083990 con 0x7f6100072ae0 2024-09-17T05:21:07.408 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:07.408 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:07.409 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60e4078e00 msgr2=0x7f60e407b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60e4078e00 0x7f60e407b2c0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f60f0007fd0 tx=0x7f60f0001410 comp rx=0 tx=0).stop 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100072ae0 msgr2=0x7f610013be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100072ae0 0x7f610013be00 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f60fc009950 tx=0x7f60fc032c10 comp rx=0 tx=0).stop 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 shutdown_connections 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60e4078e00 0x7f60e407b2c0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f610013f9a0 0x7f6100138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f610013ce00 0x7f6100138070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 --2- 172.21.15.81:0/2847295343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6100072ae0 0x7f610013be00 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 >> 172.21.15.81:0/2847295343 conn(0x7f61000b1690 msgr2=0x7f610006fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:07.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 shutdown_connections 2024-09-17T05:21:07.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:07.409+0000 7f6108059640 1 -- 172.21.15.81:0/2847295343 wait complete. 2024-09-17T05:21:07.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:21:07.538 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":9,"uptime":44.694144016999999,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.842072738773194,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:21:07.538 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 9, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.842072738773194 }, "state": "open", "uptime": 44.694144017 } ] 2024-09-17T05:21:07.539 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:21:12.539 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:12.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 -- 172.21.15.81:0/3479165368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 msgr2=0x7fe02015f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3479165368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe02015f750 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fe010009830 tx=0x7fe01002a510 comp rx=0 tx=0).stop 2024-09-17T05:21:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 -- 172.21.15.81:0/3479165368 shutdown_connections 2024-09-17T05:21:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3479165368 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe02015f750 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3479165368 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe020159680 0x7fe02015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 -- 172.21.15.81:0/3479165368 >> 172.21.15.81:0/3479165368 conn(0x7fe0200b1690 msgr2=0x7fe0200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 -- 172.21.15.81:0/3479165368 shutdown_connections 2024-09-17T05:21:12.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.652+0000 7fe027b2b640 1 -- 172.21.15.81:0/3479165368 wait complete. 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.653+0000 7fe027b2b640 1 Processor -- start 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.653+0000 7fe027b2b640 1 -- start start 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe027b2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe020152f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe027b2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0200cc8d0 0x7fe0200740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe027b2b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe020159680 0x7fe0200ae240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe027b2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe0200cf350 con 0x7fe0200cc490 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe027b2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe0200cf1d0 con 0x7fe0200cc8d0 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe027b2b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe0200cf4d0 con 0x7fe020159680 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe0258c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe020152f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:12.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe0258c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe020152f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38756/0 (socket says 172.21.15.81:38756) 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.654+0000 7fe0258c7640 1 -- 172.21.15.81:0/3367692642 learned_addr learned my addr 172.21.15.81:0/3367692642 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0260c8640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe020159680 0x7fe0200ae240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0258c7640 1 -- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe020159680 msgr2=0x7fe0200ae240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0258c7640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe020159680 0x7fe0200ae240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0258c7640 1 -- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0200cc8d0 msgr2=0x7fe0200740f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0258c7640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0200cc8d0 0x7fe0200740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0258c7640 1 -- 172.21.15.81:0/3367692642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe020074630 con 0x7fe0200cc490 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0260c8640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe020159680 0x7fe0200ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0258c7640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe020152f60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00d770 tx=0x7fe01c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0167fc640 1 -- 172.21.15.81:0/3367692642 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c017070 con 0x7fe0200cc490 2024-09-17T05:21:12.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0167fc640 1 -- 172.21.15.81:0/3367692642 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe01c009d20 con 0x7fe0200cc490 2024-09-17T05:21:12.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0200aee60 con 0x7fe0200cc490 2024-09-17T05:21:12.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe0167fc640 1 -- 172.21.15.81:0/3367692642 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe01c0106c0 con 0x7fe0200cc490 2024-09-17T05:21:12.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.655+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0200ada40 con 0x7fe0200cc490 2024-09-17T05:21:12.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.656+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0200af380 con 0x7fe0200cc490 2024-09-17T05:21:12.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.657+0000 7fe0167fc640 1 -- 172.21.15.81:0/3367692642 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7fe01c01a070 con 0x7fe0200cc490 2024-09-17T05:21:12.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.658+0000 7fe0167fc640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe004078dd0 0x7fe00407b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:12.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.658+0000 7fe0167fc640 1 -- 172.21.15.81:0/3367692642 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe01c09b300 con 0x7fe0200cc490 2024-09-17T05:21:12.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.658+0000 7fe0250c6640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe004078dd0 0x7fe00407b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:12.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.658+0000 7fe0250c6640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe004078dd0 0x7fe00407b290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe010034000 tx=0x7fe0100046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:12.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.662+0000 7fe0167fc640 1 -- 172.21.15.81:0/3367692642 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe01c0633b0 con 0x7fe0200cc490 2024-09-17T05:21:12.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.873+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe02015fe00 con 0x7fe0200cc490 2024-09-17T05:21:12.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.873+0000 7fe0167fc640 1 -- 172.21.15.81:0/3367692642 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fe01c062cb0 con 0x7fe0200cc490 2024-09-17T05:21:12.874 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:12.875 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe004078dd0 msgr2=0x7fe00407b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe004078dd0 0x7fe00407b290 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe010034000 tx=0x7fe0100046c0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 msgr2=0x7fe020152f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe020152f60 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fe01c00d770 tx=0x7fe01c00dc30 comp rx=0 tx=0).stop 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 shutdown_connections 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe004078dd0 0x7fe00407b290 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe020159680 0x7fe0200ae240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe0200cc8d0 0x7fe0200740f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 --2- 172.21.15.81:0/3367692642 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe0200cc490 0x7fe020152f60 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 >> 172.21.15.81:0/3367692642 conn(0x7fe0200b1690 msgr2=0x7fe02015e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 shutdown_connections 2024-09-17T05:21:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:12.875+0000 7fe027b2b640 1 -- 172.21.15.81:0/3367692642 wait complete. 2024-09-17T05:21:12.888 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:21:13.004 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":50.160039333999997,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.593064848448773,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:21:13.005 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.593064848448773 }, "state": "open", "uptime": 50.160039334 } ] 2024-09-17T05:21:13.005 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:21:14.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:14.933 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:18.006 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 -- 172.21.15.81:0/300109103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc0cc490 msgr2=0x7f04dc15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/300109103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc0cc490 0x7f04dc15f750 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f04dc15f6b0 tx=0x7f04c402a560 comp rx=0 tx=0).stop 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 -- 172.21.15.81:0/300109103 shutdown_connections 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/300109103 >> v2:172.21.15.160:3300/0 conn(0x7f04dc0cc900 0x7f04dc15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/300109103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc0cc490 0x7f04dc15f750 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 -- 172.21.15.81:0/300109103 >> 172.21.15.81:0/300109103 conn(0x7f04dc0b1690 msgr2=0x7f04dc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 -- 172.21.15.81:0/300109103 shutdown_connections 2024-09-17T05:21:18.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.119+0000 7f04e2a9b640 1 -- 172.21.15.81:0/300109103 wait complete. 2024-09-17T05:21:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.121+0000 7f04e2a9b640 1 Processor -- start 2024-09-17T05:21:18.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.121+0000 7f04e2a9b640 1 -- start start 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.121+0000 7f04e2a9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc0cc490 0x7f04dc155390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.121+0000 7f04e2a9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04dc0cc900 0x7f04dc13f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e2a9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc159680 0x7f04dc157290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e2a9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc0cec40 con 0x7f04dc159680 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e2a9b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04dc0ceac0 con 0x7f04dc0cc490 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e2a9b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f04dc0cedc0 con 0x7f04dc0cc900 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc159680 0x7f04dc157290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc159680 0x7f04dc157290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39292/0 (socket says 172.21.15.81:39292) 2024-09-17T05:21:18.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 -- 172.21.15.81:0/420684263 learned_addr learned my addr 172.21.15.81:0/420684263 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e0837640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc0cc490 0x7f04dc155390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04dbfff640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04dc0cc900 0x7f04dc13f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 -- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04dc0cc900 msgr2=0x7f04dc13f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04dc0cc900 0x7f04dc13f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 -- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc0cc490 msgr2=0x7f04dc155390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc0cc490 0x7f04dc155390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 -- 172.21.15.81:0/420684263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04dc1561f0 con 0x7f04dc159680 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e1038640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc159680 0x7f04dc157290 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009fd0 tx=0x7f04d400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04d97fa640 1 -- 172.21.15.81:0/420684263 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4011830 con 0x7f04dc159680 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04d97fa640 1 -- 172.21.15.81:0/420684263 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f04d4016070 con 0x7f04dc159680 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04dc1564d0 con 0x7f04dc159680 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04d97fa640 1 -- 172.21.15.81:0/420684263 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04d4011d40 con 0x7f04dc159680 2024-09-17T05:21:18.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.122+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04dc156a90 con 0x7f04dc159680 2024-09-17T05:21:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.123+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04dc0cf220 con 0x7f04dc159680 2024-09-17T05:21:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.124+0000 7f04d97fa640 1 -- 172.21.15.81:0/420684263 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f04d401b460 con 0x7f04dc159680 2024-09-17T05:21:18.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.124+0000 7f04d97fa640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f04bc078dd0 0x7f04bc07b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.125+0000 7f04d97fa640 1 -- 172.21.15.81:0/420684263 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f04d409b000 con 0x7f04dc159680 2024-09-17T05:21:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.125+0000 7f04e0837640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f04bc078dd0 0x7f04bc07b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.125+0000 7f04e0837640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f04bc078dd0 0x7f04bc07b290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0020b0 tx=0x7f04cc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:18.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.129+0000 7f04d97fa640 1 -- 172.21.15.81:0/420684263 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f04d4063030 con 0x7f04dc159680 2024-09-17T05:21:18.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.338+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f04dc15acc0 con 0x7f04dc159680 2024-09-17T05:21:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.339+0000 7f04d97fa640 1 -- 172.21.15.81:0/420684263 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f04d4062930 con 0x7f04dc159680 2024-09-17T05:21:18.340 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:18.340 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:18.340 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f04bc078dd0 msgr2=0x7f04bc07b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f04bc078dd0 0x7f04bc07b290 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0020b0 tx=0x7f04cc009040 comp rx=0 tx=0).stop 2024-09-17T05:21:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc159680 msgr2=0x7f04dc157290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:18.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc159680 0x7f04dc157290 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f04d4009fd0 tx=0x7f04d400b8e0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 shutdown_connections 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f04bc078dd0 0x7f04bc07b290 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f04dc159680 0x7f04dc157290 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04dc0cc900 0x7f04dc13f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 --2- 172.21.15.81:0/420684263 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04dc0cc490 0x7f04dc155390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 >> 172.21.15.81:0/420684263 conn(0x7f04dc0b1690 msgr2=0x7f04dc0b0360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 shutdown_connections 2024-09-17T05:21:18.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:18.341+0000 7f04e2a9b640 1 -- 172.21.15.81:0/420684263 wait complete. 2024-09-17T05:21:18.354 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:21:18.469 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":8,"uptime":55.624934670000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.34722658079934,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:21:18.470 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 8, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.34722658079934 }, "state": "open", "uptime": 55.62493467 } ] 2024-09-17T05:21:18.470 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:21:23.471 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 -- 172.21.15.81:0/969448355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc8d0 msgr2=0x7f40ec15fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 --2- 172.21.15.81:0/969448355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc8d0 0x7f40ec15fc90 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f40e4005fd0 tx=0x7f40e402aa00 comp rx=0 tx=0).stop 2024-09-17T05:21:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 -- 172.21.15.81:0/969448355 shutdown_connections 2024-09-17T05:21:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 --2- 172.21.15.81:0/969448355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc8d0 0x7f40ec15fc90 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 --2- 172.21.15.81:0/969448355 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec0cc490 0x7f40ec15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 -- 172.21.15.81:0/969448355 >> 172.21.15.81:0/969448355 conn(0x7f40ec0b1690 msgr2=0x7f40ec0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 -- 172.21.15.81:0/969448355 shutdown_connections 2024-09-17T05:21:23.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.584+0000 7f40f4685640 1 -- 172.21.15.81:0/969448355 wait complete. 2024-09-17T05:21:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.585+0000 7f40f4685640 1 Processor -- start 2024-09-17T05:21:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.585+0000 7f40f4685640 1 -- start start 2024-09-17T05:21:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f4685640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc490 0x7f40ec1534a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f4685640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec0cc8d0 0x7f40ec151c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f4685640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec159680 0x7f40ec150ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f4685640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec0cec40 con 0x7f40ec0cc490 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f4685640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f40ec0ceac0 con 0x7f40ec0cc8d0 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f4685640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f40ec0cedc0 con 0x7f40ec159680 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc490 0x7f40ec1534a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc490 0x7f40ec1534a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37926/0 (socket says 172.21.15.81:37926) 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 -- 172.21.15.81:0/257718025 learned_addr learned my addr 172.21.15.81:0/257718025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2c22640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec159680 0x7f40ec150ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 -- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec159680 msgr2=0x7f40ec150ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec159680 0x7f40ec150ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 -- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec0cc8d0 msgr2=0x7f40ec151c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec0cc8d0 0x7f40ec151c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 -- 172.21.15.81:0/257718025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40ec152150 con 0x7f40ec0cc490 2024-09-17T05:21:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f2421640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc490 0x7f40ec1534a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f40e800b3e0 tx=0x7f40e800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40deffd640 1 -- 172.21.15.81:0/257718025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8015020 con 0x7f40ec0cc490 2024-09-17T05:21:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40deffd640 1 -- 172.21.15.81:0/257718025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40e8011940 con 0x7f40ec0cc490 2024-09-17T05:21:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40deffd640 1 -- 172.21.15.81:0/257718025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e8011d90 con 0x7f40ec0cc490 2024-09-17T05:21:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.586+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40ec1f2920 con 0x7f40ec0cc490 2024-09-17T05:21:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.587+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40ec1f2ee0 con 0x7f40ec0cc490 2024-09-17T05:21:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.588+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40ec0cf2e0 con 0x7f40ec0cc490 2024-09-17T05:21:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.588+0000 7f40deffd640 1 -- 172.21.15.81:0/257718025 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 8) ==== 101645+0+0 (secure 0 0 0) 0x7f40e8018020 con 0x7f40ec0cc490 2024-09-17T05:21:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.589+0000 7f40deffd640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f40d0078dd0 0x7f40d007b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.589+0000 7f40deffd640 1 -- 172.21.15.81:0/257718025 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f40e809b240 con 0x7f40ec0cc490 2024-09-17T05:21:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.589+0000 7f40f1c20640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f40d0078dd0 0x7f40d007b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.590+0000 7f40f1c20640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f40d0078dd0 0x7f40d007b290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f40ec1f6b30 tx=0x7f40e0005c70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:23.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.593+0000 7f40deffd640 1 -- 172.21.15.81:0/257718025 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f40e801f020 con 0x7f40ec0cc490 2024-09-17T05:21:23.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.808+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f40ec151530 con 0x7f40ec0cc490 2024-09-17T05:21:23.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.808+0000 7f40deffd640 1 -- 172.21.15.81:0/257718025 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f40ec152150 con 0x7f40ec0cc490 2024-09-17T05:21:23.809 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:23.809 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:23.810 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f40d0078dd0 msgr2=0x7f40d007b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f40d0078dd0 0x7f40d007b290 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f40ec1f6b30 tx=0x7f40e0005c70 comp rx=0 tx=0).stop 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc490 msgr2=0x7f40ec1534a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc490 0x7f40ec1534a0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f40e800b3e0 tx=0x7f40e800b8a0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 shutdown_connections 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f40d0078dd0 0x7f40d007b290 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40ec159680 0x7f40ec150ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40ec0cc8d0 0x7f40ec151c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 --2- 172.21.15.81:0/257718025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40ec0cc490 0x7f40ec1534a0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:23.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 >> 172.21.15.81:0/257718025 conn(0x7f40ec0b1690 msgr2=0x7f40ec15f6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:23.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 shutdown_connections 2024-09-17T05:21:23.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:23.810+0000 7f40f4685640 1 -- 172.21.15.81:0/257718025 wait complete. 2024-09-17T05:21:23.822 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:21:23.938 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5251,"entity":{"name":{"type":"client","num":5251},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3742151257}},"state":"open","num_leases":0,"num_caps":7,"request_load_avg":7,"uptime":61.093829931000002,"requests_in_flight":0,"num_completed_requests":2,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":19.104296338430391,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5251 172.21.15.160:0/3742151257","completed_requests":[{"tid":15,"created_ino":"0x0"},{"tid":16,"created_ino":"0x100000001f9"}],"prealloc_inos":[{"start":"0x10000000005","length":500},{"start":"0x100000001fa","length":1000}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:21:23.938 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [ { "created_ino": "0x0", "tid": 15 }, { "created_ino": "0x100000001f9", "tid": 16 } ], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3742151257, "type": "any" }, "name": { "num": 5251, "type": "client" } }, "id": 5251, "inst": "client.5251 172.21.15.160:0/3742151257", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 2, "num_leases": 0, "prealloc_inos": [ { "length": 500, "start": "0x10000000005" }, { "length": 1000, "start": "0x100000001fa" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 7, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 19.10429633843039 }, "state": "open", "uptime": 61.093829931 } ] 2024-09-17T05:21:23.938 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=90 retry_count=0)... 2024-09-17T05:21:28.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.054+0000 7fea65fa0640 1 -- 172.21.15.81:0/3920113598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c004d40 msgr2=0x7fea4c0051a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.054+0000 7fea65fa0640 1 --2- 172.21.15.81:0/3920113598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea4c004d40 0x7fea4c0051a0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fea600d1ed0 tx=0x7fea4c005830 comp rx=0 tx=0).stop 2024-09-17T05:21:29.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.054+0000 7fea5ffff640 1 -- 172.21.15.81:0/3920113598 reap_dead start 2024-09-17T05:21:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.054+0000 7fea65fa0640 1 -- 172.21.15.81:0/3920113598 shutdown_connections 2024-09-17T05:21:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.054+0000 7fea65fa0640 1 -- 172.21.15.81:0/3920113598 >> 172.21.15.81:0/3920113598 conn(0x7fea600d3ea0 msgr2=0x7fea600d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.054+0000 7fea65fa0640 1 -- 172.21.15.81:0/3920113598 shutdown_connections 2024-09-17T05:21:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.054+0000 7fea65fa0640 1 -- 172.21.15.81:0/3920113598 wait complete. 2024-09-17T05:21:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.055+0000 7fea65fa0640 1 Processor -- start 2024-09-17T05:21:29.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.055+0000 7fea65fa0640 1 -- start start 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea65fa0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea4c004d40 0x7fea60160f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea65fa0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea6015aa30 0x7fea60151280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea65fa0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6015a390 0x7fea600b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea65fa0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea600cf9b0 con 0x7fea6015aa30 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea65fa0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fea601626e0 con 0x7fea6015a390 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea65fa0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fea600cfb30 con 0x7fea4c004d40 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea6015aa30 0x7fea60151280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea56ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea6015aa30 0x7fea60151280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37938/0 (socket says 172.21.15.81:37938) 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea56ffd640 1 -- 172.21.15.81:0/2032083071 learned_addr learned my addr 172.21.15.81:0/2032083071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea5f7fe640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea4c004d40 0x7fea60160f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.056+0000 7fea5ffff640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6015a390 0x7fea600b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea56ffd640 1 -- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea4c004d40 msgr2=0x7fea60160f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea56ffd640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea4c004d40 0x7fea60160f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea56ffd640 1 -- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6015a390 msgr2=0x7fea600b8ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea56ffd640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6015a390 0x7fea600b8ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea56ffd640 1 -- 172.21.15.81:0/2032083071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea60161570 con 0x7fea6015aa30 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea56ffd640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea6015aa30 0x7fea60151280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fea48004ed0 tx=0x7fea480017a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea5cff9640 1 -- 172.21.15.81:0/2032083071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48015020 con 0x7fea6015aa30 2024-09-17T05:21:29.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea5cff9640 1 -- 172.21.15.81:0/2032083071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea48010980 con 0x7fea6015aa30 2024-09-17T05:21:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea60161850 con 0x7fea6015aa30 2024-09-17T05:21:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea5cff9640 1 -- 172.21.15.81:0/2032083071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea48010dd0 con 0x7fea6015aa30 2024-09-17T05:21:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.057+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea60161e10 con 0x7fea6015aa30 2024-09-17T05:21:29.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.058+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea600d3090 con 0x7fea6015aa30 2024-09-17T05:21:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.059+0000 7fea5cff9640 1 -- 172.21.15.81:0/2032083071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fea48018020 con 0x7fea6015aa30 2024-09-17T05:21:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.059+0000 7fea5cff9640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fea40078d70 0x7fea4007b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.059+0000 7fea5cff9640 1 -- 172.21.15.81:0/2032083071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fea4809bb70 con 0x7fea6015aa30 2024-09-17T05:21:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.060+0000 7fea5f7fe640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fea40078d70 0x7fea4007b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.060+0000 7fea5f7fe640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fea40078d70 0x7fea4007b230 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea50009b50 tx=0x7fea50005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:29.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.063+0000 7fea5cff9640 1 -- 172.21.15.81:0/2032083071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fea600d3090 con 0x7fea6015aa30 2024-09-17T05:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.274+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fea600b1e50 con 0x7fea6015aa30 2024-09-17T05:21:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.274+0000 7fea5cff9640 1 -- 172.21.15.81:0/2032083071 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7fea4801f020 con 0x7fea6015aa30 2024-09-17T05:21:29.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:29.276 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fea40078d70 msgr2=0x7fea4007b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fea40078d70 0x7fea4007b230 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fea50009b50 tx=0x7fea50005f90 comp rx=0 tx=0).stop 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea6015aa30 msgr2=0x7fea60151280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea6015aa30 0x7fea60151280 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fea48004ed0 tx=0x7fea480017a0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 shutdown_connections 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fea40078d70 0x7fea4007b230 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea6015a390 0x7fea600b8ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea6015aa30 0x7fea60151280 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 --2- 172.21.15.81:0/2032083071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea4c004d40 0x7fea60160f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.276+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 >> 172.21.15.81:0/2032083071 conn(0x7fea600d3ea0 msgr2=0x7fea6006e130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.277+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 shutdown_connections 2024-09-17T05:21:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.277+0000 7fea65fa0640 1 -- 172.21.15.81:0/2032083071 wait complete. 2024-09-17T05:21:29.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json session ls 2024-09-17T05:21:29.405 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-17T05:21:29.406 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T05:21:29.406 DEBUG:tasks.ceph_test_case:wait_until_true: success in 60s and 0 retries 2024-09-17T05:21:29.406 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:21:29.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:21:29.447 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:21:29.501 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:21:29.502 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:21:29.502 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:21:29.502 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:29.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:21:29.520 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:21:29.520 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:21:29.520 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:29.539 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:21:29.539 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:21:29.539 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:21:29.539 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:29.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:21:29.576 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:21:29.576 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:21:29.576 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:29.598 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:21:29.598 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:29.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.716+0000 7f2650a2b640 1 -- 172.21.15.81:0/1713181790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2638004d40 msgr2=0x7f26380051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.716+0000 7f2650a2b640 1 --2- 172.21.15.81:0/1713181790 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2638004d40 0x7f26380051c0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f263c009ed0 tx=0x7f2638005830 comp rx=0 tx=0).stop 2024-09-17T05:21:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.716+0000 7f264ad9d640 1 -- 172.21.15.81:0/1713181790 reap_dead start 2024-09-17T05:21:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.716+0000 7f2650a2b640 1 -- 172.21.15.81:0/1713181790 shutdown_connections 2024-09-17T05:21:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.716+0000 7f2650a2b640 1 -- 172.21.15.81:0/1713181790 >> 172.21.15.81:0/1713181790 conn(0x7f264c0d3ea0 msgr2=0x7f264c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.716+0000 7f2650a2b640 1 -- 172.21.15.81:0/1713181790 shutdown_connections 2024-09-17T05:21:29.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.716+0000 7f2650a2b640 1 -- 172.21.15.81:0/1713181790 wait complete. 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.717+0000 7f2650a2b640 1 Processor -- start 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.717+0000 7f2650a2b640 1 -- start start 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f2650a2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2638004d40 0x7f264c1f7710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f2650a2b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f264c160e00 0x7f264c161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f2650a2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f264c0cc0c0 0x7f264c0cc540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f2650a2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f264c162690 con 0x7f264c0cc0c0 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f2650a2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f264c0cf9b0 con 0x7f2638004d40 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f2650a2b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f264c150bb0 con 0x7f264c160e00 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f264ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f264c0cc0c0 0x7f264c0cc540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f264ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f264c0cc0c0 0x7f264c0cc540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37964/0 (socket says 172.21.15.81:37964) 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f264ad9d640 1 -- 172.21.15.81:0/1408767393 learned_addr learned my addr 172.21.15.81:0/1408767393 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f264a59c640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2638004d40 0x7f264c1f7710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.718+0000 7f2649d9b640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f264c160e00 0x7f264c161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f264ad9d640 1 -- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f264c160e00 msgr2=0x7f264c161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f264ad9d640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f264c160e00 0x7f264c161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f264ad9d640 1 -- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2638004d40 msgr2=0x7f264c1f7710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f264ad9d640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2638004d40 0x7f264c1f7710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f264ad9d640 1 -- 172.21.15.81:0/1408767393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f264c0cda50 con 0x7f264c0cc0c0 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f264ad9d640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f264c0cc0c0 0x7f264c0cc540 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f263c02af20 tx=0x7f263c033da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f2642ffd640 1 -- 172.21.15.81:0/1408767393 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c042070 con 0x7f264c0cc0c0 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f2642ffd640 1 -- 172.21.15.81:0/1408767393 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f263c003b70 con 0x7f264c0cc0c0 2024-09-17T05:21:29.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f264c1617c0 con 0x7f264c0cc0c0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f2642ffd640 1 -- 172.21.15.81:0/1408767393 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f263c038040 con 0x7f264c0cc0c0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.719+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f264c0cd120 con 0x7f264c0cc0c0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.720+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f264c0d0630 con 0x7f264c0cc0c0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.720+0000 7f2642ffd640 1 -- 172.21.15.81:0/1408767393 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f263c004030 con 0x7f264c0cc0c0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.721+0000 7f2642ffd640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f262c078d40 0x7f262c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.721+0000 7f2642ffd640 1 -- 172.21.15.81:0/1408767393 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f263c0bb440 con 0x7f264c0cc0c0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.721+0000 7f264a59c640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f262c078d40 0x7f262c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.722+0000 7f264a59c640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f262c078d40 0x7f262c07b200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f264c1f59b0 tx=0x7f2644006910 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:29.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.725+0000 7f2642ffd640 1 -- 172.21.15.81:0/1408767393 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f264c1617c0 con 0x7f264c0cc0c0 2024-09-17T05:21:29.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.937+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f264c1f5a00 con 0x7f264c0cc0c0 2024-09-17T05:21:29.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.938+0000 7f2642ffd640 1 -- 172.21.15.81:0/1408767393 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f263c082f10 con 0x7f264c0cc0c0 2024-09-17T05:21:29.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:29.939 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:29.939 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f262c078d40 msgr2=0x7f262c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f262c078d40 0x7f262c07b200 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f264c1f59b0 tx=0x7f2644006910 comp rx=0 tx=0).stop 2024-09-17T05:21:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f264c0cc0c0 msgr2=0x7f264c0cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f264c0cc0c0 0x7f264c0cc540 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f263c02af20 tx=0x7f263c033da0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 shutdown_connections 2024-09-17T05:21:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f262c078d40 0x7f262c07b200 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f264c0cc0c0 0x7f264c0cc540 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f264c160e00 0x7f264c161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 --2- 172.21.15.81:0/1408767393 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2638004d40 0x7f264c1f7710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 >> 172.21.15.81:0/1408767393 conn(0x7f264c0d3ea0 msgr2=0x7f264c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 shutdown_connections 2024-09-17T05:21:29.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:29.940+0000 7f2650a2b640 1 -- 172.21.15.81:0/1408767393 wait complete. 2024-09-17T05:21:29.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.053+0000 7f6d02e6a640 1 -- 172.21.15.81:0/1828010970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 msgr2=0x7f6ce4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.053+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/1828010970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6ce4004c80 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f6cec001eb0 tx=0x7f6ce4005830 comp rx=0 tx=0).stop 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.053+0000 7f6d02e6a640 1 -- 172.21.15.81:0/1828010970 shutdown_connections 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.053+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/1828010970 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6ce4004c80 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.053+0000 7f6d02e6a640 1 -- 172.21.15.81:0/1828010970 >> 172.21.15.81:0/1828010970 conn(0x7f6cfc0b1690 msgr2=0x7f6cfc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.053+0000 7f6d02e6a640 1 -- 172.21.15.81:0/1828010970 shutdown_connections 2024-09-17T05:21:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.053+0000 7f6d02e6a640 1 -- 172.21.15.81:0/1828010970 wait complete. 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.054+0000 7f6d02e6a640 1 Processor -- start 2024-09-17T05:21:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.054+0000 7f6d02e6a640 1 -- start start 2024-09-17T05:21:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d02e6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6cfc1f5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d02e6a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cfc1517f0 0x7f6cfc1473f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d02e6a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cfc1f7370 0x7f6cfc1f77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d02e6a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc072930 con 0x7f6ce4004800 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d02e6a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6cfc0727b0 con 0x7f6cfc1517f0 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d02e6a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6cfc072ab0 con 0x7f6cfc1f7370 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6cfc1f5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6cfc1f5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37982/0 (socket says 172.21.15.81:37982) 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 -- 172.21.15.81:0/3069341015 learned_addr learned my addr 172.21.15.81:0/3069341015 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6cf3fff640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cfc1517f0 0x7f6cfc1473f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d01407640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cfc1f7370 0x7f6cfc1f77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 -- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cfc1f7370 msgr2=0x7f6cfc1f77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cfc1f7370 0x7f6cfc1f77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 -- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cfc1517f0 msgr2=0x7f6cfc1473f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cfc1517f0 0x7f6cfc1473f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 -- 172.21.15.81:0/3069341015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6cfc1f62d0 con 0x7f6ce4004800 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d01407640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cfc1f7370 0x7f6cfc1f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.055+0000 7f6d00c06640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6cfc1f5bb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c340 tx=0x7f6cf800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.056+0000 7f6cf17fa640 1 -- 172.21.15.81:0/3069341015 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf80064e0 con 0x7f6ce4004800 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.056+0000 7f6cf17fa640 1 -- 172.21.15.81:0/3069341015 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6cf8003920 con 0x7f6ce4004800 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.056+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6cfc1f65b0 con 0x7f6ce4004800 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.056+0000 7f6cf17fa640 1 -- 172.21.15.81:0/3069341015 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cf8003d70 con 0x7f6ce4004800 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.056+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6cfc1f6b70 con 0x7f6ce4004800 2024-09-17T05:21:30.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.057+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6cfc0b2990 con 0x7f6ce4004800 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.057+0000 7f6cf17fa640 1 -- 172.21.15.81:0/3069341015 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f6cf8010480 con 0x7f6ce4004800 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.058+0000 7f6cf17fa640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6ce8078d70 0x7f6ce807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.058+0000 7f6cf17fa640 1 -- 172.21.15.81:0/3069341015 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f6cf809b980 con 0x7f6ce4004800 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.058+0000 7f6cf3fff640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6ce8078d70 0x7f6ce807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.058+0000 7f6cf3fff640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6ce8078d70 0x7f6ce807b230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6cec033000 tx=0x7f6cec001930 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.062+0000 7f6cf17fa640 1 -- 172.21.15.81:0/3069341015 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6cfc0b2990 con 0x7f6ce4004800 2024-09-17T05:21:30.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.275+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6cfc0cf140 con 0x7f6ce4004800 2024-09-17T05:21:30.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.275+0000 7f6cf17fa640 1 -- 172.21.15.81:0/3069341015 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f6cf8063a80 con 0x7f6ce4004800 2024-09-17T05:21:30.276 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:30.276 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:30.277 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:30.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6ce8078d70 msgr2=0x7f6ce807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6ce8078d70 0x7f6ce807b230 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6cec033000 tx=0x7f6cec001930 comp rx=0 tx=0).stop 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 msgr2=0x7f6cfc1f5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6cfc1f5bb0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f6cf800c340 tx=0x7f6cf800c800 comp rx=0 tx=0).stop 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 shutdown_connections 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6ce8078d70 0x7f6ce807b230 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6cfc1f7370 0x7f6cfc1f77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6cfc1517f0 0x7f6cfc1473f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 --2- 172.21.15.81:0/3069341015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ce4004800 0x7f6cfc1f5bb0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 >> 172.21.15.81:0/3069341015 conn(0x7f6cfc0b1690 msgr2=0x7f6cfc0afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 shutdown_connections 2024-09-17T05:21:30.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.277+0000 7f6d02e6a640 1 -- 172.21.15.81:0/3069341015 wait complete. 2024-09-17T05:21:30.289 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.390+0000 7fe38f6ef640 1 -- 172.21.15.81:0/4157299720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 msgr2=0x7fe37000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.390+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/4157299720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe37000b9c0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fe37800c260 tx=0x7fe370005830 comp rx=0 tx=0).stop 2024-09-17T05:21:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.390+0000 7fe38f6ef640 1 -- 172.21.15.81:0/4157299720 shutdown_connections 2024-09-17T05:21:30.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.390+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/4157299720 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe37000b9c0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.390+0000 7fe38f6ef640 1 -- 172.21.15.81:0/4157299720 >> 172.21.15.81:0/4157299720 conn(0x7fe3880b1690 msgr2=0x7fe3880b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.390+0000 7fe38f6ef640 1 -- 172.21.15.81:0/4157299720 shutdown_connections 2024-09-17T05:21:30.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.390+0000 7fe38f6ef640 1 -- 172.21.15.81:0/4157299720 wait complete. 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.391+0000 7fe38f6ef640 1 Processor -- start 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.391+0000 7fe38f6ef640 1 -- start start 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38f6ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe388156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38f6ef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe38814f700 0x7fe388159a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38f6ef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe38814fb80 0x7fe388158820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38f6ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe388073f20 con 0x7fe3700052e0 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38f6ef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe388073da0 con 0x7fe38814fb80 2024-09-17T05:21:30.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38f6ef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe3880b4690 con 0x7fe38814f700 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe388156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe388156f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38012/0 (socket says 172.21.15.81:38012) 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 -- 172.21.15.81:0/220512576 learned_addr learned my addr 172.21.15.81:0/220512576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38cc8a640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe38814f700 0x7fe388159a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38dc8c640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe38814fb80 0x7fe388158820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 -- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe38814f700 msgr2=0x7fe388159a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe38814f700 0x7fe388159a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 -- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe38814fb80 msgr2=0x7fe388158820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe38814fb80 0x7fe388158820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 -- 172.21.15.81:0/220512576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe38814c660 con 0x7fe3700052e0 2024-09-17T05:21:30.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38dc8c640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe38814fb80 0x7fe388158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.392+0000 7fe38d48b640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe388156f30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe380010a70 tx=0x7fe380010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.393+0000 7fe37dffb640 1 -- 172.21.15.81:0/220512576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe38000ee60 con 0x7fe3700052e0 2024-09-17T05:21:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.393+0000 7fe37dffb640 1 -- 172.21.15.81:0/220512576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe380004b20 con 0x7fe3700052e0 2024-09-17T05:21:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.393+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe388153cc0 con 0x7fe3700052e0 2024-09-17T05:21:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.393+0000 7fe37dffb640 1 -- 172.21.15.81:0/220512576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe380005020 con 0x7fe3700052e0 2024-09-17T05:21:30.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.393+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe38814ef00 con 0x7fe3700052e0 2024-09-17T05:21:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.394+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3880b4bf0 con 0x7fe3700052e0 2024-09-17T05:21:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.394+0000 7fe37dffb640 1 -- 172.21.15.81:0/220512576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fe38001a030 con 0x7fe3700052e0 2024-09-17T05:21:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.395+0000 7fe37dffb640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe374078d40 0x7fe37407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.395+0000 7fe37dffb640 1 -- 172.21.15.81:0/220512576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe38009bb60 con 0x7fe3700052e0 2024-09-17T05:21:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.395+0000 7fe38cc8a640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe374078d40 0x7fe37407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.396+0000 7fe38cc8a640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe374078d40 0x7fe37407b200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe38815df40 tx=0x7fe384006a20 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.399+0000 7fe37dffb640 1 -- 172.21.15.81:0/220512576 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe3800636a0 con 0x7fe3700052e0 2024-09-17T05:21:30.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.576+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe38815df70 con 0x7fe3700052e0 2024-09-17T05:21:30.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.577+0000 7fe37dffb640 1 -- 172.21.15.81:0/220512576 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16765 (secure 0 0 0) 0x7fe3800680d0 con 0x7fe3700052e0 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:30.579 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:20:28.705812+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:58.505536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:58.850270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":4}]},{"pgid":"7.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe374078d40 msgr2=0x7fe37407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe374078d40 0x7fe37407b200 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fe38815df40 tx=0x7fe384006a20 comp rx=0 tx=0).stop 2024-09-17T05:21:30.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 msgr2=0x7fe388156f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe388156f30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7fe380010a70 tx=0x7fe380010f30 comp rx=0 tx=0).stop 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 shutdown_connections 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe374078d40 0x7fe37407b200 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe38814fb80 0x7fe388158820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe38814f700 0x7fe388159a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 --2- 172.21.15.81:0/220512576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700052e0 0x7fe388156f30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 >> 172.21.15.81:0/220512576 conn(0x7fe3880b1690 msgr2=0x7fe3880ceeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 shutdown_connections 2024-09-17T05:21:30.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.580+0000 7fe38f6ef640 1 -- 172.21.15.81:0/220512576 wait complete. 2024-09-17T05:21:30.592 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:21:30.593 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 -- 172.21.15.81:0/2349580348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75580b3140 msgr2=0x7f75580cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 --2- 172.21.15.81:0/2349580348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75580b3140 0x7f75580cf470 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f7558069dc0 tx=0x7f754402b880 comp rx=0 tx=0).stop 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 -- 172.21.15.81:0/2349580348 shutdown_connections 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 --2- 172.21.15.81:0/2349580348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75580725a0 0x7f7558072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 --2- 172.21.15.81:0/2349580348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75580b3140 0x7f75580cf470 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 --2- 172.21.15.81:0/2349580348 >> v2:172.21.15.160:3300/0 conn(0x7f7558151370 0x7f75580cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 -- 172.21.15.81:0/2349580348 >> 172.21.15.81:0/2349580348 conn(0x7f75580b1690 msgr2=0x7f75580b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 -- 172.21.15.81:0/2349580348 shutdown_connections 2024-09-17T05:21:30.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.692+0000 7f755ed75640 1 -- 172.21.15.81:0/2349580348 wait complete. 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 Processor -- start 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 -- start start 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75580725a0 0x7f75581e44b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75580b3140 0x7f75581e2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558151370 0x7f7558153a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f755806ea80 con 0x7f7558151370 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f755806e900 con 0x7f75580b3140 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.694+0000 7f755ed75640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f755806ec00 con 0x7f75580725a0 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558151370 0x7f7558153a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558151370 0x7f7558153a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38036/0 (socket says 172.21.15.81:38036) 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 -- 172.21.15.81:0/3402518278 learned_addr learned my addr 172.21.15.81:0/3402518278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755cb11640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75580725a0 0x7f75581e44b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f7557fff640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75580b3140 0x7f75581e2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 -- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75580725a0 msgr2=0x7f75581e44b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75580725a0 0x7f75581e44b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 -- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75580b3140 msgr2=0x7f75581e2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75580b3140 0x7f75581e2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 -- 172.21.15.81:0/3402518278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75581e3410 con 0x7f7558151370 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755cb11640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75580725a0 0x7f75581e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f7557fff640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75580b3140 0x7f75581e2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755d312640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558151370 0x7f7558153a00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f755000e9b0 tx=0x7f755000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f75557fa640 1 -- 172.21.15.81:0/3402518278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550004d20 con 0x7f7558151370 2024-09-17T05:21:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f75557fa640 1 -- 172.21.15.81:0/3402518278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f755000cac0 con 0x7f7558151370 2024-09-17T05:21:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75581e36f0 con 0x7f7558151370 2024-09-17T05:21:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f75557fa640 1 -- 172.21.15.81:0/3402518278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7550005020 con 0x7f7558151370 2024-09-17T05:21:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.695+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75581e3cb0 con 0x7f7558151370 2024-09-17T05:21:30.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.696+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7558072a10 con 0x7f7558151370 2024-09-17T05:21:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.697+0000 7f75557fa640 1 -- 172.21.15.81:0/3402518278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f75500051c0 con 0x7f7558151370 2024-09-17T05:21:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.697+0000 7f75557fa640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f753c078d40 0x7f753c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.697+0000 7f75557fa640 1 -- 172.21.15.81:0/3402518278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f755009b9c0 con 0x7f7558151370 2024-09-17T05:21:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.697+0000 7f755cb11640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f753c078d40 0x7f753c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:30.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.698+0000 7f755cb11640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f753c078d40 0x7f753c07b200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f754c00ab40 tx=0x7f754c00a520 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:30.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.701+0000 7f75557fa640 1 -- 172.21.15.81:0/3402518278 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f755009de20 con 0x7f7558151370 2024-09-17T05:21:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.912+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f755815b6f0 con 0x7f7558151370 2024-09-17T05:21:30.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.913+0000 7f75557fa640 1 -- 172.21.15.81:0/3402518278 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f7550016030 con 0x7f7558151370 2024-09-17T05:21:30.914 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:30.914 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:30.914 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:30.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f753c078d40 msgr2=0x7f753c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f753c078d40 0x7f753c07b200 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f754c00ab40 tx=0x7f754c00a520 comp rx=0 tx=0).stop 2024-09-17T05:21:30.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558151370 msgr2=0x7f7558153a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:30.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558151370 0x7f7558153a00 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f755000e9b0 tx=0x7f755000ee70 comp rx=0 tx=0).stop 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 shutdown_connections 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f753c078d40 0x7f753c07b200 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7558151370 0x7f7558153a00 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f75580b3140 0x7f75581e2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 --2- 172.21.15.81:0/3402518278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75580725a0 0x7f75581e44b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 >> 172.21.15.81:0/3402518278 conn(0x7f75580b1690 msgr2=0x7f7558147210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 shutdown_connections 2024-09-17T05:21:30.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:30.915+0000 7f755ed75640 1 -- 172.21.15.81:0/3402518278 wait complete. 2024-09-17T05:21:30.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:31.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.026+0000 7f077852b640 1 -- 172.21.15.81:0/21752590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f075c004d40 msgr2=0x7f075c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.026+0000 7f077852b640 1 --2- 172.21.15.81:0/21752590 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f075c004d40 0x7f075c0051c0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f07700697f0 tx=0x7f075c005830 comp rx=0 tx=0).stop 2024-09-17T05:21:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.026+0000 7f0776ac8640 1 -- 172.21.15.81:0/21752590 reap_dead start 2024-09-17T05:21:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.026+0000 7f077852b640 1 -- 172.21.15.81:0/21752590 shutdown_connections 2024-09-17T05:21:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.026+0000 7f077852b640 1 -- 172.21.15.81:0/21752590 >> 172.21.15.81:0/21752590 conn(0x7f07700d1c40 msgr2=0x7f07700d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.026+0000 7f077852b640 1 -- 172.21.15.81:0/21752590 shutdown_connections 2024-09-17T05:21:31.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.026+0000 7f077852b640 1 -- 172.21.15.81:0/21752590 wait complete. 2024-09-17T05:21:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 Processor -- start 2024-09-17T05:21:31.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 -- start start 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f075c004d40 0x7f077015c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0770156030 0x7f07701f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f077014e0a0 0x7f07700caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07700cda80 con 0x7f0770156030 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f07700cd900 con 0x7f077014e0a0 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f077852b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f077015ea60 con 0x7f075c004d40 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f0775ac6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0770156030 0x7f07701f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f0775ac6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0770156030 0x7f07701f3210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38050/0 (socket says 172.21.15.81:38050) 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.028+0000 7f0775ac6640 1 -- 172.21.15.81:0/42780322 learned_addr learned my addr 172.21.15.81:0/42780322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f07762c7640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f075c004d40 0x7f077015c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0776ac8640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f077014e0a0 0x7f07700caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0775ac6640 1 -- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f075c004d40 msgr2=0x7f077015c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0775ac6640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f075c004d40 0x7f077015c110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0775ac6640 1 -- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f077014e0a0 msgr2=0x7f07700caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0775ac6640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f077014e0a0 0x7f07700caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0775ac6640 1 -- 172.21.15.81:0/42780322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f077015ed20 con 0x7f0770156030 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0776ac8640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f077014e0a0 0x7f07700caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0775ac6640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0770156030 0x7f07701f3210 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0760004d90 tx=0x7f0760001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0766ffd640 1 -- 172.21.15.81:0/42780322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07600107d0 con 0x7f0770156030 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0766ffd640 1 -- 172.21.15.81:0/42780322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0760016070 con 0x7f0770156030 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07700c8db0 con 0x7f0770156030 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f0766ffd640 1 -- 172.21.15.81:0/42780322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0760010d00 con 0x7f0770156030 2024-09-17T05:21:31.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.029+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f077015f000 con 0x7f0770156030 2024-09-17T05:21:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.030+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07700cf1f0 con 0x7f0770156030 2024-09-17T05:21:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.031+0000 7f0766ffd640 1 -- 172.21.15.81:0/42780322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f076001b460 con 0x7f0770156030 2024-09-17T05:21:31.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.031+0000 7f0766ffd640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0754078d70 0x7f075407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.031+0000 7f0766ffd640 1 -- 172.21.15.81:0/42780322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f076009b8a0 con 0x7f0770156030 2024-09-17T05:21:31.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.032+0000 7f07762c7640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0754078d70 0x7f075407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.032+0000 7f07762c7640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0754078d70 0x7f075407b230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f077015e610 tx=0x7f076c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.035+0000 7f0766ffd640 1 -- 172.21.15.81:0/42780322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f07600639a0 con 0x7f0770156030 2024-09-17T05:21:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.247+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0770072140 con 0x7f0770156030 2024-09-17T05:21:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.247+0000 7f0766ffd640 1 -- 172.21.15.81:0/42780322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+5223 (secure 0 0 0) 0x7f076009b020 con 0x7f0770156030 2024-09-17T05:21:31.249 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:31.249 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":23,"btime":"2024-09-17T05:20:13:663868+0000","default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19}],"filesystems":[{"mdsmap":{"epoch":22,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:19:59.900244+0000","modified":"2024-09-17T05:20:01.898397+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5277},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5277":{"gid":5277,"name":"a","rank":0,"incarnation":20,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1152829207","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1152829207},{"type":"v1","addr":"172.21.15.81:6835","nonce":1152829207}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5277,"qdb_cluster":[5277]},"id":3}]} 2024-09-17T05:21:31.249 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 23 2024-09-17T05:21:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0754078d70 msgr2=0x7f075407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0754078d70 0x7f075407b230 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f077015e610 tx=0x7f076c005f90 comp rx=0 tx=0).stop 2024-09-17T05:21:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0770156030 msgr2=0x7f07701f3210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0770156030 0x7f07701f3210 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0760004d90 tx=0x7f0760001630 comp rx=0 tx=0).stop 2024-09-17T05:21:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 shutdown_connections 2024-09-17T05:21:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0754078d70 0x7f075407b230 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f077014e0a0 0x7f07700caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0770156030 0x7f07701f3210 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 --2- 172.21.15.81:0/42780322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f075c004d40 0x7f077015c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 >> 172.21.15.81:0/42780322 conn(0x7f07700d1c40 msgr2=0x7f07700af510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 shutdown_connections 2024-09-17T05:21:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.250+0000 7f077852b640 1 -- 172.21.15.81:0/42780322 wait complete. 2024-09-17T05:21:31.262 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.362+0000 7fe157fa0640 1 -- 172.21.15.81:0/2291781662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 msgr2=0x7fe15015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.363+0000 7fe157fa0640 1 --2- 172.21.15.81:0/2291781662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe15015d270 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fe14c005fd0 tx=0x7fe14c02a530 comp rx=0 tx=0).stop 2024-09-17T05:21:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.363+0000 7fe157fa0640 1 -- 172.21.15.81:0/2291781662 shutdown_connections 2024-09-17T05:21:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.363+0000 7fe157fa0640 1 --2- 172.21.15.81:0/2291781662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1500cc490 0x7fe15015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.363+0000 7fe157fa0640 1 --2- 172.21.15.81:0/2291781662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe15015d270 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.363+0000 7fe157fa0640 1 -- 172.21.15.81:0/2291781662 >> 172.21.15.81:0/2291781662 conn(0x7fe1500b1690 msgr2=0x7fe1500b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.363+0000 7fe157fa0640 1 -- 172.21.15.81:0/2291781662 shutdown_connections 2024-09-17T05:21:31.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.363+0000 7fe157fa0640 1 -- 172.21.15.81:0/2291781662 wait complete. 2024-09-17T05:21:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.364+0000 7fe157fa0640 1 Processor -- start 2024-09-17T05:21:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.364+0000 7fe157fa0640 1 -- start start 2024-09-17T05:21:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.364+0000 7fe157fa0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1500cc490 0x7fe1501573a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.364+0000 7fe157fa0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1500cc8d0 0x7fe1500ad0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.364+0000 7fe157fa0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe1500ad5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe157fa0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe1500cf350 con 0x7fe150159680 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe157fa0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe1500cf1d0 con 0x7fe1500cc8d0 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe157fa0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe1500cf4d0 con 0x7fe1500cc490 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe1500ad5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe1500ad5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38062/0 (socket says 172.21.15.81:38062) 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 -- 172.21.15.81:0/1299159089 learned_addr learned my addr 172.21.15.81:0/1299159089 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe155d3c640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1500cc490 0x7fe1501573a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15553b640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1500cc8d0 0x7fe1500ad0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 -- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1500cc490 msgr2=0x7fe1501573a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1500cc490 0x7fe1501573a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 -- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1500cc8d0 msgr2=0x7fe1500ad0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1500cc8d0 0x7fe1500ad0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 -- 172.21.15.81:0/1299159089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe150148010 con 0x7fe150159680 2024-09-17T05:21:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe15653d640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe1500ad5f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c7b0 tx=0x7fe14800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe1467fc640 1 -- 172.21.15.81:0/1299159089 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe148004b60 con 0x7fe150159680 2024-09-17T05:21:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe1467fc640 1 -- 172.21.15.81:0/1299159089 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe148004df0 con 0x7fe150159680 2024-09-17T05:21:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1501f3210 con 0x7fe150159680 2024-09-17T05:21:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe1467fc640 1 -- 172.21.15.81:0/1299159089 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe14800aa90 con 0x7fe150159680 2024-09-17T05:21:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.365+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe150148580 con 0x7fe150159680 2024-09-17T05:21:31.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.366+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe15015fe00 con 0x7fe150159680 2024-09-17T05:21:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.367+0000 7fe1467fc640 1 -- 172.21.15.81:0/1299159089 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fe14800ac30 con 0x7fe150159680 2024-09-17T05:21:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.367+0000 7fe1467fc640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe134078d40 0x7fe13407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.368+0000 7fe1467fc640 1 -- 172.21.15.81:0/1299159089 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7fe14809b250 con 0x7fe150159680 2024-09-17T05:21:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.368+0000 7fe155d3c640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe134078d40 0x7fe13407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.368+0000 7fe155d3c640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe134078d40 0x7fe13407b200 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe14c033000 tx=0x7fe14c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.372+0000 7fe1467fc640 1 -- 172.21.15.81:0/1299159089 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe148020070 con 0x7fe150159680 2024-09-17T05:21:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.550+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe1500cee40 con 0x7fe150159680 2024-09-17T05:21:31.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.551+0000 7fe1467fc640 1 -- 172.21.15.81:0/1299159089 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) ==== 74+0+16765 (secure 0 0 0) 0x7fe148062d90 con 0x7fe150159680 2024-09-17T05:21:31.552 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:31.552 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":47,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:20:28.705812+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:19:58.505536+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"44","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2024-09-17T05:19:58.850270+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"45","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.35","mappings":[{"from":0,"to":4}]},{"pgid":"7.36","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe134078d40 msgr2=0x7fe13407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe134078d40 0x7fe13407b200 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fe14c033000 tx=0x7fe14c004730 comp rx=0 tx=0).stop 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 msgr2=0x7fe1500ad5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe1500ad5f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7fe14800c7b0 tx=0x7fe14800cc70 comp rx=0 tx=0).stop 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 shutdown_connections 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe134078d40 0x7fe13407b200 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe150159680 0x7fe1500ad5f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1500cc8d0 0x7fe1500ad0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 --2- 172.21.15.81:0/1299159089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1500cc490 0x7fe1501573a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 >> 172.21.15.81:0/1299159089 conn(0x7fe1500b1690 msgr2=0x7fe150159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 shutdown_connections 2024-09-17T05:21:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.553+0000 7fe157fa0640 1 -- 172.21.15.81:0/1299159089 wait complete. 2024-09-17T05:21:31.568 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 -- 172.21.15.81:0/784793326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c15df90 msgr2=0x7f2f2c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 --2- 172.21.15.81:0/784793326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c15df90 0x7f2f2c0cf9b0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f2f2c0b9f20 tx=0x7f2f1c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 -- 172.21.15.81:0/784793326 shutdown_connections 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 --2- 172.21.15.81:0/784793326 >> v2:172.21.15.160:3300/0 conn(0x7f2f2c0d0d40 0x7f2f2c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 --2- 172.21.15.81:0/784793326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c15df90 0x7f2f2c0cf9b0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 -- 172.21.15.81:0/784793326 >> 172.21.15.81:0/784793326 conn(0x7f2f2c0d3ea0 msgr2=0x7f2f2c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 -- 172.21.15.81:0/784793326 shutdown_connections 2024-09-17T05:21:31.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.669+0000 7f2f343b4640 1 -- 172.21.15.81:0/784793326 wait complete. 2024-09-17T05:21:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.670+0000 7f2f343b4640 1 Processor -- start 2024-09-17T05:21:31.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.670+0000 7f2f343b4640 1 -- start start 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f343b4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f2c0d0d40 0x7f2f2c0a1680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f343b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c0d49c0 0x7f2f2c0b92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f343b4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f2c15df90 0x7f2f2c14dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f343b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c162690 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f343b4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2f2c0b3d40 con 0x7f2f2c15df90 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f343b4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2f2c0a1bc0 con 0x7f2f2c0d0d40 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f3194f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c0d49c0 0x7f2f2c0b92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f3194f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c0d49c0 0x7f2f2c0b92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38082/0 (socket says 172.21.15.81:38082) 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.671+0000 7f2f3194f640 1 -- 172.21.15.81:0/1661694054 learned_addr learned my addr 172.21.15.81:0/1661694054 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f32150640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f2c0d0d40 0x7f2f2c0a1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f32951640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f2c15df90 0x7f2f2c14dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f3194f640 1 -- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f2c0d0d40 msgr2=0x7f2f2c0a1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f3194f640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f2c0d0d40 0x7f2f2c0a1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f3194f640 1 -- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f2c15df90 msgr2=0x7f2f2c14dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f3194f640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f2c15df90 0x7f2f2c14dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f3194f640 1 -- 172.21.15.81:0/1661694054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2c0b9800 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f3194f640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c0d49c0 0x7f2f2c0b92c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000c440 tx=0x7f2f2000c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f2affd640 1 -- 172.21.15.81:0/1661694054 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20017070 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f2affd640 1 -- 172.21.15.81:0/1661694054 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2f200035f0 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2c0b8220 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f2affd640 1 -- 172.21.15.81:0/1661694054 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f20003a40 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.672+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f2c0b87e0 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.673+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f2c0b5440 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.674+0000 7f2f2affd640 1 -- 172.21.15.81:0/1661694054 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f2f2001a070 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.674+0000 7f2f2affd640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f18078d40 0x7f2f1807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.674+0000 7f2f2affd640 1 -- 172.21.15.81:0/1661694054 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5767+0+0 (secure 0 0 0) 0x7f2f2009a500 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.674+0000 7f2f32150640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f18078d40 0x7f2f1807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:31.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.675+0000 7f2f32150640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f18078d40 0x7f2f1807b200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c035000 tx=0x7f2f1c004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:31.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.678+0000 7f2f2affd640 1 -- 172.21.15.81:0/1661694054 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2f20062600 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.890+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f2f2c08d590 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.891 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:21:31.890+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:21:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.892+0000 7f2f2affd640 1 -- 172.21.15.81:0/1661694054 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v24) ==== 161+0+0 (secure 0 0 0) 0x7f2f200010c0 con 0x7f2f2c0d49c0 2024-09-17T05:21:31.892 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:21:31.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f18078d40 msgr2=0x7f2f1807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f18078d40 0x7f2f1807b200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c035000 tx=0x7f2f1c004ab0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c0d49c0 msgr2=0x7f2f2c0b92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c0d49c0 0x7f2f2c0b92c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f2f2000c440 tx=0x7f2f2000c900 comp rx=0 tx=0).stop 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 shutdown_connections 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2f18078d40 0x7f2f1807b200 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2f2c15df90 0x7f2f2c14dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2f2c0d49c0 0x7f2f2c0b92c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 --2- 172.21.15.81:0/1661694054 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2f2c0d0d40 0x7f2f2c0a1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.894+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 >> 172.21.15.81:0/1661694054 conn(0x7f2f2c0d3ea0 msgr2=0x7f2f2c06e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.895+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 shutdown_connections 2024-09-17T05:21:31.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:31.895+0000 7f2f343b4640 1 -- 172.21.15.81:0/1661694054 wait complete. 2024-09-17T05:21:31.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:21:31.939 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:21:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 -- 172.21.15.81:0/3684610313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0b3de0 msgr2=0x7f823c0b4270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 --2- 172.21.15.81:0/3684610313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0b3de0 0x7f823c0b4270 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f8234005fd0 tx=0x7f823402a820 comp rx=0 tx=0).stop 2024-09-17T05:21:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 -- 172.21.15.81:0/3684610313 shutdown_connections 2024-09-17T05:21:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 --2- 172.21.15.81:0/3684610313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0b3de0 0x7f823c0b4270 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 --2- 172.21.15.81:0/3684610313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f823c0d01b0 0x7f823c0d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 -- 172.21.15.81:0/3684610313 >> 172.21.15.81:0/3684610313 conn(0x7f823c0d3e30 msgr2=0x7f823c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 -- 172.21.15.81:0/3684610313 shutdown_connections 2024-09-17T05:21:32.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.016+0000 7f8241c7f640 1 -- 172.21.15.81:0/3684610313 wait complete. 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.017+0000 7f8241c7f640 1 Processor -- start 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.017+0000 7f8241c7f640 1 -- start start 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f8241c7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f823c0b3de0 0x7f823c15c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f8241c7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0d01b0 0x7f823c150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f8241c7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823c1617f0 0x7f823c0ccf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f8241c7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0b4930 con 0x7f823c1617f0 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f8241c7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f823c0b47b0 con 0x7f823c0d01b0 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f8241c7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f823c0b4ab0 con 0x7f823c0b3de0 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823c1617f0 0x7f823c0ccf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823c1617f0 0x7f823c0ccf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38112/0 (socket says 172.21.15.81:38112) 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 -- 172.21.15.81:0/1492685694 learned_addr learned my addr 172.21.15.81:0/1492685694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823affd640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0d01b0 0x7f823c150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823b7fe640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f823c0b3de0 0x7f823c15c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 -- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f823c0b3de0 msgr2=0x7f823c15c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f823c0b3de0 0x7f823c15c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 -- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0d01b0 msgr2=0x7f823c150290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0d01b0 0x7f823c150290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.018+0000 7f823bfff640 1 -- 172.21.15.81:0/1492685694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f823c15c740 con 0x7f823c1617f0 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.019+0000 7f823bfff640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823c1617f0 0x7f823c0ccf50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8234035040 tx=0x7f8234032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.019+0000 7f8223fff640 1 -- 172.21.15.81:0/1492685694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234037040 con 0x7f823c1617f0 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.019+0000 7f8223fff640 1 -- 172.21.15.81:0/1492685694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8234004040 con 0x7f823c1617f0 2024-09-17T05:21:32.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.019+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f823c15ca20 con 0x7f823c1617f0 2024-09-17T05:21:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.019+0000 7f8223fff640 1 -- 172.21.15.81:0/1492685694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8234003e60 con 0x7f823c1617f0 2024-09-17T05:21:32.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.019+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f823c15cfe0 con 0x7f823c1617f0 2024-09-17T05:21:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.020+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f823c06c540 con 0x7f823c1617f0 2024-09-17T05:21:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.020+0000 7f8223fff640 1 -- 172.21.15.81:0/1492685694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f8234044020 con 0x7f823c1617f0 2024-09-17T05:21:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.021+0000 7f8223fff640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8228078d40 0x7f822807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.021+0000 7f8223fff640 1 -- 172.21.15.81:0/1492685694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7f82340bb650 con 0x7f823c1617f0 2024-09-17T05:21:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.021+0000 7f823b7fe640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8228078d40 0x7f822807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:32.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.022+0000 7f823b7fe640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8228078d40 0x7f822807b200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f822c001720 tx=0x7f822c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:32.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.025+0000 7f8223fff640 1 -- 172.21.15.81:0/1492685694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f823c06c540 con 0x7f823c1617f0 2024-09-17T05:21:32.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.237+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f823c0b5040 con 0x7f823c1617f0 2024-09-17T05:21:32.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.893+0000 7f8223fff640 1 -- 172.21.15.81:0/1492685694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v25) ==== 104+0+0 (secure 0 0 0) 0x7f8234083710 con 0x7f823c1617f0 2024-09-17T05:21:32.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8228078d40 msgr2=0x7f822807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8228078d40 0x7f822807b200 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f822c001720 tx=0x7f822c009040 comp rx=0 tx=0).stop 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823c1617f0 msgr2=0x7f823c0ccf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823c1617f0 0x7f823c0ccf50 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f8234035040 tx=0x7f8234032c90 comp rx=0 tx=0).stop 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 shutdown_connections 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8228078d40 0x7f822807b200 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f823c1617f0 0x7f823c0ccf50 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f823c0d01b0 0x7f823c150290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 --2- 172.21.15.81:0/1492685694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f823c0b3de0 0x7f823c15c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.896+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 >> 172.21.15.81:0/1492685694 conn(0x7f823c0d3e30 msgr2=0x7f823c0d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.897+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 shutdown_connections 2024-09-17T05:21:32.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:32.897+0000 7f8241c7f640 1 -- 172.21.15.81:0/1492685694 wait complete. 2024-09-17T05:21:32.910 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/3220024147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 msgr2=0x7fb2cc070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/3220024147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc070180 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fb2cc0b4da0 tx=0x7fb2bc02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/3220024147 shutdown_connections 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/3220024147 >> v2:172.21.15.160:3300/0 conn(0x7fb2cc0aec50 0x7fb2cc072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/3220024147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc070180 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/3220024147 >> 172.21.15.81:0/3220024147 conn(0x7fb2cc0b1620 msgr2=0x7fb2cc0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/3220024147 shutdown_connections 2024-09-17T05:21:33.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.057+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/3220024147 wait complete. 2024-09-17T05:21:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.058+0000 7fb2d3d0e640 1 Processor -- start 2024-09-17T05:21:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.058+0000 7fb2d3d0e640 1 -- start start 2024-09-17T05:21:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d3d0e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2cc0ae690 0x7fb2cc13edd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d3d0e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2cc0aec50 0x7fb2cc0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d3d0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc1f7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:33.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d3d0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc0b35f0 con 0x7fb2cc15d610 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d3d0e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb2cc072f50 con 0x7fb2cc0aec50 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d3d0e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb2cc149220 con 0x7fb2cc0ae690 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc1f7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc1f7d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:38122/0 (socket says 172.21.15.81:38122) 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 -- 172.21.15.81:0/1103095389 learned_addr learned my addr 172.21.15.81:0/1103095389 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d12a9640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2cc0aec50 0x7fb2cc0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 -- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2cc0ae690 msgr2=0x7fb2cc13edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d1aaa640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2cc0ae690 0x7fb2cc13edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:33.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2cc0ae690 0x7fb2cc13edd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 -- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2cc0aec50 msgr2=0x7fb2cc0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2cc0aec50 0x7fb2cc0afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 -- 172.21.15.81:0/1103095389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2cc148c10 con 0x7fb2cc15d610 2024-09-17T05:21:33.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d12a9640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2cc0aec50 0x7fb2cc0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:33.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.059+0000 7fb2d22ab640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc1f7d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c3f0 tx=0x7fb2c400c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:33.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.060+0000 7fb2ca7fc640 1 -- 172.21.15.81:0/1103095389 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011790 con 0x7fb2cc15d610 2024-09-17T05:21:33.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.060+0000 7fb2ca7fc640 1 -- 172.21.15.81:0/1103095389 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2c4017070 con 0x7fb2cc15d610 2024-09-17T05:21:33.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.060+0000 7fb2ca7fc640 1 -- 172.21.15.81:0/1103095389 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2c4011cc0 con 0x7fb2cc15d610 2024-09-17T05:21:33.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.060+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2cc0b05a0 con 0x7fb2cc15d610 2024-09-17T05:21:33.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.060+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2cc148eb0 con 0x7fb2cc15d610 2024-09-17T05:21:33.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.061+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2cc072a10 con 0x7fb2cc15d610 2024-09-17T05:21:33.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.061+0000 7fb2ca7fc640 1 -- 172.21.15.81:0/1103095389 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fb2c401c460 con 0x7fb2cc15d610 2024-09-17T05:21:33.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.062+0000 7fb2ca7fc640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2b8078d40 0x7fb2b807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:33.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.062+0000 7fb2ca7fc640 1 -- 172.21.15.81:0/1103095389 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(48..48 src has 1..48) ==== 5853+0+0 (secure 0 0 0) 0x7fb2c409aed0 con 0x7fb2cc15d610 2024-09-17T05:21:33.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.062+0000 7fb2d1aaa640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2b8078d40 0x7fb2b807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:33.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.062+0000 7fb2d1aaa640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2b8078d40 0x7fb2b807b200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc034000 tx=0x7fb2bc004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:33.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.066+0000 7fb2ca7fc640 1 -- 172.21.15.81:0/1103095389 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb2c4063010 con 0x7fb2cc15d610 2024-09-17T05:21:33.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.238+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fb2cc0b2ab0 con 0x7fb2cc15d610 2024-09-17T05:21:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.902+0000 7fb2ca7fc640 1 -- 172.21.15.81:0/1103095389 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v49) ==== 181+0+0 (secure 0 0 0) 0x7fb2c4062910 con 0x7fb2cc15d610 2024-09-17T05:21:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:21:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2b8078d40 msgr2=0x7fb2b807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2b8078d40 0x7fb2b807b200 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc034000 tx=0x7fb2bc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 msgr2=0x7fb2cc1f7d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc1f7d90 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb2c400c3f0 tx=0x7fb2c400c8b0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 shutdown_connections 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2b8078d40 0x7fb2b807b200 secure :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fb2bc034000 tx=0x7fb2bc004ab0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2cc15d610 0x7fb2cc1f7d90 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2cc0aec50 0x7fb2cc0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 --2- 172.21.15.81:0/1103095389 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2cc0ae690 0x7fb2cc13edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.905+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 >> 172.21.15.81:0/1103095389 conn(0x7fb2cc0b1620 msgr2=0x7fb2cc14ad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.906+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 shutdown_connections 2024-09-17T05:21:33.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:33.906+0000 7fb2d3d0e640 1 -- 172.21.15.81:0/1103095389 wait complete. 2024-09-17T05:21:33.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 -- 172.21.15.81:0/894877384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580d25b0 msgr2=0x7f03580b73e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 --2- 172.21.15.81:0/894877384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580d25b0 0x7f03580b73e0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f0350005fd0 tx=0x7f035002aa90 comp rx=0 tx=0).stop 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 -- 172.21.15.81:0/894877384 shutdown_connections 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 --2- 172.21.15.81:0/894877384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03580d25b0 0x7f03580b73e0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 --2- 172.21.15.81:0/894877384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03581616e0 0x7f03580d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 -- 172.21.15.81:0/894877384 >> 172.21.15.81:0/894877384 conn(0x7f03580d3e20 msgr2=0x7f03580d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 -- 172.21.15.81:0/894877384 shutdown_connections 2024-09-17T05:21:34.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.024+0000 7f035e27f640 1 -- 172.21.15.81:0/894877384 wait complete. 2024-09-17T05:21:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.025+0000 7f035e27f640 1 Processor -- start 2024-09-17T05:21:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035e27f640 1 -- start start 2024-09-17T05:21:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035e27f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03580d25b0 0x7f03581f7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:34.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035e27f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0358161300 0x7f03580cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035e27f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03581616e0 0x7f03580cce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035e27f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03580b7cb0 con 0x7f03581616e0 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035e27f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f03580b7b30 con 0x7f03580d25b0 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035e27f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f03580b7e30 con 0x7f0358161300 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035c81c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03581616e0 0x7f03580cce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035c81c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03581616e0 0x7f03580cce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59346/0 (socket says 172.21.15.81:59346) 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f035c81c640 1 -- 172.21.15.81:0/658768853 learned_addr learned my addr 172.21.15.81:0/658768853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f03577fe640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0358161300 0x7f03580cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.026+0000 7f0357fff640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03580d25b0 0x7f03581f7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035c81c640 1 -- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0358161300 msgr2=0x7f03580cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035c81c640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0358161300 0x7f03580cc950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035c81c640 1 -- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03580d25b0 msgr2=0x7f03581f7c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035c81c640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03580d25b0 0x7f03581f7c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035c81c640 1 -- 172.21.15.81:0/658768853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03580cd4c0 con 0x7f03581616e0 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035c81c640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03581616e0 0x7f03580cce90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f0350003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f0354ff9640 1 -- 172.21.15.81:0/658768853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350046070 con 0x7f03581616e0 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f0354ff9640 1 -- 172.21.15.81:0/658768853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0350004250 con 0x7f03581616e0 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03580cd7a0 con 0x7f03581616e0 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f0354ff9640 1 -- 172.21.15.81:0/658768853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0350004660 con 0x7f03581616e0 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.027+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0358149480 con 0x7f03581616e0 2024-09-17T05:21:34.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.028+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0358148f90 con 0x7f03581616e0 2024-09-17T05:21:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.029+0000 7f0354ff9640 1 -- 172.21.15.81:0/658768853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f0350049070 con 0x7f03581616e0 2024-09-17T05:21:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.029+0000 7f0354ff9640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0344078d40 0x7f034407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.029+0000 7f0354ff9640 1 -- 172.21.15.81:0/658768853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(49..49 src has 1..49) ==== 5415+0+0 (secure 0 0 0) 0x7f03500bbd70 con 0x7f03581616e0 2024-09-17T05:21:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.029+0000 7f0357fff640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0344078d40 0x7f034407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.030+0000 7f0357fff640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0344078d40 0x7f034407b200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0348004f60 tx=0x7f0348007e30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:34.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.033+0000 7f0354ff9640 1 -- 172.21.15.81:0/658768853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0350032030 con 0x7f03581616e0 2024-09-17T05:21:34.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.208+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f03580b73e0 con 0x7f03581616e0 2024-09-17T05:21:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.909+0000 7f0354ff9640 1 -- 172.21.15.81:0/658768853 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v50) ==== 169+0+0 (secure 0 0 0) 0x7f0350083ac0 con 0x7f03581616e0 2024-09-17T05:21:34.911 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:21:34.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0344078d40 msgr2=0x7f034407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0344078d40 0x7f034407b200 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f0348004f60 tx=0x7f0348007e30 comp rx=0 tx=0).stop 2024-09-17T05:21:34.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03581616e0 msgr2=0x7f03580cce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:34.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03581616e0 0x7f03580cce90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f0350009d90 tx=0x7f0350003ce0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 shutdown_connections 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0344078d40 0x7f034407b200 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03581616e0 0x7f03580cce90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0358161300 0x7f03580cc950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 --2- 172.21.15.81:0/658768853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03580d25b0 0x7f03581f7c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 >> 172.21.15.81:0/658768853 conn(0x7f03580d3e20 msgr2=0x7f03580b8300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 shutdown_connections 2024-09-17T05:21:34.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:34.912+0000 7f035e27f640 1 -- 172.21.15.81:0/658768853 wait complete. 2024-09-17T05:21:34.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 -- 172.21.15.81:0/1437251006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b040d0d40 msgr2=0x7f0b040b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 --2- 172.21.15.81:0/1437251006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b040d0d40 0x7f0b040b3800 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f0afc009830 tx=0x7f0afc02a510 comp rx=0 tx=0).stop 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 -- 172.21.15.81:0/1437251006 shutdown_connections 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 --2- 172.21.15.81:0/1437251006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b040d0d40 0x7f0b040b3800 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 --2- 172.21.15.81:0/1437251006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b0415df90 0x7f0b040cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 -- 172.21.15.81:0/1437251006 >> 172.21.15.81:0/1437251006 conn(0x7f0b040d3ea0 msgr2=0x7f0b040d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 -- 172.21.15.81:0/1437251006 shutdown_connections 2024-09-17T05:21:35.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.028+0000 7f0b0a070640 1 -- 172.21.15.81:0/1437251006 wait complete. 2024-09-17T05:21:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 Processor -- start 2024-09-17T05:21:35.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 -- start start 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b040d0d40 0x7f0b040b2040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b040d49c0 0x7f0b041601a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b0415df90 0x7f0b041606e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0b040b3d40 con 0x7f0b040d49c0 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0b04162710 con 0x7f0b0415df90 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.030+0000 7f0b0a070640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0b040b3ec0 con 0x7f0b040d0d40 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b040d49c0 0x7f0b041601a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b040d49c0 0x7f0b041601a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59348/0 (socket says 172.21.15.81:59348) 2024-09-17T05:21:35.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 -- 172.21.15.81:0/2570429847 learned_addr learned my addr 172.21.15.81:0/2570429847 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b037fe640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b040d0d40 0x7f0b040b2040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b03fff640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b0415df90 0x7f0b041606e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 -- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b040d0d40 msgr2=0x7f0b040b2040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b040d0d40 0x7f0b040b2040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 -- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b0415df90 msgr2=0x7f0b041606e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b0415df90 0x7f0b041606e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 -- 172.21.15.81:0/2570429847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b04161590 con 0x7f0b040d49c0 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b02ffd640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b040d49c0 0x7f0b041601a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c450 tx=0x7f0af800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0aebfff640 1 -- 172.21.15.81:0/2570429847 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af80052d0 con 0x7f0b040d49c0 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0aebfff640 1 -- 172.21.15.81:0/2570429847 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0af8005470 con 0x7f0b040d49c0 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b04160cf0 con 0x7f0b040d49c0 2024-09-17T05:21:35.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0aebfff640 1 -- 172.21.15.81:0/2570429847 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0af8012870 con 0x7f0b040d49c0 2024-09-17T05:21:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.031+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b041612b0 con 0x7f0b040d49c0 2024-09-17T05:21:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.032+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b040b5530 con 0x7f0b040d49c0 2024-09-17T05:21:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.033+0000 7f0aebfff640 1 -- 172.21.15.81:0/2570429847 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f0af80035f0 con 0x7f0b040d49c0 2024-09-17T05:21:35.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.033+0000 7f0aebfff640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0af0078d40 0x7f0af007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.034+0000 7f0aebfff640 1 -- 172.21.15.81:0/2570429847 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f0af809a7a0 con 0x7f0b040d49c0 2024-09-17T05:21:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.034+0000 7f0b037fe640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0af0078d40 0x7f0af007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.034+0000 7f0b037fe640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0af0078d40 0x7f0af007b200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009a60 tx=0x7f0af4010040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:35.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.038+0000 7f0aebfff640 1 -- 172.21.15.81:0/2570429847 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0b040ce970 con 0x7f0b040d49c0 2024-09-17T05:21:35.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.215+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f0b0408d590 con 0x7f0b040d49c0 2024-09-17T05:21:35.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.218+0000 7f0aebfff640 1 -- 172.21.15.81:0/2570429847 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v31) ==== 71+0+0 (secure 0 0 0) 0x7f0af8062620 con 0x7f0b040d49c0 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0af0078d40 msgr2=0x7f0af007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0af0078d40 0x7f0af007b200 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f0af4009a60 tx=0x7f0af4010040 comp rx=0 tx=0).stop 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b040d49c0 msgr2=0x7f0b041601a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b040d49c0 0x7f0b041601a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f0af800c450 tx=0x7f0af800c910 comp rx=0 tx=0).stop 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 shutdown_connections 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0af0078d40 0x7f0af007b200 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0b0415df90 0x7f0b041606e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0b040d49c0 0x7f0b041601a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 --2- 172.21.15.81:0/2570429847 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0b040d0d40 0x7f0b040b2040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 >> 172.21.15.81:0/2570429847 conn(0x7f0b040d3ea0 msgr2=0x7f0b040b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 shutdown_connections 2024-09-17T05:21:35.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.221+0000 7f0b0a070640 1 -- 172.21.15.81:0/2570429847 wait complete. 2024-09-17T05:21:35.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration' 2024-09-17T05:21:35.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.332+0000 7fb311eb0640 1 -- 172.21.15.81:0/3618043902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 msgr2=0x7fb30c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.332+0000 7fb311eb0640 1 --2- 172.21.15.81:0/3618043902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0cf9b0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0b9f50 tx=0x7fb30402a4f0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.332+0000 7fb311eb0640 1 -- 172.21.15.81:0/3618043902 shutdown_connections 2024-09-17T05:21:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.332+0000 7fb311eb0640 1 --2- 172.21.15.81:0/3618043902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0cf9b0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.332+0000 7fb311eb0640 1 -- 172.21.15.81:0/3618043902 >> 172.21.15.81:0/3618043902 conn(0x7fb30c0d3ea0 msgr2=0x7fb30c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.332+0000 7fb311eb0640 1 -- 172.21.15.81:0/3618043902 shutdown_connections 2024-09-17T05:21:35.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.332+0000 7fb311eb0640 1 -- 172.21.15.81:0/3618043902 wait complete. 2024-09-17T05:21:35.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.333+0000 7fb311eb0640 1 Processor -- start 2024-09-17T05:21:35.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.333+0000 7fb311eb0640 1 -- start start 2024-09-17T05:21:35.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb311eb0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c0d0d40 0x7fb30c0b9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb311eb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0b7e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb311eb0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c15df90 0x7fb30c0b8390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb311eb0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c162690 con 0x7fb30c0d49c0 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb311eb0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb30c0b3f10 con 0x7fb30c0d0d40 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb311eb0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb30c14e5b0 con 0x7fb30c15df90 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb30affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0b7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb30affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0b7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59364/0 (socket says 172.21.15.81:59364) 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.334+0000 7fb30affd640 1 -- 172.21.15.81:0/2189723059 learned_addr learned my addr 172.21.15.81:0/2189723059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30bfff640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c15df90 0x7fb30c0b8390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30b7fe640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c0d0d40 0x7fb30c0b9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30affd640 1 -- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c15df90 msgr2=0x7fb30c0b8390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30affd640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c15df90 0x7fb30c0b8390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30affd640 1 -- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c0d0d40 msgr2=0x7fb30c0b9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30affd640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c0d0d40 0x7fb30c0b9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30affd640 1 -- 172.21.15.81:0/2189723059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb30c0cdcb0 con 0x7fb30c0d49c0 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30b7fe640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c0d0d40 0x7fb30c0b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb30affd640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0b7e50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb30000c730 tx=0x7fb30000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb2f3fff640 1 -- 172.21.15.81:0/2189723059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb300005070 con 0x7fb30c0d49c0 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb2f3fff640 1 -- 172.21.15.81:0/2189723059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb300005230 con 0x7fb30c0d49c0 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb30c0b97b0 con 0x7fb30c0d49c0 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb2f3fff640 1 -- 172.21.15.81:0/2189723059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb30000a640 con 0x7fb30c0d49c0 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.335+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb30c14df60 con 0x7fb30c0d49c0 2024-09-17T05:21:35.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.336+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb30c0b4490 con 0x7fb30c0d49c0 2024-09-17T05:21:35.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.337+0000 7fb2f3fff640 1 -- 172.21.15.81:0/2189723059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fb30000a7e0 con 0x7fb30c0d49c0 2024-09-17T05:21:35.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.337+0000 7fb2f3fff640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2f8078d70 0x7fb2f807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:35.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.337+0000 7fb2f3fff640 1 -- 172.21.15.81:0/2189723059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fb30009a970 con 0x7fb30c0d49c0 2024-09-17T05:21:35.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.337+0000 7fb30b7fe640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2f8078d70 0x7fb2f807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:35.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.338+0000 7fb30b7fe640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2f8078d70 0x7fb2f807b230 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc007e90 tx=0x7fb2fc0073a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:35.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.341+0000 7fb2f3fff640 1 -- 172.21.15.81:0/2189723059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb30c0b97b0 con 0x7fb30c0d49c0 2024-09-17T05:21:35.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.586+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]} v 0) -- 0x7fb30c08d590 con 0x7fb30c0d49c0 2024-09-17T05:21:35.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.911+0000 7fb2f3fff640 1 -- 172.21.15.81:0/2189723059 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_connection_expiration"]}]=0 v158) ==== 140+0+0 (secure 0 0 0) 0x7fb30c0ce970 con 0x7fb30c0d49c0 2024-09-17T05:21:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2f8078d70 msgr2=0x7fb2f807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2f8078d70 0x7fb2f807b230 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fb2fc007e90 tx=0x7fb2fc0073a0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 msgr2=0x7fb30c0b7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0b7e50 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fb30000c730 tx=0x7fb30000cbf0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 shutdown_connections 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb2f8078d70 0x7fb2f807b230 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb30c15df90 0x7fb30c0b8390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb30c0d49c0 0x7fb30c0b7e50 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 --2- 172.21.15.81:0/2189723059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb30c0d0d40 0x7fb30c0b9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 >> 172.21.15.81:0/2189723059 conn(0x7fb30c0d3ea0 msgr2=0x7fb30c0b0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 shutdown_connections 2024-09-17T05:21:35.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:35.913+0000 7fb311eb0640 1 -- 172.21.15.81:0/2189723059 wait complete. 2024-09-17T05:21:35.926 INFO:tasks.cephfs_test_runner:test_connection_expiration (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-17T05:21:35.927 INFO:tasks.cephfs_test_runner:Starting test: test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate handcrafted .meta file on legacy subvol root doesn't break the system 2024-09-17T05:21:35.927 INFO:tasks.cephfs_test_runner:test_malicious_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:21:35.928 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 -- 172.21.15.81:0/2897285228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 msgr2=0x7f04740cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 --2- 172.21.15.81:0/2897285228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740cf9e0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f047408e130 tx=0x7f046402a980 comp rx=0 tx=0).stop 2024-09-17T05:21:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 -- 172.21.15.81:0/2897285228 shutdown_connections 2024-09-17T05:21:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 --2- 172.21.15.81:0/2897285228 >> v2:172.21.15.160:3300/0 conn(0x7f04740d4960 0x7f04740d05f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 --2- 172.21.15.81:0/2897285228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740cf9e0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 -- 172.21.15.81:0/2897285228 >> 172.21.15.81:0/2897285228 conn(0x7f04740d3e40 msgr2=0x7f04740d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 -- 172.21.15.81:0/2897285228 shutdown_connections 2024-09-17T05:21:36.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.029+0000 7f0479316640 1 -- 172.21.15.81:0/2897285228 wait complete. 2024-09-17T05:21:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.030+0000 7f0479316640 1 Processor -- start 2024-09-17T05:21:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.030+0000 7f0479316640 1 -- start start 2024-09-17T05:21:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0479316640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04740d28d0 0x7f047414f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0479316640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04740d4960 0x7f04741f4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0479316640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0479316640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f04740d0ec0 con 0x7f047415df30 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0479316640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f04740d0d40 con 0x7f04740d28d0 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0479316640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f047415e3a0 con 0x7f04740d4960 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740c9720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59370/0 (socket says 172.21.15.81:59370) 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 -- 172.21.15.81:0/368141020 learned_addr learned my addr 172.21.15.81:0/368141020 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0472ffd640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04740d28d0 0x7f047414f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04727fc640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04740d4960 0x7f04741f4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 -- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04740d4960 msgr2=0x7f04741f4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04740d4960 0x7f04741f4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 -- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04740d28d0 msgr2=0x7f047414f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04740d28d0 0x7f047414f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 -- 172.21.15.81:0/368141020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04741f56d0 con 0x7f047415df30 2024-09-17T05:21:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04727fc640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04740d4960 0x7f04741f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:36.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f04737fe640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740c9720 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c3c0 tx=0x7f046c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f046b7fe640 1 -- 172.21.15.81:0/368141020 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c017070 con 0x7f047415df30 2024-09-17T05:21:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f046b7fe640 1 -- 172.21.15.81:0/368141020 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f046c0035f0 con 0x7f047415df30 2024-09-17T05:21:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f046b7fe640 1 -- 172.21.15.81:0/368141020 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f046c003a40 con 0x7f047415df30 2024-09-17T05:21:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.031+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04741f59b0 con 0x7f047415df30 2024-09-17T05:21:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.032+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04740c7870 con 0x7f047415df30 2024-09-17T05:21:36.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.032+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04740d05f0 con 0x7f047415df30 2024-09-17T05:21:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.033+0000 7f046b7fe640 1 -- 172.21.15.81:0/368141020 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f046c01a070 con 0x7f047415df30 2024-09-17T05:21:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.033+0000 7f046b7fe640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0454078d40 0x7f045407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.034+0000 7f046b7fe640 1 -- 172.21.15.81:0/368141020 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f046c09a070 con 0x7f047415df30 2024-09-17T05:21:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.034+0000 7f0472ffd640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0454078d40 0x7f045407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.034+0000 7f0472ffd640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0454078d40 0x7f045407b200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0464035000 tx=0x7f0464004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.038+0000 7f046b7fe640 1 -- 172.21.15.81:0/368141020 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f046c062540 con 0x7f047415df30 2024-09-17T05:21:36.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.215+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04740cac50 con 0x7f047415df30 2024-09-17T05:21:36.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.216+0000 7f046b7fe640 1 -- 172.21.15.81:0/368141020 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v50) ==== 74+0+13032 (secure 0 0 0) 0x7f046c061e40 con 0x7f047415df30 2024-09-17T05:21:36.217 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:36.217 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":50,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:21:34.903723+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":46,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":43,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/1152829207":"2024-09-18T05:21:31.891794+0000","172.21.15.81:6833/1152829207":"2024-09-18T05:21:31.891794+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0454078d40 msgr2=0x7f045407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0454078d40 0x7f045407b200 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f0464035000 tx=0x7f0464004ab0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 msgr2=0x7f04740c9720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740c9720 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f046c00c3c0 tx=0x7f046c00c880 comp rx=0 tx=0).stop 2024-09-17T05:21:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 shutdown_connections 2024-09-17T05:21:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0454078d40 0x7f045407b200 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f047415df30 0x7f04740c9720 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f04740d4960 0x7f04741f4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 --2- 172.21.15.81:0/368141020 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f04740d28d0 0x7f047414f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 >> 172.21.15.81:0/368141020 conn(0x7f04740d3e40 msgr2=0x7f04740b8f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 shutdown_connections 2024-09-17T05:21:36.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.219+0000 7f0479316640 1 -- 172.21.15.81:0/368141020 wait complete. 2024-09-17T05:21:36.231 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:21:36.231 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:21:36.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 -- 172.21.15.81:0/4165172030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 msgr2=0x7fd474072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 --2- 172.21.15.81:0/4165172030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd474072b50 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7fd4740ca110 tx=0x7fd47002a560 comp rx=0 tx=0).stop 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 -- 172.21.15.81:0/4165172030 shutdown_connections 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 --2- 172.21.15.81:0/4165172030 >> v2:172.21.15.160:3300/0 conn(0x7fd4740cdf50 0x7fd47415de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 --2- 172.21.15.81:0/4165172030 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd474073090 0x7fd4740cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 --2- 172.21.15.81:0/4165172030 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd474072b50 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 -- 172.21.15.81:0/4165172030 >> 172.21.15.81:0/4165172030 conn(0x7fd4740b1700 msgr2=0x7fd4740b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 -- 172.21.15.81:0/4165172030 shutdown_connections 2024-09-17T05:21:36.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.334+0000 7fd47b60f640 1 -- 172.21.15.81:0/4165172030 wait complete. 2024-09-17T05:21:36.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 Processor -- start 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 -- start start 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd474073090 0x7fd4740c9570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4740cdf50 0x7fd4741f6470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd4740c5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4740cbe50 con 0x7fd47415b380 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4740cbcd0 con 0x7fd4740cdf50 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd47b60f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd4740cc550 con 0x7fd474073090 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd479bac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd4740c5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd479bac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd4740c5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59392/0 (socket says 172.21.15.81:59392) 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.336+0000 7fd479bac640 1 -- 172.21.15.81:0/889556575 learned_addr learned my addr 172.21.15.81:0/889556575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:36.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd4793ab640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd474073090 0x7fd4740c9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd478baa640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4740cdf50 0x7fd4741f6470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd479bac640 1 -- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd474073090 msgr2=0x7fd4740c9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd479bac640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd474073090 0x7fd4740c9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd479bac640 1 -- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4740cdf50 msgr2=0x7fd4741f6470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd479bac640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4740cdf50 0x7fd4741f6470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd479bac640 1 -- 172.21.15.81:0/889556575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd4741f28d0 con 0x7fd47415b380 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd479bac640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd4740c5870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00eaa0 tx=0x7fd46c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd465ffb640 1 -- 172.21.15.81:0/889556575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c00cdb0 con 0x7fd47415b380 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd465ffb640 1 -- 172.21.15.81:0/889556575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd46c004c10 con 0x7fd47415b380 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4741f2b70 con 0x7fd47415b380 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd465ffb640 1 -- 172.21.15.81:0/889556575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd46c005020 con 0x7fd47415b380 2024-09-17T05:21:36.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.337+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4741f3130 con 0x7fd47415b380 2024-09-17T05:21:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.338+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4740ccae0 con 0x7fd47415b380 2024-09-17T05:21:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.339+0000 7fd465ffb640 1 -- 172.21.15.81:0/889556575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fd46c0051c0 con 0x7fd47415b380 2024-09-17T05:21:36.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.339+0000 7fd465ffb640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd458078d40 0x7fd45807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.339+0000 7fd465ffb640 1 -- 172.21.15.81:0/889556575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fd46c09b520 con 0x7fd47415b380 2024-09-17T05:21:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.340+0000 7fd4793ab640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd458078d40 0x7fd45807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.340+0000 7fd4793ab640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd458078d40 0x7fd45807b200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd470033000 tx=0x7fd470004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:36.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.344+0000 7fd465ffb640 1 -- 172.21.15.81:0/889556575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd46c016030 con 0x7fd47415b380 2024-09-17T05:21:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.526+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fd4740b1250 con 0x7fd47415b380 2024-09-17T05:21:36.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.526+0000 7fd465ffb640 1 -- 172.21.15.81:0/889556575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v50) ==== 93+0+10 (secure 0 0 0) 0x7fd46c063450 con 0x7fd47415b380 2024-09-17T05:21:36.528 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:21:36.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd458078d40 msgr2=0x7fd45807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd458078d40 0x7fd45807b200 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fd470033000 tx=0x7fd470004730 comp rx=0 tx=0).stop 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 msgr2=0x7fd4740c5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd4740c5870 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00eaa0 tx=0x7fd46c00ef60 comp rx=0 tx=0).stop 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 shutdown_connections 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd458078d40 0x7fd45807b200 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd47415b380 0x7fd4740c5870 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd4740cdf50 0x7fd4741f6470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 --2- 172.21.15.81:0/889556575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd474073090 0x7fd4740c9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.528+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 >> 172.21.15.81:0/889556575 conn(0x7fd4740b1700 msgr2=0x7fd47406ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.529+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 shutdown_connections 2024-09-17T05:21:36.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.529+0000 7fd47b60f640 1 -- 172.21.15.81:0/889556575 wait complete. 2024-09-17T05:21:36.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:21:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.640+0000 7f8a3918a640 1 -- 172.21.15.81:0/136920540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200051c0 msgr2=0x7f8a2000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.640+0000 7f8a3918a640 1 --2- 172.21.15.81:0/136920540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200051c0 0x7f8a2000b9c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c00c640 tx=0x7f8a20005830 comp rx=0 tx=0).stop 2024-09-17T05:21:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.640+0000 7f8a3918a640 1 -- 172.21.15.81:0/136920540 shutdown_connections 2024-09-17T05:21:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.640+0000 7f8a3918a640 1 --2- 172.21.15.81:0/136920540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a200051c0 0x7f8a2000b9c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.640+0000 7f8a3918a640 1 -- 172.21.15.81:0/136920540 >> 172.21.15.81:0/136920540 conn(0x7f8a3406cf60 msgr2=0x7f8a3406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:36.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.640+0000 7f8a3918a640 1 -- 172.21.15.81:0/136920540 shutdown_connections 2024-09-17T05:21:36.643 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.640+0000 7f8a3918a640 1 -- 172.21.15.81:0/136920540 wait complete. 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.641+0000 7f8a3918a640 1 Processor -- start 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.641+0000 7f8a3918a640 1 -- start start 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a3918a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a200051c0 0x7f8a341f0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a3918a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3414f470 0x7f8a340b1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a3918a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3414f8f0 0x7f8a3415c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a3918a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a3415f020 con 0x7f8a3414f470 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a3918a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a34073fd0 con 0x7f8a3414f8f0 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a3918a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8a3415f1a0 con 0x7f8a200051c0 2024-09-17T05:21:36.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3414f470 0x7f8a340b1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a2a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3414f470 0x7f8a340b1710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59402/0 (socket says 172.21.15.81:59402) 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a2a59c640 1 -- 172.21.15.81:0/2642709046 learned_addr learned my addr 172.21.15.81:0/2642709046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a32d9d640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a200051c0 0x7f8a341f0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.642+0000 7f8a3359e640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3414f8f0 0x7f8a3415c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2a59c640 1 -- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a200051c0 msgr2=0x7f8a341f0e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2a59c640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a200051c0 0x7f8a341f0e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2a59c640 1 -- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3414f8f0 msgr2=0x7f8a3415c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2a59c640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3414f8f0 0x7f8a3415c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2a59c640 1 -- 172.21.15.81:0/2642709046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a340b2470 con 0x7f8a3414f470 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2a59c640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3414f470 0x7f8a340b1710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c011ab0 tx=0x7f8a1c011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:36.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2bfff640 1 -- 172.21.15.81:0/2642709046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c01e070 con 0x7f8a3414f470 2024-09-17T05:21:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2bfff640 1 -- 172.21.15.81:0/2642709046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a1c00fe70 con 0x7f8a3414f470 2024-09-17T05:21:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a340b2190 con 0x7f8a3414f470 2024-09-17T05:21:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a2bfff640 1 -- 172.21.15.81:0/2642709046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a1c0042b0 con 0x7f8a3414f470 2024-09-17T05:21:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.643+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a341f0620 con 0x7f8a3414f470 2024-09-17T05:21:36.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.644+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a340b3640 con 0x7f8a3414f470 2024-09-17T05:21:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.645+0000 7f8a2bfff640 1 -- 172.21.15.81:0/2642709046 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f8a1c021070 con 0x7f8a3414f470 2024-09-17T05:21:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.645+0000 7f8a2bfff640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a14078d40 0x7f8a1407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.645+0000 7f8a2bfff640 1 -- 172.21.15.81:0/2642709046 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f8a1c09b700 con 0x7f8a3414f470 2024-09-17T05:21:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.645+0000 7f8a32d9d640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a14078d40 0x7f8a1407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:36.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.646+0000 7f8a32d9d640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a14078d40 0x7f8a1407b200 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8a34153f90 tx=0x7f8a24006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:36.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.649+0000 7f8a2bfff640 1 -- 172.21.15.81:0/2642709046 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8a1c0635a0 con 0x7f8a3414f470 2024-09-17T05:21:36.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.892+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f8a34153ce0 con 0x7f8a3414f470 2024-09-17T05:21:36.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.912+0000 7f8a2bfff640 1 -- 172.21.15.81:0/2642709046 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v159) ==== 164+0+0 (secure 0 0 0) 0x7f8a1c067fd0 con 0x7f8a3414f470 2024-09-17T05:21:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a14078d40 msgr2=0x7f8a1407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a14078d40 0x7f8a1407b200 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f8a34153f90 tx=0x7f8a24006bc0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3414f470 msgr2=0x7f8a340b1710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3414f470 0x7f8a340b1710 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f8a1c011ab0 tx=0x7f8a1c011f70 comp rx=0 tx=0).stop 2024-09-17T05:21:36.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 shutdown_connections 2024-09-17T05:21:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8a14078d40 0x7f8a1407b200 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a3414f8f0 0x7f8a3415c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a3414f470 0x7f8a340b1710 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 --2- 172.21.15.81:0/2642709046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a200051c0 0x7f8a341f0e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 >> 172.21.15.81:0/2642709046 conn(0x7f8a3406cf60 msgr2=0x7f8a3406d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 shutdown_connections 2024-09-17T05:21:36.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:36.914+0000 7f8a3918a640 1 -- 172.21.15.81:0/2642709046 wait complete. 2024-09-17T05:21:36.926 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:21:37.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 -- 172.21.15.81:0/2013280678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 msgr2=0x7fb6880739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/2013280678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880739a0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fb670009830 tx=0x7fb67002a510 comp rx=0 tx=0).stop 2024-09-17T05:21:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 -- 172.21.15.81:0/2013280678 shutdown_connections 2024-09-17T05:21:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/2013280678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880739a0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/2013280678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68815aa70 0x7fb6880b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 -- 172.21.15.81:0/2013280678 >> 172.21.15.81:0/2013280678 conn(0x7fb6880b1690 msgr2=0x7fb6880b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 -- 172.21.15.81:0/2013280678 shutdown_connections 2024-09-17T05:21:37.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.026+0000 7fb68dcb6640 1 -- 172.21.15.81:0/2013280678 wait complete. 2024-09-17T05:21:37.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.027+0000 7fb68dcb6640 1 Processor -- start 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb68dcb6640 1 -- start start 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb68dcb6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68806ff80 0x7fb6880c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb68dcb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880cb620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb68dcb6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68815aa70 0x7fb6880cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb68dcb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb6880707c0 con 0x7fb6880735a0 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb68dcb6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb688070640 con 0x7fb68815aa70 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb68dcb6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb6880cd5f0 con 0x7fb68806ff80 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb686ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880cb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb686ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880cb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59434/0 (socket says 172.21.15.81:59434) 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.028+0000 7fb686ffd640 1 -- 172.21.15.81:0/1746272984 learned_addr learned my addr 172.21.15.81:0/1746272984 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:37.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb6877fe640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68806ff80 0x7fb6880c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb687fff640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68815aa70 0x7fb6880cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb686ffd640 1 -- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68806ff80 msgr2=0x7fb6880c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb686ffd640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68806ff80 0x7fb6880c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb686ffd640 1 -- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68815aa70 msgr2=0x7fb6880cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb686ffd640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68815aa70 0x7fb6880cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb686ffd640 1 -- 172.21.15.81:0/1746272984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6880c6310 con 0x7fb6880735a0 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb687fff640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68815aa70 0x7fb6880cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb686ffd640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880cb620 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb670009950 tx=0x7fb670032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb67ffff640 1 -- 172.21.15.81:0/1746272984 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670040070 con 0x7fb6880735a0 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb67ffff640 1 -- 172.21.15.81:0/1746272984 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb670005310 con 0x7fb6880735a0 2024-09-17T05:21:37.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb67ffff640 1 -- 172.21.15.81:0/1746272984 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb670005c90 con 0x7fb6880735a0 2024-09-17T05:21:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6880c5270 con 0x7fb6880735a0 2024-09-17T05:21:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.029+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6880c5830 con 0x7fb6880735a0 2024-09-17T05:21:37.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.030+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6880739a0 con 0x7fb6880735a0 2024-09-17T05:21:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.031+0000 7fb67ffff640 1 -- 172.21.15.81:0/1746272984 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fb670039040 con 0x7fb6880735a0 2024-09-17T05:21:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.031+0000 7fb67ffff640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb668078d40 0x7fb66807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.031+0000 7fb67ffff640 1 -- 172.21.15.81:0/1746272984 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7fb6700bc120 con 0x7fb6880735a0 2024-09-17T05:21:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.031+0000 7fb6877fe640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb668078d40 0x7fb66807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.032+0000 7fb6877fe640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb668078d40 0x7fb66807b200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb678005fd0 tx=0x7fb678005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:37.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.035+0000 7fb67ffff640 1 -- 172.21.15.81:0/1746272984 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb6880c6310 con 0x7fb6880735a0 2024-09-17T05:21:37.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.211+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb6880c5fa0 con 0x7fb6880735a0 2024-09-17T05:21:37.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.212+0000 7fb67ffff640 1 -- 172.21.15.81:0/1746272984 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v31) ==== 59+0+1998 (secure 0 0 0) 0x7fb670084560 con 0x7fb6880735a0 2024-09-17T05:21:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:21:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:21:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:21:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:21:37.213 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:21:37.214 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:21:37.215 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:21:37.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb668078d40 msgr2=0x7fb66807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb668078d40 0x7fb66807b200 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fb678005fd0 tx=0x7fb678005850 comp rx=0 tx=0).stop 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 msgr2=0x7fb6880cb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880cb620 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fb670009950 tx=0x7fb670032c10 comp rx=0 tx=0).stop 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 shutdown_connections 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb668078d40 0x7fb66807b200 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb68815aa70 0x7fb6880cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb6880735a0 0x7fb6880cb620 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 --2- 172.21.15.81:0/1746272984 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb68806ff80 0x7fb6880c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 >> 172.21.15.81:0/1746272984 conn(0x7fb6880b1690 msgr2=0x7fb68815d000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 shutdown_connections 2024-09-17T05:21:37.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.214+0000 7fb68dcb6640 1 -- 172.21.15.81:0/1746272984 wait complete. 2024-09-17T05:21:37.225 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:21:37.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 -- 172.21.15.81:0/2919738602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 msgr2=0x7f8c6c0cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 --2- 172.21.15.81:0/2919738602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 0x7f8c6c0cabc0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f8c64005fd0 tx=0x7f8c6402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 -- 172.21.15.81:0/2919738602 shutdown_connections 2024-09-17T05:21:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 --2- 172.21.15.81:0/2919738602 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 0x7f8c6c0cabc0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 --2- 172.21.15.81:0/2919738602 >> v2:172.21.15.160:3300/0 conn(0x7f8c6c15b380 0x7f8c6c072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 -- 172.21.15.81:0/2919738602 >> 172.21.15.81:0/2919738602 conn(0x7f8c6c0b1700 msgr2=0x7f8c6c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 -- 172.21.15.81:0/2919738602 shutdown_connections 2024-09-17T05:21:37.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.329+0000 7f8c713d3640 1 -- 172.21.15.81:0/2919738602 wait complete. 2024-09-17T05:21:37.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 Processor -- start 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 -- start start 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c6c073090 0x7f8c6c1f80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 0x7f8c6c0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c6c15b380 0x7f8c6c0b2a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c0cb490 con 0x7f8c6c073090 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8c6c0cb310 con 0x7f8c6c15b380 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.331+0000 7f8c713d3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8c6c0cb610 con 0x7f8c6c0ce120 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c6c073090 0x7f8c6c1f80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c6c073090 0x7f8c6c1f80d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59448/0 (socket says 172.21.15.81:59448) 2024-09-17T05:21:37.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 -- 172.21.15.81:0/1343329814 learned_addr learned my addr 172.21.15.81:0/1343329814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6b7fe640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c6c15b380 0x7f8c6c0b2a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6a7fc640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 0x7f8c6c0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 -- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 msgr2=0x7f8c6c0b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 0x7f8c6c0b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 -- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c6c15b380 msgr2=0x7f8c6c0b2a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c6c15b380 0x7f8c6c0b2a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 -- 172.21.15.81:0/1343329814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c6c1f4cd0 con 0x7f8c6c073090 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c6affd640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c6c073090 0x7f8c6c1f80d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eb30 tx=0x7f8c5c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c637fe640 1 -- 172.21.15.81:0/1343329814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c010430 con 0x7f8c6c073090 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c637fe640 1 -- 172.21.15.81:0/1343329814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c5c0105d0 con 0x7f8c6c073090 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c6c1f8840 con 0x7f8c6c073090 2024-09-17T05:21:37.335 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c637fe640 1 -- 172.21.15.81:0/1343329814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c5c010a20 con 0x7f8c6c073090 2024-09-17T05:21:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.332+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c6c1f8e00 con 0x7f8c6c073090 2024-09-17T05:21:37.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.333+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c6c0cbba0 con 0x7f8c6c073090 2024-09-17T05:21:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.334+0000 7f8c637fe640 1 -- 172.21.15.81:0/1343329814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f8c5c010bc0 con 0x7f8c6c073090 2024-09-17T05:21:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.334+0000 7f8c637fe640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c4c078d40 0x7f8c4c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.334+0000 7f8c637fe640 1 -- 172.21.15.81:0/1343329814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f8c5c09ba30 con 0x7f8c6c073090 2024-09-17T05:21:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.335+0000 7f8c6a7fc640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c4c078d40 0x7f8c4c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.335+0000 7f8c6a7fc640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c4c078d40 0x7f8c4c07b200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c153750 tx=0x7f8c54009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:37.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.339+0000 7f8c637fe640 1 -- 172.21.15.81:0/1343329814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8c5c063960 con 0x7f8c6c073090 2024-09-17T05:21:37.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.517+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8c6c0b4cc0 con 0x7f8c6c073090 2024-09-17T05:21:37.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.520+0000 7f8c637fe640 1 -- 172.21.15.81:0/1343329814 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f8c5c068390 con 0x7f8c6c073090 2024-09-17T05:21:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c4c078d40 msgr2=0x7f8c4c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c4c078d40 0x7f8c4c07b200 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c153750 tx=0x7f8c54009040 comp rx=0 tx=0).stop 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c6c073090 msgr2=0x7f8c6c1f80d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c6c073090 0x7f8c6c1f80d0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f8c5c00eb30 tx=0x7f8c5c00c2d0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 shutdown_connections 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8c4c078d40 0x7f8c4c07b200 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c6c15b380 0x7f8c6c0b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c6c0ce120 0x7f8c6c0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 --2- 172.21.15.81:0/1343329814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c6c073090 0x7f8c6c1f80d0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 >> 172.21.15.81:0/1343329814 conn(0x7f8c6c0b1700 msgr2=0x7f8c6c072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 shutdown_connections 2024-09-17T05:21:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.522+0000 7f8c713d3640 1 -- 172.21.15.81:0/1343329814 wait complete. 2024-09-17T05:21:37.534 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:21:37.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:21:37.582 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:21:37.648 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:21:37.649 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:21:37.649 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:37.664 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:21:37.665 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:21:37.665 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:37.683 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:21:37.683 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:21:37.683 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:37.722 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:21:37.722 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:21:37.723 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:21:37.741 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:21:37.741 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:21:37.741 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.862+0000 7f887020c640 1 -- 172.21.15.81:0/2950867451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88680cc490 msgr2=0x7f886815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.862+0000 7f887020c640 1 --2- 172.21.15.81:0/2950867451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88680cc490 0x7f886815f750 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f886815f6b0 tx=0x7f885802a580 comp rx=0 tx=0).stop 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.863+0000 7f887020c640 1 -- 172.21.15.81:0/2950867451 shutdown_connections 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.863+0000 7f887020c640 1 --2- 172.21.15.81:0/2950867451 >> v2:172.21.15.160:3300/0 conn(0x7f88680cc900 0x7f886815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.863+0000 7f887020c640 1 --2- 172.21.15.81:0/2950867451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88680cc490 0x7f886815f750 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.863+0000 7f887020c640 1 -- 172.21.15.81:0/2950867451 >> 172.21.15.81:0/2950867451 conn(0x7f88680b1690 msgr2=0x7f88680b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.863+0000 7f887020c640 1 -- 172.21.15.81:0/2950867451 shutdown_connections 2024-09-17T05:21:37.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.863+0000 7f887020c640 1 -- 172.21.15.81:0/2950867451 wait complete. 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.864+0000 7f887020c640 1 Processor -- start 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.864+0000 7f887020c640 1 -- start start 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.864+0000 7f887020c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88680cc490 0x7f88681558d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f887020c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88680cc900 0x7f886814f640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f887020c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868159680 0x7f88681f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f887020c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88680cec40 con 0x7f8868159680 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f887020c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f88680ceac0 con 0x7f88680cc900 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f887020c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f88680cedc0 con 0x7f88680cc490 2024-09-17T05:21:37.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868159680 0x7f88681f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868159680 0x7f88681f5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59454/0 (socket says 172.21.15.81:59454) 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 -- 172.21.15.81:0/1370147637 learned_addr learned my addr 172.21.15.81:0/1370147637 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886dfa8640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88680cc490 0x7f88681558d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886d7a7640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88680cc900 0x7f886814f640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 -- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88680cc490 msgr2=0x7f88681558d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88680cc490 0x7f88681558d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 -- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88680cc900 msgr2=0x7f886814f640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88680cc900 0x7f886814f640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 -- 172.21.15.81:0/1370147637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88681522b0 con 0x7f8868159680 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886d7a7640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88680cc900 0x7f886814f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f886e7a9640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868159680 0x7f88681f5bc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f886000eaa0 tx=0x7f886000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:37.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f885e7fc640 1 -- 172.21.15.81:0/1370147637 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f886000cdb0 con 0x7f8868159680 2024-09-17T05:21:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f885e7fc640 1 -- 172.21.15.81:0/1370147637 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8860004c10 con 0x7f8868159680 2024-09-17T05:21:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f885e7fc640 1 -- 172.21.15.81:0/1370147637 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8860005020 con 0x7f8868159680 2024-09-17T05:21:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8868152590 con 0x7f8868159680 2024-09-17T05:21:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.865+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f886814fb80 con 0x7f8868159680 2024-09-17T05:21:37.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.866+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88680cf220 con 0x7f8868159680 2024-09-17T05:21:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.867+0000 7f885e7fc640 1 -- 172.21.15.81:0/1370147637 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f88600051c0 con 0x7f8868159680 2024-09-17T05:21:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.867+0000 7f885e7fc640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f884c078d40 0x7f884c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.868+0000 7f885e7fc640 1 -- 172.21.15.81:0/1370147637 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f886009b6a0 con 0x7f8868159680 2024-09-17T05:21:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.868+0000 7f886dfa8640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f884c078d40 0x7f884c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:37.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.868+0000 7f886dfa8640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f884c078d40 0x7f884c07b200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8864006fd0 tx=0x7f8864009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:37.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:37.872+0000 7f885e7fc640 1 -- 172.21.15.81:0/1370147637 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8860016030 con 0x7f8868159680 2024-09-17T05:21:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.086+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8868152760 con 0x7f8868159680 2024-09-17T05:21:38.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.087+0000 7f885e7fc640 1 -- 172.21.15.81:0/1370147637 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+3911 (secure 0 0 0) 0x7f8860063520 con 0x7f8868159680 2024-09-17T05:21:38.088 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:38.088 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":25,"btime":"2024-09-17T05:21:32:893212+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5107,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/486097284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":486097284},{"type":"v1","addr":"172.21.15.160:6837","nonce":486097284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5110,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/620750257","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":620750257},{"type":"v1","addr":"172.21.15.160:6836","nonce":620750257}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5274,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/4247199681","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":4247199681},{"type":"v1","addr":"172.21.15.81:6834","nonce":4247199681}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":19},{"gid":5679,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1438265889","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1438265889},{"type":"v1","addr":"172.21.15.81:6835","nonce":1438265889}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":25}],"filesystems":[]} 2024-09-17T05:21:38.089 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 25 2024-09-17T05:21:38.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f884c078d40 msgr2=0x7f884c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:38.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f884c078d40 0x7f884c07b200 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8864006fd0 tx=0x7f8864009060 comp rx=0 tx=0).stop 2024-09-17T05:21:38.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868159680 msgr2=0x7f88681f5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868159680 0x7f88681f5bc0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f886000eaa0 tx=0x7f886000ef60 comp rx=0 tx=0).stop 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 shutdown_connections 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f884c078d40 0x7f884c07b200 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8868159680 0x7f88681f5bc0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88680cc900 0x7f886814f640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 --2- 172.21.15.81:0/1370147637 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88680cc490 0x7f88681558d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 >> 172.21.15.81:0/1370147637 conn(0x7f88680b1690 msgr2=0x7f88680cbc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 shutdown_connections 2024-09-17T05:21:38.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.089+0000 7f887020c640 1 -- 172.21.15.81:0/1370147637 wait complete. 2024-09-17T05:21:38.102 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:21:38.102 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:21:38.102 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:21:38.102 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:21:38.102 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:21:38.102 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:21:38.103 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:21:38.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:21:38.103 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:21:38.103 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:21:38.103 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:21:38.103 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:21:38.103 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:21:38.104 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:21:38.104 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:21:38.104 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:21:38.112 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:21:38.112 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:21:38.113 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:21:38.113 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:21:38.116 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:21:38.116 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:21:38.116 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:21:38.117 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:21:38.154 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:21:38.155 DEBUG:teuthology.parallel:result is None 2024-09-17T05:21:38.155 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:21:38.155 DEBUG:teuthology.parallel:result is None 2024-09-17T05:21:38.159 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:21:38.159 DEBUG:teuthology.parallel:result is None 2024-09-17T05:21:38.160 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:21:38.160 DEBUG:teuthology.parallel:result is None 2024-09-17T05:21:38.161 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:21:38.228 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:21:38.229 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:21:38.242 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:21:38.242 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:21:38.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.267+0000 7f16b6d2b640 1 -- 172.21.15.81:0/48627873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0003a00 msgr2=0x7f16a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.267+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/48627873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0003a00 0x7f16a0003e20 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f16a400bb20 tx=0x7f16a0005830 comp rx=0 tx=0).stop 2024-09-17T05:21:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.267+0000 7f16b6d2b640 1 -- 172.21.15.81:0/48627873 shutdown_connections 2024-09-17T05:21:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.267+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/48627873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0003a00 0x7f16a0003e20 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.267+0000 7f16b6d2b640 1 -- 172.21.15.81:0/48627873 >> 172.21.15.81:0/48627873 conn(0x7f16b00d3ea0 msgr2=0x7f16b00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.267+0000 7f16b6d2b640 1 -- 172.21.15.81:0/48627873 shutdown_connections 2024-09-17T05:21:38.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.267+0000 7f16b6d2b640 1 -- 172.21.15.81:0/48627873 wait complete. 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.268+0000 7f16b6d2b640 1 Processor -- start 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.268+0000 7f16b6d2b640 1 -- start start 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b6d2b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16a0003a00 0x7f16b0148cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b6d2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b0161470 0x7f16b00ccde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b6d2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b00caf70 0x7f16b00cb420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b6d2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16b00cf9b0 con 0x7f16b0161470 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b6d2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f16b01627a0 con 0x7f16b00caf70 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b6d2b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f16b00cfb30 con 0x7f16a0003a00 2024-09-17T05:21:38.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b0161470 0x7f16b00ccde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b4ac7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16a0003a00 0x7f16b0148cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b0161470 0x7f16b00ccde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59492/0 (socket says 172.21.15.81:59492) 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16affff640 1 -- 172.21.15.81:0/2388414623 learned_addr learned my addr 172.21.15.81:0/2388414623 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.269+0000 7f16b52c8640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b00caf70 0x7f16b00cb420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16affff640 1 -- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16a0003a00 msgr2=0x7f16b0148cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16affff640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16a0003a00 0x7f16b0148cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16affff640 1 -- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b00caf70 msgr2=0x7f16b00cb420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16affff640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b00caf70 0x7f16b00cb420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16affff640 1 -- 172.21.15.81:0/2388414623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b01618d0 con 0x7f16b0161470 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16affff640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b0161470 0x7f16b00ccde0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f169c00d5d0 tx=0x7f169c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:38.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16ad7fa640 1 -- 172.21.15.81:0/2388414623 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c014070 con 0x7f16b0161470 2024-09-17T05:21:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16ad7fa640 1 -- 172.21.15.81:0/2388414623 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f169c00f990 con 0x7f16b0161470 2024-09-17T05:21:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b00cd640 con 0x7f16b0161470 2024-09-17T05:21:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16ad7fa640 1 -- 172.21.15.81:0/2388414623 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f169c00fde0 con 0x7f16b0161470 2024-09-17T05:21:38.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.270+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b00cdc00 con 0x7f16b0161470 2024-09-17T05:21:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.271+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b00d07a0 con 0x7f16b0161470 2024-09-17T05:21:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.272+0000 7f16ad7fa640 1 -- 172.21.15.81:0/2388414623 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f169c017070 con 0x7f16b0161470 2024-09-17T05:21:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.272+0000 7f16ad7fa640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1694078d70 0x7f169407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.272+0000 7f16ad7fa640 1 -- 172.21.15.81:0/2388414623 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 4943+0+0 (secure 0 0 0) 0x7f169c09afe0 con 0x7f16b0161470 2024-09-17T05:21:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.272+0000 7f16b4ac7640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1694078d70 0x7f169407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:38.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.273+0000 7f16b4ac7640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1694078d70 0x7f169407b230 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f16a4036000 tx=0x7f16a403c040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:38.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.276+0000 7f16ad7fa640 1 -- 172.21.15.81:0/2388414623 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f16b01618d0 con 0x7f16b0161470 2024-09-17T05:21:38.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a is failed for ~0s 2024-09-17T05:21:38.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c is failed for ~0s 2024-09-17T05:21:38.318 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2024-09-17T05:21:38.319 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2024-09-17T05:21:38.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.461+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f16b00d2f00 con 0x7f16b0161470 2024-09-17T05:21:38.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.930+0000 7f16ad7fa640 1 -- 172.21.15.81:0/2388414623 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v52) ==== 97+0+0 (secure 0 0 0) 0x7f169c062e80 con 0x7f16b0161470 2024-09-17T05:21:38.931 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:21:38.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1694078d70 msgr2=0x7f169407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:38.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1694078d70 0x7f169407b230 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f16a4036000 tx=0x7f16a403c040 comp rx=0 tx=0).stop 2024-09-17T05:21:38.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b0161470 msgr2=0x7f16b00ccde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b0161470 0x7f16b00ccde0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f169c00d5d0 tx=0x7f169c00da90 comp rx=0 tx=0).stop 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 shutdown_connections 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1694078d70 0x7f169407b230 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b00caf70 0x7f16b00cb420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16b0161470 0x7f16b00ccde0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 --2- 172.21.15.81:0/2388414623 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16a0003a00 0x7f16b0148cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 >> 172.21.15.81:0/2388414623 conn(0x7f16b00d3ea0 msgr2=0x7f16b00b77a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 shutdown_connections 2024-09-17T05:21:38.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:38.932+0000 7f16b6d2b640 1 -- 172.21.15.81:0/2388414623 wait complete. 2024-09-17T05:21:38.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:21:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.049+0000 7f386bcbf640 1 -- 172.21.15.81:0/3051702995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 msgr2=0x7f384c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.049+0000 7f386bcbf640 1 --2- 172.21.15.81:0/3051702995 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 0x7f384c0051c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f385c009b50 tx=0x7f384c005830 comp rx=0 tx=0).stop 2024-09-17T05:21:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.049+0000 7f386a25c640 1 -- 172.21.15.81:0/3051702995 reap_dead start 2024-09-17T05:21:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.049+0000 7f386bcbf640 1 -- 172.21.15.81:0/3051702995 shutdown_connections 2024-09-17T05:21:39.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.049+0000 7f386bcbf640 1 -- 172.21.15.81:0/3051702995 >> 172.21.15.81:0/3051702995 conn(0x7f38640d3ea0 msgr2=0x7f38640d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.049+0000 7f386bcbf640 1 -- 172.21.15.81:0/3051702995 shutdown_connections 2024-09-17T05:21:39.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.049+0000 7f386bcbf640 1 -- 172.21.15.81:0/3051702995 wait complete. 2024-09-17T05:21:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.050+0000 7f386bcbf640 1 Processor -- start 2024-09-17T05:21:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.050+0000 7f386bcbf640 1 -- start start 2024-09-17T05:21:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 0x7f386414d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38641f8df0 0x7f38640cdd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386415e570 0x7f386415e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3864162690 con 0x7f384c004d40 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38640b3800 con 0x7f386415e570 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f38640ca580 con 0x7f38641f8df0 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 0x7f386414d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 0x7f386414d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59498/0 (socket says 172.21.15.81:59498) 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 -- 172.21.15.81:0/685524456 learned_addr learned my addr 172.21.15.81:0/685524456 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386a25c640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386415e570 0x7f386415e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386925a640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38641f8df0 0x7f38640cdd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 -- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38641f8df0 msgr2=0x7f38640cdd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38641f8df0 0x7f38640cdd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 -- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386415e570 msgr2=0x7f386415e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386415e570 0x7f386415e9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 -- 172.21.15.81:0/685524456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38641f9250 con 0x7f384c004d40 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f3869a5b640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 0x7f386414d1b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3854011d40 tx=0x7f385400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f38627fc640 1 -- 172.21.15.81:0/685524456 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854003d80 con 0x7f384c004d40 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f38627fc640 1 -- 172.21.15.81:0/685524456 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3854004b20 con 0x7f384c004d40 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386414d840 con 0x7f384c004d40 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f38627fc640 1 -- 172.21.15.81:0/685524456 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854004050 con 0x7f384c004d40 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.051+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386414de00 con 0x7f384c004d40 2024-09-17T05:21:39.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.052+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38640cf9b0 con 0x7f384c004d40 2024-09-17T05:21:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.053+0000 7f38627fc640 1 -- 172.21.15.81:0/685524456 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f38540041f0 con 0x7f384c004d40 2024-09-17T05:21:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.054+0000 7f38627fc640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3850078d70 0x7f385007b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.054+0000 7f38627fc640 1 -- 172.21.15.81:0/685524456 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7f385409c040 con 0x7f384c004d40 2024-09-17T05:21:39.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.054+0000 7f386925a640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3850078d70 0x7f385007b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.054+0000 7f386925a640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3850078d70 0x7f385007b230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3858001330 tx=0x7f3858000ed0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:39.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.058+0000 7f38627fc640 1 -- 172.21.15.81:0/685524456 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f38540644d0 con 0x7f384c004d40 2024-09-17T05:21:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.300+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f386408d590 con 0x7f384c004d40 2024-09-17T05:21:39.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.300+0000 7f38627fc640 1 -- 172.21.15.81:0/685524456 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) ==== 80+0+5304 (secure 0 0 0) 0x7f3854063dd0 con 0x7f384c004d40 2024-09-17T05:21:39.301 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:39.301 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.303 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:21:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:21:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:21:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:21:39.304 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:21:39.305 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.306 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:21:39.307 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.308 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.309 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.311 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:21:39.312 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:21:39.313 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:21:39.314 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:21:39.315 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:21:39.316 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.317 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:21:39.318 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:21:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:21:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:21:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:21:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.319 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:21:39.319 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:21:39.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3850078d70 msgr2=0x7f385007b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3850078d70 0x7f385007b230 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f3858001330 tx=0x7f3858000ed0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 msgr2=0x7f386414d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 0x7f386414d1b0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f3854011d40 tx=0x7f385400f790 comp rx=0 tx=0).stop 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 shutdown_connections 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3850078d70 0x7f385007b230 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386415e570 0x7f386415e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38641f8df0 0x7f38640cdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 --2- 172.21.15.81:0/685524456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f384c004d40 0x7f386414d1b0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 >> 172.21.15.81:0/685524456 conn(0x7f38640d3ea0 msgr2=0x7f38640b5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 shutdown_connections 2024-09-17T05:21:39.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.302+0000 7f386bcbf640 1 -- 172.21.15.81:0/685524456 wait complete. 2024-09-17T05:21:39.322 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:21:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 -- 172.21.15.81:0/1548658822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0b0220 msgr2=0x7fc7ac0b06d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1548658822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0b0220 0x7fc7ac0b06d0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fc7ac0b63f0 tx=0x7fc7a402aa30 comp rx=0 tx=0).stop 2024-09-17T05:21:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 -- 172.21.15.81:0/1548658822 shutdown_connections 2024-09-17T05:21:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1548658822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0b0220 0x7fc7ac0b06d0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1548658822 >> v2:172.21.15.160:3300/0 conn(0x7fc7ac0cb5e0 0x7fc7ac074c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 -- 172.21.15.81:0/1548658822 >> 172.21.15.81:0/1548658822 conn(0x7fc7ac074160 msgr2=0x7fc7ac074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:39.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 -- 172.21.15.81:0/1548658822 shutdown_connections 2024-09-17T05:21:39.425 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.422+0000 7fc7b1990640 1 -- 172.21.15.81:0/1548658822 wait complete. 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.423+0000 7fc7b1990640 1 Processor -- start 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.423+0000 7fc7b1990640 1 -- start start 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7b1990640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac0b0220 0x7fc7ac0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7b1990640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0cb5e0 0x7fc7ac1f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7b1990640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7ac0ce120 0x7fc7ac1f6810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7b1990640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac0b0d90 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7b1990640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc7ac0b0c10 con 0x7fc7ac0b0220 2024-09-17T05:21:39.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7b1990640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc7ac0b0f10 con 0x7fc7ac0ce120 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0cb5e0 0x7fc7ac1f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0cb5e0 0x7fc7ac1f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59518/0 (socket says 172.21.15.81:59518) 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 -- 172.21.15.81:0/1409350511 learned_addr learned my addr 172.21.15.81:0/1409350511 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 -- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7ac0ce120 msgr2=0x7fc7ac1f6810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7ac0ce120 0x7fc7ac1f6810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 -- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac0b0220 msgr2=0x7fc7ac0c5940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac0b0220 0x7fc7ac0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.424+0000 7fc7a3fff640 1 -- 172.21.15.81:0/1409350511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc7ac0b50d0 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.425+0000 7fc7a3fff640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0cb5e0 0x7fc7ac1f62d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc79400e9c0 tx=0x7fc79400ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:39.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.425+0000 7fc7a8ff9640 1 -- 172.21.15.81:0/1409350511 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc79400cd80 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.425+0000 7fc7a8ff9640 1 -- 172.21.15.81:0/1409350511 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc794004020 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.425+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc7ac0b53b0 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.425+0000 7fc7a8ff9640 1 -- 172.21.15.81:0/1409350511 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc794004450 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.425+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc7ac0b5970 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.426+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc7ac0b1c30 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.427+0000 7fc7a8ff9640 1 -- 172.21.15.81:0/1409350511 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fc7940035f0 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.427+0000 7fc7a8ff9640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc78c078d70 0x7fc78c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.427+0000 7fc7a8ff9640 1 -- 172.21.15.81:0/1409350511 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7fc79409b850 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.427+0000 7fc7aaffd640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc78c078d70 0x7fc78c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.428+0000 7fc7aaffd640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc78c078d70 0x7fc78c07b230 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000f60 tx=0x7fc79c0079b0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:39.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.431+0000 7fc7a8ff9640 1 -- 172.21.15.81:0/1409350511 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc794063ce0 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.608+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fc7ac15e140 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.608+0000 7fc7a8ff9640 1 -- 172.21.15.81:0/1409350511 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v54) ==== 84+0+65 (secure 0 0 0) 0x7fc7940635e0 con 0x7fc7ac0cb5e0 2024-09-17T05:21:39.609 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:39.609 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:21:39.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:39.610 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:21:39.610 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:21:39.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:39.610 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:21:39.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc78c078d70 msgr2=0x7fc78c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc78c078d70 0x7fc78c07b230 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fc79c000f60 tx=0x7fc79c0079b0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0cb5e0 msgr2=0x7fc7ac1f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0cb5e0 0x7fc7ac1f62d0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7fc79400e9c0 tx=0x7fc79400ee80 comp rx=0 tx=0).stop 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 shutdown_connections 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc78c078d70 0x7fc78c07b230 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc7ac0ce120 0x7fc7ac1f6810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc7ac0cb5e0 0x7fc7ac1f62d0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 --2- 172.21.15.81:0/1409350511 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc7ac0b0220 0x7fc7ac0c5940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 >> 172.21.15.81:0/1409350511 conn(0x7fc7ac074160 msgr2=0x7fc7ac0d0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 shutdown_connections 2024-09-17T05:21:39.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.610+0000 7fc7b1990640 1 -- 172.21.15.81:0/1409350511 wait complete. 2024-09-17T05:21:39.622 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:21:39.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.725+0000 7f753bd3d640 1 -- 172.21.15.81:0/2452446339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 msgr2=0x7f75340cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.725+0000 7f753bd3d640 1 --2- 172.21.15.81:0/2452446339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340cd1d0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f75340cdde0 tx=0x7f752402a410 comp rx=0 tx=0).stop 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.725+0000 7f753bd3d640 1 -- 172.21.15.81:0/2452446339 shutdown_connections 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.725+0000 7f753bd3d640 1 --2- 172.21.15.81:0/2452446339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340cd1d0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.725+0000 7f753bd3d640 1 --2- 172.21.15.81:0/2452446339 >> v2:172.21.15.160:3300/0 conn(0x7f753415be70 0x7f75340ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.725+0000 7f753bd3d640 1 -- 172.21.15.81:0/2452446339 >> 172.21.15.81:0/2452446339 conn(0x7f7534074160 msgr2=0x7f7534074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.726+0000 7f753bd3d640 1 -- 172.21.15.81:0/2452446339 shutdown_connections 2024-09-17T05:21:39.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.726+0000 7f753bd3d640 1 -- 172.21.15.81:0/2452446339 wait complete. 2024-09-17T05:21:39.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 Processor -- start 2024-09-17T05:21:39.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 -- start start 2024-09-17T05:21:39.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340c5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75340cd710 0x7f75340c6130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f753415be70 0x7f75340c6670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7534068f50 con 0x7f75340b0590 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7534068dd0 con 0x7f753415be70 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.727+0000 7f753bd3d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f75340b11f0 con 0x7f75340cd710 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340c5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340c5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59532/0 (socket says 172.21.15.81:59532) 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 -- 172.21.15.81:0/1717019031 learned_addr learned my addr 172.21.15.81:0/1717019031 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 -- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75340cd710 msgr2=0x7f75340c6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75340cd710 0x7f75340c6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 -- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f753415be70 msgr2=0x7f75340c6670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f753415be70 0x7f75340c6670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 -- 172.21.15.81:0/1717019031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f75340c5af0 con 0x7f75340b0590 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f7539ad9640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340c5440 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f753000d770 tx=0x7f753000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f752a7fc640 1 -- 172.21.15.81:0/1717019031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530017070 con 0x7f75340b0590 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f752a7fc640 1 -- 172.21.15.81:0/1717019031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7530009ab0 con 0x7f75340b0590 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f75340b5e70 con 0x7f75340b0590 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f752a7fc640 1 -- 172.21.15.81:0/1717019031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7530010460 con 0x7f75340b0590 2024-09-17T05:21:39.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.728+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f75340705d0 con 0x7f75340b0590 2024-09-17T05:21:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.729+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f75340b5c80 con 0x7f75340b0590 2024-09-17T05:21:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.730+0000 7f752a7fc640 1 -- 172.21.15.81:0/1717019031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f753001a070 con 0x7f75340b0590 2024-09-17T05:21:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.731+0000 7f752a7fc640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7518078d40 0x7f751807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.731+0000 7f752a7fc640 1 -- 172.21.15.81:0/1717019031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(54..54 src has 1..54) ==== 4857+0+0 (secure 0 0 0) 0x7f753009ae50 con 0x7f75340b0590 2024-09-17T05:21:39.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.731+0000 7f75392d8640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7518078d40 0x7f751807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:39.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.731+0000 7f75392d8640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7518078d40 0x7f751807b200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7524034000 tx=0x7f75240046c0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:39.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.735+0000 7f752a7fc640 1 -- 172.21.15.81:0/1717019031 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7530063370 con 0x7f75340b0590 2024-09-17T05:21:39.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.909+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f75340b1780 con 0x7f75340b0590 2024-09-17T05:21:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.945+0000 7f752a7fc640 1 -- 172.21.15.81:0/1717019031 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v55) ==== 138+0+0 (secure 0 0 0) 0x7f7530062c70 con 0x7f75340b0590 2024-09-17T05:21:39.946 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:21:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7518078d40 msgr2=0x7f751807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7518078d40 0x7f751807b200 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7524034000 tx=0x7f75240046c0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 msgr2=0x7f75340c5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340c5440 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f753000d770 tx=0x7f753000dc30 comp rx=0 tx=0).stop 2024-09-17T05:21:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 shutdown_connections 2024-09-17T05:21:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7518078d40 0x7f751807b200 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f753415be70 0x7f75340c6670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f75340cd710 0x7f75340c6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 --2- 172.21.15.81:0/1717019031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f75340b0590 0x7f75340c5440 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 >> 172.21.15.81:0/1717019031 conn(0x7f7534074160 msgr2=0x7f753406ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 shutdown_connections 2024-09-17T05:21:39.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:39.948+0000 7f753bd3d640 1 -- 172.21.15.81:0/1717019031 wait complete. 2024-09-17T05:21:39.962 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:21:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.070+0000 7f2db82a9640 1 -- 172.21.15.81:0/2588446537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 msgr2=0x7f2d9c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.070+0000 7f2db82a9640 1 --2- 172.21.15.81:0/2588446537 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 0x7f2d9c0051c0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f2da8009ed0 tx=0x7f2d9c005830 comp rx=0 tx=0).stop 2024-09-17T05:21:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.070+0000 7f2db6846640 1 -- 172.21.15.81:0/2588446537 reap_dead start 2024-09-17T05:21:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.070+0000 7f2db82a9640 1 -- 172.21.15.81:0/2588446537 shutdown_connections 2024-09-17T05:21:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.070+0000 7f2db82a9640 1 -- 172.21.15.81:0/2588446537 >> 172.21.15.81:0/2588446537 conn(0x7f2db009aa30 msgr2=0x7f2db009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.070+0000 7f2db82a9640 1 -- 172.21.15.81:0/2588446537 shutdown_connections 2024-09-17T05:21:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.070+0000 7f2db82a9640 1 -- 172.21.15.81:0/2588446537 wait complete. 2024-09-17T05:21:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.071+0000 7f2db82a9640 1 Processor -- start 2024-09-17T05:21:40.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.071+0000 7f2db82a9640 1 -- start start 2024-09-17T05:21:40.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db82a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 0x7f2db01f3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:40.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db82a9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db00b4ce0 0x7f2db0158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:40.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db82a9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db00b64e0 0x7f2db00b6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db82a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2db00b00c0 con 0x7f2d9c004d40 2024-09-17T05:21:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db82a9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2db00aff40 con 0x7f2db00b64e0 2024-09-17T05:21:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db82a9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2db00b0240 con 0x7f2db00b4ce0 2024-09-17T05:21:40.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 0x7f2db01f3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 0x7f2db01f3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59552/0 (socket says 172.21.15.81:59552) 2024-09-17T05:21:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 -- 172.21.15.81:0/2138954893 learned_addr learned my addr 172.21.15.81:0/2138954893 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db5844640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db00b4ce0 0x7f2db0158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6846640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db00b64e0 0x7f2db00b6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:40.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 -- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db00b4ce0 msgr2=0x7f2db0158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db00b4ce0 0x7f2db0158420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 -- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db00b64e0 msgr2=0x7f2db00b6960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db00b64e0 0x7f2db00b6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db6045640 1 -- 172.21.15.81:0/2138954893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2db0158960 con 0x7f2d9c004d40 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.072+0000 7f2db5844640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db00b4ce0 0x7f2db0158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.073+0000 7f2db6045640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 0x7f2db01f3540 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006680 tx=0x7f2dac0066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.073+0000 7f2da6ffd640 1 -- 172.21.15.81:0/2138954893 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac015070 con 0x7f2d9c004d40 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.073+0000 7f2da6ffd640 1 -- 172.21.15.81:0/2138954893 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2dac011920 con 0x7f2d9c004d40 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.073+0000 7f2da6ffd640 1 -- 172.21.15.81:0/2138954893 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2dac011d70 con 0x7f2d9c004d40 2024-09-17T05:21:40.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.073+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2db00b5140 con 0x7f2d9c004d40 2024-09-17T05:21:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.073+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2db00b56d0 con 0x7f2d9c004d40 2024-09-17T05:21:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.074+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2db00b07a0 con 0x7f2d9c004d40 2024-09-17T05:21:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.074+0000 7f2da6ffd640 1 -- 172.21.15.81:0/2138954893 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f2dac018070 con 0x7f2d9c004d40 2024-09-17T05:21:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.075+0000 7f2da6ffd640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2d94078d70 0x7f2d9407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.075+0000 7f2da6ffd640 1 -- 172.21.15.81:0/2138954893 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(55..55 src has 1..55) ==== 5227+0+0 (secure 0 0 0) 0x7f2dac09b880 con 0x7f2d9c004d40 2024-09-17T05:21:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.075+0000 7f2db5844640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2d94078d70 0x7f2d9407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:40.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.076+0000 7f2db5844640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2d94078d70 0x7f2d9407b230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2db00b1c90 tx=0x7f2da0006b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:40.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.079+0000 7f2da6ffd640 1 -- 172.21.15.81:0/2138954893 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2db0158960 con 0x7f2d9c004d40 2024-09-17T05:21:40.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.256+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f2db015b050 con 0x7f2d9c004d40 2024-09-17T05:21:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.948+0000 7f2da6ffd640 1 -- 172.21.15.81:0/2138954893 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v56) ==== 170+0+0 (secure 0 0 0) 0x7f2dac063ba0 con 0x7f2d9c004d40 2024-09-17T05:21:40.949 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:21:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.953+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2d94078d70 msgr2=0x7f2d9407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.953+0000 7f2db82a9640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2d94078d70 0x7f2d9407b230 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2db00b1c90 tx=0x7f2da0006b70 comp rx=0 tx=0).stop 2024-09-17T05:21:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.953+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 msgr2=0x7f2db01f3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:40.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.953+0000 7f2db82a9640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 0x7f2db01f3540 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2dac006680 tx=0x7f2dac0066b0 comp rx=0 tx=0).stop 2024-09-17T05:21:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.954+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 shutdown_connections 2024-09-17T05:21:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.954+0000 7f2db82a9640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2d94078d70 0x7f2d9407b230 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.954+0000 7f2db82a9640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2db00b64e0 0x7f2db00b6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.954+0000 7f2db82a9640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2db00b4ce0 0x7f2db0158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.954+0000 7f2db82a9640 1 --2- 172.21.15.81:0/2138954893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d9c004d40 0x7f2db01f3540 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:40.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.954+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 >> 172.21.15.81:0/2138954893 conn(0x7f2db009aa30 msgr2=0x7f2db00711e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:40.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.956+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 shutdown_connections 2024-09-17T05:21:40.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:40.959+0000 7f2db82a9640 1 -- 172.21.15.81:0/2138954893 wait complete. 2024-09-17T05:21:40.978 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:21:41.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 -- 172.21.15.81:0/1383024622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde41617f0 msgr2=0x7efde40d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 --2- 172.21.15.81:0/1383024622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde41617f0 0x7efde40d1d30 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7efdd4005fd0 tx=0x7efdd402a540 comp rx=0 tx=0).stop 2024-09-17T05:21:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 -- 172.21.15.81:0/1383024622 shutdown_connections 2024-09-17T05:21:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 --2- 172.21.15.81:0/1383024622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efde40d01b0 0x7efde40d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 --2- 172.21.15.81:0/1383024622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde41617f0 0x7efde40d1d30 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 -- 172.21.15.81:0/1383024622 >> 172.21.15.81:0/1383024622 conn(0x7efde40d3e30 msgr2=0x7efde40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 -- 172.21.15.81:0/1383024622 shutdown_connections 2024-09-17T05:21:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.083+0000 7efdebb10640 1 -- 172.21.15.81:0/1383024622 wait complete. 2024-09-17T05:21:41.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 Processor -- start 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 -- start start 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde40d01b0 0x7efde40b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efde40d27b0 0x7efde40c80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efde41617f0 0x7efde40c85e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efde40d0f50 con 0x7efde40d01b0 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efde40b5000 con 0x7efde40d27b0 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efdebb10640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efde40d10d0 con 0x7efde41617f0 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efde98ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde40d01b0 0x7efde40b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efde98ac640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde40d01b0 0x7efde40b8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59570/0 (socket says 172.21.15.81:59570) 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.085+0000 7efde98ac640 1 -- 172.21.15.81:0/450918980 learned_addr learned my addr 172.21.15.81:0/450918980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efdea0ad640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efde41617f0 0x7efde40c85e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efde90ab640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efde40d27b0 0x7efde40c80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efde98ac640 1 -- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efde41617f0 msgr2=0x7efde40c85e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efde98ac640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efde41617f0 0x7efde40c85e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efde98ac640 1 -- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efde40d27b0 msgr2=0x7efde40c80a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efde98ac640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efde40d27b0 0x7efde40c80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efde98ac640 1 -- 172.21.15.81:0/450918980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efde41f57f0 con 0x7efde40d01b0 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efde98ac640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde40d01b0 0x7efde40b8e00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efdd4034040 tx=0x7efdd4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efdda7fc640 1 -- 172.21.15.81:0/450918980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd403e030 con 0x7efde40d01b0 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efdda7fc640 1 -- 172.21.15.81:0/450918980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efdd4003e00 con 0x7efde40d01b0 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efde41f4a50 con 0x7efde40d01b0 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efdda7fc640 1 -- 172.21.15.81:0/450918980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efdd4035040 con 0x7efde40d01b0 2024-09-17T05:21:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.086+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efde41f4ff0 con 0x7efde40d01b0 2024-09-17T05:21:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.087+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efde40d1610 con 0x7efde40d01b0 2024-09-17T05:21:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.088+0000 7efdda7fc640 1 -- 172.21.15.81:0/450918980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7efdd4041030 con 0x7efde40d01b0 2024-09-17T05:21:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.089+0000 7efdda7fc640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efdc8078d40 0x7efdc807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.089+0000 7efdda7fc640 1 -- 172.21.15.81:0/450918980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(56..56 src has 1..56) ==== 5609+0+0 (secure 0 0 0) 0x7efdd40bbbe0 con 0x7efde40d01b0 2024-09-17T05:21:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.089+0000 7efde90ab640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efdc8078d40 0x7efdc807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:41.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.090+0000 7efde90ab640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efdc8078d40 0x7efdc807b200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efde0005fd0 tx=0x7efde0005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.093+0000 7efdda7fc640 1 -- 172.21.15.81:0/450918980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7efdd4083e60 con 0x7efde40d01b0 2024-09-17T05:21:41.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.302+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7efde40b5700 con 0x7efde40d01b0 2024-09-17T05:21:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.958+0000 7efdda7fc640 1 -- 172.21.15.81:0/450918980 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v28) ==== 172+0+0 (secure 0 0 0) 0x7efdd40bb070 con 0x7efde40d01b0 2024-09-17T05:21:41.958 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 8 and data pool 9 2024-09-17T05:21:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efdc8078d40 msgr2=0x7efdc807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efdc8078d40 0x7efdc807b200 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7efde0005fd0 tx=0x7efde0005850 comp rx=0 tx=0).stop 2024-09-17T05:21:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde40d01b0 msgr2=0x7efde40b8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:41.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde40d01b0 0x7efde40b8e00 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7efdd4034040 tx=0x7efdd4003910 comp rx=0 tx=0).stop 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 shutdown_connections 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7efdc8078d40 0x7efdc807b200 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efde41617f0 0x7efde40c85e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efde40d27b0 0x7efde40c80a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 --2- 172.21.15.81:0/450918980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efde40d01b0 0x7efde40b8e00 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 >> 172.21.15.81:0/450918980 conn(0x7efde40d3e30 msgr2=0x7efde40b1d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.965+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 shutdown_connections 2024-09-17T05:21:41.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:41.966+0000 7efdebb10640 1 -- 172.21.15.81:0/450918980 wait complete. 2024-09-17T05:21:41.987 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.088+0000 7f1990e8e640 1 -- 172.21.15.81:0/687606742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c074d10 msgr2=0x7f198c0688b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.088+0000 7f1990e8e640 1 --2- 172.21.15.81:0/687606742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c074d10 0x7f198c0688b0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f198c0caa70 tx=0x7f198402aa70 comp rx=0 tx=0).stop 2024-09-17T05:21:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.088+0000 7f1990e8e640 1 -- 172.21.15.81:0/687606742 shutdown_connections 2024-09-17T05:21:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.088+0000 7f1990e8e640 1 --2- 172.21.15.81:0/687606742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c074d10 0x7f198c0688b0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.088+0000 7f1990e8e640 1 -- 172.21.15.81:0/687606742 >> 172.21.15.81:0/687606742 conn(0x7f198c0741f0 msgr2=0x7f198c074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.088+0000 7f1990e8e640 1 -- 172.21.15.81:0/687606742 shutdown_connections 2024-09-17T05:21:42.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.088+0000 7f1990e8e640 1 -- 172.21.15.81:0/687606742 wait complete. 2024-09-17T05:21:42.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 Processor -- start 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 -- start start 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f198c074d10 0x7f198c15a660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f198c0ce950 0x7f198c0c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c15f120 0x7f198c0c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f198c0cc910 con 0x7f198c15f120 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f198c0cc790 con 0x7f198c074d10 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.090+0000 7f1990e8e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f198c0cca90 con 0x7f198c0ce950 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c15f120 0x7f198c0c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c15f120 0x7f198c0c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59578/0 (socket says 172.21.15.81:59578) 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 -- 172.21.15.81:0/3362038391 learned_addr learned my addr 172.21.15.81:0/3362038391 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:42.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f1983fff640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f198c0ce950 0x7f198c0c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198a59c640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f198c074d10 0x7f198c15a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 -- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f198c0ce950 msgr2=0x7f198c0c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f198c0ce950 0x7f198c0c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 -- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f198c074d10 msgr2=0x7f198c15a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f198c074d10 0x7f198c15a660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 -- 172.21.15.81:0/3362038391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f198c1f3990 con 0x7f198c15f120 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f198ad9d640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c15f120 0x7f198c0c6580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d60 tx=0x7f1984003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f1982ffd640 1 -- 172.21.15.81:0/3362038391 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984046070 con 0x7f198c15f120 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f1982ffd640 1 -- 172.21.15.81:0/3362038391 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1984004250 con 0x7f198c15f120 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f198c15b000 con 0x7f198c15f120 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f1982ffd640 1 -- 172.21.15.81:0/3362038391 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1984004680 con 0x7f198c15f120 2024-09-17T05:21:42.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.091+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f198c15b2e0 con 0x7f198c15f120 2024-09-17T05:21:42.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.092+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f198c0ccfb0 con 0x7f198c15f120 2024-09-17T05:21:42.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.093+0000 7f1982ffd640 1 -- 172.21.15.81:0/3362038391 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f1984049070 con 0x7f198c15f120 2024-09-17T05:21:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.093+0000 7f1982ffd640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f196c078d40 0x7f196c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.094+0000 7f1982ffd640 1 -- 172.21.15.81:0/3362038391 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f19840bbf20 con 0x7f198c15f120 2024-09-17T05:21:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.094+0000 7f198a59c640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f196c078d40 0x7f196c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.094+0000 7f198a59c640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f196c078d40 0x7f196c07b200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f197c006fd0 tx=0x7f197c009060 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:42.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.098+0000 7f1982ffd640 1 -- 172.21.15.81:0/3362038391 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1984032030 con 0x7f198c15f120 2024-09-17T05:21:42.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.276+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f198c0ce490 con 0x7f198c15f120 2024-09-17T05:21:42.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.277+0000 7f1982ffd640 1 -- 172.21.15.81:0/3362038391 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16738 (secure 0 0 0) 0x7f1984004820 con 0x7f198c15f120 2024-09-17T05:21:42.277 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:42.277 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":57,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:21:41.304282+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:39.914624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:40.261517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f196c078d40 msgr2=0x7f196c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f196c078d40 0x7f196c07b200 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f197c006fd0 tx=0x7f197c009060 comp rx=0 tx=0).stop 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c15f120 msgr2=0x7f198c0c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c15f120 0x7f198c0c6580 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d60 tx=0x7f1984003f10 comp rx=0 tx=0).stop 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 shutdown_connections 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f196c078d40 0x7f196c07b200 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f198c15f120 0x7f198c0c6580 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f198c0ce950 0x7f198c0c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 --2- 172.21.15.81:0/3362038391 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f198c074d10 0x7f198c15a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 >> 172.21.15.81:0/3362038391 conn(0x7f198c0741f0 msgr2=0x7f198c0c89a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:42.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.279+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 shutdown_connections 2024-09-17T05:21:42.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.280+0000 7f1990e8e640 1 -- 172.21.15.81:0/3362038391 wait complete. 2024-09-17T05:21:42.291 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 -- 172.21.15.81:0/3889907570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c074310 msgr2=0x7f041c06e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 --2- 172.21.15.81:0/3889907570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c074310 0x7f041c06e920 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f041c076700 tx=0x7f041402aac0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 -- 172.21.15.81:0/3889907570 shutdown_connections 2024-09-17T05:21:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 --2- 172.21.15.81:0/3889907570 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c074310 0x7f041c06e920 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 --2- 172.21.15.81:0/3889907570 >> v2:172.21.15.160:3300/0 conn(0x7f041c15f3d0 0x7f041c0736c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 -- 172.21.15.81:0/3889907570 >> 172.21.15.81:0/3889907570 conn(0x7f041c0b19c0 msgr2=0x7f041c0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 -- 172.21.15.81:0/3889907570 shutdown_connections 2024-09-17T05:21:42.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.392+0000 7f04223cd640 1 -- 172.21.15.81:0/3889907570 wait complete. 2024-09-17T05:21:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.393+0000 7f04223cd640 1 Processor -- start 2024-09-17T05:21:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.393+0000 7f04223cd640 1 -- start start 2024-09-17T05:21:42.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f04223cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c074310 0x7f041c147500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f04223cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cdaa0 0x7f041c09d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f04223cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c15f3d0 0x7f041c09aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f04223cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f041c15f930 con 0x7f041c15f3d0 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f04223cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f041c15f7b0 con 0x7f041c074310 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f04223cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f041c06ee60 con 0x7f041c0cdaa0 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c15f3d0 0x7f041c09aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c15f3d0 0x7f041c09aa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59604/0 (socket says 172.21.15.81:59604) 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 -- 172.21.15.81:0/3637635848 learned_addr learned my addr 172.21.15.81:0/3637635848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f041bfff640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c074310 0x7f041c147500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f041b7fe640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cdaa0 0x7f041c09d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 -- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cdaa0 msgr2=0x7f041c09d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cdaa0 0x7f041c09d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 -- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c074310 msgr2=0x7f041c147500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c074310 0x7f041c147500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.394+0000 7f042096a640 1 -- 172.21.15.81:0/3637635848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f041c15e300 con 0x7f041c15f3d0 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.395+0000 7f042096a640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c15f3d0 0x7f041c09aa30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0414009d60 tx=0x7f0414003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.395+0000 7f0418ff9640 1 -- 172.21.15.81:0/3637635848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0414044070 con 0x7f041c15f3d0 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.395+0000 7f0418ff9640 1 -- 172.21.15.81:0/3637635848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0414003e00 con 0x7f041c15f3d0 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.395+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f041c15e5e0 con 0x7f041c15f3d0 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.395+0000 7f0418ff9640 1 -- 172.21.15.81:0/3637635848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04140044b0 con 0x7f041c15f3d0 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.395+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f041c09cd20 con 0x7f041c15f3d0 2024-09-17T05:21:42.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.396+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f041c06e920 con 0x7f041c15f3d0 2024-09-17T05:21:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.396+0000 7f0418ff9640 1 -- 172.21.15.81:0/3637635848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f0414004650 con 0x7f041c15f3d0 2024-09-17T05:21:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.397+0000 7f0418ff9640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0408078d70 0x7f040807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.397+0000 7f0418ff9640 1 -- 172.21.15.81:0/3637635848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f04140bb600 con 0x7f041c15f3d0 2024-09-17T05:21:42.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.397+0000 7f041bfff640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0408078d70 0x7f040807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.398+0000 7f041bfff640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0408078d70 0x7f040807b230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f040c009b30 tx=0x7f040c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:42.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.401+0000 7f0418ff9640 1 -- 172.21.15.81:0/3637635848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0414032030 con 0x7f041c15f3d0 2024-09-17T05:21:42.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.577+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f041c0cee50 con 0x7f041c15f3d0 2024-09-17T05:21:42.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.578+0000 7f0418ff9640 1 -- 172.21.15.81:0/3637635848 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v57) ==== 74+0+16738 (secure 0 0 0) 0x7f0414083230 con 0x7f041c15f3d0 2024-09-17T05:21:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:42.578 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":57,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:21:41.304282+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:39.914624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:40.261517+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0408078d70 msgr2=0x7f040807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0408078d70 0x7f040807b230 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f040c009b30 tx=0x7f040c005f90 comp rx=0 tx=0).stop 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c15f3d0 msgr2=0x7f041c09aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c15f3d0 0x7f041c09aa30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0414009d60 tx=0x7f0414003c10 comp rx=0 tx=0).stop 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 shutdown_connections 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0408078d70 0x7f040807b230 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f041c15f3d0 0x7f041c09aa30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f041c0cdaa0 0x7f041c09d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 --2- 172.21.15.81:0/3637635848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f041c074310 0x7f041c147500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 >> 172.21.15.81:0/3637635848 conn(0x7f041c0b19c0 msgr2=0x7f041c073530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:42.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 shutdown_connections 2024-09-17T05:21:42.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.580+0000 7f04223cd640 1 -- 172.21.15.81:0/3637635848 wait complete. 2024-09-17T05:21:42.591 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:21:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 -- 172.21.15.81:0/208044991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01700cdb90 msgr2=0x7f01700cdfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 --2- 172.21.15.81:0/208044991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01700cdb90 0x7f01700cdfe0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0168005fd0 tx=0x7f016802a5c0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 -- 172.21.15.81:0/208044991 shutdown_connections 2024-09-17T05:21:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 --2- 172.21.15.81:0/208044991 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f01700cdb90 0x7f01700cdfe0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 --2- 172.21.15.81:0/208044991 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cede0 0x7f01700cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 -- 172.21.15.81:0/208044991 >> 172.21.15.81:0/208044991 conn(0x7f01700b1700 msgr2=0x7f01700b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 -- 172.21.15.81:0/208044991 shutdown_connections 2024-09-17T05:21:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.695+0000 7f0176ab8640 1 -- 172.21.15.81:0/208044991 wait complete. 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.696+0000 7f0176ab8640 1 Processor -- start 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.696+0000 7f0176ab8640 1 -- start start 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0176ab8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cdb90 0x7f01701f37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0176ab8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700cede0 0x7f01700aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0176ab8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017015bb20 0x7f01700afd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0176ab8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f017006fde0 con 0x7f017015bb20 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0176ab8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f017006fc60 con 0x7f01700cede0 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0176ab8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f017006ff60 con 0x7f01700cdb90 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0175055640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017015bb20 0x7f01700afd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0175055640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017015bb20 0x7f01700afd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59616/0 (socket says 172.21.15.81:59616) 2024-09-17T05:21:42.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0175055640 1 -- 172.21.15.81:0/4127433201 learned_addr learned my addr 172.21.15.81:0/4127433201 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f0174854640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cdb90 0x7f01701f37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.697+0000 7f016ffff640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700cede0 0x7f01700aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0175055640 1 -- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cdb90 msgr2=0x7f01701f37e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0175055640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cdb90 0x7f01701f37e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0175055640 1 -- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700cede0 msgr2=0x7f01700aee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0175055640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700cede0 0x7f01700aee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0175055640 1 -- 172.21.15.81:0/4127433201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01701f3d20 con 0x7f017015bb20 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0175055640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017015bb20 0x7f01700afd70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0168006010 tx=0x7f0168003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f016d7fa640 1 -- 172.21.15.81:0/4127433201 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f016803f070 con 0x7f017015bb20 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f016d7fa640 1 -- 172.21.15.81:0/4127433201 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f01680047a0 con 0x7f017015bb20 2024-09-17T05:21:42.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01700af340 con 0x7f017015bb20 2024-09-17T05:21:42.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f016d7fa640 1 -- 172.21.15.81:0/4127433201 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0168035030 con 0x7f017015bb20 2024-09-17T05:21:42.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.698+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01700c7130 con 0x7f017015bb20 2024-09-17T05:21:42.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.699+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01700704a0 con 0x7f017015bb20 2024-09-17T05:21:42.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.700+0000 7f016d7fa640 1 -- 172.21.15.81:0/4127433201 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f0168042070 con 0x7f017015bb20 2024-09-17T05:21:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.700+0000 7f016d7fa640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0150078d40 0x7f015007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.700+0000 7f016d7fa640 1 -- 172.21.15.81:0/4127433201 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5709+0+0 (secure 0 0 0) 0x7f01680bbd30 con 0x7f017015bb20 2024-09-17T05:21:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.700+0000 7f0174854640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0150078d40 0x7f015007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:42.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.701+0000 7f0174854640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0150078d40 0x7f015007b200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0160001e20 tx=0x7f0160009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:42.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.704+0000 7f016d7fa640 1 -- 172.21.15.81:0/4127433201 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f01701f3d20 con 0x7f017015bb20 2024-09-17T05:21:42.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:42.917+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f01700b1450 con 0x7f017015bb20 2024-09-17T05:21:43.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.819+0000 7f016d7fa640 1 -- 172.21.15.81:0/4127433201 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v30) ==== 118+0+0 (secure 0 0 0) 0x7f0168083960 con 0x7f017015bb20 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0150078d40 msgr2=0x7f015007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0150078d40 0x7f015007b200 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f0160001e20 tx=0x7f0160009040 comp rx=0 tx=0).stop 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017015bb20 msgr2=0x7f01700afd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017015bb20 0x7f01700afd70 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0168006010 tx=0x7f0168003820 comp rx=0 tx=0).stop 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 shutdown_connections 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0150078d40 0x7f015007b200 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f017015bb20 0x7f01700afd70 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f01700cede0 0x7f01700aee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 --2- 172.21.15.81:0/4127433201 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f01700cdb90 0x7f01701f37e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 >> 172.21.15.81:0/4127433201 conn(0x7f01700b1700 msgr2=0x7f017015aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:43.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.822+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 shutdown_connections 2024-09-17T05:21:43.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.823+0000 7f0176ab8640 1 -- 172.21.15.81:0/4127433201 wait complete. 2024-09-17T05:21:43.835 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:21:43.836 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:21:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.945+0000 7f5887ac6640 1 -- 172.21.15.81:0/754833063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c005e50 msgr2=0x7f586c0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.945+0000 7f5887ac6640 1 --2- 172.21.15.81:0/754833063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f586c005e50 0x7f586c0062d0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f5878005fd0 tx=0x7f586c006940 comp rx=0 tx=0).stop 2024-09-17T05:21:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.945+0000 7f5886063640 1 -- 172.21.15.81:0/754833063 reap_dead start 2024-09-17T05:21:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.945+0000 7f5887ac6640 1 -- 172.21.15.81:0/754833063 shutdown_connections 2024-09-17T05:21:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.945+0000 7f5887ac6640 1 -- 172.21.15.81:0/754833063 >> 172.21.15.81:0/754833063 conn(0x7f58800b1700 msgr2=0x7f58800b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.945+0000 7f5887ac6640 1 -- 172.21.15.81:0/754833063 shutdown_connections 2024-09-17T05:21:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.945+0000 7f5887ac6640 1 -- 172.21.15.81:0/754833063 wait complete. 2024-09-17T05:21:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.946+0000 7f5887ac6640 1 Processor -- start 2024-09-17T05:21:43.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.946+0000 7f5887ac6640 1 -- start start 2024-09-17T05:21:43.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5887ac6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f586c005e50 0x7f58800c40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:43.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5887ac6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588014b8a0 0x7f588014a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5887ac6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588014cee0 0x7f588014d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5887ac6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f588015aee0 con 0x7f588014cee0 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5887ac6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f588015ad60 con 0x7f588014b8a0 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5887ac6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f58801629f0 con 0x7f586c005e50 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5886063640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588014cee0 0x7f588014d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5886063640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588014cee0 0x7f588014d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47558/0 (socket says 172.21.15.81:47558) 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5886063640 1 -- 172.21.15.81:0/2706620049 learned_addr learned my addr 172.21.15.81:0/2706620049 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5885061640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588014b8a0 0x7f588014a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.947+0000 7f5885862640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f586c005e50 0x7f58800c40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5886063640 1 -- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f586c005e50 msgr2=0x7f58800c40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5886063640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f586c005e50 0x7f58800c40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:43.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5886063640 1 -- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588014b8a0 msgr2=0x7f588014a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5886063640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588014b8a0 0x7f588014a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5886063640 1 -- 172.21.15.81:0/2706620049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f58800c45e0 con 0x7f588014cee0 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5886063640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588014cee0 0x7f588014d360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5878005fd0 tx=0x7f5878033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f58767fc640 1 -- 172.21.15.81:0/2706620049 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878043070 con 0x7f588014cee0 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f58767fc640 1 -- 172.21.15.81:0/2706620049 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5878003970 con 0x7f588014cee0 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f588014be40 con 0x7f588014cee0 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f58767fc640 1 -- 172.21.15.81:0/2706620049 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5878038040 con 0x7f588014cee0 2024-09-17T05:21:43.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.948+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f588014c400 con 0x7f588014cee0 2024-09-17T05:21:43.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.949+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f58800cc540 con 0x7f588014cee0 2024-09-17T05:21:43.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.950+0000 7f58767fc640 1 -- 172.21.15.81:0/2706620049 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f58780337e0 con 0x7f588014cee0 2024-09-17T05:21:43.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.950+0000 7f58767fc640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5864078d40 0x7f586407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:43.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.950+0000 7f58767fc640 1 -- 172.21.15.81:0/2706620049 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f58780bac90 con 0x7f588014cee0 2024-09-17T05:21:43.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.950+0000 7f5885862640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5864078d40 0x7f586407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:43.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.951+0000 7f5885862640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5864078d40 0x7f586407b200 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f587c006cf0 tx=0x7f587c001570 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:43.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:43.955+0000 7f58767fc640 1 -- 172.21.15.81:0/2706620049 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f58780826f0 con 0x7f588014cee0 2024-09-17T05:21:44.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.170+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f588014ae40 con 0x7f588014cee0 2024-09-17T05:21:44.938 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-17T05:21:44.938+0000 7f590acb6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:21:44.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.982+0000 7f58767fc640 1 -- 172.21.15.81:0/2706620049 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v31) ==== 122+0+0 (secure 0 0 0) 0x7f5878087120 con 0x7f588014cee0 2024-09-17T05:21:44.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5864078d40 msgr2=0x7f586407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:44.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5864078d40 0x7f586407b200 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f587c006cf0 tx=0x7f587c001570 comp rx=0 tx=0).stop 2024-09-17T05:21:44.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588014cee0 msgr2=0x7f588014d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:44.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588014cee0 0x7f588014d360 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f5878005fd0 tx=0x7f5878033670 comp rx=0 tx=0).stop 2024-09-17T05:21:44.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 shutdown_connections 2024-09-17T05:21:44.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5864078d40 0x7f586407b200 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:44.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f588014cee0 0x7f588014d360 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:44.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f588014b8a0 0x7f588014a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:44.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 --2- 172.21.15.81:0/2706620049 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f586c005e50 0x7f58800c40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:44.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 >> 172.21.15.81:0/2706620049 conn(0x7f58800b1700 msgr2=0x7f58801505c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:44.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 shutdown_connections 2024-09-17T05:21:44.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:44.985+0000 7f5887ac6640 1 -- 172.21.15.81:0/2706620049 wait complete. 2024-09-17T05:21:44.996 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:21:44.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:45.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.a has been restored 2024-09-17T05:21:45.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.c has been restored 2024-09-17T05:21:45.033 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2024-09-17T05:21:45.034 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2024-09-17T05:21:45.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:45.059 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:21:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.102+0000 7f70c7f6c640 1 -- 172.21.15.81:0/3261055988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ac003a50 msgr2=0x7f70ac003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.102+0000 7f70c7f6c640 1 --2- 172.21.15.81:0/3261055988 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70ac003a50 0x7f70ac003e70 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f70bc009b50 tx=0x7f70ac005830 comp rx=0 tx=0).stop 2024-09-17T05:21:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.102+0000 7f70c6509640 1 -- 172.21.15.81:0/3261055988 reap_dead start 2024-09-17T05:21:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.102+0000 7f70c7f6c640 1 -- 172.21.15.81:0/3261055988 shutdown_connections 2024-09-17T05:21:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.102+0000 7f70c7f6c640 1 -- 172.21.15.81:0/3261055988 >> 172.21.15.81:0/3261055988 conn(0x7f70c00d0b40 msgr2=0x7f70c00d0f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.102+0000 7f70c7f6c640 1 -- 172.21.15.81:0/3261055988 shutdown_connections 2024-09-17T05:21:45.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.102+0000 7f70c7f6c640 1 -- 172.21.15.81:0/3261055988 wait complete. 2024-09-17T05:21:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.103+0000 7f70c7f6c640 1 Processor -- start 2024-09-17T05:21:45.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.103+0000 7f70c7f6c640 1 -- start start 2024-09-17T05:21:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c7f6c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70ac003a50 0x7f70c00b4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c7f6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c00b5b10 0x7f70c00b5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c7f6c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c00c37f0 0x7f70c00c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c7f6c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f70c015f1e0 con 0x7f70c00b5b10 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c7f6c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f70c015f060 con 0x7f70c00c37f0 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c7f6c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f70c015f360 con 0x7f70ac003a50 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c00b5b10 0x7f70c00b5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c00b5b10 0x7f70c00b5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47568/0 (socket says 172.21.15.81:47568) 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 -- 172.21.15.81:0/2618953278 learned_addr learned my addr 172.21.15.81:0/2618953278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c6509640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c00c37f0 0x7f70c00c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5d08640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70ac003a50 0x7f70c00b4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 -- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70ac003a50 msgr2=0x7f70c00b4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70ac003a50 0x7f70c00b4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 -- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c00c37f0 msgr2=0x7f70c00c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c00c37f0 0x7f70c00c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 -- 172.21.15.81:0/2618953278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c00c4af0 con 0x7f70c00b5b10 2024-09-17T05:21:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c5507640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c00b5b10 0x7f70c00b5f90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70b000e5c0 tx=0x7f70b000ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70b67fc640 1 -- 172.21.15.81:0/2618953278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0015070 con 0x7f70c00b5b10 2024-09-17T05:21:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70b67fc640 1 -- 172.21.15.81:0/2618953278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f70b00109a0 con 0x7f70c00b5b10 2024-09-17T05:21:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.104+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c00b6620 con 0x7f70c00b5b10 2024-09-17T05:21:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.105+0000 7f70b67fc640 1 -- 172.21.15.81:0/2618953278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b0010df0 con 0x7f70c00b5b10 2024-09-17T05:21:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.105+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c00b4550 con 0x7f70c00b5b10 2024-09-17T05:21:45.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.106+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c00c41b0 con 0x7f70c00b5b10 2024-09-17T05:21:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.106+0000 7f70b67fc640 1 -- 172.21.15.81:0/2618953278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f70b0018070 con 0x7f70c00b5b10 2024-09-17T05:21:45.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.107+0000 7f70b67fc640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f70a4078d40 0x7f70a407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.107+0000 7f70b67fc640 1 -- 172.21.15.81:0/2618953278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f70b009b3c0 con 0x7f70c00b5b10 2024-09-17T05:21:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.107+0000 7f70c5d08640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f70a4078d40 0x7f70a407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.107+0000 7f70c5d08640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f70a4078d40 0x7f70a407b200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f70bc035000 tx=0x7f70bc02d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:45.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.111+0000 7f70b67fc640 1 -- 172.21.15.81:0/2618953278 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f70c015f5a0 con 0x7f70c00b5b10 2024-09-17T05:21:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.324+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f70c00cb8e0 con 0x7f70c00b5b10 2024-09-17T05:21:45.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.325+0000 7f70b67fc640 1 -- 172.21.15.81:0/2618953278 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5226 (secure 0 0 0) 0x7f70b0062f60 con 0x7f70c00b5b10 2024-09-17T05:21:45.325 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:45.325 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"btime":"2024-09-17T05:21:44:975320+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1537992933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1537992933},{"type":"v1","addr":"172.21.15.160:6836","nonce":1537992933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5419,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3597720446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3597720446},{"type":"v1","addr":"172.21.15.160:6837","nonce":3597720446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/457781060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":457781060},{"type":"v1","addr":"172.21.15.81:6834","nonce":457781060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:41.304247+0000","modified":"2024-09-17T05:21:44.170675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1068882112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1068882112},{"type":"v1","addr":"172.21.15.81:6835","nonce":1068882112}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-09-17T05:21:45.325 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2024-09-17T05:21:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f70a4078d40 msgr2=0x7f70a407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f70a4078d40 0x7f70a407b200 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f70bc035000 tx=0x7f70bc02d040 comp rx=0 tx=0).stop 2024-09-17T05:21:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c00b5b10 msgr2=0x7f70c00b5f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c00b5b10 0x7f70c00b5f90 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70b000e5c0 tx=0x7f70b000ea80 comp rx=0 tx=0).stop 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 shutdown_connections 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f70a4078d40 0x7f70a407b200 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f70c00c37f0 0x7f70c00c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f70c00b5b10 0x7f70c00b5f90 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 --2- 172.21.15.81:0/2618953278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f70ac003a50 0x7f70c00b4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 >> 172.21.15.81:0/2618953278 conn(0x7f70c00d0b40 msgr2=0x7f70c0156c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 shutdown_connections 2024-09-17T05:21:45.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.327+0000 7f70c7f6c640 1 -- 172.21.15.81:0/2618953278 wait complete. 2024-09-17T05:21:45.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:21:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.479+0000 7f7d46233640 1 -- 172.21.15.81:0/779604718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 msgr2=0x7f7d28004f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.479+0000 7f7d46233640 1 --2- 172.21.15.81:0/779604718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 0x7f7d28004f60 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000c630 tx=0x7f7d28006940 comp rx=0 tx=0).stop 2024-09-17T05:21:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.479+0000 7f7d3ffff640 1 -- 172.21.15.81:0/779604718 reap_dead start 2024-09-17T05:21:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.479+0000 7f7d46233640 1 -- 172.21.15.81:0/779604718 shutdown_connections 2024-09-17T05:21:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.479+0000 7f7d46233640 1 -- 172.21.15.81:0/779604718 >> 172.21.15.81:0/779604718 conn(0x7f7d400b1690 msgr2=0x7f7d400b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.479+0000 7f7d46233640 1 -- 172.21.15.81:0/779604718 shutdown_connections 2024-09-17T05:21:45.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.479+0000 7f7d46233640 1 -- 172.21.15.81:0/779604718 wait complete. 2024-09-17T05:21:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 Processor -- start 2024-09-17T05:21:45.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 -- start start 2024-09-17T05:21:45.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 0x7f7d40139310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d40155850 0x7f7d40157080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d401575c0 0x7f7d400cfe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4006e970 con 0x7f7d28004b40 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7d4006e7f0 con 0x7f7d40155850 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.481+0000 7f7d46233640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4006eaf0 con 0x7f7d401575c0 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 0x7f7d40139310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 0x7f7d40139310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47584/0 (socket says 172.21.15.81:47584) 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/1278882536 learned_addr learned my addr 172.21.15.81:0/1278882536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d401575c0 msgr2=0x7f7d400cfe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3ffff640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d401575c0 0x7f7d400cfe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d401575c0 0x7f7d400cfe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d40155850 msgr2=0x7f7d40157080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d40155850 0x7f7d40157080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 -- 172.21.15.81:0/1278882536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d40157a80 con 0x7f7d28004b40 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d3f7fe640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 0x7f7d40139310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000c630 tx=0x7f7d30004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d27fff640 1 -- 172.21.15.81:0/1278882536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3002b730 con 0x7f7d28004b40 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d27fff640 1 -- 172.21.15.81:0/1278882536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d3002b8d0 con 0x7f7d28004b40 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d40157d60 con 0x7f7d28004b40 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d27fff640 1 -- 172.21.15.81:0/1278882536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3002bd00 con 0x7f7d28004b40 2024-09-17T05:21:45.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.482+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d40158600 con 0x7f7d28004b40 2024-09-17T05:21:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.483+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d40157f30 con 0x7f7d28004b40 2024-09-17T05:21:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.484+0000 7f7d27fff640 1 -- 172.21.15.81:0/1278882536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f7d30006050 con 0x7f7d28004b40 2024-09-17T05:21:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.484+0000 7f7d27fff640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7d2c078d70 0x7f7d2c07b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.485+0000 7f7d27fff640 1 -- 172.21.15.81:0/1278882536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f7d300bb0a0 con 0x7f7d28004b40 2024-09-17T05:21:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.485+0000 7f7d3effd640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7d2c078d70 0x7f7d2c07b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.485+0000 7f7d3effd640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7d2c078d70 0x7f7d2c07b230 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d40146e00 tx=0x7f7d34006a60 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:45.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.489+0000 7f7d27fff640 1 -- 172.21.15.81:0/1278882536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7d300831e0 con 0x7f7d28004b40 2024-09-17T05:21:45.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.665+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d400725a0 con 0x7f7d28004b40 2024-09-17T05:21:45.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.666+0000 7f7d27fff640 1 -- 172.21.15.81:0/1278882536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16725 (secure 0 0 0) 0x7f7d30082ae0 con 0x7f7d28004b40 2024-09-17T05:21:45.666 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:45.666 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:21:42.957747+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:39.914624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:40.261517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:21:45.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7d2c078d70 msgr2=0x7f7d2c07b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7d2c078d70 0x7f7d2c07b230 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7d40146e00 tx=0x7f7d34006a60 comp rx=0 tx=0).stop 2024-09-17T05:21:45.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 msgr2=0x7f7d40139310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 0x7f7d40139310 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f7d3000c630 tx=0x7f7d30004b90 comp rx=0 tx=0).stop 2024-09-17T05:21:45.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 shutdown_connections 2024-09-17T05:21:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7d2c078d70 0x7f7d2c07b230 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d401575c0 0x7f7d400cfe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d40155850 0x7f7d40157080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 --2- 172.21.15.81:0/1278882536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d28004b40 0x7f7d40139310 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 >> 172.21.15.81:0/1278882536 conn(0x7f7d400b1690 msgr2=0x7f7d4015ade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:45.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 shutdown_connections 2024-09-17T05:21:45.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.668+0000 7f7d46233640 1 -- 172.21.15.81:0/1278882536 wait complete. 2024-09-17T05:21:45.679 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:21:45.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.781+0000 7f9485ee6640 1 -- 172.21.15.81:0/1395597777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9468003a30 msgr2=0x7f9468003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.781+0000 7f9485ee6640 1 --2- 172.21.15.81:0/1395597777 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9468003a30 0x7f9468003e50 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f9470001dc0 tx=0x7f9468005830 comp rx=0 tx=0).stop 2024-09-17T05:21:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.781+0000 7f947ffff640 1 -- 172.21.15.81:0/1395597777 reap_dead start 2024-09-17T05:21:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.781+0000 7f9485ee6640 1 -- 172.21.15.81:0/1395597777 shutdown_connections 2024-09-17T05:21:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.781+0000 7f9485ee6640 1 -- 172.21.15.81:0/1395597777 >> 172.21.15.81:0/1395597777 conn(0x7f94800d0c20 msgr2=0x7f94800d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:45.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.781+0000 7f9485ee6640 1 -- 172.21.15.81:0/1395597777 shutdown_connections 2024-09-17T05:21:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.781+0000 7f9485ee6640 1 -- 172.21.15.81:0/1395597777 wait complete. 2024-09-17T05:21:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.782+0000 7f9485ee6640 1 Processor -- start 2024-09-17T05:21:45.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.782+0000 7f9485ee6640 1 -- start start 2024-09-17T05:21:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9468003a30 0x7f94801f0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94801594f0 0x7f94800ca180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94800ca6c0 0x7f94800b4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94800d0820 con 0x7f94801594f0 2024-09-17T05:21:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f94800d06a0 con 0x7f94800ca6c0 2024-09-17T05:21:45.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f94800cba60 con 0x7f9468003a30 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94801594f0 0x7f94800ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94801594f0 0x7f94800ca180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47606/0 (socket says 172.21.15.81:47606) 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 -- 172.21.15.81:0/3078517643 learned_addr learned my addr 172.21.15.81:0/3078517643 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 -- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9468003a30 msgr2=0x7f94801f0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9468003a30 0x7f94801f0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 -- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94800ca6c0 msgr2=0x7f94800b4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94800ca6c0 0x7f94800b4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 -- 172.21.15.81:0/3078517643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9480156f90 con 0x7f94801594f0 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f947effd640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94801594f0 0x7f94800ca180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9474001050 tx=0x7f9474003d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9467fff640 1 -- 172.21.15.81:0/3078517643 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474003e60 con 0x7f94801594f0 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9467fff640 1 -- 172.21.15.81:0/3078517643 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9474018020 con 0x7f94801594f0 2024-09-17T05:21:45.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94800cabd0 con 0x7f94801594f0 2024-09-17T05:21:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9467fff640 1 -- 172.21.15.81:0/3078517643 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9474011d20 con 0x7f94801594f0 2024-09-17T05:21:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.783+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94801f1410 con 0x7f94801594f0 2024-09-17T05:21:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.784+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94800cbff0 con 0x7f94801594f0 2024-09-17T05:21:45.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.785+0000 7f9467fff640 1 -- 172.21.15.81:0/3078517643 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f9474013450 con 0x7f94801594f0 2024-09-17T05:21:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.786+0000 7f9467fff640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f946c078d40 0x7f946c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.786+0000 7f9467fff640 1 -- 172.21.15.81:0/3078517643 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f947409e040 con 0x7f94801594f0 2024-09-17T05:21:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.786+0000 7f947f7fe640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f946c078d40 0x7f946c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:45.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.786+0000 7f947f7fe640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f946c078d40 0x7f946c07b200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9470032000 tx=0x7f94700014a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:45.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.790+0000 7f9467fff640 1 -- 172.21.15.81:0/3078517643 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9474022030 con 0x7f94801594f0 2024-09-17T05:21:45.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.963+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f94800b6ba0 con 0x7f946c078d40 2024-09-17T05:21:45.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.967+0000 7f9467fff640 1 -- 172.21.15.81:0/3078517643 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247500 (secure 0 0 0) 0x7f94800b6ba0 con 0x7f946c078d40 2024-09-17T05:21:45.970 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:45.972 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f946c078d40 msgr2=0x7f946c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f946c078d40 0x7f946c07b200 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f9470032000 tx=0x7f94700014a0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94801594f0 msgr2=0x7f94800ca180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94801594f0 0x7f94800ca180 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f9474001050 tx=0x7f9474003d30 comp rx=0 tx=0).stop 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 shutdown_connections 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f946c078d40 0x7f946c07b200 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94800ca6c0 0x7f94800b4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f94801594f0 0x7f94800ca180 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 --2- 172.21.15.81:0/3078517643 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9468003a30 0x7f94801f0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 >> 172.21.15.81:0/3078517643 conn(0x7f94800d0c20 msgr2=0x7f94800b2d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:45.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 shutdown_connections 2024-09-17T05:21:45.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:45.970+0000 7f9485ee6640 1 -- 172.21.15.81:0/3078517643 wait complete. 2024-09-17T05:21:45.981 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-17T05:21:45.417244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226748,"kb_used_data":6324,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747972,"statfs":{"total":773094113280,"available":772861923328,"internally_reserved":0,"allocated":6475776,"data_stored":3323789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469532"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956492+0000","last_change":"2024-09-17T05:21:40.956492+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956492+0000","last_undegraded":"2024-09-17T05:21:40.956492+0000","last_fullsized":"2024-09-17T05:21:40.956492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961469+0000","last_change":"2024-09-17T05:21:40.961469+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961469+0000","last_undegraded":"2024-09-17T05:21:40.961469+0000","last_fullsized":"2024-09-17T05:21:40.961469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959275+0000","last_change":"2024-09-17T05:21:40.959275+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959275+0000","last_undegraded":"2024-09-17T05:21:40.959275+0000","last_fullsized":"2024-09-17T05:21:40.959275+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958219+0000","last_change":"2024-09-17T05:21:40.958219+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958219+0000","last_undegraded":"2024-09-17T05:21:40.958219+0000","last_fullsized":"2024-09-17T05:21:40.958219+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957793+0000","last_change":"2024-09-17T05:21:40.957793+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957793+0000","last_undegraded":"2024-09-17T05:21:40.957793+0000","last_fullsized":"2024-09-17T05:21:40.957793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.973076+0000","last_change":"2024-09-17T05:21:41.966263+0000","last_active":"2024-09-17T05:21:41.973076+0000","last_peered":"2024-09-17T05:21:41.973076+0000","last_clean":"2024-09-17T05:21:41.973076+0000","last_became_active":"2024-09-17T05:21:41.965998+0000","last_became_peered":"2024-09-17T05:21:41.965998+0000","last_unstale":"2024-09-17T05:21:41.973076+0000","last_undegraded":"2024-09-17T05:21:41.973076+0000","last_fullsized":"2024-09-17T05:21:41.973076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:47.756519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953365+0000","last_change":"2024-09-17T05:21:40.953365+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953365+0000","last_undegraded":"2024-09-17T05:21:40.953365+0000","last_fullsized":"2024-09-17T05:21:40.953365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961669+0000","last_change":"2024-09-17T05:21:40.961669+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961669+0000","last_undegraded":"2024-09-17T05:21:40.961669+0000","last_fullsized":"2024-09-17T05:21:40.961669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952461+0000","last_change":"2024-09-17T05:21:40.952461+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952461+0000","last_undegraded":"2024-09-17T05:21:40.952461+0000","last_fullsized":"2024-09-17T05:21:40.952461+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954960+0000","last_change":"2024-09-17T05:21:40.954960+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954960+0000","last_undegraded":"2024-09-17T05:21:40.954960+0000","last_fullsized":"2024-09-17T05:21:40.954960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953449+0000","last_change":"2024-09-17T05:21:40.953449+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953449+0000","last_undegraded":"2024-09-17T05:21:40.953449+0000","last_fullsized":"2024-09-17T05:21:40.953449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957739+0000","last_change":"2024-09-17T05:21:40.957739+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957739+0000","last_undegraded":"2024-09-17T05:21:40.957739+0000","last_fullsized":"2024-09-17T05:21:40.957739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955240+0000","last_change":"2024-09-17T05:21:40.955240+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955240+0000","last_undegraded":"2024-09-17T05:21:40.955240+0000","last_fullsized":"2024-09-17T05:21:40.955240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952529+0000","last_change":"2024-09-17T05:21:40.952529+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952529+0000","last_undegraded":"2024-09-17T05:21:40.952529+0000","last_fullsized":"2024-09-17T05:21:40.952529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952386+0000","last_change":"2024-09-17T05:21:40.952386+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952386+0000","last_undegraded":"2024-09-17T05:21:40.952386+0000","last_fullsized":"2024-09-17T05:21:40.952386+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978469+0000","last_change":"2024-09-17T05:21:41.973282+0000","last_active":"2024-09-17T05:21:41.978469+0000","last_peered":"2024-09-17T05:21:41.978469+0000","last_clean":"2024-09-17T05:21:41.978469+0000","last_became_active":"2024-09-17T05:21:41.972899+0000","last_became_peered":"2024-09-17T05:21:41.972899+0000","last_unstale":"2024-09-17T05:21:41.978469+0000","last_undegraded":"2024-09-17T05:21:41.978469+0000","last_fullsized":"2024-09-17T05:21:41.978469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:13.151036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963021+0000","last_change":"2024-09-17T05:21:40.963021+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963021+0000","last_undegraded":"2024-09-17T05:21:40.963021+0000","last_fullsized":"2024-09-17T05:21:40.963021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959846+0000","last_change":"2024-09-17T05:21:40.959846+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959846+0000","last_undegraded":"2024-09-17T05:21:40.959846+0000","last_fullsized":"2024-09-17T05:21:40.959846+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957605+0000","last_change":"2024-09-17T05:21:40.957605+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957605+0000","last_undegraded":"2024-09-17T05:21:40.957605+0000","last_fullsized":"2024-09-17T05:21:40.957605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961482+0000","last_change":"2024-09-17T05:21:40.961482+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961482+0000","last_undegraded":"2024-09-17T05:21:40.961482+0000","last_fullsized":"2024-09-17T05:21:40.961482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959540+0000","last_change":"2024-09-17T05:21:40.959540+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959540+0000","last_undegraded":"2024-09-17T05:21:40.959540+0000","last_fullsized":"2024-09-17T05:21:40.959540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963974+0000","last_change":"2024-09-17T05:21:40.963974+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963974+0000","last_undegraded":"2024-09-17T05:21:40.963974+0000","last_fullsized":"2024-09-17T05:21:40.963974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958557+0000","last_change":"2024-09-17T05:21:40.958557+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958557+0000","last_undegraded":"2024-09-17T05:21:40.958557+0000","last_fullsized":"2024-09-17T05:21:40.958557+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955698+0000","last_change":"2024-09-17T05:21:40.955698+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955698+0000","last_undegraded":"2024-09-17T05:21:40.955698+0000","last_fullsized":"2024-09-17T05:21:40.955698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956132+0000","last_change":"2024-09-17T05:21:40.956132+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956132+0000","last_undegraded":"2024-09-17T05:21:40.956132+0000","last_fullsized":"2024-09-17T05:21:40.956132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958106+0000","last_change":"2024-09-17T05:21:40.958106+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958106+0000","last_undegraded":"2024-09-17T05:21:40.958106+0000","last_fullsized":"2024-09-17T05:21:40.958106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976288+0000","last_change":"2024-09-17T05:21:41.971075+0000","last_active":"2024-09-17T05:21:41.976288+0000","last_peered":"2024-09-17T05:21:41.976288+0000","last_clean":"2024-09-17T05:21:41.976288+0000","last_became_active":"2024-09-17T05:21:41.969951+0000","last_became_peered":"2024-09-17T05:21:41.969951+0000","last_unstale":"2024-09-17T05:21:41.976288+0000","last_undegraded":"2024-09-17T05:21:41.976288+0000","last_fullsized":"2024-09-17T05:21:41.976288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:47.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957520+0000","last_change":"2024-09-17T05:21:40.957520+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957520+0000","last_undegraded":"2024-09-17T05:21:40.957520+0000","last_fullsized":"2024-09-17T05:21:40.957520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961310+0000","last_change":"2024-09-17T05:21:40.961310+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961310+0000","last_undegraded":"2024-09-17T05:21:40.961310+0000","last_fullsized":"2024-09-17T05:21:40.961310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959462+0000","last_change":"2024-09-17T05:21:40.959462+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959462+0000","last_undegraded":"2024-09-17T05:21:40.959462+0000","last_fullsized":"2024-09-17T05:21:40.959462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955663+0000","last_change":"2024-09-17T05:21:40.955663+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955663+0000","last_undegraded":"2024-09-17T05:21:40.955663+0000","last_fullsized":"2024-09-17T05:21:40.955663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978446+0000","last_change":"2024-09-17T05:21:41.971005+0000","last_active":"2024-09-17T05:21:41.978446+0000","last_peered":"2024-09-17T05:21:41.978446+0000","last_clean":"2024-09-17T05:21:41.978446+0000","last_became_active":"2024-09-17T05:21:41.970391+0000","last_became_peered":"2024-09-17T05:21:41.970391+0000","last_unstale":"2024-09-17T05:21:41.978446+0000","last_undegraded":"2024-09-17T05:21:41.978446+0000","last_fullsized":"2024-09-17T05:21:41.978446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:25.078219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.977831+0000","last_change":"2024-09-17T05:21:41.968746+0000","last_active":"2024-09-17T05:21:41.977831+0000","last_peered":"2024-09-17T05:21:41.977831+0000","last_clean":"2024-09-17T05:21:41.977831+0000","last_became_active":"2024-09-17T05:21:41.968484+0000","last_became_peered":"2024-09-17T05:21:41.968484+0000","last_unstale":"2024-09-17T05:21:41.977831+0000","last_undegraded":"2024-09-17T05:21:41.977831+0000","last_fullsized":"2024-09-17T05:21:41.977831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:54.971834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.982342+0000","last_change":"2024-09-17T05:21:40.968346+0000","last_active":"2024-09-17T05:21:41.982342+0000","last_peered":"2024-09-17T05:21:41.982342+0000","last_clean":"2024-09-17T05:21:41.982342+0000","last_became_active":"2024-09-17T05:21:40.968049+0000","last_became_peered":"2024-09-17T05:21:40.968049+0000","last_unstale":"2024-09-17T05:21:41.982342+0000","last_undegraded":"2024-09-17T05:21:41.982342+0000","last_fullsized":"2024-09-17T05:21:41.982342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:01.544228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953367+0000","last_change":"2024-09-17T05:21:40.953367+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953367+0000","last_undegraded":"2024-09-17T05:21:40.953367+0000","last_fullsized":"2024-09-17T05:21:40.953367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970884+0000","last_change":"2024-09-17T05:21:40.967671+0000","last_active":"2024-09-17T05:21:40.970884+0000","last_peered":"2024-09-17T05:21:40.970884+0000","last_clean":"2024-09-17T05:21:40.970884+0000","last_became_active":"2024-09-17T05:21:40.967346+0000","last_became_peered":"2024-09-17T05:21:40.967346+0000","last_unstale":"2024-09-17T05:21:40.970884+0000","last_undegraded":"2024-09-17T05:21:40.970884+0000","last_fullsized":"2024-09-17T05:21:40.970884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:07.178757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978311+0000","last_change":"2024-09-17T05:21:41.969430+0000","last_active":"2024-09-17T05:21:41.978311+0000","last_peered":"2024-09-17T05:21:41.978311+0000","last_clean":"2024-09-17T05:21:41.978311+0000","last_became_active":"2024-09-17T05:21:41.969185+0000","last_became_peered":"2024-09-17T05:21:41.969185+0000","last_unstale":"2024-09-17T05:21:41.978311+0000","last_undegraded":"2024-09-17T05:21:41.978311+0000","last_fullsized":"2024-09-17T05:21:41.978311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:26.543092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.983832+0000","last_change":"2024-09-17T05:21:40.955534+0000","last_active":"2024-09-17T05:21:41.983832+0000","last_peered":"2024-09-17T05:21:41.983832+0000","last_clean":"2024-09-17T05:21:41.983832+0000","last_became_active":"2024-09-17T05:21:40.955159+0000","last_became_peered":"2024-09-17T05:21:40.955159+0000","last_unstale":"2024-09-17T05:21:41.983832+0000","last_undegraded":"2024-09-17T05:21:41.983832+0000","last_fullsized":"2024-09-17T05:21:41.983832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:48.548506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978521+0000","last_change":"2024-09-17T05:21:41.973041+0000","last_active":"2024-09-17T05:21:41.978521+0000","last_peered":"2024-09-17T05:21:41.978521+0000","last_clean":"2024-09-17T05:21:41.978521+0000","last_became_active":"2024-09-17T05:21:41.972532+0000","last_became_peered":"2024-09-17T05:21:41.972532+0000","last_unstale":"2024-09-17T05:21:41.978521+0000","last_undegraded":"2024-09-17T05:21:41.978521+0000","last_fullsized":"2024-09-17T05:21:41.978521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:29.553319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969613+0000","last_change":"2024-09-17T05:21:40.965725+0000","last_active":"2024-09-17T05:21:40.969613+0000","last_peered":"2024-09-17T05:21:40.969613+0000","last_clean":"2024-09-17T05:21:40.969613+0000","last_became_active":"2024-09-17T05:21:40.965447+0000","last_became_peered":"2024-09-17T05:21:40.965447+0000","last_unstale":"2024-09-17T05:21:40.969613+0000","last_undegraded":"2024-09-17T05:21:40.969613+0000","last_fullsized":"2024-09-17T05:21:40.969613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:55.548456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963621+0000","last_change":"2024-09-17T05:21:40.963621+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963621+0000","last_undegraded":"2024-09-17T05:21:40.963621+0000","last_fullsized":"2024-09-17T05:21:40.963621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969075+0000","last_change":"2024-09-17T05:21:40.963116+0000","last_active":"2024-09-17T05:21:40.969075+0000","last_peered":"2024-09-17T05:21:40.969075+0000","last_clean":"2024-09-17T05:21:40.969075+0000","last_became_active":"2024-09-17T05:21:40.961833+0000","last_became_peered":"2024-09-17T05:21:40.961833+0000","last_unstale":"2024-09-17T05:21:40.969075+0000","last_undegraded":"2024-09-17T05:21:40.969075+0000","last_fullsized":"2024-09-17T05:21:40.969075+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:37.860369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961806+0000","last_change":"2024-09-17T05:21:40.961806+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961806+0000","last_undegraded":"2024-09-17T05:21:40.961806+0000","last_fullsized":"2024-09-17T05:21:40.961806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.981651+0000","last_change":"2024-09-17T05:21:40.963990+0000","last_active":"2024-09-17T05:21:41.981651+0000","last_peered":"2024-09-17T05:21:41.981651+0000","last_clean":"2024-09-17T05:21:41.981651+0000","last_became_active":"2024-09-17T05:21:40.963731+0000","last_became_peered":"2024-09-17T05:21:40.963731+0000","last_unstale":"2024-09-17T05:21:41.981651+0000","last_undegraded":"2024-09-17T05:21:41.981651+0000","last_fullsized":"2024-09-17T05:21:41.981651+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:56.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955212+0000","last_change":"2024-09-17T05:21:40.955212+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955212+0000","last_undegraded":"2024-09-17T05:21:40.955212+0000","last_fullsized":"2024-09-17T05:21:40.955212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.974434+0000","last_change":"2024-09-17T05:21:40.969945+0000","last_active":"2024-09-17T05:21:40.974434+0000","last_peered":"2024-09-17T05:21:40.974434+0000","last_clean":"2024-09-17T05:21:40.974434+0000","last_became_active":"2024-09-17T05:21:40.969578+0000","last_became_peered":"2024-09-17T05:21:40.969578+0000","last_unstale":"2024-09-17T05:21:40.974434+0000","last_undegraded":"2024-09-17T05:21:40.974434+0000","last_fullsized":"2024-09-17T05:21:40.974434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.960703+0000","last_change":"2024-09-17T05:21:40.960703+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.960703+0000","last_undegraded":"2024-09-17T05:21:40.960703+0000","last_fullsized":"2024-09-17T05:21:40.960703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969938+0000","last_change":"2024-09-17T05:21:40.964753+0000","last_active":"2024-09-17T05:21:40.969938+0000","last_peered":"2024-09-17T05:21:40.969938+0000","last_clean":"2024-09-17T05:21:40.969938+0000","last_became_active":"2024-09-17T05:21:40.964467+0000","last_became_peered":"2024-09-17T05:21:40.964467+0000","last_unstale":"2024-09-17T05:21:40.969938+0000","last_undegraded":"2024-09-17T05:21:40.969938+0000","last_fullsized":"2024-09-17T05:21:40.969938+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:05.070651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952679+0000","last_change":"2024-09-17T05:21:40.952679+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952679+0000","last_undegraded":"2024-09-17T05:21:40.952679+0000","last_fullsized":"2024-09-17T05:21:40.952679+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969299+0000","last_change":"2024-09-17T05:21:40.966548+0000","last_active":"2024-09-17T05:21:40.969299+0000","last_peered":"2024-09-17T05:21:40.969299+0000","last_clean":"2024-09-17T05:21:40.969299+0000","last_became_active":"2024-09-17T05:21:40.966011+0000","last_became_peered":"2024-09-17T05:21:40.966011+0000","last_unstale":"2024-09-17T05:21:40.969299+0000","last_undegraded":"2024-09-17T05:21:40.969299+0000","last_fullsized":"2024-09-17T05:21:40.969299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958287+0000","last_change":"2024-09-17T05:21:40.958287+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958287+0000","last_undegraded":"2024-09-17T05:21:40.958287+0000","last_fullsized":"2024-09-17T05:21:40.958287+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.965236+0000","last_change":"2024-09-17T05:21:40.964038+0000","last_active":"2024-09-17T05:21:40.965236+0000","last_peered":"2024-09-17T05:21:40.965236+0000","last_clean":"2024-09-17T05:21:40.965236+0000","last_became_active":"2024-09-17T05:21:40.963792+0000","last_became_peered":"2024-09-17T05:21:40.963792+0000","last_unstale":"2024-09-17T05:21:40.965236+0000","last_undegraded":"2024-09-17T05:21:40.965236+0000","last_fullsized":"2024-09-17T05:21:40.965236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:49.506583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954113+0000","last_change":"2024-09-17T05:21:40.954113+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954113+0000","last_undegraded":"2024-09-17T05:21:40.954113+0000","last_fullsized":"2024-09-17T05:21:40.954113+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970160+0000","last_change":"2024-09-17T05:21:40.968246+0000","last_active":"2024-09-17T05:21:40.970160+0000","last_peered":"2024-09-17T05:21:40.970160+0000","last_clean":"2024-09-17T05:21:40.970160+0000","last_became_active":"2024-09-17T05:21:40.968012+0000","last_became_peered":"2024-09-17T05:21:40.968012+0000","last_unstale":"2024-09-17T05:21:40.970160+0000","last_undegraded":"2024-09-17T05:21:40.970160+0000","last_fullsized":"2024-09-17T05:21:40.970160+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958264+0000","last_change":"2024-09-17T05:21:40.958264+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958264+0000","last_undegraded":"2024-09-17T05:21:40.958264+0000","last_fullsized":"2024-09-17T05:21:40.958264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964872+0000","last_change":"2024-09-17T05:21:40.960153+0000","last_active":"2024-09-17T05:21:40.964872+0000","last_peered":"2024-09-17T05:21:40.964872+0000","last_clean":"2024-09-17T05:21:40.964872+0000","last_became_active":"2024-09-17T05:21:40.959884+0000","last_became_peered":"2024-09-17T05:21:40.959884+0000","last_unstale":"2024-09-17T05:21:40.964872+0000","last_undegraded":"2024-09-17T05:21:40.964872+0000","last_fullsized":"2024-09-17T05:21:40.964872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.792618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957038+0000","last_change":"2024-09-17T05:21:40.957038+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957038+0000","last_undegraded":"2024-09-17T05:21:40.957038+0000","last_fullsized":"2024-09-17T05:21:40.957038+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970840+0000","last_change":"2024-09-17T05:21:40.966702+0000","last_active":"2024-09-17T05:21:40.970840+0000","last_peered":"2024-09-17T05:21:40.970840+0000","last_clean":"2024-09-17T05:21:40.970840+0000","last_became_active":"2024-09-17T05:21:40.966428+0000","last_became_peered":"2024-09-17T05:21:40.966428+0000","last_unstale":"2024-09-17T05:21:40.970840+0000","last_undegraded":"2024-09-17T05:21:40.970840+0000","last_fullsized":"2024-09-17T05:21:40.970840+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:15.960978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959085+0000","last_change":"2024-09-17T05:21:40.959085+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959085+0000","last_undegraded":"2024-09-17T05:21:40.959085+0000","last_fullsized":"2024-09-17T05:21:40.959085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968922+0000","last_change":"2024-09-17T05:21:40.964010+0000","last_active":"2024-09-17T05:21:40.968922+0000","last_peered":"2024-09-17T05:21:40.968922+0000","last_clean":"2024-09-17T05:21:40.968922+0000","last_became_active":"2024-09-17T05:21:40.963746+0000","last_became_peered":"2024-09-17T05:21:40.963746+0000","last_unstale":"2024-09-17T05:21:40.968922+0000","last_undegraded":"2024-09-17T05:21:40.968922+0000","last_fullsized":"2024-09-17T05:21:40.968922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:42.681141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952845+0000","last_change":"2024-09-17T05:21:40.952845+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952845+0000","last_undegraded":"2024-09-17T05:21:40.952845+0000","last_fullsized":"2024-09-17T05:21:40.952845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968927+0000","last_change":"2024-09-17T05:21:40.963557+0000","last_active":"2024-09-17T05:21:40.968927+0000","last_peered":"2024-09-17T05:21:40.968927+0000","last_clean":"2024-09-17T05:21:40.968927+0000","last_became_active":"2024-09-17T05:21:40.963038+0000","last_became_peered":"2024-09-17T05:21:40.963038+0000","last_unstale":"2024-09-17T05:21:40.968927+0000","last_undegraded":"2024-09-17T05:21:40.968927+0000","last_fullsized":"2024-09-17T05:21:40.968927+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:29.652603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958146+0000","last_change":"2024-09-17T05:21:40.958146+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958146+0000","last_undegraded":"2024-09-17T05:21:40.958146+0000","last_fullsized":"2024-09-17T05:21:40.958146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.976907+0000","last_change":"2024-09-17T05:21:40.969574+0000","last_active":"2024-09-17T05:21:40.976907+0000","last_peered":"2024-09-17T05:21:40.976907+0000","last_clean":"2024-09-17T05:21:40.976907+0000","last_became_active":"2024-09-17T05:21:40.969303+0000","last_became_peered":"2024-09-17T05:21:40.969303+0000","last_unstale":"2024-09-17T05:21:40.976907+0000","last_undegraded":"2024-09-17T05:21:40.976907+0000","last_fullsized":"2024-09-17T05:21:40.976907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959421+0000","last_change":"2024-09-17T05:21:40.959421+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959421+0000","last_undegraded":"2024-09-17T05:21:40.959421+0000","last_fullsized":"2024-09-17T05:21:40.959421+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968013+0000","last_change":"2024-09-17T05:21:40.964669+0000","last_active":"2024-09-17T05:21:40.968013+0000","last_peered":"2024-09-17T05:21:40.968013+0000","last_clean":"2024-09-17T05:21:40.968013+0000","last_became_active":"2024-09-17T05:21:40.964429+0000","last_became_peered":"2024-09-17T05:21:40.964429+0000","last_unstale":"2024-09-17T05:21:40.968013+0000","last_undegraded":"2024-09-17T05:21:40.968013+0000","last_fullsized":"2024-09-17T05:21:40.968013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:56.840775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957759+0000","last_change":"2024-09-17T05:21:40.957759+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957759+0000","last_undegraded":"2024-09-17T05:21:40.957759+0000","last_fullsized":"2024-09-17T05:21:40.957759+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.986567+0000","last_change":"2024-09-17T05:21:40.963624+0000","last_active":"2024-09-17T05:21:41.986567+0000","last_peered":"2024-09-17T05:21:41.986567+0000","last_clean":"2024-09-17T05:21:41.986567+0000","last_became_active":"2024-09-17T05:21:40.963377+0000","last_became_peered":"2024-09-17T05:21:40.963377+0000","last_unstale":"2024-09-17T05:21:41.986567+0000","last_undegraded":"2024-09-17T05:21:41.986567+0000","last_fullsized":"2024-09-17T05:21:41.986567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:01.418973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961057+0000","last_change":"2024-09-17T05:21:40.961057+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961057+0000","last_undegraded":"2024-09-17T05:21:40.961057+0000","last_fullsized":"2024-09-17T05:21:40.961057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969907+0000","last_change":"2024-09-17T05:21:40.965780+0000","last_active":"2024-09-17T05:21:40.969907+0000","last_peered":"2024-09-17T05:21:40.969907+0000","last_clean":"2024-09-17T05:21:40.969907+0000","last_became_active":"2024-09-17T05:21:40.965506+0000","last_became_peered":"2024-09-17T05:21:40.965506+0000","last_unstale":"2024-09-17T05:21:40.969907+0000","last_undegraded":"2024-09-17T05:21:40.969907+0000","last_fullsized":"2024-09-17T05:21:40.969907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957830+0000","last_change":"2024-09-17T05:21:40.957830+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957830+0000","last_undegraded":"2024-09-17T05:21:40.957830+0000","last_fullsized":"2024-09-17T05:21:40.957830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.957445+0000","last_change":"2024-09-17T05:21:40.967020+0000","last_active":"2024-09-17T05:21:41.957445+0000","last_peered":"2024-09-17T05:21:41.957445+0000","last_clean":"2024-09-17T05:21:41.957445+0000","last_became_active":"2024-09-17T05:21:40.966744+0000","last_became_peered":"2024-09-17T05:21:40.966744+0000","last_unstale":"2024-09-17T05:21:41.957445+0000","last_undegraded":"2024-09-17T05:21:41.957445+0000","last_fullsized":"2024-09-17T05:21:41.957445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:49.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956537+0000","last_change":"2024-09-17T05:21:40.956537+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956537+0000","last_undegraded":"2024-09-17T05:21:40.956537+0000","last_fullsized":"2024-09-17T05:21:40.956537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971416+0000","last_change":"2024-09-17T05:21:40.969833+0000","last_active":"2024-09-17T05:21:40.971416+0000","last_peered":"2024-09-17T05:21:40.971416+0000","last_clean":"2024-09-17T05:21:40.971416+0000","last_became_active":"2024-09-17T05:21:40.969550+0000","last_became_peered":"2024-09-17T05:21:40.969550+0000","last_unstale":"2024-09-17T05:21:40.971416+0000","last_undegraded":"2024-09-17T05:21:40.971416+0000","last_fullsized":"2024-09-17T05:21:40.971416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:13.362775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978954+0000","last_change":"2024-09-17T05:21:41.975403+0000","last_active":"2024-09-17T05:21:41.978954+0000","last_peered":"2024-09-17T05:21:41.978954+0000","last_clean":"2024-09-17T05:21:41.978954+0000","last_became_active":"2024-09-17T05:21:41.975049+0000","last_became_peered":"2024-09-17T05:21:41.975049+0000","last_unstale":"2024-09-17T05:21:41.978954+0000","last_undegraded":"2024-09-17T05:21:41.978954+0000","last_fullsized":"2024-09-17T05:21:41.978954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:06.056960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.962271+0000","last_change":"2024-09-17T05:21:40.958820+0000","last_active":"2024-09-17T05:21:40.962271+0000","last_peered":"2024-09-17T05:21:40.962271+0000","last_clean":"2024-09-17T05:21:40.962271+0000","last_became_active":"2024-09-17T05:21:40.958548+0000","last_became_peered":"2024-09-17T05:21:40.958548+0000","last_unstale":"2024-09-17T05:21:40.962271+0000","last_undegraded":"2024-09-17T05:21:40.962271+0000","last_fullsized":"2024-09-17T05:21:40.962271+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:40.305357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976909+0000","last_change":"2024-09-17T05:21:41.968799+0000","last_active":"2024-09-17T05:21:41.976909+0000","last_peered":"2024-09-17T05:21:41.976909+0000","last_clean":"2024-09-17T05:21:41.976909+0000","last_became_active":"2024-09-17T05:21:41.968530+0000","last_became_peered":"2024-09-17T05:21:41.968530+0000","last_unstale":"2024-09-17T05:21:41.976909+0000","last_undegraded":"2024-09-17T05:21:41.976909+0000","last_fullsized":"2024-09-17T05:21:41.976909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:00.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969912+0000","last_change":"2024-09-17T05:21:40.966445+0000","last_active":"2024-09-17T05:21:40.969912+0000","last_peered":"2024-09-17T05:21:40.969912+0000","last_clean":"2024-09-17T05:21:40.969912+0000","last_became_active":"2024-09-17T05:21:40.966200+0000","last_became_peered":"2024-09-17T05:21:40.966200+0000","last_unstale":"2024-09-17T05:21:40.969912+0000","last_undegraded":"2024-09-17T05:21:40.969912+0000","last_fullsized":"2024-09-17T05:21:40.969912+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956988+0000","last_change":"2024-09-17T05:21:40.956988+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956988+0000","last_undegraded":"2024-09-17T05:21:40.956988+0000","last_fullsized":"2024-09-17T05:21:40.956988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968291+0000","last_change":"2024-09-17T05:21:40.966051+0000","last_active":"2024-09-17T05:21:40.968291+0000","last_peered":"2024-09-17T05:21:40.968291+0000","last_clean":"2024-09-17T05:21:40.968291+0000","last_became_active":"2024-09-17T05:21:40.965771+0000","last_became_peered":"2024-09-17T05:21:40.965771+0000","last_unstale":"2024-09-17T05:21:40.968291+0000","last_undegraded":"2024-09-17T05:21:40.968291+0000","last_fullsized":"2024-09-17T05:21:40.968291+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.183423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957198+0000","last_change":"2024-09-17T05:21:40.957198+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957198+0000","last_undegraded":"2024-09-17T05:21:40.957198+0000","last_fullsized":"2024-09-17T05:21:40.957198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.968881+0000","last_change":"2024-09-17T05:21:40.964246+0000","last_active":"2024-09-17T05:21:42.968881+0000","last_peered":"2024-09-17T05:21:42.968881+0000","last_clean":"2024-09-17T05:21:42.968881+0000","last_became_active":"2024-09-17T05:21:40.963976+0000","last_became_peered":"2024-09-17T05:21:40.963976+0000","last_unstale":"2024-09-17T05:21:42.968881+0000","last_undegraded":"2024-09-17T05:21:42.968881+0000","last_fullsized":"2024-09-17T05:21:42.968881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:33.579472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953710+0000","last_change":"2024-09-17T05:21:40.953710+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953710+0000","last_undegraded":"2024-09-17T05:21:40.953710+0000","last_fullsized":"2024-09-17T05:21:40.953710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964214+0000","last_change":"2024-09-17T05:21:40.963049+0000","last_active":"2024-09-17T05:21:40.964214+0000","last_peered":"2024-09-17T05:21:40.964214+0000","last_clean":"2024-09-17T05:21:40.964214+0000","last_became_active":"2024-09-17T05:21:40.962743+0000","last_became_peered":"2024-09-17T05:21:40.962743+0000","last_unstale":"2024-09-17T05:21:40.964214+0000","last_undegraded":"2024-09-17T05:21:40.964214+0000","last_fullsized":"2024-09-17T05:21:40.964214+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:57.944586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978212+0000","last_change":"2024-09-17T05:21:41.972775+0000","last_active":"2024-09-17T05:21:41.978212+0000","last_peered":"2024-09-17T05:21:41.978212+0000","last_clean":"2024-09-17T05:21:41.978212+0000","last_became_active":"2024-09-17T05:21:41.972226+0000","last_became_peered":"2024-09-17T05:21:41.972226+0000","last_unstale":"2024-09-17T05:21:41.978212+0000","last_undegraded":"2024-09-17T05:21:41.978212+0000","last_fullsized":"2024-09-17T05:21:41.978212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969581+0000","last_change":"2024-09-17T05:21:40.965286+0000","last_active":"2024-09-17T05:21:40.969581+0000","last_peered":"2024-09-17T05:21:40.969581+0000","last_clean":"2024-09-17T05:21:40.969581+0000","last_became_active":"2024-09-17T05:21:40.963994+0000","last_became_peered":"2024-09-17T05:21:40.963994+0000","last_unstale":"2024-09-17T05:21:40.969581+0000","last_undegraded":"2024-09-17T05:21:40.969581+0000","last_fullsized":"2024-09-17T05:21:40.969581+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:58.092810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963247+0000","last_change":"2024-09-17T05:21:40.963247+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963247+0000","last_undegraded":"2024-09-17T05:21:40.963247+0000","last_fullsized":"2024-09-17T05:21:40.963247+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968342+0000","last_change":"2024-09-17T05:21:40.966188+0000","last_active":"2024-09-17T05:21:40.968342+0000","last_peered":"2024-09-17T05:21:40.968342+0000","last_clean":"2024-09-17T05:21:40.968342+0000","last_became_active":"2024-09-17T05:21:40.965925+0000","last_became_peered":"2024-09-17T05:21:40.965925+0000","last_unstale":"2024-09-17T05:21:40.968342+0000","last_undegraded":"2024-09-17T05:21:40.968342+0000","last_fullsized":"2024-09-17T05:21:40.968342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:30.135801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957598+0000","last_change":"2024-09-17T05:21:40.957598+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957598+0000","last_undegraded":"2024-09-17T05:21:40.957598+0000","last_fullsized":"2024-09-17T05:21:40.957598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.961276+0000","last_change":"2024-09-17T05:21:40.955869+0000","last_active":"2024-09-17T05:21:40.961276+0000","last_peered":"2024-09-17T05:21:40.961276+0000","last_clean":"2024-09-17T05:21:40.961276+0000","last_became_active":"2024-09-17T05:21:40.955539+0000","last_became_peered":"2024-09-17T05:21:40.955539+0000","last_unstale":"2024-09-17T05:21:40.961276+0000","last_undegraded":"2024-09-17T05:21:40.961276+0000","last_fullsized":"2024-09-17T05:21:40.961276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:44.437748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953261+0000","last_change":"2024-09-17T05:21:40.953261+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953261+0000","last_undegraded":"2024-09-17T05:21:40.953261+0000","last_fullsized":"2024-09-17T05:21:40.953261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.959366+0000","last_change":"2024-09-17T05:21:40.958018+0000","last_active":"2024-09-17T05:21:40.959366+0000","last_peered":"2024-09-17T05:21:40.959366+0000","last_clean":"2024-09-17T05:21:40.959366+0000","last_became_active":"2024-09-17T05:21:40.957745+0000","last_became_peered":"2024-09-17T05:21:40.957745+0000","last_unstale":"2024-09-17T05:21:40.959366+0000","last_undegraded":"2024-09-17T05:21:40.959366+0000","last_fullsized":"2024-09-17T05:21:40.959366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:00.937883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959744+0000","last_change":"2024-09-17T05:21:40.959744+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959744+0000","last_undegraded":"2024-09-17T05:21:40.959744+0000","last_fullsized":"2024-09-17T05:21:40.959744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971410+0000","last_change":"2024-09-17T05:21:40.969445+0000","last_active":"2024-09-17T05:21:40.971410+0000","last_peered":"2024-09-17T05:21:40.971410+0000","last_clean":"2024-09-17T05:21:40.971410+0000","last_became_active":"2024-09-17T05:21:40.969235+0000","last_became_peered":"2024-09-17T05:21:40.969235+0000","last_unstale":"2024-09-17T05:21:40.971410+0000","last_undegraded":"2024-09-17T05:21:40.971410+0000","last_fullsized":"2024-09-17T05:21:40.971410+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:05.115216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961194+0000","last_change":"2024-09-17T05:21:40.961194+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961194+0000","last_undegraded":"2024-09-17T05:21:40.961194+0000","last_fullsized":"2024-09-17T05:21:40.961194+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969072+0000","last_change":"2024-09-17T05:21:40.965053+0000","last_active":"2024-09-17T05:21:40.969072+0000","last_peered":"2024-09-17T05:21:40.969072+0000","last_clean":"2024-09-17T05:21:40.969072+0000","last_became_active":"2024-09-17T05:21:40.964717+0000","last_became_peered":"2024-09-17T05:21:40.964717+0000","last_unstale":"2024-09-17T05:21:40.969072+0000","last_undegraded":"2024-09-17T05:21:40.969072+0000","last_fullsized":"2024-09-17T05:21:40.969072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:30.434888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.960480+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:21:40.960480+0000","last_peered":"2024-09-17T05:21:40.960480+0000","last_clean":"2024-09-17T05:21:40.960480+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:21:40.960480+0000","last_undegraded":"2024-09-17T05:21:40.960480+0000","last_fullsized":"2024-09-17T05:21:40.960480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1257472,"data_stored":860262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":869231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:45.986 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 -- 172.21.15.81:0/2596564487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd80d49c0 msgr2=0x7f1cd80b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 --2- 172.21.15.81:0/2596564487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd80d49c0 0x7f1cd80b3800 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0005fd0 tx=0x7f1cd002aa90 comp rx=0 tx=0).stop 2024-09-17T05:21:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 -- 172.21.15.81:0/2596564487 shutdown_connections 2024-09-17T05:21:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 --2- 172.21.15.81:0/2596564487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd80d49c0 0x7f1cd80b3800 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 --2- 172.21.15.81:0/2596564487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd80d0d40 0x7f1cd80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 -- 172.21.15.81:0/2596564487 >> 172.21.15.81:0/2596564487 conn(0x7f1cd80d3ea0 msgr2=0x7f1cd80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 -- 172.21.15.81:0/2596564487 shutdown_connections 2024-09-17T05:21:46.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.123+0000 7f1cdd462640 1 -- 172.21.15.81:0/2596564487 wait complete. 2024-09-17T05:21:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.124+0000 7f1cdd462640 1 Processor -- start 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.124+0000 7f1cdd462640 1 -- start start 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cdd462640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd80d0d40 0x7f1cd814dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cdd462640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd80d49c0 0x7f1cd809f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cdd462640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd815df90 0x7f1cd814f810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cdd462640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd8162690 con 0x7f1cd815df90 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cdd462640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1cd80b3d40 con 0x7f1cd80d0d40 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cdd462640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1cd814dff0 con 0x7f1cd80d49c0 2024-09-17T05:21:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd815df90 0x7f1cd814f810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd815df90 0x7f1cd814f810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47624/0 (socket says 172.21.15.81:47624) 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 -- 172.21.15.81:0/3243943518 learned_addr learned my addr 172.21.15.81:0/3243943518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd67fc640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd80d49c0 0x7f1cd809f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd6ffd640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd80d0d40 0x7f1cd814dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 -- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd80d49c0 msgr2=0x7f1cd809f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd80d49c0 0x7f1cd809f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 -- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd80d0d40 msgr2=0x7f1cd814dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd80d0d40 0x7f1cd814dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd77fe640 1 -- 172.21.15.81:0/3243943518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1cd814e770 con 0x7f1cd815df90 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.125+0000 7f1cd6ffd640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd80d0d40 0x7f1cd814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.126+0000 7f1cd77fe640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd815df90 0x7f1cd814f810 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009bf0 tx=0x7f1cd0003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.126+0000 7f1cbf7fe640 1 -- 172.21.15.81:0/3243943518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0046070 con 0x7f1cd815df90 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.126+0000 7f1cbf7fe640 1 -- 172.21.15.81:0/3243943518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1cd0004040 con 0x7f1cd815df90 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.126+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1cd814ea50 con 0x7f1cd815df90 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.126+0000 7f1cbf7fe640 1 -- 172.21.15.81:0/3243943518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1cd0004450 con 0x7f1cd815df90 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.126+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1cd814f010 con 0x7f1cd815df90 2024-09-17T05:21:46.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.127+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1cd80b5620 con 0x7f1cd815df90 2024-09-17T05:21:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.127+0000 7f1cbf7fe640 1 -- 172.21.15.81:0/3243943518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f1cd0049070 con 0x7f1cd815df90 2024-09-17T05:21:46.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.128+0000 7f1cbf7fe640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1cc4078d40 0x7f1cc407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.128+0000 7f1cbf7fe640 1 -- 172.21.15.81:0/3243943518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f1cd00bbe80 con 0x7f1cd815df90 2024-09-17T05:21:46.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.128+0000 7f1cd6ffd640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1cc4078d40 0x7f1cc407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.129+0000 7f1cd6ffd640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1cc4078d40 0x7f1cc407b200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007fd0 tx=0x7f1cc8009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:46.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.132+0000 7f1cbf7fe640 1 -- 172.21.15.81:0/3243943518 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1cd80b5620 con 0x7f1cd815df90 2024-09-17T05:21:46.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.305+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1cd80cf9b0 con 0x7f1cc4078d40 2024-09-17T05:21:46.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.310+0000 7f1cbf7fe640 1 -- 172.21.15.81:0/3243943518 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247500 (secure 0 0 0) 0x7f1cd80cf9b0 con 0x7f1cc4078d40 2024-09-17T05:21:46.312 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:46.317 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1cc4078d40 msgr2=0x7f1cc407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1cc4078d40 0x7f1cc407b200 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007fd0 tx=0x7f1cc8009040 comp rx=0 tx=0).stop 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd815df90 msgr2=0x7f1cd814f810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd815df90 0x7f1cd814f810 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f1cd0009bf0 tx=0x7f1cd0003ba0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 shutdown_connections 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1cc4078d40 0x7f1cc407b200 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1cd815df90 0x7f1cd814f810 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1cd80d49c0 0x7f1cd809f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 --2- 172.21.15.81:0/3243943518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1cd80d0d40 0x7f1cd814dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 >> 172.21.15.81:0/3243943518 conn(0x7f1cd80d3ea0 msgr2=0x7f1cd80b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 shutdown_connections 2024-09-17T05:21:46.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.313+0000 7f1cdd462640 1 -- 172.21.15.81:0/3243943518 wait complete. 2024-09-17T05:21:46.324 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-17T05:21:45.417244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226748,"kb_used_data":6324,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747972,"statfs":{"total":773094113280,"available":772861923328,"internally_reserved":0,"allocated":6475776,"data_stored":3323789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469532"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956492+0000","last_change":"2024-09-17T05:21:40.956492+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956492+0000","last_undegraded":"2024-09-17T05:21:40.956492+0000","last_fullsized":"2024-09-17T05:21:40.956492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961469+0000","last_change":"2024-09-17T05:21:40.961469+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961469+0000","last_undegraded":"2024-09-17T05:21:40.961469+0000","last_fullsized":"2024-09-17T05:21:40.961469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959275+0000","last_change":"2024-09-17T05:21:40.959275+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959275+0000","last_undegraded":"2024-09-17T05:21:40.959275+0000","last_fullsized":"2024-09-17T05:21:40.959275+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958219+0000","last_change":"2024-09-17T05:21:40.958219+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958219+0000","last_undegraded":"2024-09-17T05:21:40.958219+0000","last_fullsized":"2024-09-17T05:21:40.958219+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957793+0000","last_change":"2024-09-17T05:21:40.957793+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957793+0000","last_undegraded":"2024-09-17T05:21:40.957793+0000","last_fullsized":"2024-09-17T05:21:40.957793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.973076+0000","last_change":"2024-09-17T05:21:41.966263+0000","last_active":"2024-09-17T05:21:41.973076+0000","last_peered":"2024-09-17T05:21:41.973076+0000","last_clean":"2024-09-17T05:21:41.973076+0000","last_became_active":"2024-09-17T05:21:41.965998+0000","last_became_peered":"2024-09-17T05:21:41.965998+0000","last_unstale":"2024-09-17T05:21:41.973076+0000","last_undegraded":"2024-09-17T05:21:41.973076+0000","last_fullsized":"2024-09-17T05:21:41.973076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:47.756519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953365+0000","last_change":"2024-09-17T05:21:40.953365+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953365+0000","last_undegraded":"2024-09-17T05:21:40.953365+0000","last_fullsized":"2024-09-17T05:21:40.953365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961669+0000","last_change":"2024-09-17T05:21:40.961669+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961669+0000","last_undegraded":"2024-09-17T05:21:40.961669+0000","last_fullsized":"2024-09-17T05:21:40.961669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952461+0000","last_change":"2024-09-17T05:21:40.952461+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952461+0000","last_undegraded":"2024-09-17T05:21:40.952461+0000","last_fullsized":"2024-09-17T05:21:40.952461+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954960+0000","last_change":"2024-09-17T05:21:40.954960+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954960+0000","last_undegraded":"2024-09-17T05:21:40.954960+0000","last_fullsized":"2024-09-17T05:21:40.954960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953449+0000","last_change":"2024-09-17T05:21:40.953449+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953449+0000","last_undegraded":"2024-09-17T05:21:40.953449+0000","last_fullsized":"2024-09-17T05:21:40.953449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957739+0000","last_change":"2024-09-17T05:21:40.957739+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957739+0000","last_undegraded":"2024-09-17T05:21:40.957739+0000","last_fullsized":"2024-09-17T05:21:40.957739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955240+0000","last_change":"2024-09-17T05:21:40.955240+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955240+0000","last_undegraded":"2024-09-17T05:21:40.955240+0000","last_fullsized":"2024-09-17T05:21:40.955240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952529+0000","last_change":"2024-09-17T05:21:40.952529+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952529+0000","last_undegraded":"2024-09-17T05:21:40.952529+0000","last_fullsized":"2024-09-17T05:21:40.952529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952386+0000","last_change":"2024-09-17T05:21:40.952386+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952386+0000","last_undegraded":"2024-09-17T05:21:40.952386+0000","last_fullsized":"2024-09-17T05:21:40.952386+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978469+0000","last_change":"2024-09-17T05:21:41.973282+0000","last_active":"2024-09-17T05:21:41.978469+0000","last_peered":"2024-09-17T05:21:41.978469+0000","last_clean":"2024-09-17T05:21:41.978469+0000","last_became_active":"2024-09-17T05:21:41.972899+0000","last_became_peered":"2024-09-17T05:21:41.972899+0000","last_unstale":"2024-09-17T05:21:41.978469+0000","last_undegraded":"2024-09-17T05:21:41.978469+0000","last_fullsized":"2024-09-17T05:21:41.978469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:13.151036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963021+0000","last_change":"2024-09-17T05:21:40.963021+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963021+0000","last_undegraded":"2024-09-17T05:21:40.963021+0000","last_fullsized":"2024-09-17T05:21:40.963021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959846+0000","last_change":"2024-09-17T05:21:40.959846+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959846+0000","last_undegraded":"2024-09-17T05:21:40.959846+0000","last_fullsized":"2024-09-17T05:21:40.959846+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957605+0000","last_change":"2024-09-17T05:21:40.957605+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957605+0000","last_undegraded":"2024-09-17T05:21:40.957605+0000","last_fullsized":"2024-09-17T05:21:40.957605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961482+0000","last_change":"2024-09-17T05:21:40.961482+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961482+0000","last_undegraded":"2024-09-17T05:21:40.961482+0000","last_fullsized":"2024-09-17T05:21:40.961482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959540+0000","last_change":"2024-09-17T05:21:40.959540+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959540+0000","last_undegraded":"2024-09-17T05:21:40.959540+0000","last_fullsized":"2024-09-17T05:21:40.959540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963974+0000","last_change":"2024-09-17T05:21:40.963974+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963974+0000","last_undegraded":"2024-09-17T05:21:40.963974+0000","last_fullsized":"2024-09-17T05:21:40.963974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958557+0000","last_change":"2024-09-17T05:21:40.958557+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958557+0000","last_undegraded":"2024-09-17T05:21:40.958557+0000","last_fullsized":"2024-09-17T05:21:40.958557+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955698+0000","last_change":"2024-09-17T05:21:40.955698+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955698+0000","last_undegraded":"2024-09-17T05:21:40.955698+0000","last_fullsized":"2024-09-17T05:21:40.955698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956132+0000","last_change":"2024-09-17T05:21:40.956132+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956132+0000","last_undegraded":"2024-09-17T05:21:40.956132+0000","last_fullsized":"2024-09-17T05:21:40.956132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958106+0000","last_change":"2024-09-17T05:21:40.958106+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958106+0000","last_undegraded":"2024-09-17T05:21:40.958106+0000","last_fullsized":"2024-09-17T05:21:40.958106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976288+0000","last_change":"2024-09-17T05:21:41.971075+0000","last_active":"2024-09-17T05:21:41.976288+0000","last_peered":"2024-09-17T05:21:41.976288+0000","last_clean":"2024-09-17T05:21:41.976288+0000","last_became_active":"2024-09-17T05:21:41.969951+0000","last_became_peered":"2024-09-17T05:21:41.969951+0000","last_unstale":"2024-09-17T05:21:41.976288+0000","last_undegraded":"2024-09-17T05:21:41.976288+0000","last_fullsized":"2024-09-17T05:21:41.976288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:47.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957520+0000","last_change":"2024-09-17T05:21:40.957520+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957520+0000","last_undegraded":"2024-09-17T05:21:40.957520+0000","last_fullsized":"2024-09-17T05:21:40.957520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961310+0000","last_change":"2024-09-17T05:21:40.961310+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961310+0000","last_undegraded":"2024-09-17T05:21:40.961310+0000","last_fullsized":"2024-09-17T05:21:40.961310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959462+0000","last_change":"2024-09-17T05:21:40.959462+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959462+0000","last_undegraded":"2024-09-17T05:21:40.959462+0000","last_fullsized":"2024-09-17T05:21:40.959462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955663+0000","last_change":"2024-09-17T05:21:40.955663+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955663+0000","last_undegraded":"2024-09-17T05:21:40.955663+0000","last_fullsized":"2024-09-17T05:21:40.955663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978446+0000","last_change":"2024-09-17T05:21:41.971005+0000","last_active":"2024-09-17T05:21:41.978446+0000","last_peered":"2024-09-17T05:21:41.978446+0000","last_clean":"2024-09-17T05:21:41.978446+0000","last_became_active":"2024-09-17T05:21:41.970391+0000","last_became_peered":"2024-09-17T05:21:41.970391+0000","last_unstale":"2024-09-17T05:21:41.978446+0000","last_undegraded":"2024-09-17T05:21:41.978446+0000","last_fullsized":"2024-09-17T05:21:41.978446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:25.078219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.977831+0000","last_change":"2024-09-17T05:21:41.968746+0000","last_active":"2024-09-17T05:21:41.977831+0000","last_peered":"2024-09-17T05:21:41.977831+0000","last_clean":"2024-09-17T05:21:41.977831+0000","last_became_active":"2024-09-17T05:21:41.968484+0000","last_became_peered":"2024-09-17T05:21:41.968484+0000","last_unstale":"2024-09-17T05:21:41.977831+0000","last_undegraded":"2024-09-17T05:21:41.977831+0000","last_fullsized":"2024-09-17T05:21:41.977831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:54.971834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.982342+0000","last_change":"2024-09-17T05:21:40.968346+0000","last_active":"2024-09-17T05:21:41.982342+0000","last_peered":"2024-09-17T05:21:41.982342+0000","last_clean":"2024-09-17T05:21:41.982342+0000","last_became_active":"2024-09-17T05:21:40.968049+0000","last_became_peered":"2024-09-17T05:21:40.968049+0000","last_unstale":"2024-09-17T05:21:41.982342+0000","last_undegraded":"2024-09-17T05:21:41.982342+0000","last_fullsized":"2024-09-17T05:21:41.982342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:01.544228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953367+0000","last_change":"2024-09-17T05:21:40.953367+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953367+0000","last_undegraded":"2024-09-17T05:21:40.953367+0000","last_fullsized":"2024-09-17T05:21:40.953367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970884+0000","last_change":"2024-09-17T05:21:40.967671+0000","last_active":"2024-09-17T05:21:40.970884+0000","last_peered":"2024-09-17T05:21:40.970884+0000","last_clean":"2024-09-17T05:21:40.970884+0000","last_became_active":"2024-09-17T05:21:40.967346+0000","last_became_peered":"2024-09-17T05:21:40.967346+0000","last_unstale":"2024-09-17T05:21:40.970884+0000","last_undegraded":"2024-09-17T05:21:40.970884+0000","last_fullsized":"2024-09-17T05:21:40.970884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:07.178757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978311+0000","last_change":"2024-09-17T05:21:41.969430+0000","last_active":"2024-09-17T05:21:41.978311+0000","last_peered":"2024-09-17T05:21:41.978311+0000","last_clean":"2024-09-17T05:21:41.978311+0000","last_became_active":"2024-09-17T05:21:41.969185+0000","last_became_peered":"2024-09-17T05:21:41.969185+0000","last_unstale":"2024-09-17T05:21:41.978311+0000","last_undegraded":"2024-09-17T05:21:41.978311+0000","last_fullsized":"2024-09-17T05:21:41.978311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:26.543092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.983832+0000","last_change":"2024-09-17T05:21:40.955534+0000","last_active":"2024-09-17T05:21:41.983832+0000","last_peered":"2024-09-17T05:21:41.983832+0000","last_clean":"2024-09-17T05:21:41.983832+0000","last_became_active":"2024-09-17T05:21:40.955159+0000","last_became_peered":"2024-09-17T05:21:40.955159+0000","last_unstale":"2024-09-17T05:21:41.983832+0000","last_undegraded":"2024-09-17T05:21:41.983832+0000","last_fullsized":"2024-09-17T05:21:41.983832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:48.548506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978521+0000","last_change":"2024-09-17T05:21:41.973041+0000","last_active":"2024-09-17T05:21:41.978521+0000","last_peered":"2024-09-17T05:21:41.978521+0000","last_clean":"2024-09-17T05:21:41.978521+0000","last_became_active":"2024-09-17T05:21:41.972532+0000","last_became_peered":"2024-09-17T05:21:41.972532+0000","last_unstale":"2024-09-17T05:21:41.978521+0000","last_undegraded":"2024-09-17T05:21:41.978521+0000","last_fullsized":"2024-09-17T05:21:41.978521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:29.553319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969613+0000","last_change":"2024-09-17T05:21:40.965725+0000","last_active":"2024-09-17T05:21:40.969613+0000","last_peered":"2024-09-17T05:21:40.969613+0000","last_clean":"2024-09-17T05:21:40.969613+0000","last_became_active":"2024-09-17T05:21:40.965447+0000","last_became_peered":"2024-09-17T05:21:40.965447+0000","last_unstale":"2024-09-17T05:21:40.969613+0000","last_undegraded":"2024-09-17T05:21:40.969613+0000","last_fullsized":"2024-09-17T05:21:40.969613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:55.548456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963621+0000","last_change":"2024-09-17T05:21:40.963621+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963621+0000","last_undegraded":"2024-09-17T05:21:40.963621+0000","last_fullsized":"2024-09-17T05:21:40.963621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969075+0000","last_change":"2024-09-17T05:21:40.963116+0000","last_active":"2024-09-17T05:21:40.969075+0000","last_peered":"2024-09-17T05:21:40.969075+0000","last_clean":"2024-09-17T05:21:40.969075+0000","last_became_active":"2024-09-17T05:21:40.961833+0000","last_became_peered":"2024-09-17T05:21:40.961833+0000","last_unstale":"2024-09-17T05:21:40.969075+0000","last_undegraded":"2024-09-17T05:21:40.969075+0000","last_fullsized":"2024-09-17T05:21:40.969075+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:37.860369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961806+0000","last_change":"2024-09-17T05:21:40.961806+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961806+0000","last_undegraded":"2024-09-17T05:21:40.961806+0000","last_fullsized":"2024-09-17T05:21:40.961806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.981651+0000","last_change":"2024-09-17T05:21:40.963990+0000","last_active":"2024-09-17T05:21:41.981651+0000","last_peered":"2024-09-17T05:21:41.981651+0000","last_clean":"2024-09-17T05:21:41.981651+0000","last_became_active":"2024-09-17T05:21:40.963731+0000","last_became_peered":"2024-09-17T05:21:40.963731+0000","last_unstale":"2024-09-17T05:21:41.981651+0000","last_undegraded":"2024-09-17T05:21:41.981651+0000","last_fullsized":"2024-09-17T05:21:41.981651+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:56.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955212+0000","last_change":"2024-09-17T05:21:40.955212+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955212+0000","last_undegraded":"2024-09-17T05:21:40.955212+0000","last_fullsized":"2024-09-17T05:21:40.955212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.974434+0000","last_change":"2024-09-17T05:21:40.969945+0000","last_active":"2024-09-17T05:21:40.974434+0000","last_peered":"2024-09-17T05:21:40.974434+0000","last_clean":"2024-09-17T05:21:40.974434+0000","last_became_active":"2024-09-17T05:21:40.969578+0000","last_became_peered":"2024-09-17T05:21:40.969578+0000","last_unstale":"2024-09-17T05:21:40.974434+0000","last_undegraded":"2024-09-17T05:21:40.974434+0000","last_fullsized":"2024-09-17T05:21:40.974434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.960703+0000","last_change":"2024-09-17T05:21:40.960703+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.960703+0000","last_undegraded":"2024-09-17T05:21:40.960703+0000","last_fullsized":"2024-09-17T05:21:40.960703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969938+0000","last_change":"2024-09-17T05:21:40.964753+0000","last_active":"2024-09-17T05:21:40.969938+0000","last_peered":"2024-09-17T05:21:40.969938+0000","last_clean":"2024-09-17T05:21:40.969938+0000","last_became_active":"2024-09-17T05:21:40.964467+0000","last_became_peered":"2024-09-17T05:21:40.964467+0000","last_unstale":"2024-09-17T05:21:40.969938+0000","last_undegraded":"2024-09-17T05:21:40.969938+0000","last_fullsized":"2024-09-17T05:21:40.969938+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:05.070651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952679+0000","last_change":"2024-09-17T05:21:40.952679+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952679+0000","last_undegraded":"2024-09-17T05:21:40.952679+0000","last_fullsized":"2024-09-17T05:21:40.952679+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969299+0000","last_change":"2024-09-17T05:21:40.966548+0000","last_active":"2024-09-17T05:21:40.969299+0000","last_peered":"2024-09-17T05:21:40.969299+0000","last_clean":"2024-09-17T05:21:40.969299+0000","last_became_active":"2024-09-17T05:21:40.966011+0000","last_became_peered":"2024-09-17T05:21:40.966011+0000","last_unstale":"2024-09-17T05:21:40.969299+0000","last_undegraded":"2024-09-17T05:21:40.969299+0000","last_fullsized":"2024-09-17T05:21:40.969299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958287+0000","last_change":"2024-09-17T05:21:40.958287+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958287+0000","last_undegraded":"2024-09-17T05:21:40.958287+0000","last_fullsized":"2024-09-17T05:21:40.958287+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.965236+0000","last_change":"2024-09-17T05:21:40.964038+0000","last_active":"2024-09-17T05:21:40.965236+0000","last_peered":"2024-09-17T05:21:40.965236+0000","last_clean":"2024-09-17T05:21:40.965236+0000","last_became_active":"2024-09-17T05:21:40.963792+0000","last_became_peered":"2024-09-17T05:21:40.963792+0000","last_unstale":"2024-09-17T05:21:40.965236+0000","last_undegraded":"2024-09-17T05:21:40.965236+0000","last_fullsized":"2024-09-17T05:21:40.965236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:49.506583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954113+0000","last_change":"2024-09-17T05:21:40.954113+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954113+0000","last_undegraded":"2024-09-17T05:21:40.954113+0000","last_fullsized":"2024-09-17T05:21:40.954113+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970160+0000","last_change":"2024-09-17T05:21:40.968246+0000","last_active":"2024-09-17T05:21:40.970160+0000","last_peered":"2024-09-17T05:21:40.970160+0000","last_clean":"2024-09-17T05:21:40.970160+0000","last_became_active":"2024-09-17T05:21:40.968012+0000","last_became_peered":"2024-09-17T05:21:40.968012+0000","last_unstale":"2024-09-17T05:21:40.970160+0000","last_undegraded":"2024-09-17T05:21:40.970160+0000","last_fullsized":"2024-09-17T05:21:40.970160+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958264+0000","last_change":"2024-09-17T05:21:40.958264+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958264+0000","last_undegraded":"2024-09-17T05:21:40.958264+0000","last_fullsized":"2024-09-17T05:21:40.958264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964872+0000","last_change":"2024-09-17T05:21:40.960153+0000","last_active":"2024-09-17T05:21:40.964872+0000","last_peered":"2024-09-17T05:21:40.964872+0000","last_clean":"2024-09-17T05:21:40.964872+0000","last_became_active":"2024-09-17T05:21:40.959884+0000","last_became_peered":"2024-09-17T05:21:40.959884+0000","last_unstale":"2024-09-17T05:21:40.964872+0000","last_undegraded":"2024-09-17T05:21:40.964872+0000","last_fullsized":"2024-09-17T05:21:40.964872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.792618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957038+0000","last_change":"2024-09-17T05:21:40.957038+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957038+0000","last_undegraded":"2024-09-17T05:21:40.957038+0000","last_fullsized":"2024-09-17T05:21:40.957038+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970840+0000","last_change":"2024-09-17T05:21:40.966702+0000","last_active":"2024-09-17T05:21:40.970840+0000","last_peered":"2024-09-17T05:21:40.970840+0000","last_clean":"2024-09-17T05:21:40.970840+0000","last_became_active":"2024-09-17T05:21:40.966428+0000","last_became_peered":"2024-09-17T05:21:40.966428+0000","last_unstale":"2024-09-17T05:21:40.970840+0000","last_undegraded":"2024-09-17T05:21:40.970840+0000","last_fullsized":"2024-09-17T05:21:40.970840+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:15.960978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959085+0000","last_change":"2024-09-17T05:21:40.959085+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959085+0000","last_undegraded":"2024-09-17T05:21:40.959085+0000","last_fullsized":"2024-09-17T05:21:40.959085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968922+0000","last_change":"2024-09-17T05:21:40.964010+0000","last_active":"2024-09-17T05:21:40.968922+0000","last_peered":"2024-09-17T05:21:40.968922+0000","last_clean":"2024-09-17T05:21:40.968922+0000","last_became_active":"2024-09-17T05:21:40.963746+0000","last_became_peered":"2024-09-17T05:21:40.963746+0000","last_unstale":"2024-09-17T05:21:40.968922+0000","last_undegraded":"2024-09-17T05:21:40.968922+0000","last_fullsized":"2024-09-17T05:21:40.968922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:42.681141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952845+0000","last_change":"2024-09-17T05:21:40.952845+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952845+0000","last_undegraded":"2024-09-17T05:21:40.952845+0000","last_fullsized":"2024-09-17T05:21:40.952845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968927+0000","last_change":"2024-09-17T05:21:40.963557+0000","last_active":"2024-09-17T05:21:40.968927+0000","last_peered":"2024-09-17T05:21:40.968927+0000","last_clean":"2024-09-17T05:21:40.968927+0000","last_became_active":"2024-09-17T05:21:40.963038+0000","last_became_peered":"2024-09-17T05:21:40.963038+0000","last_unstale":"2024-09-17T05:21:40.968927+0000","last_undegraded":"2024-09-17T05:21:40.968927+0000","last_fullsized":"2024-09-17T05:21:40.968927+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:29.652603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958146+0000","last_change":"2024-09-17T05:21:40.958146+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958146+0000","last_undegraded":"2024-09-17T05:21:40.958146+0000","last_fullsized":"2024-09-17T05:21:40.958146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.976907+0000","last_change":"2024-09-17T05:21:40.969574+0000","last_active":"2024-09-17T05:21:40.976907+0000","last_peered":"2024-09-17T05:21:40.976907+0000","last_clean":"2024-09-17T05:21:40.976907+0000","last_became_active":"2024-09-17T05:21:40.969303+0000","last_became_peered":"2024-09-17T05:21:40.969303+0000","last_unstale":"2024-09-17T05:21:40.976907+0000","last_undegraded":"2024-09-17T05:21:40.976907+0000","last_fullsized":"2024-09-17T05:21:40.976907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959421+0000","last_change":"2024-09-17T05:21:40.959421+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959421+0000","last_undegraded":"2024-09-17T05:21:40.959421+0000","last_fullsized":"2024-09-17T05:21:40.959421+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968013+0000","last_change":"2024-09-17T05:21:40.964669+0000","last_active":"2024-09-17T05:21:40.968013+0000","last_peered":"2024-09-17T05:21:40.968013+0000","last_clean":"2024-09-17T05:21:40.968013+0000","last_became_active":"2024-09-17T05:21:40.964429+0000","last_became_peered":"2024-09-17T05:21:40.964429+0000","last_unstale":"2024-09-17T05:21:40.968013+0000","last_undegraded":"2024-09-17T05:21:40.968013+0000","last_fullsized":"2024-09-17T05:21:40.968013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:56.840775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957759+0000","last_change":"2024-09-17T05:21:40.957759+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957759+0000","last_undegraded":"2024-09-17T05:21:40.957759+0000","last_fullsized":"2024-09-17T05:21:40.957759+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.986567+0000","last_change":"2024-09-17T05:21:40.963624+0000","last_active":"2024-09-17T05:21:41.986567+0000","last_peered":"2024-09-17T05:21:41.986567+0000","last_clean":"2024-09-17T05:21:41.986567+0000","last_became_active":"2024-09-17T05:21:40.963377+0000","last_became_peered":"2024-09-17T05:21:40.963377+0000","last_unstale":"2024-09-17T05:21:41.986567+0000","last_undegraded":"2024-09-17T05:21:41.986567+0000","last_fullsized":"2024-09-17T05:21:41.986567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:01.418973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961057+0000","last_change":"2024-09-17T05:21:40.961057+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961057+0000","last_undegraded":"2024-09-17T05:21:40.961057+0000","last_fullsized":"2024-09-17T05:21:40.961057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969907+0000","last_change":"2024-09-17T05:21:40.965780+0000","last_active":"2024-09-17T05:21:40.969907+0000","last_peered":"2024-09-17T05:21:40.969907+0000","last_clean":"2024-09-17T05:21:40.969907+0000","last_became_active":"2024-09-17T05:21:40.965506+0000","last_became_peered":"2024-09-17T05:21:40.965506+0000","last_unstale":"2024-09-17T05:21:40.969907+0000","last_undegraded":"2024-09-17T05:21:40.969907+0000","last_fullsized":"2024-09-17T05:21:40.969907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957830+0000","last_change":"2024-09-17T05:21:40.957830+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957830+0000","last_undegraded":"2024-09-17T05:21:40.957830+0000","last_fullsized":"2024-09-17T05:21:40.957830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.957445+0000","last_change":"2024-09-17T05:21:40.967020+0000","last_active":"2024-09-17T05:21:41.957445+0000","last_peered":"2024-09-17T05:21:41.957445+0000","last_clean":"2024-09-17T05:21:41.957445+0000","last_became_active":"2024-09-17T05:21:40.966744+0000","last_became_peered":"2024-09-17T05:21:40.966744+0000","last_unstale":"2024-09-17T05:21:41.957445+0000","last_undegraded":"2024-09-17T05:21:41.957445+0000","last_fullsized":"2024-09-17T05:21:41.957445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:49.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956537+0000","last_change":"2024-09-17T05:21:40.956537+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956537+0000","last_undegraded":"2024-09-17T05:21:40.956537+0000","last_fullsized":"2024-09-17T05:21:40.956537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971416+0000","last_change":"2024-09-17T05:21:40.969833+0000","last_active":"2024-09-17T05:21:40.971416+0000","last_peered":"2024-09-17T05:21:40.971416+0000","last_clean":"2024-09-17T05:21:40.971416+0000","last_became_active":"2024-09-17T05:21:40.969550+0000","last_became_peered":"2024-09-17T05:21:40.969550+0000","last_unstale":"2024-09-17T05:21:40.971416+0000","last_undegraded":"2024-09-17T05:21:40.971416+0000","last_fullsized":"2024-09-17T05:21:40.971416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:13.362775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978954+0000","last_change":"2024-09-17T05:21:41.975403+0000","last_active":"2024-09-17T05:21:41.978954+0000","last_peered":"2024-09-17T05:21:41.978954+0000","last_clean":"2024-09-17T05:21:41.978954+0000","last_became_active":"2024-09-17T05:21:41.975049+0000","last_became_peered":"2024-09-17T05:21:41.975049+0000","last_unstale":"2024-09-17T05:21:41.978954+0000","last_undegraded":"2024-09-17T05:21:41.978954+0000","last_fullsized":"2024-09-17T05:21:41.978954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:06.056960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.962271+0000","last_change":"2024-09-17T05:21:40.958820+0000","last_active":"2024-09-17T05:21:40.962271+0000","last_peered":"2024-09-17T05:21:40.962271+0000","last_clean":"2024-09-17T05:21:40.962271+0000","last_became_active":"2024-09-17T05:21:40.958548+0000","last_became_peered":"2024-09-17T05:21:40.958548+0000","last_unstale":"2024-09-17T05:21:40.962271+0000","last_undegraded":"2024-09-17T05:21:40.962271+0000","last_fullsized":"2024-09-17T05:21:40.962271+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:40.305357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976909+0000","last_change":"2024-09-17T05:21:41.968799+0000","last_active":"2024-09-17T05:21:41.976909+0000","last_peered":"2024-09-17T05:21:41.976909+0000","last_clean":"2024-09-17T05:21:41.976909+0000","last_became_active":"2024-09-17T05:21:41.968530+0000","last_became_peered":"2024-09-17T05:21:41.968530+0000","last_unstale":"2024-09-17T05:21:41.976909+0000","last_undegraded":"2024-09-17T05:21:41.976909+0000","last_fullsized":"2024-09-17T05:21:41.976909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:00.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969912+0000","last_change":"2024-09-17T05:21:40.966445+0000","last_active":"2024-09-17T05:21:40.969912+0000","last_peered":"2024-09-17T05:21:40.969912+0000","last_clean":"2024-09-17T05:21:40.969912+0000","last_became_active":"2024-09-17T05:21:40.966200+0000","last_became_peered":"2024-09-17T05:21:40.966200+0000","last_unstale":"2024-09-17T05:21:40.969912+0000","last_undegraded":"2024-09-17T05:21:40.969912+0000","last_fullsized":"2024-09-17T05:21:40.969912+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956988+0000","last_change":"2024-09-17T05:21:40.956988+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956988+0000","last_undegraded":"2024-09-17T05:21:40.956988+0000","last_fullsized":"2024-09-17T05:21:40.956988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968291+0000","last_change":"2024-09-17T05:21:40.966051+0000","last_active":"2024-09-17T05:21:40.968291+0000","last_peered":"2024-09-17T05:21:40.968291+0000","last_clean":"2024-09-17T05:21:40.968291+0000","last_became_active":"2024-09-17T05:21:40.965771+0000","last_became_peered":"2024-09-17T05:21:40.965771+0000","last_unstale":"2024-09-17T05:21:40.968291+0000","last_undegraded":"2024-09-17T05:21:40.968291+0000","last_fullsized":"2024-09-17T05:21:40.968291+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.183423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957198+0000","last_change":"2024-09-17T05:21:40.957198+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957198+0000","last_undegraded":"2024-09-17T05:21:40.957198+0000","last_fullsized":"2024-09-17T05:21:40.957198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.968881+0000","last_change":"2024-09-17T05:21:40.964246+0000","last_active":"2024-09-17T05:21:42.968881+0000","last_peered":"2024-09-17T05:21:42.968881+0000","last_clean":"2024-09-17T05:21:42.968881+0000","last_became_active":"2024-09-17T05:21:40.963976+0000","last_became_peered":"2024-09-17T05:21:40.963976+0000","last_unstale":"2024-09-17T05:21:42.968881+0000","last_undegraded":"2024-09-17T05:21:42.968881+0000","last_fullsized":"2024-09-17T05:21:42.968881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:33.579472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953710+0000","last_change":"2024-09-17T05:21:40.953710+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953710+0000","last_undegraded":"2024-09-17T05:21:40.953710+0000","last_fullsized":"2024-09-17T05:21:40.953710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964214+0000","last_change":"2024-09-17T05:21:40.963049+0000","last_active":"2024-09-17T05:21:40.964214+0000","last_peered":"2024-09-17T05:21:40.964214+0000","last_clean":"2024-09-17T05:21:40.964214+0000","last_became_active":"2024-09-17T05:21:40.962743+0000","last_became_peered":"2024-09-17T05:21:40.962743+0000","last_unstale":"2024-09-17T05:21:40.964214+0000","last_undegraded":"2024-09-17T05:21:40.964214+0000","last_fullsized":"2024-09-17T05:21:40.964214+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:57.944586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978212+0000","last_change":"2024-09-17T05:21:41.972775+0000","last_active":"2024-09-17T05:21:41.978212+0000","last_peered":"2024-09-17T05:21:41.978212+0000","last_clean":"2024-09-17T05:21:41.978212+0000","last_became_active":"2024-09-17T05:21:41.972226+0000","last_became_peered":"2024-09-17T05:21:41.972226+0000","last_unstale":"2024-09-17T05:21:41.978212+0000","last_undegraded":"2024-09-17T05:21:41.978212+0000","last_fullsized":"2024-09-17T05:21:41.978212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969581+0000","last_change":"2024-09-17T05:21:40.965286+0000","last_active":"2024-09-17T05:21:40.969581+0000","last_peered":"2024-09-17T05:21:40.969581+0000","last_clean":"2024-09-17T05:21:40.969581+0000","last_became_active":"2024-09-17T05:21:40.963994+0000","last_became_peered":"2024-09-17T05:21:40.963994+0000","last_unstale":"2024-09-17T05:21:40.969581+0000","last_undegraded":"2024-09-17T05:21:40.969581+0000","last_fullsized":"2024-09-17T05:21:40.969581+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:58.092810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963247+0000","last_change":"2024-09-17T05:21:40.963247+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963247+0000","last_undegraded":"2024-09-17T05:21:40.963247+0000","last_fullsized":"2024-09-17T05:21:40.963247+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968342+0000","last_change":"2024-09-17T05:21:40.966188+0000","last_active":"2024-09-17T05:21:40.968342+0000","last_peered":"2024-09-17T05:21:40.968342+0000","last_clean":"2024-09-17T05:21:40.968342+0000","last_became_active":"2024-09-17T05:21:40.965925+0000","last_became_peered":"2024-09-17T05:21:40.965925+0000","last_unstale":"2024-09-17T05:21:40.968342+0000","last_undegraded":"2024-09-17T05:21:40.968342+0000","last_fullsized":"2024-09-17T05:21:40.968342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:30.135801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957598+0000","last_change":"2024-09-17T05:21:40.957598+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957598+0000","last_undegraded":"2024-09-17T05:21:40.957598+0000","last_fullsized":"2024-09-17T05:21:40.957598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.961276+0000","last_change":"2024-09-17T05:21:40.955869+0000","last_active":"2024-09-17T05:21:40.961276+0000","last_peered":"2024-09-17T05:21:40.961276+0000","last_clean":"2024-09-17T05:21:40.961276+0000","last_became_active":"2024-09-17T05:21:40.955539+0000","last_became_peered":"2024-09-17T05:21:40.955539+0000","last_unstale":"2024-09-17T05:21:40.961276+0000","last_undegraded":"2024-09-17T05:21:40.961276+0000","last_fullsized":"2024-09-17T05:21:40.961276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:44.437748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953261+0000","last_change":"2024-09-17T05:21:40.953261+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953261+0000","last_undegraded":"2024-09-17T05:21:40.953261+0000","last_fullsized":"2024-09-17T05:21:40.953261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.959366+0000","last_change":"2024-09-17T05:21:40.958018+0000","last_active":"2024-09-17T05:21:40.959366+0000","last_peered":"2024-09-17T05:21:40.959366+0000","last_clean":"2024-09-17T05:21:40.959366+0000","last_became_active":"2024-09-17T05:21:40.957745+0000","last_became_peered":"2024-09-17T05:21:40.957745+0000","last_unstale":"2024-09-17T05:21:40.959366+0000","last_undegraded":"2024-09-17T05:21:40.959366+0000","last_fullsized":"2024-09-17T05:21:40.959366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:00.937883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959744+0000","last_change":"2024-09-17T05:21:40.959744+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959744+0000","last_undegraded":"2024-09-17T05:21:40.959744+0000","last_fullsized":"2024-09-17T05:21:40.959744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971410+0000","last_change":"2024-09-17T05:21:40.969445+0000","last_active":"2024-09-17T05:21:40.971410+0000","last_peered":"2024-09-17T05:21:40.971410+0000","last_clean":"2024-09-17T05:21:40.971410+0000","last_became_active":"2024-09-17T05:21:40.969235+0000","last_became_peered":"2024-09-17T05:21:40.969235+0000","last_unstale":"2024-09-17T05:21:40.971410+0000","last_undegraded":"2024-09-17T05:21:40.971410+0000","last_fullsized":"2024-09-17T05:21:40.971410+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:05.115216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961194+0000","last_change":"2024-09-17T05:21:40.961194+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961194+0000","last_undegraded":"2024-09-17T05:21:40.961194+0000","last_fullsized":"2024-09-17T05:21:40.961194+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969072+0000","last_change":"2024-09-17T05:21:40.965053+0000","last_active":"2024-09-17T05:21:40.969072+0000","last_peered":"2024-09-17T05:21:40.969072+0000","last_clean":"2024-09-17T05:21:40.969072+0000","last_became_active":"2024-09-17T05:21:40.964717+0000","last_became_peered":"2024-09-17T05:21:40.964717+0000","last_unstale":"2024-09-17T05:21:40.969072+0000","last_undegraded":"2024-09-17T05:21:40.969072+0000","last_fullsized":"2024-09-17T05:21:40.969072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:30.434888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.960480+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:21:40.960480+0000","last_peered":"2024-09-17T05:21:40.960480+0000","last_clean":"2024-09-17T05:21:40.960480+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:21:40.960480+0000","last_undegraded":"2024-09-17T05:21:40.960480+0000","last_fullsized":"2024-09-17T05:21:40.960480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1257472,"data_stored":860262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":869231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:46.328 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 -- 172.21.15.81:0/333639411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c0b3140 msgr2=0x7f798c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 --2- 172.21.15.81:0/333639411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c0b3140 0x7f798c072ae0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f798c0762e0 tx=0x7f798402a530 comp rx=0 tx=0).stop 2024-09-17T05:21:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 -- 172.21.15.81:0/333639411 shutdown_connections 2024-09-17T05:21:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 --2- 172.21.15.81:0/333639411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c0b3140 0x7f798c072ae0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 --2- 172.21.15.81:0/333639411 >> v2:172.21.15.160:3300/0 conn(0x7f798c0cf640 0x7f798c0725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 -- 172.21.15.81:0/333639411 >> 172.21.15.81:0/333639411 conn(0x7f798c0b1690 msgr2=0x7f798c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 -- 172.21.15.81:0/333639411 shutdown_connections 2024-09-17T05:21:46.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.465+0000 7f7990b2b640 1 -- 172.21.15.81:0/333639411 wait complete. 2024-09-17T05:21:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.466+0000 7f7990b2b640 1 Processor -- start 2024-09-17T05:21:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.466+0000 7f7990b2b640 1 -- start start 2024-09-17T05:21:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7990b2b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f798c0b3140 0x7f798c146250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7990b2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c0cf640 0x7f798c1f2c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7990b2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c151370 0x7f798c1f58a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7990b2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f798c06ffd0 con 0x7f798c151370 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7990b2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f798c06fe50 con 0x7f798c0cf640 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7990b2b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f798c070150 con 0x7f798c0b3140 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c151370 0x7f798c1f58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c151370 0x7f798c1f58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47638/0 (socket says 172.21.15.81:47638) 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 -- 172.21.15.81:0/1063837996 learned_addr learned my addr 172.21.15.81:0/1063837996 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7989d9b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c0cf640 0x7f798c1f2c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798a59c640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f798c0b3140 0x7f798c146250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 -- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f798c0b3140 msgr2=0x7f798c146250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f798c0b3140 0x7f798c146250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 -- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c0cf640 msgr2=0x7f798c1f2c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c0cf640 0x7f798c1f2c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f798ad9d640 1 -- 172.21.15.81:0/1063837996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f798c1f61a0 con 0x7f798c151370 2024-09-17T05:21:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.467+0000 7f7989d9b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c0cf640 0x7f798c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.468+0000 7f798ad9d640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c151370 0x7f798c1f58a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f798402ab20 tx=0x7f7984032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.468+0000 7f7982ffd640 1 -- 172.21.15.81:0/1063837996 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7984040070 con 0x7f798c151370 2024-09-17T05:21:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.468+0000 7f7982ffd640 1 -- 172.21.15.81:0/1063837996 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7984005310 con 0x7f798c151370 2024-09-17T05:21:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.468+0000 7f7982ffd640 1 -- 172.21.15.81:0/1063837996 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79840047a0 con 0x7f798c151370 2024-09-17T05:21:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.468+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f798c1f6480 con 0x7f798c151370 2024-09-17T05:21:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.468+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f798c1f2730 con 0x7f798c151370 2024-09-17T05:21:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.469+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f798c1f2930 con 0x7f798c151370 2024-09-17T05:21:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.469+0000 7f7982ffd640 1 -- 172.21.15.81:0/1063837996 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f7984039040 con 0x7f798c151370 2024-09-17T05:21:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.470+0000 7f7982ffd640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f796c078d40 0x7f796c07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.470+0000 7f7982ffd640 1 -- 172.21.15.81:0/1063837996 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f79840bc200 con 0x7f798c151370 2024-09-17T05:21:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.470+0000 7f798a59c640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f796c078d40 0x7f796c07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.471+0000 7f798a59c640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f796c078d40 0x7f796c07b200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f797c0020b0 tx=0x7f797c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:46.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.474+0000 7f7982ffd640 1 -- 172.21.15.81:0/1063837996 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f798c1f2930 con 0x7f798c151370 2024-09-17T05:21:46.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.646+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f798c070670 con 0x7f796c078d40 2024-09-17T05:21:46.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.650+0000 7f7982ffd640 1 -- 172.21.15.81:0/1063837996 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247500 (secure 0 0 0) 0x7f798c070670 con 0x7f796c078d40 2024-09-17T05:21:46.653 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f796c078d40 msgr2=0x7f796c07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f796c078d40 0x7f796c07b200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f797c0020b0 tx=0x7f797c009040 comp rx=0 tx=0).stop 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c151370 msgr2=0x7f798c1f58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c151370 0x7f798c1f58a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f798402ab20 tx=0x7f7984032c00 comp rx=0 tx=0).stop 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 shutdown_connections 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f796c078d40 0x7f796c07b200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f798c151370 0x7f798c1f58a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f798c0cf640 0x7f798c1f2c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 --2- 172.21.15.81:0/1063837996 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f798c0b3140 0x7f798c146250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 >> 172.21.15.81:0/1063837996 conn(0x7f798c0b1690 msgr2=0x7f798c0b0ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 shutdown_connections 2024-09-17T05:21:46.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.654+0000 7f7990b2b640 1 -- 172.21.15.81:0/1063837996 wait complete. 2024-09-17T05:21:46.665 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-17T05:21:45.417244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226748,"kb_used_data":6324,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747972,"statfs":{"total":773094113280,"available":772861923328,"internally_reserved":0,"allocated":6475776,"data_stored":3323789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469532"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956492+0000","last_change":"2024-09-17T05:21:40.956492+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956492+0000","last_undegraded":"2024-09-17T05:21:40.956492+0000","last_fullsized":"2024-09-17T05:21:40.956492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961469+0000","last_change":"2024-09-17T05:21:40.961469+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961469+0000","last_undegraded":"2024-09-17T05:21:40.961469+0000","last_fullsized":"2024-09-17T05:21:40.961469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959275+0000","last_change":"2024-09-17T05:21:40.959275+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959275+0000","last_undegraded":"2024-09-17T05:21:40.959275+0000","last_fullsized":"2024-09-17T05:21:40.959275+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958219+0000","last_change":"2024-09-17T05:21:40.958219+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958219+0000","last_undegraded":"2024-09-17T05:21:40.958219+0000","last_fullsized":"2024-09-17T05:21:40.958219+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957793+0000","last_change":"2024-09-17T05:21:40.957793+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957793+0000","last_undegraded":"2024-09-17T05:21:40.957793+0000","last_fullsized":"2024-09-17T05:21:40.957793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.973076+0000","last_change":"2024-09-17T05:21:41.966263+0000","last_active":"2024-09-17T05:21:41.973076+0000","last_peered":"2024-09-17T05:21:41.973076+0000","last_clean":"2024-09-17T05:21:41.973076+0000","last_became_active":"2024-09-17T05:21:41.965998+0000","last_became_peered":"2024-09-17T05:21:41.965998+0000","last_unstale":"2024-09-17T05:21:41.973076+0000","last_undegraded":"2024-09-17T05:21:41.973076+0000","last_fullsized":"2024-09-17T05:21:41.973076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:47.756519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953365+0000","last_change":"2024-09-17T05:21:40.953365+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953365+0000","last_undegraded":"2024-09-17T05:21:40.953365+0000","last_fullsized":"2024-09-17T05:21:40.953365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961669+0000","last_change":"2024-09-17T05:21:40.961669+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961669+0000","last_undegraded":"2024-09-17T05:21:40.961669+0000","last_fullsized":"2024-09-17T05:21:40.961669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952461+0000","last_change":"2024-09-17T05:21:40.952461+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952461+0000","last_undegraded":"2024-09-17T05:21:40.952461+0000","last_fullsized":"2024-09-17T05:21:40.952461+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954960+0000","last_change":"2024-09-17T05:21:40.954960+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954960+0000","last_undegraded":"2024-09-17T05:21:40.954960+0000","last_fullsized":"2024-09-17T05:21:40.954960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953449+0000","last_change":"2024-09-17T05:21:40.953449+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953449+0000","last_undegraded":"2024-09-17T05:21:40.953449+0000","last_fullsized":"2024-09-17T05:21:40.953449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957739+0000","last_change":"2024-09-17T05:21:40.957739+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957739+0000","last_undegraded":"2024-09-17T05:21:40.957739+0000","last_fullsized":"2024-09-17T05:21:40.957739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955240+0000","last_change":"2024-09-17T05:21:40.955240+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955240+0000","last_undegraded":"2024-09-17T05:21:40.955240+0000","last_fullsized":"2024-09-17T05:21:40.955240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952529+0000","last_change":"2024-09-17T05:21:40.952529+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952529+0000","last_undegraded":"2024-09-17T05:21:40.952529+0000","last_fullsized":"2024-09-17T05:21:40.952529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952386+0000","last_change":"2024-09-17T05:21:40.952386+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952386+0000","last_undegraded":"2024-09-17T05:21:40.952386+0000","last_fullsized":"2024-09-17T05:21:40.952386+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978469+0000","last_change":"2024-09-17T05:21:41.973282+0000","last_active":"2024-09-17T05:21:41.978469+0000","last_peered":"2024-09-17T05:21:41.978469+0000","last_clean":"2024-09-17T05:21:41.978469+0000","last_became_active":"2024-09-17T05:21:41.972899+0000","last_became_peered":"2024-09-17T05:21:41.972899+0000","last_unstale":"2024-09-17T05:21:41.978469+0000","last_undegraded":"2024-09-17T05:21:41.978469+0000","last_fullsized":"2024-09-17T05:21:41.978469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:13.151036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963021+0000","last_change":"2024-09-17T05:21:40.963021+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963021+0000","last_undegraded":"2024-09-17T05:21:40.963021+0000","last_fullsized":"2024-09-17T05:21:40.963021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959846+0000","last_change":"2024-09-17T05:21:40.959846+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959846+0000","last_undegraded":"2024-09-17T05:21:40.959846+0000","last_fullsized":"2024-09-17T05:21:40.959846+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957605+0000","last_change":"2024-09-17T05:21:40.957605+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957605+0000","last_undegraded":"2024-09-17T05:21:40.957605+0000","last_fullsized":"2024-09-17T05:21:40.957605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961482+0000","last_change":"2024-09-17T05:21:40.961482+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961482+0000","last_undegraded":"2024-09-17T05:21:40.961482+0000","last_fullsized":"2024-09-17T05:21:40.961482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959540+0000","last_change":"2024-09-17T05:21:40.959540+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959540+0000","last_undegraded":"2024-09-17T05:21:40.959540+0000","last_fullsized":"2024-09-17T05:21:40.959540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963974+0000","last_change":"2024-09-17T05:21:40.963974+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963974+0000","last_undegraded":"2024-09-17T05:21:40.963974+0000","last_fullsized":"2024-09-17T05:21:40.963974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958557+0000","last_change":"2024-09-17T05:21:40.958557+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958557+0000","last_undegraded":"2024-09-17T05:21:40.958557+0000","last_fullsized":"2024-09-17T05:21:40.958557+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955698+0000","last_change":"2024-09-17T05:21:40.955698+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955698+0000","last_undegraded":"2024-09-17T05:21:40.955698+0000","last_fullsized":"2024-09-17T05:21:40.955698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956132+0000","last_change":"2024-09-17T05:21:40.956132+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956132+0000","last_undegraded":"2024-09-17T05:21:40.956132+0000","last_fullsized":"2024-09-17T05:21:40.956132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958106+0000","last_change":"2024-09-17T05:21:40.958106+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958106+0000","last_undegraded":"2024-09-17T05:21:40.958106+0000","last_fullsized":"2024-09-17T05:21:40.958106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976288+0000","last_change":"2024-09-17T05:21:41.971075+0000","last_active":"2024-09-17T05:21:41.976288+0000","last_peered":"2024-09-17T05:21:41.976288+0000","last_clean":"2024-09-17T05:21:41.976288+0000","last_became_active":"2024-09-17T05:21:41.969951+0000","last_became_peered":"2024-09-17T05:21:41.969951+0000","last_unstale":"2024-09-17T05:21:41.976288+0000","last_undegraded":"2024-09-17T05:21:41.976288+0000","last_fullsized":"2024-09-17T05:21:41.976288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:47.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957520+0000","last_change":"2024-09-17T05:21:40.957520+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957520+0000","last_undegraded":"2024-09-17T05:21:40.957520+0000","last_fullsized":"2024-09-17T05:21:40.957520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961310+0000","last_change":"2024-09-17T05:21:40.961310+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961310+0000","last_undegraded":"2024-09-17T05:21:40.961310+0000","last_fullsized":"2024-09-17T05:21:40.961310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959462+0000","last_change":"2024-09-17T05:21:40.959462+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959462+0000","last_undegraded":"2024-09-17T05:21:40.959462+0000","last_fullsized":"2024-09-17T05:21:40.959462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955663+0000","last_change":"2024-09-17T05:21:40.955663+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955663+0000","last_undegraded":"2024-09-17T05:21:40.955663+0000","last_fullsized":"2024-09-17T05:21:40.955663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978446+0000","last_change":"2024-09-17T05:21:41.971005+0000","last_active":"2024-09-17T05:21:41.978446+0000","last_peered":"2024-09-17T05:21:41.978446+0000","last_clean":"2024-09-17T05:21:41.978446+0000","last_became_active":"2024-09-17T05:21:41.970391+0000","last_became_peered":"2024-09-17T05:21:41.970391+0000","last_unstale":"2024-09-17T05:21:41.978446+0000","last_undegraded":"2024-09-17T05:21:41.978446+0000","last_fullsized":"2024-09-17T05:21:41.978446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:25.078219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.977831+0000","last_change":"2024-09-17T05:21:41.968746+0000","last_active":"2024-09-17T05:21:41.977831+0000","last_peered":"2024-09-17T05:21:41.977831+0000","last_clean":"2024-09-17T05:21:41.977831+0000","last_became_active":"2024-09-17T05:21:41.968484+0000","last_became_peered":"2024-09-17T05:21:41.968484+0000","last_unstale":"2024-09-17T05:21:41.977831+0000","last_undegraded":"2024-09-17T05:21:41.977831+0000","last_fullsized":"2024-09-17T05:21:41.977831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:54.971834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.982342+0000","last_change":"2024-09-17T05:21:40.968346+0000","last_active":"2024-09-17T05:21:41.982342+0000","last_peered":"2024-09-17T05:21:41.982342+0000","last_clean":"2024-09-17T05:21:41.982342+0000","last_became_active":"2024-09-17T05:21:40.968049+0000","last_became_peered":"2024-09-17T05:21:40.968049+0000","last_unstale":"2024-09-17T05:21:41.982342+0000","last_undegraded":"2024-09-17T05:21:41.982342+0000","last_fullsized":"2024-09-17T05:21:41.982342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:01.544228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953367+0000","last_change":"2024-09-17T05:21:40.953367+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953367+0000","last_undegraded":"2024-09-17T05:21:40.953367+0000","last_fullsized":"2024-09-17T05:21:40.953367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970884+0000","last_change":"2024-09-17T05:21:40.967671+0000","last_active":"2024-09-17T05:21:40.970884+0000","last_peered":"2024-09-17T05:21:40.970884+0000","last_clean":"2024-09-17T05:21:40.970884+0000","last_became_active":"2024-09-17T05:21:40.967346+0000","last_became_peered":"2024-09-17T05:21:40.967346+0000","last_unstale":"2024-09-17T05:21:40.970884+0000","last_undegraded":"2024-09-17T05:21:40.970884+0000","last_fullsized":"2024-09-17T05:21:40.970884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:07.178757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978311+0000","last_change":"2024-09-17T05:21:41.969430+0000","last_active":"2024-09-17T05:21:41.978311+0000","last_peered":"2024-09-17T05:21:41.978311+0000","last_clean":"2024-09-17T05:21:41.978311+0000","last_became_active":"2024-09-17T05:21:41.969185+0000","last_became_peered":"2024-09-17T05:21:41.969185+0000","last_unstale":"2024-09-17T05:21:41.978311+0000","last_undegraded":"2024-09-17T05:21:41.978311+0000","last_fullsized":"2024-09-17T05:21:41.978311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:26.543092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.983832+0000","last_change":"2024-09-17T05:21:40.955534+0000","last_active":"2024-09-17T05:21:41.983832+0000","last_peered":"2024-09-17T05:21:41.983832+0000","last_clean":"2024-09-17T05:21:41.983832+0000","last_became_active":"2024-09-17T05:21:40.955159+0000","last_became_peered":"2024-09-17T05:21:40.955159+0000","last_unstale":"2024-09-17T05:21:41.983832+0000","last_undegraded":"2024-09-17T05:21:41.983832+0000","last_fullsized":"2024-09-17T05:21:41.983832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:48.548506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978521+0000","last_change":"2024-09-17T05:21:41.973041+0000","last_active":"2024-09-17T05:21:41.978521+0000","last_peered":"2024-09-17T05:21:41.978521+0000","last_clean":"2024-09-17T05:21:41.978521+0000","last_became_active":"2024-09-17T05:21:41.972532+0000","last_became_peered":"2024-09-17T05:21:41.972532+0000","last_unstale":"2024-09-17T05:21:41.978521+0000","last_undegraded":"2024-09-17T05:21:41.978521+0000","last_fullsized":"2024-09-17T05:21:41.978521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:29.553319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969613+0000","last_change":"2024-09-17T05:21:40.965725+0000","last_active":"2024-09-17T05:21:40.969613+0000","last_peered":"2024-09-17T05:21:40.969613+0000","last_clean":"2024-09-17T05:21:40.969613+0000","last_became_active":"2024-09-17T05:21:40.965447+0000","last_became_peered":"2024-09-17T05:21:40.965447+0000","last_unstale":"2024-09-17T05:21:40.969613+0000","last_undegraded":"2024-09-17T05:21:40.969613+0000","last_fullsized":"2024-09-17T05:21:40.969613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:55.548456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963621+0000","last_change":"2024-09-17T05:21:40.963621+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963621+0000","last_undegraded":"2024-09-17T05:21:40.963621+0000","last_fullsized":"2024-09-17T05:21:40.963621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969075+0000","last_change":"2024-09-17T05:21:40.963116+0000","last_active":"2024-09-17T05:21:40.969075+0000","last_peered":"2024-09-17T05:21:40.969075+0000","last_clean":"2024-09-17T05:21:40.969075+0000","last_became_active":"2024-09-17T05:21:40.961833+0000","last_became_peered":"2024-09-17T05:21:40.961833+0000","last_unstale":"2024-09-17T05:21:40.969075+0000","last_undegraded":"2024-09-17T05:21:40.969075+0000","last_fullsized":"2024-09-17T05:21:40.969075+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:37.860369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961806+0000","last_change":"2024-09-17T05:21:40.961806+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961806+0000","last_undegraded":"2024-09-17T05:21:40.961806+0000","last_fullsized":"2024-09-17T05:21:40.961806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.981651+0000","last_change":"2024-09-17T05:21:40.963990+0000","last_active":"2024-09-17T05:21:41.981651+0000","last_peered":"2024-09-17T05:21:41.981651+0000","last_clean":"2024-09-17T05:21:41.981651+0000","last_became_active":"2024-09-17T05:21:40.963731+0000","last_became_peered":"2024-09-17T05:21:40.963731+0000","last_unstale":"2024-09-17T05:21:41.981651+0000","last_undegraded":"2024-09-17T05:21:41.981651+0000","last_fullsized":"2024-09-17T05:21:41.981651+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:56.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955212+0000","last_change":"2024-09-17T05:21:40.955212+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955212+0000","last_undegraded":"2024-09-17T05:21:40.955212+0000","last_fullsized":"2024-09-17T05:21:40.955212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.974434+0000","last_change":"2024-09-17T05:21:40.969945+0000","last_active":"2024-09-17T05:21:40.974434+0000","last_peered":"2024-09-17T05:21:40.974434+0000","last_clean":"2024-09-17T05:21:40.974434+0000","last_became_active":"2024-09-17T05:21:40.969578+0000","last_became_peered":"2024-09-17T05:21:40.969578+0000","last_unstale":"2024-09-17T05:21:40.974434+0000","last_undegraded":"2024-09-17T05:21:40.974434+0000","last_fullsized":"2024-09-17T05:21:40.974434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.960703+0000","last_change":"2024-09-17T05:21:40.960703+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.960703+0000","last_undegraded":"2024-09-17T05:21:40.960703+0000","last_fullsized":"2024-09-17T05:21:40.960703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969938+0000","last_change":"2024-09-17T05:21:40.964753+0000","last_active":"2024-09-17T05:21:40.969938+0000","last_peered":"2024-09-17T05:21:40.969938+0000","last_clean":"2024-09-17T05:21:40.969938+0000","last_became_active":"2024-09-17T05:21:40.964467+0000","last_became_peered":"2024-09-17T05:21:40.964467+0000","last_unstale":"2024-09-17T05:21:40.969938+0000","last_undegraded":"2024-09-17T05:21:40.969938+0000","last_fullsized":"2024-09-17T05:21:40.969938+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:05.070651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952679+0000","last_change":"2024-09-17T05:21:40.952679+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952679+0000","last_undegraded":"2024-09-17T05:21:40.952679+0000","last_fullsized":"2024-09-17T05:21:40.952679+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969299+0000","last_change":"2024-09-17T05:21:40.966548+0000","last_active":"2024-09-17T05:21:40.969299+0000","last_peered":"2024-09-17T05:21:40.969299+0000","last_clean":"2024-09-17T05:21:40.969299+0000","last_became_active":"2024-09-17T05:21:40.966011+0000","last_became_peered":"2024-09-17T05:21:40.966011+0000","last_unstale":"2024-09-17T05:21:40.969299+0000","last_undegraded":"2024-09-17T05:21:40.969299+0000","last_fullsized":"2024-09-17T05:21:40.969299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958287+0000","last_change":"2024-09-17T05:21:40.958287+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958287+0000","last_undegraded":"2024-09-17T05:21:40.958287+0000","last_fullsized":"2024-09-17T05:21:40.958287+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.965236+0000","last_change":"2024-09-17T05:21:40.964038+0000","last_active":"2024-09-17T05:21:40.965236+0000","last_peered":"2024-09-17T05:21:40.965236+0000","last_clean":"2024-09-17T05:21:40.965236+0000","last_became_active":"2024-09-17T05:21:40.963792+0000","last_became_peered":"2024-09-17T05:21:40.963792+0000","last_unstale":"2024-09-17T05:21:40.965236+0000","last_undegraded":"2024-09-17T05:21:40.965236+0000","last_fullsized":"2024-09-17T05:21:40.965236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:49.506583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954113+0000","last_change":"2024-09-17T05:21:40.954113+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954113+0000","last_undegraded":"2024-09-17T05:21:40.954113+0000","last_fullsized":"2024-09-17T05:21:40.954113+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970160+0000","last_change":"2024-09-17T05:21:40.968246+0000","last_active":"2024-09-17T05:21:40.970160+0000","last_peered":"2024-09-17T05:21:40.970160+0000","last_clean":"2024-09-17T05:21:40.970160+0000","last_became_active":"2024-09-17T05:21:40.968012+0000","last_became_peered":"2024-09-17T05:21:40.968012+0000","last_unstale":"2024-09-17T05:21:40.970160+0000","last_undegraded":"2024-09-17T05:21:40.970160+0000","last_fullsized":"2024-09-17T05:21:40.970160+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958264+0000","last_change":"2024-09-17T05:21:40.958264+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958264+0000","last_undegraded":"2024-09-17T05:21:40.958264+0000","last_fullsized":"2024-09-17T05:21:40.958264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964872+0000","last_change":"2024-09-17T05:21:40.960153+0000","last_active":"2024-09-17T05:21:40.964872+0000","last_peered":"2024-09-17T05:21:40.964872+0000","last_clean":"2024-09-17T05:21:40.964872+0000","last_became_active":"2024-09-17T05:21:40.959884+0000","last_became_peered":"2024-09-17T05:21:40.959884+0000","last_unstale":"2024-09-17T05:21:40.964872+0000","last_undegraded":"2024-09-17T05:21:40.964872+0000","last_fullsized":"2024-09-17T05:21:40.964872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.792618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957038+0000","last_change":"2024-09-17T05:21:40.957038+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957038+0000","last_undegraded":"2024-09-17T05:21:40.957038+0000","last_fullsized":"2024-09-17T05:21:40.957038+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970840+0000","last_change":"2024-09-17T05:21:40.966702+0000","last_active":"2024-09-17T05:21:40.970840+0000","last_peered":"2024-09-17T05:21:40.970840+0000","last_clean":"2024-09-17T05:21:40.970840+0000","last_became_active":"2024-09-17T05:21:40.966428+0000","last_became_peered":"2024-09-17T05:21:40.966428+0000","last_unstale":"2024-09-17T05:21:40.970840+0000","last_undegraded":"2024-09-17T05:21:40.970840+0000","last_fullsized":"2024-09-17T05:21:40.970840+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:15.960978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959085+0000","last_change":"2024-09-17T05:21:40.959085+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959085+0000","last_undegraded":"2024-09-17T05:21:40.959085+0000","last_fullsized":"2024-09-17T05:21:40.959085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968922+0000","last_change":"2024-09-17T05:21:40.964010+0000","last_active":"2024-09-17T05:21:40.968922+0000","last_peered":"2024-09-17T05:21:40.968922+0000","last_clean":"2024-09-17T05:21:40.968922+0000","last_became_active":"2024-09-17T05:21:40.963746+0000","last_became_peered":"2024-09-17T05:21:40.963746+0000","last_unstale":"2024-09-17T05:21:40.968922+0000","last_undegraded":"2024-09-17T05:21:40.968922+0000","last_fullsized":"2024-09-17T05:21:40.968922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:42.681141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952845+0000","last_change":"2024-09-17T05:21:40.952845+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952845+0000","last_undegraded":"2024-09-17T05:21:40.952845+0000","last_fullsized":"2024-09-17T05:21:40.952845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968927+0000","last_change":"2024-09-17T05:21:40.963557+0000","last_active":"2024-09-17T05:21:40.968927+0000","last_peered":"2024-09-17T05:21:40.968927+0000","last_clean":"2024-09-17T05:21:40.968927+0000","last_became_active":"2024-09-17T05:21:40.963038+0000","last_became_peered":"2024-09-17T05:21:40.963038+0000","last_unstale":"2024-09-17T05:21:40.968927+0000","last_undegraded":"2024-09-17T05:21:40.968927+0000","last_fullsized":"2024-09-17T05:21:40.968927+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:29.652603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958146+0000","last_change":"2024-09-17T05:21:40.958146+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958146+0000","last_undegraded":"2024-09-17T05:21:40.958146+0000","last_fullsized":"2024-09-17T05:21:40.958146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.976907+0000","last_change":"2024-09-17T05:21:40.969574+0000","last_active":"2024-09-17T05:21:40.976907+0000","last_peered":"2024-09-17T05:21:40.976907+0000","last_clean":"2024-09-17T05:21:40.976907+0000","last_became_active":"2024-09-17T05:21:40.969303+0000","last_became_peered":"2024-09-17T05:21:40.969303+0000","last_unstale":"2024-09-17T05:21:40.976907+0000","last_undegraded":"2024-09-17T05:21:40.976907+0000","last_fullsized":"2024-09-17T05:21:40.976907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959421+0000","last_change":"2024-09-17T05:21:40.959421+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959421+0000","last_undegraded":"2024-09-17T05:21:40.959421+0000","last_fullsized":"2024-09-17T05:21:40.959421+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968013+0000","last_change":"2024-09-17T05:21:40.964669+0000","last_active":"2024-09-17T05:21:40.968013+0000","last_peered":"2024-09-17T05:21:40.968013+0000","last_clean":"2024-09-17T05:21:40.968013+0000","last_became_active":"2024-09-17T05:21:40.964429+0000","last_became_peered":"2024-09-17T05:21:40.964429+0000","last_unstale":"2024-09-17T05:21:40.968013+0000","last_undegraded":"2024-09-17T05:21:40.968013+0000","last_fullsized":"2024-09-17T05:21:40.968013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:56.840775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957759+0000","last_change":"2024-09-17T05:21:40.957759+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957759+0000","last_undegraded":"2024-09-17T05:21:40.957759+0000","last_fullsized":"2024-09-17T05:21:40.957759+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.986567+0000","last_change":"2024-09-17T05:21:40.963624+0000","last_active":"2024-09-17T05:21:41.986567+0000","last_peered":"2024-09-17T05:21:41.986567+0000","last_clean":"2024-09-17T05:21:41.986567+0000","last_became_active":"2024-09-17T05:21:40.963377+0000","last_became_peered":"2024-09-17T05:21:40.963377+0000","last_unstale":"2024-09-17T05:21:41.986567+0000","last_undegraded":"2024-09-17T05:21:41.986567+0000","last_fullsized":"2024-09-17T05:21:41.986567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:01.418973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961057+0000","last_change":"2024-09-17T05:21:40.961057+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961057+0000","last_undegraded":"2024-09-17T05:21:40.961057+0000","last_fullsized":"2024-09-17T05:21:40.961057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969907+0000","last_change":"2024-09-17T05:21:40.965780+0000","last_active":"2024-09-17T05:21:40.969907+0000","last_peered":"2024-09-17T05:21:40.969907+0000","last_clean":"2024-09-17T05:21:40.969907+0000","last_became_active":"2024-09-17T05:21:40.965506+0000","last_became_peered":"2024-09-17T05:21:40.965506+0000","last_unstale":"2024-09-17T05:21:40.969907+0000","last_undegraded":"2024-09-17T05:21:40.969907+0000","last_fullsized":"2024-09-17T05:21:40.969907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957830+0000","last_change":"2024-09-17T05:21:40.957830+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957830+0000","last_undegraded":"2024-09-17T05:21:40.957830+0000","last_fullsized":"2024-09-17T05:21:40.957830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.957445+0000","last_change":"2024-09-17T05:21:40.967020+0000","last_active":"2024-09-17T05:21:41.957445+0000","last_peered":"2024-09-17T05:21:41.957445+0000","last_clean":"2024-09-17T05:21:41.957445+0000","last_became_active":"2024-09-17T05:21:40.966744+0000","last_became_peered":"2024-09-17T05:21:40.966744+0000","last_unstale":"2024-09-17T05:21:41.957445+0000","last_undegraded":"2024-09-17T05:21:41.957445+0000","last_fullsized":"2024-09-17T05:21:41.957445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:49.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956537+0000","last_change":"2024-09-17T05:21:40.956537+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956537+0000","last_undegraded":"2024-09-17T05:21:40.956537+0000","last_fullsized":"2024-09-17T05:21:40.956537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971416+0000","last_change":"2024-09-17T05:21:40.969833+0000","last_active":"2024-09-17T05:21:40.971416+0000","last_peered":"2024-09-17T05:21:40.971416+0000","last_clean":"2024-09-17T05:21:40.971416+0000","last_became_active":"2024-09-17T05:21:40.969550+0000","last_became_peered":"2024-09-17T05:21:40.969550+0000","last_unstale":"2024-09-17T05:21:40.971416+0000","last_undegraded":"2024-09-17T05:21:40.971416+0000","last_fullsized":"2024-09-17T05:21:40.971416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:13.362775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978954+0000","last_change":"2024-09-17T05:21:41.975403+0000","last_active":"2024-09-17T05:21:41.978954+0000","last_peered":"2024-09-17T05:21:41.978954+0000","last_clean":"2024-09-17T05:21:41.978954+0000","last_became_active":"2024-09-17T05:21:41.975049+0000","last_became_peered":"2024-09-17T05:21:41.975049+0000","last_unstale":"2024-09-17T05:21:41.978954+0000","last_undegraded":"2024-09-17T05:21:41.978954+0000","last_fullsized":"2024-09-17T05:21:41.978954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:06.056960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.962271+0000","last_change":"2024-09-17T05:21:40.958820+0000","last_active":"2024-09-17T05:21:40.962271+0000","last_peered":"2024-09-17T05:21:40.962271+0000","last_clean":"2024-09-17T05:21:40.962271+0000","last_became_active":"2024-09-17T05:21:40.958548+0000","last_became_peered":"2024-09-17T05:21:40.958548+0000","last_unstale":"2024-09-17T05:21:40.962271+0000","last_undegraded":"2024-09-17T05:21:40.962271+0000","last_fullsized":"2024-09-17T05:21:40.962271+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:40.305357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976909+0000","last_change":"2024-09-17T05:21:41.968799+0000","last_active":"2024-09-17T05:21:41.976909+0000","last_peered":"2024-09-17T05:21:41.976909+0000","last_clean":"2024-09-17T05:21:41.976909+0000","last_became_active":"2024-09-17T05:21:41.968530+0000","last_became_peered":"2024-09-17T05:21:41.968530+0000","last_unstale":"2024-09-17T05:21:41.976909+0000","last_undegraded":"2024-09-17T05:21:41.976909+0000","last_fullsized":"2024-09-17T05:21:41.976909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:00.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969912+0000","last_change":"2024-09-17T05:21:40.966445+0000","last_active":"2024-09-17T05:21:40.969912+0000","last_peered":"2024-09-17T05:21:40.969912+0000","last_clean":"2024-09-17T05:21:40.969912+0000","last_became_active":"2024-09-17T05:21:40.966200+0000","last_became_peered":"2024-09-17T05:21:40.966200+0000","last_unstale":"2024-09-17T05:21:40.969912+0000","last_undegraded":"2024-09-17T05:21:40.969912+0000","last_fullsized":"2024-09-17T05:21:40.969912+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956988+0000","last_change":"2024-09-17T05:21:40.956988+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956988+0000","last_undegraded":"2024-09-17T05:21:40.956988+0000","last_fullsized":"2024-09-17T05:21:40.956988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968291+0000","last_change":"2024-09-17T05:21:40.966051+0000","last_active":"2024-09-17T05:21:40.968291+0000","last_peered":"2024-09-17T05:21:40.968291+0000","last_clean":"2024-09-17T05:21:40.968291+0000","last_became_active":"2024-09-17T05:21:40.965771+0000","last_became_peered":"2024-09-17T05:21:40.965771+0000","last_unstale":"2024-09-17T05:21:40.968291+0000","last_undegraded":"2024-09-17T05:21:40.968291+0000","last_fullsized":"2024-09-17T05:21:40.968291+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.183423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957198+0000","last_change":"2024-09-17T05:21:40.957198+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957198+0000","last_undegraded":"2024-09-17T05:21:40.957198+0000","last_fullsized":"2024-09-17T05:21:40.957198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.968881+0000","last_change":"2024-09-17T05:21:40.964246+0000","last_active":"2024-09-17T05:21:42.968881+0000","last_peered":"2024-09-17T05:21:42.968881+0000","last_clean":"2024-09-17T05:21:42.968881+0000","last_became_active":"2024-09-17T05:21:40.963976+0000","last_became_peered":"2024-09-17T05:21:40.963976+0000","last_unstale":"2024-09-17T05:21:42.968881+0000","last_undegraded":"2024-09-17T05:21:42.968881+0000","last_fullsized":"2024-09-17T05:21:42.968881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:33.579472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953710+0000","last_change":"2024-09-17T05:21:40.953710+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953710+0000","last_undegraded":"2024-09-17T05:21:40.953710+0000","last_fullsized":"2024-09-17T05:21:40.953710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964214+0000","last_change":"2024-09-17T05:21:40.963049+0000","last_active":"2024-09-17T05:21:40.964214+0000","last_peered":"2024-09-17T05:21:40.964214+0000","last_clean":"2024-09-17T05:21:40.964214+0000","last_became_active":"2024-09-17T05:21:40.962743+0000","last_became_peered":"2024-09-17T05:21:40.962743+0000","last_unstale":"2024-09-17T05:21:40.964214+0000","last_undegraded":"2024-09-17T05:21:40.964214+0000","last_fullsized":"2024-09-17T05:21:40.964214+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:57.944586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978212+0000","last_change":"2024-09-17T05:21:41.972775+0000","last_active":"2024-09-17T05:21:41.978212+0000","last_peered":"2024-09-17T05:21:41.978212+0000","last_clean":"2024-09-17T05:21:41.978212+0000","last_became_active":"2024-09-17T05:21:41.972226+0000","last_became_peered":"2024-09-17T05:21:41.972226+0000","last_unstale":"2024-09-17T05:21:41.978212+0000","last_undegraded":"2024-09-17T05:21:41.978212+0000","last_fullsized":"2024-09-17T05:21:41.978212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969581+0000","last_change":"2024-09-17T05:21:40.965286+0000","last_active":"2024-09-17T05:21:40.969581+0000","last_peered":"2024-09-17T05:21:40.969581+0000","last_clean":"2024-09-17T05:21:40.969581+0000","last_became_active":"2024-09-17T05:21:40.963994+0000","last_became_peered":"2024-09-17T05:21:40.963994+0000","last_unstale":"2024-09-17T05:21:40.969581+0000","last_undegraded":"2024-09-17T05:21:40.969581+0000","last_fullsized":"2024-09-17T05:21:40.969581+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:58.092810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963247+0000","last_change":"2024-09-17T05:21:40.963247+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963247+0000","last_undegraded":"2024-09-17T05:21:40.963247+0000","last_fullsized":"2024-09-17T05:21:40.963247+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968342+0000","last_change":"2024-09-17T05:21:40.966188+0000","last_active":"2024-09-17T05:21:40.968342+0000","last_peered":"2024-09-17T05:21:40.968342+0000","last_clean":"2024-09-17T05:21:40.968342+0000","last_became_active":"2024-09-17T05:21:40.965925+0000","last_became_peered":"2024-09-17T05:21:40.965925+0000","last_unstale":"2024-09-17T05:21:40.968342+0000","last_undegraded":"2024-09-17T05:21:40.968342+0000","last_fullsized":"2024-09-17T05:21:40.968342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:30.135801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957598+0000","last_change":"2024-09-17T05:21:40.957598+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957598+0000","last_undegraded":"2024-09-17T05:21:40.957598+0000","last_fullsized":"2024-09-17T05:21:40.957598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.961276+0000","last_change":"2024-09-17T05:21:40.955869+0000","last_active":"2024-09-17T05:21:40.961276+0000","last_peered":"2024-09-17T05:21:40.961276+0000","last_clean":"2024-09-17T05:21:40.961276+0000","last_became_active":"2024-09-17T05:21:40.955539+0000","last_became_peered":"2024-09-17T05:21:40.955539+0000","last_unstale":"2024-09-17T05:21:40.961276+0000","last_undegraded":"2024-09-17T05:21:40.961276+0000","last_fullsized":"2024-09-17T05:21:40.961276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:44.437748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953261+0000","last_change":"2024-09-17T05:21:40.953261+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953261+0000","last_undegraded":"2024-09-17T05:21:40.953261+0000","last_fullsized":"2024-09-17T05:21:40.953261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.959366+0000","last_change":"2024-09-17T05:21:40.958018+0000","last_active":"2024-09-17T05:21:40.959366+0000","last_peered":"2024-09-17T05:21:40.959366+0000","last_clean":"2024-09-17T05:21:40.959366+0000","last_became_active":"2024-09-17T05:21:40.957745+0000","last_became_peered":"2024-09-17T05:21:40.957745+0000","last_unstale":"2024-09-17T05:21:40.959366+0000","last_undegraded":"2024-09-17T05:21:40.959366+0000","last_fullsized":"2024-09-17T05:21:40.959366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:00.937883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959744+0000","last_change":"2024-09-17T05:21:40.959744+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959744+0000","last_undegraded":"2024-09-17T05:21:40.959744+0000","last_fullsized":"2024-09-17T05:21:40.959744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971410+0000","last_change":"2024-09-17T05:21:40.969445+0000","last_active":"2024-09-17T05:21:40.971410+0000","last_peered":"2024-09-17T05:21:40.971410+0000","last_clean":"2024-09-17T05:21:40.971410+0000","last_became_active":"2024-09-17T05:21:40.969235+0000","last_became_peered":"2024-09-17T05:21:40.969235+0000","last_unstale":"2024-09-17T05:21:40.971410+0000","last_undegraded":"2024-09-17T05:21:40.971410+0000","last_fullsized":"2024-09-17T05:21:40.971410+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:05.115216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961194+0000","last_change":"2024-09-17T05:21:40.961194+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961194+0000","last_undegraded":"2024-09-17T05:21:40.961194+0000","last_fullsized":"2024-09-17T05:21:40.961194+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969072+0000","last_change":"2024-09-17T05:21:40.965053+0000","last_active":"2024-09-17T05:21:40.969072+0000","last_peered":"2024-09-17T05:21:40.969072+0000","last_clean":"2024-09-17T05:21:40.969072+0000","last_became_active":"2024-09-17T05:21:40.964717+0000","last_became_peered":"2024-09-17T05:21:40.964717+0000","last_unstale":"2024-09-17T05:21:40.969072+0000","last_undegraded":"2024-09-17T05:21:40.969072+0000","last_fullsized":"2024-09-17T05:21:40.969072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:30.434888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.960480+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:21:40.960480+0000","last_peered":"2024-09-17T05:21:40.960480+0000","last_clean":"2024-09-17T05:21:40.960480+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:21:40.960480+0000","last_undegraded":"2024-09-17T05:21:40.960480+0000","last_fullsized":"2024-09-17T05:21:40.960480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1257472,"data_stored":860262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":869231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3f is not active+clean 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.956492+0000', 'last_change': '2024-09-17T05:21:40.956492+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.956492+0000', 'last_undegraded': '2024-09-17T05:21:40.956492+0000', 'last_fullsized': '2024-09-17T05:21:40.956492+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3e is not active+clean 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.961469+0000', 'last_change': '2024-09-17T05:21:40.961469+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.961469+0000', 'last_undegraded': '2024-09-17T05:21:40.961469+0000', 'last_fullsized': '2024-09-17T05:21:40.961469+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3d is not active+clean 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.959275+0000', 'last_change': '2024-09-17T05:21:40.959275+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.959275+0000', 'last_undegraded': '2024-09-17T05:21:40.959275+0000', 'last_fullsized': '2024-09-17T05:21:40.959275+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3c is not active+clean 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.958219+0000', 'last_change': '2024-09-17T05:21:40.958219+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.958219+0000', 'last_undegraded': '2024-09-17T05:21:40.958219+0000', 'last_fullsized': '2024-09-17T05:21:40.958219+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3b is not active+clean 2024-09-17T05:21:46.669 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957793+0000', 'last_change': '2024-09-17T05:21:40.957793+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957793+0000', 'last_undegraded': '2024-09-17T05:21:40.957793+0000', 'last_fullsized': '2024-09-17T05:21:40.957793+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:PG 9.39 is not active+clean 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.953365+0000', 'last_change': '2024-09-17T05:21:40.953365+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.953365+0000', 'last_undegraded': '2024-09-17T05:21:40.953365+0000', 'last_fullsized': '2024-09-17T05:21:40.953365+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:PG 9.38 is not active+clean 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.961669+0000', 'last_change': '2024-09-17T05:21:40.961669+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.961669+0000', 'last_undegraded': '2024-09-17T05:21:40.961669+0000', 'last_fullsized': '2024-09-17T05:21:40.961669+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:PG 9.37 is not active+clean 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.952461+0000', 'last_change': '2024-09-17T05:21:40.952461+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.952461+0000', 'last_undegraded': '2024-09-17T05:21:40.952461+0000', 'last_fullsized': '2024-09-17T05:21:40.952461+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:PG 9.36 is not active+clean 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.954960+0000', 'last_change': '2024-09-17T05:21:40.954960+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.954960+0000', 'last_undegraded': '2024-09-17T05:21:40.954960+0000', 'last_fullsized': '2024-09-17T05:21:40.954960+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:PG 9.35 is not active+clean 2024-09-17T05:21:46.670 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.953449+0000', 'last_change': '2024-09-17T05:21:40.953449+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.953449+0000', 'last_undegraded': '2024-09-17T05:21:40.953449+0000', 'last_fullsized': '2024-09-17T05:21:40.953449+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:PG 9.34 is not active+clean 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957739+0000', 'last_change': '2024-09-17T05:21:40.957739+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957739+0000', 'last_undegraded': '2024-09-17T05:21:40.957739+0000', 'last_fullsized': '2024-09-17T05:21:40.957739+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:PG 9.33 is not active+clean 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.955240+0000', 'last_change': '2024-09-17T05:21:40.955240+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.955240+0000', 'last_undegraded': '2024-09-17T05:21:40.955240+0000', 'last_fullsized': '2024-09-17T05:21:40.955240+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:PG 9.32 is not active+clean 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.952529+0000', 'last_change': '2024-09-17T05:21:40.952529+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.952529+0000', 'last_undegraded': '2024-09-17T05:21:40.952529+0000', 'last_fullsized': '2024-09-17T05:21:40.952529+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:PG 9.31 is not active+clean 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.952386+0000', 'last_change': '2024-09-17T05:21:40.952386+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.952386+0000', 'last_undegraded': '2024-09-17T05:21:40.952386+0000', 'last_fullsized': '2024-09-17T05:21:40.952386+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2f is not active+clean 2024-09-17T05:21:46.671 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.963021+0000', 'last_change': '2024-09-17T05:21:40.963021+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.963021+0000', 'last_undegraded': '2024-09-17T05:21:40.963021+0000', 'last_fullsized': '2024-09-17T05:21:40.963021+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2e is not active+clean 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.959846+0000', 'last_change': '2024-09-17T05:21:40.959846+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.959846+0000', 'last_undegraded': '2024-09-17T05:21:40.959846+0000', 'last_fullsized': '2024-09-17T05:21:40.959846+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2d is not active+clean 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957605+0000', 'last_change': '2024-09-17T05:21:40.957605+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957605+0000', 'last_undegraded': '2024-09-17T05:21:40.957605+0000', 'last_fullsized': '2024-09-17T05:21:40.957605+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2c is not active+clean 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.961482+0000', 'last_change': '2024-09-17T05:21:40.961482+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.961482+0000', 'last_undegraded': '2024-09-17T05:21:40.961482+0000', 'last_fullsized': '2024-09-17T05:21:40.961482+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2b is not active+clean 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.959540+0000', 'last_change': '2024-09-17T05:21:40.959540+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.959540+0000', 'last_undegraded': '2024-09-17T05:21:40.959540+0000', 'last_fullsized': '2024-09-17T05:21:40.959540+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2a is not active+clean 2024-09-17T05:21:46.672 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.963974+0000', 'last_change': '2024-09-17T05:21:40.963974+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.963974+0000', 'last_undegraded': '2024-09-17T05:21:40.963974+0000', 'last_fullsized': '2024-09-17T05:21:40.963974+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:PG 9.29 is not active+clean 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.958557+0000', 'last_change': '2024-09-17T05:21:40.958557+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.958557+0000', 'last_undegraded': '2024-09-17T05:21:40.958557+0000', 'last_fullsized': '2024-09-17T05:21:40.958557+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:PG 9.28 is not active+clean 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.955698+0000', 'last_change': '2024-09-17T05:21:40.955698+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.955698+0000', 'last_undegraded': '2024-09-17T05:21:40.955698+0000', 'last_fullsized': '2024-09-17T05:21:40.955698+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:PG 9.27 is not active+clean 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.956132+0000', 'last_change': '2024-09-17T05:21:40.956132+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.956132+0000', 'last_undegraded': '2024-09-17T05:21:40.956132+0000', 'last_fullsized': '2024-09-17T05:21:40.956132+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:PG 9.26 is not active+clean 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.958106+0000', 'last_change': '2024-09-17T05:21:40.958106+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.958106+0000', 'last_undegraded': '2024-09-17T05:21:40.958106+0000', 'last_fullsized': '2024-09-17T05:21:40.958106+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:PG 9.24 is not active+clean 2024-09-17T05:21:46.673 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957520+0000', 'last_change': '2024-09-17T05:21:40.957520+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957520+0000', 'last_undegraded': '2024-09-17T05:21:40.957520+0000', 'last_fullsized': '2024-09-17T05:21:40.957520+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:PG 9.23 is not active+clean 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.961310+0000', 'last_change': '2024-09-17T05:21:40.961310+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.961310+0000', 'last_undegraded': '2024-09-17T05:21:40.961310+0000', 'last_fullsized': '2024-09-17T05:21:40.961310+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:PG 9.22 is not active+clean 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.959462+0000', 'last_change': '2024-09-17T05:21:40.959462+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.959462+0000', 'last_undegraded': '2024-09-17T05:21:40.959462+0000', 'last_fullsized': '2024-09-17T05:21:40.959462+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:PG 9.21 is not active+clean 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.955663+0000', 'last_change': '2024-09-17T05:21:40.955663+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.955663+0000', 'last_undegraded': '2024-09-17T05:21:40.955663+0000', 'last_fullsized': '2024-09-17T05:21:40.955663+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1f is not active+clean 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.953367+0000', 'last_change': '2024-09-17T05:21:40.953367+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.953367+0000', 'last_undegraded': '2024-09-17T05:21:40.953367+0000', 'last_fullsized': '2024-09-17T05:21:40.953367+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1a is not active+clean 2024-09-17T05:21:46.674 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.963621+0000', 'last_change': '2024-09-17T05:21:40.963621+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.963621+0000', 'last_undegraded': '2024-09-17T05:21:40.963621+0000', 'last_fullsized': '2024-09-17T05:21:40.963621+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1b is not active+clean 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.961806+0000', 'last_change': '2024-09-17T05:21:40.961806+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.961806+0000', 'last_undegraded': '2024-09-17T05:21:40.961806+0000', 'last_fullsized': '2024-09-17T05:21:40.961806+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 9.18 is not active+clean 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.955212+0000', 'last_change': '2024-09-17T05:21:40.955212+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.955212+0000', 'last_undegraded': '2024-09-17T05:21:40.955212+0000', 'last_fullsized': '2024-09-17T05:21:40.955212+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 9.19 is not active+clean 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.960703+0000', 'last_change': '2024-09-17T05:21:40.960703+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.960703+0000', 'last_undegraded': '2024-09-17T05:21:40.960703+0000', 'last_fullsized': '2024-09-17T05:21:40.960703+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 9.16 is not active+clean 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.952679+0000', 'last_change': '2024-09-17T05:21:40.952679+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.952679+0000', 'last_undegraded': '2024-09-17T05:21:40.952679+0000', 'last_fullsized': '2024-09-17T05:21:40.952679+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:PG 9.17 is not active+clean 2024-09-17T05:21:46.675 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.958287+0000', 'last_change': '2024-09-17T05:21:40.958287+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.958287+0000', 'last_undegraded': '2024-09-17T05:21:40.958287+0000', 'last_fullsized': '2024-09-17T05:21:40.958287+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 9.14 is not active+clean 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.954113+0000', 'last_change': '2024-09-17T05:21:40.954113+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.954113+0000', 'last_undegraded': '2024-09-17T05:21:40.954113+0000', 'last_fullsized': '2024-09-17T05:21:40.954113+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 9.15 is not active+clean 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.958264+0000', 'last_change': '2024-09-17T05:21:40.958264+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.958264+0000', 'last_undegraded': '2024-09-17T05:21:40.958264+0000', 'last_fullsized': '2024-09-17T05:21:40.958264+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 9.12 is not active+clean 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957038+0000', 'last_change': '2024-09-17T05:21:40.957038+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957038+0000', 'last_undegraded': '2024-09-17T05:21:40.957038+0000', 'last_fullsized': '2024-09-17T05:21:40.957038+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 9.13 is not active+clean 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.959085+0000', 'last_change': '2024-09-17T05:21:40.959085+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.959085+0000', 'last_undegraded': '2024-09-17T05:21:40.959085+0000', 'last_fullsized': '2024-09-17T05:21:40.959085+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:PG 9.10 is not active+clean 2024-09-17T05:21:46.676 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.952845+0000', 'last_change': '2024-09-17T05:21:40.952845+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.952845+0000', 'last_undegraded': '2024-09-17T05:21:40.952845+0000', 'last_fullsized': '2024-09-17T05:21:40.952845+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 9.11 is not active+clean 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.958146+0000', 'last_change': '2024-09-17T05:21:40.958146+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.958146+0000', 'last_undegraded': '2024-09-17T05:21:40.958146+0000', 'last_fullsized': '2024-09-17T05:21:40.958146+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 9.e is not active+clean 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.959421+0000', 'last_change': '2024-09-17T05:21:40.959421+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.959421+0000', 'last_undegraded': '2024-09-17T05:21:40.959421+0000', 'last_fullsized': '2024-09-17T05:21:40.959421+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 9.f is not active+clean 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957759+0000', 'last_change': '2024-09-17T05:21:40.957759+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957759+0000', 'last_undegraded': '2024-09-17T05:21:40.957759+0000', 'last_fullsized': '2024-09-17T05:21:40.957759+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 9.c is not active+clean 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.961057+0000', 'last_change': '2024-09-17T05:21:40.961057+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.961057+0000', 'last_undegraded': '2024-09-17T05:21:40.961057+0000', 'last_fullsized': '2024-09-17T05:21:40.961057+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:PG 9.d is not active+clean 2024-09-17T05:21:46.677 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957830+0000', 'last_change': '2024-09-17T05:21:40.957830+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957830+0000', 'last_undegraded': '2024-09-17T05:21:40.957830+0000', 'last_fullsized': '2024-09-17T05:21:40.957830+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 9.a is not active+clean 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.956537+0000', 'last_change': '2024-09-17T05:21:40.956537+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.956537+0000', 'last_undegraded': '2024-09-17T05:21:40.956537+0000', 'last_fullsized': '2024-09-17T05:21:40.956537+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 9.6 is not active+clean 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.956988+0000', 'last_change': '2024-09-17T05:21:40.956988+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.956988+0000', 'last_undegraded': '2024-09-17T05:21:40.956988+0000', 'last_fullsized': '2024-09-17T05:21:40.956988+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 9.7 is not active+clean 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957198+0000', 'last_change': '2024-09-17T05:21:40.957198+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957198+0000', 'last_undegraded': '2024-09-17T05:21:40.957198+0000', 'last_fullsized': '2024-09-17T05:21:40.957198+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 9.4 is not active+clean 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.953710+0000', 'last_change': '2024-09-17T05:21:40.953710+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.953710+0000', 'last_undegraded': '2024-09-17T05:21:40.953710+0000', 'last_fullsized': '2024-09-17T05:21:40.953710+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:PG 9.2 is not active+clean 2024-09-17T05:21:46.678 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.963247+0000', 'last_change': '2024-09-17T05:21:40.963247+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.963247+0000', 'last_undegraded': '2024-09-17T05:21:40.963247+0000', 'last_fullsized': '2024-09-17T05:21:40.963247+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.3 is not active+clean 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.957598+0000', 'last_change': '2024-09-17T05:21:40.957598+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.957598+0000', 'last_undegraded': '2024-09-17T05:21:40.957598+0000', 'last_fullsized': '2024-09-17T05:21:40.957598+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.0 is not active+clean 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.953261+0000', 'last_change': '2024-09-17T05:21:40.953261+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.953261+0000', 'last_undegraded': '2024-09-17T05:21:40.953261+0000', 'last_fullsized': '2024-09-17T05:21:40.953261+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.1 is not active+clean 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.959744+0000', 'last_change': '2024-09-17T05:21:40.959744+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.959744+0000', 'last_undegraded': '2024-09-17T05:21:40.959744+0000', 'last_fullsized': '2024-09-17T05:21:40.959744+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:PG 9.8 is not active+clean 2024-09-17T05:21:46.679 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '9.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 56, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:21:40.961194+0000', 'last_change': '2024-09-17T05:21:40.961194+0000', 'last_active': '2024-09-17T05:21:40.946611+0000', 'last_peered': '2024-09-17T05:21:40.946611+0000', 'last_clean': '2024-09-17T05:21:40.946611+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:21:40.961194+0000', 'last_undegraded': '2024-09-17T05:21:40.961194+0000', 'last_fullsized': '2024-09-17T05:21:40.961194+0000', 'mapping_epoch': 56, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 56, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'last_clean_scrub_stamp': '2024-09-17T05:21:40.946611+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:21:46.680 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:21:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.803+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3099756108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b94072ab0 msgr2=0x7f8b940b2ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.803+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3099756108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b94072ab0 0x7f8b940b2ba0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f8b94070340 tx=0x7f8b8402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.803+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3099756108 shutdown_connections 2024-09-17T05:21:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.803+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3099756108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b94072ab0 0x7f8b940b2ba0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.804+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3099756108 >> v2:172.21.15.160:3300/0 conn(0x7f8b941436e0 0x7f8b9415a390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.804+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3099756108 >> 172.21.15.81:0/3099756108 conn(0x7f8b9406cf60 msgr2=0x7f8b9406d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:46.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.804+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3099756108 shutdown_connections 2024-09-17T05:21:46.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.804+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3099756108 wait complete. 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 Processor -- start 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 -- start start 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b94072ab0 0x7f8b94136290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b940b30e0 0x7f8b9412fdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b941436e0 0x7f8b94155820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9406f770 con 0x7f8b940b30e0 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8b9406f5f0 con 0x7f8b94072ab0 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.805+0000 7f8b9bbad640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8b94070690 con 0x7f8b941436e0 2024-09-17T05:21:46.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b940b30e0 0x7f8b9412fdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b940b30e0 0x7f8b9412fdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47656/0 (socket says 172.21.15.81:47656) 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 -- 172.21.15.81:0/3053990106 learned_addr learned my addr 172.21.15.81:0/3053990106 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b9a14a640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b941436e0 0x7f8b94155820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99949640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b94072ab0 0x7f8b94136290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 -- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b941436e0 msgr2=0x7f8b94155820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b941436e0 0x7f8b94155820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 -- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b94072ab0 msgr2=0x7f8b94136290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b94072ab0 0x7f8b94136290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 -- 172.21.15.81:0/3053990106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b94130790 con 0x7f8b940b30e0 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b99148640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b940b30e0 0x7f8b9412fdc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009780 tx=0x7f8b84032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:46.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b8a7fc640 1 -- 172.21.15.81:0/3053990106 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b84040070 con 0x7f8b940b30e0 2024-09-17T05:21:46.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b8a7fc640 1 -- 172.21.15.81:0/3053990106 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b84005310 con 0x7f8b940b30e0 2024-09-17T05:21:46.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b8a7fc640 1 -- 172.21.15.81:0/3053990106 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b84003800 con 0x7f8b940b30e0 2024-09-17T05:21:46.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b94130a70 con 0x7f8b940b30e0 2024-09-17T05:21:46.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.806+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b94131030 con 0x7f8b940b30e0 2024-09-17T05:21:46.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.807+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b940b4330 con 0x7f8b940b30e0 2024-09-17T05:21:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.808+0000 7f8b8a7fc640 1 -- 172.21.15.81:0/3053990106 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f8b84039040 con 0x7f8b940b30e0 2024-09-17T05:21:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.808+0000 7f8b8a7fc640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8b78078d40 0x7f8b7807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.808+0000 7f8b8a7fc640 1 -- 172.21.15.81:0/3053990106 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f8b840bc370 con 0x7f8b940b30e0 2024-09-17T05:21:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.808+0000 7f8b99949640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8b78078d40 0x7f8b7807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:46.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.809+0000 7f8b99949640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8b78078d40 0x7f8b7807b200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b90006fd0 tx=0x7f8b90008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:46.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:46.812+0000 7f8b8a7fc640 1 -- 172.21.15.81:0/3053990106 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8b940b4330 con 0x7f8b940b30e0 2024-09-17T05:21:47.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.059+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f8b940b2ba0 con 0x7f8b940b30e0 2024-09-17T05:21:47.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.059+0000 7f8b8a7fc640 1 -- 172.21.15.81:0/3053990106 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1139 (secure 0 0 0) 0x7f8b840844c0 con 0x7f8b940b30e0 2024-09-17T05:21:47.060 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:47.060 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":204,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550316,"num_in_osds":8,"osd_in_since":1726550306,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":54},{"state_name":"active+clean","count":43}],"num_pgs":97,"num_pools":3,"num_objects":7,"data_bytes":590950,"bytes_used":232189952,"bytes_avail":772861923328,"bytes_total":773094113280,"inactive_pgs_ratio":0.55670100450515747,"write_bytes_sec":187,"read_op_per_sec":0,"write_op_per_sec":2},"fsmap":{"epoch":31,"btime":"2024-09-17T05:21:44:975320+0000","id":4,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":4,"rank":0,"name":"c","status":"up:active","gid":5757}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-17T05:21:09.408358+0000","services":{}},"progress_events":{}} 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8b78078d40 msgr2=0x7f8b7807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8b78078d40 0x7f8b7807b200 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f8b90006fd0 tx=0x7f8b90008040 comp rx=0 tx=0).stop 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b940b30e0 msgr2=0x7f8b9412fdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b940b30e0 0x7f8b9412fdc0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f8b84009780 tx=0x7f8b84032d50 comp rx=0 tx=0).stop 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 shutdown_connections 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f8b78078d40 0x7f8b7807b200 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b941436e0 0x7f8b94155820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b940b30e0 0x7f8b9412fdc0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 --2- 172.21.15.81:0/3053990106 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b94072ab0 0x7f8b94136290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 >> 172.21.15.81:0/3053990106 conn(0x7f8b9406cf60 msgr2=0x7f8b94139380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 shutdown_connections 2024-09-17T05:21:47.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.062+0000 7f8b9bbad640 1 -- 172.21.15.81:0/3053990106 wait complete. 2024-09-17T05:21:47.072 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:21:47.073 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.173+0000 7fedf1524640 1 -- 172.21.15.81:0/2231401820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec0d0d40 msgr2=0x7fedec0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.173+0000 7fedf1524640 1 --2- 172.21.15.81:0/2231401820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec0d0d40 0x7fedec0cf9b0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fedec0d1eb0 tx=0x7fede002a4f0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.173+0000 7fedf1524640 1 -- 172.21.15.81:0/2231401820 shutdown_connections 2024-09-17T05:21:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.173+0000 7fedf1524640 1 --2- 172.21.15.81:0/2231401820 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec0d0d40 0x7fedec0cf9b0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.173+0000 7fedf1524640 1 -- 172.21.15.81:0/2231401820 >> 172.21.15.81:0/2231401820 conn(0x7fedec0d3ea0 msgr2=0x7fedec0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.173+0000 7fedf1524640 1 -- 172.21.15.81:0/2231401820 shutdown_connections 2024-09-17T05:21:47.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.173+0000 7fedf1524640 1 -- 172.21.15.81:0/2231401820 wait complete. 2024-09-17T05:21:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.174+0000 7fedf1524640 1 Processor -- start 2024-09-17T05:21:47.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.174+0000 7fedf1524640 1 -- start start 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedf1524640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedec0d0d40 0x7fedec150b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedf1524640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedec0d49c0 0x7fedec161610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedf1524640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec15df90 0x7fedec0b8ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedf1524640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedec162690 con 0x7fedec15df90 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedf1524640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fedec0b3f10 con 0x7fedec0d49c0 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedf1524640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fedec15d550 con 0x7fedec0d0d40 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec15df90 0x7fedec0b8ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:47.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec15df90 0x7fedec0b8ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47674/0 (socket says 172.21.15.81:47674) 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 -- 172.21.15.81:0/3942833666 learned_addr learned my addr 172.21.15.81:0/3942833666 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedea7fc640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedec0d49c0 0x7fedec161610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeaffd640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedec0d0d40 0x7fedec150b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 -- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedec0d0d40 msgr2=0x7fedec150b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedec0d0d40 0x7fedec150b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 -- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedec0d49c0 msgr2=0x7fedec161610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedec0d49c0 0x7fedec161610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 -- 172.21.15.81:0/3942833666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedec0cd020 con 0x7fedec15df90 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.175+0000 7fedeb7fe640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec15df90 0x7fedec0b8ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fede400c390 tx=0x7fede400c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.176+0000 7fedd37fe640 1 -- 172.21.15.81:0/3942833666 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4017070 con 0x7fedec15df90 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.176+0000 7fedd37fe640 1 -- 172.21.15.81:0/3942833666 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fede40035f0 con 0x7fedec15df90 2024-09-17T05:21:47.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.176+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedec15f080 con 0x7fedec15df90 2024-09-17T05:21:47.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.176+0000 7fedd37fe640 1 -- 172.21.15.81:0/3942833666 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fede4003a40 con 0x7fedec15df90 2024-09-17T05:21:47.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.176+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedec0cd5a0 con 0x7fedec15df90 2024-09-17T05:21:47.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.177+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedec0b4490 con 0x7fedec15df90 2024-09-17T05:21:47.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.177+0000 7fedd37fe640 1 -- 172.21.15.81:0/3942833666 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fede401a070 con 0x7fedec15df90 2024-09-17T05:21:47.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.178+0000 7fedd37fe640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fedd8078d40 0x7fedd807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:47.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.178+0000 7fedd37fe640 1 -- 172.21.15.81:0/3942833666 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fede409a430 con 0x7fedec15df90 2024-09-17T05:21:47.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.178+0000 7fedeaffd640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fedd8078d40 0x7fedd807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:47.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.179+0000 7fedeaffd640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fedd8078d40 0x7fedd807b200 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feddc009f20 tx=0x7feddc0094d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:47.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.182+0000 7fedd37fe640 1 -- 172.21.15.81:0/3942833666 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fedec0ce970 con 0x7fedec15df90 2024-09-17T05:21:47.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.355+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fedec151100 con 0x7fedd8078d40 2024-09-17T05:21:47.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.359+0000 7fedd37fe640 1 -- 172.21.15.81:0/3942833666 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247500 (secure 0 0 0) 0x7feddc009680 con 0x7fedd8078d40 2024-09-17T05:21:47.361 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:47.364 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:21:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fedd8078d40 msgr2=0x7fedd807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fedd8078d40 0x7fedd807b200 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7feddc009f20 tx=0x7feddc0094d0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec15df90 msgr2=0x7fedec0b8ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:47.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec15df90 0x7fedec0b8ea0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fede400c390 tx=0x7fede400c850 comp rx=0 tx=0).stop 2024-09-17T05:21:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 shutdown_connections 2024-09-17T05:21:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fedd8078d40 0x7fedd807b200 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedec15df90 0x7fedec0b8ea0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedec0d49c0 0x7fedec161610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 --2- 172.21.15.81:0/3942833666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedec0d0d40 0x7fedec150b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:47.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.362+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 >> 172.21.15.81:0/3942833666 conn(0x7fedec0d3ea0 msgr2=0x7fedec0b0ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.363+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 shutdown_connections 2024-09-17T05:21:47.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:47.363+0000 7fedf1524640 1 -- 172.21.15.81:0/3942833666 wait complete. 2024-09-17T05:21:47.373 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":147,"stamp":"2024-09-17T05:21:45.417244+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590950,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":112,"num_write_kb":1629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":82,"ondisk_log_size":82,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":44,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":226748,"kb_used_data":6324,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747972,"statfs":{"total":773094113280,"available":772861923328,"internally_reserved":0,"allocated":6475776,"data_stored":3323789,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.469532"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956492+0000","last_change":"2024-09-17T05:21:40.956492+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956492+0000","last_undegraded":"2024-09-17T05:21:40.956492+0000","last_fullsized":"2024-09-17T05:21:40.956492+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961469+0000","last_change":"2024-09-17T05:21:40.961469+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961469+0000","last_undegraded":"2024-09-17T05:21:40.961469+0000","last_fullsized":"2024-09-17T05:21:40.961469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959275+0000","last_change":"2024-09-17T05:21:40.959275+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959275+0000","last_undegraded":"2024-09-17T05:21:40.959275+0000","last_fullsized":"2024-09-17T05:21:40.959275+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958219+0000","last_change":"2024-09-17T05:21:40.958219+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958219+0000","last_undegraded":"2024-09-17T05:21:40.958219+0000","last_fullsized":"2024-09-17T05:21:40.958219+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957793+0000","last_change":"2024-09-17T05:21:40.957793+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957793+0000","last_undegraded":"2024-09-17T05:21:40.957793+0000","last_fullsized":"2024-09-17T05:21:40.957793+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.973076+0000","last_change":"2024-09-17T05:21:41.966263+0000","last_active":"2024-09-17T05:21:41.973076+0000","last_peered":"2024-09-17T05:21:41.973076+0000","last_clean":"2024-09-17T05:21:41.973076+0000","last_became_active":"2024-09-17T05:21:41.965998+0000","last_became_peered":"2024-09-17T05:21:41.965998+0000","last_unstale":"2024-09-17T05:21:41.973076+0000","last_undegraded":"2024-09-17T05:21:41.973076+0000","last_fullsized":"2024-09-17T05:21:41.973076+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:47.756519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953365+0000","last_change":"2024-09-17T05:21:40.953365+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953365+0000","last_undegraded":"2024-09-17T05:21:40.953365+0000","last_fullsized":"2024-09-17T05:21:40.953365+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961669+0000","last_change":"2024-09-17T05:21:40.961669+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961669+0000","last_undegraded":"2024-09-17T05:21:40.961669+0000","last_fullsized":"2024-09-17T05:21:40.961669+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952461+0000","last_change":"2024-09-17T05:21:40.952461+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952461+0000","last_undegraded":"2024-09-17T05:21:40.952461+0000","last_fullsized":"2024-09-17T05:21:40.952461+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954960+0000","last_change":"2024-09-17T05:21:40.954960+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954960+0000","last_undegraded":"2024-09-17T05:21:40.954960+0000","last_fullsized":"2024-09-17T05:21:40.954960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953449+0000","last_change":"2024-09-17T05:21:40.953449+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953449+0000","last_undegraded":"2024-09-17T05:21:40.953449+0000","last_fullsized":"2024-09-17T05:21:40.953449+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957739+0000","last_change":"2024-09-17T05:21:40.957739+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957739+0000","last_undegraded":"2024-09-17T05:21:40.957739+0000","last_fullsized":"2024-09-17T05:21:40.957739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955240+0000","last_change":"2024-09-17T05:21:40.955240+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955240+0000","last_undegraded":"2024-09-17T05:21:40.955240+0000","last_fullsized":"2024-09-17T05:21:40.955240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952529+0000","last_change":"2024-09-17T05:21:40.952529+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952529+0000","last_undegraded":"2024-09-17T05:21:40.952529+0000","last_fullsized":"2024-09-17T05:21:40.952529+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952386+0000","last_change":"2024-09-17T05:21:40.952386+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952386+0000","last_undegraded":"2024-09-17T05:21:40.952386+0000","last_fullsized":"2024-09-17T05:21:40.952386+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978469+0000","last_change":"2024-09-17T05:21:41.973282+0000","last_active":"2024-09-17T05:21:41.978469+0000","last_peered":"2024-09-17T05:21:41.978469+0000","last_clean":"2024-09-17T05:21:41.978469+0000","last_became_active":"2024-09-17T05:21:41.972899+0000","last_became_peered":"2024-09-17T05:21:41.972899+0000","last_unstale":"2024-09-17T05:21:41.978469+0000","last_undegraded":"2024-09-17T05:21:41.978469+0000","last_fullsized":"2024-09-17T05:21:41.978469+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:13.151036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963021+0000","last_change":"2024-09-17T05:21:40.963021+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963021+0000","last_undegraded":"2024-09-17T05:21:40.963021+0000","last_fullsized":"2024-09-17T05:21:40.963021+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959846+0000","last_change":"2024-09-17T05:21:40.959846+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959846+0000","last_undegraded":"2024-09-17T05:21:40.959846+0000","last_fullsized":"2024-09-17T05:21:40.959846+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957605+0000","last_change":"2024-09-17T05:21:40.957605+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957605+0000","last_undegraded":"2024-09-17T05:21:40.957605+0000","last_fullsized":"2024-09-17T05:21:40.957605+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961482+0000","last_change":"2024-09-17T05:21:40.961482+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961482+0000","last_undegraded":"2024-09-17T05:21:40.961482+0000","last_fullsized":"2024-09-17T05:21:40.961482+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959540+0000","last_change":"2024-09-17T05:21:40.959540+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959540+0000","last_undegraded":"2024-09-17T05:21:40.959540+0000","last_fullsized":"2024-09-17T05:21:40.959540+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963974+0000","last_change":"2024-09-17T05:21:40.963974+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963974+0000","last_undegraded":"2024-09-17T05:21:40.963974+0000","last_fullsized":"2024-09-17T05:21:40.963974+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958557+0000","last_change":"2024-09-17T05:21:40.958557+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958557+0000","last_undegraded":"2024-09-17T05:21:40.958557+0000","last_fullsized":"2024-09-17T05:21:40.958557+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955698+0000","last_change":"2024-09-17T05:21:40.955698+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955698+0000","last_undegraded":"2024-09-17T05:21:40.955698+0000","last_fullsized":"2024-09-17T05:21:40.955698+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956132+0000","last_change":"2024-09-17T05:21:40.956132+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956132+0000","last_undegraded":"2024-09-17T05:21:40.956132+0000","last_fullsized":"2024-09-17T05:21:40.956132+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958106+0000","last_change":"2024-09-17T05:21:40.958106+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958106+0000","last_undegraded":"2024-09-17T05:21:40.958106+0000","last_fullsized":"2024-09-17T05:21:40.958106+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976288+0000","last_change":"2024-09-17T05:21:41.971075+0000","last_active":"2024-09-17T05:21:41.976288+0000","last_peered":"2024-09-17T05:21:41.976288+0000","last_clean":"2024-09-17T05:21:41.976288+0000","last_became_active":"2024-09-17T05:21:41.969951+0000","last_became_peered":"2024-09-17T05:21:41.969951+0000","last_unstale":"2024-09-17T05:21:41.976288+0000","last_undegraded":"2024-09-17T05:21:41.976288+0000","last_fullsized":"2024-09-17T05:21:41.976288+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:47.725933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957520+0000","last_change":"2024-09-17T05:21:40.957520+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957520+0000","last_undegraded":"2024-09-17T05:21:40.957520+0000","last_fullsized":"2024-09-17T05:21:40.957520+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961310+0000","last_change":"2024-09-17T05:21:40.961310+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961310+0000","last_undegraded":"2024-09-17T05:21:40.961310+0000","last_fullsized":"2024-09-17T05:21:40.961310+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959462+0000","last_change":"2024-09-17T05:21:40.959462+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959462+0000","last_undegraded":"2024-09-17T05:21:40.959462+0000","last_fullsized":"2024-09-17T05:21:40.959462+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955663+0000","last_change":"2024-09-17T05:21:40.955663+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955663+0000","last_undegraded":"2024-09-17T05:21:40.955663+0000","last_fullsized":"2024-09-17T05:21:40.955663+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978446+0000","last_change":"2024-09-17T05:21:41.971005+0000","last_active":"2024-09-17T05:21:41.978446+0000","last_peered":"2024-09-17T05:21:41.978446+0000","last_clean":"2024-09-17T05:21:41.978446+0000","last_became_active":"2024-09-17T05:21:41.970391+0000","last_became_peered":"2024-09-17T05:21:41.970391+0000","last_unstale":"2024-09-17T05:21:41.978446+0000","last_undegraded":"2024-09-17T05:21:41.978446+0000","last_fullsized":"2024-09-17T05:21:41.978446+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:25.078219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.977831+0000","last_change":"2024-09-17T05:21:41.968746+0000","last_active":"2024-09-17T05:21:41.977831+0000","last_peered":"2024-09-17T05:21:41.977831+0000","last_clean":"2024-09-17T05:21:41.977831+0000","last_became_active":"2024-09-17T05:21:41.968484+0000","last_became_peered":"2024-09-17T05:21:41.968484+0000","last_unstale":"2024-09-17T05:21:41.977831+0000","last_undegraded":"2024-09-17T05:21:41.977831+0000","last_fullsized":"2024-09-17T05:21:41.977831+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:54.971834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":17,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.982342+0000","last_change":"2024-09-17T05:21:40.968346+0000","last_active":"2024-09-17T05:21:41.982342+0000","last_peered":"2024-09-17T05:21:41.982342+0000","last_clean":"2024-09-17T05:21:41.982342+0000","last_became_active":"2024-09-17T05:21:40.968049+0000","last_became_peered":"2024-09-17T05:21:40.968049+0000","last_unstale":"2024-09-17T05:21:41.982342+0000","last_undegraded":"2024-09-17T05:21:41.982342+0000","last_fullsized":"2024-09-17T05:21:41.982342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:01.544228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953367+0000","last_change":"2024-09-17T05:21:40.953367+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953367+0000","last_undegraded":"2024-09-17T05:21:40.953367+0000","last_fullsized":"2024-09-17T05:21:40.953367+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970884+0000","last_change":"2024-09-17T05:21:40.967671+0000","last_active":"2024-09-17T05:21:40.970884+0000","last_peered":"2024-09-17T05:21:40.970884+0000","last_clean":"2024-09-17T05:21:40.970884+0000","last_became_active":"2024-09-17T05:21:40.967346+0000","last_became_peered":"2024-09-17T05:21:40.967346+0000","last_unstale":"2024-09-17T05:21:40.970884+0000","last_undegraded":"2024-09-17T05:21:40.970884+0000","last_fullsized":"2024-09-17T05:21:40.970884+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:07.178757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978311+0000","last_change":"2024-09-17T05:21:41.969430+0000","last_active":"2024-09-17T05:21:41.978311+0000","last_peered":"2024-09-17T05:21:41.978311+0000","last_clean":"2024-09-17T05:21:41.978311+0000","last_became_active":"2024-09-17T05:21:41.969185+0000","last_became_peered":"2024-09-17T05:21:41.969185+0000","last_unstale":"2024-09-17T05:21:41.978311+0000","last_undegraded":"2024-09-17T05:21:41.978311+0000","last_fullsized":"2024-09-17T05:21:41.978311+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:38:26.543092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.983832+0000","last_change":"2024-09-17T05:21:40.955534+0000","last_active":"2024-09-17T05:21:41.983832+0000","last_peered":"2024-09-17T05:21:41.983832+0000","last_clean":"2024-09-17T05:21:41.983832+0000","last_became_active":"2024-09-17T05:21:40.955159+0000","last_became_peered":"2024-09-17T05:21:40.955159+0000","last_unstale":"2024-09-17T05:21:41.983832+0000","last_undegraded":"2024-09-17T05:21:41.983832+0000","last_fullsized":"2024-09-17T05:21:41.983832+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:48.548506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978521+0000","last_change":"2024-09-17T05:21:41.973041+0000","last_active":"2024-09-17T05:21:41.978521+0000","last_peered":"2024-09-17T05:21:41.978521+0000","last_clean":"2024-09-17T05:21:41.978521+0000","last_became_active":"2024-09-17T05:21:41.972532+0000","last_became_peered":"2024-09-17T05:21:41.972532+0000","last_unstale":"2024-09-17T05:21:41.978521+0000","last_undegraded":"2024-09-17T05:21:41.978521+0000","last_fullsized":"2024-09-17T05:21:41.978521+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:29.553319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969613+0000","last_change":"2024-09-17T05:21:40.965725+0000","last_active":"2024-09-17T05:21:40.969613+0000","last_peered":"2024-09-17T05:21:40.969613+0000","last_clean":"2024-09-17T05:21:40.969613+0000","last_became_active":"2024-09-17T05:21:40.965447+0000","last_became_peered":"2024-09-17T05:21:40.965447+0000","last_unstale":"2024-09-17T05:21:40.969613+0000","last_undegraded":"2024-09-17T05:21:40.969613+0000","last_fullsized":"2024-09-17T05:21:40.969613+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:55.548456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963621+0000","last_change":"2024-09-17T05:21:40.963621+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963621+0000","last_undegraded":"2024-09-17T05:21:40.963621+0000","last_fullsized":"2024-09-17T05:21:40.963621+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969075+0000","last_change":"2024-09-17T05:21:40.963116+0000","last_active":"2024-09-17T05:21:40.969075+0000","last_peered":"2024-09-17T05:21:40.969075+0000","last_clean":"2024-09-17T05:21:40.969075+0000","last_became_active":"2024-09-17T05:21:40.961833+0000","last_became_peered":"2024-09-17T05:21:40.961833+0000","last_unstale":"2024-09-17T05:21:40.969075+0000","last_undegraded":"2024-09-17T05:21:40.969075+0000","last_fullsized":"2024-09-17T05:21:40.969075+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:08:37.860369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961806+0000","last_change":"2024-09-17T05:21:40.961806+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961806+0000","last_undegraded":"2024-09-17T05:21:40.961806+0000","last_fullsized":"2024-09-17T05:21:40.961806+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.981651+0000","last_change":"2024-09-17T05:21:40.963990+0000","last_active":"2024-09-17T05:21:41.981651+0000","last_peered":"2024-09-17T05:21:41.981651+0000","last_clean":"2024-09-17T05:21:41.981651+0000","last_became_active":"2024-09-17T05:21:40.963731+0000","last_became_peered":"2024-09-17T05:21:40.963731+0000","last_unstale":"2024-09-17T05:21:41.981651+0000","last_undegraded":"2024-09-17T05:21:41.981651+0000","last_fullsized":"2024-09-17T05:21:41.981651+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:56.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.955212+0000","last_change":"2024-09-17T05:21:40.955212+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.955212+0000","last_undegraded":"2024-09-17T05:21:40.955212+0000","last_fullsized":"2024-09-17T05:21:40.955212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.974434+0000","last_change":"2024-09-17T05:21:40.969945+0000","last_active":"2024-09-17T05:21:40.974434+0000","last_peered":"2024-09-17T05:21:40.974434+0000","last_clean":"2024-09-17T05:21:40.974434+0000","last_became_active":"2024-09-17T05:21:40.969578+0000","last_became_peered":"2024-09-17T05:21:40.969578+0000","last_unstale":"2024-09-17T05:21:40.974434+0000","last_undegraded":"2024-09-17T05:21:40.974434+0000","last_fullsized":"2024-09-17T05:21:40.974434+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.960703+0000","last_change":"2024-09-17T05:21:40.960703+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.960703+0000","last_undegraded":"2024-09-17T05:21:40.960703+0000","last_fullsized":"2024-09-17T05:21:40.960703+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969938+0000","last_change":"2024-09-17T05:21:40.964753+0000","last_active":"2024-09-17T05:21:40.969938+0000","last_peered":"2024-09-17T05:21:40.969938+0000","last_clean":"2024-09-17T05:21:40.969938+0000","last_became_active":"2024-09-17T05:21:40.964467+0000","last_became_peered":"2024-09-17T05:21:40.964467+0000","last_unstale":"2024-09-17T05:21:40.969938+0000","last_undegraded":"2024-09-17T05:21:40.969938+0000","last_fullsized":"2024-09-17T05:21:40.969938+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:05.070651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952679+0000","last_change":"2024-09-17T05:21:40.952679+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952679+0000","last_undegraded":"2024-09-17T05:21:40.952679+0000","last_fullsized":"2024-09-17T05:21:40.952679+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969299+0000","last_change":"2024-09-17T05:21:40.966548+0000","last_active":"2024-09-17T05:21:40.969299+0000","last_peered":"2024-09-17T05:21:40.969299+0000","last_clean":"2024-09-17T05:21:40.969299+0000","last_became_active":"2024-09-17T05:21:40.966011+0000","last_became_peered":"2024-09-17T05:21:40.966011+0000","last_unstale":"2024-09-17T05:21:40.969299+0000","last_undegraded":"2024-09-17T05:21:40.969299+0000","last_fullsized":"2024-09-17T05:21:40.969299+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958287+0000","last_change":"2024-09-17T05:21:40.958287+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958287+0000","last_undegraded":"2024-09-17T05:21:40.958287+0000","last_fullsized":"2024-09-17T05:21:40.958287+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.965236+0000","last_change":"2024-09-17T05:21:40.964038+0000","last_active":"2024-09-17T05:21:40.965236+0000","last_peered":"2024-09-17T05:21:40.965236+0000","last_clean":"2024-09-17T05:21:40.965236+0000","last_became_active":"2024-09-17T05:21:40.963792+0000","last_became_peered":"2024-09-17T05:21:40.963792+0000","last_unstale":"2024-09-17T05:21:40.965236+0000","last_undegraded":"2024-09-17T05:21:40.965236+0000","last_fullsized":"2024-09-17T05:21:40.965236+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:49.506583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.954113+0000","last_change":"2024-09-17T05:21:40.954113+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.954113+0000","last_undegraded":"2024-09-17T05:21:40.954113+0000","last_fullsized":"2024-09-17T05:21:40.954113+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970160+0000","last_change":"2024-09-17T05:21:40.968246+0000","last_active":"2024-09-17T05:21:40.970160+0000","last_peered":"2024-09-17T05:21:40.970160+0000","last_clean":"2024-09-17T05:21:40.970160+0000","last_became_active":"2024-09-17T05:21:40.968012+0000","last_became_peered":"2024-09-17T05:21:40.968012+0000","last_unstale":"2024-09-17T05:21:40.970160+0000","last_undegraded":"2024-09-17T05:21:40.970160+0000","last_fullsized":"2024-09-17T05:21:40.970160+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958264+0000","last_change":"2024-09-17T05:21:40.958264+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958264+0000","last_undegraded":"2024-09-17T05:21:40.958264+0000","last_fullsized":"2024-09-17T05:21:40.958264+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964872+0000","last_change":"2024-09-17T05:21:40.960153+0000","last_active":"2024-09-17T05:21:40.964872+0000","last_peered":"2024-09-17T05:21:40.964872+0000","last_clean":"2024-09-17T05:21:40.964872+0000","last_became_active":"2024-09-17T05:21:40.959884+0000","last_became_peered":"2024-09-17T05:21:40.959884+0000","last_unstale":"2024-09-17T05:21:40.964872+0000","last_undegraded":"2024-09-17T05:21:40.964872+0000","last_fullsized":"2024-09-17T05:21:40.964872+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:23:52.792618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957038+0000","last_change":"2024-09-17T05:21:40.957038+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957038+0000","last_undegraded":"2024-09-17T05:21:40.957038+0000","last_fullsized":"2024-09-17T05:21:40.957038+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.970840+0000","last_change":"2024-09-17T05:21:40.966702+0000","last_active":"2024-09-17T05:21:40.970840+0000","last_peered":"2024-09-17T05:21:40.970840+0000","last_clean":"2024-09-17T05:21:40.970840+0000","last_became_active":"2024-09-17T05:21:40.966428+0000","last_became_peered":"2024-09-17T05:21:40.966428+0000","last_unstale":"2024-09-17T05:21:40.970840+0000","last_undegraded":"2024-09-17T05:21:40.970840+0000","last_fullsized":"2024-09-17T05:21:40.970840+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:15.960978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959085+0000","last_change":"2024-09-17T05:21:40.959085+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959085+0000","last_undegraded":"2024-09-17T05:21:40.959085+0000","last_fullsized":"2024-09-17T05:21:40.959085+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968922+0000","last_change":"2024-09-17T05:21:40.964010+0000","last_active":"2024-09-17T05:21:40.968922+0000","last_peered":"2024-09-17T05:21:40.968922+0000","last_clean":"2024-09-17T05:21:40.968922+0000","last_became_active":"2024-09-17T05:21:40.963746+0000","last_became_peered":"2024-09-17T05:21:40.963746+0000","last_unstale":"2024-09-17T05:21:40.968922+0000","last_undegraded":"2024-09-17T05:21:40.968922+0000","last_fullsized":"2024-09-17T05:21:40.968922+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:42.681141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.952845+0000","last_change":"2024-09-17T05:21:40.952845+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.952845+0000","last_undegraded":"2024-09-17T05:21:40.952845+0000","last_fullsized":"2024-09-17T05:21:40.952845+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968927+0000","last_change":"2024-09-17T05:21:40.963557+0000","last_active":"2024-09-17T05:21:40.968927+0000","last_peered":"2024-09-17T05:21:40.968927+0000","last_clean":"2024-09-17T05:21:40.968927+0000","last_became_active":"2024-09-17T05:21:40.963038+0000","last_became_peered":"2024-09-17T05:21:40.963038+0000","last_unstale":"2024-09-17T05:21:40.968927+0000","last_undegraded":"2024-09-17T05:21:40.968927+0000","last_fullsized":"2024-09-17T05:21:40.968927+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:29.652603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.958146+0000","last_change":"2024-09-17T05:21:40.958146+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.958146+0000","last_undegraded":"2024-09-17T05:21:40.958146+0000","last_fullsized":"2024-09-17T05:21:40.958146+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.976907+0000","last_change":"2024-09-17T05:21:40.969574+0000","last_active":"2024-09-17T05:21:40.976907+0000","last_peered":"2024-09-17T05:21:40.976907+0000","last_clean":"2024-09-17T05:21:40.976907+0000","last_became_active":"2024-09-17T05:21:40.969303+0000","last_became_peered":"2024-09-17T05:21:40.969303+0000","last_unstale":"2024-09-17T05:21:40.976907+0000","last_undegraded":"2024-09-17T05:21:40.976907+0000","last_fullsized":"2024-09-17T05:21:40.976907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:32.539163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959421+0000","last_change":"2024-09-17T05:21:40.959421+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959421+0000","last_undegraded":"2024-09-17T05:21:40.959421+0000","last_fullsized":"2024-09-17T05:21:40.959421+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968013+0000","last_change":"2024-09-17T05:21:40.964669+0000","last_active":"2024-09-17T05:21:40.968013+0000","last_peered":"2024-09-17T05:21:40.968013+0000","last_clean":"2024-09-17T05:21:40.968013+0000","last_became_active":"2024-09-17T05:21:40.964429+0000","last_became_peered":"2024-09-17T05:21:40.964429+0000","last_unstale":"2024-09-17T05:21:40.968013+0000","last_undegraded":"2024-09-17T05:21:40.968013+0000","last_fullsized":"2024-09-17T05:21:40.968013+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:17:56.840775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957759+0000","last_change":"2024-09-17T05:21:40.957759+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957759+0000","last_undegraded":"2024-09-17T05:21:40.957759+0000","last_fullsized":"2024-09-17T05:21:40.957759+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":15,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.986567+0000","last_change":"2024-09-17T05:21:40.963624+0000","last_active":"2024-09-17T05:21:41.986567+0000","last_peered":"2024-09-17T05:21:41.986567+0000","last_clean":"2024-09-17T05:21:41.986567+0000","last_became_active":"2024-09-17T05:21:40.963377+0000","last_became_peered":"2024-09-17T05:21:40.963377+0000","last_unstale":"2024-09-17T05:21:41.986567+0000","last_undegraded":"2024-09-17T05:21:41.986567+0000","last_fullsized":"2024-09-17T05:21:41.986567+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:01.418973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961057+0000","last_change":"2024-09-17T05:21:40.961057+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961057+0000","last_undegraded":"2024-09-17T05:21:40.961057+0000","last_fullsized":"2024-09-17T05:21:40.961057+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969907+0000","last_change":"2024-09-17T05:21:40.965780+0000","last_active":"2024-09-17T05:21:40.969907+0000","last_peered":"2024-09-17T05:21:40.969907+0000","last_clean":"2024-09-17T05:21:40.969907+0000","last_became_active":"2024-09-17T05:21:40.965506+0000","last_became_peered":"2024-09-17T05:21:40.965506+0000","last_unstale":"2024-09-17T05:21:40.969907+0000","last_undegraded":"2024-09-17T05:21:40.969907+0000","last_fullsized":"2024-09-17T05:21:40.969907+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:23.532444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957830+0000","last_change":"2024-09-17T05:21:40.957830+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957830+0000","last_undegraded":"2024-09-17T05:21:40.957830+0000","last_fullsized":"2024-09-17T05:21:40.957830+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":13,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.957445+0000","last_change":"2024-09-17T05:21:40.967020+0000","last_active":"2024-09-17T05:21:41.957445+0000","last_peered":"2024-09-17T05:21:41.957445+0000","last_clean":"2024-09-17T05:21:41.957445+0000","last_became_active":"2024-09-17T05:21:40.966744+0000","last_became_peered":"2024-09-17T05:21:40.966744+0000","last_unstale":"2024-09-17T05:21:41.957445+0000","last_undegraded":"2024-09-17T05:21:41.957445+0000","last_fullsized":"2024-09-17T05:21:41.957445+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:49.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956537+0000","last_change":"2024-09-17T05:21:40.956537+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956537+0000","last_undegraded":"2024-09-17T05:21:40.956537+0000","last_fullsized":"2024-09-17T05:21:40.956537+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971416+0000","last_change":"2024-09-17T05:21:40.969833+0000","last_active":"2024-09-17T05:21:40.971416+0000","last_peered":"2024-09-17T05:21:40.971416+0000","last_clean":"2024-09-17T05:21:40.971416+0000","last_became_active":"2024-09-17T05:21:40.969550+0000","last_became_peered":"2024-09-17T05:21:40.969550+0000","last_unstale":"2024-09-17T05:21:40.971416+0000","last_undegraded":"2024-09-17T05:21:40.971416+0000","last_fullsized":"2024-09-17T05:21:40.971416+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:13.362775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978954+0000","last_change":"2024-09-17T05:21:41.975403+0000","last_active":"2024-09-17T05:21:41.978954+0000","last_peered":"2024-09-17T05:21:41.978954+0000","last_clean":"2024-09-17T05:21:41.978954+0000","last_became_active":"2024-09-17T05:21:41.975049+0000","last_became_peered":"2024-09-17T05:21:41.975049+0000","last_unstale":"2024-09-17T05:21:41.978954+0000","last_undegraded":"2024-09-17T05:21:41.978954+0000","last_fullsized":"2024-09-17T05:21:41.978954+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:46:06.056960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.962271+0000","last_change":"2024-09-17T05:21:40.958820+0000","last_active":"2024-09-17T05:21:40.962271+0000","last_peered":"2024-09-17T05:21:40.962271+0000","last_clean":"2024-09-17T05:21:40.962271+0000","last_became_active":"2024-09-17T05:21:40.958548+0000","last_became_peered":"2024-09-17T05:21:40.958548+0000","last_unstale":"2024-09-17T05:21:40.962271+0000","last_undegraded":"2024-09-17T05:21:40.962271+0000","last_fullsized":"2024-09-17T05:21:40.962271+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:40.305357+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.976909+0000","last_change":"2024-09-17T05:21:41.968799+0000","last_active":"2024-09-17T05:21:41.976909+0000","last_peered":"2024-09-17T05:21:41.976909+0000","last_clean":"2024-09-17T05:21:41.976909+0000","last_became_active":"2024-09-17T05:21:41.968530+0000","last_became_peered":"2024-09-17T05:21:41.968530+0000","last_unstale":"2024-09-17T05:21:41.976909+0000","last_undegraded":"2024-09-17T05:21:41.976909+0000","last_fullsized":"2024-09-17T05:21:41.976909+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:00.510859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969912+0000","last_change":"2024-09-17T05:21:40.966445+0000","last_active":"2024-09-17T05:21:40.969912+0000","last_peered":"2024-09-17T05:21:40.969912+0000","last_clean":"2024-09-17T05:21:40.969912+0000","last_became_active":"2024-09-17T05:21:40.966200+0000","last_became_peered":"2024-09-17T05:21:40.966200+0000","last_unstale":"2024-09-17T05:21:40.969912+0000","last_undegraded":"2024-09-17T05:21:40.969912+0000","last_fullsized":"2024-09-17T05:21:40.969912+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:06.288136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.956988+0000","last_change":"2024-09-17T05:21:40.956988+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.956988+0000","last_undegraded":"2024-09-17T05:21:40.956988+0000","last_fullsized":"2024-09-17T05:21:40.956988+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968291+0000","last_change":"2024-09-17T05:21:40.966051+0000","last_active":"2024-09-17T05:21:40.968291+0000","last_peered":"2024-09-17T05:21:40.968291+0000","last_clean":"2024-09-17T05:21:40.968291+0000","last_became_active":"2024-09-17T05:21:40.965771+0000","last_became_peered":"2024-09-17T05:21:40.965771+0000","last_unstale":"2024-09-17T05:21:40.968291+0000","last_undegraded":"2024-09-17T05:21:40.968291+0000","last_fullsized":"2024-09-17T05:21:40.968291+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:09:00.183423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957198+0000","last_change":"2024-09-17T05:21:40.957198+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957198+0000","last_undegraded":"2024-09-17T05:21:40.957198+0000","last_fullsized":"2024-09-17T05:21:40.957198+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":14,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.968881+0000","last_change":"2024-09-17T05:21:40.964246+0000","last_active":"2024-09-17T05:21:42.968881+0000","last_peered":"2024-09-17T05:21:42.968881+0000","last_clean":"2024-09-17T05:21:42.968881+0000","last_became_active":"2024-09-17T05:21:40.963976+0000","last_became_peered":"2024-09-17T05:21:40.963976+0000","last_unstale":"2024-09-17T05:21:42.968881+0000","last_undegraded":"2024-09-17T05:21:42.968881+0000","last_fullsized":"2024-09-17T05:21:42.968881+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:33.579472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953710+0000","last_change":"2024-09-17T05:21:40.953710+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953710+0000","last_undegraded":"2024-09-17T05:21:40.953710+0000","last_fullsized":"2024-09-17T05:21:40.953710+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.964214+0000","last_change":"2024-09-17T05:21:40.963049+0000","last_active":"2024-09-17T05:21:40.964214+0000","last_peered":"2024-09-17T05:21:40.964214+0000","last_clean":"2024-09-17T05:21:40.964214+0000","last_became_active":"2024-09-17T05:21:40.962743+0000","last_became_peered":"2024-09-17T05:21:40.962743+0000","last_unstale":"2024-09-17T05:21:40.964214+0000","last_undegraded":"2024-09-17T05:21:40.964214+0000","last_fullsized":"2024-09-17T05:21:40.964214+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:57.944586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":57,"state":"active+clean","last_fresh":"2024-09-17T05:21:41.978212+0000","last_change":"2024-09-17T05:21:41.972775+0000","last_active":"2024-09-17T05:21:41.978212+0000","last_peered":"2024-09-17T05:21:41.978212+0000","last_clean":"2024-09-17T05:21:41.978212+0000","last_became_active":"2024-09-17T05:21:41.972226+0000","last_became_peered":"2024-09-17T05:21:41.972226+0000","last_unstale":"2024-09-17T05:21:41.978212+0000","last_undegraded":"2024-09-17T05:21:41.978212+0000","last_fullsized":"2024-09-17T05:21:41.978212+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:16.840174+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969581+0000","last_change":"2024-09-17T05:21:40.965286+0000","last_active":"2024-09-17T05:21:40.969581+0000","last_peered":"2024-09-17T05:21:40.969581+0000","last_clean":"2024-09-17T05:21:40.969581+0000","last_became_active":"2024-09-17T05:21:40.963994+0000","last_became_peered":"2024-09-17T05:21:40.963994+0000","last_unstale":"2024-09-17T05:21:40.969581+0000","last_undegraded":"2024-09-17T05:21:40.969581+0000","last_fullsized":"2024-09-17T05:21:40.969581+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:58.092810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.963247+0000","last_change":"2024-09-17T05:21:40.963247+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.963247+0000","last_undegraded":"2024-09-17T05:21:40.963247+0000","last_fullsized":"2024-09-17T05:21:40.963247+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.968342+0000","last_change":"2024-09-17T05:21:40.966188+0000","last_active":"2024-09-17T05:21:40.968342+0000","last_peered":"2024-09-17T05:21:40.968342+0000","last_clean":"2024-09-17T05:21:40.968342+0000","last_became_active":"2024-09-17T05:21:40.965925+0000","last_became_peered":"2024-09-17T05:21:40.965925+0000","last_unstale":"2024-09-17T05:21:40.968342+0000","last_undegraded":"2024-09-17T05:21:40.968342+0000","last_fullsized":"2024-09-17T05:21:40.968342+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:30.135801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.957598+0000","last_change":"2024-09-17T05:21:40.957598+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.957598+0000","last_undegraded":"2024-09-17T05:21:40.957598+0000","last_fullsized":"2024-09-17T05:21:40.957598+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.961276+0000","last_change":"2024-09-17T05:21:40.955869+0000","last_active":"2024-09-17T05:21:40.961276+0000","last_peered":"2024-09-17T05:21:40.961276+0000","last_clean":"2024-09-17T05:21:40.961276+0000","last_became_active":"2024-09-17T05:21:40.955539+0000","last_became_peered":"2024-09-17T05:21:40.955539+0000","last_unstale":"2024-09-17T05:21:40.961276+0000","last_undegraded":"2024-09-17T05:21:40.961276+0000","last_fullsized":"2024-09-17T05:21:40.961276+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:44.437748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.953261+0000","last_change":"2024-09-17T05:21:40.953261+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.953261+0000","last_undegraded":"2024-09-17T05:21:40.953261+0000","last_fullsized":"2024-09-17T05:21:40.953261+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.959366+0000","last_change":"2024-09-17T05:21:40.958018+0000","last_active":"2024-09-17T05:21:40.959366+0000","last_peered":"2024-09-17T05:21:40.959366+0000","last_clean":"2024-09-17T05:21:40.959366+0000","last_became_active":"2024-09-17T05:21:40.957745+0000","last_became_peered":"2024-09-17T05:21:40.957745+0000","last_unstale":"2024-09-17T05:21:40.959366+0000","last_undegraded":"2024-09-17T05:21:40.959366+0000","last_fullsized":"2024-09-17T05:21:40.959366+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:00.937883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.959744+0000","last_change":"2024-09-17T05:21:40.959744+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.959744+0000","last_undegraded":"2024-09-17T05:21:40.959744+0000","last_fullsized":"2024-09-17T05:21:40.959744+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.971410+0000","last_change":"2024-09-17T05:21:40.969445+0000","last_active":"2024-09-17T05:21:40.971410+0000","last_peered":"2024-09-17T05:21:40.971410+0000","last_clean":"2024-09-17T05:21:40.971410+0000","last_became_active":"2024-09-17T05:21:40.969235+0000","last_became_peered":"2024-09-17T05:21:40.969235+0000","last_unstale":"2024-09-17T05:21:40.971410+0000","last_undegraded":"2024-09-17T05:21:40.971410+0000","last_fullsized":"2024-09-17T05:21:40.971410+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:05.115216+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":1,"reported_epoch":56,"state":"creating+peering","last_fresh":"2024-09-17T05:21:40.961194+0000","last_change":"2024-09-17T05:21:40.961194+0000","last_active":"2024-09-17T05:21:40.946611+0000","last_peered":"2024-09-17T05:21:40.946611+0000","last_clean":"2024-09-17T05:21:40.946611+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:21:40.961194+0000","last_undegraded":"2024-09-17T05:21:40.961194+0000","last_fullsized":"2024-09-17T05:21:40.961194+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":10,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.969072+0000","last_change":"2024-09-17T05:21:40.965053+0000","last_active":"2024-09-17T05:21:40.969072+0000","last_peered":"2024-09-17T05:21:40.969072+0000","last_clean":"2024-09-17T05:21:40.969072+0000","last_became_active":"2024-09-17T05:21:40.964717+0000","last_became_peered":"2024-09-17T05:21:40.964717+0000","last_unstale":"2024-09-17T05:21:40.969072+0000","last_undegraded":"2024-09-17T05:21:40.969072+0000","last_fullsized":"2024-09-17T05:21:40.969072+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:45:30.434888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":167,"reported_epoch":56,"state":"active+clean","last_fresh":"2024-09-17T05:21:40.960480+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:21:40.960480+0000","last_peered":"2024-09-17T05:21:40.960480+0000","last_clean":"2024-09-17T05:21:40.960480+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:21:40.960480+0000","last_undegraded":"2024-09-17T05:21:40.960480+0000","last_fullsized":"2024-09-17T05:21:40.960480+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":582,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509481,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28260,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343580,"statfs":{"total":96636764160,"available":96607825920,"internally_reserved":0,"allocated":1257472,"data_stored":860262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509481,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509480,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27664,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344176,"statfs":{"total":96636764160,"available":96608436224,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509480,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27680,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344160,"statfs":{"total":96636764160,"available":96608419840,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509480,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27668,"kb_used_data":636,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344172,"statfs":{"total":96636764160,"available":96608432128,"internally_reserved":0,"allocated":651264,"data_stored":263627,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509481,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509480,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27676,"kb_used_data":648,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344164,"statfs":{"total":96636764160,"available":96608423936,"internally_reserved":0,"allocated":663552,"data_stored":269894,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574889,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32444,"kb_used_data":1256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339396,"statfs":{"total":96636764160,"available":96603541504,"internally_reserved":0,"allocated":1286144,"data_stored":869231,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:50.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:21:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 -- 172.21.15.81:0/401310980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 msgr2=0x7fca0015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 --2- 172.21.15.81:0/401310980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca0015fc90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fca000b2330 tx=0x7fc9f802a560 comp rx=0 tx=0).stop 2024-09-17T05:21:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 -- 172.21.15.81:0/401310980 shutdown_connections 2024-09-17T05:21:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 --2- 172.21.15.81:0/401310980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca0015fc90 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 --2- 172.21.15.81:0/401310980 >> v2:172.21.15.160:3300/0 conn(0x7fca000cc490 0x7fca0015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 -- 172.21.15.81:0/401310980 >> 172.21.15.81:0/401310980 conn(0x7fca000b1690 msgr2=0x7fca000b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 -- 172.21.15.81:0/401310980 shutdown_connections 2024-09-17T05:21:50.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.491+0000 7fca05784640 1 -- 172.21.15.81:0/401310980 wait complete. 2024-09-17T05:21:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.492+0000 7fca05784640 1 Processor -- start 2024-09-17T05:21:50.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fca05784640 1 -- start start 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fca05784640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca000cc490 0x7fca000aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fca05784640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca001f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fca05784640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca00159680 0x7fca000ab010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fca05784640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca000cec40 con 0x7fca000cc900 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fca05784640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca000ceac0 con 0x7fca000cc490 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fca05784640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fca000cedc0 con 0x7fca00159680 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fc9fe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca001f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fc9fe7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca001f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47702/0 (socket says 172.21.15.81:47702) 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fc9fe7fc640 1 -- 172.21.15.81:0/638512779 learned_addr learned my addr 172.21.15.81:0/638512779 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:50.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.493+0000 7fc9feffd640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca000cc490 0x7fca000aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9ff7fe640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca00159680 0x7fca000ab010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9fe7fc640 1 -- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca00159680 msgr2=0x7fca000ab010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9fe7fc640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca00159680 0x7fca000ab010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9fe7fc640 1 -- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca000cc490 msgr2=0x7fca000aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9fe7fc640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca000cc490 0x7fca000aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9fe7fc640 1 -- 172.21.15.81:0/638512779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca001f2a70 con 0x7fca000cc900 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9ff7fe640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca00159680 0x7fca000ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9fe7fc640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca001f34e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400e9f0 tx=0x7fc9f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9e77fe640 1 -- 172.21.15.81:0/638512779 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f400cd80 con 0x7fca000cc900 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9e77fe640 1 -- 172.21.15.81:0/638512779 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc9f4010430 con 0x7fca000cc900 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca000ab780 con 0x7fca000cc900 2024-09-17T05:21:50.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fc9e77fe640 1 -- 172.21.15.81:0/638512779 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9f4010840 con 0x7fca000cc900 2024-09-17T05:21:50.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.494+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca001f2fc0 con 0x7fca000cc900 2024-09-17T05:21:50.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.495+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca000cf270 con 0x7fca000cc900 2024-09-17T05:21:50.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.496+0000 7fc9e77fe640 1 -- 172.21.15.81:0/638512779 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fc9f40109e0 con 0x7fca000cc900 2024-09-17T05:21:50.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.496+0000 7fc9e77fe640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc9ec078d40 0x7fc9ec07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.497+0000 7fc9e77fe640 1 -- 172.21.15.81:0/638512779 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fc9f409bc70 con 0x7fca000cc900 2024-09-17T05:21:50.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.497+0000 7fc9feffd640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc9ec078d40 0x7fc9ec07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.497+0000 7fc9feffd640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc9ec078d40 0x7fc9ec07b200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fca000cc010 tx=0x7fc9f00019f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:50.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.501+0000 7fc9e77fe640 1 -- 172.21.15.81:0/638512779 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc9f40637a0 con 0x7fca000cc900 2024-09-17T05:21:50.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.675+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca00157ee0 con 0x7fc9ec078d40 2024-09-17T05:21:50.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.680+0000 7fc9e77fe640 1 -- 172.21.15.81:0/638512779 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+251931 (secure 0 0 0) 0x7fca00157ee0 con 0x7fc9ec078d40 2024-09-17T05:21:50.683 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:50.684 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:21:50.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc9ec078d40 msgr2=0x7fc9ec07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc9ec078d40 0x7fc9ec07b200 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fca000cc010 tx=0x7fc9f00019f0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 msgr2=0x7fca001f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca001f34e0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fc9f400e9f0 tx=0x7fc9f400eeb0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 shutdown_connections 2024-09-17T05:21:50.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fc9ec078d40 0x7fc9ec07b200 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca00159680 0x7fca000ab010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca000cc900 0x7fca001f34e0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 --2- 172.21.15.81:0/638512779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca000cc490 0x7fca000aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.682+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 >> 172.21.15.81:0/638512779 conn(0x7fca000b1690 msgr2=0x7fca0015e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:50.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.683+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 shutdown_connections 2024-09-17T05:21:50.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.683+0000 7fca05784640 1 -- 172.21.15.81:0/638512779 wait complete. 2024-09-17T05:21:50.694 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-17T05:21:49.418537+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":179,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":227004,"kb_used_data":6600,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754747716,"statfs":{"total":773094113280,"available":772861661184,"internally_reserved":0,"allocated":6758400,"data_stored":3449308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":225496624},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":28,"apply_latency_ms":28,"commit_latency_ns":28000000,"apply_latency_ns":28000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002242"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970374+0000","last_change":"2024-09-17T05:21:41.968469+0000","last_active":"2024-09-17T05:21:42.970374+0000","last_peered":"2024-09-17T05:21:42.970374+0000","last_clean":"2024-09-17T05:21:42.970374+0000","last_became_active":"2024-09-17T05:21:41.968223+0000","last_became_peered":"2024-09-17T05:21:41.968223+0000","last_unstale":"2024-09-17T05:21:42.970374+0000","last_undegraded":"2024-09-17T05:21:42.970374+0000","last_fullsized":"2024-09-17T05:21:42.970374+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:12:43.344099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811812+0000","last_change":"2024-09-17T05:21:41.977614+0000","last_active":"2024-09-17T05:21:44.811812+0000","last_peered":"2024-09-17T05:21:44.811812+0000","last_clean":"2024-09-17T05:21:44.811812+0000","last_became_active":"2024-09-17T05:21:41.977367+0000","last_became_peered":"2024-09-17T05:21:41.977367+0000","last_unstale":"2024-09-17T05:21:44.811812+0000","last_undegraded":"2024-09-17T05:21:44.811812+0000","last_fullsized":"2024-09-17T05:21:44.811812+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:34:24.694648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812739+0000","last_change":"2024-09-17T05:21:41.979325+0000","last_active":"2024-09-17T05:21:44.812739+0000","last_peered":"2024-09-17T05:21:44.812739+0000","last_clean":"2024-09-17T05:21:44.812739+0000","last_became_active":"2024-09-17T05:21:41.978879+0000","last_became_peered":"2024-09-17T05:21:41.978879+0000","last_unstale":"2024-09-17T05:21:44.812739+0000","last_undegraded":"2024-09-17T05:21:44.812739+0000","last_fullsized":"2024-09-17T05:21:44.812739+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:14:58.338403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812996+0000","last_change":"2024-09-17T05:21:41.971710+0000","last_active":"2024-09-17T05:21:44.812996+0000","last_peered":"2024-09-17T05:21:44.812996+0000","last_clean":"2024-09-17T05:21:44.812996+0000","last_became_active":"2024-09-17T05:21:41.971277+0000","last_became_peered":"2024-09-17T05:21:41.971277+0000","last_unstale":"2024-09-17T05:21:44.812996+0000","last_undegraded":"2024-09-17T05:21:44.812996+0000","last_fullsized":"2024-09-17T05:21:44.812996+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:49.816817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970209+0000","last_change":"2024-09-17T05:21:41.971709+0000","last_active":"2024-09-17T05:21:42.970209+0000","last_peered":"2024-09-17T05:21:42.970209+0000","last_clean":"2024-09-17T05:21:42.970209+0000","last_became_active":"2024-09-17T05:21:41.971466+0000","last_became_peered":"2024-09-17T05:21:41.971466+0000","last_unstale":"2024-09-17T05:21:42.970209+0000","last_undegraded":"2024-09-17T05:21:42.970209+0000","last_fullsized":"2024-09-17T05:21:42.970209+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:30.053532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719058+0000","last_change":"2024-09-17T05:21:41.966263+0000","last_active":"2024-09-17T05:21:43.719058+0000","last_peered":"2024-09-17T05:21:43.719058+0000","last_clean":"2024-09-17T05:21:43.719058+0000","last_became_active":"2024-09-17T05:21:41.965998+0000","last_became_peered":"2024-09-17T05:21:41.965998+0000","last_unstale":"2024-09-17T05:21:43.719058+0000","last_undegraded":"2024-09-17T05:21:43.719058+0000","last_fullsized":"2024-09-17T05:21:43.719058+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:58:20.014523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969307+0000","last_change":"2024-09-17T05:21:41.972478+0000","last_active":"2024-09-17T05:21:42.969307+0000","last_peered":"2024-09-17T05:21:42.969307+0000","last_clean":"2024-09-17T05:21:42.969307+0000","last_became_active":"2024-09-17T05:21:41.971920+0000","last_became_peered":"2024-09-17T05:21:41.971920+0000","last_unstale":"2024-09-17T05:21:42.969307+0000","last_undegraded":"2024-09-17T05:21:42.969307+0000","last_fullsized":"2024-09-17T05:21:42.969307+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:06.387315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811476+0000","last_change":"2024-09-17T05:21:41.969953+0000","last_active":"2024-09-17T05:21:44.811476+0000","last_peered":"2024-09-17T05:21:44.811476+0000","last_clean":"2024-09-17T05:21:44.811476+0000","last_became_active":"2024-09-17T05:21:41.968797+0000","last_became_peered":"2024-09-17T05:21:41.968797+0000","last_unstale":"2024-09-17T05:21:44.811476+0000","last_undegraded":"2024-09-17T05:21:44.811476+0000","last_fullsized":"2024-09-17T05:21:44.811476+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:57.129054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970035+0000","last_change":"2024-09-17T05:21:41.965765+0000","last_active":"2024-09-17T05:21:42.970035+0000","last_peered":"2024-09-17T05:21:42.970035+0000","last_clean":"2024-09-17T05:21:42.970035+0000","last_became_active":"2024-09-17T05:21:41.965464+0000","last_became_peered":"2024-09-17T05:21:41.965464+0000","last_unstale":"2024-09-17T05:21:42.970035+0000","last_undegraded":"2024-09-17T05:21:42.970035+0000","last_fullsized":"2024-09-17T05:21:42.970035+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:23:27.771460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711455+0000","last_change":"2024-09-17T05:21:41.964081+0000","last_active":"2024-09-17T05:21:43.711455+0000","last_peered":"2024-09-17T05:21:43.711455+0000","last_clean":"2024-09-17T05:21:43.711455+0000","last_became_active":"2024-09-17T05:21:41.963834+0000","last_became_peered":"2024-09-17T05:21:41.963834+0000","last_unstale":"2024-09-17T05:21:43.711455+0000","last_undegraded":"2024-09-17T05:21:43.711455+0000","last_fullsized":"2024-09-17T05:21:43.711455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:47:56.552547+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711475+0000","last_change":"2024-09-17T05:21:41.963287+0000","last_active":"2024-09-17T05:21:43.711475+0000","last_peered":"2024-09-17T05:21:43.711475+0000","last_clean":"2024-09-17T05:21:43.711475+0000","last_became_active":"2024-09-17T05:21:41.963027+0000","last_became_peered":"2024-09-17T05:21:41.963027+0000","last_unstale":"2024-09-17T05:21:43.711475+0000","last_undegraded":"2024-09-17T05:21:43.711475+0000","last_fullsized":"2024-09-17T05:21:43.711475+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:17.098946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.813032+0000","last_change":"2024-09-17T05:21:41.971869+0000","last_active":"2024-09-17T05:21:44.813032+0000","last_peered":"2024-09-17T05:21:44.813032+0000","last_clean":"2024-09-17T05:21:44.813032+0000","last_became_active":"2024-09-17T05:21:41.971590+0000","last_became_peered":"2024-09-17T05:21:41.971590+0000","last_unstale":"2024-09-17T05:21:44.813032+0000","last_undegraded":"2024-09-17T05:21:44.813032+0000","last_fullsized":"2024-09-17T05:21:44.813032+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:41.977756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969980+0000","last_change":"2024-09-17T05:21:41.965692+0000","last_active":"2024-09-17T05:21:42.969980+0000","last_peered":"2024-09-17T05:21:42.969980+0000","last_clean":"2024-09-17T05:21:42.969980+0000","last_became_active":"2024-09-17T05:21:41.965399+0000","last_became_peered":"2024-09-17T05:21:41.965399+0000","last_unstale":"2024-09-17T05:21:42.969980+0000","last_undegraded":"2024-09-17T05:21:42.969980+0000","last_fullsized":"2024-09-17T05:21:42.969980+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:55.202015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969257+0000","last_change":"2024-09-17T05:21:41.963225+0000","last_active":"2024-09-17T05:21:42.969257+0000","last_peered":"2024-09-17T05:21:42.969257+0000","last_clean":"2024-09-17T05:21:42.969257+0000","last_became_active":"2024-09-17T05:21:41.962906+0000","last_became_peered":"2024-09-17T05:21:41.962906+0000","last_unstale":"2024-09-17T05:21:42.969257+0000","last_undegraded":"2024-09-17T05:21:42.969257+0000","last_fullsized":"2024-09-17T05:21:42.969257+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:29.016763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969597+0000","last_change":"2024-09-17T05:21:41.972839+0000","last_active":"2024-09-17T05:21:42.969597+0000","last_peered":"2024-09-17T05:21:42.969597+0000","last_clean":"2024-09-17T05:21:42.969597+0000","last_became_active":"2024-09-17T05:21:41.972262+0000","last_became_peered":"2024-09-17T05:21:41.972262+0000","last_unstale":"2024-09-17T05:21:42.969597+0000","last_undegraded":"2024-09-17T05:21:42.969597+0000","last_fullsized":"2024-09-17T05:21:42.969597+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:06:23.196186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.718960+0000","last_change":"2024-09-17T05:21:41.973282+0000","last_active":"2024-09-17T05:21:43.718960+0000","last_peered":"2024-09-17T05:21:43.718960+0000","last_clean":"2024-09-17T05:21:43.718960+0000","last_became_active":"2024-09-17T05:21:41.972899+0000","last_became_peered":"2024-09-17T05:21:41.972899+0000","last_unstale":"2024-09-17T05:21:43.718960+0000","last_undegraded":"2024-09-17T05:21:43.718960+0000","last_fullsized":"2024-09-17T05:21:43.718960+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:22.805923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812181+0000","last_change":"2024-09-17T05:21:41.968554+0000","last_active":"2024-09-17T05:21:44.812181+0000","last_peered":"2024-09-17T05:21:44.812181+0000","last_clean":"2024-09-17T05:21:44.812181+0000","last_became_active":"2024-09-17T05:21:41.968278+0000","last_became_peered":"2024-09-17T05:21:41.968278+0000","last_unstale":"2024-09-17T05:21:44.812181+0000","last_undegraded":"2024-09-17T05:21:44.812181+0000","last_fullsized":"2024-09-17T05:21:44.812181+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:34.801312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812415+0000","last_change":"2024-09-17T05:21:41.980492+0000","last_active":"2024-09-17T05:21:44.812415+0000","last_peered":"2024-09-17T05:21:44.812415+0000","last_clean":"2024-09-17T05:21:44.812415+0000","last_became_active":"2024-09-17T05:21:41.980194+0000","last_became_peered":"2024-09-17T05:21:41.980194+0000","last_unstale":"2024-09-17T05:21:44.812415+0000","last_undegraded":"2024-09-17T05:21:44.812415+0000","last_fullsized":"2024-09-17T05:21:44.812415+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.328704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970240+0000","last_change":"2024-09-17T05:21:41.969687+0000","last_active":"2024-09-17T05:21:42.970240+0000","last_peered":"2024-09-17T05:21:42.970240+0000","last_clean":"2024-09-17T05:21:42.970240+0000","last_became_active":"2024-09-17T05:21:41.969317+0000","last_became_peered":"2024-09-17T05:21:41.969317+0000","last_unstale":"2024-09-17T05:21:42.970240+0000","last_undegraded":"2024-09-17T05:21:42.970240+0000","last_fullsized":"2024-09-17T05:21:42.970240+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:39.666400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811784+0000","last_change":"2024-09-17T05:21:41.968079+0000","last_active":"2024-09-17T05:21:44.811784+0000","last_peered":"2024-09-17T05:21:44.811784+0000","last_clean":"2024-09-17T05:21:44.811784+0000","last_became_active":"2024-09-17T05:21:41.967756+0000","last_became_peered":"2024-09-17T05:21:41.967756+0000","last_unstale":"2024-09-17T05:21:44.811784+0000","last_undegraded":"2024-09-17T05:21:44.811784+0000","last_fullsized":"2024-09-17T05:21:44.811784+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:47.561009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812455+0000","last_change":"2024-09-17T05:21:41.972461+0000","last_active":"2024-09-17T05:21:44.812455+0000","last_peered":"2024-09-17T05:21:44.812455+0000","last_clean":"2024-09-17T05:21:44.812455+0000","last_became_active":"2024-09-17T05:21:41.972195+0000","last_became_peered":"2024-09-17T05:21:41.972195+0000","last_unstale":"2024-09-17T05:21:44.812455+0000","last_undegraded":"2024-09-17T05:21:44.812455+0000","last_fullsized":"2024-09-17T05:21:44.812455+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:31.748829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811657+0000","last_change":"2024-09-17T05:21:41.969754+0000","last_active":"2024-09-17T05:21:44.811657+0000","last_peered":"2024-09-17T05:21:44.811657+0000","last_clean":"2024-09-17T05:21:44.811657+0000","last_became_active":"2024-09-17T05:21:41.968741+0000","last_became_peered":"2024-09-17T05:21:41.968741+0000","last_unstale":"2024-09-17T05:21:44.811657+0000","last_undegraded":"2024-09-17T05:21:44.811657+0000","last_fullsized":"2024-09-17T05:21:44.811657+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:58.160198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812115+0000","last_change":"2024-09-17T05:21:41.978613+0000","last_active":"2024-09-17T05:21:44.812115+0000","last_peered":"2024-09-17T05:21:44.812115+0000","last_clean":"2024-09-17T05:21:44.812115+0000","last_became_active":"2024-09-17T05:21:41.978269+0000","last_became_peered":"2024-09-17T05:21:41.978269+0000","last_unstale":"2024-09-17T05:21:44.812115+0000","last_undegraded":"2024-09-17T05:21:44.812115+0000","last_fullsized":"2024-09-17T05:21:44.812115+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:33.778001+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969295+0000","last_change":"2024-09-17T05:21:41.966535+0000","last_active":"2024-09-17T05:21:42.969295+0000","last_peered":"2024-09-17T05:21:42.969295+0000","last_clean":"2024-09-17T05:21:42.969295+0000","last_became_active":"2024-09-17T05:21:41.966261+0000","last_became_peered":"2024-09-17T05:21:41.966261+0000","last_unstale":"2024-09-17T05:21:42.969295+0000","last_undegraded":"2024-09-17T05:21:42.969295+0000","last_fullsized":"2024-09-17T05:21:42.969295+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:18:43.829817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970506+0000","last_change":"2024-09-17T05:21:41.962731+0000","last_active":"2024-09-17T05:21:42.970506+0000","last_peered":"2024-09-17T05:21:42.970506+0000","last_clean":"2024-09-17T05:21:42.970506+0000","last_became_active":"2024-09-17T05:21:41.962472+0000","last_became_peered":"2024-09-17T05:21:41.962472+0000","last_unstale":"2024-09-17T05:21:42.970506+0000","last_undegraded":"2024-09-17T05:21:42.970506+0000","last_fullsized":"2024-09-17T05:21:42.970506+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:44.534081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812701+0000","last_change":"2024-09-17T05:21:41.964858+0000","last_active":"2024-09-17T05:21:44.812701+0000","last_peered":"2024-09-17T05:21:44.812701+0000","last_clean":"2024-09-17T05:21:44.812701+0000","last_became_active":"2024-09-17T05:21:41.963882+0000","last_became_peered":"2024-09-17T05:21:41.963882+0000","last_unstale":"2024-09-17T05:21:44.812701+0000","last_undegraded":"2024-09-17T05:21:44.812701+0000","last_fullsized":"2024-09-17T05:21:44.812701+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:30.328704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719583+0000","last_change":"2024-09-17T05:21:41.971075+0000","last_active":"2024-09-17T05:21:43.719583+0000","last_peered":"2024-09-17T05:21:43.719583+0000","last_clean":"2024-09-17T05:21:43.719583+0000","last_became_active":"2024-09-17T05:21:41.969951+0000","last_became_peered":"2024-09-17T05:21:41.969951+0000","last_unstale":"2024-09-17T05:21:43.719583+0000","last_undegraded":"2024-09-17T05:21:43.719583+0000","last_fullsized":"2024-09-17T05:21:43.719583+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:10:27.299420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970270+0000","last_change":"2024-09-17T05:21:41.972566+0000","last_active":"2024-09-17T05:21:42.970270+0000","last_peered":"2024-09-17T05:21:42.970270+0000","last_clean":"2024-09-17T05:21:42.970270+0000","last_became_active":"2024-09-17T05:21:41.972332+0000","last_became_peered":"2024-09-17T05:21:41.972332+0000","last_unstale":"2024-09-17T05:21:42.970270+0000","last_undegraded":"2024-09-17T05:21:42.970270+0000","last_fullsized":"2024-09-17T05:21:42.970270+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:58.140308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812306+0000","last_change":"2024-09-17T05:21:41.973880+0000","last_active":"2024-09-17T05:21:44.812306+0000","last_peered":"2024-09-17T05:21:44.812306+0000","last_clean":"2024-09-17T05:21:44.812306+0000","last_became_active":"2024-09-17T05:21:41.973623+0000","last_became_peered":"2024-09-17T05:21:41.973623+0000","last_unstale":"2024-09-17T05:21:44.812306+0000","last_undegraded":"2024-09-17T05:21:44.812306+0000","last_fullsized":"2024-09-17T05:21:44.812306+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:52:55.213302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812187+0000","last_change":"2024-09-17T05:21:41.977142+0000","last_active":"2024-09-17T05:21:44.812187+0000","last_peered":"2024-09-17T05:21:44.812187+0000","last_clean":"2024-09-17T05:21:44.812187+0000","last_became_active":"2024-09-17T05:21:41.976882+0000","last_became_peered":"2024-09-17T05:21:41.976882+0000","last_unstale":"2024-09-17T05:21:44.812187+0000","last_undegraded":"2024-09-17T05:21:44.812187+0000","last_fullsized":"2024-09-17T05:21:44.812187+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:31.477275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970124+0000","last_change":"2024-09-17T05:21:41.957719+0000","last_active":"2024-09-17T05:21:42.970124+0000","last_peered":"2024-09-17T05:21:42.970124+0000","last_clean":"2024-09-17T05:21:42.970124+0000","last_became_active":"2024-09-17T05:21:41.957474+0000","last_became_peered":"2024-09-17T05:21:41.957474+0000","last_unstale":"2024-09-17T05:21:42.970124+0000","last_undegraded":"2024-09-17T05:21:42.970124+0000","last_fullsized":"2024-09-17T05:21:42.970124+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:22:12.460078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719061+0000","last_change":"2024-09-17T05:21:41.971005+0000","last_active":"2024-09-17T05:21:43.719061+0000","last_peered":"2024-09-17T05:21:43.719061+0000","last_clean":"2024-09-17T05:21:43.719061+0000","last_became_active":"2024-09-17T05:21:41.970391+0000","last_became_peered":"2024-09-17T05:21:41.970391+0000","last_unstale":"2024-09-17T05:21:43.719061+0000","last_undegraded":"2024-09-17T05:21:43.719061+0000","last_fullsized":"2024-09-17T05:21:43.719061+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:35.579950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719670+0000","last_change":"2024-09-17T05:21:41.968746+0000","last_active":"2024-09-17T05:21:43.719670+0000","last_peered":"2024-09-17T05:21:43.719670+0000","last_clean":"2024-09-17T05:21:43.719670+0000","last_became_active":"2024-09-17T05:21:41.968484+0000","last_became_peered":"2024-09-17T05:21:41.968484+0000","last_unstale":"2024-09-17T05:21:43.719670+0000","last_undegraded":"2024-09-17T05:21:43.719670+0000","last_fullsized":"2024-09-17T05:21:43.719670+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:12.895881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"57'4","reported_seq":19,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719699+0000","last_change":"2024-09-17T05:21:40.968346+0000","last_active":"2024-09-17T05:21:43.719699+0000","last_peered":"2024-09-17T05:21:43.719699+0000","last_clean":"2024-09-17T05:21:43.719699+0000","last_became_active":"2024-09-17T05:21:40.968049+0000","last_became_peered":"2024-09-17T05:21:40.968049+0000","last_unstale":"2024-09-17T05:21:43.719699+0000","last_undegraded":"2024-09-17T05:21:43.719699+0000","last_fullsized":"2024-09-17T05:21:43.719699+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:51:01.544228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711714+0000","last_change":"2024-09-17T05:21:41.969262+0000","last_active":"2024-09-17T05:21:43.711714+0000","last_peered":"2024-09-17T05:21:43.711714+0000","last_clean":"2024-09-17T05:21:43.711714+0000","last_became_active":"2024-09-17T05:21:41.968991+0000","last_became_peered":"2024-09-17T05:21:41.968991+0000","last_unstale":"2024-09-17T05:21:43.711714+0000","last_undegraded":"2024-09-17T05:21:43.711714+0000","last_fullsized":"2024-09-17T05:21:43.711714+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:02:33.543254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811979+0000","last_change":"2024-09-17T05:21:40.967671+0000","last_active":"2024-09-17T05:21:44.811979+0000","last_peered":"2024-09-17T05:21:44.811979+0000","last_clean":"2024-09-17T05:21:44.811979+0000","last_became_active":"2024-09-17T05:21:40.967346+0000","last_became_peered":"2024-09-17T05:21:40.967346+0000","last_unstale":"2024-09-17T05:21:44.811979+0000","last_undegraded":"2024-09-17T05:21:44.811979+0000","last_fullsized":"2024-09-17T05:21:44.811979+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:50:29.324613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719321+0000","last_change":"2024-09-17T05:21:41.969430+0000","last_active":"2024-09-17T05:21:43.719321+0000","last_peered":"2024-09-17T05:21:43.719321+0000","last_clean":"2024-09-17T05:21:43.719321+0000","last_became_active":"2024-09-17T05:21:41.969185+0000","last_became_peered":"2024-09-17T05:21:41.969185+0000","last_unstale":"2024-09-17T05:21:43.719321+0000","last_undegraded":"2024-09-17T05:21:43.719321+0000","last_fullsized":"2024-09-17T05:21:43.719321+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:51.097416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719789+0000","last_change":"2024-09-17T05:21:40.955534+0000","last_active":"2024-09-17T05:21:43.719789+0000","last_peered":"2024-09-17T05:21:43.719789+0000","last_clean":"2024-09-17T05:21:43.719789+0000","last_became_active":"2024-09-17T05:21:40.955159+0000","last_became_peered":"2024-09-17T05:21:40.955159+0000","last_unstale":"2024-09-17T05:21:43.719789+0000","last_undegraded":"2024-09-17T05:21:43.719789+0000","last_fullsized":"2024-09-17T05:21:43.719789+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:02:48.548506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719580+0000","last_change":"2024-09-17T05:21:41.973041+0000","last_active":"2024-09-17T05:21:43.719580+0000","last_peered":"2024-09-17T05:21:43.719580+0000","last_clean":"2024-09-17T05:21:43.719580+0000","last_became_active":"2024-09-17T05:21:41.972532+0000","last_became_peered":"2024-09-17T05:21:41.972532+0000","last_unstale":"2024-09-17T05:21:43.719580+0000","last_undegraded":"2024-09-17T05:21:43.719580+0000","last_fullsized":"2024-09-17T05:21:43.719580+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:05.122639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.813162+0000","last_change":"2024-09-17T05:21:40.965725+0000","last_active":"2024-09-17T05:21:44.813162+0000","last_peered":"2024-09-17T05:21:44.813162+0000","last_clean":"2024-09-17T05:21:44.813162+0000","last_became_active":"2024-09-17T05:21:40.965447+0000","last_became_peered":"2024-09-17T05:21:40.965447+0000","last_unstale":"2024-09-17T05:21:44.813162+0000","last_undegraded":"2024-09-17T05:21:44.813162+0000","last_fullsized":"2024-09-17T05:21:44.813162+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:04.582149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811609+0000","last_change":"2024-09-17T05:21:41.969037+0000","last_active":"2024-09-17T05:21:44.811609+0000","last_peered":"2024-09-17T05:21:44.811609+0000","last_clean":"2024-09-17T05:21:44.811609+0000","last_became_active":"2024-09-17T05:21:41.968460+0000","last_became_peered":"2024-09-17T05:21:41.968460+0000","last_unstale":"2024-09-17T05:21:44.811609+0000","last_undegraded":"2024-09-17T05:21:44.811609+0000","last_fullsized":"2024-09-17T05:21:44.811609+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:10.709479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969562+0000","last_change":"2024-09-17T05:21:40.963116+0000","last_active":"2024-09-17T05:21:42.969562+0000","last_peered":"2024-09-17T05:21:42.969562+0000","last_clean":"2024-09-17T05:21:42.969562+0000","last_became_active":"2024-09-17T05:21:40.961833+0000","last_became_peered":"2024-09-17T05:21:40.961833+0000","last_unstale":"2024-09-17T05:21:42.969562+0000","last_undegraded":"2024-09-17T05:21:42.969562+0000","last_fullsized":"2024-09-17T05:21:42.969562+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:03.291522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811948+0000","last_change":"2024-09-17T05:21:41.970541+0000","last_active":"2024-09-17T05:21:44.811948+0000","last_peered":"2024-09-17T05:21:44.811948+0000","last_clean":"2024-09-17T05:21:44.811948+0000","last_became_active":"2024-09-17T05:21:41.970278+0000","last_became_peered":"2024-09-17T05:21:41.970278+0000","last_unstale":"2024-09-17T05:21:44.811948+0000","last_undegraded":"2024-09-17T05:21:44.811948+0000","last_fullsized":"2024-09-17T05:21:44.811948+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:24:32.937307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719130+0000","last_change":"2024-09-17T05:21:40.963990+0000","last_active":"2024-09-17T05:21:43.719130+0000","last_peered":"2024-09-17T05:21:43.719130+0000","last_clean":"2024-09-17T05:21:43.719130+0000","last_became_active":"2024-09-17T05:21:40.963731+0000","last_became_peered":"2024-09-17T05:21:40.963731+0000","last_unstale":"2024-09-17T05:21:43.719130+0000","last_undegraded":"2024-09-17T05:21:43.719130+0000","last_fullsized":"2024-09-17T05:21:43.719130+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:56.691484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969391+0000","last_change":"2024-09-17T05:21:41.969007+0000","last_active":"2024-09-17T05:21:42.969391+0000","last_peered":"2024-09-17T05:21:42.969391+0000","last_clean":"2024-09-17T05:21:42.969391+0000","last_became_active":"2024-09-17T05:21:41.968705+0000","last_became_peered":"2024-09-17T05:21:41.968705+0000","last_unstale":"2024-09-17T05:21:42.969391+0000","last_undegraded":"2024-09-17T05:21:42.969391+0000","last_fullsized":"2024-09-17T05:21:42.969391+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:14.573177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812041+0000","last_change":"2024-09-17T05:21:40.969945+0000","last_active":"2024-09-17T05:21:44.812041+0000","last_peered":"2024-09-17T05:21:44.812041+0000","last_clean":"2024-09-17T05:21:44.812041+0000","last_became_active":"2024-09-17T05:21:40.969578+0000","last_became_peered":"2024-09-17T05:21:40.969578+0000","last_unstale":"2024-09-17T05:21:44.812041+0000","last_undegraded":"2024-09-17T05:21:44.812041+0000","last_fullsized":"2024-09-17T05:21:44.812041+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:03.215671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811662+0000","last_change":"2024-09-17T05:21:41.970250+0000","last_active":"2024-09-17T05:21:44.811662+0000","last_peered":"2024-09-17T05:21:44.811662+0000","last_clean":"2024-09-17T05:21:44.811662+0000","last_became_active":"2024-09-17T05:21:41.970010+0000","last_became_peered":"2024-09-17T05:21:41.970010+0000","last_unstale":"2024-09-17T05:21:44.811662+0000","last_undegraded":"2024-09-17T05:21:44.811662+0000","last_fullsized":"2024-09-17T05:21:44.811662+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:44:34.276334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969412+0000","last_change":"2024-09-17T05:21:40.964753+0000","last_active":"2024-09-17T05:21:42.969412+0000","last_peered":"2024-09-17T05:21:42.969412+0000","last_clean":"2024-09-17T05:21:42.969412+0000","last_became_active":"2024-09-17T05:21:40.964467+0000","last_became_peered":"2024-09-17T05:21:40.964467+0000","last_unstale":"2024-09-17T05:21:42.969412+0000","last_undegraded":"2024-09-17T05:21:42.969412+0000","last_fullsized":"2024-09-17T05:21:42.969412+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:19:55.185639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970160+0000","last_change":"2024-09-17T05:21:41.968943+0000","last_active":"2024-09-17T05:21:42.970160+0000","last_peered":"2024-09-17T05:21:42.970160+0000","last_clean":"2024-09-17T05:21:42.970160+0000","last_became_active":"2024-09-17T05:21:41.968245+0000","last_became_peered":"2024-09-17T05:21:41.968245+0000","last_unstale":"2024-09-17T05:21:42.970160+0000","last_undegraded":"2024-09-17T05:21:42.970160+0000","last_fullsized":"2024-09-17T05:21:42.970160+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:42:27.161672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812496+0000","last_change":"2024-09-17T05:21:40.966548+0000","last_active":"2024-09-17T05:21:44.812496+0000","last_peered":"2024-09-17T05:21:44.812496+0000","last_clean":"2024-09-17T05:21:44.812496+0000","last_became_active":"2024-09-17T05:21:40.966011+0000","last_became_peered":"2024-09-17T05:21:40.966011+0000","last_unstale":"2024-09-17T05:21:44.812496+0000","last_undegraded":"2024-09-17T05:21:44.812496+0000","last_fullsized":"2024-09-17T05:21:44.812496+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:54.648312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812359+0000","last_change":"2024-09-17T05:21:41.978458+0000","last_active":"2024-09-17T05:21:44.812359+0000","last_peered":"2024-09-17T05:21:44.812359+0000","last_clean":"2024-09-17T05:21:44.812359+0000","last_became_active":"2024-09-17T05:21:41.978123+0000","last_became_peered":"2024-09-17T05:21:41.978123+0000","last_unstale":"2024-09-17T05:21:44.812359+0000","last_undegraded":"2024-09-17T05:21:44.812359+0000","last_fullsized":"2024-09-17T05:21:44.812359+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:54.750425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812091+0000","last_change":"2024-09-17T05:21:40.964038+0000","last_active":"2024-09-17T05:21:44.812091+0000","last_peered":"2024-09-17T05:21:44.812091+0000","last_clean":"2024-09-17T05:21:44.812091+0000","last_became_active":"2024-09-17T05:21:40.963792+0000","last_became_peered":"2024-09-17T05:21:40.963792+0000","last_unstale":"2024-09-17T05:21:44.812091+0000","last_undegraded":"2024-09-17T05:21:44.812091+0000","last_fullsized":"2024-09-17T05:21:44.812091+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:30.744738+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711247+0000","last_change":"2024-09-17T05:21:41.965105+0000","last_active":"2024-09-17T05:21:43.711247+0000","last_peered":"2024-09-17T05:21:43.711247+0000","last_clean":"2024-09-17T05:21:43.711247+0000","last_became_active":"2024-09-17T05:21:41.964018+0000","last_became_peered":"2024-09-17T05:21:41.964018+0000","last_unstale":"2024-09-17T05:21:43.711247+0000","last_undegraded":"2024-09-17T05:21:43.711247+0000","last_fullsized":"2024-09-17T05:21:43.711247+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:59.096901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"57'3","reported_seq":18,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812990+0000","last_change":"2024-09-17T05:21:40.968246+0000","last_active":"2024-09-17T05:21:44.812990+0000","last_peered":"2024-09-17T05:21:44.812990+0000","last_clean":"2024-09-17T05:21:44.812990+0000","last_became_active":"2024-09-17T05:21:40.968012+0000","last_became_peered":"2024-09-17T05:21:40.968012+0000","last_unstale":"2024-09-17T05:21:44.812990+0000","last_undegraded":"2024-09-17T05:21:44.812990+0000","last_fullsized":"2024-09-17T05:21:44.812990+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:59.353676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812791+0000","last_change":"2024-09-17T05:21:41.978522+0000","last_active":"2024-09-17T05:21:44.812791+0000","last_peered":"2024-09-17T05:21:44.812791+0000","last_clean":"2024-09-17T05:21:44.812791+0000","last_became_active":"2024-09-17T05:21:41.975526+0000","last_became_peered":"2024-09-17T05:21:41.975526+0000","last_unstale":"2024-09-17T05:21:44.812791+0000","last_undegraded":"2024-09-17T05:21:44.812791+0000","last_fullsized":"2024-09-17T05:21:44.812791+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:29:24.697794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"57'6","reported_seq":21,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970020+0000","last_change":"2024-09-17T05:21:40.960153+0000","last_active":"2024-09-17T05:21:42.970020+0000","last_peered":"2024-09-17T05:21:42.970020+0000","last_clean":"2024-09-17T05:21:42.970020+0000","last_became_active":"2024-09-17T05:21:40.959884+0000","last_became_peered":"2024-09-17T05:21:40.959884+0000","last_unstale":"2024-09-17T05:21:42.970020+0000","last_undegraded":"2024-09-17T05:21:42.970020+0000","last_fullsized":"2024-09-17T05:21:42.970020+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:08:16.094855+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812348+0000","last_change":"2024-09-17T05:21:41.973957+0000","last_active":"2024-09-17T05:21:44.812348+0000","last_peered":"2024-09-17T05:21:44.812348+0000","last_clean":"2024-09-17T05:21:44.812348+0000","last_became_active":"2024-09-17T05:21:41.973628+0000","last_became_peered":"2024-09-17T05:21:41.973628+0000","last_unstale":"2024-09-17T05:21:44.812348+0000","last_undegraded":"2024-09-17T05:21:44.812348+0000","last_fullsized":"2024-09-17T05:21:44.812348+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:14.366866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812101+0000","last_change":"2024-09-17T05:21:40.966702+0000","last_active":"2024-09-17T05:21:44.812101+0000","last_peered":"2024-09-17T05:21:44.812101+0000","last_clean":"2024-09-17T05:21:44.812101+0000","last_became_active":"2024-09-17T05:21:40.966428+0000","last_became_peered":"2024-09-17T05:21:40.966428+0000","last_unstale":"2024-09-17T05:21:44.812101+0000","last_undegraded":"2024-09-17T05:21:44.812101+0000","last_fullsized":"2024-09-17T05:21:44.812101+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:40.973665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812646+0000","last_change":"2024-09-17T05:21:41.971189+0000","last_active":"2024-09-17T05:21:44.812646+0000","last_peered":"2024-09-17T05:21:44.812646+0000","last_clean":"2024-09-17T05:21:44.812646+0000","last_became_active":"2024-09-17T05:21:41.970886+0000","last_became_peered":"2024-09-17T05:21:41.970886+0000","last_unstale":"2024-09-17T05:21:44.812646+0000","last_undegraded":"2024-09-17T05:21:44.812646+0000","last_fullsized":"2024-09-17T05:21:44.812646+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:49.816817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970323+0000","last_change":"2024-09-17T05:21:40.964010+0000","last_active":"2024-09-17T05:21:42.970323+0000","last_peered":"2024-09-17T05:21:42.970323+0000","last_clean":"2024-09-17T05:21:42.970323+0000","last_became_active":"2024-09-17T05:21:40.963746+0000","last_became_peered":"2024-09-17T05:21:40.963746+0000","last_unstale":"2024-09-17T05:21:42.970323+0000","last_undegraded":"2024-09-17T05:21:42.970323+0000","last_fullsized":"2024-09-17T05:21:42.970323+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:29.154676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969090+0000","last_change":"2024-09-17T05:21:41.963247+0000","last_active":"2024-09-17T05:21:42.969090+0000","last_peered":"2024-09-17T05:21:42.969090+0000","last_clean":"2024-09-17T05:21:42.969090+0000","last_became_active":"2024-09-17T05:21:41.960540+0000","last_became_peered":"2024-09-17T05:21:41.960540+0000","last_unstale":"2024-09-17T05:21:42.969090+0000","last_undegraded":"2024-09-17T05:21:42.969090+0000","last_fullsized":"2024-09-17T05:21:42.969090+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:38:05.586240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812140+0000","last_change":"2024-09-17T05:21:40.963557+0000","last_active":"2024-09-17T05:21:44.812140+0000","last_peered":"2024-09-17T05:21:44.812140+0000","last_clean":"2024-09-17T05:21:44.812140+0000","last_became_active":"2024-09-17T05:21:40.963038+0000","last_became_peered":"2024-09-17T05:21:40.963038+0000","last_unstale":"2024-09-17T05:21:44.812140+0000","last_undegraded":"2024-09-17T05:21:44.812140+0000","last_fullsized":"2024-09-17T05:21:44.812140+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:02:36.493223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812204+0000","last_change":"2024-09-17T05:21:41.980005+0000","last_active":"2024-09-17T05:21:44.812204+0000","last_peered":"2024-09-17T05:21:44.812204+0000","last_clean":"2024-09-17T05:21:44.812204+0000","last_became_active":"2024-09-17T05:21:41.979635+0000","last_became_peered":"2024-09-17T05:21:41.979635+0000","last_unstale":"2024-09-17T05:21:44.812204+0000","last_undegraded":"2024-09-17T05:21:44.812204+0000","last_fullsized":"2024-09-17T05:21:44.812204+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:06.119307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"57'8","reported_seq":23,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811969+0000","last_change":"2024-09-17T05:21:40.969574+0000","last_active":"2024-09-17T05:21:44.811969+0000","last_peered":"2024-09-17T05:21:44.811969+0000","last_clean":"2024-09-17T05:21:44.811969+0000","last_became_active":"2024-09-17T05:21:40.969303+0000","last_became_peered":"2024-09-17T05:21:40.969303+0000","last_unstale":"2024-09-17T05:21:44.811969+0000","last_undegraded":"2024-09-17T05:21:44.811969+0000","last_fullsized":"2024-09-17T05:21:44.811969+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:03.236947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812644+0000","last_change":"2024-09-17T05:21:41.979586+0000","last_active":"2024-09-17T05:21:44.812644+0000","last_peered":"2024-09-17T05:21:44.812644+0000","last_clean":"2024-09-17T05:21:44.812644+0000","last_became_active":"2024-09-17T05:21:41.977982+0000","last_became_peered":"2024-09-17T05:21:41.977982+0000","last_unstale":"2024-09-17T05:21:44.812644+0000","last_undegraded":"2024-09-17T05:21:44.812644+0000","last_fullsized":"2024-09-17T05:21:44.812644+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:24.712347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812177+0000","last_change":"2024-09-17T05:21:40.964669+0000","last_active":"2024-09-17T05:21:44.812177+0000","last_peered":"2024-09-17T05:21:44.812177+0000","last_clean":"2024-09-17T05:21:44.812177+0000","last_became_active":"2024-09-17T05:21:40.964429+0000","last_became_peered":"2024-09-17T05:21:40.964429+0000","last_unstale":"2024-09-17T05:21:44.812177+0000","last_undegraded":"2024-09-17T05:21:44.812177+0000","last_fullsized":"2024-09-17T05:21:44.812177+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:17.167631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812166+0000","last_change":"2024-09-17T05:21:41.975048+0000","last_active":"2024-09-17T05:21:44.812166+0000","last_peered":"2024-09-17T05:21:44.812166+0000","last_clean":"2024-09-17T05:21:44.812166+0000","last_became_active":"2024-09-17T05:21:41.974770+0000","last_became_peered":"2024-09-17T05:21:41.974770+0000","last_unstale":"2024-09-17T05:21:44.812166+0000","last_undegraded":"2024-09-17T05:21:44.812166+0000","last_fullsized":"2024-09-17T05:21:44.812166+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:06.119307+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719661+0000","last_change":"2024-09-17T05:21:40.963624+0000","last_active":"2024-09-17T05:21:43.719661+0000","last_peered":"2024-09-17T05:21:43.719661+0000","last_clean":"2024-09-17T05:21:43.719661+0000","last_became_active":"2024-09-17T05:21:40.963377+0000","last_became_peered":"2024-09-17T05:21:40.963377+0000","last_unstale":"2024-09-17T05:21:43.719661+0000","last_undegraded":"2024-09-17T05:21:43.719661+0000","last_fullsized":"2024-09-17T05:21:43.719661+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:01.418973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811863+0000","last_change":"2024-09-17T05:21:41.972740+0000","last_active":"2024-09-17T05:21:44.811863+0000","last_peered":"2024-09-17T05:21:44.811863+0000","last_clean":"2024-09-17T05:21:44.811863+0000","last_became_active":"2024-09-17T05:21:41.972469+0000","last_became_peered":"2024-09-17T05:21:41.972469+0000","last_unstale":"2024-09-17T05:21:44.811863+0000","last_undegraded":"2024-09-17T05:21:44.811863+0000","last_fullsized":"2024-09-17T05:21:44.811863+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:19.231899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.813133+0000","last_change":"2024-09-17T05:21:40.965780+0000","last_active":"2024-09-17T05:21:44.813133+0000","last_peered":"2024-09-17T05:21:44.813133+0000","last_clean":"2024-09-17T05:21:44.813133+0000","last_became_active":"2024-09-17T05:21:40.965506+0000","last_became_peered":"2024-09-17T05:21:40.965506+0000","last_unstale":"2024-09-17T05:21:44.813133+0000","last_undegraded":"2024-09-17T05:21:44.813133+0000","last_fullsized":"2024-09-17T05:21:44.813133+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:28:37.289164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812964+0000","last_change":"2024-09-17T05:21:41.977343+0000","last_active":"2024-09-17T05:21:44.812964+0000","last_peered":"2024-09-17T05:21:44.812964+0000","last_clean":"2024-09-17T05:21:44.812964+0000","last_became_active":"2024-09-17T05:21:41.976076+0000","last_became_peered":"2024-09-17T05:21:41.976076+0000","last_unstale":"2024-09-17T05:21:44.812964+0000","last_undegraded":"2024-09-17T05:21:44.812964+0000","last_fullsized":"2024-09-17T05:21:44.812964+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:28.053898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719487+0000","last_change":"2024-09-17T05:21:40.967020+0000","last_active":"2024-09-17T05:21:43.719487+0000","last_peered":"2024-09-17T05:21:43.719487+0000","last_clean":"2024-09-17T05:21:43.719487+0000","last_became_active":"2024-09-17T05:21:40.966744+0000","last_became_peered":"2024-09-17T05:21:40.966744+0000","last_unstale":"2024-09-17T05:21:43.719487+0000","last_undegraded":"2024-09-17T05:21:43.719487+0000","last_fullsized":"2024-09-17T05:21:43.719487+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:49.890682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812573+0000","last_change":"2024-09-17T05:21:41.973614+0000","last_active":"2024-09-17T05:21:44.812573+0000","last_peered":"2024-09-17T05:21:44.812573+0000","last_clean":"2024-09-17T05:21:44.812573+0000","last_became_active":"2024-09-17T05:21:41.972926+0000","last_became_peered":"2024-09-17T05:21:41.972926+0000","last_unstale":"2024-09-17T05:21:44.812573+0000","last_undegraded":"2024-09-17T05:21:44.812573+0000","last_fullsized":"2024-09-17T05:21:44.812573+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:18.171722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812252+0000","last_change":"2024-09-17T05:21:40.969833+0000","last_active":"2024-09-17T05:21:44.812252+0000","last_peered":"2024-09-17T05:21:44.812252+0000","last_clean":"2024-09-17T05:21:44.812252+0000","last_became_active":"2024-09-17T05:21:40.969550+0000","last_became_peered":"2024-09-17T05:21:40.969550+0000","last_unstale":"2024-09-17T05:21:44.812252+0000","last_undegraded":"2024-09-17T05:21:44.812252+0000","last_fullsized":"2024-09-17T05:21:44.812252+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:04:48.812726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719302+0000","last_change":"2024-09-17T05:21:41.975403+0000","last_active":"2024-09-17T05:21:43.719302+0000","last_peered":"2024-09-17T05:21:43.719302+0000","last_clean":"2024-09-17T05:21:43.719302+0000","last_became_active":"2024-09-17T05:21:41.975049+0000","last_became_peered":"2024-09-17T05:21:41.975049+0000","last_unstale":"2024-09-17T05:21:43.719302+0000","last_undegraded":"2024-09-17T05:21:43.719302+0000","last_fullsized":"2024-09-17T05:21:43.719302+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:28:30.047142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711181+0000","last_change":"2024-09-17T05:21:40.958820+0000","last_active":"2024-09-17T05:21:43.711181+0000","last_peered":"2024-09-17T05:21:43.711181+0000","last_clean":"2024-09-17T05:21:43.711181+0000","last_became_active":"2024-09-17T05:21:40.958548+0000","last_became_peered":"2024-09-17T05:21:40.958548+0000","last_unstale":"2024-09-17T05:21:43.711181+0000","last_undegraded":"2024-09-17T05:21:43.711181+0000","last_fullsized":"2024-09-17T05:21:43.711181+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:29.154676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719051+0000","last_change":"2024-09-17T05:21:41.968799+0000","last_active":"2024-09-17T05:21:43.719051+0000","last_peered":"2024-09-17T05:21:43.719051+0000","last_clean":"2024-09-17T05:21:43.719051+0000","last_became_active":"2024-09-17T05:21:41.968530+0000","last_became_peered":"2024-09-17T05:21:41.968530+0000","last_unstale":"2024-09-17T05:21:43.719051+0000","last_undegraded":"2024-09-17T05:21:43.719051+0000","last_fullsized":"2024-09-17T05:21:43.719051+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:59:08.445414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811956+0000","last_change":"2024-09-17T05:21:40.966445+0000","last_active":"2024-09-17T05:21:44.811956+0000","last_peered":"2024-09-17T05:21:44.811956+0000","last_clean":"2024-09-17T05:21:44.811956+0000","last_became_active":"2024-09-17T05:21:40.966200+0000","last_became_peered":"2024-09-17T05:21:40.966200+0000","last_unstale":"2024-09-17T05:21:44.811956+0000","last_undegraded":"2024-09-17T05:21:44.811956+0000","last_fullsized":"2024-09-17T05:21:44.811956+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:50:44.747675+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812927+0000","last_change":"2024-09-17T05:21:41.965386+0000","last_active":"2024-09-17T05:21:44.812927+0000","last_peered":"2024-09-17T05:21:44.812927+0000","last_clean":"2024-09-17T05:21:44.812927+0000","last_became_active":"2024-09-17T05:21:41.965078+0000","last_became_peered":"2024-09-17T05:21:41.965078+0000","last_unstale":"2024-09-17T05:21:44.812927+0000","last_undegraded":"2024-09-17T05:21:44.812927+0000","last_fullsized":"2024-09-17T05:21:44.812927+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:31.748829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"57'2","reported_seq":17,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711666+0000","last_change":"2024-09-17T05:21:40.966051+0000","last_active":"2024-09-17T05:21:43.711666+0000","last_peered":"2024-09-17T05:21:43.711666+0000","last_clean":"2024-09-17T05:21:43.711666+0000","last_became_active":"2024-09-17T05:21:40.965771+0000","last_became_peered":"2024-09-17T05:21:40.965771+0000","last_unstale":"2024-09-17T05:21:43.711666+0000","last_undegraded":"2024-09-17T05:21:43.711666+0000","last_fullsized":"2024-09-17T05:21:43.711666+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:54.548520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812394+0000","last_change":"2024-09-17T05:21:41.970972+0000","last_active":"2024-09-17T05:21:44.812394+0000","last_peered":"2024-09-17T05:21:44.812394+0000","last_clean":"2024-09-17T05:21:44.812394+0000","last_became_active":"2024-09-17T05:21:41.970323+0000","last_became_peered":"2024-09-17T05:21:41.970323+0000","last_unstale":"2024-09-17T05:21:44.812394+0000","last_undegraded":"2024-09-17T05:21:44.812394+0000","last_fullsized":"2024-09-17T05:21:44.812394+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:54.750425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"57'1","reported_seq":16,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719783+0000","last_change":"2024-09-17T05:21:40.964246+0000","last_active":"2024-09-17T05:21:43.719783+0000","last_peered":"2024-09-17T05:21:43.719783+0000","last_clean":"2024-09-17T05:21:43.719783+0000","last_became_active":"2024-09-17T05:21:40.963976+0000","last_became_peered":"2024-09-17T05:21:40.963976+0000","last_unstale":"2024-09-17T05:21:43.719783+0000","last_undegraded":"2024-09-17T05:21:43.719783+0000","last_fullsized":"2024-09-17T05:21:43.719783+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:56:33.579472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711451+0000","last_change":"2024-09-17T05:21:41.958676+0000","last_active":"2024-09-17T05:21:43.711451+0000","last_peered":"2024-09-17T05:21:43.711451+0000","last_clean":"2024-09-17T05:21:43.711451+0000","last_became_active":"2024-09-17T05:21:41.958413+0000","last_became_peered":"2024-09-17T05:21:41.958413+0000","last_unstale":"2024-09-17T05:21:43.711451+0000","last_undegraded":"2024-09-17T05:21:43.711451+0000","last_fullsized":"2024-09-17T05:21:43.711451+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:07.292227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.970220+0000","last_change":"2024-09-17T05:21:40.963049+0000","last_active":"2024-09-17T05:21:42.970220+0000","last_peered":"2024-09-17T05:21:42.970220+0000","last_clean":"2024-09-17T05:21:42.970220+0000","last_became_active":"2024-09-17T05:21:40.962743+0000","last_became_peered":"2024-09-17T05:21:40.962743+0000","last_unstale":"2024-09-17T05:21:42.970220+0000","last_undegraded":"2024-09-17T05:21:42.970220+0000","last_fullsized":"2024-09-17T05:21:42.970220+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:39.921244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.719787+0000","last_change":"2024-09-17T05:21:41.972775+0000","last_active":"2024-09-17T05:21:43.719787+0000","last_peered":"2024-09-17T05:21:43.719787+0000","last_clean":"2024-09-17T05:21:43.719787+0000","last_became_active":"2024-09-17T05:21:41.972226+0000","last_became_peered":"2024-09-17T05:21:41.972226+0000","last_unstale":"2024-09-17T05:21:43.719787+0000","last_undegraded":"2024-09-17T05:21:43.719787+0000","last_fullsized":"2024-09-17T05:21:43.719787+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:01.636245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.813180+0000","last_change":"2024-09-17T05:21:40.965286+0000","last_active":"2024-09-17T05:21:44.813180+0000","last_peered":"2024-09-17T05:21:44.813180+0000","last_clean":"2024-09-17T05:21:44.813180+0000","last_became_active":"2024-09-17T05:21:40.963994+0000","last_became_peered":"2024-09-17T05:21:40.963994+0000","last_unstale":"2024-09-17T05:21:44.813180+0000","last_undegraded":"2024-09-17T05:21:44.813180+0000","last_fullsized":"2024-09-17T05:21:44.813180+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:28.012672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811987+0000","last_change":"2024-09-17T05:21:41.976742+0000","last_active":"2024-09-17T05:21:44.811987+0000","last_peered":"2024-09-17T05:21:44.811987+0000","last_clean":"2024-09-17T05:21:44.811987+0000","last_became_active":"2024-09-17T05:21:41.976476+0000","last_became_peered":"2024-09-17T05:21:41.976476+0000","last_unstale":"2024-09-17T05:21:44.811987+0000","last_undegraded":"2024-09-17T05:21:44.811987+0000","last_fullsized":"2024-09-17T05:21:44.811987+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:19.613921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711142+0000","last_change":"2024-09-17T05:21:40.966188+0000","last_active":"2024-09-17T05:21:43.711142+0000","last_peered":"2024-09-17T05:21:43.711142+0000","last_clean":"2024-09-17T05:21:43.711142+0000","last_became_active":"2024-09-17T05:21:40.965925+0000","last_became_peered":"2024-09-17T05:21:40.965925+0000","last_unstale":"2024-09-17T05:21:43.711142+0000","last_undegraded":"2024-09-17T05:21:43.711142+0000","last_fullsized":"2024-09-17T05:21:43.711142+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:59:14.194607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812665+0000","last_change":"2024-09-17T05:21:41.978647+0000","last_active":"2024-09-17T05:21:44.812665+0000","last_peered":"2024-09-17T05:21:44.812665+0000","last_clean":"2024-09-17T05:21:44.812665+0000","last_became_active":"2024-09-17T05:21:41.978314+0000","last_became_peered":"2024-09-17T05:21:41.978314+0000","last_unstale":"2024-09-17T05:21:44.812665+0000","last_undegraded":"2024-09-17T05:21:44.812665+0000","last_fullsized":"2024-09-17T05:21:44.812665+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:41.977756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969413+0000","last_change":"2024-09-17T05:21:40.955869+0000","last_active":"2024-09-17T05:21:42.969413+0000","last_peered":"2024-09-17T05:21:42.969413+0000","last_clean":"2024-09-17T05:21:42.969413+0000","last_became_active":"2024-09-17T05:21:40.955539+0000","last_became_peered":"2024-09-17T05:21:40.955539+0000","last_unstale":"2024-09-17T05:21:42.969413+0000","last_undegraded":"2024-09-17T05:21:42.969413+0000","last_fullsized":"2024-09-17T05:21:42.969413+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:58.287076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711038+0000","last_change":"2024-09-17T05:21:41.960278+0000","last_active":"2024-09-17T05:21:43.711038+0000","last_peered":"2024-09-17T05:21:43.711038+0000","last_clean":"2024-09-17T05:21:43.711038+0000","last_became_active":"2024-09-17T05:21:41.960037+0000","last_became_peered":"2024-09-17T05:21:41.960037+0000","last_unstale":"2024-09-17T05:21:43.711038+0000","last_undegraded":"2024-09-17T05:21:43.711038+0000","last_fullsized":"2024-09-17T05:21:43.711038+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:30.656695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:43.711135+0000","last_change":"2024-09-17T05:21:40.958018+0000","last_active":"2024-09-17T05:21:43.711135+0000","last_peered":"2024-09-17T05:21:43.711135+0000","last_clean":"2024-09-17T05:21:43.711135+0000","last_became_active":"2024-09-17T05:21:40.957745+0000","last_became_peered":"2024-09-17T05:21:40.957745+0000","last_unstale":"2024-09-17T05:21:43.711135+0000","last_undegraded":"2024-09-17T05:21:43.711135+0000","last_fullsized":"2024-09-17T05:21:43.711135+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:12.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811677+0000","last_change":"2024-09-17T05:21:41.970619+0000","last_active":"2024-09-17T05:21:44.811677+0000","last_peered":"2024-09-17T05:21:44.811677+0000","last_clean":"2024-09-17T05:21:44.811677+0000","last_became_active":"2024-09-17T05:21:41.969476+0000","last_became_peered":"2024-09-17T05:21:41.969476+0000","last_unstale":"2024-09-17T05:21:44.811677+0000","last_undegraded":"2024-09-17T05:21:44.811677+0000","last_fullsized":"2024-09-17T05:21:44.811677+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:28.101271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811934+0000","last_change":"2024-09-17T05:21:40.969445+0000","last_active":"2024-09-17T05:21:44.811934+0000","last_peered":"2024-09-17T05:21:44.811934+0000","last_clean":"2024-09-17T05:21:44.811934+0000","last_became_active":"2024-09-17T05:21:40.969235+0000","last_became_peered":"2024-09-17T05:21:40.969235+0000","last_unstale":"2024-09-17T05:21:44.811934+0000","last_undegraded":"2024-09-17T05:21:44.811934+0000","last_fullsized":"2024-09-17T05:21:44.811934+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:53.746334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":13,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.811742+0000","last_change":"2024-09-17T05:21:41.969911+0000","last_active":"2024-09-17T05:21:44.811742+0000","last_peered":"2024-09-17T05:21:44.811742+0000","last_clean":"2024-09-17T05:21:44.811742+0000","last_became_active":"2024-09-17T05:21:41.968957+0000","last_became_peered":"2024-09-17T05:21:41.968957+0000","last_unstale":"2024-09-17T05:21:44.811742+0000","last_undegraded":"2024-09-17T05:21:44.811742+0000","last_fullsized":"2024-09-17T05:21:44.811742+0000","mapping_epoch":56,"log_start":"0'0","ondisk_log_start":"0'0","created":56,"last_epoch_clean":57,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:40.946611+0000","last_clean_scrub_stamp":"2024-09-17T05:21:40.946611+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:39.447483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":15,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:42.969554+0000","last_change":"2024-09-17T05:21:40.965053+0000","last_active":"2024-09-17T05:21:42.969554+0000","last_peered":"2024-09-17T05:21:42.969554+0000","last_clean":"2024-09-17T05:21:42.969554+0000","last_became_active":"2024-09-17T05:21:40.964717+0000","last_became_peered":"2024-09-17T05:21:40.964717+0000","last_unstale":"2024-09-17T05:21:42.969554+0000","last_undegraded":"2024-09-17T05:21:42.969554+0000","last_fullsized":"2024-09-17T05:21:42.969554+0000","mapping_epoch":55,"log_start":"0'0","ondisk_log_start":"0'0","created":55,"last_epoch_clean":56,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:21:39.942520+0000","last_clean_scrub_stamp":"2024-09-17T05:21:39.942520+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:12.719447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":171,"reported_epoch":58,"state":"active+clean","last_fresh":"2024-09-17T05:21:44.812129+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:21:44.812129+0000","last_peered":"2024-09-17T05:21:44.812129+0000","last_clean":"2024-09-17T05:21:44.812129+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:21:44.812129+0000","last_undegraded":"2024-09-17T05:21:44.812129+0000","last_fullsized":"2024-09-17T05:21:44.812129+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509482,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28288,"kb_used_data":1260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343552,"statfs":{"total":96636764160,"available":96607797248,"internally_reserved":0,"allocated":1290240,"data_stored":873497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":672,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":688128,"data_stored":282969,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509481,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":283621,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509481,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":684,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":700416,"data_stored":284581,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509481,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27708,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344132,"statfs":{"total":96636764160,"available":96608391168,"internally_reserved":0,"allocated":696320,"data_stored":283025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509482,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27716,"kb_used_data":680,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344124,"statfs":{"total":96636764160,"available":96608382976,"internally_reserved":0,"allocated":696320,"data_stored":283025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509481,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27704,"kb_used_data":676,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344136,"statfs":{"total":96636764160,"available":96608395264,"internally_reserved":0,"allocated":692224,"data_stored":283059,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574890,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32460,"kb_used_data":1268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339380,"statfs":{"total":96636764160,"available":96603525120,"internally_reserved":0,"allocated":1298432,"data_stored":875531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":9,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:21:50.698 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:21:50.699 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:21:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.843+0000 7f6373b94640 1 -- 172.21.15.81:0/2363321338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 msgr2=0x7f6354003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.843+0000 7f6373b94640 1 --2- 172.21.15.81:0/2363321338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 0x7f6354003e70 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f635c00c610 tx=0x7f6354005830 comp rx=0 tx=0).stop 2024-09-17T05:21:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.843+0000 7f6372131640 1 -- 172.21.15.81:0/2363321338 reap_dead start 2024-09-17T05:21:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.843+0000 7f6373b94640 1 -- 172.21.15.81:0/2363321338 shutdown_connections 2024-09-17T05:21:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.843+0000 7f6373b94640 1 -- 172.21.15.81:0/2363321338 >> 172.21.15.81:0/2363321338 conn(0x7f636c0d3e30 msgr2=0x7f636c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.843+0000 7f6373b94640 1 -- 172.21.15.81:0/2363321338 shutdown_connections 2024-09-17T05:21:50.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.843+0000 7f6373b94640 1 -- 172.21.15.81:0/2363321338 wait complete. 2024-09-17T05:21:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.844+0000 7f6373b94640 1 Processor -- start 2024-09-17T05:21:50.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.844+0000 7f6373b94640 1 -- start start 2024-09-17T05:21:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6373b94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 0x7f636c15d850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6373b94640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f636c1f5e40 0x7f636c06d7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6373b94640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636c1f62c0 0x7f636c06dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6373b94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f636c0d2860 con 0x7f6354003a50 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6373b94640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f636c0d26e0 con 0x7f636c1f5e40 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6373b94640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f636c0d29e0 con 0x7f636c1f62c0 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 0x7f636c15d850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 0x7f636c15d850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47720/0 (socket says 172.21.15.81:47720) 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 -- 172.21.15.81:0/1537184251 learned_addr learned my addr 172.21.15.81:0/1537184251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6372131640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636c1f62c0 0x7f636c06dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f637112f640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f636c1f5e40 0x7f636c06d7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 -- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636c1f62c0 msgr2=0x7f636c06dd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636c1f62c0 0x7f636c06dd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 -- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f636c1f5e40 msgr2=0x7f636c06d7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f636c1f5e40 0x7f636c06d7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 -- 172.21.15.81:0/1537184251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f636c1f9240 con 0x7f6354003a50 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6371930640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 0x7f636c15d850 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f635c000f80 tx=0x7f635c004c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f636a7fc640 1 -- 172.21.15.81:0/1537184251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c02bc10 con 0x7f6354003a50 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f636a7fc640 1 -- 172.21.15.81:0/1537184251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f635c03a070 con 0x7f6354003a50 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f636c1f89a0 con 0x7f6354003a50 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.845+0000 7f636a7fc640 1 -- 172.21.15.81:0/1537184251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f635c006290 con 0x7f6354003a50 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.846+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f636c1f8f60 con 0x7f6354003a50 2024-09-17T05:21:50.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.846+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f636c0b4270 con 0x7f6354003a50 2024-09-17T05:21:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.847+0000 7f636a7fc640 1 -- 172.21.15.81:0/1537184251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f635c03c070 con 0x7f6354003a50 2024-09-17T05:21:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.848+0000 7f636a7fc640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6358078d70 0x7f635807b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.848+0000 7f636a7fc640 1 -- 172.21.15.81:0/1537184251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f635c0baf90 con 0x7f6354003a50 2024-09-17T05:21:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.848+0000 7f637112f640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6358078d70 0x7f635807b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:50.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.848+0000 7f637112f640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6358078d70 0x7f635807b230 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f636c1ebde0 tx=0x7f636000d550 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:50.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:50.852+0000 7f636a7fc640 1 -- 172.21.15.81:0/1537184251 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f635c004e20 con 0x7f6354003a50 2024-09-17T05:21:51.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.096+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f636c0b5700 con 0x7f6354003a50 2024-09-17T05:21:51.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.099+0000 7f636a7fc640 1 -- 172.21.15.81:0/1537184251 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) ==== 190+0+147 (secure 0 0 0) 0x7f635c0830d0 con 0x7f6354003a50 2024-09-17T05:21:51.100 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:21:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:21:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:21:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:21:51.100 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:21:51.100 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6358078d70 msgr2=0x7f635807b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6358078d70 0x7f635807b230 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f636c1ebde0 tx=0x7f636000d550 comp rx=0 tx=0).stop 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 msgr2=0x7f636c15d850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 0x7f636c15d850 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f635c000f80 tx=0x7f635c004c30 comp rx=0 tx=0).stop 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 shutdown_connections 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6358078d70 0x7f635807b230 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f636c1f62c0 0x7f636c06dd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f636c1f5e40 0x7f636c06d7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 --2- 172.21.15.81:0/1537184251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6354003a50 0x7f636c15d850 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 >> 172.21.15.81:0/1537184251 conn(0x7f636c0d3e30 msgr2=0x7f636c0b0a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 shutdown_connections 2024-09-17T05:21:51.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.102+0000 7f6373b94640 1 -- 172.21.15.81:0/1537184251 wait complete. 2024-09-17T05:21:51.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:21:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 -- 172.21.15.81:0/3783234547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 msgr2=0x7f7c94074130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/3783234547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c94074130 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f7c94073670 tx=0x7f7c9002a580 comp rx=0 tx=0).stop 2024-09-17T05:21:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 -- 172.21.15.81:0/3783234547 shutdown_connections 2024-09-17T05:21:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/3783234547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c940cc6d0 0x7f7c940ccb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/3783234547 >> v2:172.21.15.160:3300/0 conn(0x7f7c940cb270 0x7f7c940cb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/3783234547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c94074130 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 -- 172.21.15.81:0/3783234547 >> 172.21.15.81:0/3783234547 conn(0x7f7c940d0c20 msgr2=0x7f7c940d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 -- 172.21.15.81:0/3783234547 shutdown_connections 2024-09-17T05:21:51.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.213+0000 7f7c9bf64640 1 -- 172.21.15.81:0/3783234547 wait complete. 2024-09-17T05:21:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.214+0000 7f7c9bf64640 1 Processor -- start 2024-09-17T05:21:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.214+0000 7f7c9bf64640 1 -- start start 2024-09-17T05:21:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c9bf64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c941f8b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c9bf64640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c940cb270 0x7f7c940b2ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c9bf64640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c940cc6d0 0x7f7c941f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c9bf64640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94070b10 con 0x7f7c9406d590 2024-09-17T05:21:51.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c9bf64640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c94070990 con 0x7f7c940cb270 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c9bf64640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7c94070c90 con 0x7f7c940cc6d0 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c941f8b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c941f8b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47740/0 (socket says 172.21.15.81:47740) 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 -- 172.21.15.81:0/1579754308 learned_addr learned my addr 172.21.15.81:0/1579754308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c9a501640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c940cc6d0 0x7f7c941f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c994ff640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c940cb270 0x7f7c940b2ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 -- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c940cc6d0 msgr2=0x7f7c941f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c940cc6d0 0x7f7c941f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 -- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c940cb270 msgr2=0x7f7c940b2ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c940cb270 0x7f7c940b2ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 -- 172.21.15.81:0/1579754308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c941f9050 con 0x7f7c9406d590 2024-09-17T05:21:51.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c994ff640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c940cb270 0x7f7c940b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.215+0000 7f7c99d00640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c941f8b10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c900099f0 tx=0x7f7c900039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.216+0000 7f7c8a7fc640 1 -- 172.21.15.81:0/1579754308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c9003f070 con 0x7f7c9406d590 2024-09-17T05:21:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.216+0000 7f7c8a7fc640 1 -- 172.21.15.81:0/1579754308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c900048b0 con 0x7f7c9406d590 2024-09-17T05:21:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.216+0000 7f7c8a7fc640 1 -- 172.21.15.81:0/1579754308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c90035030 con 0x7f7c9406d590 2024-09-17T05:21:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.216+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c940a1650 con 0x7f7c9406d590 2024-09-17T05:21:51.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.216+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c941f4e60 con 0x7f7c9406d590 2024-09-17T05:21:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.217+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c940cb6c0 con 0x7f7c9406d590 2024-09-17T05:21:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.217+0000 7f7c8a7fc640 1 -- 172.21.15.81:0/1579754308 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f7c90042070 con 0x7f7c9406d590 2024-09-17T05:21:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.218+0000 7f7c8a7fc640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7c78078d40 0x7f7c7807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.218+0000 7f7c8a7fc640 1 -- 172.21.15.81:0/1579754308 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f7c900bbdc0 con 0x7f7c9406d590 2024-09-17T05:21:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.218+0000 7f7c994ff640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7c78078d40 0x7f7c7807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.218+0000 7f7c994ff640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7c78078d40 0x7f7c7807b200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7c940cf8b0 tx=0x7f7c84005f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.222+0000 7f7c8a7fc640 1 -- 172.21.15.81:0/1579754308 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7c941f9050 con 0x7f7c9406d590 2024-09-17T05:21:51.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.432+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7c940b6ba0 con 0x7f7c9406d590 2024-09-17T05:21:51.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.432+0000 7f7c8a7fc640 1 -- 172.21.15.81:0/1579754308 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 31 v31) ==== 94+0+5226 (secure 0 0 0) 0x7f7c90083940 con 0x7f7c9406d590 2024-09-17T05:21:51.437 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:21:51.437 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":31,"btime":"2024-09-17T05:21:44:975320+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1537992933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1537992933},{"type":"v1","addr":"172.21.15.160:6836","nonce":1537992933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5419,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3597720446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3597720446},{"type":"v1","addr":"172.21.15.160:6837","nonce":3597720446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/457781060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":457781060},{"type":"v1","addr":"172.21.15.81:6834","nonce":457781060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:41.304247+0000","modified":"2024-09-17T05:21:44.170675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1068882112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1068882112},{"type":"v1","addr":"172.21.15.81:6835","nonce":1068882112}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-09-17T05:21:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 31 2024-09-17T05:21:51.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.434+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7c78078d40 msgr2=0x7f7c7807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.434+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7c78078d40 0x7f7c7807b200 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f7c940cf8b0 tx=0x7f7c84005f10 comp rx=0 tx=0).stop 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.434+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 msgr2=0x7f7c941f8b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c941f8b10 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f7c900099f0 tx=0x7f7c900039e0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 shutdown_connections 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7c78078d40 0x7f7c7807b200 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c940cc6d0 0x7f7c941f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c940cb270 0x7f7c940b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 --2- 172.21.15.81:0/1579754308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9406d590 0x7f7c941f8b10 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 >> 172.21.15.81:0/1579754308 conn(0x7f7c940d0c20 msgr2=0x7f7c940c6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 shutdown_connections 2024-09-17T05:21:51.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.435+0000 7f7c9bf64640 1 -- 172.21.15.81:0/1579754308 wait complete. 2024-09-17T05:21:51.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 31, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:21:41.304247+0000', 'modified': '2024-09-17T05:21:44.170675+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5757}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5757': {'gid': 5757, 'name': 'c', 'rank': 0, 'incarnation': 28, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.81:6835/1068882112', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 1068882112}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1068882112}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 5757, 'qdb_cluster': [5757]} 2024-09-17T05:21:51.850 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:21:51.850 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:21:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.953+0000 7f0229cef640 1 -- 172.21.15.81:0/699046806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 msgr2=0x7f020c003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.953+0000 7f0229cef640 1 --2- 172.21.15.81:0/699046806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f020c003e90 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f0214009ed0 tx=0x7f020c005830 comp rx=0 tx=0).stop 2024-09-17T05:21:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.953+0000 7f0229cef640 1 -- 172.21.15.81:0/699046806 shutdown_connections 2024-09-17T05:21:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.953+0000 7f0229cef640 1 --2- 172.21.15.81:0/699046806 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f020c003e90 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.953+0000 7f0229cef640 1 -- 172.21.15.81:0/699046806 >> 172.21.15.81:0/699046806 conn(0x7f02240b1690 msgr2=0x7f02240b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.954+0000 7f0229cef640 1 -- 172.21.15.81:0/699046806 shutdown_connections 2024-09-17T05:21:51.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.954+0000 7f0229cef640 1 -- 172.21.15.81:0/699046806 wait complete. 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.955+0000 7f0229cef640 1 Processor -- start 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.955+0000 7f0229cef640 1 -- start start 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f02241f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02241e31a0 0x7f02241e3600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0224152d70 0x7f0224153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f022406ff80 con 0x7f020c003a50 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0224073df0 con 0x7f0224152d70 2024-09-17T05:21:51.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0224070100 con 0x7f02241e31a0 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f02241f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f02241f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47754/0 (socket says 172.21.15.81:47754) 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 -- 172.21.15.81:0/1739940481 learned_addr learned my addr 172.21.15.81:0/1739940481 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0222ffd640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02241e31a0 0x7f02241e3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0223fff640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0224152d70 0x7f0224153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 -- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02241e31a0 msgr2=0x7f02241e3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02241e31a0 0x7f02241e3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 -- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0224152d70 msgr2=0x7f0224153200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0224152d70 0x7f0224153200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 -- 172.21.15.81:0/1739940481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0224153a80 con 0x7f020c003a50 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f02237fe640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f02241f1f10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0214009e20 tx=0x7f0214033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f020bfff640 1 -- 172.21.15.81:0/1739940481 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214033c70 con 0x7f020c003a50 2024-09-17T05:21:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f020bfff640 1 -- 172.21.15.81:0/1739940481 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f021403e030 con 0x7f020c003a50 2024-09-17T05:21:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0224153d60 con 0x7f020c003a50 2024-09-17T05:21:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f020bfff640 1 -- 172.21.15.81:0/1739940481 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214043680 con 0x7f020c003a50 2024-09-17T05:21:51.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.956+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0224154320 con 0x7f020c003a50 2024-09-17T05:21:51.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.958+0000 7f020bfff640 1 -- 172.21.15.81:0/1739940481 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f021402bcf0 con 0x7f020c003a50 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.958+0000 7f020bfff640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0210078d40 0x7f021007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.959+0000 7f020bfff640 1 -- 172.21.15.81:0/1739940481 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f02140bd940 con 0x7f020c003a50 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.959+0000 7f0222ffd640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0210078d40 0x7f021007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.959+0000 7f022cabd740 1 Processor -- start 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.959+0000 7f022cabd740 1 -- start start 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.959+0000 7f0222ffd640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0210078d40 0x7f021007b200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0218001220 tx=0x7f0218006720 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f022cabd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095cd1b0 0x5565095a4b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095ecdf0 0x5565095ed1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095a2a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f022cabd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556509519820 con 0x5565095cd1b0 2024-09-17T05:21:51.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x556509508c50 con 0x5565095a25f0 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55650950ca60 con 0x5565095ecdf0 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095cd1b0 0x5565095a4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095cd1b0 0x5565095a4b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47770/0 (socket says 172.21.15.81:47770) 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 -- 172.21.15.81:0/3016186474 learned_addr learned my addr 172.21.15.81:0/3016186474 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f0222ffd640 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095ecdf0 0x5565095ed1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f0223fff640 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095a2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 -- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095ecdf0 msgr2=0x5565095ed1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095ecdf0 0x5565095ed1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 -- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 msgr2=0x5565095a2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095a2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 -- 172.21.15.81:0/3016186474 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55650926a850 con 0x5565095cd1b0 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f0222ffd640 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095ecdf0 0x5565095ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:51.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f0223fff640 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.960+0000 7f02237fe640 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095cd1b0 0x5565095a4b20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f021400e350 tx=0x7f0214081400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b5c08f1c16a68f server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f02097fa640 1 -- 172.21.15.81:0/3016186474 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214048030 con 0x5565095cd1b0 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f02097fa640 1 -- 172.21.15.81:0/3016186474 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0214085070 con 0x5565095cd1b0 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f02097fa640 1 -- 172.21.15.81:0/3016186474 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214084cd0 con 0x5565095cd1b0 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 -- 172.21.15.81:0/3016186474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095cd1b0 msgr2=0x5565095a4b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095cd1b0 0x5565095a4b20 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f021400e350 tx=0x7f0214081400 comp rx=0 tx=0).stop 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 -- 172.21.15.81:0/3016186474 shutdown_connections 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095a2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095ecdf0 0x5565095ed1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 --2- 172.21.15.81:0/3016186474 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095cd1b0 0x5565095a4b20 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 -- 172.21.15.81:0/3016186474 >> 172.21.15.81:0/3016186474 conn(0x5565095a36a0 msgr2=0x5565095a70c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 -- 172.21.15.81:0/3016186474 shutdown_connections 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.961+0000 7f022cabd740 1 -- 172.21.15.81:0/3016186474 wait complete. 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.962+0000 7f022cabd740 1 -- start start 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.962+0000 7f022cabd740 1 Processor -- start 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x5565095fef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095ecdf0 0x5565095ff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095ff9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x556509279620 con 0x5565095c56a0 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5565094ae5f0 con 0x5565095ecdf0 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x556509519820 con 0x5565095cd1b0 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 10 client.0 _ll_register_callbacks cb 0x5565094b20a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095ff9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095ff9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47776/0 (socket says 172.21.15.81:47776) 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 -- 172.21.15.81:0/2524179485 learned_addr learned my addr 172.21.15.81:0/2524179485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f02237fe640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x5565095fef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0222ffd640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095ecdf0 0x5565095ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 -- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 msgr2=0x5565095fef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x5565095fef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 -- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095ecdf0 msgr2=0x5565095ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095ecdf0 0x5565095ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 -- 172.21.15.81:0/2524179485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565092e16b0 con 0x5565095c56a0 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f02237fe640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x5565095fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f0223fff640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095ff9a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f02240b3370 tx=0x7f021c003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9598c66aebb480ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f02027fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:21:51.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f02027fc640 1 -- 172.21.15.81:0/2524179485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021c012ab0 con 0x5565095c56a0 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f02027fc640 1 -- 172.21.15.81:0/2524179485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f021c012c50 con 0x5565095c56a0 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.963+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0214085070 con 0x5565095c56a0 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f02027fc640 1 -- 172.21.15.81:0/2524179485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f021c020050 con 0x5565095c56a0 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 10 client.5925 fetch_fsmap learned FSMap version 31 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5565095c5150 con 0x5565095c56a0 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f02027fc640 1 -- 172.21.15.81:0/2524179485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0214085070 con 0x5565095c56a0 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f02027fc640 1 -- 172.21.15.81:0/2524179485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f021c023020 con 0x5565095c56a0 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 10 client.5925 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 10 client.5925 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 20 client.5925 populate_metadata read hostname 'smithi081' 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095cfdb0 0x556509609860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 4 client.5925 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:21:51.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 --> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55650951b770 con 0x5565095cfdb0 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f02237fe640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095cfdb0 0x556509609860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f02237fe640 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095cfdb0 0x556509609860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2bc748a9a1ca6db3 server_cookie=3bfe830a94a14305 in_seq=0 out_seq=0 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.964+0000 7f02027fc640 10 client.5925 ms_handle_connect on v2:172.21.15.81:6833/1068882112 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f02027fc640 1 -- 172.21.15.81:0/2524179485 <== mds.0 v2:172.21.15.81:6833/1068882112 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55650951b770 con 0x5565095cfdb0 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f02027fc640 10 client.5925 handle_command_reply: tid=0 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 client.5925 shutdown 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 msgr2=0x5565095ff9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095ff9a0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f02240b3370 tx=0x7f021c003a80 comp rx=0 tx=0).stop 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 shutdown_connections 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095cfdb0 0x556509609860 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095ff9a0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095ecdf0 0x5565095ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 --2- 172.21.15.81:0/2524179485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x5565095fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 >> 172.21.15.81:0/2524179485 conn(0x5565095a25f0 msgr2=0x5565095a7610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f02027fc640 0 client.5925 ms_handle_reset on v2:172.21.15.81:6833/1068882112 2024-09-17T05:21:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 shutdown_connections 2024-09-17T05:21:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 1 -- 172.21.15.81:0/2524179485 wait complete. 2024-09-17T05:21:51.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.965+0000 7f022cabd740 20 client.5925 trim_cache size 0 max 16384 2024-09-17T05:21:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.983+0000 7f022cabd740 1 Processor -- start 2024-09-17T05:21:51.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.983+0000 7f022cabd740 1 -- start start 2024-09-17T05:21:51.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f022cabd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095a25f0 0x5565095e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095c56a0 0x5565095e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095cd1b0 0x5565095e1de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f022cabd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02241fc570 con 0x5565095a25f0 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f022406fbf0 con 0x5565095cd1b0 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f02241fbf50 con 0x5565095c56a0 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f02237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095a25f0 0x5565095e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f02237fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095a25f0 0x5565095e5630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47778/0 (socket says 172.21.15.81:47778) 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.984+0000 7f02237fe640 1 -- 172.21.15.81:0/1615510692 learned_addr learned my addr 172.21.15.81:0/1615510692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f02237fe640 1 -- 172.21.15.81:0/1615510692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095c56a0 msgr2=0x5565095e5b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f02237fe640 1 --2- 172.21.15.81:0/1615510692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095c56a0 0x5565095e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f02237fe640 1 -- 172.21.15.81:0/1615510692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095cd1b0 msgr2=0x5565095e1de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f02237fe640 1 --2- 172.21.15.81:0/1615510692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095cd1b0 0x5565095e1de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f02237fe640 1 -- 172.21.15.81:0/1615510692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565095a2d90 con 0x5565095a25f0 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f02237fe640 1 --2- 172.21.15.81:0/1615510692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095a25f0 0x5565095e5630 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f02140bbac0 tx=0x7f021409e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d684d269fa147d2c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f0208ff9640 1 -- 172.21.15.81:0/1615510692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214048040 con 0x5565095a25f0 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f0208ff9640 1 -- 172.21.15.81:0/1615510692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0214091070 con 0x5565095a25f0 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f0208ff9640 1 -- 172.21.15.81:0/1615510692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0214085330 con 0x5565095a25f0 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f022cabd740 1 -- 172.21.15.81:0/1615510692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095a25f0 msgr2=0x5565095e5630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.985+0000 7f022cabd740 1 --2- 172.21.15.81:0/1615510692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095a25f0 0x5565095e5630 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f02140bbac0 tx=0x7f021409e040 comp rx=0 tx=0).stop 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 -- 172.21.15.81:0/1615510692 shutdown_connections 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 --2- 172.21.15.81:0/1615510692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095cd1b0 0x5565095e1de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 --2- 172.21.15.81:0/1615510692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095c56a0 0x5565095e5b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 --2- 172.21.15.81:0/1615510692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095a25f0 0x5565095e5630 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 -- 172.21.15.81:0/1615510692 >> 172.21.15.81:0/1615510692 conn(0x5565095d0fd0 msgr2=0x5565095cd590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 -- 172.21.15.81:0/1615510692 shutdown_connections 2024-09-17T05:21:51.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 -- 172.21.15.81:0/1615510692 wait complete. 2024-09-17T05:21:51.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 -- start start 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.986+0000 7f022cabd740 1 Processor -- start 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095e5630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f022cabd740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095e5b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f022cabd740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x55650966ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f022cabd740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5565095cfc30 con 0x5565095c56a0 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5565095c63f0 con 0x5565095a25f0 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f022cabd740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5565095d0230 con 0x5565095cd1b0 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f022cabd740 10 client.0 _ll_register_callbacks cb 0x7f021c006ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095e5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095e5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47788/0 (socket says 172.21.15.81:47788) 2024-09-17T05:21:51.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 -- 172.21.15.81:0/3559005593 learned_addr learned my addr 172.21.15.81:0/3559005593 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 -- 172.21.15.81:0/3559005593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 msgr2=0x55650966ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x55650966ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 -- 172.21.15.81:0/3559005593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 msgr2=0x5565095e5630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095e5630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 -- 172.21.15.81:0/3559005593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565095eef80 con 0x5565095c56a0 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f0222ffd640 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095e5b70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0218000c00 tx=0x7f02240b3d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d170b9463967c78e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.987+0000 7f02027fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02027fc640 1 -- 172.21.15.81:0/3559005593 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f021801f400 con 0x5565095c56a0 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02027fc640 1 -- 172.21.15.81:0/3559005593 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f02180258a0 con 0x5565095c56a0 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0214091070 con 0x5565095c56a0 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02027fc640 1 -- 172.21.15.81:0/3559005593 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f021802f050 con 0x5565095c56a0 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 10 client.5931 fetch_fsmap learned FSMap version 31 2024-09-17T05:21:51.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=2+}) -- 0x5565095fbdf0 con 0x5565095c56a0 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02027fc640 1 -- 172.21.15.81:0/3559005593 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0214091070 con 0x5565095c56a0 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02027fc640 1 -- 172.21.15.81:0/3559005593 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 31) ==== 3502+0+0 (secure 0 0 0) 0x7f0218032020 con 0x5565095c56a0 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 10 client.5931 fetch_fsmap finished waiting for FSMap version 31 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 10 client.5931 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 20 client.5931 populate_metadata read hostname 'smithi081' 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095ecdf0 0x5565095cb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 4 client.5931 mds_command: new command op to 5757 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 --> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] -- command(tid 0: {"prefix": "status"}) -- 0x556509517220 con 0x5565095ecdf0 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02237fe640 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095ecdf0 0x5565095cb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02027fc640 10 client.5931 ms_handle_connect on v2:172.21.15.81:6833/1068882112 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.988+0000 7f02237fe640 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095ecdf0 0x5565095cb540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a27b40c809c9c5ab server_cookie=c2ea326e2f86c6c in_seq=0 out_seq=0 2024-09-17T05:21:51.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f02027fc640 1 -- 172.21.15.81:0/3559005593 <== mds.0 v2:172.21.15.81:6833/1068882112 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x556509517220 con 0x5565095ecdf0 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f02027fc640 10 client.5931 handle_command_reply: tid=0 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 client.5931 shutdown 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 msgr2=0x5565095e5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095e5b70 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f0218000c00 tx=0x7f02240b3d80 comp rx=0 tx=0).stop 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 shutdown_connections 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:6833/1068882112,v1:172.21.15.81:6835/1068882112] conn(0x5565095ecdf0 0x5565095cb540 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5565095cd1b0 0x55650966ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5565095c56a0 0x5565095e5b70 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f02027fc640 0 client.5931 ms_handle_reset on v2:172.21.15.81:6833/1068882112 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 --2- 172.21.15.81:0/3559005593 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5565095a25f0 0x5565095e5630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 >> 172.21.15.81:0/3559005593 conn(0x5565095d0fd0 msgr2=0x5565095a1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:51.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 shutdown_connections 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 1 -- 172.21.15.81:0/3559005593 wait complete. 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f022cabd740 20 client.5931 trim_cache size 0 max 16384 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5757, 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:21:51.997 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:21:51.998 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 10.029543888999999, 2024-09-17T05:21:51.998 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 31, 2024-09-17T05:21:51.998 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 58, 2024-09-17T05:21:51.998 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 58, 2024-09-17T05:21:51.998 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.759648815 2024-09-17T05:21:51.998 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0210078d40 msgr2=0x7f021007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0210078d40 0x7f021007b200 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f0218001220 tx=0x7f0218006720 comp rx=0 tx=0).stop 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 msgr2=0x7f02241f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f02241f1f10 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f0214009e20 tx=0x7f0214033670 comp rx=0 tx=0).stop 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 shutdown_connections 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0210078d40 0x7f021007b200 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0224152d70 0x7f0224153200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:51.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02241e31a0 0x7f02241e3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 --2- 172.21.15.81:0/1739940481 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f020c003a50 0x7f02241f1f10 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.989+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 >> 172.21.15.81:0/1739940481 conn(0x7f02240b1690 msgr2=0x7f022415da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:52.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.990+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 shutdown_connections 2024-09-17T05:21:52.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:51.990+0000 7f0229cef640 1 -- 172.21.15.81:0/1739940481 wait complete. 2024-09-17T05:21:52.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:21:52.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 -- 172.21.15.81:0/313170468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a1815df90 msgr2=0x7f6a180cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 --2- 172.21.15.81:0/313170468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a1815df90 0x7f6a180cf9b0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f6a08009830 tx=0x7f6a0802a510 comp rx=0 tx=0).stop 2024-09-17T05:21:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 -- 172.21.15.81:0/313170468 shutdown_connections 2024-09-17T05:21:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 --2- 172.21.15.81:0/313170468 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a180d0d40 0x7f6a180b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 --2- 172.21.15.81:0/313170468 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a1815df90 0x7f6a180cf9b0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 -- 172.21.15.81:0/313170468 >> 172.21.15.81:0/313170468 conn(0x7f6a180d3ea0 msgr2=0x7f6a180d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 -- 172.21.15.81:0/313170468 shutdown_connections 2024-09-17T05:21:52.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.103+0000 7f6a1c982640 1 -- 172.21.15.81:0/313170468 wait complete. 2024-09-17T05:21:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.104+0000 7f6a1c982640 1 Processor -- start 2024-09-17T05:21:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1c982640 1 -- start start 2024-09-17T05:21:52.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1c982640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a180d0d40 0x7f6a181f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1c982640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a180d49c0 0x7f6a180b6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1c982640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a1815df90 0x7f6a1815c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1c982640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6a180b3d40 con 0x7f6a180d0d40 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1c982640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6a18162710 con 0x7f6a180d49c0 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1c982640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6a180b3ec0 con 0x7f6a1815df90 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a180d0d40 0x7f6a181f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a180d0d40 0x7f6a181f8200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47790/0 (socket says 172.21.15.81:47790) 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a1659c640 1 -- 172.21.15.81:0/4034762552 learned_addr learned my addr 172.21.15.81:0/4034762552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a16d9d640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a1815df90 0x7f6a1815c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.105+0000 7f6a15d9b640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a180d49c0 0x7f6a180b6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1659c640 1 -- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a1815df90 msgr2=0x7f6a1815c550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1659c640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a1815df90 0x7f6a1815c550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1659c640 1 -- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a180d49c0 msgr2=0x7f6a180b6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1659c640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a180d49c0 0x7f6a180b6cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1659c640 1 -- 172.21.15.81:0/4034762552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a181f4d20 con 0x7f6a180d0d40 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1659c640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a180d0d40 0x7f6a181f8200 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6a08000c00 tx=0x7f6a08033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a06ffd640 1 -- 172.21.15.81:0/4034762552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08031d60 con 0x7f6a180d0d40 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a06ffd640 1 -- 172.21.15.81:0/4034762552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6a08033e10 con 0x7f6a180d0d40 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a181f87e0 con 0x7f6a180d0d40 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a06ffd640 1 -- 172.21.15.81:0/4034762552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a08033310 con 0x7f6a180d0d40 2024-09-17T05:21:52.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.106+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a181f8da0 con 0x7f6a180d0d40 2024-09-17T05:21:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.107+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a180cd4e0 con 0x7f6a180d0d40 2024-09-17T05:21:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.108+0000 7f6a06ffd640 1 -- 172.21.15.81:0/4034762552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f6a080334b0 con 0x7f6a180d0d40 2024-09-17T05:21:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.108+0000 7f6a06ffd640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f69f8078d40 0x7f69f807b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:52.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.108+0000 7f6a06ffd640 1 -- 172.21.15.81:0/4034762552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f6a080bc2c0 con 0x7f6a180d0d40 2024-09-17T05:21:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.108+0000 7f6a15d9b640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f69f8078d40 0x7f69f807b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:52.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.109+0000 7f6a15d9b640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f69f8078d40 0x7f69f807b200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a181ebd00 tx=0x7f6a0c007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:52.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.112+0000 7f6a06ffd640 1 -- 172.21.15.81:0/4034762552 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6a0803f030 con 0x7f6a180d0d40 2024-09-17T05:21:52.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.326+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f6a180b54c0 con 0x7f6a180d0d40 2024-09-17T05:21:52.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.326+0000 7f6a06ffd640 1 -- 172.21.15.81:0/4034762552 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) ==== 53+0+73 (secure 0 0 0) 0x7f6a08083db0 con 0x7f6a180d0d40 2024-09-17T05:21:52.327 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:21:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f69f8078d40 msgr2=0x7f69f807b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f69f8078d40 0x7f69f807b200 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6a181ebd00 tx=0x7f6a0c007e90 comp rx=0 tx=0).stop 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a180d0d40 msgr2=0x7f6a181f8200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a180d0d40 0x7f6a181f8200 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f6a08000c00 tx=0x7f6a08033c20 comp rx=0 tx=0).stop 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 shutdown_connections 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f69f8078d40 0x7f69f807b200 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6a1815df90 0x7f6a1815c550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6a180d49c0 0x7f6a180b6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 --2- 172.21.15.81:0/4034762552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6a180d0d40 0x7f6a181f8200 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 >> 172.21.15.81:0/4034762552 conn(0x7f6a180d3ea0 msgr2=0x7f6a180b0a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 shutdown_connections 2024-09-17T05:21:52.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52.328+0000 7f6a1c982640 1 -- 172.21.15.81:0/4034762552 wait complete. 2024-09-17T05:21:52.340 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:21:52.340 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:21:52.340 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:21:52.340 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:21:52.340 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:21:52.340 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:21:52.340 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:21:52.341 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:21:52.341 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:21:52.341 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:52.341 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:21:52.357 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:21:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:21:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:21:52.357 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:21:52.358 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42605sec preferred_lft 42605sec 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:21:52.359 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:21:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:21:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:52.360 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:21:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:21:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:21:52.360 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:52.360 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:52.360 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:21:52.421 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:21:52.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:52.423 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:21:52.479 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:21:52.479 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:21:52.479 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:21:52.479 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:21:52.479 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:21:52.480 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:21:52.480 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:21:52.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:21:52.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:21:52.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:21:52.481 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:21:52.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:21:52.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:21:52.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:52.603 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:21:52.618 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:21:52.618 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:21:52.619 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:21:52.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:52.619 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:21:52.683 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:21:52.683 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:21:52.684 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:21:52.739 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:21:52.739 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:21:52.739 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:21:52.793 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:21:52.859 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:21:52.915 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:21:52.915 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:21:52.915 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:21:52.915 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:21:52.915 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:21:52.915 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:21:52.916 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:21:52.917 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:21:52.918 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:21:52.918 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:21:52.918 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:21:52.918 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:21:52.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:52.918 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:21:52.971 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:21:52.971 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:21:53.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:21:53.038 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:21:53.095 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:21:53.095 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:21:53.095 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:21:53.096 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:21:53.097 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:21:53.098 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:21:53.099 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:53.099 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:21:53.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:21:53.095+0000 7f8a9e927480 -1 init, newargv = 0x559ca4ce0630 newargc=15 2024-09-17T05:21:53.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[55376]: starting ceph client 2024-09-17T05:21:53.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[55376]: starting fuse 2024-09-17T05:21:53.115 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:21:53.115 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:21:53.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:21:53.115 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:21:53.115 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:21:53.115 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:21:53.115 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:21:53.115 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:21:53.116 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:21:53.117 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:21:53.233 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.55376.asok 2024-09-17T05:21:53.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:21:53.243 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.55376.asok 2024-09-17T05:21:53.243 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:53.243 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.55376.asok status 2024-09-17T05:21:53.378 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:21:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:21:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:21:53.378 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "55376", 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 5940, 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:21:53.379 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 5940 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1917487750 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:53.380 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1917487750 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.5940 192.168.0.1:0/1917487750", 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/1917487750", 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 31, 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 58, 2024-09-17T05:21:53.381 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:21:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:21:53.382 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:21:53.382 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:21:53.386 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:53.386 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:21:53.387 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:21:53.402 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:21:53.402 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:21:53.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:53.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:21:53.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.608+0000 7f332887f640 1 -- 172.21.15.81:0/384421176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3310003a00 msgr2=0x7f3310003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.608+0000 7f332887f640 1 --2- 172.21.15.81:0/384421176 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3310003a00 0x7f3310003e20 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f3314009b50 tx=0x7f3310005830 comp rx=0 tx=0).stop 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.608+0000 7f3322d9d640 1 -- 172.21.15.81:0/384421176 reap_dead start 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.608+0000 7f332887f640 1 -- 172.21.15.81:0/384421176 shutdown_connections 2024-09-17T05:21:53.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.608+0000 7f332887f640 1 -- 172.21.15.81:0/384421176 >> 172.21.15.81:0/384421176 conn(0x7f33240b1690 msgr2=0x7f33240b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.608+0000 7f332887f640 1 -- 172.21.15.81:0/384421176 shutdown_connections 2024-09-17T05:21:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.608+0000 7f332887f640 1 -- 172.21.15.81:0/384421176 wait complete. 2024-09-17T05:21:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.609+0000 7f332887f640 1 Processor -- start 2024-09-17T05:21:53.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.609+0000 7f332887f640 1 -- start start 2024-09-17T05:21:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f332887f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3310003a00 0x7f3324150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f332887f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33240b44a0 0x7f33241f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f332887f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33241f4870 0x7f33241f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f332887f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f33240cca80 con 0x7f33240b44a0 2024-09-17T05:21:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f332887f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f33240cc900 con 0x7f33241f4870 2024-09-17T05:21:53.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f332887f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f33240ccc00 con 0x7f3310003a00 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33240b44a0 0x7f33241f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33240b44a0 0x7f33241f4330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44328/0 (socket says 172.21.15.81:44328) 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 -- 172.21.15.81:0/2134642455 learned_addr learned my addr 172.21.15.81:0/2134642455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 -- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3310003a00 msgr2=0x7f3324150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3310003a00 0x7f3324150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 -- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33241f4870 msgr2=0x7f33241f4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33241f4870 0x7f33241f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 -- 172.21.15.81:0/2134642455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3324150da0 con 0x7f33240b44a0 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.610+0000 7f331bfff640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33240b44a0 0x7f33241f4330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f330c001160 tx=0x7f330c00ea90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.611+0000 7f331affd640 1 -- 172.21.15.81:0/2134642455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c015070 con 0x7f33240b44a0 2024-09-17T05:21:53.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.611+0000 7f331affd640 1 -- 172.21.15.81:0/2134642455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f330c00c9e0 con 0x7f33240b44a0 2024-09-17T05:21:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.611+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3324151080 con 0x7f33240b44a0 2024-09-17T05:21:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.611+0000 7f331affd640 1 -- 172.21.15.81:0/2134642455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f330c00ce30 con 0x7f33240b44a0 2024-09-17T05:21:53.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.611+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3324151640 con 0x7f33240b44a0 2024-09-17T05:21:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.612+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f332415d270 con 0x7f33240b44a0 2024-09-17T05:21:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.612+0000 7f331affd640 1 -- 172.21.15.81:0/2134642455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f330c018070 con 0x7f33240b44a0 2024-09-17T05:21:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.613+0000 7f331affd640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3304078d70 0x7f330407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.613+0000 7f331affd640 1 -- 172.21.15.81:0/2134642455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f330c09b440 con 0x7f33240b44a0 2024-09-17T05:21:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.613+0000 7f332259c640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3304078d70 0x7f330407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:53.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.613+0000 7f332259c640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3304078d70 0x7f330407b230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3314035000 tx=0x7f3314004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:53.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.617+0000 7f331affd640 1 -- 172.21.15.81:0/2134642455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f330c063610 con 0x7f33240b44a0 2024-09-17T05:21:53.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.830+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f33240b1260 con 0x7f33240b44a0 2024-09-17T05:21:53.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.831+0000 7f331affd640 1 -- 172.21.15.81:0/2134642455 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v31) ==== 53+0+73 (secure 0 0 0) 0x7f330c062f10 con 0x7f33240b44a0 2024-09-17T05:21:53.832 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3304078d70 msgr2=0x7f330407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3304078d70 0x7f330407b230 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3314035000 tx=0x7f3314004730 comp rx=0 tx=0).stop 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33240b44a0 msgr2=0x7f33241f4330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33240b44a0 0x7f33241f4330 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f330c001160 tx=0x7f330c00ea90 comp rx=0 tx=0).stop 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 shutdown_connections 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3304078d70 0x7f330407b230 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f33241f4870 0x7f33241f4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f33240b44a0 0x7f33241f4330 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 --2- 172.21.15.81:0/2134642455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3310003a00 0x7f3324150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:53.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 >> 172.21.15.81:0/2134642455 conn(0x7f33240b1690 msgr2=0x7f33240cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:53.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 shutdown_connections 2024-09-17T05:21:53.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:53.833+0000 7f332887f640 1 -- 172.21.15.81:0/2134642455 wait complete. 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:21:53.845 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:21:53.846 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:53.846 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:21:53.866 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:21:53.866 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:21:53.866 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:21:53.866 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:53.866 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:53.867 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42601sec preferred_lft 42601sec 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:21:53.868 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:21:53.869 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:21:53.869 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:53.869 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:21:53.869 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:21:53.869 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:21:53.869 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:21:53.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:53.869 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:21:53.934 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:21:53.935 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:53.936 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:21:53.994 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:21:53.995 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:21:53.995 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:21:53.995 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:21:53.995 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:21:53.995 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:21:53.995 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:21:54.088 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:21:54 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:21:54.121 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:21:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:21:54.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:54.127 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:21:54.143 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:21:54.143 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:21:54.144 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:21:54.144 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:54.144 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:21:54.208 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:21:54.208 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:21:54.208 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:21:54.264 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:21:54.264 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:21:54.264 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:21:54.319 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:21:54.385 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:21:54.441 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:21:54.442 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:21:54.443 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:21:54.444 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:21:54.445 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:21:54.445 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:21:54.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:54.445 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:21:54.496 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:21:54.497 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:21:54.539 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:21:54.563 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:21:54.620 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:21:54.621 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:21:54.622 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:21:54.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:54.623 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:21:54.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:21:54.620+0000 7f368e9dd480 -1 init, newargv = 0x55636d0bc7c0 newargc=15 2024-09-17T05:21:54.624 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[45368]: starting ceph client 2024-09-17T05:21:54.625 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[45368]: starting fuse 2024-09-17T05:21:54.639 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:21:54.640 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:21:54.640 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:21:54.640 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:21:54.640 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:21:54.640 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:21:54.640 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:21:54.640 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:21:54.640 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:21:54.641 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:21:54.642 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:21:54.757 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.45368.asok 2024-09-17T05:21:54.760 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:21:54 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:21:54.767 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.45368.asok 2024-09-17T05:21:54.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:54.767 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.45368.asok status 2024-09-17T05:21:54.900 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "45368", 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:21:54.901 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 5324, 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 5324 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 117639599 2024-09-17T05:21:54.902 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 117639599 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.5324 192.168.0.1:0/117639599", 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/117639599", 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 31, 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 58, 2024-09-17T05:21:54.903 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:21:54.904 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:21:54.904 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:21:54.904 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:21:54.909 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:54.909 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:21:54.909 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:21:54.925 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:21:54.925 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:21:54.926 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:54.926 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:21:54.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:21:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 -- 172.21.15.81:0/2998861879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe40b11f0 msgr2=0x7fdbe415be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2998861879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe40b11f0 0x7fdbe415be90 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40cf710 tx=0x7fdbdc02a4a0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 -- 172.21.15.81:0/2998861879 shutdown_connections 2024-09-17T05:21:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2998861879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe40b11f0 0x7fdbe415be90 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2998861879 >> v2:172.21.15.160:3300/0 conn(0x7fdbe415bab0 0x7fdbe40cf7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 -- 172.21.15.81:0/2998861879 >> 172.21.15.81:0/2998861879 conn(0x7fdbe409aa30 msgr2=0x7fdbe409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 -- 172.21.15.81:0/2998861879 shutdown_connections 2024-09-17T05:21:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.108+0000 7fdbe959b640 1 -- 172.21.15.81:0/2998861879 wait complete. 2024-09-17T05:21:55.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 Processor -- start 2024-09-17T05:21:55.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 -- start start 2024-09-17T05:21:55.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbe40b11f0 0x7fdbe415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe40b18c0 0x7fdbe40b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe415bab0 0x7fdbe41f2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe415c760 con 0x7fdbe415bab0 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe415c5e0 con 0x7fdbe40b18c0 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe959b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe415c8e0 con 0x7fdbe40b11f0 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe415bab0 0x7fdbe41f2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe415bab0 0x7fdbe41f2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44340/0 (socket says 172.21.15.81:44340) 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.110+0000 7fdbe37fe640 1 -- 172.21.15.81:0/2122871786 learned_addr learned my addr 172.21.15.81:0/2122871786 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe2ffd640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbe40b11f0 0x7fdbe415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe27fc640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe40b18c0 0x7fdbe40b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe37fe640 1 -- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbe40b11f0 msgr2=0x7fdbe415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe37fe640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbe40b11f0 0x7fdbe415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe37fe640 1 -- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe40b18c0 msgr2=0x7fdbe40b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe37fe640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe40b18c0 0x7fdbe40b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe37fe640 1 -- 172.21.15.81:0/2122871786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe40cbad0 con 0x7fdbe415bab0 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe37fe640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe415bab0 0x7fdbe41f2ce0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009920 tx=0x7fdbdc032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbdb7fe640 1 -- 172.21.15.81:0/2122871786 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc040070 con 0x7fdbe415bab0 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbdb7fe640 1 -- 172.21.15.81:0/2122871786 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbdc005330 con 0x7fdbe415bab0 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbdb7fe640 1 -- 172.21.15.81:0/2122871786 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbdc0047a0 con 0x7fdbe415bab0 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe40cbdb0 con 0x7fdbe415bab0 2024-09-17T05:21:55.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.111+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe41f21d0 con 0x7fdbe415bab0 2024-09-17T05:21:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.112+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbe415ce00 con 0x7fdbe415bab0 2024-09-17T05:21:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.113+0000 7fdbdb7fe640 1 -- 172.21.15.81:0/2122871786 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fdbdc039040 con 0x7fdbe415bab0 2024-09-17T05:21:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.113+0000 7fdbdb7fe640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdbc4078d40 0x7fdbc407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.114+0000 7fdbdb7fe640 1 -- 172.21.15.81:0/2122871786 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fdbdc0bc060 con 0x7fdbe415bab0 2024-09-17T05:21:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.114+0000 7fdbe2ffd640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdbc4078d40 0x7fdbc407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:55.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.114+0000 7fdbe2ffd640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdbc4078d40 0x7fdbc407b200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40b51b0 tx=0x7fdbd40095e0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:55.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.118+0000 7fdbdb7fe640 1 -- 172.21.15.81:0/2122871786 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdbdc083be0 con 0x7fdbe415bab0 2024-09-17T05:21:55.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:55.331+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fdbe40cf010 con 0x7fdbe415bab0 2024-09-17T05:21:56.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.008+0000 7fdbdb7fe640 1 -- 172.21.15.81:0/2122871786 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v32) ==== 136+0+0 (secure 0 0 0) 0x7fdbdc088610 con 0x7fdbe415bab0 2024-09-17T05:21:56.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdbc4078d40 msgr2=0x7fdbc407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdbc4078d40 0x7fdbc407b200 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fdbe40b51b0 tx=0x7fdbd40095e0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe415bab0 msgr2=0x7fdbe41f2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe415bab0 0x7fdbe41f2ce0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fdbdc009920 tx=0x7fdbdc032b90 comp rx=0 tx=0).stop 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 shutdown_connections 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdbc4078d40 0x7fdbc407b200 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbe415bab0 0x7fdbe41f2ce0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbe40b18c0 0x7fdbe40b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 --2- 172.21.15.81:0/2122871786 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbe40b11f0 0x7fdbe415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 >> 172.21.15.81:0/2122871786 conn(0x7fdbe409aa30 msgr2=0x7fdbe40b07d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 shutdown_connections 2024-09-17T05:21:56.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.011+0000 7fdbe959b640 1 -- 172.21.15.81:0/2122871786 wait complete. 2024-09-17T05:21:56.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:21:56.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.131+0000 7fa2a3f89640 1 -- 172.21.15.81:0/413208859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 msgr2=0x7fa2880051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.131+0000 7fa2a3f89640 1 --2- 172.21.15.81:0/413208859 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 0x7fa2880051c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0727e0 tx=0x7fa288005830 comp rx=0 tx=0).stop 2024-09-17T05:21:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.131+0000 7fa2a2526640 1 -- 172.21.15.81:0/413208859 reap_dead start 2024-09-17T05:21:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.131+0000 7fa2a3f89640 1 -- 172.21.15.81:0/413208859 shutdown_connections 2024-09-17T05:21:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.131+0000 7fa2a3f89640 1 -- 172.21.15.81:0/413208859 >> 172.21.15.81:0/413208859 conn(0x7fa29c0b1690 msgr2=0x7fa29c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.131+0000 7fa2a3f89640 1 -- 172.21.15.81:0/413208859 shutdown_connections 2024-09-17T05:21:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.131+0000 7fa2a3f89640 1 -- 172.21.15.81:0/413208859 wait complete. 2024-09-17T05:21:56.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.132+0000 7fa2a3f89640 1 Processor -- start 2024-09-17T05:21:56.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.132+0000 7fa2a3f89640 1 -- start start 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a3f89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 0x7fa29c153870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a3f89640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa29c159690 0x7fa29c0ab060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a3f89640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa29c159b10 0x7fa29c0ab5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a3f89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c0739a0 con 0x7fa288004d40 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a3f89640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa29c0cdb30 con 0x7fa29c159690 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a3f89640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa29c073b20 con 0x7fa29c159b10 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a1d25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 0x7fa29c153870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a1d25640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 0x7fa29c153870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44370/0 (socket says 172.21.15.81:44370) 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.133+0000 7fa2a1d25640 1 -- 172.21.15.81:0/559441934 learned_addr learned my addr 172.21.15.81:0/559441934 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:56.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1524640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa29c159690 0x7fa29c0ab060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a2526640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa29c159b10 0x7fa29c0ab5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1d25640 1 -- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa29c159b10 msgr2=0x7fa29c0ab5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1d25640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa29c159b10 0x7fa29c0ab5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1d25640 1 -- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa29c159690 msgr2=0x7fa29c0ab060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1d25640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa29c159690 0x7fa29c0ab060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1d25640 1 -- 172.21.15.81:0/559441934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa29c156f30 con 0x7fa288004d40 2024-09-17T05:21:56.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a2526640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa29c159b10 0x7fa29c0ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1524640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa29c159690 0x7fa29c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a1d25640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 0x7fa29c153870 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa298011820 tx=0x7fa298011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2927fc640 1 -- 172.21.15.81:0/559441934 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29800fd50 con 0x7fa288004d40 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2927fc640 1 -- 172.21.15.81:0/559441934 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa298016070 con 0x7fa288004d40 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa29c153db0 con 0x7fa288004d40 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2927fc640 1 -- 172.21.15.81:0/559441934 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa298012690 con 0x7fa288004d40 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.134+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa29c0adea0 con 0x7fa288004d40 2024-09-17T05:21:56.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.135+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa29c0ccee0 con 0x7fa288004d40 2024-09-17T05:21:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.136+0000 7fa2927fc640 1 -- 172.21.15.81:0/559441934 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fa298018030 con 0x7fa288004d40 2024-09-17T05:21:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.136+0000 7fa2927fc640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa280078d40 0x7fa28007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.136+0000 7fa2927fc640 1 -- 172.21.15.81:0/559441934 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fa29809b960 con 0x7fa288004d40 2024-09-17T05:21:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.137+0000 7fa2a1524640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa280078d40 0x7fa28007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.137+0000 7fa2a1524640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa280078d40 0x7fa28007b200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0d0690 tx=0x7fa28c006b70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.140+0000 7fa2927fc640 1 -- 172.21.15.81:0/559441934 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa298063aa0 con 0x7fa288004d40 2024-09-17T05:21:56.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.337+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fa29c0a98b0 con 0x7fa280078d40 2024-09-17T05:21:56.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.339+0000 7fa2927fc640 1 -- 172.21.15.81:0/559441934 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fa29c0a98b0 con 0x7fa280078d40 2024-09-17T05:21:56.340 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:21:56.340 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:21:56.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:21:56.340 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:21:56.340 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:21:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa280078d40 msgr2=0x7fa28007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa280078d40 0x7fa28007b200 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0d0690 tx=0x7fa28c006b70 comp rx=0 tx=0).stop 2024-09-17T05:21:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 msgr2=0x7fa29c153870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 0x7fa29c153870 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fa298011820 tx=0x7fa298011ce0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 shutdown_connections 2024-09-17T05:21:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa280078d40 0x7fa28007b200 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa29c159b10 0x7fa29c0ab5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa29c159690 0x7fa29c0ab060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 --2- 172.21.15.81:0/559441934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa288004d40 0x7fa29c153870 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 >> 172.21.15.81:0/559441934 conn(0x7fa29c0b1690 msgr2=0x7fa29c15d4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 shutdown_connections 2024-09-17T05:21:56.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.341+0000 7fa2a3f89640 1 -- 172.21.15.81:0/559441934 wait complete. 2024-09-17T05:21:56.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:21:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.456+0000 7f146fc60640 1 -- 172.21.15.81:0/1225615237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 msgr2=0x7f1450004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.456+0000 7f146fc60640 1 --2- 172.21.15.81:0/1225615237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 0x7f1450004800 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f145800c630 tx=0x7f1450005830 comp rx=0 tx=0).stop 2024-09-17T05:21:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.456+0000 7f146e1fd640 1 -- 172.21.15.81:0/1225615237 reap_dead start 2024-09-17T05:21:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.456+0000 7f146fc60640 1 -- 172.21.15.81:0/1225615237 shutdown_connections 2024-09-17T05:21:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.456+0000 7f146fc60640 1 -- 172.21.15.81:0/1225615237 >> 172.21.15.81:0/1225615237 conn(0x7f14680b1700 msgr2=0x7f14680b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.457+0000 7f146fc60640 1 -- 172.21.15.81:0/1225615237 shutdown_connections 2024-09-17T05:21:56.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.457+0000 7f146fc60640 1 -- 172.21.15.81:0/1225615237 wait complete. 2024-09-17T05:21:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.458+0000 7f146fc60640 1 Processor -- start 2024-09-17T05:21:56.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.458+0000 7f146fc60640 1 -- start start 2024-09-17T05:21:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.458+0000 7f146fc60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 0x7f1468147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146fc60640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14680c7c50 0x7f14680c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146fc60640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14680b4a20 0x7f14680b4ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146fc60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14680cc730 con 0x7f1450003fd0 2024-09-17T05:21:56.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146fc60640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14680cc5b0 con 0x7f14680c7c50 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146fc60640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f14680cc8b0 con 0x7f14680b4a20 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 0x7f1468147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 0x7f1468147fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44384/0 (socket says 172.21.15.81:44384) 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 -- 172.21.15.81:0/992250189 learned_addr learned my addr 172.21.15.81:0/992250189 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146e1fd640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14680b4a20 0x7f14680b4ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d1fb640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14680c7c50 0x7f14680c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 -- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14680b4a20 msgr2=0x7f14680b4ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14680b4a20 0x7f14680b4ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 -- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14680c7c50 msgr2=0x7f14680c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14680c7c50 0x7f14680c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 -- 172.21.15.81:0/992250189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14680c9500 con 0x7f1450003fd0 2024-09-17T05:21:56.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d1fb640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14680c7c50 0x7f14680c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146d9fc640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 0x7f1468147fc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f145c011a00 tx=0x7f145c011ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f14667fc640 1 -- 172.21.15.81:0/992250189 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c00fcf0 con 0x7f1450003fd0 2024-09-17T05:21:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f14667fc640 1 -- 172.21.15.81:0/992250189 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f145c016070 con 0x7f1450003fd0 2024-09-17T05:21:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14680c87c0 con 0x7f1450003fd0 2024-09-17T05:21:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f14667fc640 1 -- 172.21.15.81:0/992250189 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f145c012690 con 0x7f1450003fd0 2024-09-17T05:21:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.459+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14680b2a00 con 0x7f1450003fd0 2024-09-17T05:21:56.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.460+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1468072b50 con 0x7f1450003fd0 2024-09-17T05:21:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.461+0000 7f14667fc640 1 -- 172.21.15.81:0/992250189 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7f145c018030 con 0x7f1450003fd0 2024-09-17T05:21:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.462+0000 7f14667fc640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1454078d70 0x7f145407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.462+0000 7f14667fc640 1 -- 172.21.15.81:0/992250189 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f145c09b820 con 0x7f1450003fd0 2024-09-17T05:21:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.462+0000 7f146d1fb640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1454078d70 0x7f145407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.463+0000 7f146d1fb640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1454078d70 0x7f145407b230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1458033000 tx=0x7f1458001e40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.466+0000 7f14667fc640 1 -- 172.21.15.81:0/992250189 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f145c063310 con 0x7f1450003fd0 2024-09-17T05:21:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.641+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f146815c170 con 0x7f1450003fd0 2024-09-17T05:21:56.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.642+0000 7f14667fc640 1 -- 172.21.15.81:0/992250189 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v32)=0 v32) ==== 122+0+0 (secure 0 0 0) 0x7f145c067d40 con 0x7f1450003fd0 2024-09-17T05:21:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1454078d70 msgr2=0x7f145407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1454078d70 0x7f145407b230 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f1458033000 tx=0x7f1458001e40 comp rx=0 tx=0).stop 2024-09-17T05:21:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 msgr2=0x7f1468147fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 0x7f1468147fc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f145c011a00 tx=0x7f145c011ec0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 shutdown_connections 2024-09-17T05:21:56.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1454078d70 0x7f145407b230 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14680b4a20 0x7f14680b4ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14680c7c50 0x7f14680c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 --2- 172.21.15.81:0/992250189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1450003fd0 0x7f1468147fc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 >> 172.21.15.81:0/992250189 conn(0x7f14680b1700 msgr2=0x7f14680cb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 shutdown_connections 2024-09-17T05:21:56.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.644+0000 7f146fc60640 1 -- 172.21.15.81:0/992250189 wait complete. 2024-09-17T05:21:56.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:56.656 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol21380) 2024-09-17T05:21:56.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:56.688 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:21:56.745 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:21:56.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:56.746 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/_nogroup/subvol21380) 2024-09-17T05:21:56.815 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol30651 2024-09-17T05:21:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.957+0000 7fe2adced640 1 -- 172.21.15.81:0/1273151343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a80ccc50 msgr2=0x7fe2a806fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.957+0000 7fe2adced640 1 --2- 172.21.15.81:0/1273151343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a80ccc50 0x7fe2a806fb90 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7fe29c009830 tx=0x7fe29c02a510 comp rx=0 tx=0).stop 2024-09-17T05:21:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.957+0000 7fe2adced640 1 -- 172.21.15.81:0/1273151343 shutdown_connections 2024-09-17T05:21:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.957+0000 7fe2adced640 1 --2- 172.21.15.81:0/1273151343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a80ccc50 0x7fe2a806fb90 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.957+0000 7fe2adced640 1 -- 172.21.15.81:0/1273151343 >> 172.21.15.81:0/1273151343 conn(0x7fe2a80b1700 msgr2=0x7fe2a80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.957+0000 7fe2adced640 1 -- 172.21.15.81:0/1273151343 shutdown_connections 2024-09-17T05:21:56.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.957+0000 7fe2adced640 1 -- 172.21.15.81:0/1273151343 wait complete. 2024-09-17T05:21:56.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 Processor -- start 2024-09-17T05:21:56.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 -- start start 2024-09-17T05:21:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80ccc50 0x7fe2a81f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a8151e30 0x7fe2a80c94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a815b3d0 0x7fe2a80b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80cb240 con 0x7fe2a815b3d0 2024-09-17T05:21:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a80cb0c0 con 0x7fe2a8151e30 2024-09-17T05:21:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.959+0000 7fe2adced640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a80cb3c0 con 0x7fe2a80ccc50 2024-09-17T05:21:56.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a815b3d0 0x7fe2a80b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a815b3d0 0x7fe2a80b41f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44416/0 (socket says 172.21.15.81:44416) 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 -- 172.21.15.81:0/1949238853 learned_addr learned my addr 172.21.15.81:0/1949238853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a77fe640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80ccc50 0x7fe2a81f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a6ffd640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a8151e30 0x7fe2a80c94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 -- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80ccc50 msgr2=0x7fe2a81f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80ccc50 0x7fe2a81f2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 -- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a8151e30 msgr2=0x7fe2a80c94d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a8151e30 0x7fe2a80c94d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 -- 172.21.15.81:0/1949238853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a80b2b10 con 0x7fe2a815b3d0 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2a7fff640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a815b3d0 0x7fe2a80b41f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000b9a0 tx=0x7fe2a000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe28ffff640 1 -- 172.21.15.81:0/1949238853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a0019070 con 0x7fe2a815b3d0 2024-09-17T05:21:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe28ffff640 1 -- 172.21.15.81:0/1949238853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2a000cc90 con 0x7fe2a815b3d0 2024-09-17T05:21:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a80b2df0 con 0x7fe2a815b3d0 2024-09-17T05:21:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe28ffff640 1 -- 172.21.15.81:0/1949238853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2a00146a0 con 0x7fe2a815b3d0 2024-09-17T05:21:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.960+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a80b33b0 con 0x7fe2a815b3d0 2024-09-17T05:21:56.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.961+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a80cb870 con 0x7fe2a815b3d0 2024-09-17T05:21:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.962+0000 7fe28ffff640 1 -- 172.21.15.81:0/1949238853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 9) ==== 101594+0+0 (secure 0 0 0) 0x7fe2a001c070 con 0x7fe2a815b3d0 2024-09-17T05:21:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.962+0000 7fe28ffff640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe294078d70 0x7fe29407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.962+0000 7fe28ffff640 1 -- 172.21.15.81:0/1949238853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe2a009abe0 con 0x7fe2a815b3d0 2024-09-17T05:21:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.963+0000 7fe2a77fe640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe294078d70 0x7fe29407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:56.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.963+0000 7fe2a77fe640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe294078d70 0x7fe29407b230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe2980017c0 tx=0x7fe298007e90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:56.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:56.967+0000 7fe28ffff640 1 -- 172.21.15.81:0/1949238853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe2a0062780 con 0x7fe2a815b3d0 2024-09-17T05:21:57.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.169+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol30651", "target": ["mon-mgr", ""]}) -- 0x7fe2a80b1fa0 con 0x7fe294078d70 2024-09-17T05:21:57.175 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:21:57.175+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:21:57.175 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:21:57.175+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:21:57.176 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:21:57.175+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:21:57.176 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:21:57.175+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:21:57.176 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:21:57.175+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:21:57.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.209+0000 7fe28ffff640 1 -- 172.21.15.81:0/1949238853 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fe2a80b1fa0 con 0x7fe294078d70 2024-09-17T05:21:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe294078d70 msgr2=0x7fe29407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe294078d70 0x7fe29407b230 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7fe2980017c0 tx=0x7fe298007e90 comp rx=0 tx=0).stop 2024-09-17T05:21:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a815b3d0 msgr2=0x7fe2a80b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a815b3d0 0x7fe2a80b41f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fe2a000b9a0 tx=0x7fe2a000be60 comp rx=0 tx=0).stop 2024-09-17T05:21:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 shutdown_connections 2024-09-17T05:21:57.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe294078d70 0x7fe29407b230 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2a815b3d0 0x7fe2a80b41f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2a8151e30 0x7fe2a80c94d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 --2- 172.21.15.81:0/1949238853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2a80ccc50 0x7fe2a81f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 >> 172.21.15.81:0/1949238853 conn(0x7fe2a80b1700 msgr2=0x7fe2a80affe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 shutdown_connections 2024-09-17T05:21:57.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:57.211+0000 7fe2adced640 1 -- 172.21.15.81:0/1949238853 wait complete. 2024-09-17T05:21:57.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:57.223 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cp ./volumes/_nogroup/subvol30651/.meta ./volumes/_nogroup/subvol21380) 2024-09-17T05:21:58.242 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol21380 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 -- 172.21.15.81:0/2617078366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 msgr2=0x7f4cc00ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/2617078366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc00ccd20 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f4cc00740d0 tx=0x7f4cb002aac0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 -- 172.21.15.81:0/2617078366 shutdown_connections 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/2617078366 >> v2:172.21.15.160:3300/0 conn(0x7f4cc00cd260 0x7f4cc00cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/2617078366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc00ccd20 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 -- 172.21.15.81:0/2617078366 >> 172.21.15.81:0/2617078366 conn(0x7f4cc0074160 msgr2=0x7f4cc0074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 -- 172.21.15.81:0/2617078366 shutdown_connections 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.346+0000 7f4cc5bec640 1 -- 172.21.15.81:0/2617078366 wait complete. 2024-09-17T05:21:58.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.347+0000 7f4cc5bec640 1 Processor -- start 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.347+0000 7f4cc5bec640 1 -- start start 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cc5bec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cbd00 0x7f4cc01f0f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cc5bec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc00cd260 0x7f4cc015cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cc5bec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc01522d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cc5bec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00b1510 con 0x7f4cc015adb0 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cc5bec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00b1390 con 0x7f4cc00cd260 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cc5bec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc00b1690 con 0x7f4cc00cbd00 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cbffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc01522d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cbffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc01522d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44430/0 (socket says 172.21.15.81:44430) 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cbffff640 1 -- 172.21.15.81:0/3616931824 learned_addr learned my addr 172.21.15.81:0/3616931824 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cbeffd640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc00cd260 0x7f4cc015cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.348+0000 7f4cbf7fe640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cbd00 0x7f4cc01f0f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cbffff640 1 -- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cbd00 msgr2=0x7f4cc01f0f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cbffff640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cbd00 0x7f4cc01f0f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cbffff640 1 -- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc00cd260 msgr2=0x7f4cc015cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cbffff640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc00cd260 0x7f4cc015cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cbffff640 1 -- 172.21.15.81:0/3616931824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc006c740 con 0x7f4cc015adb0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cbeffd640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc00cd260 0x7f4cc015cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cbffff640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc01522d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c430 tx=0x7f4cb800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4ca7fff640 1 -- 172.21.15.81:0/3616931824 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8017070 con 0x7f4cc015adb0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4ca7fff640 1 -- 172.21.15.81:0/3616931824 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb80053e0 con 0x7f4cc015adb0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc015b610 con 0x7f4cc015adb0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4ca7fff640 1 -- 172.21.15.81:0/3616931824 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8003870 con 0x7f4cc015adb0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.349+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc015c8a0 con 0x7f4cc015adb0 2024-09-17T05:21:58.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.350+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc015caa0 con 0x7f4cc015adb0 2024-09-17T05:21:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.351+0000 7f4ca7fff640 1 -- 172.21.15.81:0/3616931824 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7f4cb801a070 con 0x7f4cc015adb0 2024-09-17T05:21:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.351+0000 7f4ca7fff640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cac078dd0 0x7f4cac07b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.351+0000 7f4ca7fff640 1 -- 172.21.15.81:0/3616931824 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f4cb809a570 con 0x7f4cc015adb0 2024-09-17T05:21:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.351+0000 7f4cbf7fe640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cac078dd0 0x7f4cac07b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.352+0000 7f4cbf7fe640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cac078dd0 0x7f4cac07b290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0035000 tx=0x7f4cb0004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.355+0000 7f4ca7fff640 1 -- 172.21.15.81:0/3616931824 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4cc015caa0 con 0x7f4cc015adb0 2024-09-17T05:21:58.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.557+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol21380", "target": ["mon-mgr", ""]}) -- 0x7f4cc015b7e0 con 0x7f4cac078dd0 2024-09-17T05:21:58.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.587+0000 7f4ca7fff640 1 -- 172.21.15.81:0/3616931824 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f4cb0003a70 con 0x7f4cac078dd0 2024-09-17T05:21:58.588 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol21380 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cac078dd0 msgr2=0x7f4cac07b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cac078dd0 0x7f4cac07b290 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0035000 tx=0x7f4cb0004ab0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 msgr2=0x7f4cc01522d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc01522d0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800c430 tx=0x7f4cb800c8f0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 shutdown_connections 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cac078dd0 0x7f4cac07b290 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc015adb0 0x7f4cc01522d0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc00cd260 0x7f4cc015cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 --2- 172.21.15.81:0/3616931824 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cbd00 0x7f4cc01f0f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 >> 172.21.15.81:0/3616931824 conn(0x7f4cc0074160 msgr2=0x7f4cc00ad160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.589+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 shutdown_connections 2024-09-17T05:21:58.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.590+0000 7f4cc5bec640 1 -- 172.21.15.81:0/3616931824 wait complete. 2024-09-17T05:21:58.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol21380 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.703+0000 7f85a0cb1640 1 -- 172.21.15.81:0/1218807634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c1617f0 msgr2=0x7f859c0d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.703+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/1218807634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c1617f0 0x7f859c0d1d30 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f859c0b69d0 tx=0x7f858c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.704+0000 7f85a0cb1640 1 -- 172.21.15.81:0/1218807634 shutdown_connections 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.704+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/1218807634 >> v2:172.21.15.160:3300/0 conn(0x7f859c0d01b0 0x7f859c0d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.704+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/1218807634 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c1617f0 0x7f859c0d1d30 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.704+0000 7f85a0cb1640 1 -- 172.21.15.81:0/1218807634 >> 172.21.15.81:0/1218807634 conn(0x7f859c0d3e30 msgr2=0x7f859c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.704+0000 7f85a0cb1640 1 -- 172.21.15.81:0/1218807634 shutdown_connections 2024-09-17T05:21:58.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.704+0000 7f85a0cb1640 1 -- 172.21.15.81:0/1218807634 wait complete. 2024-09-17T05:21:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.705+0000 7f85a0cb1640 1 Processor -- start 2024-09-17T05:21:58.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.705+0000 7f85a0cb1640 1 -- start start 2024-09-17T05:21:58.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f85a0cb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d01b0 0x7f859c0b0db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f85a0cb1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f859c0d27b0 0x7f859c09db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f85a0cb1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f859c1617f0 0x7f859c15fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f85a0cb1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0d0f50 con 0x7f859c0d01b0 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f85a0cb1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f859c0b5000 con 0x7f859c1617f0 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f85a0cb1640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f859c0d10d0 con 0x7f859c0d27b0 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d01b0 0x7f859c0b0db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d01b0 0x7f859c0b0db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:44448/0 (socket says 172.21.15.81:44448) 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 -- 172.21.15.81:0/3014769883 learned_addr learned my addr 172.21.15.81:0/3014769883 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859ad9d640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f859c1617f0 0x7f859c15fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f8591d9b640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f859c0d27b0 0x7f859c09db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 -- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f859c0d27b0 msgr2=0x7f859c09db30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f859c0d27b0 0x7f859c09db30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 -- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f859c1617f0 msgr2=0x7f859c15fdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f859c1617f0 0x7f859c15fdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 -- 172.21.15.81:0/3014769883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f859c1f4ad0 con 0x7f859c0d01b0 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859ad9d640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f859c1617f0 0x7f859c15fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.706+0000 7f859a59c640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d01b0 0x7f859c0b0db0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f858c034040 tx=0x7f858c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.707+0000 7f85937fe640 1 -- 172.21.15.81:0/3014769883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c03e030 con 0x7f859c0d01b0 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.707+0000 7f85937fe640 1 -- 172.21.15.81:0/3014769883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f858c003e00 con 0x7f859c0d01b0 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.707+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f859c1f4db0 con 0x7f859c0d01b0 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.707+0000 7f85937fe640 1 -- 172.21.15.81:0/3014769883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f858c035040 con 0x7f859c0d01b0 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.707+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f859c1f5370 con 0x7f859c0d01b0 2024-09-17T05:21:58.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.708+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f859c0d1610 con 0x7f859c0d01b0 2024-09-17T05:21:58.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.708+0000 7f85937fe640 1 -- 172.21.15.81:0/3014769883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7f858c041030 con 0x7f859c0d01b0 2024-09-17T05:21:58.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.709+0000 7f85937fe640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f857c078dd0 0x7f857c07b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:21:58.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.709+0000 7f85937fe640 1 -- 172.21.15.81:0/3014769883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f858c0bb7b0 con 0x7f859c0d01b0 2024-09-17T05:21:58.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.709+0000 7f8591d9b640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f857c078dd0 0x7f857c07b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:21:58.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.709+0000 7f8591d9b640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f857c078dd0 0x7f857c07b290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8584005fd0 tx=0x7f8584005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:21:58.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.713+0000 7f85937fe640 1 -- 172.21.15.81:0/3014769883 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f858c0838e0 con 0x7f859c0d01b0 2024-09-17T05:21:58.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.914+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol21380", "target": ["mon-mgr", ""]}) -- 0x7f859c0b3570 con 0x7f857c078dd0 2024-09-17T05:21:58.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.919+0000 7f85937fe640 1 -- 172.21.15.81:0/3014769883 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f859c0b3570 con 0x7f857c078dd0 2024-09-17T05:21:58.920 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol21380 2024-09-17T05:21:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f857c078dd0 msgr2=0x7f857c07b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f857c078dd0 0x7f857c07b290 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f8584005fd0 tx=0x7f8584005850 comp rx=0 tx=0).stop 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d01b0 msgr2=0x7f859c0b0db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d01b0 0x7f859c0b0db0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f858c034040 tx=0x7f858c003910 comp rx=0 tx=0).stop 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 shutdown_connections 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f857c078dd0 0x7f857c07b290 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f859c1617f0 0x7f859c15fdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f859c0d27b0 0x7f859c09db30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 --2- 172.21.15.81:0/3014769883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f859c0d01b0 0x7f859c0b0db0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 >> 172.21.15.81:0/3014769883 conn(0x7f859c0d3e30 msgr2=0x7f859c0b8c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 shutdown_connections 2024-09-17T05:21:58.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:21:58.921+0000 7f85a0cb1640 1 -- 172.21.15.81:0/3014769883 wait complete. 2024-09-17T05:21:58.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:21:58.933 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/fac1ebb8796401d327199973441ff759.meta) 2024-09-17T05:22:03.239 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:22:03.239 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:22:03.239 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:22:03.239 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol21380 2024-09-17T05:22:03.239 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:22:03.240 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:03.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume authorize cephfs subvol21380 alice 2024-09-17T05:22:03.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.356+0000 7fae9c0c6640 1 -- 172.21.15.81:0/3071566922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9406e4e0 msgr2=0x7fae940ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.356+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/3071566922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9406e4e0 0x7fae940ae6f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fae8400a940 tx=0x7fae8402b7b0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.356+0000 7fae9c0c6640 1 -- 172.21.15.81:0/3071566922 shutdown_connections 2024-09-17T05:22:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.356+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/3071566922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae9406e4e0 0x7fae940ae6f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.356+0000 7fae9c0c6640 1 -- 172.21.15.81:0/3071566922 >> 172.21.15.81:0/3071566922 conn(0x7fae940b1620 msgr2=0x7fae940b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.356+0000 7fae9c0c6640 1 -- 172.21.15.81:0/3071566922 shutdown_connections 2024-09-17T05:22:03.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.356+0000 7fae9c0c6640 1 -- 172.21.15.81:0/3071566922 wait complete. 2024-09-17T05:22:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.357+0000 7fae9c0c6640 1 Processor -- start 2024-09-17T05:22:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.357+0000 7fae9c0c6640 1 -- start start 2024-09-17T05:22:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae9c0c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae9406e4e0 0x7fae9413e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae9c0c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae94072610 0x7fae94159450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae9c0c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae94150ef0 0x7fae94159990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae9c0c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fae94072c20 con 0x7fae94072610 2024-09-17T05:22:03.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae9c0c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fae94072aa0 con 0x7fae9406e4e0 2024-09-17T05:22:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae9c0c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fae94072da0 con 0x7fae94150ef0 2024-09-17T05:22:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99661640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae94072610 0x7fae94159450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99661640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae94072610 0x7fae94159450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50602/0 (socket says 172.21.15.81:50602) 2024-09-17T05:22:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99661640 1 -- 172.21.15.81:0/2641846950 learned_addr learned my addr 172.21.15.81:0/2641846950 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99e62640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae9406e4e0 0x7fae9413e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae9a663640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae94150ef0 0x7fae94159990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99661640 1 -- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae94150ef0 msgr2=0x7fae94159990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99661640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae94150ef0 0x7fae94159990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99661640 1 -- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae9406e4e0 msgr2=0x7fae9413e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.358+0000 7fae99661640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae9406e4e0 0x7fae9413e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae99661640 1 -- 172.21.15.81:0/2641846950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae941f6c60 con 0x7fae94072610 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae99e62640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae9406e4e0 0x7fae9413e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae99661640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae94072610 0x7fae94159450 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fae84000c00 tx=0x7fae84004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae8a7fc640 1 -- 172.21.15.81:0/2641846950 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae84003a00 con 0x7fae94072610 2024-09-17T05:22:03.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae8a7fc640 1 -- 172.21.15.81:0/2641846950 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fae84003c90 con 0x7fae94072610 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae941f5ea0 con 0x7fae94072610 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae8a7fc640 1 -- 172.21.15.81:0/2641846950 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae8403c670 con 0x7fae94072610 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.359+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae941f6460 con 0x7fae94072610 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.360+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae940ae6f0 con 0x7fae94072610 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.361+0000 7fae8a7fc640 1 -- 172.21.15.81:0/2641846950 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7fae8403c810 con 0x7fae94072610 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.361+0000 7fae8a7fc640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fae78078dd0 0x7fae7807b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.361+0000 7fae8a7fc640 1 -- 172.21.15.81:0/2641846950 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fae840bc990 con 0x7fae94072610 2024-09-17T05:22:03.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.361+0000 7fae99e62640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fae78078dd0 0x7fae7807b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.362+0000 7fae99e62640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fae78078dd0 0x7fae7807b290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fae9406f8c0 tx=0x7fae90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.365+0000 7fae8a7fc640 1 -- 172.21.15.81:0/2641846950 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fae84040030 con 0x7fae94072610 2024-09-17T05:22:03.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.565+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume authorize", "vol_name": "cephfs", "sub_name": "subvol21380", "auth_id": "alice", "target": ["mon-mgr", ""]}) -- 0x7fae94070330 con 0x7fae78078dd0 2024-09-17T05:22:03.576 INFO:tasks.ceph.mgr.x.smithi160.stderr:Creating meta for ID alice with tenant None 2024-09-17T05:22:03.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.607+0000 7fae8a7fc640 1 -- 172.21.15.81:0/2641846950 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fae94070330 con 0x7fae78078dd0 2024-09-17T05:22:03.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fae78078dd0 msgr2=0x7fae7807b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fae78078dd0 0x7fae7807b290 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fae9406f8c0 tx=0x7fae90009040 comp rx=0 tx=0).stop 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae94072610 msgr2=0x7fae94159450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae94072610 0x7fae94159450 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fae84000c00 tx=0x7fae84004430 comp rx=0 tx=0).stop 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 shutdown_connections 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fae78078dd0 0x7fae7807b290 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fae94150ef0 0x7fae94159990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fae94072610 0x7fae94159450 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 --2- 172.21.15.81:0/2641846950 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fae9406e4e0 0x7fae9413e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 >> 172.21.15.81:0/2641846950 conn(0x7fae940b1620 msgr2=0x7fae9415b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 shutdown_connections 2024-09-17T05:22:03.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.609+0000 7fae9c0c6640 1 -- 172.21.15.81:0/2641846950 wait complete. 2024-09-17T05:22:03.621 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth get client.alice --format=json-pretty 2024-09-17T05:22:03.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/318338874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d49c0 msgr2=0x7f4f080b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/318338874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d49c0 0x7f4f080b3800 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f4f080d1eb0 tx=0x7f4f0002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/318338874 shutdown_connections 2024-09-17T05:22:03.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/318338874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d49c0 0x7f4f080b3800 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/318338874 >> v2:172.21.15.160:3300/0 conn(0x7f4f080d0d40 0x7f4f080cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/318338874 >> 172.21.15.81:0/318338874 conn(0x7f4f080d3ea0 msgr2=0x7f4f080d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/318338874 shutdown_connections 2024-09-17T05:22:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.722+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/318338874 wait complete. 2024-09-17T05:22:03.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.723+0000 7f4f0e0b8640 1 Processor -- start 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.723+0000 7f4f0e0b8640 1 -- start start 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f0e0b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d0d40 0x7f4f0815d360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f0e0b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f080d49c0 0x7f4f081612d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f0e0b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f0815df90 0x7f4f081f7e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f0e0b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4f08162690 con 0x7f4f080d0d40 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f0e0b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4f080b3d40 con 0x7f4f0815df90 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f0e0b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4f0815ea10 con 0x7f4f080d49c0 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d0d40 0x7f4f0815d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d0d40 0x7f4f0815d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50616/0 (socket says 172.21.15.81:50616) 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 -- 172.21.15.81:0/4176347691 learned_addr learned my addr 172.21.15.81:0/4176347691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 -- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f080d49c0 msgr2=0x7f4f081612d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f080d49c0 0x7f4f081612d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 -- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f0815df90 msgr2=0x7f4f081f7e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f0815df90 0x7f4f081f7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 -- 172.21.15.81:0/4176347691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f0815ecf0 con 0x7f4f080d0d40 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.724+0000 7f4f077fe640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d0d40 0x7f4f0815d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c3a0 tx=0x7f4ef800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.725+0000 7f4eeffff640 1 -- 172.21.15.81:0/4176347691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8011790 con 0x7f4f080d0d40 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.725+0000 7f4eeffff640 1 -- 172.21.15.81:0/4176347691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4ef8017070 con 0x7f4f080d0d40 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.725+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f0815efd0 con 0x7f4f080d0d40 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.725+0000 7f4eeffff640 1 -- 172.21.15.81:0/4176347691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ef8011cc0 con 0x7f4f080d0d40 2024-09-17T05:22:03.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.725+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f0815f590 con 0x7f4f080d0d40 2024-09-17T05:22:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.726+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f080cf9b0 con 0x7f4f080d0d40 2024-09-17T05:22:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.726+0000 7f4eeffff640 1 -- 172.21.15.81:0/4176347691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7f4ef801c460 con 0x7f4f080d0d40 2024-09-17T05:22:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.727+0000 7f4eeffff640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4ef4078dd0 0x7f4ef407b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.727+0000 7f4eeffff640 1 -- 172.21.15.81:0/4176347691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f4ef809ae60 con 0x7f4f080d0d40 2024-09-17T05:22:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.727+0000 7f4f06ffd640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4ef4078dd0 0x7f4ef407b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.727+0000 7f4f06ffd640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4ef4078dd0 0x7f4ef407b290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4efc005fd0 tx=0x7f4efc005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:03.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.731+0000 7f4eeffff640 1 -- 172.21.15.81:0/4176347691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4f080ce970 con 0x7f4f080d0d40 2024-09-17T05:22:03.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.974+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"} v 0) -- 0x7f4f0815f760 con 0x7f4f080d0d40 2024-09-17T05:22:03.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.974+0000 7f4eeffff640 1 -- 172.21.15.81:0/4176347691 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth get", "entity": "client.alice", "format": "json-pretty"}]=0 v18) ==== 107+0+280 (secure 0 0 0) 0x7f4ef8063020 con 0x7f4f080d0d40 2024-09-17T05:22:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:03.975 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:22:03.975 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.alice", 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EelmoW0vIxAAKuhmjA6Y6sc1GKjyQ9THTg==", 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol21380", 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:03.976 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:22:03.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4ef4078dd0 msgr2=0x7f4ef407b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4ef4078dd0 0x7f4ef407b290 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f4efc005fd0 tx=0x7f4efc005850 comp rx=0 tx=0).stop 2024-09-17T05:22:03.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d0d40 msgr2=0x7f4f0815d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d0d40 0x7f4f0815d360 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f4ef800c3a0 tx=0x7f4ef800c860 comp rx=0 tx=0).stop 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 shutdown_connections 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4ef4078dd0 0x7f4ef407b290 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f0815df90 0x7f4f081f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f080d49c0 0x7f4f081612d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 --2- 172.21.15.81:0/4176347691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f080d0d40 0x7f4f0815d360 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 >> 172.21.15.81:0/4176347691 conn(0x7f4f080d3ea0 msgr2=0x7f4f080b41a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 shutdown_connections 2024-09-17T05:22:03.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:03.976+0000 7f4f0e0b8640 1 -- 172.21.15.81:0/4176347691 wait complete. 2024-09-17T05:22:03.989 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol21380 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.093+0000 7fcfc01c6640 1 -- 172.21.15.81:0/3015708610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80cdf50 msgr2=0x7fcfb80cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.093+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/3015708610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80cdf50 0x7fcfb80cabc0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fcfb0009830 tx=0x7fcfb002a510 comp rx=0 tx=0).stop 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.094+0000 7fcfc01c6640 1 -- 172.21.15.81:0/3015708610 shutdown_connections 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.094+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/3015708610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb80cdf50 0x7fcfb80cabc0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.094+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/3015708610 >> v2:172.21.15.160:3300/0 conn(0x7fcfb8073260 0x7fcfb80cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.094+0000 7fcfc01c6640 1 -- 172.21.15.81:0/3015708610 >> 172.21.15.81:0/3015708610 conn(0x7fcfb80b1700 msgr2=0x7fcfb80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.094+0000 7fcfc01c6640 1 -- 172.21.15.81:0/3015708610 shutdown_connections 2024-09-17T05:22:04.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.094+0000 7fcfc01c6640 1 -- 172.21.15.81:0/3015708610 wait complete. 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.095+0000 7fcfc01c6640 1 Processor -- start 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.095+0000 7fcfc01c6640 1 -- start start 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.095+0000 7fcfc01c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfb8073260 0x7fcfb814a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.095+0000 7fcfc01c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb80cdf50 0x7fcfb81f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfc01c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb815b380 0x7fcfb81f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfc01c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb80cc920 con 0x7fcfb8073260 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfc01c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcfb80cc7a0 con 0x7fcfb80cdf50 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfc01c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcfb80ccaa0 con 0x7fcfb815b380 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfb8073260 0x7fcfb814a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfb8073260 0x7fcfb814a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50620/0 (socket says 172.21.15.81:50620) 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 -- 172.21.15.81:0/1371318291 learned_addr learned my addr 172.21.15.81:0/1371318291 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:04.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbd761640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb80cdf50 0x7fcfb81f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbe763640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb815b380 0x7fcfb81f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 -- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb815b380 msgr2=0x7fcfb81f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb815b380 0x7fcfb81f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 -- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb80cdf50 msgr2=0x7fcfb81f8410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb80cdf50 0x7fcfb81f8410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 -- 172.21.15.81:0/1371318291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfb815dcd0 con 0x7fcfb8073260 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfbdf62640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfb8073260 0x7fcfb814a620 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400cb60 tx=0x7fcfb400a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfae7fc640 1 -- 172.21.15.81:0/1371318291 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4016020 con 0x7fcfb8073260 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfb8145dd0 con 0x7fcfb8073260 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfae7fc640 1 -- 172.21.15.81:0/1371318291 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcfb400ae30 con 0x7fcfb8073260 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfae7fc640 1 -- 172.21.15.81:0/1371318291 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfb4012660 con 0x7fcfb8073260 2024-09-17T05:22:04.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.096+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfb8147430 con 0x7fcfb8073260 2024-09-17T05:22:04.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.097+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcfb80cda10 con 0x7fcfb8073260 2024-09-17T05:22:04.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.098+0000 7fcfae7fc640 1 -- 172.21.15.81:0/1371318291 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7fcfb4019020 con 0x7fcfb8073260 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.099+0000 7fcfae7fc640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcf9c078dd0 0x7fcf9c07b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.099+0000 7fcfae7fc640 1 -- 172.21.15.81:0/1371318291 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fcfb409b6e0 con 0x7fcfb8073260 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.099+0000 7fcfbd761640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcf9c078dd0 0x7fcf9c07b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.099+0000 7fcfbd761640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcf9c078dd0 0x7fcf9c07b290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80095f0 tx=0x7fcfa8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.103+0000 7fcfae7fc640 1 -- 172.21.15.81:0/1371318291 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcfb4020020 con 0x7fcfb8073260 2024-09-17T05:22:04.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.302+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol21380", "target": ["mon-mgr", ""]}) -- 0x7fcfb8072b50 con 0x7fcf9c078dd0 2024-09-17T05:22:04.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.315+0000 7fcfae7fc640 1 -- 172.21.15.81:0/1371318291 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fcfb8072b50 con 0x7fcf9c078dd0 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.317+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcf9c078dd0 msgr2=0x7fcf9c07b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.317+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcf9c078dd0 0x7fcf9c07b290 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcfa80095f0 tx=0x7fcfa8005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.317+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfb8073260 msgr2=0x7fcfb814a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.317+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfb8073260 0x7fcfb814a620 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7fcfb400cb60 tx=0x7fcfb400a430 comp rx=0 tx=0).stop 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 shutdown_connections 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcf9c078dd0 0x7fcf9c07b290 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfb815b380 0x7fcfb81f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcfb80cdf50 0x7fcfb81f8410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 --2- 172.21.15.81:0/1371318291 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfb8073260 0x7fcfb814a620 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 >> 172.21.15.81:0/1371318291 conn(0x7fcfb80b1700 msgr2=0x7fcfb8147b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 shutdown_connections 2024-09-17T05:22:04.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.318+0000 7fcfc01c6640 1 -- 172.21.15.81:0/1371318291 wait complete. 2024-09-17T05:22:04.320 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.319+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.320 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.319+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.320 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.319+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.320 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.319+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.320 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.319+0000 7f03cbfd1640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol30651 2024-09-17T05:22:04.334 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.333+0000 7f03cafcf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.334 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.333+0000 7f03cafcf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.334 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.333+0000 7f03cafcf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.334 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.333+0000 7f03cafcf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.334 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:04.333+0000 7f03cafcf640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:04.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.433+0000 7f76ef532640 1 -- 172.21.15.81:0/2883016881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e815de50 msgr2=0x7f76e80b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.433+0000 7f76ef532640 1 --2- 172.21.15.81:0/2883016881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e815de50 0x7f76e80b2950 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f76d8005fd0 tx=0x7f76d802a940 comp rx=0 tx=0).stop 2024-09-17T05:22:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.433+0000 7f76ef532640 1 -- 172.21.15.81:0/2883016881 shutdown_connections 2024-09-17T05:22:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.433+0000 7f76ef532640 1 --2- 172.21.15.81:0/2883016881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e815de50 0x7f76e80b2950 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.433+0000 7f76ef532640 1 -- 172.21.15.81:0/2883016881 >> 172.21.15.81:0/2883016881 conn(0x7f76e809aa30 msgr2=0x7f76e809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.433+0000 7f76ef532640 1 -- 172.21.15.81:0/2883016881 shutdown_connections 2024-09-17T05:22:04.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.433+0000 7f76ef532640 1 -- 172.21.15.81:0/2883016881 wait complete. 2024-09-17T05:22:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.434+0000 7f76ef532640 1 Processor -- start 2024-09-17T05:22:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.434+0000 7f76ef532640 1 -- start start 2024-09-17T05:22:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ef532640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e80b1610 0x7f76e809f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ef532640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76e80d2060 0x7f76e8071960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ef532640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76e815de50 0x7f76e81f7da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ef532640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76e806e4e0 con 0x7f76e80b1610 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ef532640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f76e806e360 con 0x7f76e80d2060 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ef532640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f76e806e660 con 0x7f76e815de50 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ed2ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e80b1610 0x7f76e809f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ed2ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e80b1610 0x7f76e809f460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50624/0 (socket says 172.21.15.81:50624) 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ed2ce640 1 -- 172.21.15.81:0/1992102335 learned_addr learned my addr 172.21.15.81:0/1992102335 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ecacd640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76e80d2060 0x7f76e8071960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76edacf640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76e815de50 0x7f76e81f7da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.435+0000 7f76ed2ce640 1 -- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76e815de50 msgr2=0x7f76e81f7da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ed2ce640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76e815de50 0x7f76e81f7da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ed2ce640 1 -- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76e80d2060 msgr2=0x7f76e8071960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ed2ce640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76e80d2060 0x7f76e8071960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ed2ce640 1 -- 172.21.15.81:0/1992102335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e81f8bd0 con 0x7f76e80b1610 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ecacd640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76e80d2060 0x7f76e8071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ed2ce640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e80b1610 0x7f76e809f460 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f80 tx=0x7f76d8031ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76e5ffb640 1 -- 172.21.15.81:0/1992102335 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d803e070 con 0x7f76e80b1610 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76e5ffb640 1 -- 172.21.15.81:0/1992102335 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76d8004540 con 0x7f76e80b1610 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76e5ffb640 1 -- 172.21.15.81:0/1992102335 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76d8043460 con 0x7f76e80b1610 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e81f88f0 con 0x7f76e80b1610 2024-09-17T05:22:04.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.436+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e809ec60 con 0x7f76e80b1610 2024-09-17T05:22:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.437+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e809f0a0 con 0x7f76e80b1610 2024-09-17T05:22:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.438+0000 7f76e5ffb640 1 -- 172.21.15.81:0/1992102335 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7f76d8043600 con 0x7f76e80b1610 2024-09-17T05:22:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.438+0000 7f76e5ffb640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f76d4078dd0 0x7f76d407b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.438+0000 7f76e5ffb640 1 -- 172.21.15.81:0/1992102335 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f76d80bcbf0 con 0x7f76e80b1610 2024-09-17T05:22:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.438+0000 7f76ecacd640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f76d4078dd0 0x7f76d407b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:04.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.439+0000 7f76ecacd640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f76d4078dd0 0x7f76d407b290 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f76dc007a50 tx=0x7f76dc009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:04.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.442+0000 7f76e5ffb640 1 -- 172.21.15.81:0/1992102335 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f76d8084ce0 con 0x7f76e80b1610 2024-09-17T05:22:04.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.641+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol30651", "target": ["mon-mgr", ""]}) -- 0x7f76e809f2b0 con 0x7f76d4078dd0 2024-09-17T05:22:04.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.656+0000 7f76e5ffb640 1 -- 172.21.15.81:0/1992102335 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f76e809f2b0 con 0x7f76d4078dd0 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f76d4078dd0 msgr2=0x7f76d407b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f76d4078dd0 0x7f76d407b290 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f76dc007a50 tx=0x7f76dc009040 comp rx=0 tx=0).stop 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e80b1610 msgr2=0x7f76e809f460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e80b1610 0x7f76e809f460 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f76d8000f80 tx=0x7f76d8031ea0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 shutdown_connections 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f76d4078dd0 0x7f76d407b290 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76e815de50 0x7f76e81f7da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76e80d2060 0x7f76e8071960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 --2- 172.21.15.81:0/1992102335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76e80b1610 0x7f76e809f460 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:04.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 >> 172.21.15.81:0/1992102335 conn(0x7f76e809aa30 msgr2=0x7f76e80ae8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 shutdown_connections 2024-09-17T05:22:04.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04.659+0000 7f76ef532640 1 -- 172.21.15.81:0/1992102335 wait complete. 2024-09-17T05:22:04.671 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:22:04.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:22:04.724 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-17T05:22:04.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:04.731 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:22:04.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:04.777 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:04.828 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:22:04.828 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:04.828 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:04.829 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:04.844 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:04.845 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:04.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:05.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 -- 172.21.15.81:0/2544552401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e015beb0 msgr2=0x7f15e00cf7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 --2- 172.21.15.81:0/2544552401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e015beb0 0x7f15e00cf7e0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f15dc009820 tx=0x7f15dc02a510 comp rx=0 tx=0).stop 2024-09-17T05:22:05.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 -- 172.21.15.81:0/2544552401 shutdown_connections 2024-09-17T05:22:05.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 --2- 172.21.15.81:0/2544552401 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15e00cfd20 0x7f15e00d01f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 --2- 172.21.15.81:0/2544552401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e015beb0 0x7f15e00cf7e0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 -- 172.21.15.81:0/2544552401 >> 172.21.15.81:0/2544552401 conn(0x7f15e009aa30 msgr2=0x7f15e009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 -- 172.21.15.81:0/2544552401 shutdown_connections 2024-09-17T05:22:05.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.043+0000 7f15e8485640 1 -- 172.21.15.81:0/2544552401 wait complete. 2024-09-17T05:22:05.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.044+0000 7f15e8485640 1 Processor -- start 2024-09-17T05:22:05.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.044+0000 7f15e8485640 1 -- start start 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e8485640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e00cfd20 0x7f15e0158080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e8485640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15e00d0730 0x7f15e01f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e8485640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15e015beb0 0x7f15e00b24e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e8485640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0160310 con 0x7f15e00cfd20 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e8485640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f15e0160190 con 0x7f15e00d0730 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e8485640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f15e0160490 con 0x7f15e015beb0 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e00cfd20 0x7f15e0158080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e00cfd20 0x7f15e0158080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50636/0 (socket says 172.21.15.81:50636) 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 -- 172.21.15.81:0/3147503561 learned_addr learned my addr 172.21.15.81:0/3147503561 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 -- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15e015beb0 msgr2=0x7f15e00b24e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15e015beb0 0x7f15e00b24e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 -- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15e00d0730 msgr2=0x7f15e01f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15e00d0730 0x7f15e01f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 -- 172.21.15.81:0/3147503561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f15e01f8ba0 con 0x7f15e00cfd20 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15e6221640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e00cfd20 0x7f15e0158080 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f15dc02ab00 tx=0x7f15dc004a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.045+0000 7f15d6ffd640 1 -- 172.21.15.81:0/3147503561 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc005c30 con 0x7f15e00cfd20 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.046+0000 7f15d6ffd640 1 -- 172.21.15.81:0/3147503561 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f15dc004e50 con 0x7f15e00cfd20 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.046+0000 7f15d6ffd640 1 -- 172.21.15.81:0/3147503561 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f15dc005040 con 0x7f15e00cfd20 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.046+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f15e01f8e80 con 0x7f15e00cfd20 2024-09-17T05:22:05.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.046+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15e01585c0 con 0x7f15e00cfd20 2024-09-17T05:22:05.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.047+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15e006dde0 con 0x7f15e00cfd20 2024-09-17T05:22:05.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.047+0000 7f15d6ffd640 1 -- 172.21.15.81:0/3147503561 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7f15dc0051e0 con 0x7f15e00cfd20 2024-09-17T05:22:05.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.047+0000 7f15d6ffd640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f15c4078dd0 0x7f15c407b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.048+0000 7f15d6ffd640 1 -- 172.21.15.81:0/3147503561 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f15dc0bc380 con 0x7f15e00cfd20 2024-09-17T05:22:05.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.048+0000 7f15e5a20640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f15c4078dd0 0x7f15c407b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.048+0000 7f15e5a20640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f15c4078dd0 0x7f15c407b290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f15d00058c0 tx=0x7f15d0005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.052+0000 7f15d6ffd640 1 -- 172.21.15.81:0/3147503561 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f15dc03f030 con 0x7f15e00cfd20 2024-09-17T05:22:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.238+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f15e00d01f0 con 0x7f15e00cfd20 2024-09-17T05:22:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.238+0000 7f15d6ffd640 1 -- 172.21.15.81:0/3147503561 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) ==== 80+0+0 (secure 0 0 0) 0x7f15dc031770 con 0x7f15e00cfd20 2024-09-17T05:22:05.239 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:22:05.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f15c4078dd0 msgr2=0x7f15c407b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f15c4078dd0 0x7f15c407b290 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f15d00058c0 tx=0x7f15d0005850 comp rx=0 tx=0).stop 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e00cfd20 msgr2=0x7f15e0158080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e00cfd20 0x7f15e0158080 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f15dc02ab00 tx=0x7f15dc004a50 comp rx=0 tx=0).stop 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 shutdown_connections 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f15c4078dd0 0x7f15c407b290 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f15e015beb0 0x7f15e00b24e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f15e00d0730 0x7f15e01f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 --2- 172.21.15.81:0/3147503561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f15e00cfd20 0x7f15e0158080 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 >> 172.21.15.81:0/3147503561 conn(0x7f15e009aa30 msgr2=0x7f15e0070860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 shutdown_connections 2024-09-17T05:22:05.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.240+0000 7f15e8485640 1 -- 172.21.15.81:0/3147503561 wait complete. 2024-09-17T05:22:05.252 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:22:05.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:05.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:05.275 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[55376]: fuse finished with error 0 and tester_r 0 2024-09-17T05:22:05.277 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:22:05.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:05.277 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:22:05.443 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:05.443 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:05.443 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:05.461 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:05.462 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:05.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.622+0000 7f520ff0e640 1 -- 172.21.15.81:0/2175527932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f4003a00 msgr2=0x7f51f4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.622+0000 7f520ff0e640 1 --2- 172.21.15.81:0/2175527932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f4003a00 0x7f51f4003e20 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f520400baf0 tx=0x7f51f4005830 comp rx=0 tx=0).stop 2024-09-17T05:22:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.622+0000 7f520e4ab640 1 -- 172.21.15.81:0/2175527932 reap_dead start 2024-09-17T05:22:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.622+0000 7f520ff0e640 1 -- 172.21.15.81:0/2175527932 shutdown_connections 2024-09-17T05:22:05.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.622+0000 7f520ff0e640 1 -- 172.21.15.81:0/2175527932 >> 172.21.15.81:0/2175527932 conn(0x7f52080d3ea0 msgr2=0x7f52080d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.622+0000 7f520ff0e640 1 -- 172.21.15.81:0/2175527932 shutdown_connections 2024-09-17T05:22:05.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.622+0000 7f520ff0e640 1 -- 172.21.15.81:0/2175527932 wait complete. 2024-09-17T05:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.623+0000 7f520ff0e640 1 Processor -- start 2024-09-17T05:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.623+0000 7f520ff0e640 1 -- start start 2024-09-17T05:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520ff0e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f4003a00 0x7f520815b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520ff0e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f520815c9f0 0x7f5208159ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520ff0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52081ea9e0 0x7f52081eae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520ff0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f52080b3800 con 0x7f52081ea9e0 2024-09-17T05:22:05.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520ff0e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5208162710 con 0x7f51f4003a00 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520ff0e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f52080b3980 con 0x7f520815c9f0 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52081ea9e0 0x7f52081eae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52081ea9e0 0x7f52081eae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50666/0 (socket says 172.21.15.81:50666) 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 -- 172.21.15.81:0/911992985 learned_addr learned my addr 172.21.15.81:0/911992985 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520dcaa640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f4003a00 0x7f520815b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 -- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f520815c9f0 msgr2=0x7f5208159ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f520815c9f0 0x7f5208159ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 -- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f4003a00 msgr2=0x7f520815b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f4003a00 0x7f520815b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 -- 172.21.15.81:0/911992985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f520815d220 con 0x7f52081ea9e0 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520dcaa640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f4003a00 0x7f520815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:05.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f520e4ab640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52081ea9e0 0x7f52081eae40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f52080d1ed0 tx=0x7f5200009a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.624+0000 7f51fe7fc640 1 -- 172.21.15.81:0/911992985 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200004d20 con 0x7f52081ea9e0 2024-09-17T05:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.625+0000 7f51fe7fc640 1 -- 172.21.15.81:0/911992985 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5200011710 con 0x7f52081ea9e0 2024-09-17T05:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.625+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f520815beb0 con 0x7f52081ea9e0 2024-09-17T05:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.625+0000 7f51fe7fc640 1 -- 172.21.15.81:0/911992985 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5200011b60 con 0x7f52081ea9e0 2024-09-17T05:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.625+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52081f8a60 con 0x7f52081ea9e0 2024-09-17T05:22:05.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.625+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52081f9180 con 0x7f52081ea9e0 2024-09-17T05:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.626+0000 7f51fe7fc640 1 -- 172.21.15.81:0/911992985 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 10) ==== 101645+0+0 (secure 0 0 0) 0x7f5200011d00 con 0x7f52081ea9e0 2024-09-17T05:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.627+0000 7f51fe7fc640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51ec078dd0 0x7f51ec07b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.627+0000 7f51fe7fc640 1 -- 172.21.15.81:0/911992985 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f520009be10 con 0x7f52081ea9e0 2024-09-17T05:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.627+0000 7f520dcaa640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51ec078dd0 0x7f51ec07b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:05.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.627+0000 7f520dcaa640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51ec078dd0 0x7f51ec07b290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5204036000 tx=0x7f5204035040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:05.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.631+0000 7f51fe7fc640 1 -- 172.21.15.81:0/911992985 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f520815beb0 con 0x7f52081ea9e0 2024-09-17T05:22:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.816+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f520808d590 con 0x7f52081ea9e0 2024-09-17T05:22:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.816+0000 7f51fe7fc640 1 -- 172.21.15.81:0/911992985 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v58) ==== 80+0+0 (secure 0 0 0) 0x7f5200015030 con 0x7f52081ea9e0 2024-09-17T05:22:05.817 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.818+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51ec078dd0 msgr2=0x7f51ec07b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51ec078dd0 0x7f51ec07b290 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f5204036000 tx=0x7f5204035040 comp rx=0 tx=0).stop 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52081ea9e0 msgr2=0x7f52081eae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52081ea9e0 0x7f52081eae40 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f52080d1ed0 tx=0x7f5200009a80 comp rx=0 tx=0).stop 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 shutdown_connections 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f51ec078dd0 0x7f51ec07b290 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f52081ea9e0 0x7f52081eae40 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f520815c9f0 0x7f5208159ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 --2- 172.21.15.81:0/911992985 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f4003a00 0x7f520815b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 >> 172.21.15.81:0/911992985 conn(0x7f52080d3ea0 msgr2=0x7f52080b5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 shutdown_connections 2024-09-17T05:22:05.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:05.819+0000 7f520ff0e640 1 -- 172.21.15.81:0/911992985 wait complete. 2024-09-17T05:22:05.831 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:22:05.831 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:05.832 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:05.861 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[45368]: fuse finished with error 0 and tester_r 0 2024-09-17T05:22:05.863 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:22:05.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:05.863 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:22:06.025 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:06.026 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:06.026 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:06.042 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:06.042 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:06.042 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:06.042 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:06.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:06.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.185+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/391628308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 msgr2=0x7f5b940736e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.185+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/391628308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940736e0 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f5b84009830 tx=0x7f5b8402a3f0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.185+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/391628308 shutdown_connections 2024-09-17T05:22:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.185+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/391628308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940736e0 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.185+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/391628308 >> 172.21.15.81:0/391628308 conn(0x7f5b940d0c20 msgr2=0x7f5b940d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.185+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/391628308 shutdown_connections 2024-09-17T05:22:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.185+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/391628308 wait complete. 2024-09-17T05:22:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.186+0000 7f5b9a5b4640 1 Processor -- start 2024-09-17T05:22:06.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.186+0000 7f5b9a5b4640 1 -- start start 2024-09-17T05:22:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b9a5b4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b94074280 0x7f5b941f3250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b9a5b4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b940746e0 0x7f5b940c9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b9a5b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940ca400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b9a5b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b940d0820 con 0x7f5b9415ad00 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b9a5b4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b940d06a0 con 0x7f5b94074280 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b9a5b4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5b94073c20 con 0x7f5b940746e0 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940ca400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940ca400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50678/0 (socket says 172.21.15.81:50678) 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 -- 172.21.15.81:0/721178848 learned_addr learned my addr 172.21.15.81:0/721178848 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b93fff640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b94074280 0x7f5b941f3250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b937fe640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b940746e0 0x7f5b940c9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 -- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b940746e0 msgr2=0x7f5b940c9ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b940746e0 0x7f5b940c9ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 -- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b94074280 msgr2=0x7f5b941f3250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b94074280 0x7f5b941f3250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.187+0000 7f5b98b51640 1 -- 172.21.15.81:0/721178848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b9415b410 con 0x7f5b9415ad00 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.188+0000 7f5b98b51640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940ca400 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00c780 tx=0x7f5b8c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.188+0000 7f5b90ff9640 1 -- 172.21.15.81:0/721178848 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c017070 con 0x7f5b9415ad00 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.188+0000 7f5b90ff9640 1 -- 172.21.15.81:0/721178848 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b8c005070 con 0x7f5b9415ad00 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.188+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b9415b6f0 con 0x7f5b9415ad00 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.188+0000 7f5b90ff9640 1 -- 172.21.15.81:0/721178848 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b8c0054c0 con 0x7f5b9415ad00 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.188+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b9415c1d0 con 0x7f5b9415ad00 2024-09-17T05:22:06.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.189+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b940736e0 con 0x7f5b9415ad00 2024-09-17T05:22:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.189+0000 7f5b90ff9640 1 -- 172.21.15.81:0/721178848 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f5b8c01a070 con 0x7f5b9415ad00 2024-09-17T05:22:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.190+0000 7f5b90ff9640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b80078ef0 0x7f5b8007b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.190+0000 7f5b90ff9640 1 -- 172.21.15.81:0/721178848 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f5b8c09a9b0 con 0x7f5b9415ad00 2024-09-17T05:22:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.190+0000 7f5b93fff640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b80078ef0 0x7f5b8007b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.191+0000 7f5b93fff640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b80078ef0 0x7f5b8007b3b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b84034000 tx=0x7f5b84004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.194+0000 7f5b90ff9640 1 -- 172.21.15.81:0/721178848 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5b8c0629f0 con 0x7f5b9415ad00 2024-09-17T05:22:06.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.404+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5b940b6ba0 con 0x7f5b9415ad00 2024-09-17T05:22:06.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.404+0000 7f5b90ff9640 1 -- 172.21.15.81:0/721178848 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5226 (secure 0 0 0) 0x7f5b8c0622f0 con 0x7f5b9415ad00 2024-09-17T05:22:06.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:06.406 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-17T05:21:56:005381+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1537992933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1537992933},{"type":"v1","addr":"172.21.15.160:6836","nonce":1537992933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5419,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3597720446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3597720446},{"type":"v1","addr":"172.21.15.160:6837","nonce":3597720446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/457781060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":457781060},{"type":"v1","addr":"172.21.15.81:6834","nonce":457781060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:41.304247+0000","modified":"2024-09-17T05:21:44.170675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1068882112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1068882112},{"type":"v1","addr":"172.21.15.81:6835","nonce":1068882112}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-09-17T05:22:06.406 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-17T05:22:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b80078ef0 msgr2=0x7f5b8007b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b80078ef0 0x7f5b8007b3b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f5b84034000 tx=0x7f5b84004730 comp rx=0 tx=0).stop 2024-09-17T05:22:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 msgr2=0x7f5b940ca400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940ca400 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f5b8c00c780 tx=0x7f5b8c00cc40 comp rx=0 tx=0).stop 2024-09-17T05:22:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 shutdown_connections 2024-09-17T05:22:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5b80078ef0 0x7f5b8007b3b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b9415ad00 0x7f5b940ca400 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b940746e0 0x7f5b940c9ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 --2- 172.21.15.81:0/721178848 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b94074280 0x7f5b941f3250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 >> 172.21.15.81:0/721178848 conn(0x7f5b940d0c20 msgr2=0x7f5b940b2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 shutdown_connections 2024-09-17T05:22:06.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.406+0000 7f5b9a5b4640 1 -- 172.21.15.81:0/721178848 wait complete. 2024-09-17T05:22:06.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:06.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.519+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2539412324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7d0003a50 msgr2=0x7fe7d0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.519+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2539412324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7d0003a50 0x7fe7d0003e70 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fe7d800c470 tx=0x7fe7d0005830 comp rx=0 tx=0).stop 2024-09-17T05:22:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.519+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2539412324 shutdown_connections 2024-09-17T05:22:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.519+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2539412324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7d0003a50 0x7fe7d0003e70 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.519+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2539412324 >> 172.21.15.81:0/2539412324 conn(0x7fe7e80d3ea0 msgr2=0x7fe7e80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.519+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2539412324 shutdown_connections 2024-09-17T05:22:06.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.519+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2539412324 wait complete. 2024-09-17T05:22:06.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 Processor -- start 2024-09-17T05:22:06.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 -- start start 2024-09-17T05:22:06.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d0003a50 0x7fe7e814e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7e8157250 0x7fe7e8158210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e8158750 0x7fe7e80b3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e80cf9b0 con 0x7fe7e8158750 2024-09-17T05:22:06.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe7e81627a0 con 0x7fe7d0003a50 2024-09-17T05:22:06.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7ed4bf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe7e80cfb30 con 0x7fe7e8157250 2024-09-17T05:22:06.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7e77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e8158750 0x7fe7e80b3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7e77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e8158750 0x7fe7e80b3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50700/0 (socket says 172.21.15.81:50700) 2024-09-17T05:22:06.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.521+0000 7fe7e77fe640 1 -- 172.21.15.81:0/2253043347 learned_addr learned my addr 172.21.15.81:0/2253043347 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:06.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e67fc640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7e8157250 0x7fe7e8158210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e6ffd640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d0003a50 0x7fe7e814e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e77fe640 1 -- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7e8157250 msgr2=0x7fe7e8158210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e77fe640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7e8157250 0x7fe7e8158210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e77fe640 1 -- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d0003a50 msgr2=0x7fe7e814e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e77fe640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d0003a50 0x7fe7e814e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e77fe640 1 -- 172.21.15.81:0/2253043347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe7e814e820 con 0x7fe7e8158750 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7e77fe640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e8158750 0x7fe7e80b3ae0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80d1c90 tx=0x7fe7e0009b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7cf7fe640 1 -- 172.21.15.81:0/2253043347 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e0004b20 con 0x7fe7e8158750 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7cf7fe640 1 -- 172.21.15.81:0/2253043347 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7e0004db0 con 0x7fe7e8158750 2024-09-17T05:22:06.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe7e815a260 con 0x7fe7e8158750 2024-09-17T05:22:06.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7cf7fe640 1 -- 172.21.15.81:0/2253043347 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7e000f9f0 con 0x7fe7e8158750 2024-09-17T05:22:06.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.522+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7e815a820 con 0x7fe7e8158750 2024-09-17T05:22:06.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.523+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe7e80d07a0 con 0x7fe7e8158750 2024-09-17T05:22:06.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.524+0000 7fe7cf7fe640 1 -- 172.21.15.81:0/2253043347 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fe7e001b020 con 0x7fe7e8158750 2024-09-17T05:22:06.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.524+0000 7fe7cf7fe640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7d4078ef0 0x7fe7d407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.524+0000 7fe7cf7fe640 1 -- 172.21.15.81:0/2253043347 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fe7e009b230 con 0x7fe7e8158750 2024-09-17T05:22:06.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.524+0000 7fe7e6ffd640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7d4078ef0 0x7fe7d407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.525+0000 7fe7e6ffd640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7d4078ef0 0x7fe7d407b3b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8033000 tx=0x7fe7d802d070 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.528+0000 7fe7cf7fe640 1 -- 172.21.15.81:0/2253043347 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe7e814e820 con 0x7fe7e8158750 2024-09-17T05:22:06.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.738+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe7e808d590 con 0x7fe7e8158750 2024-09-17T05:22:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.739+0000 7fe7cf7fe640 1 -- 172.21.15.81:0/2253043347 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5226 (secure 0 0 0) 0x7fe7e0062b00 con 0x7fe7e8158750 2024-09-17T05:22:06.740 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:06.740 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-17T05:21:56:005381+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1537992933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1537992933},{"type":"v1","addr":"172.21.15.160:6836","nonce":1537992933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5419,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3597720446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3597720446},{"type":"v1","addr":"172.21.15.160:6837","nonce":3597720446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/457781060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":457781060},{"type":"v1","addr":"172.21.15.81:6834","nonce":457781060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:41.304247+0000","modified":"2024-09-17T05:21:44.170675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1068882112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1068882112},{"type":"v1","addr":"172.21.15.81:6835","nonce":1068882112}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-09-17T05:22:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-17T05:22:06.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7d4078ef0 msgr2=0x7fe7d407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7d4078ef0 0x7fe7d407b3b0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fe7d8033000 tx=0x7fe7d802d070 comp rx=0 tx=0).stop 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e8158750 msgr2=0x7fe7e80b3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e8158750 0x7fe7e80b3ae0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fe7e80d1c90 tx=0x7fe7e0009b00 comp rx=0 tx=0).stop 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 shutdown_connections 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe7d4078ef0 0x7fe7d407b3b0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe7e8158750 0x7fe7e80b3ae0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe7e8157250 0x7fe7e8158210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 --2- 172.21.15.81:0/2253043347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe7d0003a50 0x7fe7e814e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 >> 172.21.15.81:0/2253043347 conn(0x7fe7e80d3ea0 msgr2=0x7fe7e80b24a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 shutdown_connections 2024-09-17T05:22:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.741+0000 7fe7ed4bf640 1 -- 172.21.15.81:0/2253043347 wait complete. 2024-09-17T05:22:06.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:06.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 -- 172.21.15.81:0/3476551672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80d49c0 msgr2=0x7ff2c80d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 --2- 172.21.15.81:0/3476551672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80d49c0 0x7ff2c80d0630 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc005fd0 tx=0x7ff2bc02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 -- 172.21.15.81:0/3476551672 shutdown_connections 2024-09-17T05:22:06.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 --2- 172.21.15.81:0/3476551672 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c80d49c0 0x7ff2c80d0630 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 --2- 172.21.15.81:0/3476551672 >> v2:172.21.15.160:3300/0 conn(0x7ff2c815df90 0x7ff2c80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 -- 172.21.15.81:0/3476551672 >> 172.21.15.81:0/3476551672 conn(0x7ff2c80d3ea0 msgr2=0x7ff2c80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:06.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 -- 172.21.15.81:0/3476551672 shutdown_connections 2024-09-17T05:22:06.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.853+0000 7ff2ce794640 1 -- 172.21.15.81:0/3476551672 wait complete. 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.854+0000 7ff2ce794640 1 Processor -- start 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2ce794640 1 -- start start 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2ce794640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80d49c0 0x7ff2c809db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2ce794640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c815df90 0x7ff2c814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2ce794640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c8162480 0x7ff2c8150320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2ce794640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c80d0f00 con 0x7ff2c815df90 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2ce794640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff2c80d0d80 con 0x7ff2c80d49c0 2024-09-17T05:22:06.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2ce794640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff2c80b3f10 con 0x7ff2c8162480 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c815df90 0x7ff2c814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2c77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c815df90 0x7ff2c814d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50716/0 (socket says 172.21.15.81:50716) 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.855+0000 7ff2c77fe640 1 -- 172.21.15.81:0/1440461099 learned_addr learned my addr 172.21.15.81:0/1440461099 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c7fff640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80d49c0 0x7ff2c809db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2ccd31640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c8162480 0x7ff2c8150320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c77fe640 1 -- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c8162480 msgr2=0x7ff2c8150320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c77fe640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c8162480 0x7ff2c8150320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c77fe640 1 -- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80d49c0 msgr2=0x7ff2c809db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c77fe640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80d49c0 0x7ff2c809db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c77fe640 1 -- 172.21.15.81:0/1440461099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2c80ce140 con 0x7ff2c815df90 2024-09-17T05:22:06.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c77fe640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c815df90 0x7ff2c814d9f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0099f0 tx=0x7ff2bc003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c4ff9640 1 -- 172.21.15.81:0/1440461099 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc03f070 con 0x7ff2c815df90 2024-09-17T05:22:06.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c4ff9640 1 -- 172.21.15.81:0/1440461099 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff2bc005600 con 0x7ff2c815df90 2024-09-17T05:22:06.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2c4ff9640 1 -- 172.21.15.81:0/1440461099 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2bc035030 con 0x7ff2c815df90 2024-09-17T05:22:06.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2c814e4e0 con 0x7ff2c815df90 2024-09-17T05:22:06.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.856+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2c814eaa0 con 0x7ff2c815df90 2024-09-17T05:22:06.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.857+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2c80b4430 con 0x7ff2c815df90 2024-09-17T05:22:06.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.858+0000 7ff2c4ff9640 1 -- 172.21.15.81:0/1440461099 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7ff2bc042070 con 0x7ff2c815df90 2024-09-17T05:22:06.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.858+0000 7ff2c4ff9640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2b4078f20 0x7ff2b407b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:06.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.858+0000 7ff2c4ff9640 1 -- 172.21.15.81:0/1440461099 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7ff2bc0bbe30 con 0x7ff2c815df90 2024-09-17T05:22:06.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.858+0000 7ff2c7fff640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2b4078f20 0x7ff2b407b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:06.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.859+0000 7ff2c7fff640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2b4078f20 0x7ff2b407b3e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009b60 tx=0x7ff2b8005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:06.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:06.862+0000 7ff2c4ff9640 1 -- 172.21.15.81:0/1440461099 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff2bc083de0 con 0x7ff2c815df90 2024-09-17T05:22:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.043+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff2c808d590 con 0x7ff2c815df90 2024-09-17T05:22:07.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.044+0000 7ff2c4ff9640 1 -- 172.21.15.81:0/1440461099 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16725 (secure 0 0 0) 0x7ff2bc0836e0 con 0x7ff2c815df90 2024-09-17T05:22:07.045 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:07.045 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:21:42.957747+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:39.914624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:40.261517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2b4078f20 msgr2=0x7ff2b407b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2b4078f20 0x7ff2b407b3e0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7ff2b8009b60 tx=0x7ff2b8005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c815df90 msgr2=0x7ff2c814d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c815df90 0x7ff2c814d9f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ff2bc0099f0 tx=0x7ff2bc003820 comp rx=0 tx=0).stop 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 shutdown_connections 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff2b4078f20 0x7ff2b407b3e0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff2c8162480 0x7ff2c8150320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff2c815df90 0x7ff2c814d9f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 --2- 172.21.15.81:0/1440461099 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff2c80d49c0 0x7ff2c809db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 >> 172.21.15.81:0/1440461099 conn(0x7ff2c80d3ea0 msgr2=0x7ff2c806e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 shutdown_connections 2024-09-17T05:22:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.046+0000 7ff2ce794640 1 -- 172.21.15.81:0/1440461099 wait complete. 2024-09-17T05:22:07.058 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:22:07.059 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 -- 172.21.15.81:0/1340494091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 msgr2=0x7f007c0d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 --2- 172.21.15.81:0/1340494091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c0d0b70 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f007c06d080 tx=0x7f006c02a560 comp rx=0 tx=0).stop 2024-09-17T05:22:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 -- 172.21.15.81:0/1340494091 shutdown_connections 2024-09-17T05:22:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 --2- 172.21.15.81:0/1340494091 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c0d0b70 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 --2- 172.21.15.81:0/1340494091 >> v2:172.21.15.160:3300/0 conn(0x7f007c0d49c0 0x7f007c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 --2- 172.21.15.81:0/1340494091 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f007c15df90 0x7f007c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 -- 172.21.15.81:0/1340494091 >> 172.21.15.81:0/1340494091 conn(0x7f007c0d3ea0 msgr2=0x7f007c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 -- 172.21.15.81:0/1340494091 shutdown_connections 2024-09-17T05:22:07.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.158+0000 7f0080b75640 1 -- 172.21.15.81:0/1340494091 wait complete. 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 Processor -- start 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 -- start start 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f007c0d49c0 0x7f007c0cd520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f007c15df90 0x7f007c150560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c14daf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0b3b90 con 0x7f007c162480 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f007c0b3a10 con 0x7f007c0d49c0 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.160+0000 7f0080b75640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f007c0b3d10 con 0x7f007c15df90 2024-09-17T05:22:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c14daf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c14daf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50724/0 (socket says 172.21.15.81:50724) 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 -- 172.21.15.81:0/2665791582 learned_addr learned my addr 172.21.15.81:0/2665791582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f0079d9b640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f007c15df90 0x7f007c150560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007a59c640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f007c0d49c0 0x7f007c0cd520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 -- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f007c15df90 msgr2=0x7f007c150560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f007c15df90 0x7f007c150560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 -- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f007c0d49c0 msgr2=0x7f007c0cd520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f007c0d49c0 0x7f007c0cd520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 -- 172.21.15.81:0/2665791582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f007c1f5630 con 0x7f007c162480 2024-09-17T05:22:07.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f007ad9d640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c14daf0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f006c034040 tx=0x7f006c003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f006affd640 1 -- 172.21.15.81:0/2665791582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c03e030 con 0x7f007c162480 2024-09-17T05:22:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f006affd640 1 -- 172.21.15.81:0/2665791582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f006c003e40 con 0x7f007c162480 2024-09-17T05:22:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f007c150aa0 con 0x7f007c162480 2024-09-17T05:22:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f006affd640 1 -- 172.21.15.81:0/2665791582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f006c035040 con 0x7f007c162480 2024-09-17T05:22:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.161+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f007c0cc760 con 0x7f007c162480 2024-09-17T05:22:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.162+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f007c0cf9b0 con 0x7f007c162480 2024-09-17T05:22:07.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.163+0000 7f006affd640 1 -- 172.21.15.81:0/2665791582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f006c041030 con 0x7f007c162480 2024-09-17T05:22:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.163+0000 7f006affd640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f005c078f20 0x7f005c07b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.163+0000 7f006affd640 1 -- 172.21.15.81:0/2665791582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f006c0bbd10 con 0x7f007c162480 2024-09-17T05:22:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.164+0000 7f007a59c640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f005c078f20 0x7f005c07b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.164+0000 7f007a59c640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f005c078f20 0x7f005c07b3e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0074005fd0 tx=0x7f007400b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.168+0000 7f006affd640 1 -- 172.21.15.81:0/2665791582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f006c083670 con 0x7f007c162480 2024-09-17T05:22:07.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.379+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f007c0d0e70 con 0x7f007c162480 2024-09-17T05:22:07.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.379+0000 7f006affd640 1 -- 172.21.15.81:0/2665791582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5226 (secure 0 0 0) 0x7f006c0880a0 con 0x7f007c162480 2024-09-17T05:22:07.380 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:07.381 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-17T05:21:56:005381+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1537992933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1537992933},{"type":"v1","addr":"172.21.15.160:6836","nonce":1537992933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5419,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3597720446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3597720446},{"type":"v1","addr":"172.21.15.160:6837","nonce":3597720446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/457781060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":457781060},{"type":"v1","addr":"172.21.15.81:6834","nonce":457781060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:41.304247+0000","modified":"2024-09-17T05:21:44.170675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1068882112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1068882112},{"type":"v1","addr":"172.21.15.81:6835","nonce":1068882112}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-09-17T05:22:07.381 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f005c078f20 msgr2=0x7f005c07b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f005c078f20 0x7f005c07b3e0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f0074005fd0 tx=0x7f007400b390 comp rx=0 tx=0).stop 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 msgr2=0x7f007c14daf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c14daf0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f006c034040 tx=0x7f006c003910 comp rx=0 tx=0).stop 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 shutdown_connections 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f005c078f20 0x7f005c07b3e0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f007c162480 0x7f007c14daf0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f007c15df90 0x7f007c150560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 --2- 172.21.15.81:0/2665791582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f007c0d49c0 0x7f007c0cd520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 >> 172.21.15.81:0/2665791582 conn(0x7f007c0d3ea0 msgr2=0x7f007c0b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 shutdown_connections 2024-09-17T05:22:07.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.381+0000 7f0080b75640 1 -- 172.21.15.81:0/2665791582 wait complete. 2024-09-17T05:22:07.393 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 -- 172.21.15.81:0/2265657436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d0d40 msgr2=0x7fa79c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2265657436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d0d40 0x7fa79c0cf9b0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7fa790009830 tx=0x7fa79002a480 comp rx=0 tx=0).stop 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 -- 172.21.15.81:0/2265657436 shutdown_connections 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2265657436 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa79c0d49c0 0x7fa79c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2265657436 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d0d40 0x7fa79c0cf9b0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 -- 172.21.15.81:0/2265657436 >> 172.21.15.81:0/2265657436 conn(0x7fa79c0d3ea0 msgr2=0x7fa79c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 -- 172.21.15.81:0/2265657436 shutdown_connections 2024-09-17T05:22:07.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.492+0000 7fa7a3524640 1 -- 172.21.15.81:0/2265657436 wait complete. 2024-09-17T05:22:07.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.493+0000 7fa7a3524640 1 Processor -- start 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a3524640 1 -- start start 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a3524640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa79c0d0d40 0x7fa79c1f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a3524640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d49c0 0x7fa79c0ccb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a3524640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa79c15df90 0x7fa79c0b4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a3524640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c162690 con 0x7fa79c0d49c0 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a3524640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa79c0b3d40 con 0x7fa79c15df90 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a3524640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa79c1f9430 con 0x7fa79c0d0d40 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a0abf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d49c0 0x7fa79c0ccb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a0abf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d49c0 0x7fa79c0ccb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50744/0 (socket says 172.21.15.81:50744) 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a0abf640 1 -- 172.21.15.81:0/2080889416 learned_addr learned my addr 172.21.15.81:0/2080889416 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:07.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.494+0000 7fa7a12c0640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa79c0d0d40 0x7fa79c1f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a1ac1640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa79c15df90 0x7fa79c0b4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a0abf640 1 -- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa79c0d0d40 msgr2=0x7fa79c1f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a0abf640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa79c0d0d40 0x7fa79c1f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a0abf640 1 -- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa79c15df90 msgr2=0x7fa79c0b4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a0abf640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa79c15df90 0x7fa79c0b4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a0abf640 1 -- 172.21.15.81:0/2080889416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa79c0cd0d0 con 0x7fa79c0d49c0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a1ac1640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa79c15df90 0x7fa79c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a0abf640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d49c0 0x7fa79c0ccb90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa790000c00 tx=0x7fa790032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa799ffb640 1 -- 172.21.15.81:0/2080889416 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa790040070 con 0x7fa79c0d49c0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa799ffb640 1 -- 172.21.15.81:0/2080889416 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa790003af0 con 0x7fa79c0d49c0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa799ffb640 1 -- 172.21.15.81:0/2080889416 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa790045460 con 0x7fa79c0d49c0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa79c1f8b90 con 0x7fa79c0d49c0 2024-09-17T05:22:07.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.495+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa79c1f50f0 con 0x7fa79c0d49c0 2024-09-17T05:22:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.496+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa79c0cf9b0 con 0x7fa79c0d49c0 2024-09-17T05:22:07.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.497+0000 7fa799ffb640 1 -- 172.21.15.81:0/2080889416 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fa790039040 con 0x7fa79c0d49c0 2024-09-17T05:22:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.497+0000 7fa799ffb640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa788078ef0 0x7fa78807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.498+0000 7fa799ffb640 1 -- 172.21.15.81:0/2080889416 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7fa7900bc8d0 con 0x7fa79c0d49c0 2024-09-17T05:22:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.498+0000 7fa7a12c0640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa788078ef0 0x7fa78807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.498+0000 7fa7a12c0640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa788078ef0 0x7fa78807b3b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa78c002200 tx=0x7fa78c0019f0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.502+0000 7fa799ffb640 1 -- 172.21.15.81:0/2080889416 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa790084880 con 0x7fa79c0d49c0 2024-09-17T05:22:07.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.711+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa79c0cacc0 con 0x7fa79c0d49c0 2024-09-17T05:22:07.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.711+0000 7fa799ffb640 1 -- 172.21.15.81:0/2080889416 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) ==== 94+0+5226 (secure 0 0 0) 0x7fa790084180 con 0x7fa79c0d49c0 2024-09-17T05:22:07.712 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:07.712 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":32,"btime":"2024-09-17T05:21:56:005381+0000","default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1537992933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1537992933},{"type":"v1","addr":"172.21.15.160:6836","nonce":1537992933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5419,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3597720446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3597720446},{"type":"v1","addr":"172.21.15.160:6837","nonce":3597720446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/457781060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":457781060},{"type":"v1","addr":"172.21.15.81:6834","nonce":457781060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:21:41.304247+0000","modified":"2024-09-17T05:21:44.170675+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":5757},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5757":{"gid":5757,"name":"c","rank":0,"incarnation":28,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1068882112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1068882112},{"type":"v1","addr":"172.21.15.81:6835","nonce":1068882112}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":5757,"qdb_cluster":[5757]},"id":4}]} 2024-09-17T05:22:07.713 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 32 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.713+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa788078ef0 msgr2=0x7fa78807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.713+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa788078ef0 0x7fa78807b3b0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fa78c002200 tx=0x7fa78c0019f0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.713+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d49c0 msgr2=0x7fa79c0ccb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.713+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d49c0 0x7fa79c0ccb90 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fa790000c00 tx=0x7fa790032d50 comp rx=0 tx=0).stop 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 shutdown_connections 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa788078ef0 0x7fa78807b3b0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa79c15df90 0x7fa79c0b4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa79c0d49c0 0x7fa79c0ccb90 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 --2- 172.21.15.81:0/2080889416 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa79c0d0d40 0x7fa79c1f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 >> 172.21.15.81:0/2080889416 conn(0x7fa79c0d3ea0 msgr2=0x7fa79c0b0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 shutdown_connections 2024-09-17T05:22:07.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.714+0000 7fa7a3524640 1 -- 172.21.15.81:0/2080889416 wait complete. 2024-09-17T05:22:07.726 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 -- 172.21.15.81:0/3241010161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 msgr2=0x7f62d0073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3241010161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d0073c20 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f62d006ec30 tx=0x7f62c802a8f0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 -- 172.21.15.81:0/3241010161 shutdown_connections 2024-09-17T05:22:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3241010161 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d0073c20 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3241010161 >> v2:172.21.15.160:3300/0 conn(0x7f62d015ad00 0x7f62d00736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 -- 172.21.15.81:0/3241010161 >> 172.21.15.81:0/3241010161 conn(0x7f62d00d0c20 msgr2=0x7f62d00d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 -- 172.21.15.81:0/3241010161 shutdown_connections 2024-09-17T05:22:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.825+0000 7f62d4dec640 1 -- 172.21.15.81:0/3241010161 wait complete. 2024-09-17T05:22:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.826+0000 7f62d4dec640 1 Processor -- start 2024-09-17T05:22:07.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.826+0000 7f62d4dec640 1 -- start start 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62d4dec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62d0074280 0x7f62d00b0cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62d4dec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d00b2d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62d4dec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d015ad00 0x7f62d0159340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62d4dec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f62d00d0820 con 0x7f62d00746e0 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62d4dec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f62d00d06a0 con 0x7f62d015ad00 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62d4dec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f62d00cef00 con 0x7f62d0074280 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d00b2d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d00b2d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50750/0 (socket says 172.21.15.81:50750) 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 -- 172.21.15.81:0/3448218102 learned_addr learned my addr 172.21.15.81:0/3448218102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62ced9d640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d015ad00 0x7f62d0159340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62ce59c640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62d0074280 0x7f62d00b0cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 -- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62d0074280 msgr2=0x7f62d00b0cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62d0074280 0x7f62d00b0cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 -- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d015ad00 msgr2=0x7f62d0159340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d015ad00 0x7f62d0159340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 -- 172.21.15.81:0/3448218102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62d01f1890 con 0x7f62d00746e0 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62ce59c640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62d0074280 0x7f62d00b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.827+0000 7f62cdd9b640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d00b2d70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e6b0 tx=0x7f62c400eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.828+0000 7f62beffd640 1 -- 172.21.15.81:0/3448218102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4015070 con 0x7f62d00746e0 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.828+0000 7f62beffd640 1 -- 172.21.15.81:0/3448218102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f62c4005360 con 0x7f62d00746e0 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.828+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62d01f1b70 con 0x7f62d00746e0 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.828+0000 7f62beffd640 1 -- 172.21.15.81:0/3448218102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f62c4001980 con 0x7f62d00746e0 2024-09-17T05:22:07.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.828+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f62d01f2130 con 0x7f62d00746e0 2024-09-17T05:22:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.829+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f62d00cf460 con 0x7f62d00746e0 2024-09-17T05:22:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.829+0000 7f62beffd640 1 -- 172.21.15.81:0/3448218102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f62c4018070 con 0x7f62d00746e0 2024-09-17T05:22:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.830+0000 7f62beffd640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f62b0078ef0 0x7f62b007b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.830+0000 7f62beffd640 1 -- 172.21.15.81:0/3448218102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f62c409d710 con 0x7f62d00746e0 2024-09-17T05:22:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.830+0000 7f62ce59c640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f62b0078ef0 0x7f62b007b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.830+0000 7f62ce59c640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f62b0078ef0 0x7f62b007b3b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62d00b66c0 tx=0x7f62c0008040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:07.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:07.834+0000 7f62beffd640 1 -- 172.21.15.81:0/3448218102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f62c4065640 con 0x7f62d00746e0 2024-09-17T05:22:08.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.008+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f62d006fed0 con 0x7f62d00746e0 2024-09-17T05:22:08.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.009+0000 7f62beffd640 1 -- 172.21.15.81:0/3448218102 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v58) ==== 74+0+16725 (secure 0 0 0) 0x7f62c4064f40 con 0x7f62d00746e0 2024-09-17T05:22:08.010 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:08.010 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":58,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:21:42.957747+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:21:39.914624+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"57","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2024-09-17T05:21:40.261517+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"58","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f62b0078ef0 msgr2=0x7f62b007b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f62b0078ef0 0x7f62b007b3b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f62d00b66c0 tx=0x7f62c0008040 comp rx=0 tx=0).stop 2024-09-17T05:22:08.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 msgr2=0x7f62d00b2d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d00b2d70 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f62c400e6b0 tx=0x7f62c400eb70 comp rx=0 tx=0).stop 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 shutdown_connections 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f62b0078ef0 0x7f62b007b3b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f62d015ad00 0x7f62d0159340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f62d00746e0 0x7f62d00b2d70 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 --2- 172.21.15.81:0/3448218102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f62d0074280 0x7f62d00b0cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 >> 172.21.15.81:0/3448218102 conn(0x7f62d00d0c20 msgr2=0x7f62d0071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 shutdown_connections 2024-09-17T05:22:08.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.011+0000 7f62d4dec640 1 -- 172.21.15.81:0/3448218102 wait complete. 2024-09-17T05:22:08.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.126+0000 7f128f8bd640 1 -- 172.21.15.81:0/2035981471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 msgr2=0x7f12880d0b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.126+0000 7f128f8bd640 1 --2- 172.21.15.81:0/2035981471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880d0b70 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f128808cf10 tx=0x7f128002aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.126+0000 7f128f8bd640 1 -- 172.21.15.81:0/2035981471 shutdown_connections 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.126+0000 7f128f8bd640 1 --2- 172.21.15.81:0/2035981471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880d0b70 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.127+0000 7f128f8bd640 1 --2- 172.21.15.81:0/2035981471 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12880d49c0 0x7f12880d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.127+0000 7f128f8bd640 1 --2- 172.21.15.81:0/2035981471 >> v2:172.21.15.160:3300/0 conn(0x7f128815df90 0x7f12880cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.127+0000 7f128f8bd640 1 -- 172.21.15.81:0/2035981471 >> 172.21.15.81:0/2035981471 conn(0x7f12880d3ea0 msgr2=0x7f12880d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:08.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.127+0000 7f128f8bd640 1 -- 172.21.15.81:0/2035981471 shutdown_connections 2024-09-17T05:22:08.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.127+0000 7f128f8bd640 1 -- 172.21.15.81:0/2035981471 wait complete. 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.128+0000 7f128f8bd640 1 Processor -- start 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.128+0000 7f128f8bd640 1 -- start start 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.128+0000 7f128f8bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12880d49c0 0x7f12881f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.128+0000 7f128f8bd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f128815df90 0x7f12880b14e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.128+0000 7f128f8bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880b1a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128f8bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12880b3b90 con 0x7f1288162480 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128f8bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f12880b3a10 con 0x7f12880d49c0 2024-09-17T05:22:08.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128f8bd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f12880b3d10 con 0x7f128815df90 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880b1a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880b1a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50760/0 (socket says 172.21.15.81:50760) 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 -- 172.21.15.81:0/4009055748 learned_addr learned my addr 172.21.15.81:0/4009055748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128d659640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12880d49c0 0x7f12881f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128ce58640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f128815df90 0x7f12880b14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 -- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f128815df90 msgr2=0x7f12880b14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f128815df90 0x7f12880b14e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 -- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12880d49c0 msgr2=0x7f12881f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12880d49c0 0x7f12881f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 -- 172.21.15.81:0/4009055748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12880caf70 con 0x7f1288162480 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128de5a640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880b1a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f128002b020 tx=0x7f1280003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:08.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f127dffb640 1 -- 172.21.15.81:0/4009055748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280033050 con 0x7f1288162480 2024-09-17T05:22:08.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f127dffb640 1 -- 172.21.15.81:0/4009055748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1280004450 con 0x7f1288162480 2024-09-17T05:22:08.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12880cb230 con 0x7f1288162480 2024-09-17T05:22:08.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f127dffb640 1 -- 172.21.15.81:0/4009055748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1280038450 con 0x7f1288162480 2024-09-17T05:22:08.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.129+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f128815b840 con 0x7f1288162480 2024-09-17T05:22:08.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.130+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12880cf9b0 con 0x7f1288162480 2024-09-17T05:22:08.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.131+0000 7f127dffb640 1 -- 172.21.15.81:0/4009055748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f1280036070 con 0x7f1288162480 2024-09-17T05:22:08.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.131+0000 7f127dffb640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f126c078ef0 0x7f126c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.132+0000 7f127dffb640 1 -- 172.21.15.81:0/4009055748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(58..58 src has 1..58) ==== 5709+0+0 (secure 0 0 0) 0x7f12800bc500 con 0x7f1288162480 2024-09-17T05:22:08.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.132+0000 7f128d659640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f126c078ef0 0x7f126c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.132+0000 7f128d659640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f126c078ef0 0x7f126c07b3b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1284009b50 tx=0x7f1284005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:08.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.136+0000 7f127dffb640 1 -- 172.21.15.81:0/4009055748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1280083df0 con 0x7f1288162480 2024-09-17T05:22:08.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.349+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1288159180 con 0x7f1288162480 2024-09-17T05:22:08.350 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:22:08.350+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:22:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.351+0000 7f127dffb640 1 -- 172.21.15.81:0/4009055748 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) ==== 161+0+0 (secure 0 0 0) 0x7f1280088820 con 0x7f1288162480 2024-09-17T05:22:08.352 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:22:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f126c078ef0 msgr2=0x7f126c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f126c078ef0 0x7f126c07b3b0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f1284009b50 tx=0x7f1284005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 msgr2=0x7f12880b1a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880b1a20 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f128002b020 tx=0x7f1280003f90 comp rx=0 tx=0).stop 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 shutdown_connections 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f126c078ef0 0x7f126c07b3b0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1288162480 0x7f12880b1a20 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f128815df90 0x7f12880b14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 --2- 172.21.15.81:0/4009055748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12880d49c0 0x7f12881f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 >> 172.21.15.81:0/4009055748 conn(0x7f12880d3ea0 msgr2=0x7f12880b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 shutdown_connections 2024-09-17T05:22:08.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.354+0000 7f128f8bd640 1 -- 172.21.15.81:0/4009055748 wait complete. 2024-09-17T05:22:08.367 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:22:08.391 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:22:08.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.470+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/2108037733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d04004080 msgr2=0x7f4d04004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.470+0000 7f4d1fe2a640 1 --2- 172.21.15.81:0/2108037733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d04004080 0x7f4d04004800 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f4d0800c260 tx=0x7f4d04005830 comp rx=0 tx=0).stop 2024-09-17T05:22:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.470+0000 7f4d1e3c7640 1 -- 172.21.15.81:0/2108037733 reap_dead start 2024-09-17T05:22:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.470+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/2108037733 shutdown_connections 2024-09-17T05:22:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.470+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/2108037733 >> 172.21.15.81:0/2108037733 conn(0x7f4d180b1700 msgr2=0x7f4d180b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.470+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/2108037733 shutdown_connections 2024-09-17T05:22:08.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.470+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/2108037733 wait complete. 2024-09-17T05:22:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.471+0000 7f4d1fe2a640 1 Processor -- start 2024-09-17T05:22:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.471+0000 7f4d1fe2a640 1 -- start start 2024-09-17T05:22:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1fe2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d04004080 0x7f4d180ce0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1fe2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d18140e50 0x7f4d181412d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1fe2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d181e7830 0x7f4d181e7cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1fe2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d180cac40 con 0x7f4d181e7830 2024-09-17T05:22:08.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1fe2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4d1806fe50 con 0x7f4d04004080 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1fe2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4d180cadc0 con 0x7f4d18140e50 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1e3c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d181e7830 0x7f4d181e7cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1e3c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d181e7830 0x7f4d181e7cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50802/0 (socket says 172.21.15.81:50802) 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.472+0000 7f4d1e3c7640 1 -- 172.21.15.81:0/1856022700 learned_addr learned my addr 172.21.15.81:0/1856022700 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1e3c7640 1 -- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d18140e50 msgr2=0x7f4d181412d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1dbc6640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d04004080 0x7f4d180ce0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1d3c5640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d18140e50 0x7f4d181412d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1e3c7640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d18140e50 0x7f4d181412d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1e3c7640 1 -- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d04004080 msgr2=0x7f4d180ce0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1e3c7640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d04004080 0x7f4d180ce0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1e3c7640 1 -- 172.21.15.81:0/1856022700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d180ce610 con 0x7f4d181e7830 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1e3c7640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d181e7830 0x7f4d181e7cb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4d100096b0 tx=0x7f4d10009b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:08.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d0e7fc640 1 -- 172.21.15.81:0/1856022700 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d10004b20 con 0x7f4d181e7830 2024-09-17T05:22:08.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d0e7fc640 1 -- 172.21.15.81:0/1856022700 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d10004dd0 con 0x7f4d181e7830 2024-09-17T05:22:08.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d0e7fc640 1 -- 172.21.15.81:0/1856022700 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d1000fac0 con 0x7f4d181e7830 2024-09-17T05:22:08.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d181f80b0 con 0x7f4d181e7830 2024-09-17T05:22:08.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.473+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d181f8670 con 0x7f4d181e7830 2024-09-17T05:22:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.474+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d180cc980 con 0x7f4d181e7830 2024-09-17T05:22:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.475+0000 7f4d0e7fc640 1 -- 172.21.15.81:0/1856022700 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f4d1001b020 con 0x7f4d181e7830 2024-09-17T05:22:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.475+0000 7f4d0e7fc640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cfc078ef0 0x7f4cfc07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.475+0000 7f4d0e7fc640 1 -- 172.21.15.81:0/1856022700 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5795+0+0 (secure 0 0 0) 0x7f4d1009b350 con 0x7f4d181e7830 2024-09-17T05:22:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.475+0000 7f4d1dbc6640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cfc078ef0 0x7f4cfc07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:08.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.476+0000 7f4d1dbc6640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cfc078ef0 0x7f4cfc07b3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005fd0 tx=0x7f4d1400e3a0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:08.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.479+0000 7f4d0e7fc640 1 -- 172.21.15.81:0/1856022700 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4d100632a0 con 0x7f4d181e7830 2024-09-17T05:22:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:08.694+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4d180c3440 con 0x7f4d181e7830 2024-09-17T05:22:09.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.352+0000 7f4d0e7fc640 1 -- 172.21.15.81:0/1856022700 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) ==== 104+0+0 (secure 0 0 0) 0x7f4d10062ba0 con 0x7f4d181e7830 2024-09-17T05:22:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cfc078ef0 msgr2=0x7f4cfc07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:09.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cfc078ef0 0x7f4cfc07b3b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f4d14005fd0 tx=0x7f4d1400e3a0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d181e7830 msgr2=0x7f4d181e7cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d181e7830 0x7f4d181e7cb0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f4d100096b0 tx=0x7f4d10009b70 comp rx=0 tx=0).stop 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 shutdown_connections 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f4cfc078ef0 0x7f4cfc07b3b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d181e7830 0x7f4d181e7cb0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d18140e50 0x7f4d181412d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 --2- 172.21.15.81:0/1856022700 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d04004080 0x7f4d180ce0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 >> 172.21.15.81:0/1856022700 conn(0x7f4d180b1700 msgr2=0x7f4d180b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 shutdown_connections 2024-09-17T05:22:09.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.355+0000 7f4d1fe2a640 1 -- 172.21.15.81:0/1856022700 wait complete. 2024-09-17T05:22:09.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:22:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 -- 172.21.15.81:0/43036560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 msgr2=0x7f6468072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 --2- 172.21.15.81:0/43036560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468072a10 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6468074d60 tx=0x7f645c02a560 comp rx=0 tx=0).stop 2024-09-17T05:22:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 -- 172.21.15.81:0/43036560 shutdown_connections 2024-09-17T05:22:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 --2- 172.21.15.81:0/43036560 >> v2:172.21.15.160:3300/0 conn(0x7f64680ae690 0x7f6468072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 --2- 172.21.15.81:0/43036560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468072a10 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 -- 172.21.15.81:0/43036560 >> 172.21.15.81:0/43036560 conn(0x7f64680b1620 msgr2=0x7f64680b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 -- 172.21.15.81:0/43036560 shutdown_connections 2024-09-17T05:22:09.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.516+0000 7f646f223640 1 -- 172.21.15.81:0/43036560 wait complete. 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.517+0000 7f646f223640 1 Processor -- start 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.517+0000 7f646f223640 1 -- start start 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f646f223640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64680ae690 0x7f6468154100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f646f223640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f646f223640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f646815d610 0x7f64680b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f646f223640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64680b2e50 con 0x7f64680aec50 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f646f223640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f64680b2cd0 con 0x7f64680ae690 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f646f223640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f64680b2fd0 con 0x7f646815d610 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468153140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50824/0 (socket says 172.21.15.81:50824) 2024-09-17T05:22:09.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 -- 172.21.15.81:0/443436850 learned_addr learned my addr 172.21.15.81:0/443436850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 -- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f646815d610 msgr2=0x7f64680b0270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f646815d610 0x7f64680b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 -- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64680ae690 msgr2=0x7f6468154100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64680ae690 0x7f6468154100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 -- 172.21.15.81:0/443436850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64681f53e0 con 0x7f64680aec50 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f6467fff640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468153140 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f645c02ab50 tx=0x7f645c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.518+0000 7f64657fa640 1 -- 172.21.15.81:0/443436850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c03f070 con 0x7f64680aec50 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.519+0000 7f64657fa640 1 -- 172.21.15.81:0/443436850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f645c004890 con 0x7f64680aec50 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.519+0000 7f64657fa640 1 -- 172.21.15.81:0/443436850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f645c035030 con 0x7f64680aec50 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.519+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64681f56c0 con 0x7f64680aec50 2024-09-17T05:22:09.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.519+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64681f5c80 con 0x7f64680aec50 2024-09-17T05:22:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.520+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f646815acb0 con 0x7f64680aec50 2024-09-17T05:22:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.520+0000 7f64657fa640 1 -- 172.21.15.81:0/443436850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f645c042070 con 0x7f64680aec50 2024-09-17T05:22:09.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.521+0000 7f64657fa640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6454078ef0 0x7f645407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.521+0000 7f64657fa640 1 -- 172.21.15.81:0/443436850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(59..59 src has 1..59) ==== 5795+0+0 (secure 0 0 0) 0x7f645c0bc210 con 0x7f64680aec50 2024-09-17T05:22:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.521+0000 7f646cfbf640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6454078ef0 0x7f645407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:09.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.521+0000 7f646cfbf640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6454078ef0 0x7f645407b3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6458006fd0 tx=0x7f6458006bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:09.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.525+0000 7f64657fa640 1 -- 172.21.15.81:0/443436850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f645c084160 con 0x7f64680aec50 2024-09-17T05:22:09.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:09.703+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f64680b3480 con 0x7f64680aec50 2024-09-17T05:22:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.357+0000 7f64657fa640 1 -- 172.21.15.81:0/443436850 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v60) ==== 181+0+0 (secure 0 0 0) 0x7f645c083a60 con 0x7f64680aec50 2024-09-17T05:22:10.358 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6454078ef0 msgr2=0x7f645407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6454078ef0 0x7f645407b3b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f6458006fd0 tx=0x7f6458006bc0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 msgr2=0x7f6468153140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468153140 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f645c02ab50 tx=0x7f645c0039e0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 shutdown_connections 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6454078ef0 0x7f645407b3b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f646815d610 0x7f64680b0270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64680aec50 0x7f6468153140 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 --2- 172.21.15.81:0/443436850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64680ae690 0x7f6468154100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 >> 172.21.15.81:0/443436850 conn(0x7f64680b1620 msgr2=0x7f646815e600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:10.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 shutdown_connections 2024-09-17T05:22:10.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.361+0000 7f646f223640 1 -- 172.21.15.81:0/443436850 wait complete. 2024-09-17T05:22:10.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:22:10.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.486+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2724950687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4004d40 msgr2=0x7f2ca40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.486+0000 7f2cc10fe640 1 --2- 172.21.15.81:0/2724950687 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2ca4004d40 0x7f2ca40051c0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f2cb4009e20 tx=0x7f2ca4005830 comp rx=0 tx=0).stop 2024-09-17T05:22:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.486+0000 7f2cbb59e640 1 -- 172.21.15.81:0/2724950687 reap_dead start 2024-09-17T05:22:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.486+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2724950687 shutdown_connections 2024-09-17T05:22:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.486+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2724950687 >> 172.21.15.81:0/2724950687 conn(0x7f2cbc0b1620 msgr2=0x7f2cbc0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.486+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2724950687 shutdown_connections 2024-09-17T05:22:10.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.486+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2724950687 wait complete. 2024-09-17T05:22:10.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 Processor -- start 2024-09-17T05:22:10.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 -- start start 2024-09-17T05:22:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cbc1e8e80 0x7f2cbc1596b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cbc146dc0 0x7f2cbc159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cbc1f4a00 0x7f2cbc1f4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc15d4b0 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2cbc15d330 con 0x7f2cbc146dc0 2024-09-17T05:22:10.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.488+0000 7f2cc10fe640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2cbc15d630 con 0x7f2cbc1f4a00 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cbc1e8e80 0x7f2cbc1596b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cbc1e8e80 0x7f2cbc1596b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50832/0 (socket says 172.21.15.81:50832) 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 -- 172.21.15.81:0/2658021325 learned_addr learned my addr 172.21.15.81:0/2658021325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cba59c640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cbc146dc0 0x7f2cbc159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbb59e640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cbc1f4a00 0x7f2cbc1f4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 -- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cbc1f4a00 msgr2=0x7f2cbc1f4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cbc1f4a00 0x7f2cbc1f4e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 -- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cbc146dc0 msgr2=0x7f2cbc159bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cbc146dc0 0x7f2cbc159bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 -- 172.21.15.81:0/2658021325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cbc1e9260 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cbad9d640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cbc1e8e80 0x7f2cbc1596b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e700 tx=0x7f2cac00ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:10.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2ca37fe640 1 -- 172.21.15.81:0/2658021325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac015070 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2ca37fe640 1 -- 172.21.15.81:0/2658021325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2cac00cad0 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2ca37fe640 1 -- 172.21.15.81:0/2658021325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cac011460 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cbc1f5780 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.489+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cbc1465c0 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.490+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cbc073170 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.491+0000 7f2ca37fe640 1 -- 172.21.15.81:0/2658021325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f2cac018070 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.492+0000 7f2ca37fe640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2ca8078f20 0x7f2ca807b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:10.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.492+0000 7f2ca37fe640 1 -- 172.21.15.81:0/2658021325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5357+0+0 (secure 0 0 0) 0x7f2cac09b780 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.492+0000 7f2cba59c640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2ca8078f20 0x7f2ca807b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:10.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.492+0000 7f2cba59c640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2ca8078f20 0x7f2ca807b3e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0cbab0 tx=0x7f2cb000d410 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:10.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.496+0000 7f2ca37fe640 1 -- 172.21.15.81:0/2658021325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2cac0630c0 con 0x7f2cbc1e8e80 2024-09-17T05:22:10.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:10.670+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f2cbc0b1ef0 con 0x7f2cbc1e8e80 2024-09-17T05:22:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.358+0000 7f2ca37fe640 1 -- 172.21.15.81:0/2658021325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v61) ==== 169+0+0 (secure 0 0 0) 0x7f2cac067af0 con 0x7f2cbc1e8e80 2024-09-17T05:22:11.360 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.361+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2ca8078f20 msgr2=0x7f2ca807b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.361+0000 7f2cc10fe640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2ca8078f20 0x7f2ca807b3e0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f2cbc0cbab0 tx=0x7f2cb000d410 comp rx=0 tx=0).stop 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cbc1e8e80 msgr2=0x7f2cbc1596b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cbc1e8e80 0x7f2cbc1596b0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e700 tx=0x7f2cac00ebc0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 shutdown_connections 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2ca8078f20 0x7f2ca807b3e0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2cbc1f4a00 0x7f2cbc1f4e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2cbc146dc0 0x7f2cbc159bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 --2- 172.21.15.81:0/2658021325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2cbc1e8e80 0x7f2cbc1596b0 secure :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f2cac00e700 tx=0x7f2cac00ebc0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 >> 172.21.15.81:0/2658021325 conn(0x7f2cbc0b1620 msgr2=0x7f2cbc15e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 shutdown_connections 2024-09-17T05:22:11.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.362+0000 7f2cc10fe640 1 -- 172.21.15.81:0/2658021325 wait complete. 2024-09-17T05:22:11.376 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:22:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.479+0000 7fd67557d640 1 -- 172.21.15.81:0/3649356550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 msgr2=0x7fd658003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.479+0000 7fd67557d640 1 --2- 172.21.15.81:0/3649356550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 0x7fd658003e20 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fd660005fd0 tx=0x7fd658005830 comp rx=0 tx=0).stop 2024-09-17T05:22:11.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.479+0000 7fd66f7fe640 1 -- 172.21.15.81:0/3649356550 reap_dead start 2024-09-17T05:22:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.479+0000 7fd67557d640 1 -- 172.21.15.81:0/3649356550 shutdown_connections 2024-09-17T05:22:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.479+0000 7fd67557d640 1 -- 172.21.15.81:0/3649356550 >> 172.21.15.81:0/3649356550 conn(0x7fd6700741f0 msgr2=0x7fd670074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.479+0000 7fd67557d640 1 -- 172.21.15.81:0/3649356550 shutdown_connections 2024-09-17T05:22:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.479+0000 7fd67557d640 1 -- 172.21.15.81:0/3649356550 wait complete. 2024-09-17T05:22:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.480+0000 7fd67557d640 1 Processor -- start 2024-09-17T05:22:11.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.480+0000 7fd67557d640 1 -- start start 2024-09-17T05:22:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd67557d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 0x7fd6700cf540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd67557d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd670158580 0x7fd67009ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd67557d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67009a870 0x7fd6701f5520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd67557d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6700cc290 con 0x7fd658003a00 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd67557d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd67015e670 con 0x7fd670158580 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd67557d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd6700cc410 con 0x7fd67009a870 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 0x7fd6700cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 0x7fd6700cf540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50844/0 (socket says 172.21.15.81:50844) 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66effd640 1 -- 172.21.15.81:0/978493075 learned_addr learned my addr 172.21.15.81:0/978493075 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66e7fc640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd670158580 0x7fd67009ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66f7fe640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67009a870 0x7fd6701f5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66effd640 1 -- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67009a870 msgr2=0x7fd6701f5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66effd640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67009a870 0x7fd6701f5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66effd640 1 -- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd670158580 msgr2=0x7fd67009ad50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.481+0000 7fd66effd640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd670158580 0x7fd67009ad50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.482+0000 7fd66effd640 1 -- 172.21.15.81:0/978493075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd670157520 con 0x7fd658003a00 2024-09-17T05:22:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.482+0000 7fd66effd640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 0x7fd6700cf540 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd660036040 tx=0x7fd6600336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.482+0000 7fd6577fe640 1 -- 172.21.15.81:0/978493075 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660038040 con 0x7fd658003a00 2024-09-17T05:22:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.482+0000 7fd6577fe640 1 -- 172.21.15.81:0/978493075 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd66002b630 con 0x7fd658003a00 2024-09-17T05:22:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.482+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6701577c0 con 0x7fd658003a00 2024-09-17T05:22:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.482+0000 7fd6577fe640 1 -- 172.21.15.81:0/978493075 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd660033b40 con 0x7fd658003a00 2024-09-17T05:22:11.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.482+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd670157d80 con 0x7fd658003a00 2024-09-17T05:22:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.483+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6700ce240 con 0x7fd658003a00 2024-09-17T05:22:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.483+0000 7fd6577fe640 1 -- 172.21.15.81:0/978493075 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fd660043030 con 0x7fd658003a00 2024-09-17T05:22:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.484+0000 7fd6577fe640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd65c078f20 0x7fd65c07b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.484+0000 7fd6577fe640 1 -- 172.21.15.81:0/978493075 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7fd6600badc0 con 0x7fd658003a00 2024-09-17T05:22:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.484+0000 7fd66e7fc640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd65c078f20 0x7fd65c07b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.485+0000 7fd66e7fc640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd65c078f20 0x7fd65c07b3e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd6700ca8b0 tx=0x7fd664005f30 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:11.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.488+0000 7fd6577fe640 1 -- 172.21.15.81:0/978493075 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd66004a060 con 0x7fd658003a00 2024-09-17T05:22:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.663+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fd670075070 con 0x7fd658003a00 2024-09-17T05:22:11.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.667+0000 7fd6577fe640 1 -- 172.21.15.81:0/978493075 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v33) ==== 71+0+0 (secure 0 0 0) 0x7fd66002b800 con 0x7fd658003a00 2024-09-17T05:22:11.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd65c078f20 msgr2=0x7fd65c07b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd65c078f20 0x7fd65c07b3e0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fd6700ca8b0 tx=0x7fd664005f30 comp rx=0 tx=0).stop 2024-09-17T05:22:11.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 msgr2=0x7fd6700cf540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 0x7fd6700cf540 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fd660036040 tx=0x7fd6600336f0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 shutdown_connections 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fd65c078f20 0x7fd65c07b3e0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd67009a870 0x7fd6701f5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd670158580 0x7fd67009ad50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 --2- 172.21.15.81:0/978493075 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd658003a00 0x7fd6700cf540 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 >> 172.21.15.81:0/978493075 conn(0x7fd6700741f0 msgr2=0x7fd6700c8460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 shutdown_connections 2024-09-17T05:22:11.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.669+0000 7fd67557d640 1 -- 172.21.15.81:0/978493075 wait complete. 2024-09-17T05:22:11.681 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:22:11.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.781+0000 7f764976b640 1 -- 172.21.15.81:0/3648163532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c004d90 msgr2=0x7f762c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.781+0000 7f764976b640 1 --2- 172.21.15.81:0/3648163532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f762c004d90 0x7f762c005210 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f76440b2d70 tx=0x7f762c005830 comp rx=0 tx=0).stop 2024-09-17T05:22:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.781+0000 7f76437fe640 1 -- 172.21.15.81:0/3648163532 reap_dead start 2024-09-17T05:22:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.781+0000 7f764976b640 1 -- 172.21.15.81:0/3648163532 shutdown_connections 2024-09-17T05:22:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.781+0000 7f764976b640 1 -- 172.21.15.81:0/3648163532 >> 172.21.15.81:0/3648163532 conn(0x7f764409aa30 msgr2=0x7f764409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.781+0000 7f764976b640 1 -- 172.21.15.81:0/3648163532 shutdown_connections 2024-09-17T05:22:11.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.781+0000 7f764976b640 1 -- 172.21.15.81:0/3648163532 wait complete. 2024-09-17T05:22:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 Processor -- start 2024-09-17T05:22:11.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 -- start start 2024-09-17T05:22:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c7d70 0x7f76440c8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644159c70 0x7f76440cb350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f764415a0f0 0x7f76440cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f764415fab0 con 0x7f76440c7d70 2024-09-17T05:22:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f764415f930 con 0x7f764415a0f0 2024-09-17T05:22:11.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f764976b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f76440b1240 con 0x7f7644159c70 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f7642ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c7d70 0x7f76440c8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f7642ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c7d70 0x7f76440c8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50860/0 (socket says 172.21.15.81:50860) 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.783+0000 7f7642ffd640 1 -- 172.21.15.81:0/4235241128 learned_addr learned my addr 172.21.15.81:0/4235241128 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f76437fe640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f764415a0f0 0x7f76440cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f76427fc640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644159c70 0x7f76440cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f7642ffd640 1 -- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644159c70 msgr2=0x7f76440cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f7642ffd640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644159c70 0x7f76440cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f7642ffd640 1 -- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f764415a0f0 msgr2=0x7f76440cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f7642ffd640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f764415a0f0 0x7f76440cb890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f7642ffd640 1 -- 172.21.15.81:0/4235241128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76440ca5d0 con 0x7f76440c7d70 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f7642ffd640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c7d70 0x7f76440c8dd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7634001890 tx=0x7f7634001d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:11.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f762b7fe640 1 -- 172.21.15.81:0/4235241128 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7634015070 con 0x7f76440c7d70 2024-09-17T05:22:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f762b7fe640 1 -- 172.21.15.81:0/4235241128 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7634003c60 con 0x7f76440c7d70 2024-09-17T05:22:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76441f6b70 con 0x7f76440c7d70 2024-09-17T05:22:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f762b7fe640 1 -- 172.21.15.81:0/4235241128 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f763400e9f0 con 0x7f76440c7d70 2024-09-17T05:22:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.784+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76440cab50 con 0x7f76440c7d70 2024-09-17T05:22:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.785+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76440b17d0 con 0x7f76440c7d70 2024-09-17T05:22:11.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.786+0000 7f762b7fe640 1 -- 172.21.15.81:0/4235241128 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f763400eb90 con 0x7f76440c7d70 2024-09-17T05:22:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.786+0000 7f762b7fe640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7630078f20 0x7f763007b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.786+0000 7f762b7fe640 1 -- 172.21.15.81:0/4235241128 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7f763409ba70 con 0x7f76440c7d70 2024-09-17T05:22:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.786+0000 7f76427fc640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7630078f20 0x7f763007b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:11.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.787+0000 7f76427fc640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7630078f20 0x7f763007b3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7638001db0 tx=0x7f7638001d40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:11.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:11.790+0000 7f762b7fe640 1 -- 172.21.15.81:0/4235241128 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7634063c20 con 0x7f76440c7d70 2024-09-17T05:22:12.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.034+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7f764409b360 con 0x7f76440c7d70 2024-09-17T05:22:12.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.363+0000 7f762b7fe640 1 -- 172.21.15.81:0/4235241128 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_malicious_metafile_on_legacy_to_v1_upgrade"]}]=0 v192) ==== 161+0+0 (secure 0 0 0) 0x7f7634063520 con 0x7f76440c7d70 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7630078f20 msgr2=0x7f763007b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7630078f20 0x7f763007b3e0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f7638001db0 tx=0x7f7638001d40 comp rx=0 tx=0).stop 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c7d70 msgr2=0x7f76440c8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c7d70 0x7f76440c8dd0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f7634001890 tx=0x7f7634001d50 comp rx=0 tx=0).stop 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 shutdown_connections 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7630078f20 0x7f763007b3e0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f764415a0f0 0x7f76440cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7644159c70 0x7f76440cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 --2- 172.21.15.81:0/4235241128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76440c7d70 0x7f76440c8dd0 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 >> 172.21.15.81:0/4235241128 conn(0x7f764409aa30 msgr2=0x7f764415d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:12.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 shutdown_connections 2024-09-17T05:22:12.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.366+0000 7f764976b640 1 -- 172.21.15.81:0/4235241128 wait complete. 2024-09-17T05:22:12.378 INFO:tasks.cephfs_test_runner:Validate handcrafted .meta file on legacy subvol root doesn't break the system ... ok 2024-09-17T05:22:12.379 INFO:tasks.cephfs_test_runner:Starting test: test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:22:12.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 -- 172.21.15.81:0/3248766832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f4151370 msgr2=0x7fe5f40cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 --2- 172.21.15.81:0/3248766832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f4151370 0x7fe5f40cef30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4005fd0 tx=0x7fe5e402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 -- 172.21.15.81:0/3248766832 shutdown_connections 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 --2- 172.21.15.81:0/3248766832 >> v2:172.21.15.160:3300/0 conn(0x7fe5f4072cb0 0x7fe5f40cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 --2- 172.21.15.81:0/3248766832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f4151370 0x7fe5f40cef30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 -- 172.21.15.81:0/3248766832 >> 172.21.15.81:0/3248766832 conn(0x7fe5f40b1690 msgr2=0x7fe5f40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 -- 172.21.15.81:0/3248766832 shutdown_connections 2024-09-17T05:22:12.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.480+0000 7fe5f995d640 1 -- 172.21.15.81:0/3248766832 wait complete. 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.481+0000 7fe5f995d640 1 Processor -- start 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f995d640 1 -- start start 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f995d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5f4072cb0 0x7fe5f4150380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f995d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f40b3140 0x7fe5f41f6df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f995d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f4151370 0x7fe5f413c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f995d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f406ec10 con 0x7fe5f4151370 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f995d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe5f406ea90 con 0x7fe5f4072cb0 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f995d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe5f406f9f0 con 0x7fe5f40b3140 2024-09-17T05:22:12.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.482+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f4151370 0x7fe5f413c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f4151370 0x7fe5f413c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50868/0 (socket says 172.21.15.81:50868) 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 -- 172.21.15.81:0/1161058794 learned_addr learned my addr 172.21.15.81:0/1161058794 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f27fc640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f40b3140 0x7fe5f41f6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f2ffd640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5f4072cb0 0x7fe5f4150380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 -- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f40b3140 msgr2=0x7fe5f41f6df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f40b3140 0x7fe5f41f6df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 -- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5f4072cb0 msgr2=0x7fe5f4150380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5f4072cb0 0x7fe5f4150380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 -- 172.21.15.81:0/1161058794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5f41509f0 con 0x7fe5f4151370 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f37fe640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f4151370 0x7fe5f413c340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009cf0 tx=0x7fe5ec00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:12.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5dbfff640 1 -- 172.21.15.81:0/1161058794 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec003b70 con 0x7fe5f4151370 2024-09-17T05:22:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5dbfff640 1 -- 172.21.15.81:0/1161058794 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe5ec003e00 con 0x7fe5f4151370 2024-09-17T05:22:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5f413b860 con 0x7fe5f4151370 2024-09-17T05:22:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5dbfff640 1 -- 172.21.15.81:0/1161058794 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5ec004280 con 0x7fe5f4151370 2024-09-17T05:22:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.483+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5f413be20 con 0x7fe5f4151370 2024-09-17T05:22:12.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.484+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5f40725a0 con 0x7fe5f4151370 2024-09-17T05:22:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.485+0000 7fe5dbfff640 1 -- 172.21.15.81:0/1161058794 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fe5ec004420 con 0x7fe5f4151370 2024-09-17T05:22:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.485+0000 7fe5dbfff640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe5e0078ef0 0x7fe5e007b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.485+0000 7fe5dbfff640 1 -- 172.21.15.81:0/1161058794 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7fe5ec09be00 con 0x7fe5f4151370 2024-09-17T05:22:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.485+0000 7fe5f2ffd640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe5e0078ef0 0x7fe5e007b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:12.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.486+0000 7fe5f2ffd640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe5e0078ef0 0x7fe5e007b3b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4033000 tx=0x7fe5e4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:12.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.489+0000 7fe5dbfff640 1 -- 172.21.15.81:0/1161058794 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe5ec063a70 con 0x7fe5f4151370 2024-09-17T05:22:12.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.663+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5f4070f10 con 0x7fe5f4151370 2024-09-17T05:22:12.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.664+0000 7fe5dbfff640 1 -- 172.21.15.81:0/1161058794 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) ==== 74+0+13032 (secure 0 0 0) 0x7fe5ec0684a0 con 0x7fe5f4151370 2024-09-17T05:22:12.665 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:12.665 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":61,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:11.358555+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/1068882112":"2024-09-18T05:22:08.350804+0000","172.21.15.81:6833/1068882112":"2024-09-18T05:22:08.350804+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:12.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe5e0078ef0 msgr2=0x7fe5e007b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe5e0078ef0 0x7fe5e007b3b0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe5e4033000 tx=0x7fe5e4004730 comp rx=0 tx=0).stop 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f4151370 msgr2=0x7fe5f413c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f4151370 0x7fe5f413c340 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe5ec009cf0 tx=0x7fe5ec00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 shutdown_connections 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe5e0078ef0 0x7fe5e007b3b0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5f4151370 0x7fe5f413c340 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5f40b3140 0x7fe5f41f6df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 --2- 172.21.15.81:0/1161058794 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe5f4072cb0 0x7fe5f4150380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.666+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 >> 172.21.15.81:0/1161058794 conn(0x7fe5f40b1690 msgr2=0x7fe5f4151a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:12.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.667+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 shutdown_connections 2024-09-17T05:22:12.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.667+0000 7fe5f995d640 1 -- 172.21.15.81:0/1161058794 wait complete. 2024-09-17T05:22:12.678 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:22:12.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:22:12.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.783+0000 7fa46f132640 1 -- 172.21.15.81:0/3669497323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454003a30 msgr2=0x7fa454003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.783+0000 7fa46f132640 1 --2- 172.21.15.81:0/3669497323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa454003a30 0x7fa454003e50 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fa45800c630 tx=0x7fa454005830 comp rx=0 tx=0).stop 2024-09-17T05:22:12.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.783+0000 7fa46d6cf640 1 -- 172.21.15.81:0/3669497323 reap_dead start 2024-09-17T05:22:12.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.783+0000 7fa46f132640 1 -- 172.21.15.81:0/3669497323 shutdown_connections 2024-09-17T05:22:12.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.783+0000 7fa46f132640 1 -- 172.21.15.81:0/3669497323 >> 172.21.15.81:0/3669497323 conn(0x7fa4680d1bb0 msgr2=0x7fa4680d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:12.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.783+0000 7fa46f132640 1 -- 172.21.15.81:0/3669497323 shutdown_connections 2024-09-17T05:22:12.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.783+0000 7fa46f132640 1 -- 172.21.15.81:0/3669497323 wait complete. 2024-09-17T05:22:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.784+0000 7fa46f132640 1 Processor -- start 2024-09-17T05:22:12.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.784+0000 7fa46f132640 1 -- start start 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa46f132640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa454003a30 0x7fa468154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa46f132640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa468158f40 0x7fa4680c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa46f132640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4680c6330 0x7fa4680c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa46f132640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa468164d50 con 0x7fa468158f40 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa46f132640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa468164bd0 con 0x7fa4680c6330 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa46f132640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa468164ed0 con 0x7fa454003a30 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa468158f40 0x7fa4680c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa468158f40 0x7fa4680c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50886/0 (socket says 172.21.15.81:50886) 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 -- 172.21.15.81:0/4186609044 learned_addr learned my addr 172.21.15.81:0/4186609044 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:12.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 -- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa454003a30 msgr2=0x7fa468154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa454003a30 0x7fa468154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 -- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4680c6330 msgr2=0x7fa4680c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa46d6cf640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4680c6330 0x7fa4680c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4680c6330 0x7fa4680c7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 -- 172.21.15.81:0/4186609044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4681555c0 con 0x7fa468158f40 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.785+0000 7fa467fff640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa468158f40 0x7fa4680c5df0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa450003f50 tx=0x7fa4500016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.786+0000 7fa4657fa640 1 -- 172.21.15.81:0/4186609044 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450011640 con 0x7fa468158f40 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.786+0000 7fa4657fa640 1 -- 172.21.15.81:0/4186609044 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa450016020 con 0x7fa468158f40 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.786+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa46815e5f0 con 0x7fa468158f40 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.786+0000 7fa4657fa640 1 -- 172.21.15.81:0/4186609044 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa450011a60 con 0x7fa468158f40 2024-09-17T05:22:12.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.786+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa46815ebb0 con 0x7fa468158f40 2024-09-17T05:22:12.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.787+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4680c6740 con 0x7fa468158f40 2024-09-17T05:22:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.787+0000 7fa4657fa640 1 -- 172.21.15.81:0/4186609044 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fa450011c00 con 0x7fa468158f40 2024-09-17T05:22:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.788+0000 7fa4657fa640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa448078f20 0x7fa44807b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.788+0000 7fa4657fa640 1 -- 172.21.15.81:0/4186609044 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7fa45009bc60 con 0x7fa468158f40 2024-09-17T05:22:12.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.788+0000 7fa46cece640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa448078f20 0x7fa44807b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.788+0000 7fa46cece640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa448078f20 0x7fa44807b3e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa458033000 tx=0x7fa4680b1af0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:12.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.792+0000 7fa4657fa640 1 -- 172.21.15.81:0/4186609044 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa450020020 con 0x7fa468158f40 2024-09-17T05:22:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.967+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa46815b130 con 0x7fa468158f40 2024-09-17T05:22:12.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.967+0000 7fa4657fa640 1 -- 172.21.15.81:0/4186609044 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) ==== 93+0+10 (secure 0 0 0) 0x7fa450063f10 con 0x7fa468158f40 2024-09-17T05:22:12.969 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.969+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa448078f20 msgr2=0x7fa44807b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.969+0000 7fa46f132640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa448078f20 0x7fa44807b3e0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fa458033000 tx=0x7fa4680b1af0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa468158f40 msgr2=0x7fa4680c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa468158f40 0x7fa4680c5df0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fa450003f50 tx=0x7fa4500016f0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 shutdown_connections 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa448078f20 0x7fa44807b3e0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4680c6330 0x7fa4680c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa468158f40 0x7fa4680c5df0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 --2- 172.21.15.81:0/4186609044 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa454003a30 0x7fa468154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 >> 172.21.15.81:0/4186609044 conn(0x7fa4680d1bb0 msgr2=0x7fa4680cdc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:12.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 shutdown_connections 2024-09-17T05:22:12.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:12.970+0000 7fa46f132640 1 -- 172.21.15.81:0/4186609044 wait complete. 2024-09-17T05:22:12.981 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-17T05:22:13.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 -- 172.21.15.81:0/3005044072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1881596b0 msgr2=0x7fe1880b4890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/3005044072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1881596b0 0x7fe1880b4890 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7fe1880d0aa0 tx=0x7fe18002a480 comp rx=0 tx=0).stop 2024-09-17T05:22:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 -- 172.21.15.81:0/3005044072 shutdown_connections 2024-09-17T05:22:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/3005044072 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe18815cbe0 0x7fe1880cff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/3005044072 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1881596b0 0x7fe1880b4890 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 -- 172.21.15.81:0/3005044072 >> 172.21.15.81:0/3005044072 conn(0x7fe18806cf60 msgr2=0x7fe18806d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 -- 172.21.15.81:0/3005044072 shutdown_connections 2024-09-17T05:22:13.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.082+0000 7fe18ccd6640 1 -- 172.21.15.81:0/3005044072 wait complete. 2024-09-17T05:22:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.083+0000 7fe18ccd6640 1 Processor -- start 2024-09-17T05:22:13.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.083+0000 7fe18ccd6640 1 -- start start 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe18ccd6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1880d0480 0x7fe188151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe18ccd6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1881596b0 0x7fe188153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe18ccd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18815cbe0 0x7fe1880b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe18ccd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe18815fe40 con 0x7fe18815cbe0 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe18ccd6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe1880734e0 con 0x7fe1881596b0 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe18ccd6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe18815ffc0 con 0x7fe1880d0480 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe186d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18815cbe0 0x7fe1880b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe186d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18815cbe0 0x7fe1880b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:50898/0 (socket says 172.21.15.81:50898) 2024-09-17T05:22:13.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe186d9d640 1 -- 172.21.15.81:0/2028507420 learned_addr learned my addr 172.21.15.81:0/2028507420 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe18659c640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1880d0480 0x7fe188151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe185d9b640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1881596b0 0x7fe188153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe186d9d640 1 -- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1880d0480 msgr2=0x7fe188151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe186d9d640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1880d0480 0x7fe188151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe186d9d640 1 -- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1881596b0 msgr2=0x7fe188153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.084+0000 7fe186d9d640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1881596b0 0x7fe188153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe186d9d640 1 -- 172.21.15.81:0/2028507420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe188150e90 con 0x7fe18815cbe0 2024-09-17T05:22:13.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe185d9b640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1881596b0 0x7fe188153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe186d9d640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18815cbe0 0x7fe1880b1e30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c780 tx=0x7fe17800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe17effd640 1 -- 172.21.15.81:0/2028507420 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178017070 con 0x7fe18815cbe0 2024-09-17T05:22:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe17effd640 1 -- 172.21.15.81:0/2028507420 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe178005070 con 0x7fe18815cbe0 2024-09-17T05:22:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe17effd640 1 -- 172.21.15.81:0/2028507420 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe178005500 con 0x7fe18815cbe0 2024-09-17T05:22:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe188151130 con 0x7fe18815cbe0 2024-09-17T05:22:13.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.085+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1881516f0 con 0x7fe18815cbe0 2024-09-17T05:22:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.086+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1881604d0 con 0x7fe18815cbe0 2024-09-17T05:22:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.087+0000 7fe17effd640 1 -- 172.21.15.81:0/2028507420 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fe17801a070 con 0x7fe18815cbe0 2024-09-17T05:22:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.087+0000 7fe17effd640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe168078ef0 0x7fe16807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.087+0000 7fe17effd640 1 -- 172.21.15.81:0/2028507420 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7fe17809a570 con 0x7fe18815cbe0 2024-09-17T05:22:13.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.087+0000 7fe18659c640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe168078ef0 0x7fe16807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.088+0000 7fe18659c640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe168078ef0 0x7fe16807b3b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe180034000 tx=0x7fe180004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.092+0000 7fe17effd640 1 -- 172.21.15.81:0/2028507420 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe178062260 con 0x7fe18815cbe0 2024-09-17T05:22:13.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.345+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7fe18815c220 con 0x7fe18815cbe0 2024-09-17T05:22:13.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.364+0000 7fe17effd640 1 -- 172.21.15.81:0/2028507420 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v193) ==== 134+0+0 (secure 0 0 0) 0x7fe178067e20 con 0x7fe18815cbe0 2024-09-17T05:22:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.366+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe168078ef0 msgr2=0x7fe16807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.366+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe168078ef0 0x7fe16807b3b0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fe180034000 tx=0x7fe180004730 comp rx=0 tx=0).stop 2024-09-17T05:22:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.366+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18815cbe0 msgr2=0x7fe1880b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18815cbe0 0x7fe1880b1e30 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fe17800c780 tx=0x7fe17800cc40 comp rx=0 tx=0).stop 2024-09-17T05:22:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 shutdown_connections 2024-09-17T05:22:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fe168078ef0 0x7fe16807b3b0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe18815cbe0 0x7fe1880b1e30 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe1881596b0 0x7fe188153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 --2- 172.21.15.81:0/2028507420 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1880d0480 0x7fe188151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 >> 172.21.15.81:0/2028507420 conn(0x7fe18806cf60 msgr2=0x7fe188159ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:13.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 shutdown_connections 2024-09-17T05:22:13.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.367+0000 7fe18ccd6640 1 -- 172.21.15.81:0/2028507420 wait complete. 2024-09-17T05:22:13.378 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:22:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.479+0000 7fbf28707640 1 -- 172.21.15.81:0/3656537253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 msgr2=0x7fbf200703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.479+0000 7fbf28707640 1 --2- 172.21.15.81:0/3656537253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf200703f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fbf2006ee40 tx=0x7fbf1802a820 comp rx=0 tx=0).stop 2024-09-17T05:22:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.480+0000 7fbf28707640 1 -- 172.21.15.81:0/3656537253 shutdown_connections 2024-09-17T05:22:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.480+0000 7fbf28707640 1 --2- 172.21.15.81:0/3656537253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf200703f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.480+0000 7fbf28707640 1 --2- 172.21.15.81:0/3656537253 >> v2:172.21.15.160:3300/0 conn(0x7fbf200735a0 0x7fbf200739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.480+0000 7fbf28707640 1 -- 172.21.15.81:0/3656537253 >> 172.21.15.81:0/3656537253 conn(0x7fbf200b1690 msgr2=0x7fbf200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:13.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.480+0000 7fbf28707640 1 -- 172.21.15.81:0/3656537253 shutdown_connections 2024-09-17T05:22:13.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.480+0000 7fbf28707640 1 -- 172.21.15.81:0/3656537253 wait complete. 2024-09-17T05:22:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.481+0000 7fbf28707640 1 Processor -- start 2024-09-17T05:22:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.481+0000 7fbf28707640 1 -- start start 2024-09-17T05:22:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf201f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf200735a0 0x7fbf20158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2015aa70 0x7fbf201f16d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbf200cd060 con 0x7fbf2006ff80 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbf200ccee0 con 0x7fbf2015aa70 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbf200cd1e0 con 0x7fbf200735a0 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf201f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf201f4e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41134/0 (socket says 172.21.15.81:41134) 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 -- 172.21.15.81:0/1383888120 learned_addr learned my addr 172.21.15.81:0/1383888120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf26ca4640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2015aa70 0x7fbf201f16d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf25ca2640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf200735a0 0x7fbf20158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 -- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf200735a0 msgr2=0x7fbf20158060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf200735a0 0x7fbf20158060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 -- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2015aa70 msgr2=0x7fbf201f16d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2015aa70 0x7fbf201f16d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 -- 172.21.15.81:0/1383888120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf20158790 con 0x7fbf2006ff80 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf264a3640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf201f4e70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c3c0 tx=0x7fbf1c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf16ffd640 1 -- 172.21.15.81:0/1383888120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c017070 con 0x7fbf2006ff80 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf16ffd640 1 -- 172.21.15.81:0/1383888120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbf1c0035f0 con 0x7fbf2006ff80 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf20158a70 con 0x7fbf2006ff80 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf16ffd640 1 -- 172.21.15.81:0/1383888120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf1c003a80 con 0x7fbf2006ff80 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.482+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf20159030 con 0x7fbf2006ff80 2024-09-17T05:22:13.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.483+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf200703f0 con 0x7fbf2006ff80 2024-09-17T05:22:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.484+0000 7fbf16ffd640 1 -- 172.21.15.81:0/1383888120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fbf1c01a070 con 0x7fbf2006ff80 2024-09-17T05:22:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.484+0000 7fbf16ffd640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbf04078ef0 0x7fbf0407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.484+0000 7fbf16ffd640 1 -- 172.21.15.81:0/1383888120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7fbf1c09a220 con 0x7fbf2006ff80 2024-09-17T05:22:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.484+0000 7fbf25ca2640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbf04078ef0 0x7fbf0407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.485+0000 7fbf25ca2640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbf04078ef0 0x7fbf0407b3b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbf10005fd0 tx=0x7fbf10005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.488+0000 7fbf16ffd640 1 -- 172.21.15.81:0/1383888120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbf1c061e80 con 0x7fbf2006ff80 2024-09-17T05:22:13.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.665+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fbf200cf280 con 0x7fbf2006ff80 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.665+0000 7fbf16ffd640 1 -- 172.21.15.81:0/1383888120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v33) ==== 59+0+1998 (secure 0 0 0) 0x7fbf1c0668b0 con 0x7fbf2006ff80 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:22:13.669 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:22:13.670 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:22:13.671 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:22:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbf04078ef0 msgr2=0x7fbf0407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbf04078ef0 0x7fbf0407b3b0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fbf10005fd0 tx=0x7fbf10005850 comp rx=0 tx=0).stop 2024-09-17T05:22:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 msgr2=0x7fbf201f4e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf201f4e70 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fbf1c00c3c0 tx=0x7fbf1c00c880 comp rx=0 tx=0).stop 2024-09-17T05:22:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 shutdown_connections 2024-09-17T05:22:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbf04078ef0 0x7fbf0407b3b0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbf2015aa70 0x7fbf201f16d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbf200735a0 0x7fbf20158060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 --2- 172.21.15.81:0/1383888120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbf2006ff80 0x7fbf201f4e70 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 >> 172.21.15.81:0/1383888120 conn(0x7fbf200b1690 msgr2=0x7fbf200ce660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 shutdown_connections 2024-09-17T05:22:13.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.668+0000 7fbf28707640 1 -- 172.21.15.81:0/1383888120 wait complete. 2024-09-17T05:22:13.679 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:22:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.782+0000 7f90b2c08640 1 -- 172.21.15.81:0/577502116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 msgr2=0x7f9094004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.782+0000 7f90b2c08640 1 --2- 172.21.15.81:0/577502116 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 0x7f9094004800 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f90a000c610 tx=0x7f9094005830 comp rx=0 tx=0).stop 2024-09-17T05:22:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.782+0000 7f90b11a5640 1 -- 172.21.15.81:0/577502116 reap_dead start 2024-09-17T05:22:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.782+0000 7f90b2c08640 1 -- 172.21.15.81:0/577502116 shutdown_connections 2024-09-17T05:22:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.782+0000 7f90b2c08640 1 -- 172.21.15.81:0/577502116 >> 172.21.15.81:0/577502116 conn(0x7f90ac0b1700 msgr2=0x7f90ac0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.782+0000 7f90b2c08640 1 -- 172.21.15.81:0/577502116 shutdown_connections 2024-09-17T05:22:13.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.782+0000 7f90b2c08640 1 -- 172.21.15.81:0/577502116 wait complete. 2024-09-17T05:22:13.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.784+0000 7f90b2c08640 1 Processor -- start 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.784+0000 7f90b2c08640 1 -- start start 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.784+0000 7f90b2c08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 0x7f90ac0c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.784+0000 7f90b2c08640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90ac0c8020 0x7f90ac0c84a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b2c08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90ac0b5090 0x7f90ac0b5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b2c08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0ccb90 con 0x7f9094004000 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b2c08640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f90ac0cca10 con 0x7f90ac0c8020 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b2c08640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f90ac06f410 con 0x7f90ac0b5090 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 0x7f90ac0c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 0x7f90ac0c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41154/0 (socket says 172.21.15.81:41154) 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 -- 172.21.15.81:0/2039021838 learned_addr learned my addr 172.21.15.81:0/2039021838 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90abfff640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90ac0c8020 0x7f90ac0c84a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b11a5640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90ac0b5090 0x7f90ac0b5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 -- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90ac0b5090 msgr2=0x7f90ac0b5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90ac0b5090 0x7f90ac0b5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 -- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90ac0c8020 msgr2=0x7f90ac0c84a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90ac0c8020 0x7f90ac0c84a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 -- 172.21.15.81:0/2039021838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90ac0c3e70 con 0x7f9094004000 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90abfff640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90ac0c8020 0x7f90ac0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b09a4640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 0x7f90ac0c3930 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f909c001540 tx=0x7f909c001940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90a97fa640 1 -- 172.21.15.81:0/2039021838 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c013720 con 0x7f9094004000 2024-09-17T05:22:13.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90a97fa640 1 -- 172.21.15.81:0/2039021838 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f909c018020 con 0x7f9094004000 2024-09-17T05:22:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90ac156610 con 0x7f9094004000 2024-09-17T05:22:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90a97fa640 1 -- 172.21.15.81:0/2039021838 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f909c013b20 con 0x7f9094004000 2024-09-17T05:22:13.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.785+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90ac156bd0 con 0x7f9094004000 2024-09-17T05:22:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.786+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90ac157d90 con 0x7f9094004000 2024-09-17T05:22:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.787+0000 7f90a97fa640 1 -- 172.21.15.81:0/2039021838 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f909c013cc0 con 0x7f9094004000 2024-09-17T05:22:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.787+0000 7f90a97fa640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9098078ef0 0x7f909807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.788+0000 7f90a97fa640 1 -- 172.21.15.81:0/2039021838 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7f909c09e0f0 con 0x7f9094004000 2024-09-17T05:22:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.788+0000 7f90abfff640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9098078ef0 0x7f909807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:13.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.788+0000 7f90abfff640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9098078ef0 0x7f909807b3b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f90a0033000 tx=0x7f90a0001bc0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:13.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.792+0000 7f90a97fa640 1 -- 172.21.15.81:0/2039021838 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f909c022020 con 0x7f9094004000 2024-09-17T05:22:13.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.967+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f90ac157ab0 con 0x7f9094004000 2024-09-17T05:22:13.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.970+0000 7f90a97fa640 1 -- 172.21.15.81:0/2039021838 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7f90ac0c3e70 con 0x7f9094004000 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9098078ef0 msgr2=0x7f909807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9098078ef0 0x7f909807b3b0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f90a0033000 tx=0x7f90a0001bc0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 msgr2=0x7f90ac0c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 0x7f90ac0c3930 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f909c001540 tx=0x7f909c001940 comp rx=0 tx=0).stop 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 shutdown_connections 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9098078ef0 0x7f909807b3b0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90ac0b5090 0x7f90ac0b5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90ac0c8020 0x7f90ac0c84a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.972+0000 7f90b2c08640 1 --2- 172.21.15.81:0/2039021838 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9094004000 0x7f90ac0c3930 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:13.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.973+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 >> 172.21.15.81:0/2039021838 conn(0x7f90ac0b1700 msgr2=0x7f90ac06f920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.973+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 shutdown_connections 2024-09-17T05:22:13.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:13.973+0000 7f90b2c08640 1 -- 172.21.15.81:0/2039021838 wait complete. 2024-09-17T05:22:13.985 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:22:13.985 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:14.035 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:14.085 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:22:14.086 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:14.086 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:14.102 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:14.102 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:14.102 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:14.121 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:14.121 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:14.121 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:14.157 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:14.158 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:14.158 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:14.179 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:14.179 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:22:14.179 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.299+0000 7fa30a394640 1 -- 172.21.15.81:0/902026418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ec005e50 msgr2=0x7fa2ec0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.299+0000 7fa30a394640 1 --2- 172.21.15.81:0/902026418 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2ec005e50 0x7fa2ec0062d0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fa2fc009ed0 tx=0x7fa2ec006940 comp rx=0 tx=0).stop 2024-09-17T05:22:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.299+0000 7fa308931640 1 -- 172.21.15.81:0/902026418 reap_dead start 2024-09-17T05:22:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.299+0000 7fa30a394640 1 -- 172.21.15.81:0/902026418 shutdown_connections 2024-09-17T05:22:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.299+0000 7fa30a394640 1 -- 172.21.15.81:0/902026418 >> 172.21.15.81:0/902026418 conn(0x7fa3040b1690 msgr2=0x7fa3040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.299+0000 7fa30a394640 1 -- 172.21.15.81:0/902026418 shutdown_connections 2024-09-17T05:22:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.299+0000 7fa30a394640 1 -- 172.21.15.81:0/902026418 wait complete. 2024-09-17T05:22:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.300+0000 7fa30a394640 1 Processor -- start 2024-09-17T05:22:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.300+0000 7fa30a394640 1 -- start start 2024-09-17T05:22:14.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa30a394640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2ec005e50 0x7fa30414ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa30a394640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041473f0 0x7fa3040a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa30a394640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3040a9c70 0x7fa3040cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa30a394640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa30406e760 con 0x7fa3041473f0 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa30a394640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa30406e5e0 con 0x7fa2ec005e50 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa30a394640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa30406e8e0 con 0x7fa3040a9c70 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa3037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041473f0 0x7fa3040a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa3037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041473f0 0x7fa3040a9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41168/0 (socket says 172.21.15.81:41168) 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa3037fe640 1 -- 172.21.15.81:0/712778322 learned_addr learned my addr 172.21.15.81:0/712778322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa308931640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3040a9c70 0x7fa3040cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.301+0000 7fa303fff640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2ec005e50 0x7fa30414ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa3037fe640 1 -- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3040a9c70 msgr2=0x7fa3040cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa3037fe640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3040a9c70 0x7fa3040cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa3037fe640 1 -- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2ec005e50 msgr2=0x7fa30414ef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa3037fe640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2ec005e50 0x7fa30414ef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa3037fe640 1 -- 172.21.15.81:0/712778322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3040aa180 con 0x7fa3041473f0 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa308931640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3040a9c70 0x7fa3040cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa303fff640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2ec005e50 0x7fa30414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa3037fe640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041473f0 0x7fa3040a9730 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80065e0 tx=0x7fa2f80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa300ff9640 1 -- 172.21.15.81:0/712778322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f8015070 con 0x7fa3041473f0 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa300ff9640 1 -- 172.21.15.81:0/712778322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa2f800f980 con 0x7fa3041473f0 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3040aa460 con 0x7fa3041473f0 2024-09-17T05:22:14.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa300ff9640 1 -- 172.21.15.81:0/712778322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2f800fdd0 con 0x7fa3041473f0 2024-09-17T05:22:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.302+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa30414d830 con 0x7fa3041473f0 2024-09-17T05:22:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.303+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3040cf360 con 0x7fa3041473f0 2024-09-17T05:22:14.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.303+0000 7fa300ff9640 1 -- 172.21.15.81:0/712778322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fa2f8011430 con 0x7fa3041473f0 2024-09-17T05:22:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.304+0000 7fa300ff9640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2f0078f20 0x7fa2f007b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.304+0000 7fa300ff9640 1 -- 172.21.15.81:0/712778322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7fa2f809bea0 con 0x7fa3041473f0 2024-09-17T05:22:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.304+0000 7fa303fff640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2f0078f20 0x7fa2f007b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.305+0000 7fa303fff640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2f0078f20 0x7fa2f007b3e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009b40 tx=0x7fa2f4005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:14.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.308+0000 7fa300ff9640 1 -- 172.21.15.81:0/712778322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa2f8064060 con 0x7fa3041473f0 2024-09-17T05:22:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.520+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa3040b2480 con 0x7fa3041473f0 2024-09-17T05:22:14.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.521+0000 7fa300ff9640 1 -- 172.21.15.81:0/712778322 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+3914 (secure 0 0 0) 0x7fa2f8063960 con 0x7fa3041473f0 2024-09-17T05:22:14.522 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:14.522 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":34,"btime":"2024-09-17T05:22:09:352501+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5416,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1537992933","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1537992933},{"type":"v1","addr":"172.21.15.160:6836","nonce":1537992933}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5419,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/3597720446","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":3597720446},{"type":"v1","addr":"172.21.15.160:6837","nonce":3597720446}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":27},{"gid":5754,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/457781060","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":457781060},{"type":"v1","addr":"172.21.15.81:6834","nonce":457781060}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":26},{"gid":6108,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/1283308244","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1283308244},{"type":"v1","addr":"172.21.15.81:6835","nonce":1283308244}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":34}],"filesystems":[]} 2024-09-17T05:22:14.522 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 34 2024-09-17T05:22:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2f0078f20 msgr2=0x7fa2f007b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2f0078f20 0x7fa2f007b3e0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fa2f4009b40 tx=0x7fa2f4005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041473f0 msgr2=0x7fa3040a9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041473f0 0x7fa3040a9730 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fa2f80065e0 tx=0x7fa2f80039c0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 shutdown_connections 2024-09-17T05:22:14.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa2f0078f20 0x7fa2f007b3e0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3040a9c70 0x7fa3040cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3041473f0 0x7fa3040a9730 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 --2- 172.21.15.81:0/712778322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2ec005e50 0x7fa30414ef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 >> 172.21.15.81:0/712778322 conn(0x7fa3040b1690 msgr2=0x7fa30414cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 shutdown_connections 2024-09-17T05:22:14.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.523+0000 7fa30a394640 1 -- 172.21.15.81:0/712778322 wait complete. 2024-09-17T05:22:14.535 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:22:14.535 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:22:14.536 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:22:14.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:14.536 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:22:14.536 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:22:14.536 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:22:14.536 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:14.537 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:22:14.537 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:22:14.537 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:22:14.537 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:14.537 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:22:14.537 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:22:14.537 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:22:14.537 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:14.547 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:22:14.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:22:14.548 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:22:14.548 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:22:14.550 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:22:14.550 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:22:14.550 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:22:14.551 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:22:14.591 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:22:14.591 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:14.592 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:22:14.592 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:14.596 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:22:14.596 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:22:14.597 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:14.597 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:14.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:22:14.665 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:22:14.665 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:22:14.678 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:22:14.678 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:22:14.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 -- 172.21.15.81:0/1371978101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40ce7f0 msgr2=0x7f08a4070c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/1371978101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40ce7f0 0x7f08a4070c70 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f08a40b36e0 tx=0x7f089402a560 comp rx=0 tx=0).stop 2024-09-17T05:22:14.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 -- 172.21.15.81:0/1371978101 shutdown_connections 2024-09-17T05:22:14.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/1371978101 >> v2:172.21.15.160:3300/0 conn(0x7f08a40b2630 0x7f08a40b2ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/1371978101 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40ce7f0 0x7f08a4070c70 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/1371978101 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a406cb40 0x7f08a406cf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 -- 172.21.15.81:0/1371978101 >> 172.21.15.81:0/1371978101 conn(0x7f08a40cd630 msgr2=0x7f08a40cda40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:14.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 -- 172.21.15.81:0/1371978101 shutdown_connections 2024-09-17T05:22:14.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.703+0000 7f08aaf9f640 1 -- 172.21.15.81:0/1371978101 wait complete. 2024-09-17T05:22:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.704+0000 7f08aaf9f640 1 Processor -- start 2024-09-17T05:22:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.704+0000 7f08aaf9f640 1 -- start start 2024-09-17T05:22:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aaf9f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a406cb40 0x7f08a41542a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aaf9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40b2630 0x7f08a4160aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aaf9f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a40ce7f0 0x7f08a4160fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aaf9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08a415e230 con 0x7f08a40b2630 2024-09-17T05:22:14.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aaf9f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08a415e0b0 con 0x7f08a406cb40 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aaf9f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f08a40b3000 con 0x7f08a40ce7f0 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40b2630 0x7f08a4160aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40b2630 0x7f08a4160aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41220/0 (socket says 172.21.15.81:41220) 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 -- 172.21.15.81:0/3782572518 learned_addr learned my addr 172.21.15.81:0/3782572518 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aa79e640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a40ce7f0 0x7f08a4160fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a9f9d640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a406cb40 0x7f08a41542a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 -- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a40ce7f0 msgr2=0x7f08a4160fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a40ce7f0 0x7f08a4160fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 -- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a406cb40 msgr2=0x7f08a41542a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a406cb40 0x7f08a41542a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:14.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 -- 172.21.15.81:0/3782572518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08a40caa80 con 0x7f08a40b2630 2024-09-17T05:22:14.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08aa79e640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a40ce7f0 0x7f08a4160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:14.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.705+0000 7f08a979c640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40b2630 0x7f08a4160aa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0894000c00 tx=0x7f0894003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:14.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.706+0000 7f089a7fc640 1 -- 172.21.15.81:0/3782572518 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089403e030 con 0x7f08a40b2630 2024-09-17T05:22:14.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.706+0000 7f089a7fc640 1 -- 172.21.15.81:0/3782572518 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0894003e00 con 0x7f08a40b2630 2024-09-17T05:22:14.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.706+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08a40c9a60 con 0x7f08a40b2630 2024-09-17T05:22:14.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.706+0000 7f089a7fc640 1 -- 172.21.15.81:0/3782572518 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0894035040 con 0x7f08a40b2630 2024-09-17T05:22:14.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.706+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08a40ca020 con 0x7f08a40b2630 2024-09-17T05:22:14.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.707+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08a40b2ac0 con 0x7f08a40b2630 2024-09-17T05:22:14.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.707+0000 7f089a7fc640 1 -- 172.21.15.81:0/3782572518 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f0894041030 con 0x7f08a40b2630 2024-09-17T05:22:14.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.708+0000 7f089a7fc640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0888078ef0 0x7f088807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:14.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.708+0000 7f089a7fc640 1 -- 172.21.15.81:0/3782572518 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(61..61 src has 1..61) ==== 4943+0+0 (secure 0 0 0) 0x7f08940bb710 con 0x7f08a40b2630 2024-09-17T05:22:14.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.708+0000 7f08a9f9d640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0888078ef0 0x7f088807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:14.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.709+0000 7f08a9f9d640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0888078ef0 0x7f088807b3b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f08a0005fd0 tx=0x7f08a0005850 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:14.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.713+0000 7f089a7fc640 1 -- 172.21.15.81:0/3782572518 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f08a40caa80 con 0x7f08a40b2630 2024-09-17T05:22:14.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:14.898+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f08a40cdbb0 con 0x7f08a40b2630 2024-09-17T05:22:15.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:15.293 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:15.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.386+0000 7f089a7fc640 1 -- 172.21.15.81:0/3782572518 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v63) ==== 97+0+0 (secure 0 0 0) 0x7f0894083a50 con 0x7f08a40b2630 2024-09-17T05:22:15.387 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0888078ef0 msgr2=0x7f088807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0888078ef0 0x7f088807b3b0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f08a0005fd0 tx=0x7f08a0005850 comp rx=0 tx=0).stop 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40b2630 msgr2=0x7f08a4160aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40b2630 0x7f08a4160aa0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f0894000c00 tx=0x7f0894003910 comp rx=0 tx=0).stop 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 shutdown_connections 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f0888078ef0 0x7f088807b3b0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f08a40ce7f0 0x7f08a4160fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08a40b2630 0x7f08a4160aa0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 --2- 172.21.15.81:0/3782572518 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f08a406cb40 0x7f08a41542a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 >> 172.21.15.81:0/3782572518 conn(0x7f08a40cd630 msgr2=0x7f08a40cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 shutdown_connections 2024-09-17T05:22:15.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.389+0000 7f08aaf9f640 1 -- 172.21.15.81:0/3782572518 wait complete. 2024-09-17T05:22:15.402 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:22:15.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/592769184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab00d49c0 msgr2=0x7f7ab00d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/592769184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab00d49c0 0x7f7ab00d0630 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f7ab008cf10 tx=0x7f7a9802a560 comp rx=0 tx=0).stop 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/592769184 shutdown_connections 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/592769184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ab0162480 0x7f7ab00d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/592769184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab00d49c0 0x7f7ab00d0630 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/592769184 >> v2:172.21.15.160:3300/0 conn(0x7f7ab015df90 0x7f7ab00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/592769184 >> 172.21.15.81:0/592769184 conn(0x7f7ab00d3ea0 msgr2=0x7f7ab00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/592769184 shutdown_connections 2024-09-17T05:22:15.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.501+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/592769184 wait complete. 2024-09-17T05:22:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 Processor -- start 2024-09-17T05:22:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 -- start start 2024-09-17T05:22:15.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab00d49c0 0x7f7ab00a1790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ab015df90 0x7f7ab00cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0162480 0x7f7ab00cdac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab00b3b90 con 0x7f7ab0162480 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ab00b3a10 con 0x7f7ab00d49c0 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7ab4a8e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7ab00b3d10 con 0x7f7ab015df90 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7aaed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0162480 0x7f7ab00cdac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7aaed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0162480 0x7f7ab00cdac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41240/0 (socket says 172.21.15.81:41240) 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7aaed9d640 1 -- 172.21.15.81:0/1567609394 learned_addr learned my addr 172.21.15.81:0/1567609394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7aae59c640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab00d49c0 0x7f7ab00a1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.503+0000 7f7aadd9b640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ab015df90 0x7f7ab00cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aaed9d640 1 -- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ab015df90 msgr2=0x7f7ab00cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aaed9d640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ab015df90 0x7f7ab00cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aaed9d640 1 -- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab00d49c0 msgr2=0x7f7ab00a1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aaed9d640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab00d49c0 0x7f7ab00a1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aaed9d640 1 -- 172.21.15.81:0/1567609394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ab00caf70 con 0x7f7ab0162480 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aaed9d640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0162480 0x7f7ab00cdac0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000c8f0 tx=0x7f7aa000cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aa6ffd640 1 -- 172.21.15.81:0/1567609394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0007bb0 con 0x7f7ab0162480 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aa6ffd640 1 -- 172.21.15.81:0/1567609394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7aa000ae40 con 0x7f7ab0162480 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ab00cb210 con 0x7f7ab0162480 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7aa6ffd640 1 -- 172.21.15.81:0/1567609394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0005280 con 0x7f7ab0162480 2024-09-17T05:22:15.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.504+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ab00cb7d0 con 0x7f7ab0162480 2024-09-17T05:22:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.505+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ab00cf9b0 con 0x7f7ab0162480 2024-09-17T05:22:15.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.506+0000 7f7aa6ffd640 1 -- 172.21.15.81:0/1567609394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f7aa0005420 con 0x7f7ab0162480 2024-09-17T05:22:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.506+0000 7f7aa6ffd640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7a90078e60 0x7f7a9007b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.506+0000 7f7aa6ffd640 1 -- 172.21.15.81:0/1567609394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f7aa009b280 con 0x7f7ab0162480 2024-09-17T05:22:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.506+0000 7f7aae59c640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7a90078e60 0x7f7a9007b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.507+0000 7f7aae59c640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7a90078e60 0x7f7a9007b320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8005c40 tx=0x7f7aa800a590 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:15.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.510+0000 7f7aa6ffd640 1 -- 172.21.15.81:0/1567609394 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7aa0014030 con 0x7f7ab0162480 2024-09-17T05:22:15.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.751+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f7ab008d590 con 0x7f7ab0162480 2024-09-17T05:22:15.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.751+0000 7f7aa6ffd640 1 -- 172.21.15.81:0/1567609394 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) ==== 80+0+5617 (secure 0 0 0) 0x7f7aa0062f20 con 0x7f7ab0162480 2024-09-17T05:22:15.753 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:15.753 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:22:15.753 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:22:15.753 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.754 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:22:15.754 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:22:15.754 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.754 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.754 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:15.754 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:15.755 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.755 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.755 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.755 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:22:15.756 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:22:15.756 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:15.756 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:15.756 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.757 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.757 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.757 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:22:15.757 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:22:15.758 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.758 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.758 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:15.758 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:15.758 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.758 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.759 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.759 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:22:15.759 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:22:15.759 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.759 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:15.760 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:15.760 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.760 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.760 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.761 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.761 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:22:15.761 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:22:15.761 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.761 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.761 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.762 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.762 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.762 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.762 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:22:15.762 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:22:15.762 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.763 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.763 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.763 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.763 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.764 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.765 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.766 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.768 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.769 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.770 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:22:15.771 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:22:15.772 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.alice", 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EelmoW0vIxAAKuhmjA6Y6sc1GKjyQ9THTg==", 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow rw path=/volumes/_nogroup/subvol21380", 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw pool=cephfs_data" 2024-09-17T05:22:15.773 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:22:15.774 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:15.775 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:22:15.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.753+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7a90078e60 msgr2=0x7f7a9007b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.753+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7a90078e60 0x7f7a9007b320 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f7aa8005c40 tx=0x7f7aa800a590 comp rx=0 tx=0).stop 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.753+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0162480 msgr2=0x7f7ab00cdac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.753+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0162480 0x7f7ab00cdac0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000c8f0 tx=0x7f7aa000cdb0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 shutdown_connections 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7a90078e60 0x7f7a9007b320 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ab0162480 0x7f7ab00cdac0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ab015df90 0x7f7ab00cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 --2- 172.21.15.81:0/1567609394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ab00d49c0 0x7f7ab00a1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 >> 172.21.15.81:0/1567609394 conn(0x7f7ab00d3ea0 msgr2=0x7f7ab00b0ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 shutdown_connections 2024-09-17T05:22:15.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.754+0000 7f7ab4a8e640 1 -- 172.21.15.81:0/1567609394 wait complete. 2024-09-17T05:22:15.778 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.alice 2024-09-17T05:22:15.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.879+0000 7f1ee6589640 1 -- 172.21.15.81:0/1085955187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc490 msgr2=0x7f1ee015f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.879+0000 7f1ee6589640 1 --2- 172.21.15.81:0/1085955187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc490 0x7f1ee015f750 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4005fd0 tx=0x7f1ed402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.879+0000 7f1ee6589640 1 -- 172.21.15.81:0/1085955187 shutdown_connections 2024-09-17T05:22:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.879+0000 7f1ee6589640 1 --2- 172.21.15.81:0/1085955187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc490 0x7f1ee015f750 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.879+0000 7f1ee6589640 1 -- 172.21.15.81:0/1085955187 >> 172.21.15.81:0/1085955187 conn(0x7f1ee00b1690 msgr2=0x7f1ee00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.879+0000 7f1ee6589640 1 -- 172.21.15.81:0/1085955187 shutdown_connections 2024-09-17T05:22:15.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.879+0000 7f1ee6589640 1 -- 172.21.15.81:0/1085955187 wait complete. 2024-09-17T05:22:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.880+0000 7f1ee6589640 1 Processor -- start 2024-09-17T05:22:15.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1ee6589640 1 -- start start 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1ee6589640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ee00cc490 0x7f1ee0147ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1ee6589640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc900 0x7f1ee00735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1ee6589640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ee0159680 0x7f1ee0073b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1ee6589640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee00cf560 con 0x7f1ee00cc900 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1ee6589640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee00cf3e0 con 0x7f1ee00cc490 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1ee6589640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1ee006f130 con 0x7f1ee0159680 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1edf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc900 0x7f1ee00735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1edf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc900 0x7f1ee00735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41254/0 (socket says 172.21.15.81:41254) 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.881+0000 7f1edf7fe640 1 -- 172.21.15.81:0/3497011180 learned_addr learned my addr 172.21.15.81:0/3497011180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:15.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1ee4b26640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ee0159680 0x7f1ee0073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edffff640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ee00cc490 0x7f1ee0147ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edf7fe640 1 -- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ee0159680 msgr2=0x7f1ee0073b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edf7fe640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ee0159680 0x7f1ee0073b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edf7fe640 1 -- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ee00cc490 msgr2=0x7f1ee0147ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edf7fe640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ee00cc490 0x7f1ee0147ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edf7fe640 1 -- 172.21.15.81:0/3497011180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee01f3650 con 0x7f1ee00cc900 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edf7fe640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc900 0x7f1ee00735f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4006010 tx=0x7f1ed4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edcff9640 1 -- 172.21.15.81:0/3497011180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed403f070 con 0x7f1ee00cc900 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edcff9640 1 -- 172.21.15.81:0/3497011180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ed40047a0 con 0x7f1ee00cc900 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee0148420 con 0x7f1ee00cc900 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1edcff9640 1 -- 172.21.15.81:0/3497011180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed4035030 con 0x7f1ee00cc900 2024-09-17T05:22:15.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.882+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee0148c80 con 0x7f1ee00cc900 2024-09-17T05:22:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.883+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ee015ff40 con 0x7f1ee00cc900 2024-09-17T05:22:15.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.884+0000 7f1edcff9640 1 -- 172.21.15.81:0/3497011180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f1ed4042070 con 0x7f1ee00cc900 2024-09-17T05:22:15.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.884+0000 7f1edcff9640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ecc078ef0 0x7f1ecc07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:15.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.884+0000 7f1edcff9640 1 -- 172.21.15.81:0/3497011180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f1ed40bbeb0 con 0x7f1ee00cc900 2024-09-17T05:22:15.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.884+0000 7f1edffff640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ecc078ef0 0x7f1ecc07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:15.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.885+0000 7f1edffff640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ecc078ef0 0x7f1ecc07b3b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00018b0 tx=0x7f1ed0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:15.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:15.888+0000 7f1edcff9640 1 -- 172.21.15.81:0/3497011180 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1ed4083bf0 con 0x7f1ee00cc900 2024-09-17T05:22:16.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.133+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.alice"} v 0) -- 0x7f1ee015abf0 con 0x7f1ee00cc900 2024-09-17T05:22:16.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.135+0000 7f1edcff9640 1 -- 172.21.15.81:0/3497011180 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.alice"}]=0 v19) ==== 82+0+0 (secure 0 0 0) 0x7f1ed4088620 con 0x7f1ee00cc900 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ecc078ef0 msgr2=0x7f1ecc07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ecc078ef0 0x7f1ecc07b3b0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7f1ed00018b0 tx=0x7f1ed0009040 comp rx=0 tx=0).stop 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc900 msgr2=0x7f1ee00735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc900 0x7f1ee00735f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4006010 tx=0x7f1ed4003910 comp rx=0 tx=0).stop 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 shutdown_connections 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ecc078ef0 0x7f1ecc07b3b0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1ee0159680 0x7f1ee0073b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1ee00cc900 0x7f1ee00735f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 --2- 172.21.15.81:0/3497011180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1ee00cc490 0x7f1ee0147ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 >> 172.21.15.81:0/3497011180 conn(0x7f1ee00b1690 msgr2=0x7f1ee015a4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 shutdown_connections 2024-09-17T05:22:16.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.138+0000 7f1ee6589640 1 -- 172.21.15.81:0/3497011180 wait complete. 2024-09-17T05:22:16.150 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:22:16.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.250+0000 7f560b552640 1 -- 172.21.15.81:0/3822433086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 msgr2=0x7f55f0003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.250+0000 7f560b552640 1 --2- 172.21.15.81:0/3822433086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 0x7f55f0003e50 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f5600001050 tx=0x7f55f0005830 comp rx=0 tx=0).stop 2024-09-17T05:22:16.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.250+0000 7f5609aef640 1 -- 172.21.15.81:0/3822433086 reap_dead start 2024-09-17T05:22:16.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.250+0000 7f560b552640 1 -- 172.21.15.81:0/3822433086 shutdown_connections 2024-09-17T05:22:16.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.250+0000 7f560b552640 1 -- 172.21.15.81:0/3822433086 >> 172.21.15.81:0/3822433086 conn(0x7f56040741f0 msgr2=0x7f5604074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.250+0000 7f560b552640 1 -- 172.21.15.81:0/3822433086 shutdown_connections 2024-09-17T05:22:16.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.250+0000 7f560b552640 1 -- 172.21.15.81:0/3822433086 wait complete. 2024-09-17T05:22:16.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.251+0000 7f560b552640 1 Processor -- start 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.251+0000 7f560b552640 1 -- start start 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f560b552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 0x7f5604158a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f560b552640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040c8810 0x7f56041581e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f560b552640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5604159330 0x7f56041597b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f560b552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5604070b90 con 0x7f55f0003a30 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f560b552640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5604070a10 con 0x7f5604159330 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f560b552640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5604070d10 con 0x7f56040c8810 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f56092ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 0x7f5604158a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f56092ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 0x7f5604158a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41272/0 (socket says 172.21.15.81:41272) 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f56092ee640 1 -- 172.21.15.81:0/341352733 learned_addr learned my addr 172.21.15.81:0/341352733 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f5608aed640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040c8810 0x7f56041581e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.252+0000 7f5609aef640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5604159330 0x7f56041597b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f56092ee640 1 -- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040c8810 msgr2=0x7f56041581e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f56092ee640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040c8810 0x7f56041581e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f56092ee640 1 -- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5604159330 msgr2=0x7f56041597b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f56092ee640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5604159330 0x7f56041597b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f56092ee640 1 -- 172.21.15.81:0/341352733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56041f7b10 con 0x7f55f0003a30 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f5609aef640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5604159330 0x7f56041597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f56092ee640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 0x7f5604158a20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f560000c320 tx=0x7f5600006d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f55f9ffb640 1 -- 172.21.15.81:0/341352733 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5600031040 con 0x7f55f0003a30 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f55f9ffb640 1 -- 172.21.15.81:0/341352733 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56000035f0 con 0x7f55f0003a30 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56041f7df0 con 0x7f55f0003a30 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f55f9ffb640 1 -- 172.21.15.81:0/341352733 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5600003a00 con 0x7f55f0003a30 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.253+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56041f83b0 con 0x7f55f0003a30 2024-09-17T05:22:16.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.254+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56040cafe0 con 0x7f55f0003a30 2024-09-17T05:22:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.255+0000 7f55f9ffb640 1 -- 172.21.15.81:0/341352733 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f5600034070 con 0x7f55f0003a30 2024-09-17T05:22:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.255+0000 7f55f9ffb640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f55e8078ef0 0x7f55e807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.255+0000 7f55f9ffb640 1 -- 172.21.15.81:0/341352733 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f56000bad10 con 0x7f55f0003a30 2024-09-17T05:22:16.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.255+0000 7f5608aed640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f55e8078ef0 0x7f55e807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.256+0000 7f5608aed640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f55e8078ef0 0x7f55e807b3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f56040adff0 tx=0x7f55f4006f70 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.260+0000 7f55f9ffb640 1 -- 172.21.15.81:0/341352733 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5600082fa0 con 0x7f55f0003a30 2024-09-17T05:22:16.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.440+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f56041f8790 con 0x7f55f0003a30 2024-09-17T05:22:16.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.440+0000 7f55f9ffb640 1 -- 172.21.15.81:0/341352733 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v65) ==== 84+0+65 (secure 0 0 0) 0x7f56000828a0 con 0x7f55f0003a30 2024-09-17T05:22:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:16.442 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:22:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:22:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:22:16.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:16.442 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:22:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.442+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f55e8078ef0 msgr2=0x7f55e807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.442+0000 7f560b552640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f55e8078ef0 0x7f55e807b3b0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f56040adff0 tx=0x7f55f4006f70 comp rx=0 tx=0).stop 2024-09-17T05:22:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.442+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 msgr2=0x7f5604158a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.442+0000 7f560b552640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 0x7f5604158a20 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f560000c320 tx=0x7f5600006d10 comp rx=0 tx=0).stop 2024-09-17T05:22:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 shutdown_connections 2024-09-17T05:22:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f55e8078ef0 0x7f55e807b3b0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5604159330 0x7f56041597b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56040c8810 0x7f56041581e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 --2- 172.21.15.81:0/341352733 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f55f0003a30 0x7f5604158a20 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 >> 172.21.15.81:0/341352733 conn(0x7f56040741f0 msgr2=0x7f56040b5c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 shutdown_connections 2024-09-17T05:22:16.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.443+0000 7f560b552640 1 -- 172.21.15.81:0/341352733 wait complete. 2024-09-17T05:22:16.454 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:22:16.455 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:22:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 -- 172.21.15.81:0/1473640453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 msgr2=0x7f035006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 --2- 172.21.15.81:0/1473640453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f035006fe80 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f0344005fd0 tx=0x7f034402aa00 comp rx=0 tx=0).stop 2024-09-17T05:22:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 -- 172.21.15.81:0/1473640453 shutdown_connections 2024-09-17T05:22:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 --2- 172.21.15.81:0/1473640453 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03500703c0 0x7f0350157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 --2- 172.21.15.81:0/1473640453 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f035006fe80 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 -- 172.21.15.81:0/1473640453 >> 172.21.15.81:0/1473640453 conn(0x7f03500b1620 msgr2=0x7f03500b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 -- 172.21.15.81:0/1473640453 shutdown_connections 2024-09-17T05:22:16.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.559+0000 7f0356eb1640 1 -- 172.21.15.81:0/1473640453 wait complete. 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.560+0000 7f0356eb1640 1 Processor -- start 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.560+0000 7f0356eb1640 1 -- start start 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0356eb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f0350153460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0356eb1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03500703c0 0x7f0350149e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0356eb1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03500aee40 0x7f0350159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0356eb1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03501586b0 con 0x7f035006e940 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0356eb1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0350158530 con 0x7f03500703c0 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0356eb1640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0350158830 con 0x7f03500aee40 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f0350153460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f0350153460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41294/0 (socket says 172.21.15.81:41294) 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 -- 172.21.15.81:0/3817128732 learned_addr learned my addr 172.21.15.81:0/3817128732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f035544e640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03500aee40 0x7f0350159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f034ffff640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03500703c0 0x7f0350149e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 -- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03500aee40 msgr2=0x7f0350159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03500aee40 0x7f0350159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 -- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03500703c0 msgr2=0x7f0350149e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03500703c0 0x7f0350149e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f0354c4d640 1 -- 172.21.15.81:0/3817128732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03501f6220 con 0x7f035006e940 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.561+0000 7f034ffff640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03500703c0 0x7f0350149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:16.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.562+0000 7f0354c4d640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f0350153460 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f034000c430 tx=0x7f034000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.562+0000 7f034d7fa640 1 -- 172.21.15.81:0/3817128732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340011790 con 0x7f035006e940 2024-09-17T05:22:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.562+0000 7f034d7fa640 1 -- 172.21.15.81:0/3817128732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0340017070 con 0x7f035006e940 2024-09-17T05:22:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.562+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03501f64c0 con 0x7f035006e940 2024-09-17T05:22:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.562+0000 7f034d7fa640 1 -- 172.21.15.81:0/3817128732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0340011d00 con 0x7f035006e940 2024-09-17T05:22:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.562+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03501f6a80 con 0x7f035006e940 2024-09-17T05:22:16.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.563+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0350157cf0 con 0x7f035006e940 2024-09-17T05:22:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.563+0000 7f034d7fa640 1 -- 172.21.15.81:0/3817128732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f034001c460 con 0x7f035006e940 2024-09-17T05:22:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.564+0000 7f034d7fa640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f033c078ef0 0x7f033c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.564+0000 7f034d7fa640 1 -- 172.21.15.81:0/3817128732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(65..65 src has 1..65) ==== 4857+0+0 (secure 0 0 0) 0x7f034009af00 con 0x7f035006e940 2024-09-17T05:22:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.564+0000 7f034ffff640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f033c078ef0 0x7f033c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:16.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.565+0000 7f034ffff640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f033c078ef0 0x7f033c07b3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0344035000 tx=0x7f0344004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:16.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.568+0000 7f034d7fa640 1 -- 172.21.15.81:0/3817128732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0340063200 con 0x7f035006e940 2024-09-17T05:22:16.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:16.744+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f03500cf7a0 con 0x7f035006e940 2024-09-17T05:22:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.403+0000 7f034d7fa640 1 -- 172.21.15.81:0/3817128732 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v66) ==== 138+0+0 (secure 0 0 0) 0x7f0340062b00 con 0x7f035006e940 2024-09-17T05:22:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:22:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f033c078ef0 msgr2=0x7f033c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f033c078ef0 0x7f033c07b3b0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0344035000 tx=0x7f0344004ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 msgr2=0x7f0350153460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f0350153460 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f034000c430 tx=0x7f034000c8f0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 shutdown_connections 2024-09-17T05:22:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f033c078ef0 0x7f033c07b3b0 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03500aee40 0x7f0350159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03500703c0 0x7f0350149e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 --2- 172.21.15.81:0/3817128732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f035006e940 0x7f0350153460 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 >> 172.21.15.81:0/3817128732 conn(0x7f03500b1620 msgr2=0x7f0350153be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 shutdown_connections 2024-09-17T05:22:17.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.406+0000 7f0356eb1640 1 -- 172.21.15.81:0/3817128732 wait complete. 2024-09-17T05:22:17.425 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.536+0000 7fafbfa16640 1 -- 172.21.15.81:0/2304530192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80cc540 msgr2=0x7fafb80cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.536+0000 7fafbfa16640 1 --2- 172.21.15.81:0/2304530192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80cc540 0x7fafb80cc980 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fafa8005fd0 tx=0x7fafa802a530 comp rx=0 tx=0).stop 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.536+0000 7fafbfa16640 1 -- 172.21.15.81:0/2304530192 shutdown_connections 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.536+0000 7fafbfa16640 1 --2- 172.21.15.81:0/2304530192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb80cc540 0x7fafb80cc980 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.536+0000 7fafbfa16640 1 --2- 172.21.15.81:0/2304530192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb8151e30 0x7fafb806fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.537+0000 7fafbfa16640 1 -- 172.21.15.81:0/2304530192 >> 172.21.15.81:0/2304530192 conn(0x7fafb80b1700 msgr2=0x7fafb80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.537+0000 7fafbfa16640 1 -- 172.21.15.81:0/2304530192 shutdown_connections 2024-09-17T05:22:17.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.537+0000 7fafbfa16640 1 -- 172.21.15.81:0/2304530192 wait complete. 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 Processor -- start 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 -- start start 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb80cc540 0x7fafb81f2a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb8151e30 0x7fafb815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb815b3d0 0x7fafb81f8c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80cb0e0 con 0x7fafb8151e30 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fafb80caf60 con 0x7fafb80cc540 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.538+0000 7fafbfa16640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fafb80cb260 con 0x7fafb815b3d0 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb8151e30 0x7fafb815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb8151e30 0x7fafb815a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41312/0 (socket says 172.21.15.81:41312) 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 -- 172.21.15.81:0/3604097250 learned_addr learned my addr 172.21.15.81:0/3604097250 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbdfb3640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb815b3d0 0x7fafb81f8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbd7b2640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb80cc540 0x7fafb81f2a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 -- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb815b3d0 msgr2=0x7fafb81f8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb815b3d0 0x7fafb81f8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 -- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb80cc540 msgr2=0x7fafb81f2a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb80cc540 0x7fafb81f2a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 -- 172.21.15.81:0/3604097250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fafb80c4c30 con 0x7fafb8151e30 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbd7b2640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb80cc540 0x7fafb81f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbcfb1640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb8151e30 0x7fafb815a6a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009850 tx=0x7fafa80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafadffb640 1 -- 172.21.15.81:0/3604097250 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa803f070 con 0x7fafb8151e30 2024-09-17T05:22:17.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafadffb640 1 -- 172.21.15.81:0/3604097250 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fafa8004890 con 0x7fafb8151e30 2024-09-17T05:22:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fafb80c4f10 con 0x7fafb8151e30 2024-09-17T05:22:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.539+0000 7fafadffb640 1 -- 172.21.15.81:0/3604097250 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fafa8035030 con 0x7fafb8151e30 2024-09-17T05:22:17.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.540+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fafb80c54d0 con 0x7fafb8151e30 2024-09-17T05:22:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.541+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fafb80b1ec0 con 0x7fafb8151e30 2024-09-17T05:22:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.541+0000 7fafadffb640 1 -- 172.21.15.81:0/3604097250 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fafa8042070 con 0x7fafb8151e30 2024-09-17T05:22:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.542+0000 7fafadffb640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faf9c078f20 0x7faf9c07b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.542+0000 7fafadffb640 1 -- 172.21.15.81:0/3604097250 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 5227+0+0 (secure 0 0 0) 0x7fafa80bc010 con 0x7fafb8151e30 2024-09-17T05:22:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.542+0000 7fafbd7b2640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faf9c078f20 0x7faf9c07b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:17.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.543+0000 7fafbd7b2640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faf9c078f20 0x7faf9c07b3e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fafb40058c0 tx=0x7fafb4005d50 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:17.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.547+0000 7fafadffb640 1 -- 172.21.15.81:0/3604097250 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fafb80b1ec0 con 0x7fafb8151e30 2024-09-17T05:22:17.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:17.724+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fafb80cb780 con 0x7fafb8151e30 2024-09-17T05:22:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.412+0000 7fafadffb640 1 -- 172.21.15.81:0/3604097250 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v67) ==== 170+0+0 (secure 0 0 0) 0x7fafa80841b0 con 0x7fafb8151e30 2024-09-17T05:22:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:22:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faf9c078f20 msgr2=0x7faf9c07b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faf9c078f20 0x7faf9c07b3e0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fafb40058c0 tx=0x7fafb4005d50 comp rx=0 tx=0).stop 2024-09-17T05:22:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb8151e30 msgr2=0x7fafb815a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb8151e30 0x7fafb815a6a0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fafa8009850 tx=0x7fafa80039e0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 shutdown_connections 2024-09-17T05:22:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7faf9c078f20 0x7faf9c07b3e0 secure :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fafb40058c0 tx=0x7fafb4005d50 comp rx=0 tx=0).stop 2024-09-17T05:22:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fafb815b3d0 0x7fafb81f8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fafb8151e30 0x7fafb815a6a0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 --2- 172.21.15.81:0/3604097250 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fafb80cc540 0x7fafb81f2a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 >> 172.21.15.81:0/3604097250 conn(0x7fafb80b1700 msgr2=0x7fafb80cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 shutdown_connections 2024-09-17T05:22:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.416+0000 7fafbfa16640 1 -- 172.21.15.81:0/3604097250 wait complete. 2024-09-17T05:22:18.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:22:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 -- 172.21.15.81:0/1483619815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cede0 msgr2=0x7f86180cf270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1483619815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cede0 0x7f86180cf270 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f86180c3610 tx=0x7f860802a560 comp rx=0 tx=0).stop 2024-09-17T05:22:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 -- 172.21.15.81:0/1483619815 shutdown_connections 2024-09-17T05:22:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1483619815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cede0 0x7f86180cf270 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1483619815 >> v2:172.21.15.160:3300/0 conn(0x7f86180cdb90 0x7f86180ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 -- 172.21.15.81:0/1483619815 >> 172.21.15.81:0/1483619815 conn(0x7f86180b1700 msgr2=0x7f86180b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 -- 172.21.15.81:0/1483619815 shutdown_connections 2024-09-17T05:22:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.549+0000 7f861ca7f640 1 -- 172.21.15.81:0/1483619815 wait complete. 2024-09-17T05:22:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.550+0000 7f861ca7f640 1 Processor -- start 2024-09-17T05:22:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.550+0000 7f861ca7f640 1 -- start start 2024-09-17T05:22:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861ca7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cdb90 0x7f86181f5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861ca7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86180cede0 0x7f86180c6080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861ca7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f861815bab0 0x7f86180c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861ca7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f861806fde0 con 0x7f86180cdb90 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861ca7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f861806fc60 con 0x7f861815bab0 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861ca7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f861806ff60 con 0x7f86180cede0 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cdb90 0x7f86181f5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cdb90 0x7f86181f5100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41326/0 (socket says 172.21.15.81:41326) 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 -- 172.21.15.81:0/1132932254 learned_addr learned my addr 172.21.15.81:0/1132932254 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f8615d9b640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86180cede0 0x7f86180c6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f8616d9d640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f861815bab0 0x7f86180c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 -- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86180cede0 msgr2=0x7f86180c6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86180cede0 0x7f86180c6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 -- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f861815bab0 msgr2=0x7f86180c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f861815bab0 0x7f86180c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.551+0000 7f861659c640 1 -- 172.21.15.81:0/1132932254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86180c4f60 con 0x7f86180cdb90 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.552+0000 7f861659c640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cdb90 0x7f86181f5100 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f861000ba50 tx=0x7f861000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.552+0000 7f8606ffd640 1 -- 172.21.15.81:0/1132932254 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8610019070 con 0x7f86180cdb90 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.552+0000 7f8606ffd640 1 -- 172.21.15.81:0/1132932254 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f861000cd10 con 0x7f86180cdb90 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.552+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86180c55a0 con 0x7f86180cdb90 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.552+0000 7f8606ffd640 1 -- 172.21.15.81:0/1132932254 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86100146a0 con 0x7f86180cdb90 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.552+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86180c5b60 con 0x7f86180cdb90 2024-09-17T05:22:18.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.553+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8618070480 con 0x7f86180cdb90 2024-09-17T05:22:18.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.553+0000 7f8606ffd640 1 -- 172.21.15.81:0/1132932254 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f861001c070 con 0x7f86180cdb90 2024-09-17T05:22:18.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.554+0000 7f8606ffd640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f85f8078ef0 0x7f85f807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:18.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.554+0000 7f8606ffd640 1 -- 172.21.15.81:0/1132932254 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(67..67 src has 1..67) ==== 5609+0+0 (secure 0 0 0) 0x7f861009b770 con 0x7f86180cdb90 2024-09-17T05:22:18.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.554+0000 7f8615d9b640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f85f8078ef0 0x7f85f807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:18.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.555+0000 7f8615d9b640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f85f8078ef0 0x7f85f807b3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f860c005e10 tx=0x7f860c005da0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:18.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.558+0000 7f8606ffd640 1 -- 172.21.15.81:0/1132932254 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f86100631c0 con 0x7f86180cdb90 2024-09-17T05:22:18.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:18.769+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f86180c5350 con 0x7f86180cdb90 2024-09-17T05:22:19.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.413+0000 7f8606ffd640 1 -- 172.21.15.81:0/1132932254 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v37) ==== 174+0+0 (secure 0 0 0) 0x7f8610067bf0 con 0x7f86180cdb90 2024-09-17T05:22:19.415 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 10 and data pool 11 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f85f8078ef0 msgr2=0x7f85f807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f85f8078ef0 0x7f85f807b3b0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f860c005e10 tx=0x7f860c005da0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cdb90 msgr2=0x7f86181f5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cdb90 0x7f86181f5100 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f861000ba50 tx=0x7f861000bf10 comp rx=0 tx=0).stop 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 shutdown_connections 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f85f8078ef0 0x7f85f807b3b0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f861815bab0 0x7f86180c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f86180cede0 0x7f86180c6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 --2- 172.21.15.81:0/1132932254 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f86180cdb90 0x7f86181f5100 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.417+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 >> 172.21.15.81:0/1132932254 conn(0x7f86180b1700 msgr2=0x7f86180b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.418+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 shutdown_connections 2024-09-17T05:22:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.418+0000 7f861ca7f640 1 -- 172.21.15.81:0/1132932254 wait complete. 2024-09-17T05:22:19.448 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:19.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 -- 172.21.15.81:0/7792825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 msgr2=0x7f6c6c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 --2- 172.21.15.81:0/7792825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c072ae0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f6c64005fd0 tx=0x7f6c6402b8e0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 -- 172.21.15.81:0/7792825 shutdown_connections 2024-09-17T05:22:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 --2- 172.21.15.81:0/7792825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c072ae0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 --2- 172.21.15.81:0/7792825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c0cf640 0x7f6c6c0725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 -- 172.21.15.81:0/7792825 >> 172.21.15.81:0/7792825 conn(0x7f6c6c0b1690 msgr2=0x7f6c6c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 -- 172.21.15.81:0/7792825 shutdown_connections 2024-09-17T05:22:19.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.551+0000 7f6c72216640 1 -- 172.21.15.81:0/7792825 wait complete. 2024-09-17T05:22:19.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.552+0000 7f6c72216640 1 Processor -- start 2024-09-17T05:22:19.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.552+0000 7f6c72216640 1 -- start start 2024-09-17T05:22:19.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c72216640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c13a100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c72216640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cf640 0x7f6c6c152840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c72216640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c151370 0x7f6c6c152d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c72216640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c06ec10 con 0x7f6c6c0b3140 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c72216640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6c6c06ea90 con 0x7f6c6c0cf640 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c72216640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6c6c06f9f0 con 0x7f6c6c151370 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c13a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c6b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c13a100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41342/0 (socket says 172.21.15.81:41342) 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c6b7fe640 1 -- 172.21.15.81:0/393097533 learned_addr learned my addr 172.21.15.81:0/393097533 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c6bfff640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c151370 0x7f6c6c152d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.553+0000 7f6c6affd640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cf640 0x7f6c6c152840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c6b7fe640 1 -- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c151370 msgr2=0x7f6c6c152d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c6b7fe640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c151370 0x7f6c6c152d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c6b7fe640 1 -- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cf640 msgr2=0x7f6c6c152840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c6b7fe640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cf640 0x7f6c6c152840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c6b7fe640 1 -- 172.21.15.81:0/393097533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c6c14aaa0 con 0x7f6c6c0b3140 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c6b7fe640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c13a100 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00b420 tx=0x7f6c5c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c53fff640 1 -- 172.21.15.81:0/393097533 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c011830 con 0x7f6c6c0b3140 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c53fff640 1 -- 172.21.15.81:0/393097533 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c5c016070 con 0x7f6c6c0b3140 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c6c1e6160 con 0x7f6c6c0b3140 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c53fff640 1 -- 172.21.15.81:0/393097533 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c5c011d60 con 0x7f6c6c0b3140 2024-09-17T05:22:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.554+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c6c1e6720 con 0x7f6c6c0b3140 2024-09-17T05:22:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.555+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c6c0cef30 con 0x7f6c6c0b3140 2024-09-17T05:22:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.556+0000 7f6c53fff640 1 -- 172.21.15.81:0/393097533 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f6c5c01b460 con 0x7f6c6c0b3140 2024-09-17T05:22:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.556+0000 7f6c53fff640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6c58078ef0 0x7f6c5807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.556+0000 7f6c53fff640 1 -- 172.21.15.81:0/393097533 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7f6c5c09ad10 con 0x7f6c6c0b3140 2024-09-17T05:22:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.556+0000 7f6c6affd640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6c58078ef0 0x7f6c5807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.557+0000 7f6c6affd640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6c58078ef0 0x7f6c5807b3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0d00a0 tx=0x7f6c6000b390 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.561+0000 7f6c53fff640 1 -- 172.21.15.81:0/393097533 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6c5c020020 con 0x7f6c6c0b3140 2024-09-17T05:22:19.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.738+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6c6c0cbf30 con 0x7f6c6c0b3140 2024-09-17T05:22:19.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.739+0000 7f6c53fff640 1 -- 172.21.15.81:0/393097533 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16741 (secure 0 0 0) 0x7f6c5c062670 con 0x7f6c6c0b3140 2024-09-17T05:22:19.740 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:19.740 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:18.771242+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:16.749294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:17.729305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6c58078ef0 msgr2=0x7f6c5807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6c58078ef0 0x7f6c5807b3b0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f6c6c0d00a0 tx=0x7f6c6000b390 comp rx=0 tx=0).stop 2024-09-17T05:22:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 msgr2=0x7f6c6c13a100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c13a100 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f6c5c00b420 tx=0x7f6c5c00b8e0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 shutdown_connections 2024-09-17T05:22:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f6c58078ef0 0x7f6c5807b3b0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c6c151370 0x7f6c6c152d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c6c0cf640 0x7f6c6c152840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 --2- 172.21.15.81:0/393097533 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c6c0b3140 0x7f6c6c13a100 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 >> 172.21.15.81:0/393097533 conn(0x7f6c6c0b1690 msgr2=0x7f6c6c0b42a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 shutdown_connections 2024-09-17T05:22:19.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.741+0000 7f6c72216640 1 -- 172.21.15.81:0/393097533 wait complete. 2024-09-17T05:22:19.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.854+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/4165957018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 msgr2=0x7fbb98004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.854+0000 7fbbb2f2c640 1 --2- 172.21.15.81:0/4165957018 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 0x7fbb98004800 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c00c790 tx=0x7fbb98005830 comp rx=0 tx=0).stop 2024-09-17T05:22:19.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.854+0000 7fbbb14c9640 1 -- 172.21.15.81:0/4165957018 reap_dead start 2024-09-17T05:22:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.854+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/4165957018 shutdown_connections 2024-09-17T05:22:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.854+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/4165957018 >> 172.21.15.81:0/4165957018 conn(0x7fbbac0d3ea0 msgr2=0x7fbbac0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.854+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/4165957018 shutdown_connections 2024-09-17T05:22:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.854+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/4165957018 wait complete. 2024-09-17T05:22:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.855+0000 7fbbb2f2c640 1 Processor -- start 2024-09-17T05:22:19.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.855+0000 7fbbb2f2c640 1 -- start start 2024-09-17T05:22:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb2f2c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 0x7fbbac0b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb2f2c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbbac150960 0x7fbbac161110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb2f2c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbbac161650 0x7fbbac14d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb2f2c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac162690 con 0x7fbb98003fd0 2024-09-17T05:22:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb2f2c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbbac0b3800 con 0x7fbbac161650 2024-09-17T05:22:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb2f2c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbbac0b9680 con 0x7fbbac150960 2024-09-17T05:22:19.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 0x7fbbac0b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 0x7fbbac0b9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41356/0 (socket says 172.21.15.81:41356) 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 -- 172.21.15.81:0/3799512692 learned_addr learned my addr 172.21.15.81:0/3799512692 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbabfff640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbbac150960 0x7fbbac161110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb14c9640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbbac161650 0x7fbbac14d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 -- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbbac150960 msgr2=0x7fbbac161110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbbac150960 0x7fbbac161110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 -- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbbac161650 msgr2=0x7fbbac14d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbbac161650 0x7fbbac14d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:19.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb0cc8640 1 -- 172.21.15.81:0/3799512692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbbac15e7c0 con 0x7fbb98003fd0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.856+0000 7fbbb14c9640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbbac161650 0x7fbbac14d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.857+0000 7fbbb0cc8640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 0x7fbbac0b9140 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbba4011ae0 tx=0x7fbba4009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.857+0000 7fbba97fa640 1 -- 172.21.15.81:0/3799512692 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba400fcb0 con 0x7fbb98003fd0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.857+0000 7fbba97fa640 1 -- 172.21.15.81:0/3799512692 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbba400fe50 con 0x7fbb98003fd0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.857+0000 7fbba97fa640 1 -- 172.21.15.81:0/3799512692 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbba4004280 con 0x7fbb98003fd0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.857+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbbac15eaa0 con 0x7fbb98003fd0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.857+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbbac0b8c20 con 0x7fbb98003fd0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.858+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbbac0cf9b0 con 0x7fbb98003fd0 2024-09-17T05:22:19.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.858+0000 7fbba97fa640 1 -- 172.21.15.81:0/3799512692 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fbba40035f0 con 0x7fbb98003fd0 2024-09-17T05:22:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.859+0000 7fbba97fa640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbb8c078ef0 0x7fbb8c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.859+0000 7fbba97fa640 1 -- 172.21.15.81:0/3799512692 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7fbba409be70 con 0x7fbb98003fd0 2024-09-17T05:22:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.859+0000 7fbbabfff640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbb8c078ef0 0x7fbb8c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:19.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.860+0000 7fbbabfff640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbb8c078ef0 0x7fbb8c07b3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c033000 tx=0x7fbb9c037040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:19.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:19.863+0000 7fbba97fa640 1 -- 172.21.15.81:0/3799512692 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbba4063e20 con 0x7fbb98003fd0 2024-09-17T05:22:20.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.040+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbbac08d590 con 0x7fbb98003fd0 2024-09-17T05:22:20.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.041+0000 7fbba97fa640 1 -- 172.21.15.81:0/3799512692 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v68) ==== 74+0+16741 (secure 0 0 0) 0x7fbba4063720 con 0x7fbb98003fd0 2024-09-17T05:22:20.042 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:20.043 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:18.771242+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:16.749294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:17.729305+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbb8c078ef0 msgr2=0x7fbb8c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbb8c078ef0 0x7fbb8c07b3b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fbb9c033000 tx=0x7fbb9c037040 comp rx=0 tx=0).stop 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 msgr2=0x7fbbac0b9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 0x7fbbac0b9140 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7fbba4011ae0 tx=0x7fbba4009f10 comp rx=0 tx=0).stop 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 shutdown_connections 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbb8c078ef0 0x7fbb8c07b3b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbbac161650 0x7fbbac14d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbbac150960 0x7fbbac161110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 --2- 172.21.15.81:0/3799512692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb98003fd0 0x7fbbac0b9140 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 >> 172.21.15.81:0/3799512692 conn(0x7fbbac0d3ea0 msgr2=0x7fbbac0b5bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 shutdown_connections 2024-09-17T05:22:20.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.044+0000 7fbbb2f2c640 1 -- 172.21.15.81:0/3799512692 wait complete. 2024-09-17T05:22:20.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:22:20.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 -- 172.21.15.81:0/1360372276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80d01b0 msgr2=0x7feec80d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 --2- 172.21.15.81:0/1360372276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80d01b0 0x7feec80d2440 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7feec806a240 tx=0x7feebc02a560 comp rx=0 tx=0).stop 2024-09-17T05:22:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 -- 172.21.15.81:0/1360372276 shutdown_connections 2024-09-17T05:22:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 --2- 172.21.15.81:0/1360372276 >> v2:172.21.15.160:3300/0 conn(0x7feec80b3de0 0x7feec80b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 --2- 172.21.15.81:0/1360372276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80d01b0 0x7feec80d2440 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 -- 172.21.15.81:0/1360372276 >> 172.21.15.81:0/1360372276 conn(0x7feec80d3e30 msgr2=0x7feec80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 -- 172.21.15.81:0/1360372276 shutdown_connections 2024-09-17T05:22:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.159+0000 7feecf3b5640 1 -- 172.21.15.81:0/1360372276 wait complete. 2024-09-17T05:22:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.160+0000 7feecf3b5640 1 Processor -- start 2024-09-17T05:22:20.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.160+0000 7feecf3b5640 1 -- start start 2024-09-17T05:22:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecf3b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80b3de0 0x7feec81f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecf3b5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feec80d01b0 0x7feec80c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecf3b5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feec81617f0 0x7feec81f1e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecf3b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feec80b48b0 con 0x7feec80b3de0 2024-09-17T05:22:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecf3b5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feec80b4730 con 0x7feec81617f0 2024-09-17T05:22:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecf3b5640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7feec80b4a30 con 0x7feec80d01b0 2024-09-17T05:22:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecd151640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80b3de0 0x7feec81f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecd151640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80b3de0 0x7feec81f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41372/0 (socket says 172.21.15.81:41372) 2024-09-17T05:22:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecd151640 1 -- 172.21.15.81:0/288072169 learned_addr learned my addr 172.21.15.81:0/288072169 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecd952640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feec81617f0 0x7feec81f1e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.161+0000 7feecc950640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feec80d01b0 0x7feec80c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecd151640 1 -- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feec80d01b0 msgr2=0x7feec80c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecd151640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feec80d01b0 0x7feec80c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecd151640 1 -- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feec81617f0 msgr2=0x7feec81f1e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecd151640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feec81617f0 0x7feec81f1e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecd151640 1 -- 172.21.15.81:0/288072169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feec80cdf00 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecd151640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80b3de0 0x7feec81f4b50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c710 tx=0x7feeb800cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feec5ffb640 1 -- 172.21.15.81:0/288072169 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb8003b90 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feec5ffb640 1 -- 172.21.15.81:0/288072169 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feeb8003d30 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feec80c8060 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feec5ffb640 1 -- 172.21.15.81:0/288072169 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feeb800aab0 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.162+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feec80c8620 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.163+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feec80b4f50 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.164+0000 7feec5ffb640 1 -- 172.21.15.81:0/288072169 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7feeb800ac50 con 0x7feec80b3de0 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.164+0000 7feec5ffb640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7feeb4078f20 0x7feeb407b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.164+0000 7feec5ffb640 1 -- 172.21.15.81:0/288072169 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(68..68 src has 1..68) ==== 5709+0+0 (secure 0 0 0) 0x7feeb809b1e0 con 0x7feec80b3de0 2024-09-17T05:22:20.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.164+0000 7feecc950640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7feeb4078f20 0x7feeb407b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.165+0000 7feecc950640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7feeb4078f20 0x7feeb407b3e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feebc033000 tx=0x7feebc004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.169+0000 7feec5ffb640 1 -- 172.21.15.81:0/288072169 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7feec80cdf00 con 0x7feec80b3de0 2024-09-17T05:22:20.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.381+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7feec80b5700 con 0x7feec80b3de0 2024-09-17T05:22:20.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.426+0000 7feec5ffb640 1 -- 172.21.15.81:0/288072169 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v38) ==== 118+0+0 (secure 0 0 0) 0x7feeb800ce20 con 0x7feec80b3de0 2024-09-17T05:22:20.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.428+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7feeb4078f20 msgr2=0x7feeb407b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7feeb4078f20 0x7feeb407b3e0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7feebc033000 tx=0x7feebc004730 comp rx=0 tx=0).stop 2024-09-17T05:22:20.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80b3de0 msgr2=0x7feec81f4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80b3de0 0x7feec81f4b50 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7feeb800c710 tx=0x7feeb800cbd0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 shutdown_connections 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7feeb4078f20 0x7feeb407b3e0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feec81617f0 0x7feec81f1e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feec80d01b0 0x7feec80c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 --2- 172.21.15.81:0/288072169 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feec80b3de0 0x7feec81f4b50 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 >> 172.21.15.81:0/288072169 conn(0x7feec80d3e30 msgr2=0x7feec806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 shutdown_connections 2024-09-17T05:22:20.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.429+0000 7feecf3b5640 1 -- 172.21.15.81:0/288072169 wait complete. 2024-09-17T05:22:20.441 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:22:20.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:22:20.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.544+0000 7fb42e918640 1 -- 172.21.15.81:0/867030164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 msgr2=0x7fb4100051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.544+0000 7fb42e918640 1 --2- 172.21.15.81:0/867030164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 0x7fb4100051c0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7fb42000c610 tx=0x7fb410005830 comp rx=0 tx=0).stop 2024-09-17T05:22:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.544+0000 7fb42ceb5640 1 -- 172.21.15.81:0/867030164 reap_dead start 2024-09-17T05:22:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.544+0000 7fb42e918640 1 -- 172.21.15.81:0/867030164 shutdown_connections 2024-09-17T05:22:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.544+0000 7fb42e918640 1 -- 172.21.15.81:0/867030164 >> 172.21.15.81:0/867030164 conn(0x7fb4280b1700 msgr2=0x7fb4280b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.544+0000 7fb42e918640 1 -- 172.21.15.81:0/867030164 shutdown_connections 2024-09-17T05:22:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.544+0000 7fb42e918640 1 -- 172.21.15.81:0/867030164 wait complete. 2024-09-17T05:22:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.545+0000 7fb42e918640 1 Processor -- start 2024-09-17T05:22:20.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42e918640 1 -- start start 2024-09-17T05:22:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42e918640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 0x7fb428146f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42e918640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4280b2a00 0x7fb42815d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42e918640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4280b2e80 0x7fb42815d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42e918640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4280cac40 con 0x7fb410004d40 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42e918640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb42806feb0 con 0x7fb4280b2a00 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42e918640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb4280cadc0 con 0x7fb4280b2e80 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb427fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 0x7fb428146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb427fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 0x7fb428146f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41388/0 (socket says 172.21.15.81:41388) 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb427fff640 1 -- 172.21.15.81:0/285175620 learned_addr learned my addr 172.21.15.81:0/285175620 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb42ceb5640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4280b2e80 0x7fb42815d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.546+0000 7fb4277fe640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4280b2a00 0x7fb42815d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb427fff640 1 -- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4280b2e80 msgr2=0x7fb42815d5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb427fff640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4280b2e80 0x7fb42815d5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb427fff640 1 -- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4280b2a00 msgr2=0x7fb42815d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb427fff640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4280b2a00 0x7fb42815d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb427fff640 1 -- 172.21.15.81:0/285175620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4280b4190 con 0x7fb410004d40 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb4277fe640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4280b2a00 0x7fb42815d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb427fff640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 0x7fb428146f20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb418011b40 tx=0x7fb418009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb424ff9640 1 -- 172.21.15.81:0/285175620 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb41801e070 con 0x7fb410004d40 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb424ff9640 1 -- 172.21.15.81:0/285175620 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb418004050 con 0x7fb410004d40 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb424ff9640 1 -- 172.21.15.81:0/285175620 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4180044a0 con 0x7fb410004d40 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb428147460 con 0x7fb410004d40 2024-09-17T05:22:20.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.547+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4280b3450 con 0x7fb410004d40 2024-09-17T05:22:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.548+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4280cc980 con 0x7fb410004d40 2024-09-17T05:22:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.549+0000 7fb424ff9640 1 -- 172.21.15.81:0/285175620 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fb418021070 con 0x7fb410004d40 2024-09-17T05:22:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.549+0000 7fb424ff9640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb414078f20 0x7fb41407b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:20.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.549+0000 7fb424ff9640 1 -- 172.21.15.81:0/285175620 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fb41809bdd0 con 0x7fb410004d40 2024-09-17T05:22:20.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.549+0000 7fb4277fe640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb414078f20 0x7fb41407b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:20.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.550+0000 7fb4277fe640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb414078f20 0x7fb41407b3e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb428070230 tx=0x7fb41c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:20.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.553+0000 7fb424ff9640 1 -- 172.21.15.81:0/285175620 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb41809f030 con 0x7fb410004d40 2024-09-17T05:22:20.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:20.765+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb4280caa20 con 0x7fb410004d40 2024-09-17T05:22:21.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.435+0000 7fb424ff9640 1 -- 172.21.15.81:0/285175620 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v39) ==== 122+0+0 (secure 0 0 0) 0x7fb418063780 con 0x7fb410004d40 2024-09-17T05:22:21.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb414078f20 msgr2=0x7fb41407b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb414078f20 0x7fb41407b3e0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fb428070230 tx=0x7fb41c005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:21.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 msgr2=0x7fb428146f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 0x7fb428146f20 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7fb418011b40 tx=0x7fb418009e90 comp rx=0 tx=0).stop 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 shutdown_connections 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb414078f20 0x7fb41407b3e0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4280b2e80 0x7fb42815d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4280b2a00 0x7fb42815d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 --2- 172.21.15.81:0/285175620 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb410004d40 0x7fb428146f20 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 >> 172.21.15.81:0/285175620 conn(0x7fb4280b1700 msgr2=0x7fb4280b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 shutdown_connections 2024-09-17T05:22:21.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.437+0000 7fb42e918640 1 -- 172.21.15.81:0/285175620 wait complete. 2024-09-17T05:22:21.450 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:22:21.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 -- 172.21.15.81:0/2681199547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f80735a0 msgr2=0x7f07f80739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 --2- 172.21.15.81:0/2681199547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f80735a0 0x7f07f80739d0 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f07e0005fd0 tx=0x7f07e002a490 comp rx=0 tx=0).stop 2024-09-17T05:22:21.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 -- 172.21.15.81:0/2681199547 shutdown_connections 2024-09-17T05:22:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 --2- 172.21.15.81:0/2681199547 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07f806ff80 0x7f07f8070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 --2- 172.21.15.81:0/2681199547 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f80735a0 0x7f07f80739d0 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 -- 172.21.15.81:0/2681199547 >> 172.21.15.81:0/2681199547 conn(0x7f07f80b1690 msgr2=0x7f07f80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 -- 172.21.15.81:0/2681199547 shutdown_connections 2024-09-17T05:22:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.551+0000 7f07fd00f640 1 -- 172.21.15.81:0/2681199547 wait complete. 2024-09-17T05:22:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.552+0000 7f07fd00f640 1 Processor -- start 2024-09-17T05:22:21.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07fd00f640 1 -- start start 2024-09-17T05:22:21.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07fd00f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07f806ff80 0x7f07f81667d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07fd00f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f80735a0 0x7f07f8150c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07fd00f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f815aa70 0x7f07f813a260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07fd00f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f07f80cd270 con 0x7f07f815aa70 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07fd00f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f07f80cd0f0 con 0x7f07f80735a0 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07fd00f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f07f80cd3f0 con 0x7f07f806ff80 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07f759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f815aa70 0x7f07f813a260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07f759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f815aa70 0x7f07f813a260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41402/0 (socket says 172.21.15.81:41402) 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.553+0000 7f07f759e640 1 -- 172.21.15.81:0/147964825 learned_addr learned my addr 172.21.15.81:0/147964825 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f659c640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f80735a0 0x7f07f8150c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f6d9d640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07f806ff80 0x7f07f81667d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f759e640 1 -- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07f806ff80 msgr2=0x7f07f81667d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f759e640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07f806ff80 0x7f07f81667d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f759e640 1 -- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f80735a0 msgr2=0x7f07f8150c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f759e640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f80735a0 0x7f07f8150c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f759e640 1 -- 172.21.15.81:0/147964825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07f8167070 con 0x7f07f815aa70 2024-09-17T05:22:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07f759e640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f815aa70 0x7f07f813a260 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f07f000c970 tx=0x7f07f000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07ef7fe640 1 -- 172.21.15.81:0/147964825 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0007bb0 con 0x7f07f815aa70 2024-09-17T05:22:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07ef7fe640 1 -- 172.21.15.81:0/147964825 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f07f0007e40 con 0x7f07f815aa70 2024-09-17T05:22:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07f8167630 con 0x7f07f815aa70 2024-09-17T05:22:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07ef7fe640 1 -- 172.21.15.81:0/147964825 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07f0005280 con 0x7f07f815aa70 2024-09-17T05:22:21.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.554+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07f8167bf0 con 0x7f07f815aa70 2024-09-17T05:22:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.555+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07f80cd8a0 con 0x7f07f815aa70 2024-09-17T05:22:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.556+0000 7f07ef7fe640 1 -- 172.21.15.81:0/147964825 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f07f0005420 con 0x7f07f815aa70 2024-09-17T05:22:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.556+0000 7f07ef7fe640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f07d8078ef0 0x7f07d807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.556+0000 7f07ef7fe640 1 -- 172.21.15.81:0/147964825 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f07f009b7d0 con 0x7f07f815aa70 2024-09-17T05:22:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.556+0000 7f07f6d9d640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f07d8078ef0 0x7f07d807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.557+0000 7f07f6d9d640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f07d8078ef0 0x7f07d807b3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f07e800b450 tx=0x7f07e800d040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.560+0000 7f07ef7fe640 1 -- 172.21.15.81:0/147964825 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f07f0014030 con 0x7f07f815aa70 2024-09-17T05:22:21.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.769+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f07f815a270 con 0x7f07f815aa70 2024-09-17T05:22:21.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.770+0000 7f07ef7fe640 1 -- 172.21.15.81:0/147964825 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5225 (secure 0 0 0) 0x7f07f00630c0 con 0x7f07f815aa70 2024-09-17T05:22:21.771 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:21.771 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"btime":"2024-09-17T05:22:21:431616+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:21.772 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 39 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f07d8078ef0 msgr2=0x7f07d807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f07d8078ef0 0x7f07d807b3b0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f07e800b450 tx=0x7f07e800d040 comp rx=0 tx=0).stop 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f815aa70 msgr2=0x7f07f813a260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f815aa70 0x7f07f813a260 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f07f000c970 tx=0x7f07f000ce30 comp rx=0 tx=0).stop 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 shutdown_connections 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f07d8078ef0 0x7f07d807b3b0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f07f815aa70 0x7f07f813a260 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f07f80735a0 0x7f07f8150c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 --2- 172.21.15.81:0/147964825 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f07f806ff80 0x7f07f81667d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 >> 172.21.15.81:0/147964825 conn(0x7f07f80b1690 msgr2=0x7f07f8072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 shutdown_connections 2024-09-17T05:22:21.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.772+0000 7f07fd00f640 1 -- 172.21.15.81:0/147964825 wait complete. 2024-09-17T05:22:21.784 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:21.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.884+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/1570623754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af0004800 msgr2=0x7f5af0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.884+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/1570623754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af0004800 0x7f5af0004c80 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f5af4001690 tx=0x7f5af0005830 comp rx=0 tx=0).stop 2024-09-17T05:22:21.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.884+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/1570623754 shutdown_connections 2024-09-17T05:22:21.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.884+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/1570623754 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5af0004800 0x7f5af0004c80 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.884+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/1570623754 >> 172.21.15.81:0/1570623754 conn(0x7f5b040b1690 msgr2=0x7f5b040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:21.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.884+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/1570623754 shutdown_connections 2024-09-17T05:22:21.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.884+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/1570623754 wait complete. 2024-09-17T05:22:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.885+0000 7f5b0c1d3640 1 Processor -- start 2024-09-17T05:22:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.885+0000 7f5b0c1d3640 1 -- start start 2024-09-17T05:22:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0c1d3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af0004800 0x7f5b040cb440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0c1d3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b0415d2f0 0x7f5b0415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0c1d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b040a9490 0x7f5b040a9910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0c1d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04073d60 con 0x7f5b040a9490 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0c1d3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b04073be0 con 0x7f5af0004800 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0c1d3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5b0406ff80 con 0x7f5b0415d2f0 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0a770640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b040a9490 0x7f5b040a9910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0a770640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b040a9490 0x7f5b040a9910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41408/0 (socket says 172.21.15.81:41408) 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0a770640 1 -- 172.21.15.81:0/2003038070 learned_addr learned my addr 172.21.15.81:0/2003038070 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b09f6f640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af0004800 0x7f5b040cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.886+0000 7f5b0976e640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b0415d2f0 0x7f5b0415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0a770640 1 -- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b0415d2f0 msgr2=0x7f5b0415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0a770640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b0415d2f0 0x7f5b0415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0a770640 1 -- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af0004800 msgr2=0x7f5b040cb440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0a770640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af0004800 0x7f5b040cb440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0a770640 1 -- 172.21.15.81:0/2003038070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b041f1270 con 0x7f5b040a9490 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0a770640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b040a9490 0x7f5b040a9910 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5afc005fd0 tx=0x7f5afc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5afa7fc640 1 -- 172.21.15.81:0/2003038070 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc003970 con 0x7f5b040a9490 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5afa7fc640 1 -- 172.21.15.81:0/2003038070 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5afc003b10 con 0x7f5b040a9490 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5afa7fc640 1 -- 172.21.15.81:0/2003038070 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5afc004030 con 0x7f5b040a9490 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b041f1530 con 0x7f5b040a9490 2024-09-17T05:22:21.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.887+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b041f1af0 con 0x7f5b040a9490 2024-09-17T05:22:21.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.888+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b040b4690 con 0x7f5b040a9490 2024-09-17T05:22:21.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.888+0000 7f5afa7fc640 1 -- 172.21.15.81:0/2003038070 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f5afc0041d0 con 0x7f5b040a9490 2024-09-17T05:22:21.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.889+0000 7f5afa7fc640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ae8078ef0 0x7f5ae807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:21.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.889+0000 7f5afa7fc640 1 -- 172.21.15.81:0/2003038070 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f5afc09db30 con 0x7f5b040a9490 2024-09-17T05:22:21.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.889+0000 7f5b09f6f640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ae8078ef0 0x7f5ae807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:21.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.890+0000 7f5b09f6f640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ae8078ef0 0x7f5ae807b3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b000018a0 tx=0x7f5b00006040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:21.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:21.893+0000 7f5afa7fc640 1 -- 172.21.15.81:0/2003038070 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5afc010e20 con 0x7f5b040a9490 2024-09-17T05:22:22.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.072+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5b0415baa0 con 0x7f5b040a9490 2024-09-17T05:22:22.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.073+0000 7f5afa7fc640 1 -- 172.21.15.81:0/2003038070 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) ==== 74+0+16728 (secure 0 0 0) 0x7f5afc065420 con 0x7f5b040a9490 2024-09-17T05:22:22.075 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:22.075 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:20.426861+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:16.749294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:17.729305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ae8078ef0 msgr2=0x7f5ae807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ae8078ef0 0x7f5ae807b3b0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f5b000018a0 tx=0x7f5b00006040 comp rx=0 tx=0).stop 2024-09-17T05:22:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b040a9490 msgr2=0x7f5b040a9910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b040a9490 0x7f5b040a9910 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f5afc005fd0 tx=0x7f5afc00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 shutdown_connections 2024-09-17T05:22:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5ae8078ef0 0x7f5ae807b3b0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b040a9490 0x7f5b040a9910 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b0415d2f0 0x7f5b0415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 --2- 172.21.15.81:0/2003038070 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5af0004800 0x7f5b040cb440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 >> 172.21.15.81:0/2003038070 conn(0x7f5b040b1690 msgr2=0x7f5b040ce330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 shutdown_connections 2024-09-17T05:22:22.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.076+0000 7f5b0c1d3640 1 -- 172.21.15.81:0/2003038070 wait complete. 2024-09-17T05:22:22.088 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:22:22.088 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 -- 172.21.15.81:0/2395022641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c151370 msgr2=0x7ff33c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 --2- 172.21.15.81:0/2395022641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c151370 0x7ff33c0cef30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff33c0cc0c0 tx=0x7ff32c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:22.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 -- 172.21.15.81:0/2395022641 shutdown_connections 2024-09-17T05:22:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 --2- 172.21.15.81:0/2395022641 >> v2:172.21.15.160:3300/0 conn(0x7ff33c0725a0 0x7ff33c072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 --2- 172.21.15.81:0/2395022641 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff33c0b3140 0x7ff33c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 --2- 172.21.15.81:0/2395022641 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c151370 0x7ff33c0cef30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 -- 172.21.15.81:0/2395022641 >> 172.21.15.81:0/2395022641 conn(0x7ff33c0b1690 msgr2=0x7ff33c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 -- 172.21.15.81:0/2395022641 shutdown_connections 2024-09-17T05:22:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.188+0000 7ff3420f7640 1 -- 172.21.15.81:0/2395022641 wait complete. 2024-09-17T05:22:22.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.189+0000 7ff3420f7640 1 Processor -- start 2024-09-17T05:22:22.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.189+0000 7ff3420f7640 1 -- start start 2024-09-17T05:22:22.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff3420f7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff33c0725a0 0x7ff33c147770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff3420f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0b3140 0x7ff33c0cee90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff3420f7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff33c151370 0x7ff33c142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff3420f7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c06ea80 con 0x7ff33c0b3140 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff3420f7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff33c06e900 con 0x7ff33c0725a0 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff3420f7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff33c06ec00 con 0x7ff33c151370 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff33affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0b3140 0x7ff33c0cee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff33affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0b3140 0x7ff33c0cee90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41434/0 (socket says 172.21.15.81:41434) 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff33affd640 1 -- 172.21.15.81:0/3277975323 learned_addr learned my addr 172.21.15.81:0/3277975323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff33bfff640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff33c151370 0x7ff33c142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.190+0000 7ff33b7fe640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff33c0725a0 0x7ff33c147770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff33affd640 1 -- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff33c151370 msgr2=0x7ff33c142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff33affd640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff33c151370 0x7ff33c142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff33affd640 1 -- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff33c0725a0 msgr2=0x7ff33c147770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff33affd640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff33c0725a0 0x7ff33c147770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff33affd640 1 -- 172.21.15.81:0/3277975323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff33c0cd4f0 con 0x7ff33c0b3140 2024-09-17T05:22:22.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff33affd640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0b3140 0x7ff33c0cee90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff33000d770 tx=0x7ff33000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff323fff640 1 -- 172.21.15.81:0/3277975323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330017070 con 0x7ff33c0b3140 2024-09-17T05:22:22.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff323fff640 1 -- 172.21.15.81:0/3277975323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff330009d20 con 0x7ff33c0b3140 2024-09-17T05:22:22.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff323fff640 1 -- 172.21.15.81:0/3277975323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff330005280 con 0x7ff33c0b3140 2024-09-17T05:22:22.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff33c0cd7d0 con 0x7ff33c0b3140 2024-09-17T05:22:22.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.191+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff33c0cdd90 con 0x7ff33c0b3140 2024-09-17T05:22:22.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.192+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff33c072a10 con 0x7ff33c0b3140 2024-09-17T05:22:22.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.192+0000 7ff323fff640 1 -- 172.21.15.81:0/3277975323 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7ff330005420 con 0x7ff33c0b3140 2024-09-17T05:22:22.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.193+0000 7ff323fff640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff328078ef0 0x7ff32807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.193+0000 7ff323fff640 1 -- 172.21.15.81:0/3277975323 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7ff33009b550 con 0x7ff33c0b3140 2024-09-17T05:22:22.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.193+0000 7ff33b7fe640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff328078ef0 0x7ff32807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.194+0000 7ff33b7fe640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff328078ef0 0x7ff32807b3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff32c035000 tx=0x7ff32c03b040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.197+0000 7ff323fff640 1 -- 172.21.15.81:0/3277975323 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff330062db0 con 0x7ff33c0b3140 2024-09-17T05:22:22.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.369+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff33c13fb20 con 0x7ff328078ef0 2024-09-17T05:22:22.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.374+0000 7ff323fff640 1 -- 172.21.15.81:0/3277975323 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250912 (secure 0 0 0) 0x7ff33c13fb20 con 0x7ff328078ef0 2024-09-17T05:22:22.377 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:22.379 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:22:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff328078ef0 msgr2=0x7ff32807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff328078ef0 0x7ff32807b3b0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7ff32c035000 tx=0x7ff32c03b040 comp rx=0 tx=0).stop 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0b3140 msgr2=0x7ff33c0cee90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0b3140 0x7ff33c0cee90 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff33000d770 tx=0x7ff33000dc30 comp rx=0 tx=0).stop 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 shutdown_connections 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff328078ef0 0x7ff32807b3b0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff33c151370 0x7ff33c142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff33c0b3140 0x7ff33c0cee90 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 --2- 172.21.15.81:0/3277975323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff33c0725a0 0x7ff33c147770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 >> 172.21.15.81:0/3277975323 conn(0x7ff33c0b1690 msgr2=0x7ff33c1538e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 shutdown_connections 2024-09-17T05:22:22.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.377+0000 7ff3420f7640 1 -- 172.21.15.81:0/3277975323 wait complete. 2024-09-17T05:22:22.389 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-17T05:22:21.426298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232208,"kb_used_data":7648,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742512,"statfs":{"total":773094113280,"available":772856332288,"internally_reserved":0,"allocated":7831552,"data_stored":3916658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016345"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029833+0000","last_change":"2024-09-17T05:22:19.438662+0000","last_active":"2024-09-17T05:22:21.029833+0000","last_peered":"2024-09-17T05:22:21.029833+0000","last_clean":"2024-09-17T05:22:21.029833+0000","last_became_active":"2024-09-17T05:22:19.438390+0000","last_became_peered":"2024-09-17T05:22:19.438390+0000","last_unstale":"2024-09-17T05:22:21.029833+0000","last_undegraded":"2024-09-17T05:22:21.029833+0000","last_fullsized":"2024-09-17T05:22:21.029833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:05.760603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436833+0000","last_change":"2024-09-17T05:22:19.428772+0000","last_active":"2024-09-17T05:22:20.436833+0000","last_peered":"2024-09-17T05:22:20.436833+0000","last_clean":"2024-09-17T05:22:20.436833+0000","last_became_active":"2024-09-17T05:22:19.427862+0000","last_became_peered":"2024-09-17T05:22:19.427862+0000","last_unstale":"2024-09-17T05:22:20.436833+0000","last_undegraded":"2024-09-17T05:22:20.436833+0000","last_fullsized":"2024-09-17T05:22:20.436833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295130+0000","last_change":"2024-09-17T05:22:19.434335+0000","last_active":"2024-09-17T05:22:21.295130+0000","last_peered":"2024-09-17T05:22:21.295130+0000","last_clean":"2024-09-17T05:22:21.295130+0000","last_became_active":"2024-09-17T05:22:19.434058+0000","last_became_peered":"2024-09-17T05:22:19.434058+0000","last_unstale":"2024-09-17T05:22:21.295130+0000","last_undegraded":"2024-09-17T05:22:21.295130+0000","last_fullsized":"2024-09-17T05:22:21.295130+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:29.970938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295867+0000","last_change":"2024-09-17T05:22:19.445535+0000","last_active":"2024-09-17T05:22:21.295867+0000","last_peered":"2024-09-17T05:22:21.295867+0000","last_clean":"2024-09-17T05:22:21.295867+0000","last_became_active":"2024-09-17T05:22:19.444870+0000","last_became_peered":"2024-09-17T05:22:19.444870+0000","last_unstale":"2024-09-17T05:22:21.295867+0000","last_undegraded":"2024-09-17T05:22:21.295867+0000","last_fullsized":"2024-09-17T05:22:21.295867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:36.729817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433254+0000","last_change":"2024-09-17T05:22:19.438404+0000","last_active":"2024-09-17T05:22:20.433254+0000","last_peered":"2024-09-17T05:22:20.433254+0000","last_clean":"2024-09-17T05:22:20.433254+0000","last_became_active":"2024-09-17T05:22:19.438134+0000","last_became_peered":"2024-09-17T05:22:19.438134+0000","last_unstale":"2024-09-17T05:22:20.433254+0000","last_undegraded":"2024-09-17T05:22:20.433254+0000","last_fullsized":"2024-09-17T05:22:20.433254+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:41.699191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436163+0000","last_change":"2024-09-17T05:22:19.426534+0000","last_active":"2024-09-17T05:22:20.436163+0000","last_peered":"2024-09-17T05:22:20.436163+0000","last_clean":"2024-09-17T05:22:20.436163+0000","last_became_active":"2024-09-17T05:22:19.426215+0000","last_became_peered":"2024-09-17T05:22:19.426215+0000","last_unstale":"2024-09-17T05:22:20.436163+0000","last_undegraded":"2024-09-17T05:22:20.436163+0000","last_fullsized":"2024-09-17T05:22:20.436163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:22.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007121+0000","last_change":"2024-09-17T05:22:19.440259+0000","last_active":"2024-09-17T05:22:21.007121+0000","last_peered":"2024-09-17T05:22:21.007121+0000","last_clean":"2024-09-17T05:22:21.007121+0000","last_became_active":"2024-09-17T05:22:19.439993+0000","last_became_peered":"2024-09-17T05:22:19.439993+0000","last_unstale":"2024-09-17T05:22:21.007121+0000","last_undegraded":"2024-09-17T05:22:21.007121+0000","last_fullsized":"2024-09-17T05:22:21.007121+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.223827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436770+0000","last_change":"2024-09-17T05:22:19.437945+0000","last_active":"2024-09-17T05:22:20.436770+0000","last_peered":"2024-09-17T05:22:20.436770+0000","last_clean":"2024-09-17T05:22:20.436770+0000","last_became_active":"2024-09-17T05:22:19.437670+0000","last_became_peered":"2024-09-17T05:22:19.437670+0000","last_unstale":"2024-09-17T05:22:20.436770+0000","last_undegraded":"2024-09-17T05:22:20.436770+0000","last_fullsized":"2024-09-17T05:22:20.436770+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:26.423565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433544+0000","last_change":"2024-09-17T05:22:19.430604+0000","last_active":"2024-09-17T05:22:20.433544+0000","last_peered":"2024-09-17T05:22:20.433544+0000","last_clean":"2024-09-17T05:22:20.433544+0000","last_became_active":"2024-09-17T05:22:19.430136+0000","last_became_peered":"2024-09-17T05:22:19.430136+0000","last_unstale":"2024-09-17T05:22:20.433544+0000","last_undegraded":"2024-09-17T05:22:20.433544+0000","last_fullsized":"2024-09-17T05:22:20.433544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:15.751408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435427+0000","last_change":"2024-09-17T05:22:19.427898+0000","last_active":"2024-09-17T05:22:20.435427+0000","last_peered":"2024-09-17T05:22:20.435427+0000","last_clean":"2024-09-17T05:22:20.435427+0000","last_became_active":"2024-09-17T05:22:19.427591+0000","last_became_peered":"2024-09-17T05:22:19.427591+0000","last_unstale":"2024-09-17T05:22:20.435427+0000","last_undegraded":"2024-09-17T05:22:20.435427+0000","last_fullsized":"2024-09-17T05:22:20.435427+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:01.861609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029667+0000","last_change":"2024-09-17T05:22:19.442877+0000","last_active":"2024-09-17T05:22:21.029667+0000","last_peered":"2024-09-17T05:22:21.029667+0000","last_clean":"2024-09-17T05:22:21.029667+0000","last_became_active":"2024-09-17T05:22:19.442514+0000","last_became_peered":"2024-09-17T05:22:19.442514+0000","last_unstale":"2024-09-17T05:22:21.029667+0000","last_undegraded":"2024-09-17T05:22:21.029667+0000","last_fullsized":"2024-09-17T05:22:21.029667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:45.208300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296004+0000","last_change":"2024-09-17T05:22:19.447642+0000","last_active":"2024-09-17T05:22:21.296004+0000","last_peered":"2024-09-17T05:22:21.296004+0000","last_clean":"2024-09-17T05:22:21.296004+0000","last_became_active":"2024-09-17T05:22:19.447297+0000","last_became_peered":"2024-09-17T05:22:19.447297+0000","last_unstale":"2024-09-17T05:22:21.296004+0000","last_undegraded":"2024-09-17T05:22:21.296004+0000","last_fullsized":"2024-09-17T05:22:21.296004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:48.971688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433151+0000","last_change":"2024-09-17T05:22:19.436649+0000","last_active":"2024-09-17T05:22:20.433151+0000","last_peered":"2024-09-17T05:22:20.433151+0000","last_clean":"2024-09-17T05:22:20.433151+0000","last_became_active":"2024-09-17T05:22:19.436379+0000","last_became_peered":"2024-09-17T05:22:19.436379+0000","last_unstale":"2024-09-17T05:22:20.433151+0000","last_undegraded":"2024-09-17T05:22:20.433151+0000","last_fullsized":"2024-09-17T05:22:20.433151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:44.750380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434649+0000","last_change":"2024-09-17T05:22:19.433093+0000","last_active":"2024-09-17T05:22:20.434649+0000","last_peered":"2024-09-17T05:22:20.434649+0000","last_clean":"2024-09-17T05:22:20.434649+0000","last_became_active":"2024-09-17T05:22:19.432601+0000","last_became_peered":"2024-09-17T05:22:19.432601+0000","last_unstale":"2024-09-17T05:22:20.434649+0000","last_undegraded":"2024-09-17T05:22:20.434649+0000","last_fullsized":"2024-09-17T05:22:20.434649+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433524+0000","last_change":"2024-09-17T05:22:19.427959+0000","last_active":"2024-09-17T05:22:20.433524+0000","last_peered":"2024-09-17T05:22:20.433524+0000","last_clean":"2024-09-17T05:22:20.433524+0000","last_became_active":"2024-09-17T05:22:19.427723+0000","last_became_peered":"2024-09-17T05:22:19.427723+0000","last_unstale":"2024-09-17T05:22:20.433524+0000","last_undegraded":"2024-09-17T05:22:20.433524+0000","last_fullsized":"2024-09-17T05:22:20.433524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:37.815920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295801+0000","last_change":"2024-09-17T05:22:19.445081+0000","last_active":"2024-09-17T05:22:21.295801+0000","last_peered":"2024-09-17T05:22:21.295801+0000","last_clean":"2024-09-17T05:22:21.295801+0000","last_became_active":"2024-09-17T05:22:19.444827+0000","last_became_peered":"2024-09-17T05:22:19.444827+0000","last_unstale":"2024-09-17T05:22:21.295801+0000","last_undegraded":"2024-09-17T05:22:21.295801+0000","last_fullsized":"2024-09-17T05:22:21.295801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:37.186334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436123+0000","last_change":"2024-09-17T05:22:19.438688+0000","last_active":"2024-09-17T05:22:20.436123+0000","last_peered":"2024-09-17T05:22:20.436123+0000","last_clean":"2024-09-17T05:22:20.436123+0000","last_became_active":"2024-09-17T05:22:19.438382+0000","last_became_peered":"2024-09-17T05:22:19.438382+0000","last_unstale":"2024-09-17T05:22:20.436123+0000","last_undegraded":"2024-09-17T05:22:20.436123+0000","last_fullsized":"2024-09-17T05:22:20.436123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:32.110192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434924+0000","last_change":"2024-09-17T05:22:19.430871+0000","last_active":"2024-09-17T05:22:20.434924+0000","last_peered":"2024-09-17T05:22:20.434924+0000","last_clean":"2024-09-17T05:22:20.434924+0000","last_became_active":"2024-09-17T05:22:19.430608+0000","last_became_peered":"2024-09-17T05:22:19.430608+0000","last_unstale":"2024-09-17T05:22:20.434924+0000","last_undegraded":"2024-09-17T05:22:20.434924+0000","last_fullsized":"2024-09-17T05:22:20.434924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434847+0000","last_change":"2024-09-17T05:22:19.422392+0000","last_active":"2024-09-17T05:22:20.434847+0000","last_peered":"2024-09-17T05:22:20.434847+0000","last_clean":"2024-09-17T05:22:20.434847+0000","last_became_active":"2024-09-17T05:22:19.421987+0000","last_became_peered":"2024-09-17T05:22:19.421987+0000","last_unstale":"2024-09-17T05:22:20.434847+0000","last_undegraded":"2024-09-17T05:22:20.434847+0000","last_fullsized":"2024-09-17T05:22:20.434847+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:08.730503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029409+0000","last_change":"2024-09-17T05:22:19.435845+0000","last_active":"2024-09-17T05:22:21.029409+0000","last_peered":"2024-09-17T05:22:21.029409+0000","last_clean":"2024-09-17T05:22:21.029409+0000","last_became_active":"2024-09-17T05:22:19.435535+0000","last_became_peered":"2024-09-17T05:22:19.435535+0000","last_unstale":"2024-09-17T05:22:21.029409+0000","last_undegraded":"2024-09-17T05:22:21.029409+0000","last_fullsized":"2024-09-17T05:22:21.029409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:17.679119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029229+0000","last_change":"2024-09-17T05:22:19.438687+0000","last_active":"2024-09-17T05:22:21.029229+0000","last_peered":"2024-09-17T05:22:21.029229+0000","last_clean":"2024-09-17T05:22:21.029229+0000","last_became_active":"2024-09-17T05:22:19.438347+0000","last_became_peered":"2024-09-17T05:22:19.438347+0000","last_unstale":"2024-09-17T05:22:21.029229+0000","last_undegraded":"2024-09-17T05:22:21.029229+0000","last_fullsized":"2024-09-17T05:22:21.029229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435155+0000","last_change":"2024-09-17T05:22:19.436133+0000","last_active":"2024-09-17T05:22:20.435155+0000","last_peered":"2024-09-17T05:22:20.435155+0000","last_clean":"2024-09-17T05:22:20.435155+0000","last_became_active":"2024-09-17T05:22:19.434918+0000","last_became_peered":"2024-09-17T05:22:19.434918+0000","last_unstale":"2024-09-17T05:22:20.435155+0000","last_undegraded":"2024-09-17T05:22:20.435155+0000","last_fullsized":"2024-09-17T05:22:20.435155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:33.154454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007447+0000","last_change":"2024-09-17T05:22:19.434518+0000","last_active":"2024-09-17T05:22:21.007447+0000","last_peered":"2024-09-17T05:22:21.007447+0000","last_clean":"2024-09-17T05:22:21.007447+0000","last_became_active":"2024-09-17T05:22:19.434257+0000","last_became_peered":"2024-09-17T05:22:19.434257+0000","last_unstale":"2024-09-17T05:22:21.007447+0000","last_undegraded":"2024-09-17T05:22:21.007447+0000","last_fullsized":"2024-09-17T05:22:21.007447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:14.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295312+0000","last_change":"2024-09-17T05:22:19.440746+0000","last_active":"2024-09-17T05:22:21.295312+0000","last_peered":"2024-09-17T05:22:21.295312+0000","last_clean":"2024-09-17T05:22:21.295312+0000","last_became_active":"2024-09-17T05:22:19.440478+0000","last_became_peered":"2024-09-17T05:22:19.440478+0000","last_unstale":"2024-09-17T05:22:21.295312+0000","last_undegraded":"2024-09-17T05:22:21.295312+0000","last_fullsized":"2024-09-17T05:22:21.295312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:39.556732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435163+0000","last_change":"2024-09-17T05:22:19.423204+0000","last_active":"2024-09-17T05:22:20.435163+0000","last_peered":"2024-09-17T05:22:20.435163+0000","last_clean":"2024-09-17T05:22:20.435163+0000","last_became_active":"2024-09-17T05:22:19.422837+0000","last_became_peered":"2024-09-17T05:22:19.422837+0000","last_unstale":"2024-09-17T05:22:20.435163+0000","last_undegraded":"2024-09-17T05:22:20.435163+0000","last_fullsized":"2024-09-17T05:22:20.435163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:48.167633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295557+0000","last_change":"2024-09-17T05:22:19.436288+0000","last_active":"2024-09-17T05:22:21.295557+0000","last_peered":"2024-09-17T05:22:21.295557+0000","last_clean":"2024-09-17T05:22:21.295557+0000","last_became_active":"2024-09-17T05:22:19.435852+0000","last_became_peered":"2024-09-17T05:22:19.435852+0000","last_unstale":"2024-09-17T05:22:21.295557+0000","last_undegraded":"2024-09-17T05:22:21.295557+0000","last_fullsized":"2024-09-17T05:22:21.295557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:19.404495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007353+0000","last_change":"2024-09-17T05:22:19.435208+0000","last_active":"2024-09-17T05:22:21.007353+0000","last_peered":"2024-09-17T05:22:21.007353+0000","last_clean":"2024-09-17T05:22:21.007353+0000","last_became_active":"2024-09-17T05:22:19.434972+0000","last_became_peered":"2024-09-17T05:22:19.434972+0000","last_unstale":"2024-09-17T05:22:21.007353+0000","last_undegraded":"2024-09-17T05:22:21.007353+0000","last_fullsized":"2024-09-17T05:22:21.007353+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:44.946507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007493+0000","last_change":"2024-09-17T05:22:19.436850+0000","last_active":"2024-09-17T05:22:21.007493+0000","last_peered":"2024-09-17T05:22:21.007493+0000","last_clean":"2024-09-17T05:22:21.007493+0000","last_became_active":"2024-09-17T05:22:19.436593+0000","last_became_peered":"2024-09-17T05:22:19.436593+0000","last_unstale":"2024-09-17T05:22:21.007493+0000","last_undegraded":"2024-09-17T05:22:21.007493+0000","last_fullsized":"2024-09-17T05:22:21.007493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:04.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.430122+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.429844+0000","last_became_peered":"2024-09-17T05:22:19.429844+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:31.556861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029745+0000","last_change":"2024-09-17T05:22:19.439394+0000","last_active":"2024-09-17T05:22:21.029745+0000","last_peered":"2024-09-17T05:22:21.029745+0000","last_clean":"2024-09-17T05:22:21.029745+0000","last_became_active":"2024-09-17T05:22:19.437506+0000","last_became_peered":"2024-09-17T05:22:19.437506+0000","last_unstale":"2024-09-17T05:22:21.029745+0000","last_undegraded":"2024-09-17T05:22:21.029745+0000","last_fullsized":"2024-09-17T05:22:21.029745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.824838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029965+0000","last_change":"2024-09-17T05:22:18.429837+0000","last_active":"2024-09-17T05:22:21.029965+0000","last_peered":"2024-09-17T05:22:21.029965+0000","last_clean":"2024-09-17T05:22:21.029965+0000","last_became_active":"2024-09-17T05:22:18.429576+0000","last_became_peered":"2024-09-17T05:22:18.429576+0000","last_unstale":"2024-09-17T05:22:21.029965+0000","last_undegraded":"2024-09-17T05:22:21.029965+0000","last_fullsized":"2024-09-17T05:22:21.029965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:33.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433624+0000","last_change":"2024-09-17T05:22:19.430787+0000","last_active":"2024-09-17T05:22:20.433624+0000","last_peered":"2024-09-17T05:22:20.433624+0000","last_clean":"2024-09-17T05:22:20.433624+0000","last_became_active":"2024-09-17T05:22:19.430454+0000","last_became_peered":"2024-09-17T05:22:19.430454+0000","last_unstale":"2024-09-17T05:22:20.433624+0000","last_undegraded":"2024-09-17T05:22:20.433624+0000","last_fullsized":"2024-09-17T05:22:20.433624+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:01.979709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421267+0000","last_change":"2024-09-17T05:22:18.421267+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421267+0000","last_undegraded":"2024-09-17T05:22:18.421267+0000","last_fullsized":"2024-09-17T05:22:18.421267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436839+0000","last_change":"2024-09-17T05:22:19.434321+0000","last_active":"2024-09-17T05:22:20.436839+0000","last_peered":"2024-09-17T05:22:20.436839+0000","last_clean":"2024-09-17T05:22:20.436839+0000","last_became_active":"2024-09-17T05:22:19.433934+0000","last_became_peered":"2024-09-17T05:22:19.433934+0000","last_unstale":"2024-09-17T05:22:20.436839+0000","last_undegraded":"2024-09-17T05:22:20.436839+0000","last_fullsized":"2024-09-17T05:22:20.436839+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:15.805658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435078+0000","last_change":"2024-09-17T05:22:18.428988+0000","last_active":"2024-09-17T05:22:20.435078+0000","last_peered":"2024-09-17T05:22:20.435078+0000","last_clean":"2024-09-17T05:22:20.435078+0000","last_became_active":"2024-09-17T05:22:18.428719+0000","last_became_peered":"2024-09-17T05:22:18.428719+0000","last_unstale":"2024-09-17T05:22:20.435078+0000","last_undegraded":"2024-09-17T05:22:20.435078+0000","last_fullsized":"2024-09-17T05:22:20.435078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.794624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029706+0000","last_change":"2024-09-17T05:22:19.436635+0000","last_active":"2024-09-17T05:22:21.029706+0000","last_peered":"2024-09-17T05:22:21.029706+0000","last_clean":"2024-09-17T05:22:21.029706+0000","last_became_active":"2024-09-17T05:22:19.435951+0000","last_became_peered":"2024-09-17T05:22:19.435951+0000","last_unstale":"2024-09-17T05:22:21.029706+0000","last_undegraded":"2024-09-17T05:22:21.029706+0000","last_fullsized":"2024-09-17T05:22:21.029706+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.075149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436933+0000","last_change":"2024-09-17T05:22:18.427589+0000","last_active":"2024-09-17T05:22:20.436933+0000","last_peered":"2024-09-17T05:22:20.436933+0000","last_clean":"2024-09-17T05:22:20.436933+0000","last_became_active":"2024-09-17T05:22:18.427294+0000","last_became_peered":"2024-09-17T05:22:18.427294+0000","last_unstale":"2024-09-17T05:22:20.436933+0000","last_undegraded":"2024-09-17T05:22:20.436933+0000","last_fullsized":"2024-09-17T05:22:20.436933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:50.823087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007293+0000","last_change":"2024-09-17T05:22:19.438589+0000","last_active":"2024-09-17T05:22:21.007293+0000","last_peered":"2024-09-17T05:22:21.007293+0000","last_clean":"2024-09-17T05:22:21.007293+0000","last_became_active":"2024-09-17T05:22:19.438299+0000","last_became_peered":"2024-09-17T05:22:19.438299+0000","last_unstale":"2024-09-17T05:22:21.007293+0000","last_undegraded":"2024-09-17T05:22:21.007293+0000","last_fullsized":"2024-09-17T05:22:21.007293+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:57.072075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295653+0000","last_change":"2024-09-17T05:22:18.431383+0000","last_active":"2024-09-17T05:22:21.295653+0000","last_peered":"2024-09-17T05:22:21.295653+0000","last_clean":"2024-09-17T05:22:21.295653+0000","last_became_active":"2024-09-17T05:22:18.431115+0000","last_became_peered":"2024-09-17T05:22:18.431115+0000","last_unstale":"2024-09-17T05:22:21.295653+0000","last_undegraded":"2024-09-17T05:22:21.295653+0000","last_fullsized":"2024-09-17T05:22:21.295653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:09.892453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435067+0000","last_change":"2024-09-17T05:22:19.432969+0000","last_active":"2024-09-17T05:22:20.435067+0000","last_peered":"2024-09-17T05:22:20.435067+0000","last_clean":"2024-09-17T05:22:20.435067+0000","last_became_active":"2024-09-17T05:22:19.432466+0000","last_became_peered":"2024-09-17T05:22:19.432466+0000","last_unstale":"2024-09-17T05:22:20.435067+0000","last_undegraded":"2024-09-17T05:22:20.435067+0000","last_fullsized":"2024-09-17T05:22:20.435067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:11.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436110+0000","last_change":"2024-09-17T05:22:18.431419+0000","last_active":"2024-09-17T05:22:20.436110+0000","last_peered":"2024-09-17T05:22:20.436110+0000","last_clean":"2024-09-17T05:22:20.436110+0000","last_became_active":"2024-09-17T05:22:18.430589+0000","last_became_peered":"2024-09-17T05:22:18.430589+0000","last_unstale":"2024-09-17T05:22:20.436110+0000","last_undegraded":"2024-09-17T05:22:20.436110+0000","last_fullsized":"2024-09-17T05:22:20.436110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:39.998483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432851+0000","last_change":"2024-09-17T05:22:19.427627+0000","last_active":"2024-09-17T05:22:20.432851+0000","last_peered":"2024-09-17T05:22:20.432851+0000","last_clean":"2024-09-17T05:22:20.432851+0000","last_became_active":"2024-09-17T05:22:19.427370+0000","last_became_peered":"2024-09-17T05:22:19.427370+0000","last_unstale":"2024-09-17T05:22:20.432851+0000","last_undegraded":"2024-09-17T05:22:20.432851+0000","last_fullsized":"2024-09-17T05:22:20.432851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:36.555054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295310+0000","last_change":"2024-09-17T05:22:18.428001+0000","last_active":"2024-09-17T05:22:21.295310+0000","last_peered":"2024-09-17T05:22:21.295310+0000","last_clean":"2024-09-17T05:22:21.295310+0000","last_became_active":"2024-09-17T05:22:18.427739+0000","last_became_peered":"2024-09-17T05:22:18.427739+0000","last_unstale":"2024-09-17T05:22:21.295310+0000","last_undegraded":"2024-09-17T05:22:21.295310+0000","last_fullsized":"2024-09-17T05:22:21.295310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:10.556798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432875+0000","last_change":"2024-09-17T05:22:18.423744+0000","last_active":"2024-09-17T05:22:20.432875+0000","last_peered":"2024-09-17T05:22:20.432875+0000","last_clean":"2024-09-17T05:22:20.432875+0000","last_became_active":"2024-09-17T05:22:18.423474+0000","last_became_peered":"2024-09-17T05:22:18.423474+0000","last_unstale":"2024-09-17T05:22:20.432875+0000","last_undegraded":"2024-09-17T05:22:20.432875+0000","last_fullsized":"2024-09-17T05:22:20.432875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:20.141453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007512+0000","last_change":"2024-09-17T05:22:19.443778+0000","last_active":"2024-09-17T05:22:21.007512+0000","last_peered":"2024-09-17T05:22:21.007512+0000","last_clean":"2024-09-17T05:22:21.007512+0000","last_became_active":"2024-09-17T05:22:19.443519+0000","last_became_peered":"2024-09-17T05:22:19.443519+0000","last_unstale":"2024-09-17T05:22:21.007512+0000","last_undegraded":"2024-09-17T05:22:21.007512+0000","last_fullsized":"2024-09-17T05:22:21.007512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435207+0000","last_change":"2024-09-17T05:22:18.427480+0000","last_active":"2024-09-17T05:22:20.435207+0000","last_peered":"2024-09-17T05:22:20.435207+0000","last_clean":"2024-09-17T05:22:20.435207+0000","last_became_active":"2024-09-17T05:22:18.427197+0000","last_became_peered":"2024-09-17T05:22:18.427197+0000","last_unstale":"2024-09-17T05:22:20.435207+0000","last_undegraded":"2024-09-17T05:22:20.435207+0000","last_fullsized":"2024-09-17T05:22:20.435207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:18.433977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029862+0000","last_change":"2024-09-17T05:22:19.437340+0000","last_active":"2024-09-17T05:22:21.029862+0000","last_peered":"2024-09-17T05:22:21.029862+0000","last_clean":"2024-09-17T05:22:21.029862+0000","last_became_active":"2024-09-17T05:22:19.437078+0000","last_became_peered":"2024-09-17T05:22:19.437078+0000","last_unstale":"2024-09-17T05:22:21.029862+0000","last_undegraded":"2024-09-17T05:22:21.029862+0000","last_fullsized":"2024-09-17T05:22:21.029862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:27.525759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436753+0000","last_change":"2024-09-17T05:22:18.434179+0000","last_active":"2024-09-17T05:22:20.436753+0000","last_peered":"2024-09-17T05:22:20.436753+0000","last_clean":"2024-09-17T05:22:20.436753+0000","last_became_active":"2024-09-17T05:22:18.433907+0000","last_became_peered":"2024-09-17T05:22:18.433907+0000","last_unstale":"2024-09-17T05:22:20.436753+0000","last_undegraded":"2024-09-17T05:22:20.436753+0000","last_fullsized":"2024-09-17T05:22:20.436753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:34.301087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436901+0000","last_change":"2024-09-17T05:22:19.431778+0000","last_active":"2024-09-17T05:22:20.436901+0000","last_peered":"2024-09-17T05:22:20.436901+0000","last_clean":"2024-09-17T05:22:20.436901+0000","last_became_active":"2024-09-17T05:22:19.430979+0000","last_became_peered":"2024-09-17T05:22:19.430979+0000","last_unstale":"2024-09-17T05:22:20.436901+0000","last_undegraded":"2024-09-17T05:22:20.436901+0000","last_fullsized":"2024-09-17T05:22:20.436901+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295407+0000","last_change":"2024-09-17T05:22:18.435917+0000","last_active":"2024-09-17T05:22:21.295407+0000","last_peered":"2024-09-17T05:22:21.295407+0000","last_clean":"2024-09-17T05:22:21.295407+0000","last_became_active":"2024-09-17T05:22:18.435593+0000","last_became_peered":"2024-09-17T05:22:18.435593+0000","last_unstale":"2024-09-17T05:22:21.295407+0000","last_undegraded":"2024-09-17T05:22:21.295407+0000","last_fullsized":"2024-09-17T05:22:21.295407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.139854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433175+0000","last_change":"2024-09-17T05:22:19.439603+0000","last_active":"2024-09-17T05:22:20.433175+0000","last_peered":"2024-09-17T05:22:20.433175+0000","last_clean":"2024-09-17T05:22:20.433175+0000","last_became_active":"2024-09-17T05:22:19.439330+0000","last_became_peered":"2024-09-17T05:22:19.439330+0000","last_unstale":"2024-09-17T05:22:20.433175+0000","last_undegraded":"2024-09-17T05:22:20.433175+0000","last_fullsized":"2024-09-17T05:22:20.433175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:11.001407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296073+0000","last_change":"2024-09-17T05:22:18.424114+0000","last_active":"2024-09-17T05:22:21.296073+0000","last_peered":"2024-09-17T05:22:21.296073+0000","last_clean":"2024-09-17T05:22:21.296073+0000","last_became_active":"2024-09-17T05:22:18.423841+0000","last_became_peered":"2024-09-17T05:22:18.423841+0000","last_unstale":"2024-09-17T05:22:21.296073+0000","last_undegraded":"2024-09-17T05:22:21.296073+0000","last_fullsized":"2024-09-17T05:22:21.296073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029395+0000","last_change":"2024-09-17T05:22:19.438635+0000","last_active":"2024-09-17T05:22:21.029395+0000","last_peered":"2024-09-17T05:22:21.029395+0000","last_clean":"2024-09-17T05:22:21.029395+0000","last_became_active":"2024-09-17T05:22:19.438317+0000","last_became_peered":"2024-09-17T05:22:19.438317+0000","last_unstale":"2024-09-17T05:22:21.029395+0000","last_undegraded":"2024-09-17T05:22:21.029395+0000","last_fullsized":"2024-09-17T05:22:21.029395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:16.873928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295623+0000","last_change":"2024-09-17T05:22:18.430649+0000","last_active":"2024-09-17T05:22:21.295623+0000","last_peered":"2024-09-17T05:22:21.295623+0000","last_clean":"2024-09-17T05:22:21.295623+0000","last_became_active":"2024-09-17T05:22:18.430347+0000","last_became_peered":"2024-09-17T05:22:18.430347+0000","last_unstale":"2024-09-17T05:22:21.295623+0000","last_undegraded":"2024-09-17T05:22:21.295623+0000","last_fullsized":"2024-09-17T05:22:21.295623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:35.076714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007332+0000","last_change":"2024-09-17T05:22:19.435957+0000","last_active":"2024-09-17T05:22:21.007332+0000","last_peered":"2024-09-17T05:22:21.007332+0000","last_clean":"2024-09-17T05:22:21.007332+0000","last_became_active":"2024-09-17T05:22:19.435711+0000","last_became_peered":"2024-09-17T05:22:19.435711+0000","last_unstale":"2024-09-17T05:22:21.007332+0000","last_undegraded":"2024-09-17T05:22:21.007332+0000","last_fullsized":"2024-09-17T05:22:21.007332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.631571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436227+0000","last_change":"2024-09-17T05:22:18.432090+0000","last_active":"2024-09-17T05:22:20.436227+0000","last_peered":"2024-09-17T05:22:20.436227+0000","last_clean":"2024-09-17T05:22:20.436227+0000","last_became_active":"2024-09-17T05:22:18.431771+0000","last_became_peered":"2024-09-17T05:22:18.431771+0000","last_unstale":"2024-09-17T05:22:20.436227+0000","last_undegraded":"2024-09-17T05:22:20.436227+0000","last_fullsized":"2024-09-17T05:22:20.436227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:26.966895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007157+0000","last_change":"2024-09-17T05:22:18.438120+0000","last_active":"2024-09-17T05:22:21.007157+0000","last_peered":"2024-09-17T05:22:21.007157+0000","last_clean":"2024-09-17T05:22:21.007157+0000","last_became_active":"2024-09-17T05:22:18.437867+0000","last_became_peered":"2024-09-17T05:22:18.437867+0000","last_unstale":"2024-09-17T05:22:21.007157+0000","last_undegraded":"2024-09-17T05:22:21.007157+0000","last_fullsized":"2024-09-17T05:22:21.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:25.421633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433049+0000","last_change":"2024-09-17T05:22:19.428773+0000","last_active":"2024-09-17T05:22:20.433049+0000","last_peered":"2024-09-17T05:22:20.433049+0000","last_clean":"2024-09-17T05:22:20.433049+0000","last_became_active":"2024-09-17T05:22:19.427978+0000","last_became_peered":"2024-09-17T05:22:19.427978+0000","last_unstale":"2024-09-17T05:22:20.433049+0000","last_undegraded":"2024-09-17T05:22:20.433049+0000","last_fullsized":"2024-09-17T05:22:20.433049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:01.994688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434550+0000","last_change":"2024-09-17T05:22:18.430819+0000","last_active":"2024-09-17T05:22:20.434550+0000","last_peered":"2024-09-17T05:22:20.434550+0000","last_clean":"2024-09-17T05:22:20.434550+0000","last_became_active":"2024-09-17T05:22:18.430534+0000","last_became_peered":"2024-09-17T05:22:18.430534+0000","last_unstale":"2024-09-17T05:22:20.434550+0000","last_undegraded":"2024-09-17T05:22:20.434550+0000","last_fullsized":"2024-09-17T05:22:20.434550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:23.764199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435617+0000","last_change":"2024-09-17T05:22:19.437170+0000","last_active":"2024-09-17T05:22:20.435617+0000","last_peered":"2024-09-17T05:22:20.435617+0000","last_clean":"2024-09-17T05:22:20.435617+0000","last_became_active":"2024-09-17T05:22:19.436924+0000","last_became_peered":"2024-09-17T05:22:19.436924+0000","last_unstale":"2024-09-17T05:22:20.435617+0000","last_undegraded":"2024-09-17T05:22:20.435617+0000","last_fullsized":"2024-09-17T05:22:20.435617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:25.019162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436440+0000","last_change":"2024-09-17T05:22:18.426844+0000","last_active":"2024-09-17T05:22:20.436440+0000","last_peered":"2024-09-17T05:22:20.436440+0000","last_clean":"2024-09-17T05:22:20.436440+0000","last_became_active":"2024-09-17T05:22:18.426464+0000","last_became_peered":"2024-09-17T05:22:18.426464+0000","last_unstale":"2024-09-17T05:22:20.436440+0000","last_undegraded":"2024-09-17T05:22:20.436440+0000","last_fullsized":"2024-09-17T05:22:20.436440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:42.575528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.030025+0000","last_change":"2024-09-17T05:22:19.445918+0000","last_active":"2024-09-17T05:22:21.030025+0000","last_peered":"2024-09-17T05:22:21.030025+0000","last_clean":"2024-09-17T05:22:21.030025+0000","last_became_active":"2024-09-17T05:22:19.445591+0000","last_became_peered":"2024-09-17T05:22:19.445591+0000","last_unstale":"2024-09-17T05:22:21.030025+0000","last_undegraded":"2024-09-17T05:22:21.030025+0000","last_fullsized":"2024-09-17T05:22:21.030025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:10.894386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435745+0000","last_change":"2024-09-17T05:22:18.428672+0000","last_active":"2024-09-17T05:22:20.435745+0000","last_peered":"2024-09-17T05:22:20.435745+0000","last_clean":"2024-09-17T05:22:20.435745+0000","last_became_active":"2024-09-17T05:22:18.428286+0000","last_became_peered":"2024-09-17T05:22:18.428286+0000","last_unstale":"2024-09-17T05:22:20.435745+0000","last_undegraded":"2024-09-17T05:22:20.435745+0000","last_fullsized":"2024-09-17T05:22:20.435745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:01.168568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296016+0000","last_change":"2024-09-17T05:22:19.445238+0000","last_active":"2024-09-17T05:22:21.296016+0000","last_peered":"2024-09-17T05:22:21.296016+0000","last_clean":"2024-09-17T05:22:21.296016+0000","last_became_active":"2024-09-17T05:22:19.444427+0000","last_became_peered":"2024-09-17T05:22:19.444427+0000","last_unstale":"2024-09-17T05:22:21.296016+0000","last_undegraded":"2024-09-17T05:22:21.296016+0000","last_fullsized":"2024-09-17T05:22:21.296016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:15.940887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436323+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436323+0000","last_peered":"2024-09-17T05:22:20.436323+0000","last_clean":"2024-09-17T05:22:20.436323+0000","last_became_active":"2024-09-17T05:22:18.425366+0000","last_became_peered":"2024-09-17T05:22:18.425366+0000","last_unstale":"2024-09-17T05:22:20.436323+0000","last_undegraded":"2024-09-17T05:22:20.436323+0000","last_fullsized":"2024-09-17T05:22:20.436323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:31.206646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433306+0000","last_change":"2024-09-17T05:22:19.431613+0000","last_active":"2024-09-17T05:22:20.433306+0000","last_peered":"2024-09-17T05:22:20.433306+0000","last_clean":"2024-09-17T05:22:20.433306+0000","last_became_active":"2024-09-17T05:22:19.431303+0000","last_became_peered":"2024-09-17T05:22:19.431303+0000","last_unstale":"2024-09-17T05:22:20.433306+0000","last_undegraded":"2024-09-17T05:22:20.433306+0000","last_fullsized":"2024-09-17T05:22:20.433306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:33.110557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029435+0000","last_change":"2024-09-17T05:22:18.433627+0000","last_active":"2024-09-17T05:22:21.029435+0000","last_peered":"2024-09-17T05:22:21.029435+0000","last_clean":"2024-09-17T05:22:21.029435+0000","last_became_active":"2024-09-17T05:22:18.433349+0000","last_became_peered":"2024-09-17T05:22:18.433349+0000","last_unstale":"2024-09-17T05:22:21.029435+0000","last_undegraded":"2024-09-17T05:22:21.029435+0000","last_fullsized":"2024-09-17T05:22:21.029435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295581+0000","last_change":"2024-09-17T05:22:19.436894+0000","last_active":"2024-09-17T05:22:21.295581+0000","last_peered":"2024-09-17T05:22:21.295581+0000","last_clean":"2024-09-17T05:22:21.295581+0000","last_became_active":"2024-09-17T05:22:19.436645+0000","last_became_peered":"2024-09-17T05:22:19.436645+0000","last_unstale":"2024-09-17T05:22:21.295581+0000","last_undegraded":"2024-09-17T05:22:21.295581+0000","last_fullsized":"2024-09-17T05:22:21.295581+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:03.311936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436274+0000","last_change":"2024-09-17T05:22:18.431369+0000","last_active":"2024-09-17T05:22:20.436274+0000","last_peered":"2024-09-17T05:22:20.436274+0000","last_clean":"2024-09-17T05:22:20.436274+0000","last_became_active":"2024-09-17T05:22:18.429959+0000","last_became_peered":"2024-09-17T05:22:18.429959+0000","last_unstale":"2024-09-17T05:22:20.436274+0000","last_undegraded":"2024-09-17T05:22:20.436274+0000","last_fullsized":"2024-09-17T05:22:20.436274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294832+0000","last_change":"2024-09-17T05:22:19.432750+0000","last_active":"2024-09-17T05:22:21.294832+0000","last_peered":"2024-09-17T05:22:21.294832+0000","last_clean":"2024-09-17T05:22:21.294832+0000","last_became_active":"2024-09-17T05:22:19.432494+0000","last_became_peered":"2024-09-17T05:22:19.432494+0000","last_unstale":"2024-09-17T05:22:21.294832+0000","last_undegraded":"2024-09-17T05:22:21.294832+0000","last_fullsized":"2024-09-17T05:22:21.294832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.854203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007473+0000","last_change":"2024-09-17T05:22:18.434348+0000","last_active":"2024-09-17T05:22:21.007473+0000","last_peered":"2024-09-17T05:22:21.007473+0000","last_clean":"2024-09-17T05:22:21.007473+0000","last_became_active":"2024-09-17T05:22:18.434070+0000","last_became_peered":"2024-09-17T05:22:18.434070+0000","last_unstale":"2024-09-17T05:22:21.007473+0000","last_undegraded":"2024-09-17T05:22:21.007473+0000","last_fullsized":"2024-09-17T05:22:21.007473+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295990+0000","last_change":"2024-09-17T05:22:19.433227+0000","last_active":"2024-09-17T05:22:21.295990+0000","last_peered":"2024-09-17T05:22:21.295990+0000","last_clean":"2024-09-17T05:22:21.295990+0000","last_became_active":"2024-09-17T05:22:19.432973+0000","last_became_peered":"2024-09-17T05:22:19.432973+0000","last_unstale":"2024-09-17T05:22:21.295990+0000","last_undegraded":"2024-09-17T05:22:21.295990+0000","last_fullsized":"2024-09-17T05:22:21.295990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:44.832519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421131+0000","last_change":"2024-09-17T05:22:18.421131+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421131+0000","last_undegraded":"2024-09-17T05:22:18.421131+0000","last_fullsized":"2024-09-17T05:22:18.421131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436476+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436476+0000","last_peered":"2024-09-17T05:22:20.436476+0000","last_clean":"2024-09-17T05:22:20.436476+0000","last_became_active":"2024-09-17T05:22:18.425188+0000","last_became_peered":"2024-09-17T05:22:18.425188+0000","last_unstale":"2024-09-17T05:22:20.436476+0000","last_undegraded":"2024-09-17T05:22:20.436476+0000","last_fullsized":"2024-09-17T05:22:20.436476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:53.421290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007439+0000","last_change":"2024-09-17T05:22:19.440882+0000","last_active":"2024-09-17T05:22:21.007439+0000","last_peered":"2024-09-17T05:22:21.007439+0000","last_clean":"2024-09-17T05:22:21.007439+0000","last_became_active":"2024-09-17T05:22:19.440554+0000","last_became_peered":"2024-09-17T05:22:19.440554+0000","last_unstale":"2024-09-17T05:22:21.007439+0000","last_undegraded":"2024-09-17T05:22:21.007439+0000","last_fullsized":"2024-09-17T05:22:21.007439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.420404+0000","last_change":"2024-09-17T05:22:18.438129+0000","last_active":"2024-09-17T05:22:21.420404+0000","last_peered":"2024-09-17T05:22:21.420404+0000","last_clean":"2024-09-17T05:22:21.420404+0000","last_became_active":"2024-09-17T05:22:18.437872+0000","last_became_peered":"2024-09-17T05:22:18.437872+0000","last_unstale":"2024-09-17T05:22:21.420404+0000","last_undegraded":"2024-09-17T05:22:21.420404+0000","last_fullsized":"2024-09-17T05:22:21.420404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:01.605305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029489+0000","last_change":"2024-09-17T05:22:19.436359+0000","last_active":"2024-09-17T05:22:21.029489+0000","last_peered":"2024-09-17T05:22:21.029489+0000","last_clean":"2024-09-17T05:22:21.029489+0000","last_became_active":"2024-09-17T05:22:19.435752+0000","last_became_peered":"2024-09-17T05:22:19.435752+0000","last_unstale":"2024-09-17T05:22:21.029489+0000","last_undegraded":"2024-09-17T05:22:21.029489+0000","last_fullsized":"2024-09-17T05:22:21.029489+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433248+0000","last_change":"2024-09-17T05:22:18.429079+0000","last_active":"2024-09-17T05:22:20.433248+0000","last_peered":"2024-09-17T05:22:20.433248+0000","last_clean":"2024-09-17T05:22:20.433248+0000","last_became_active":"2024-09-17T05:22:18.428828+0000","last_became_peered":"2024-09-17T05:22:18.428828+0000","last_unstale":"2024-09-17T05:22:20.433248+0000","last_undegraded":"2024-09-17T05:22:20.433248+0000","last_fullsized":"2024-09-17T05:22:20.433248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:32.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029857+0000","last_change":"2024-09-17T05:22:19.436981+0000","last_active":"2024-09-17T05:22:21.029857+0000","last_peered":"2024-09-17T05:22:21.029857+0000","last_clean":"2024-09-17T05:22:21.029857+0000","last_became_active":"2024-09-17T05:22:19.436256+0000","last_became_peered":"2024-09-17T05:22:19.436256+0000","last_unstale":"2024-09-17T05:22:21.029857+0000","last_undegraded":"2024-09-17T05:22:21.029857+0000","last_fullsized":"2024-09-17T05:22:21.029857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:36.324734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421339+0000","last_change":"2024-09-17T05:22:18.421339+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421339+0000","last_undegraded":"2024-09-17T05:22:18.421339+0000","last_fullsized":"2024-09-17T05:22:18.421339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433029+0000","last_change":"2024-09-17T05:22:19.428711+0000","last_active":"2024-09-17T05:22:20.433029+0000","last_peered":"2024-09-17T05:22:20.433029+0000","last_clean":"2024-09-17T05:22:20.433029+0000","last_became_active":"2024-09-17T05:22:19.428345+0000","last_became_peered":"2024-09-17T05:22:19.428345+0000","last_unstale":"2024-09-17T05:22:20.433029+0000","last_undegraded":"2024-09-17T05:22:20.433029+0000","last_fullsized":"2024-09-17T05:22:20.433029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:34.010700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433341+0000","last_change":"2024-09-17T05:22:18.435789+0000","last_active":"2024-09-17T05:22:20.433341+0000","last_peered":"2024-09-17T05:22:20.433341+0000","last_clean":"2024-09-17T05:22:20.433341+0000","last_became_active":"2024-09-17T05:22:18.435509+0000","last_became_peered":"2024-09-17T05:22:18.435509+0000","last_unstale":"2024-09-17T05:22:20.433341+0000","last_undegraded":"2024-09-17T05:22:20.433341+0000","last_fullsized":"2024-09-17T05:22:20.433341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:07.895200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436640+0000","last_change":"2024-09-17T05:22:19.440009+0000","last_active":"2024-09-17T05:22:20.436640+0000","last_peered":"2024-09-17T05:22:20.436640+0000","last_clean":"2024-09-17T05:22:20.436640+0000","last_became_active":"2024-09-17T05:22:19.439695+0000","last_became_peered":"2024-09-17T05:22:19.439695+0000","last_unstale":"2024-09-17T05:22:20.436640+0000","last_undegraded":"2024-09-17T05:22:20.436640+0000","last_fullsized":"2024-09-17T05:22:20.436640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:10.705338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295403+0000","last_change":"2024-09-17T05:22:18.429070+0000","last_active":"2024-09-17T05:22:21.295403+0000","last_peered":"2024-09-17T05:22:21.295403+0000","last_clean":"2024-09-17T05:22:21.295403+0000","last_became_active":"2024-09-17T05:22:18.428814+0000","last_became_peered":"2024-09-17T05:22:18.428814+0000","last_unstale":"2024-09-17T05:22:21.295403+0000","last_undegraded":"2024-09-17T05:22:21.295403+0000","last_fullsized":"2024-09-17T05:22:21.295403+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:58.148752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295114+0000","last_change":"2024-09-17T05:22:19.441198+0000","last_active":"2024-09-17T05:22:21.295114+0000","last_peered":"2024-09-17T05:22:21.295114+0000","last_clean":"2024-09-17T05:22:21.295114+0000","last_became_active":"2024-09-17T05:22:19.440716+0000","last_became_peered":"2024-09-17T05:22:19.440716+0000","last_unstale":"2024-09-17T05:22:21.295114+0000","last_undegraded":"2024-09-17T05:22:21.295114+0000","last_fullsized":"2024-09-17T05:22:21.295114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:39.204819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434595+0000","last_change":"2024-09-17T05:22:18.428067+0000","last_active":"2024-09-17T05:22:20.434595+0000","last_peered":"2024-09-17T05:22:20.434595+0000","last_clean":"2024-09-17T05:22:20.434595+0000","last_became_active":"2024-09-17T05:22:18.427698+0000","last_became_peered":"2024-09-17T05:22:18.427698+0000","last_unstale":"2024-09-17T05:22:20.434595+0000","last_undegraded":"2024-09-17T05:22:20.434595+0000","last_fullsized":"2024-09-17T05:22:20.434595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:26.273038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.428856+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.428509+0000","last_became_peered":"2024-09-17T05:22:19.428509+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:04.873956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436222+0000","last_change":"2024-09-17T05:22:18.427604+0000","last_active":"2024-09-17T05:22:20.436222+0000","last_peered":"2024-09-17T05:22:20.436222+0000","last_clean":"2024-09-17T05:22:20.436222+0000","last_became_active":"2024-09-17T05:22:18.427324+0000","last_became_peered":"2024-09-17T05:22:18.427324+0000","last_unstale":"2024-09-17T05:22:20.436222+0000","last_undegraded":"2024-09-17T05:22:20.436222+0000","last_fullsized":"2024-09-17T05:22:20.436222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:54.627943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294931+0000","last_change":"2024-09-17T05:22:19.439418+0000","last_active":"2024-09-17T05:22:21.294931+0000","last_peered":"2024-09-17T05:22:21.294931+0000","last_clean":"2024-09-17T05:22:21.294931+0000","last_became_active":"2024-09-17T05:22:19.439146+0000","last_became_peered":"2024-09-17T05:22:19.439146+0000","last_unstale":"2024-09-17T05:22:21.294931+0000","last_undegraded":"2024-09-17T05:22:21.294931+0000","last_fullsized":"2024-09-17T05:22:21.294931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:01.545980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436507+0000","last_change":"2024-09-17T05:22:18.428890+0000","last_active":"2024-09-17T05:22:20.436507+0000","last_peered":"2024-09-17T05:22:20.436507+0000","last_clean":"2024-09-17T05:22:20.436507+0000","last_became_active":"2024-09-17T05:22:18.428073+0000","last_became_peered":"2024-09-17T05:22:18.428073+0000","last_unstale":"2024-09-17T05:22:20.436507+0000","last_undegraded":"2024-09-17T05:22:20.436507+0000","last_fullsized":"2024-09-17T05:22:20.436507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:19.470799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":192,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029128+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:22:21.029128+0000","last_peered":"2024-09-17T05:22:21.029128+0000","last_clean":"2024-09-17T05:22:21.029128+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:22:21.029128+0000","last_undegraded":"2024-09-17T05:22:21.029128+0000","last_fullsized":"2024-09-17T05:22:21.029128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":937153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":346261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":339959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":346239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":339981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":843776,"data_stored":347781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":342097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1388544,"data_stored":917187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:22.394 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:22.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.531+0000 7f363de60640 1 -- 172.21.15.81:0/614208542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36240053c0 msgr2=0x7f362400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.531+0000 7f363de60640 1 --2- 172.21.15.81:0/614208542 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36240053c0 0x7f362400b9c0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f363000ac60 tx=0x7f3624005830 comp rx=0 tx=0).stop 2024-09-17T05:22:22.532 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.531+0000 7f3637fff640 1 -- 172.21.15.81:0/614208542 reap_dead start 2024-09-17T05:22:22.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.531+0000 7f363de60640 1 -- 172.21.15.81:0/614208542 shutdown_connections 2024-09-17T05:22:22.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.531+0000 7f363de60640 1 -- 172.21.15.81:0/614208542 >> 172.21.15.81:0/614208542 conn(0x7f36380d3ea0 msgr2=0x7f36380d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.531+0000 7f363de60640 1 -- 172.21.15.81:0/614208542 shutdown_connections 2024-09-17T05:22:22.533 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.531+0000 7f363de60640 1 -- 172.21.15.81:0/614208542 wait complete. 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.532+0000 7f363de60640 1 Processor -- start 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.532+0000 7f363de60640 1 -- start start 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f363de60640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36240053c0 0x7f36380cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f363de60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36380b7d20 0x7f36381f7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f363de60640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36380b81a0 0x7f36381f8200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f363de60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3638162690 con 0x7f36380b7d20 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f363de60640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f36380cf9b0 con 0x7f36240053c0 2024-09-17T05:22:22.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f363de60640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f36380ce0f0 con 0x7f36380b81a0 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36380b7d20 0x7f36381f7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36380b7d20 0x7f36381f7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41448/0 (socket says 172.21.15.81:41448) 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 -- 172.21.15.81:0/1110777932 learned_addr learned my addr 172.21.15.81:0/1110777932 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 -- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36380b81a0 msgr2=0x7f36381f8200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36380b81a0 0x7f36381f8200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 -- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36240053c0 msgr2=0x7f36380cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36240053c0 0x7f36380cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 -- 172.21.15.81:0/1110777932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3638155e80 con 0x7f36380b7d20 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.533+0000 7f3636ffd640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36380b7d20 0x7f36381f7cc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f362000f6c0 tx=0x7f362000fb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.534+0000 7f362ffff640 1 -- 172.21.15.81:0/1110777932 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620015070 con 0x7f36380b7d20 2024-09-17T05:22:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.534+0000 7f362ffff640 1 -- 172.21.15.81:0/1110777932 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3620006170 con 0x7f36380b7d20 2024-09-17T05:22:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.534+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36381560f0 con 0x7f36380b7d20 2024-09-17T05:22:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.534+0000 7f362ffff640 1 -- 172.21.15.81:0/1110777932 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620003830 con 0x7f36380b7d20 2024-09-17T05:22:22.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.534+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36381566b0 con 0x7f36380b7d20 2024-09-17T05:22:22.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.535+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36381568b0 con 0x7f36380b7d20 2024-09-17T05:22:22.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.535+0000 7f362ffff640 1 -- 172.21.15.81:0/1110777932 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f3620018070 con 0x7f36380b7d20 2024-09-17T05:22:22.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.536+0000 7f362ffff640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3618078ef0 0x7f361807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.536+0000 7f362ffff640 1 -- 172.21.15.81:0/1110777932 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f362009b470 con 0x7f36380b7d20 2024-09-17T05:22:22.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.536+0000 7f36377fe640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3618078ef0 0x7f361807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.537+0000 7f36377fe640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3618078ef0 0x7f361807b3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3628001eb0 tx=0x7f3628000f10 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.540+0000 7f362ffff640 1 -- 172.21.15.81:0/1110777932 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f36381568b0 con 0x7f36380b7d20 2024-09-17T05:22:22.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.710+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f363808d590 con 0x7f3618078ef0 2024-09-17T05:22:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.715+0000 7f362ffff640 1 -- 172.21.15.81:0/1110777932 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250912 (secure 0 0 0) 0x7f363808d590 con 0x7f3618078ef0 2024-09-17T05:22:22.718 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:22.720 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3618078ef0 msgr2=0x7f361807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3618078ef0 0x7f361807b3b0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f3628001eb0 tx=0x7f3628000f10 comp rx=0 tx=0).stop 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36380b7d20 msgr2=0x7f36381f7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36380b7d20 0x7f36381f7cc0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f362000f6c0 tx=0x7f362000fb80 comp rx=0 tx=0).stop 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 shutdown_connections 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3618078ef0 0x7f361807b3b0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36380b81a0 0x7f36381f8200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f36380b7d20 0x7f36381f7cc0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 --2- 172.21.15.81:0/1110777932 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36240053c0 0x7f36380cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 >> 172.21.15.81:0/1110777932 conn(0x7f36380d3ea0 msgr2=0x7f36380b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 shutdown_connections 2024-09-17T05:22:22.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.718+0000 7f363de60640 1 -- 172.21.15.81:0/1110777932 wait complete. 2024-09-17T05:22:22.729 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-17T05:22:21.426298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232208,"kb_used_data":7648,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742512,"statfs":{"total":773094113280,"available":772856332288,"internally_reserved":0,"allocated":7831552,"data_stored":3916658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016345"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029833+0000","last_change":"2024-09-17T05:22:19.438662+0000","last_active":"2024-09-17T05:22:21.029833+0000","last_peered":"2024-09-17T05:22:21.029833+0000","last_clean":"2024-09-17T05:22:21.029833+0000","last_became_active":"2024-09-17T05:22:19.438390+0000","last_became_peered":"2024-09-17T05:22:19.438390+0000","last_unstale":"2024-09-17T05:22:21.029833+0000","last_undegraded":"2024-09-17T05:22:21.029833+0000","last_fullsized":"2024-09-17T05:22:21.029833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:05.760603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436833+0000","last_change":"2024-09-17T05:22:19.428772+0000","last_active":"2024-09-17T05:22:20.436833+0000","last_peered":"2024-09-17T05:22:20.436833+0000","last_clean":"2024-09-17T05:22:20.436833+0000","last_became_active":"2024-09-17T05:22:19.427862+0000","last_became_peered":"2024-09-17T05:22:19.427862+0000","last_unstale":"2024-09-17T05:22:20.436833+0000","last_undegraded":"2024-09-17T05:22:20.436833+0000","last_fullsized":"2024-09-17T05:22:20.436833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295130+0000","last_change":"2024-09-17T05:22:19.434335+0000","last_active":"2024-09-17T05:22:21.295130+0000","last_peered":"2024-09-17T05:22:21.295130+0000","last_clean":"2024-09-17T05:22:21.295130+0000","last_became_active":"2024-09-17T05:22:19.434058+0000","last_became_peered":"2024-09-17T05:22:19.434058+0000","last_unstale":"2024-09-17T05:22:21.295130+0000","last_undegraded":"2024-09-17T05:22:21.295130+0000","last_fullsized":"2024-09-17T05:22:21.295130+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:29.970938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295867+0000","last_change":"2024-09-17T05:22:19.445535+0000","last_active":"2024-09-17T05:22:21.295867+0000","last_peered":"2024-09-17T05:22:21.295867+0000","last_clean":"2024-09-17T05:22:21.295867+0000","last_became_active":"2024-09-17T05:22:19.444870+0000","last_became_peered":"2024-09-17T05:22:19.444870+0000","last_unstale":"2024-09-17T05:22:21.295867+0000","last_undegraded":"2024-09-17T05:22:21.295867+0000","last_fullsized":"2024-09-17T05:22:21.295867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:36.729817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433254+0000","last_change":"2024-09-17T05:22:19.438404+0000","last_active":"2024-09-17T05:22:20.433254+0000","last_peered":"2024-09-17T05:22:20.433254+0000","last_clean":"2024-09-17T05:22:20.433254+0000","last_became_active":"2024-09-17T05:22:19.438134+0000","last_became_peered":"2024-09-17T05:22:19.438134+0000","last_unstale":"2024-09-17T05:22:20.433254+0000","last_undegraded":"2024-09-17T05:22:20.433254+0000","last_fullsized":"2024-09-17T05:22:20.433254+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:41.699191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436163+0000","last_change":"2024-09-17T05:22:19.426534+0000","last_active":"2024-09-17T05:22:20.436163+0000","last_peered":"2024-09-17T05:22:20.436163+0000","last_clean":"2024-09-17T05:22:20.436163+0000","last_became_active":"2024-09-17T05:22:19.426215+0000","last_became_peered":"2024-09-17T05:22:19.426215+0000","last_unstale":"2024-09-17T05:22:20.436163+0000","last_undegraded":"2024-09-17T05:22:20.436163+0000","last_fullsized":"2024-09-17T05:22:20.436163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:22.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007121+0000","last_change":"2024-09-17T05:22:19.440259+0000","last_active":"2024-09-17T05:22:21.007121+0000","last_peered":"2024-09-17T05:22:21.007121+0000","last_clean":"2024-09-17T05:22:21.007121+0000","last_became_active":"2024-09-17T05:22:19.439993+0000","last_became_peered":"2024-09-17T05:22:19.439993+0000","last_unstale":"2024-09-17T05:22:21.007121+0000","last_undegraded":"2024-09-17T05:22:21.007121+0000","last_fullsized":"2024-09-17T05:22:21.007121+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.223827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436770+0000","last_change":"2024-09-17T05:22:19.437945+0000","last_active":"2024-09-17T05:22:20.436770+0000","last_peered":"2024-09-17T05:22:20.436770+0000","last_clean":"2024-09-17T05:22:20.436770+0000","last_became_active":"2024-09-17T05:22:19.437670+0000","last_became_peered":"2024-09-17T05:22:19.437670+0000","last_unstale":"2024-09-17T05:22:20.436770+0000","last_undegraded":"2024-09-17T05:22:20.436770+0000","last_fullsized":"2024-09-17T05:22:20.436770+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:26.423565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433544+0000","last_change":"2024-09-17T05:22:19.430604+0000","last_active":"2024-09-17T05:22:20.433544+0000","last_peered":"2024-09-17T05:22:20.433544+0000","last_clean":"2024-09-17T05:22:20.433544+0000","last_became_active":"2024-09-17T05:22:19.430136+0000","last_became_peered":"2024-09-17T05:22:19.430136+0000","last_unstale":"2024-09-17T05:22:20.433544+0000","last_undegraded":"2024-09-17T05:22:20.433544+0000","last_fullsized":"2024-09-17T05:22:20.433544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:15.751408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435427+0000","last_change":"2024-09-17T05:22:19.427898+0000","last_active":"2024-09-17T05:22:20.435427+0000","last_peered":"2024-09-17T05:22:20.435427+0000","last_clean":"2024-09-17T05:22:20.435427+0000","last_became_active":"2024-09-17T05:22:19.427591+0000","last_became_peered":"2024-09-17T05:22:19.427591+0000","last_unstale":"2024-09-17T05:22:20.435427+0000","last_undegraded":"2024-09-17T05:22:20.435427+0000","last_fullsized":"2024-09-17T05:22:20.435427+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:01.861609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029667+0000","last_change":"2024-09-17T05:22:19.442877+0000","last_active":"2024-09-17T05:22:21.029667+0000","last_peered":"2024-09-17T05:22:21.029667+0000","last_clean":"2024-09-17T05:22:21.029667+0000","last_became_active":"2024-09-17T05:22:19.442514+0000","last_became_peered":"2024-09-17T05:22:19.442514+0000","last_unstale":"2024-09-17T05:22:21.029667+0000","last_undegraded":"2024-09-17T05:22:21.029667+0000","last_fullsized":"2024-09-17T05:22:21.029667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:45.208300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296004+0000","last_change":"2024-09-17T05:22:19.447642+0000","last_active":"2024-09-17T05:22:21.296004+0000","last_peered":"2024-09-17T05:22:21.296004+0000","last_clean":"2024-09-17T05:22:21.296004+0000","last_became_active":"2024-09-17T05:22:19.447297+0000","last_became_peered":"2024-09-17T05:22:19.447297+0000","last_unstale":"2024-09-17T05:22:21.296004+0000","last_undegraded":"2024-09-17T05:22:21.296004+0000","last_fullsized":"2024-09-17T05:22:21.296004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:48.971688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433151+0000","last_change":"2024-09-17T05:22:19.436649+0000","last_active":"2024-09-17T05:22:20.433151+0000","last_peered":"2024-09-17T05:22:20.433151+0000","last_clean":"2024-09-17T05:22:20.433151+0000","last_became_active":"2024-09-17T05:22:19.436379+0000","last_became_peered":"2024-09-17T05:22:19.436379+0000","last_unstale":"2024-09-17T05:22:20.433151+0000","last_undegraded":"2024-09-17T05:22:20.433151+0000","last_fullsized":"2024-09-17T05:22:20.433151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:44.750380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434649+0000","last_change":"2024-09-17T05:22:19.433093+0000","last_active":"2024-09-17T05:22:20.434649+0000","last_peered":"2024-09-17T05:22:20.434649+0000","last_clean":"2024-09-17T05:22:20.434649+0000","last_became_active":"2024-09-17T05:22:19.432601+0000","last_became_peered":"2024-09-17T05:22:19.432601+0000","last_unstale":"2024-09-17T05:22:20.434649+0000","last_undegraded":"2024-09-17T05:22:20.434649+0000","last_fullsized":"2024-09-17T05:22:20.434649+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433524+0000","last_change":"2024-09-17T05:22:19.427959+0000","last_active":"2024-09-17T05:22:20.433524+0000","last_peered":"2024-09-17T05:22:20.433524+0000","last_clean":"2024-09-17T05:22:20.433524+0000","last_became_active":"2024-09-17T05:22:19.427723+0000","last_became_peered":"2024-09-17T05:22:19.427723+0000","last_unstale":"2024-09-17T05:22:20.433524+0000","last_undegraded":"2024-09-17T05:22:20.433524+0000","last_fullsized":"2024-09-17T05:22:20.433524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:37.815920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295801+0000","last_change":"2024-09-17T05:22:19.445081+0000","last_active":"2024-09-17T05:22:21.295801+0000","last_peered":"2024-09-17T05:22:21.295801+0000","last_clean":"2024-09-17T05:22:21.295801+0000","last_became_active":"2024-09-17T05:22:19.444827+0000","last_became_peered":"2024-09-17T05:22:19.444827+0000","last_unstale":"2024-09-17T05:22:21.295801+0000","last_undegraded":"2024-09-17T05:22:21.295801+0000","last_fullsized":"2024-09-17T05:22:21.295801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:37.186334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436123+0000","last_change":"2024-09-17T05:22:19.438688+0000","last_active":"2024-09-17T05:22:20.436123+0000","last_peered":"2024-09-17T05:22:20.436123+0000","last_clean":"2024-09-17T05:22:20.436123+0000","last_became_active":"2024-09-17T05:22:19.438382+0000","last_became_peered":"2024-09-17T05:22:19.438382+0000","last_unstale":"2024-09-17T05:22:20.436123+0000","last_undegraded":"2024-09-17T05:22:20.436123+0000","last_fullsized":"2024-09-17T05:22:20.436123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:32.110192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434924+0000","last_change":"2024-09-17T05:22:19.430871+0000","last_active":"2024-09-17T05:22:20.434924+0000","last_peered":"2024-09-17T05:22:20.434924+0000","last_clean":"2024-09-17T05:22:20.434924+0000","last_became_active":"2024-09-17T05:22:19.430608+0000","last_became_peered":"2024-09-17T05:22:19.430608+0000","last_unstale":"2024-09-17T05:22:20.434924+0000","last_undegraded":"2024-09-17T05:22:20.434924+0000","last_fullsized":"2024-09-17T05:22:20.434924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434847+0000","last_change":"2024-09-17T05:22:19.422392+0000","last_active":"2024-09-17T05:22:20.434847+0000","last_peered":"2024-09-17T05:22:20.434847+0000","last_clean":"2024-09-17T05:22:20.434847+0000","last_became_active":"2024-09-17T05:22:19.421987+0000","last_became_peered":"2024-09-17T05:22:19.421987+0000","last_unstale":"2024-09-17T05:22:20.434847+0000","last_undegraded":"2024-09-17T05:22:20.434847+0000","last_fullsized":"2024-09-17T05:22:20.434847+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:08.730503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029409+0000","last_change":"2024-09-17T05:22:19.435845+0000","last_active":"2024-09-17T05:22:21.029409+0000","last_peered":"2024-09-17T05:22:21.029409+0000","last_clean":"2024-09-17T05:22:21.029409+0000","last_became_active":"2024-09-17T05:22:19.435535+0000","last_became_peered":"2024-09-17T05:22:19.435535+0000","last_unstale":"2024-09-17T05:22:21.029409+0000","last_undegraded":"2024-09-17T05:22:21.029409+0000","last_fullsized":"2024-09-17T05:22:21.029409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:17.679119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029229+0000","last_change":"2024-09-17T05:22:19.438687+0000","last_active":"2024-09-17T05:22:21.029229+0000","last_peered":"2024-09-17T05:22:21.029229+0000","last_clean":"2024-09-17T05:22:21.029229+0000","last_became_active":"2024-09-17T05:22:19.438347+0000","last_became_peered":"2024-09-17T05:22:19.438347+0000","last_unstale":"2024-09-17T05:22:21.029229+0000","last_undegraded":"2024-09-17T05:22:21.029229+0000","last_fullsized":"2024-09-17T05:22:21.029229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435155+0000","last_change":"2024-09-17T05:22:19.436133+0000","last_active":"2024-09-17T05:22:20.435155+0000","last_peered":"2024-09-17T05:22:20.435155+0000","last_clean":"2024-09-17T05:22:20.435155+0000","last_became_active":"2024-09-17T05:22:19.434918+0000","last_became_peered":"2024-09-17T05:22:19.434918+0000","last_unstale":"2024-09-17T05:22:20.435155+0000","last_undegraded":"2024-09-17T05:22:20.435155+0000","last_fullsized":"2024-09-17T05:22:20.435155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:33.154454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007447+0000","last_change":"2024-09-17T05:22:19.434518+0000","last_active":"2024-09-17T05:22:21.007447+0000","last_peered":"2024-09-17T05:22:21.007447+0000","last_clean":"2024-09-17T05:22:21.007447+0000","last_became_active":"2024-09-17T05:22:19.434257+0000","last_became_peered":"2024-09-17T05:22:19.434257+0000","last_unstale":"2024-09-17T05:22:21.007447+0000","last_undegraded":"2024-09-17T05:22:21.007447+0000","last_fullsized":"2024-09-17T05:22:21.007447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:14.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295312+0000","last_change":"2024-09-17T05:22:19.440746+0000","last_active":"2024-09-17T05:22:21.295312+0000","last_peered":"2024-09-17T05:22:21.295312+0000","last_clean":"2024-09-17T05:22:21.295312+0000","last_became_active":"2024-09-17T05:22:19.440478+0000","last_became_peered":"2024-09-17T05:22:19.440478+0000","last_unstale":"2024-09-17T05:22:21.295312+0000","last_undegraded":"2024-09-17T05:22:21.295312+0000","last_fullsized":"2024-09-17T05:22:21.295312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:39.556732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435163+0000","last_change":"2024-09-17T05:22:19.423204+0000","last_active":"2024-09-17T05:22:20.435163+0000","last_peered":"2024-09-17T05:22:20.435163+0000","last_clean":"2024-09-17T05:22:20.435163+0000","last_became_active":"2024-09-17T05:22:19.422837+0000","last_became_peered":"2024-09-17T05:22:19.422837+0000","last_unstale":"2024-09-17T05:22:20.435163+0000","last_undegraded":"2024-09-17T05:22:20.435163+0000","last_fullsized":"2024-09-17T05:22:20.435163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:48.167633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295557+0000","last_change":"2024-09-17T05:22:19.436288+0000","last_active":"2024-09-17T05:22:21.295557+0000","last_peered":"2024-09-17T05:22:21.295557+0000","last_clean":"2024-09-17T05:22:21.295557+0000","last_became_active":"2024-09-17T05:22:19.435852+0000","last_became_peered":"2024-09-17T05:22:19.435852+0000","last_unstale":"2024-09-17T05:22:21.295557+0000","last_undegraded":"2024-09-17T05:22:21.295557+0000","last_fullsized":"2024-09-17T05:22:21.295557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:19.404495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007353+0000","last_change":"2024-09-17T05:22:19.435208+0000","last_active":"2024-09-17T05:22:21.007353+0000","last_peered":"2024-09-17T05:22:21.007353+0000","last_clean":"2024-09-17T05:22:21.007353+0000","last_became_active":"2024-09-17T05:22:19.434972+0000","last_became_peered":"2024-09-17T05:22:19.434972+0000","last_unstale":"2024-09-17T05:22:21.007353+0000","last_undegraded":"2024-09-17T05:22:21.007353+0000","last_fullsized":"2024-09-17T05:22:21.007353+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:44.946507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007493+0000","last_change":"2024-09-17T05:22:19.436850+0000","last_active":"2024-09-17T05:22:21.007493+0000","last_peered":"2024-09-17T05:22:21.007493+0000","last_clean":"2024-09-17T05:22:21.007493+0000","last_became_active":"2024-09-17T05:22:19.436593+0000","last_became_peered":"2024-09-17T05:22:19.436593+0000","last_unstale":"2024-09-17T05:22:21.007493+0000","last_undegraded":"2024-09-17T05:22:21.007493+0000","last_fullsized":"2024-09-17T05:22:21.007493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:04.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.430122+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.429844+0000","last_became_peered":"2024-09-17T05:22:19.429844+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:31.556861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029745+0000","last_change":"2024-09-17T05:22:19.439394+0000","last_active":"2024-09-17T05:22:21.029745+0000","last_peered":"2024-09-17T05:22:21.029745+0000","last_clean":"2024-09-17T05:22:21.029745+0000","last_became_active":"2024-09-17T05:22:19.437506+0000","last_became_peered":"2024-09-17T05:22:19.437506+0000","last_unstale":"2024-09-17T05:22:21.029745+0000","last_undegraded":"2024-09-17T05:22:21.029745+0000","last_fullsized":"2024-09-17T05:22:21.029745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.824838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029965+0000","last_change":"2024-09-17T05:22:18.429837+0000","last_active":"2024-09-17T05:22:21.029965+0000","last_peered":"2024-09-17T05:22:21.029965+0000","last_clean":"2024-09-17T05:22:21.029965+0000","last_became_active":"2024-09-17T05:22:18.429576+0000","last_became_peered":"2024-09-17T05:22:18.429576+0000","last_unstale":"2024-09-17T05:22:21.029965+0000","last_undegraded":"2024-09-17T05:22:21.029965+0000","last_fullsized":"2024-09-17T05:22:21.029965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:33.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433624+0000","last_change":"2024-09-17T05:22:19.430787+0000","last_active":"2024-09-17T05:22:20.433624+0000","last_peered":"2024-09-17T05:22:20.433624+0000","last_clean":"2024-09-17T05:22:20.433624+0000","last_became_active":"2024-09-17T05:22:19.430454+0000","last_became_peered":"2024-09-17T05:22:19.430454+0000","last_unstale":"2024-09-17T05:22:20.433624+0000","last_undegraded":"2024-09-17T05:22:20.433624+0000","last_fullsized":"2024-09-17T05:22:20.433624+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:01.979709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421267+0000","last_change":"2024-09-17T05:22:18.421267+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421267+0000","last_undegraded":"2024-09-17T05:22:18.421267+0000","last_fullsized":"2024-09-17T05:22:18.421267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436839+0000","last_change":"2024-09-17T05:22:19.434321+0000","last_active":"2024-09-17T05:22:20.436839+0000","last_peered":"2024-09-17T05:22:20.436839+0000","last_clean":"2024-09-17T05:22:20.436839+0000","last_became_active":"2024-09-17T05:22:19.433934+0000","last_became_peered":"2024-09-17T05:22:19.433934+0000","last_unstale":"2024-09-17T05:22:20.436839+0000","last_undegraded":"2024-09-17T05:22:20.436839+0000","last_fullsized":"2024-09-17T05:22:20.436839+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:15.805658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435078+0000","last_change":"2024-09-17T05:22:18.428988+0000","last_active":"2024-09-17T05:22:20.435078+0000","last_peered":"2024-09-17T05:22:20.435078+0000","last_clean":"2024-09-17T05:22:20.435078+0000","last_became_active":"2024-09-17T05:22:18.428719+0000","last_became_peered":"2024-09-17T05:22:18.428719+0000","last_unstale":"2024-09-17T05:22:20.435078+0000","last_undegraded":"2024-09-17T05:22:20.435078+0000","last_fullsized":"2024-09-17T05:22:20.435078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.794624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029706+0000","last_change":"2024-09-17T05:22:19.436635+0000","last_active":"2024-09-17T05:22:21.029706+0000","last_peered":"2024-09-17T05:22:21.029706+0000","last_clean":"2024-09-17T05:22:21.029706+0000","last_became_active":"2024-09-17T05:22:19.435951+0000","last_became_peered":"2024-09-17T05:22:19.435951+0000","last_unstale":"2024-09-17T05:22:21.029706+0000","last_undegraded":"2024-09-17T05:22:21.029706+0000","last_fullsized":"2024-09-17T05:22:21.029706+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.075149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436933+0000","last_change":"2024-09-17T05:22:18.427589+0000","last_active":"2024-09-17T05:22:20.436933+0000","last_peered":"2024-09-17T05:22:20.436933+0000","last_clean":"2024-09-17T05:22:20.436933+0000","last_became_active":"2024-09-17T05:22:18.427294+0000","last_became_peered":"2024-09-17T05:22:18.427294+0000","last_unstale":"2024-09-17T05:22:20.436933+0000","last_undegraded":"2024-09-17T05:22:20.436933+0000","last_fullsized":"2024-09-17T05:22:20.436933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:50.823087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007293+0000","last_change":"2024-09-17T05:22:19.438589+0000","last_active":"2024-09-17T05:22:21.007293+0000","last_peered":"2024-09-17T05:22:21.007293+0000","last_clean":"2024-09-17T05:22:21.007293+0000","last_became_active":"2024-09-17T05:22:19.438299+0000","last_became_peered":"2024-09-17T05:22:19.438299+0000","last_unstale":"2024-09-17T05:22:21.007293+0000","last_undegraded":"2024-09-17T05:22:21.007293+0000","last_fullsized":"2024-09-17T05:22:21.007293+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:57.072075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295653+0000","last_change":"2024-09-17T05:22:18.431383+0000","last_active":"2024-09-17T05:22:21.295653+0000","last_peered":"2024-09-17T05:22:21.295653+0000","last_clean":"2024-09-17T05:22:21.295653+0000","last_became_active":"2024-09-17T05:22:18.431115+0000","last_became_peered":"2024-09-17T05:22:18.431115+0000","last_unstale":"2024-09-17T05:22:21.295653+0000","last_undegraded":"2024-09-17T05:22:21.295653+0000","last_fullsized":"2024-09-17T05:22:21.295653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:09.892453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435067+0000","last_change":"2024-09-17T05:22:19.432969+0000","last_active":"2024-09-17T05:22:20.435067+0000","last_peered":"2024-09-17T05:22:20.435067+0000","last_clean":"2024-09-17T05:22:20.435067+0000","last_became_active":"2024-09-17T05:22:19.432466+0000","last_became_peered":"2024-09-17T05:22:19.432466+0000","last_unstale":"2024-09-17T05:22:20.435067+0000","last_undegraded":"2024-09-17T05:22:20.435067+0000","last_fullsized":"2024-09-17T05:22:20.435067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:11.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436110+0000","last_change":"2024-09-17T05:22:18.431419+0000","last_active":"2024-09-17T05:22:20.436110+0000","last_peered":"2024-09-17T05:22:20.436110+0000","last_clean":"2024-09-17T05:22:20.436110+0000","last_became_active":"2024-09-17T05:22:18.430589+0000","last_became_peered":"2024-09-17T05:22:18.430589+0000","last_unstale":"2024-09-17T05:22:20.436110+0000","last_undegraded":"2024-09-17T05:22:20.436110+0000","last_fullsized":"2024-09-17T05:22:20.436110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:39.998483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432851+0000","last_change":"2024-09-17T05:22:19.427627+0000","last_active":"2024-09-17T05:22:20.432851+0000","last_peered":"2024-09-17T05:22:20.432851+0000","last_clean":"2024-09-17T05:22:20.432851+0000","last_became_active":"2024-09-17T05:22:19.427370+0000","last_became_peered":"2024-09-17T05:22:19.427370+0000","last_unstale":"2024-09-17T05:22:20.432851+0000","last_undegraded":"2024-09-17T05:22:20.432851+0000","last_fullsized":"2024-09-17T05:22:20.432851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:36.555054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295310+0000","last_change":"2024-09-17T05:22:18.428001+0000","last_active":"2024-09-17T05:22:21.295310+0000","last_peered":"2024-09-17T05:22:21.295310+0000","last_clean":"2024-09-17T05:22:21.295310+0000","last_became_active":"2024-09-17T05:22:18.427739+0000","last_became_peered":"2024-09-17T05:22:18.427739+0000","last_unstale":"2024-09-17T05:22:21.295310+0000","last_undegraded":"2024-09-17T05:22:21.295310+0000","last_fullsized":"2024-09-17T05:22:21.295310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:10.556798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432875+0000","last_change":"2024-09-17T05:22:18.423744+0000","last_active":"2024-09-17T05:22:20.432875+0000","last_peered":"2024-09-17T05:22:20.432875+0000","last_clean":"2024-09-17T05:22:20.432875+0000","last_became_active":"2024-09-17T05:22:18.423474+0000","last_became_peered":"2024-09-17T05:22:18.423474+0000","last_unstale":"2024-09-17T05:22:20.432875+0000","last_undegraded":"2024-09-17T05:22:20.432875+0000","last_fullsized":"2024-09-17T05:22:20.432875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:20.141453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007512+0000","last_change":"2024-09-17T05:22:19.443778+0000","last_active":"2024-09-17T05:22:21.007512+0000","last_peered":"2024-09-17T05:22:21.007512+0000","last_clean":"2024-09-17T05:22:21.007512+0000","last_became_active":"2024-09-17T05:22:19.443519+0000","last_became_peered":"2024-09-17T05:22:19.443519+0000","last_unstale":"2024-09-17T05:22:21.007512+0000","last_undegraded":"2024-09-17T05:22:21.007512+0000","last_fullsized":"2024-09-17T05:22:21.007512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435207+0000","last_change":"2024-09-17T05:22:18.427480+0000","last_active":"2024-09-17T05:22:20.435207+0000","last_peered":"2024-09-17T05:22:20.435207+0000","last_clean":"2024-09-17T05:22:20.435207+0000","last_became_active":"2024-09-17T05:22:18.427197+0000","last_became_peered":"2024-09-17T05:22:18.427197+0000","last_unstale":"2024-09-17T05:22:20.435207+0000","last_undegraded":"2024-09-17T05:22:20.435207+0000","last_fullsized":"2024-09-17T05:22:20.435207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:18.433977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029862+0000","last_change":"2024-09-17T05:22:19.437340+0000","last_active":"2024-09-17T05:22:21.029862+0000","last_peered":"2024-09-17T05:22:21.029862+0000","last_clean":"2024-09-17T05:22:21.029862+0000","last_became_active":"2024-09-17T05:22:19.437078+0000","last_became_peered":"2024-09-17T05:22:19.437078+0000","last_unstale":"2024-09-17T05:22:21.029862+0000","last_undegraded":"2024-09-17T05:22:21.029862+0000","last_fullsized":"2024-09-17T05:22:21.029862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:27.525759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436753+0000","last_change":"2024-09-17T05:22:18.434179+0000","last_active":"2024-09-17T05:22:20.436753+0000","last_peered":"2024-09-17T05:22:20.436753+0000","last_clean":"2024-09-17T05:22:20.436753+0000","last_became_active":"2024-09-17T05:22:18.433907+0000","last_became_peered":"2024-09-17T05:22:18.433907+0000","last_unstale":"2024-09-17T05:22:20.436753+0000","last_undegraded":"2024-09-17T05:22:20.436753+0000","last_fullsized":"2024-09-17T05:22:20.436753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:34.301087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436901+0000","last_change":"2024-09-17T05:22:19.431778+0000","last_active":"2024-09-17T05:22:20.436901+0000","last_peered":"2024-09-17T05:22:20.436901+0000","last_clean":"2024-09-17T05:22:20.436901+0000","last_became_active":"2024-09-17T05:22:19.430979+0000","last_became_peered":"2024-09-17T05:22:19.430979+0000","last_unstale":"2024-09-17T05:22:20.436901+0000","last_undegraded":"2024-09-17T05:22:20.436901+0000","last_fullsized":"2024-09-17T05:22:20.436901+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295407+0000","last_change":"2024-09-17T05:22:18.435917+0000","last_active":"2024-09-17T05:22:21.295407+0000","last_peered":"2024-09-17T05:22:21.295407+0000","last_clean":"2024-09-17T05:22:21.295407+0000","last_became_active":"2024-09-17T05:22:18.435593+0000","last_became_peered":"2024-09-17T05:22:18.435593+0000","last_unstale":"2024-09-17T05:22:21.295407+0000","last_undegraded":"2024-09-17T05:22:21.295407+0000","last_fullsized":"2024-09-17T05:22:21.295407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.139854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433175+0000","last_change":"2024-09-17T05:22:19.439603+0000","last_active":"2024-09-17T05:22:20.433175+0000","last_peered":"2024-09-17T05:22:20.433175+0000","last_clean":"2024-09-17T05:22:20.433175+0000","last_became_active":"2024-09-17T05:22:19.439330+0000","last_became_peered":"2024-09-17T05:22:19.439330+0000","last_unstale":"2024-09-17T05:22:20.433175+0000","last_undegraded":"2024-09-17T05:22:20.433175+0000","last_fullsized":"2024-09-17T05:22:20.433175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:11.001407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296073+0000","last_change":"2024-09-17T05:22:18.424114+0000","last_active":"2024-09-17T05:22:21.296073+0000","last_peered":"2024-09-17T05:22:21.296073+0000","last_clean":"2024-09-17T05:22:21.296073+0000","last_became_active":"2024-09-17T05:22:18.423841+0000","last_became_peered":"2024-09-17T05:22:18.423841+0000","last_unstale":"2024-09-17T05:22:21.296073+0000","last_undegraded":"2024-09-17T05:22:21.296073+0000","last_fullsized":"2024-09-17T05:22:21.296073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029395+0000","last_change":"2024-09-17T05:22:19.438635+0000","last_active":"2024-09-17T05:22:21.029395+0000","last_peered":"2024-09-17T05:22:21.029395+0000","last_clean":"2024-09-17T05:22:21.029395+0000","last_became_active":"2024-09-17T05:22:19.438317+0000","last_became_peered":"2024-09-17T05:22:19.438317+0000","last_unstale":"2024-09-17T05:22:21.029395+0000","last_undegraded":"2024-09-17T05:22:21.029395+0000","last_fullsized":"2024-09-17T05:22:21.029395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:16.873928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295623+0000","last_change":"2024-09-17T05:22:18.430649+0000","last_active":"2024-09-17T05:22:21.295623+0000","last_peered":"2024-09-17T05:22:21.295623+0000","last_clean":"2024-09-17T05:22:21.295623+0000","last_became_active":"2024-09-17T05:22:18.430347+0000","last_became_peered":"2024-09-17T05:22:18.430347+0000","last_unstale":"2024-09-17T05:22:21.295623+0000","last_undegraded":"2024-09-17T05:22:21.295623+0000","last_fullsized":"2024-09-17T05:22:21.295623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:35.076714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007332+0000","last_change":"2024-09-17T05:22:19.435957+0000","last_active":"2024-09-17T05:22:21.007332+0000","last_peered":"2024-09-17T05:22:21.007332+0000","last_clean":"2024-09-17T05:22:21.007332+0000","last_became_active":"2024-09-17T05:22:19.435711+0000","last_became_peered":"2024-09-17T05:22:19.435711+0000","last_unstale":"2024-09-17T05:22:21.007332+0000","last_undegraded":"2024-09-17T05:22:21.007332+0000","last_fullsized":"2024-09-17T05:22:21.007332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.631571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436227+0000","last_change":"2024-09-17T05:22:18.432090+0000","last_active":"2024-09-17T05:22:20.436227+0000","last_peered":"2024-09-17T05:22:20.436227+0000","last_clean":"2024-09-17T05:22:20.436227+0000","last_became_active":"2024-09-17T05:22:18.431771+0000","last_became_peered":"2024-09-17T05:22:18.431771+0000","last_unstale":"2024-09-17T05:22:20.436227+0000","last_undegraded":"2024-09-17T05:22:20.436227+0000","last_fullsized":"2024-09-17T05:22:20.436227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:26.966895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007157+0000","last_change":"2024-09-17T05:22:18.438120+0000","last_active":"2024-09-17T05:22:21.007157+0000","last_peered":"2024-09-17T05:22:21.007157+0000","last_clean":"2024-09-17T05:22:21.007157+0000","last_became_active":"2024-09-17T05:22:18.437867+0000","last_became_peered":"2024-09-17T05:22:18.437867+0000","last_unstale":"2024-09-17T05:22:21.007157+0000","last_undegraded":"2024-09-17T05:22:21.007157+0000","last_fullsized":"2024-09-17T05:22:21.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:25.421633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433049+0000","last_change":"2024-09-17T05:22:19.428773+0000","last_active":"2024-09-17T05:22:20.433049+0000","last_peered":"2024-09-17T05:22:20.433049+0000","last_clean":"2024-09-17T05:22:20.433049+0000","last_became_active":"2024-09-17T05:22:19.427978+0000","last_became_peered":"2024-09-17T05:22:19.427978+0000","last_unstale":"2024-09-17T05:22:20.433049+0000","last_undegraded":"2024-09-17T05:22:20.433049+0000","last_fullsized":"2024-09-17T05:22:20.433049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:01.994688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434550+0000","last_change":"2024-09-17T05:22:18.430819+0000","last_active":"2024-09-17T05:22:20.434550+0000","last_peered":"2024-09-17T05:22:20.434550+0000","last_clean":"2024-09-17T05:22:20.434550+0000","last_became_active":"2024-09-17T05:22:18.430534+0000","last_became_peered":"2024-09-17T05:22:18.430534+0000","last_unstale":"2024-09-17T05:22:20.434550+0000","last_undegraded":"2024-09-17T05:22:20.434550+0000","last_fullsized":"2024-09-17T05:22:20.434550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:23.764199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435617+0000","last_change":"2024-09-17T05:22:19.437170+0000","last_active":"2024-09-17T05:22:20.435617+0000","last_peered":"2024-09-17T05:22:20.435617+0000","last_clean":"2024-09-17T05:22:20.435617+0000","last_became_active":"2024-09-17T05:22:19.436924+0000","last_became_peered":"2024-09-17T05:22:19.436924+0000","last_unstale":"2024-09-17T05:22:20.435617+0000","last_undegraded":"2024-09-17T05:22:20.435617+0000","last_fullsized":"2024-09-17T05:22:20.435617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:25.019162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436440+0000","last_change":"2024-09-17T05:22:18.426844+0000","last_active":"2024-09-17T05:22:20.436440+0000","last_peered":"2024-09-17T05:22:20.436440+0000","last_clean":"2024-09-17T05:22:20.436440+0000","last_became_active":"2024-09-17T05:22:18.426464+0000","last_became_peered":"2024-09-17T05:22:18.426464+0000","last_unstale":"2024-09-17T05:22:20.436440+0000","last_undegraded":"2024-09-17T05:22:20.436440+0000","last_fullsized":"2024-09-17T05:22:20.436440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:42.575528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.030025+0000","last_change":"2024-09-17T05:22:19.445918+0000","last_active":"2024-09-17T05:22:21.030025+0000","last_peered":"2024-09-17T05:22:21.030025+0000","last_clean":"2024-09-17T05:22:21.030025+0000","last_became_active":"2024-09-17T05:22:19.445591+0000","last_became_peered":"2024-09-17T05:22:19.445591+0000","last_unstale":"2024-09-17T05:22:21.030025+0000","last_undegraded":"2024-09-17T05:22:21.030025+0000","last_fullsized":"2024-09-17T05:22:21.030025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:10.894386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435745+0000","last_change":"2024-09-17T05:22:18.428672+0000","last_active":"2024-09-17T05:22:20.435745+0000","last_peered":"2024-09-17T05:22:20.435745+0000","last_clean":"2024-09-17T05:22:20.435745+0000","last_became_active":"2024-09-17T05:22:18.428286+0000","last_became_peered":"2024-09-17T05:22:18.428286+0000","last_unstale":"2024-09-17T05:22:20.435745+0000","last_undegraded":"2024-09-17T05:22:20.435745+0000","last_fullsized":"2024-09-17T05:22:20.435745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:01.168568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296016+0000","last_change":"2024-09-17T05:22:19.445238+0000","last_active":"2024-09-17T05:22:21.296016+0000","last_peered":"2024-09-17T05:22:21.296016+0000","last_clean":"2024-09-17T05:22:21.296016+0000","last_became_active":"2024-09-17T05:22:19.444427+0000","last_became_peered":"2024-09-17T05:22:19.444427+0000","last_unstale":"2024-09-17T05:22:21.296016+0000","last_undegraded":"2024-09-17T05:22:21.296016+0000","last_fullsized":"2024-09-17T05:22:21.296016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:15.940887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436323+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436323+0000","last_peered":"2024-09-17T05:22:20.436323+0000","last_clean":"2024-09-17T05:22:20.436323+0000","last_became_active":"2024-09-17T05:22:18.425366+0000","last_became_peered":"2024-09-17T05:22:18.425366+0000","last_unstale":"2024-09-17T05:22:20.436323+0000","last_undegraded":"2024-09-17T05:22:20.436323+0000","last_fullsized":"2024-09-17T05:22:20.436323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:31.206646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433306+0000","last_change":"2024-09-17T05:22:19.431613+0000","last_active":"2024-09-17T05:22:20.433306+0000","last_peered":"2024-09-17T05:22:20.433306+0000","last_clean":"2024-09-17T05:22:20.433306+0000","last_became_active":"2024-09-17T05:22:19.431303+0000","last_became_peered":"2024-09-17T05:22:19.431303+0000","last_unstale":"2024-09-17T05:22:20.433306+0000","last_undegraded":"2024-09-17T05:22:20.433306+0000","last_fullsized":"2024-09-17T05:22:20.433306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:33.110557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029435+0000","last_change":"2024-09-17T05:22:18.433627+0000","last_active":"2024-09-17T05:22:21.029435+0000","last_peered":"2024-09-17T05:22:21.029435+0000","last_clean":"2024-09-17T05:22:21.029435+0000","last_became_active":"2024-09-17T05:22:18.433349+0000","last_became_peered":"2024-09-17T05:22:18.433349+0000","last_unstale":"2024-09-17T05:22:21.029435+0000","last_undegraded":"2024-09-17T05:22:21.029435+0000","last_fullsized":"2024-09-17T05:22:21.029435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295581+0000","last_change":"2024-09-17T05:22:19.436894+0000","last_active":"2024-09-17T05:22:21.295581+0000","last_peered":"2024-09-17T05:22:21.295581+0000","last_clean":"2024-09-17T05:22:21.295581+0000","last_became_active":"2024-09-17T05:22:19.436645+0000","last_became_peered":"2024-09-17T05:22:19.436645+0000","last_unstale":"2024-09-17T05:22:21.295581+0000","last_undegraded":"2024-09-17T05:22:21.295581+0000","last_fullsized":"2024-09-17T05:22:21.295581+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:03.311936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436274+0000","last_change":"2024-09-17T05:22:18.431369+0000","last_active":"2024-09-17T05:22:20.436274+0000","last_peered":"2024-09-17T05:22:20.436274+0000","last_clean":"2024-09-17T05:22:20.436274+0000","last_became_active":"2024-09-17T05:22:18.429959+0000","last_became_peered":"2024-09-17T05:22:18.429959+0000","last_unstale":"2024-09-17T05:22:20.436274+0000","last_undegraded":"2024-09-17T05:22:20.436274+0000","last_fullsized":"2024-09-17T05:22:20.436274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294832+0000","last_change":"2024-09-17T05:22:19.432750+0000","last_active":"2024-09-17T05:22:21.294832+0000","last_peered":"2024-09-17T05:22:21.294832+0000","last_clean":"2024-09-17T05:22:21.294832+0000","last_became_active":"2024-09-17T05:22:19.432494+0000","last_became_peered":"2024-09-17T05:22:19.432494+0000","last_unstale":"2024-09-17T05:22:21.294832+0000","last_undegraded":"2024-09-17T05:22:21.294832+0000","last_fullsized":"2024-09-17T05:22:21.294832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.854203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007473+0000","last_change":"2024-09-17T05:22:18.434348+0000","last_active":"2024-09-17T05:22:21.007473+0000","last_peered":"2024-09-17T05:22:21.007473+0000","last_clean":"2024-09-17T05:22:21.007473+0000","last_became_active":"2024-09-17T05:22:18.434070+0000","last_became_peered":"2024-09-17T05:22:18.434070+0000","last_unstale":"2024-09-17T05:22:21.007473+0000","last_undegraded":"2024-09-17T05:22:21.007473+0000","last_fullsized":"2024-09-17T05:22:21.007473+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295990+0000","last_change":"2024-09-17T05:22:19.433227+0000","last_active":"2024-09-17T05:22:21.295990+0000","last_peered":"2024-09-17T05:22:21.295990+0000","last_clean":"2024-09-17T05:22:21.295990+0000","last_became_active":"2024-09-17T05:22:19.432973+0000","last_became_peered":"2024-09-17T05:22:19.432973+0000","last_unstale":"2024-09-17T05:22:21.295990+0000","last_undegraded":"2024-09-17T05:22:21.295990+0000","last_fullsized":"2024-09-17T05:22:21.295990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:44.832519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421131+0000","last_change":"2024-09-17T05:22:18.421131+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421131+0000","last_undegraded":"2024-09-17T05:22:18.421131+0000","last_fullsized":"2024-09-17T05:22:18.421131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436476+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436476+0000","last_peered":"2024-09-17T05:22:20.436476+0000","last_clean":"2024-09-17T05:22:20.436476+0000","last_became_active":"2024-09-17T05:22:18.425188+0000","last_became_peered":"2024-09-17T05:22:18.425188+0000","last_unstale":"2024-09-17T05:22:20.436476+0000","last_undegraded":"2024-09-17T05:22:20.436476+0000","last_fullsized":"2024-09-17T05:22:20.436476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:53.421290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007439+0000","last_change":"2024-09-17T05:22:19.440882+0000","last_active":"2024-09-17T05:22:21.007439+0000","last_peered":"2024-09-17T05:22:21.007439+0000","last_clean":"2024-09-17T05:22:21.007439+0000","last_became_active":"2024-09-17T05:22:19.440554+0000","last_became_peered":"2024-09-17T05:22:19.440554+0000","last_unstale":"2024-09-17T05:22:21.007439+0000","last_undegraded":"2024-09-17T05:22:21.007439+0000","last_fullsized":"2024-09-17T05:22:21.007439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.420404+0000","last_change":"2024-09-17T05:22:18.438129+0000","last_active":"2024-09-17T05:22:21.420404+0000","last_peered":"2024-09-17T05:22:21.420404+0000","last_clean":"2024-09-17T05:22:21.420404+0000","last_became_active":"2024-09-17T05:22:18.437872+0000","last_became_peered":"2024-09-17T05:22:18.437872+0000","last_unstale":"2024-09-17T05:22:21.420404+0000","last_undegraded":"2024-09-17T05:22:21.420404+0000","last_fullsized":"2024-09-17T05:22:21.420404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:01.605305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029489+0000","last_change":"2024-09-17T05:22:19.436359+0000","last_active":"2024-09-17T05:22:21.029489+0000","last_peered":"2024-09-17T05:22:21.029489+0000","last_clean":"2024-09-17T05:22:21.029489+0000","last_became_active":"2024-09-17T05:22:19.435752+0000","last_became_peered":"2024-09-17T05:22:19.435752+0000","last_unstale":"2024-09-17T05:22:21.029489+0000","last_undegraded":"2024-09-17T05:22:21.029489+0000","last_fullsized":"2024-09-17T05:22:21.029489+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433248+0000","last_change":"2024-09-17T05:22:18.429079+0000","last_active":"2024-09-17T05:22:20.433248+0000","last_peered":"2024-09-17T05:22:20.433248+0000","last_clean":"2024-09-17T05:22:20.433248+0000","last_became_active":"2024-09-17T05:22:18.428828+0000","last_became_peered":"2024-09-17T05:22:18.428828+0000","last_unstale":"2024-09-17T05:22:20.433248+0000","last_undegraded":"2024-09-17T05:22:20.433248+0000","last_fullsized":"2024-09-17T05:22:20.433248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:32.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029857+0000","last_change":"2024-09-17T05:22:19.436981+0000","last_active":"2024-09-17T05:22:21.029857+0000","last_peered":"2024-09-17T05:22:21.029857+0000","last_clean":"2024-09-17T05:22:21.029857+0000","last_became_active":"2024-09-17T05:22:19.436256+0000","last_became_peered":"2024-09-17T05:22:19.436256+0000","last_unstale":"2024-09-17T05:22:21.029857+0000","last_undegraded":"2024-09-17T05:22:21.029857+0000","last_fullsized":"2024-09-17T05:22:21.029857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:36.324734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421339+0000","last_change":"2024-09-17T05:22:18.421339+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421339+0000","last_undegraded":"2024-09-17T05:22:18.421339+0000","last_fullsized":"2024-09-17T05:22:18.421339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433029+0000","last_change":"2024-09-17T05:22:19.428711+0000","last_active":"2024-09-17T05:22:20.433029+0000","last_peered":"2024-09-17T05:22:20.433029+0000","last_clean":"2024-09-17T05:22:20.433029+0000","last_became_active":"2024-09-17T05:22:19.428345+0000","last_became_peered":"2024-09-17T05:22:19.428345+0000","last_unstale":"2024-09-17T05:22:20.433029+0000","last_undegraded":"2024-09-17T05:22:20.433029+0000","last_fullsized":"2024-09-17T05:22:20.433029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:34.010700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433341+0000","last_change":"2024-09-17T05:22:18.435789+0000","last_active":"2024-09-17T05:22:20.433341+0000","last_peered":"2024-09-17T05:22:20.433341+0000","last_clean":"2024-09-17T05:22:20.433341+0000","last_became_active":"2024-09-17T05:22:18.435509+0000","last_became_peered":"2024-09-17T05:22:18.435509+0000","last_unstale":"2024-09-17T05:22:20.433341+0000","last_undegraded":"2024-09-17T05:22:20.433341+0000","last_fullsized":"2024-09-17T05:22:20.433341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:07.895200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436640+0000","last_change":"2024-09-17T05:22:19.440009+0000","last_active":"2024-09-17T05:22:20.436640+0000","last_peered":"2024-09-17T05:22:20.436640+0000","last_clean":"2024-09-17T05:22:20.436640+0000","last_became_active":"2024-09-17T05:22:19.439695+0000","last_became_peered":"2024-09-17T05:22:19.439695+0000","last_unstale":"2024-09-17T05:22:20.436640+0000","last_undegraded":"2024-09-17T05:22:20.436640+0000","last_fullsized":"2024-09-17T05:22:20.436640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:10.705338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295403+0000","last_change":"2024-09-17T05:22:18.429070+0000","last_active":"2024-09-17T05:22:21.295403+0000","last_peered":"2024-09-17T05:22:21.295403+0000","last_clean":"2024-09-17T05:22:21.295403+0000","last_became_active":"2024-09-17T05:22:18.428814+0000","last_became_peered":"2024-09-17T05:22:18.428814+0000","last_unstale":"2024-09-17T05:22:21.295403+0000","last_undegraded":"2024-09-17T05:22:21.295403+0000","last_fullsized":"2024-09-17T05:22:21.295403+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:58.148752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295114+0000","last_change":"2024-09-17T05:22:19.441198+0000","last_active":"2024-09-17T05:22:21.295114+0000","last_peered":"2024-09-17T05:22:21.295114+0000","last_clean":"2024-09-17T05:22:21.295114+0000","last_became_active":"2024-09-17T05:22:19.440716+0000","last_became_peered":"2024-09-17T05:22:19.440716+0000","last_unstale":"2024-09-17T05:22:21.295114+0000","last_undegraded":"2024-09-17T05:22:21.295114+0000","last_fullsized":"2024-09-17T05:22:21.295114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:39.204819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434595+0000","last_change":"2024-09-17T05:22:18.428067+0000","last_active":"2024-09-17T05:22:20.434595+0000","last_peered":"2024-09-17T05:22:20.434595+0000","last_clean":"2024-09-17T05:22:20.434595+0000","last_became_active":"2024-09-17T05:22:18.427698+0000","last_became_peered":"2024-09-17T05:22:18.427698+0000","last_unstale":"2024-09-17T05:22:20.434595+0000","last_undegraded":"2024-09-17T05:22:20.434595+0000","last_fullsized":"2024-09-17T05:22:20.434595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:26.273038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.428856+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.428509+0000","last_became_peered":"2024-09-17T05:22:19.428509+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:04.873956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436222+0000","last_change":"2024-09-17T05:22:18.427604+0000","last_active":"2024-09-17T05:22:20.436222+0000","last_peered":"2024-09-17T05:22:20.436222+0000","last_clean":"2024-09-17T05:22:20.436222+0000","last_became_active":"2024-09-17T05:22:18.427324+0000","last_became_peered":"2024-09-17T05:22:18.427324+0000","last_unstale":"2024-09-17T05:22:20.436222+0000","last_undegraded":"2024-09-17T05:22:20.436222+0000","last_fullsized":"2024-09-17T05:22:20.436222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:54.627943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294931+0000","last_change":"2024-09-17T05:22:19.439418+0000","last_active":"2024-09-17T05:22:21.294931+0000","last_peered":"2024-09-17T05:22:21.294931+0000","last_clean":"2024-09-17T05:22:21.294931+0000","last_became_active":"2024-09-17T05:22:19.439146+0000","last_became_peered":"2024-09-17T05:22:19.439146+0000","last_unstale":"2024-09-17T05:22:21.294931+0000","last_undegraded":"2024-09-17T05:22:21.294931+0000","last_fullsized":"2024-09-17T05:22:21.294931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:01.545980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436507+0000","last_change":"2024-09-17T05:22:18.428890+0000","last_active":"2024-09-17T05:22:20.436507+0000","last_peered":"2024-09-17T05:22:20.436507+0000","last_clean":"2024-09-17T05:22:20.436507+0000","last_became_active":"2024-09-17T05:22:18.428073+0000","last_became_peered":"2024-09-17T05:22:18.428073+0000","last_unstale":"2024-09-17T05:22:20.436507+0000","last_undegraded":"2024-09-17T05:22:20.436507+0000","last_fullsized":"2024-09-17T05:22:20.436507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:19.470799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":192,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029128+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:22:21.029128+0000","last_peered":"2024-09-17T05:22:21.029128+0000","last_clean":"2024-09-17T05:22:21.029128+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:22:21.029128+0000","last_undegraded":"2024-09-17T05:22:21.029128+0000","last_fullsized":"2024-09-17T05:22:21.029128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":937153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":346261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":339959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":346239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":339981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":843776,"data_stored":347781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":342097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1388544,"data_stored":917187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:22.736 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:22.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 -- 172.21.15.81:0/869094083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8151370 msgr2=0x7fdfa80cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 --2- 172.21.15.81:0/869094083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8151370 0x7fdfa80cef30 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0009830 tx=0x7fdfa002a510 comp rx=0 tx=0).stop 2024-09-17T05:22:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 -- 172.21.15.81:0/869094083 shutdown_connections 2024-09-17T05:22:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 --2- 172.21.15.81:0/869094083 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfa8072cb0 0x7fdfa80cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 --2- 172.21.15.81:0/869094083 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8151370 0x7fdfa80cef30 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 -- 172.21.15.81:0/869094083 >> 172.21.15.81:0/869094083 conn(0x7fdfa80b1690 msgr2=0x7fdfa80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 -- 172.21.15.81:0/869094083 shutdown_connections 2024-09-17T05:22:22.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.870+0000 7fdfaf717640 1 -- 172.21.15.81:0/869094083 wait complete. 2024-09-17T05:22:22.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 Processor -- start 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 -- start start 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8072cb0 0x7fdfa80cd5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfa80b3140 0x7fdfa80cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8151370 0x7fdfa80ce3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa8070020 con 0x7fdfa8151370 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdfa806fea0 con 0x7fdfa8072cb0 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaf717640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdfa80701a0 con 0x7fdfa80b3140 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfadcb4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8151370 0x7fdfa80ce3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfadcb4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8151370 0x7fdfa80ce3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41462/0 (socket says 172.21.15.81:41462) 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfadcb4640 1 -- 172.21.15.81:0/148992464 learned_addr learned my addr 172.21.15.81:0/148992464 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:22.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfad4b3640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8072cb0 0x7fdfa80cd5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.872+0000 7fdfaccb2640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfa80b3140 0x7fdfa80cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfadcb4640 1 -- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfa80b3140 msgr2=0x7fdfa80cc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfadcb4640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfa80b3140 0x7fdfa80cc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfadcb4640 1 -- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8072cb0 msgr2=0x7fdfa80cd5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfadcb4640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8072cb0 0x7fdfa80cd5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfadcb4640 1 -- 172.21.15.81:0/148992464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfa80ccb20 con 0x7fdfa8151370 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfadcb4640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8151370 0x7fdfa80ce3c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c370 tx=0x7fdf9800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/148992464 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98003970 con 0x7fdfa8151370 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/148992464 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf98003c00 con 0x7fdfa8151370 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfa81f86c0 con 0x7fdfa8151370 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/148992464 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf98004020 con 0x7fdfa8151370 2024-09-17T05:22:22.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.873+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfa81f8c80 con 0x7fdfa8151370 2024-09-17T05:22:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.874+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfa80706c0 con 0x7fdfa8151370 2024-09-17T05:22:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.875+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/148992464 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fdf9801d020 con 0x7fdfa8151370 2024-09-17T05:22:22.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.875+0000 7fdfa5ffb640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdf94078e60 0x7fdf9407b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.876+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/148992464 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fdf9809b640 con 0x7fdfa8151370 2024-09-17T05:22:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.876+0000 7fdfad4b3640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdf94078e60 0x7fdf9407b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:22.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.876+0000 7fdfad4b3640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdf94078e60 0x7fdf9407b320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0034000 tx=0x7fdfa0004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:22.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:22.880+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/148992464 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdf98063110 con 0x7fdfa8151370 2024-09-17T05:22:23.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.054+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdfa80b44b0 con 0x7fdf94078e60 2024-09-17T05:22:23.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.058+0000 7fdfa5ffb640 1 -- 172.21.15.81:0/148992464 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+250912 (secure 0 0 0) 0x7fdfa80b44b0 con 0x7fdf94078e60 2024-09-17T05:22:23.062 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:23.063 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdf94078e60 msgr2=0x7fdf9407b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdf94078e60 0x7fdf9407b320 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fdfa0034000 tx=0x7fdfa0004730 comp rx=0 tx=0).stop 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8151370 msgr2=0x7fdfa80ce3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8151370 0x7fdfa80ce3c0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7fdf9800c370 tx=0x7fdf9800c830 comp rx=0 tx=0).stop 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 shutdown_connections 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fdf94078e60 0x7fdf9407b320 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdfa8151370 0x7fdfa80ce3c0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdfa80b3140 0x7fdfa80cc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 --2- 172.21.15.81:0/148992464 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdfa8072cb0 0x7fdfa80cd5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.061+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 >> 172.21.15.81:0/148992464 conn(0x7fdfa80b1690 msgr2=0x7fdfa80b0400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.062+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 shutdown_connections 2024-09-17T05:22:23.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.062+0000 7fdfaf717640 1 -- 172.21.15.81:0/148992464 wait complete. 2024-09-17T05:22:23.074 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-17T05:22:21.426298+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":110,"ondisk_log_size":110,"up":182,"acting":182,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":96,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232208,"kb_used_data":7648,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742512,"statfs":{"total":773094113280,"available":772856332288,"internally_reserved":0,"allocated":7831552,"data_stored":3916658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":25,"apply_latency_ms":25,"commit_latency_ns":25000000,"apply_latency_ns":25000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.016345"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029833+0000","last_change":"2024-09-17T05:22:19.438662+0000","last_active":"2024-09-17T05:22:21.029833+0000","last_peered":"2024-09-17T05:22:21.029833+0000","last_clean":"2024-09-17T05:22:21.029833+0000","last_became_active":"2024-09-17T05:22:19.438390+0000","last_became_peered":"2024-09-17T05:22:19.438390+0000","last_unstale":"2024-09-17T05:22:21.029833+0000","last_undegraded":"2024-09-17T05:22:21.029833+0000","last_fullsized":"2024-09-17T05:22:21.029833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:05.760603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436833+0000","last_change":"2024-09-17T05:22:19.428772+0000","last_active":"2024-09-17T05:22:20.436833+0000","last_peered":"2024-09-17T05:22:20.436833+0000","last_clean":"2024-09-17T05:22:20.436833+0000","last_became_active":"2024-09-17T05:22:19.427862+0000","last_became_peered":"2024-09-17T05:22:19.427862+0000","last_unstale":"2024-09-17T05:22:20.436833+0000","last_undegraded":"2024-09-17T05:22:20.436833+0000","last_fullsized":"2024-09-17T05:22:20.436833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295130+0000","last_change":"2024-09-17T05:22:19.434335+0000","last_active":"2024-09-17T05:22:21.295130+0000","last_peered":"2024-09-17T05:22:21.295130+0000","last_clean":"2024-09-17T05:22:21.295130+0000","last_became_active":"2024-09-17T05:22:19.434058+0000","last_became_peered":"2024-09-17T05:22:19.434058+0000","last_unstale":"2024-09-17T05:22:21.295130+0000","last_undegraded":"2024-09-17T05:22:21.295130+0000","last_fullsized":"2024-09-17T05:22:21.295130+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:29.970938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295867+0000","last_change":"2024-09-17T05:22:19.445535+0000","last_active":"2024-09-17T05:22:21.295867+0000","last_peered":"2024-09-17T05:22:21.295867+0000","last_clean":"2024-09-17T05:22:21.295867+0000","last_became_active":"2024-09-17T05:22:19.444870+0000","last_became_peered":"2024-09-17T05:22:19.444870+0000","last_unstale":"2024-09-17T05:22:21.295867+0000","last_undegraded":"2024-09-17T05:22:21.295867+0000","last_fullsized":"2024-09-17T05:22:21.295867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:36.729817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433254+0000","last_change":"2024-09-17T05:22:19.438404+0000","last_active":"2024-09-17T05:22:20.433254+0000","last_peered":"2024-09-17T05:22:20.433254+0000","last_clean":"2024-09-17T05:22:20.433254+0000","last_became_active":"2024-09-17T05:22:19.438134+0000","last_became_peered":"2024-09-17T05:22:19.438134+0000","last_unstale":"2024-09-17T05:22:20.433254+0000","last_undegraded":"2024-09-17T05:22:20.433254+0000","last_fullsized":"2024-09-17T05:22:20.433254+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:41.699191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436163+0000","last_change":"2024-09-17T05:22:19.426534+0000","last_active":"2024-09-17T05:22:20.436163+0000","last_peered":"2024-09-17T05:22:20.436163+0000","last_clean":"2024-09-17T05:22:20.436163+0000","last_became_active":"2024-09-17T05:22:19.426215+0000","last_became_peered":"2024-09-17T05:22:19.426215+0000","last_unstale":"2024-09-17T05:22:20.436163+0000","last_undegraded":"2024-09-17T05:22:20.436163+0000","last_fullsized":"2024-09-17T05:22:20.436163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:22.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007121+0000","last_change":"2024-09-17T05:22:19.440259+0000","last_active":"2024-09-17T05:22:21.007121+0000","last_peered":"2024-09-17T05:22:21.007121+0000","last_clean":"2024-09-17T05:22:21.007121+0000","last_became_active":"2024-09-17T05:22:19.439993+0000","last_became_peered":"2024-09-17T05:22:19.439993+0000","last_unstale":"2024-09-17T05:22:21.007121+0000","last_undegraded":"2024-09-17T05:22:21.007121+0000","last_fullsized":"2024-09-17T05:22:21.007121+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.223827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436770+0000","last_change":"2024-09-17T05:22:19.437945+0000","last_active":"2024-09-17T05:22:20.436770+0000","last_peered":"2024-09-17T05:22:20.436770+0000","last_clean":"2024-09-17T05:22:20.436770+0000","last_became_active":"2024-09-17T05:22:19.437670+0000","last_became_peered":"2024-09-17T05:22:19.437670+0000","last_unstale":"2024-09-17T05:22:20.436770+0000","last_undegraded":"2024-09-17T05:22:20.436770+0000","last_fullsized":"2024-09-17T05:22:20.436770+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:26.423565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433544+0000","last_change":"2024-09-17T05:22:19.430604+0000","last_active":"2024-09-17T05:22:20.433544+0000","last_peered":"2024-09-17T05:22:20.433544+0000","last_clean":"2024-09-17T05:22:20.433544+0000","last_became_active":"2024-09-17T05:22:19.430136+0000","last_became_peered":"2024-09-17T05:22:19.430136+0000","last_unstale":"2024-09-17T05:22:20.433544+0000","last_undegraded":"2024-09-17T05:22:20.433544+0000","last_fullsized":"2024-09-17T05:22:20.433544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:15.751408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435427+0000","last_change":"2024-09-17T05:22:19.427898+0000","last_active":"2024-09-17T05:22:20.435427+0000","last_peered":"2024-09-17T05:22:20.435427+0000","last_clean":"2024-09-17T05:22:20.435427+0000","last_became_active":"2024-09-17T05:22:19.427591+0000","last_became_peered":"2024-09-17T05:22:19.427591+0000","last_unstale":"2024-09-17T05:22:20.435427+0000","last_undegraded":"2024-09-17T05:22:20.435427+0000","last_fullsized":"2024-09-17T05:22:20.435427+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:01.861609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029667+0000","last_change":"2024-09-17T05:22:19.442877+0000","last_active":"2024-09-17T05:22:21.029667+0000","last_peered":"2024-09-17T05:22:21.029667+0000","last_clean":"2024-09-17T05:22:21.029667+0000","last_became_active":"2024-09-17T05:22:19.442514+0000","last_became_peered":"2024-09-17T05:22:19.442514+0000","last_unstale":"2024-09-17T05:22:21.029667+0000","last_undegraded":"2024-09-17T05:22:21.029667+0000","last_fullsized":"2024-09-17T05:22:21.029667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:45.208300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296004+0000","last_change":"2024-09-17T05:22:19.447642+0000","last_active":"2024-09-17T05:22:21.296004+0000","last_peered":"2024-09-17T05:22:21.296004+0000","last_clean":"2024-09-17T05:22:21.296004+0000","last_became_active":"2024-09-17T05:22:19.447297+0000","last_became_peered":"2024-09-17T05:22:19.447297+0000","last_unstale":"2024-09-17T05:22:21.296004+0000","last_undegraded":"2024-09-17T05:22:21.296004+0000","last_fullsized":"2024-09-17T05:22:21.296004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:48.971688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433151+0000","last_change":"2024-09-17T05:22:19.436649+0000","last_active":"2024-09-17T05:22:20.433151+0000","last_peered":"2024-09-17T05:22:20.433151+0000","last_clean":"2024-09-17T05:22:20.433151+0000","last_became_active":"2024-09-17T05:22:19.436379+0000","last_became_peered":"2024-09-17T05:22:19.436379+0000","last_unstale":"2024-09-17T05:22:20.433151+0000","last_undegraded":"2024-09-17T05:22:20.433151+0000","last_fullsized":"2024-09-17T05:22:20.433151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:44.750380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434649+0000","last_change":"2024-09-17T05:22:19.433093+0000","last_active":"2024-09-17T05:22:20.434649+0000","last_peered":"2024-09-17T05:22:20.434649+0000","last_clean":"2024-09-17T05:22:20.434649+0000","last_became_active":"2024-09-17T05:22:19.432601+0000","last_became_peered":"2024-09-17T05:22:19.432601+0000","last_unstale":"2024-09-17T05:22:20.434649+0000","last_undegraded":"2024-09-17T05:22:20.434649+0000","last_fullsized":"2024-09-17T05:22:20.434649+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433524+0000","last_change":"2024-09-17T05:22:19.427959+0000","last_active":"2024-09-17T05:22:20.433524+0000","last_peered":"2024-09-17T05:22:20.433524+0000","last_clean":"2024-09-17T05:22:20.433524+0000","last_became_active":"2024-09-17T05:22:19.427723+0000","last_became_peered":"2024-09-17T05:22:19.427723+0000","last_unstale":"2024-09-17T05:22:20.433524+0000","last_undegraded":"2024-09-17T05:22:20.433524+0000","last_fullsized":"2024-09-17T05:22:20.433524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:37.815920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295801+0000","last_change":"2024-09-17T05:22:19.445081+0000","last_active":"2024-09-17T05:22:21.295801+0000","last_peered":"2024-09-17T05:22:21.295801+0000","last_clean":"2024-09-17T05:22:21.295801+0000","last_became_active":"2024-09-17T05:22:19.444827+0000","last_became_peered":"2024-09-17T05:22:19.444827+0000","last_unstale":"2024-09-17T05:22:21.295801+0000","last_undegraded":"2024-09-17T05:22:21.295801+0000","last_fullsized":"2024-09-17T05:22:21.295801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:37.186334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436123+0000","last_change":"2024-09-17T05:22:19.438688+0000","last_active":"2024-09-17T05:22:20.436123+0000","last_peered":"2024-09-17T05:22:20.436123+0000","last_clean":"2024-09-17T05:22:20.436123+0000","last_became_active":"2024-09-17T05:22:19.438382+0000","last_became_peered":"2024-09-17T05:22:19.438382+0000","last_unstale":"2024-09-17T05:22:20.436123+0000","last_undegraded":"2024-09-17T05:22:20.436123+0000","last_fullsized":"2024-09-17T05:22:20.436123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:32.110192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434924+0000","last_change":"2024-09-17T05:22:19.430871+0000","last_active":"2024-09-17T05:22:20.434924+0000","last_peered":"2024-09-17T05:22:20.434924+0000","last_clean":"2024-09-17T05:22:20.434924+0000","last_became_active":"2024-09-17T05:22:19.430608+0000","last_became_peered":"2024-09-17T05:22:19.430608+0000","last_unstale":"2024-09-17T05:22:20.434924+0000","last_undegraded":"2024-09-17T05:22:20.434924+0000","last_fullsized":"2024-09-17T05:22:20.434924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434847+0000","last_change":"2024-09-17T05:22:19.422392+0000","last_active":"2024-09-17T05:22:20.434847+0000","last_peered":"2024-09-17T05:22:20.434847+0000","last_clean":"2024-09-17T05:22:20.434847+0000","last_became_active":"2024-09-17T05:22:19.421987+0000","last_became_peered":"2024-09-17T05:22:19.421987+0000","last_unstale":"2024-09-17T05:22:20.434847+0000","last_undegraded":"2024-09-17T05:22:20.434847+0000","last_fullsized":"2024-09-17T05:22:20.434847+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:08.730503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029409+0000","last_change":"2024-09-17T05:22:19.435845+0000","last_active":"2024-09-17T05:22:21.029409+0000","last_peered":"2024-09-17T05:22:21.029409+0000","last_clean":"2024-09-17T05:22:21.029409+0000","last_became_active":"2024-09-17T05:22:19.435535+0000","last_became_peered":"2024-09-17T05:22:19.435535+0000","last_unstale":"2024-09-17T05:22:21.029409+0000","last_undegraded":"2024-09-17T05:22:21.029409+0000","last_fullsized":"2024-09-17T05:22:21.029409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:17.679119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029229+0000","last_change":"2024-09-17T05:22:19.438687+0000","last_active":"2024-09-17T05:22:21.029229+0000","last_peered":"2024-09-17T05:22:21.029229+0000","last_clean":"2024-09-17T05:22:21.029229+0000","last_became_active":"2024-09-17T05:22:19.438347+0000","last_became_peered":"2024-09-17T05:22:19.438347+0000","last_unstale":"2024-09-17T05:22:21.029229+0000","last_undegraded":"2024-09-17T05:22:21.029229+0000","last_fullsized":"2024-09-17T05:22:21.029229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435155+0000","last_change":"2024-09-17T05:22:19.436133+0000","last_active":"2024-09-17T05:22:20.435155+0000","last_peered":"2024-09-17T05:22:20.435155+0000","last_clean":"2024-09-17T05:22:20.435155+0000","last_became_active":"2024-09-17T05:22:19.434918+0000","last_became_peered":"2024-09-17T05:22:19.434918+0000","last_unstale":"2024-09-17T05:22:20.435155+0000","last_undegraded":"2024-09-17T05:22:20.435155+0000","last_fullsized":"2024-09-17T05:22:20.435155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:33.154454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007447+0000","last_change":"2024-09-17T05:22:19.434518+0000","last_active":"2024-09-17T05:22:21.007447+0000","last_peered":"2024-09-17T05:22:21.007447+0000","last_clean":"2024-09-17T05:22:21.007447+0000","last_became_active":"2024-09-17T05:22:19.434257+0000","last_became_peered":"2024-09-17T05:22:19.434257+0000","last_unstale":"2024-09-17T05:22:21.007447+0000","last_undegraded":"2024-09-17T05:22:21.007447+0000","last_fullsized":"2024-09-17T05:22:21.007447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:14.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295312+0000","last_change":"2024-09-17T05:22:19.440746+0000","last_active":"2024-09-17T05:22:21.295312+0000","last_peered":"2024-09-17T05:22:21.295312+0000","last_clean":"2024-09-17T05:22:21.295312+0000","last_became_active":"2024-09-17T05:22:19.440478+0000","last_became_peered":"2024-09-17T05:22:19.440478+0000","last_unstale":"2024-09-17T05:22:21.295312+0000","last_undegraded":"2024-09-17T05:22:21.295312+0000","last_fullsized":"2024-09-17T05:22:21.295312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:39.556732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435163+0000","last_change":"2024-09-17T05:22:19.423204+0000","last_active":"2024-09-17T05:22:20.435163+0000","last_peered":"2024-09-17T05:22:20.435163+0000","last_clean":"2024-09-17T05:22:20.435163+0000","last_became_active":"2024-09-17T05:22:19.422837+0000","last_became_peered":"2024-09-17T05:22:19.422837+0000","last_unstale":"2024-09-17T05:22:20.435163+0000","last_undegraded":"2024-09-17T05:22:20.435163+0000","last_fullsized":"2024-09-17T05:22:20.435163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:48.167633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295557+0000","last_change":"2024-09-17T05:22:19.436288+0000","last_active":"2024-09-17T05:22:21.295557+0000","last_peered":"2024-09-17T05:22:21.295557+0000","last_clean":"2024-09-17T05:22:21.295557+0000","last_became_active":"2024-09-17T05:22:19.435852+0000","last_became_peered":"2024-09-17T05:22:19.435852+0000","last_unstale":"2024-09-17T05:22:21.295557+0000","last_undegraded":"2024-09-17T05:22:21.295557+0000","last_fullsized":"2024-09-17T05:22:21.295557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:19.404495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007353+0000","last_change":"2024-09-17T05:22:19.435208+0000","last_active":"2024-09-17T05:22:21.007353+0000","last_peered":"2024-09-17T05:22:21.007353+0000","last_clean":"2024-09-17T05:22:21.007353+0000","last_became_active":"2024-09-17T05:22:19.434972+0000","last_became_peered":"2024-09-17T05:22:19.434972+0000","last_unstale":"2024-09-17T05:22:21.007353+0000","last_undegraded":"2024-09-17T05:22:21.007353+0000","last_fullsized":"2024-09-17T05:22:21.007353+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:44.946507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007493+0000","last_change":"2024-09-17T05:22:19.436850+0000","last_active":"2024-09-17T05:22:21.007493+0000","last_peered":"2024-09-17T05:22:21.007493+0000","last_clean":"2024-09-17T05:22:21.007493+0000","last_became_active":"2024-09-17T05:22:19.436593+0000","last_became_peered":"2024-09-17T05:22:19.436593+0000","last_unstale":"2024-09-17T05:22:21.007493+0000","last_undegraded":"2024-09-17T05:22:21.007493+0000","last_fullsized":"2024-09-17T05:22:21.007493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:04.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.430122+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.429844+0000","last_became_peered":"2024-09-17T05:22:19.429844+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:31.556861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029745+0000","last_change":"2024-09-17T05:22:19.439394+0000","last_active":"2024-09-17T05:22:21.029745+0000","last_peered":"2024-09-17T05:22:21.029745+0000","last_clean":"2024-09-17T05:22:21.029745+0000","last_became_active":"2024-09-17T05:22:19.437506+0000","last_became_peered":"2024-09-17T05:22:19.437506+0000","last_unstale":"2024-09-17T05:22:21.029745+0000","last_undegraded":"2024-09-17T05:22:21.029745+0000","last_fullsized":"2024-09-17T05:22:21.029745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.824838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029965+0000","last_change":"2024-09-17T05:22:18.429837+0000","last_active":"2024-09-17T05:22:21.029965+0000","last_peered":"2024-09-17T05:22:21.029965+0000","last_clean":"2024-09-17T05:22:21.029965+0000","last_became_active":"2024-09-17T05:22:18.429576+0000","last_became_peered":"2024-09-17T05:22:18.429576+0000","last_unstale":"2024-09-17T05:22:21.029965+0000","last_undegraded":"2024-09-17T05:22:21.029965+0000","last_fullsized":"2024-09-17T05:22:21.029965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:33.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433624+0000","last_change":"2024-09-17T05:22:19.430787+0000","last_active":"2024-09-17T05:22:20.433624+0000","last_peered":"2024-09-17T05:22:20.433624+0000","last_clean":"2024-09-17T05:22:20.433624+0000","last_became_active":"2024-09-17T05:22:19.430454+0000","last_became_peered":"2024-09-17T05:22:19.430454+0000","last_unstale":"2024-09-17T05:22:20.433624+0000","last_undegraded":"2024-09-17T05:22:20.433624+0000","last_fullsized":"2024-09-17T05:22:20.433624+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:01.979709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421267+0000","last_change":"2024-09-17T05:22:18.421267+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421267+0000","last_undegraded":"2024-09-17T05:22:18.421267+0000","last_fullsized":"2024-09-17T05:22:18.421267+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436839+0000","last_change":"2024-09-17T05:22:19.434321+0000","last_active":"2024-09-17T05:22:20.436839+0000","last_peered":"2024-09-17T05:22:20.436839+0000","last_clean":"2024-09-17T05:22:20.436839+0000","last_became_active":"2024-09-17T05:22:19.433934+0000","last_became_peered":"2024-09-17T05:22:19.433934+0000","last_unstale":"2024-09-17T05:22:20.436839+0000","last_undegraded":"2024-09-17T05:22:20.436839+0000","last_fullsized":"2024-09-17T05:22:20.436839+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:15.805658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435078+0000","last_change":"2024-09-17T05:22:18.428988+0000","last_active":"2024-09-17T05:22:20.435078+0000","last_peered":"2024-09-17T05:22:20.435078+0000","last_clean":"2024-09-17T05:22:20.435078+0000","last_became_active":"2024-09-17T05:22:18.428719+0000","last_became_peered":"2024-09-17T05:22:18.428719+0000","last_unstale":"2024-09-17T05:22:20.435078+0000","last_undegraded":"2024-09-17T05:22:20.435078+0000","last_fullsized":"2024-09-17T05:22:20.435078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.794624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029706+0000","last_change":"2024-09-17T05:22:19.436635+0000","last_active":"2024-09-17T05:22:21.029706+0000","last_peered":"2024-09-17T05:22:21.029706+0000","last_clean":"2024-09-17T05:22:21.029706+0000","last_became_active":"2024-09-17T05:22:19.435951+0000","last_became_peered":"2024-09-17T05:22:19.435951+0000","last_unstale":"2024-09-17T05:22:21.029706+0000","last_undegraded":"2024-09-17T05:22:21.029706+0000","last_fullsized":"2024-09-17T05:22:21.029706+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.075149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436933+0000","last_change":"2024-09-17T05:22:18.427589+0000","last_active":"2024-09-17T05:22:20.436933+0000","last_peered":"2024-09-17T05:22:20.436933+0000","last_clean":"2024-09-17T05:22:20.436933+0000","last_became_active":"2024-09-17T05:22:18.427294+0000","last_became_peered":"2024-09-17T05:22:18.427294+0000","last_unstale":"2024-09-17T05:22:20.436933+0000","last_undegraded":"2024-09-17T05:22:20.436933+0000","last_fullsized":"2024-09-17T05:22:20.436933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:50.823087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007293+0000","last_change":"2024-09-17T05:22:19.438589+0000","last_active":"2024-09-17T05:22:21.007293+0000","last_peered":"2024-09-17T05:22:21.007293+0000","last_clean":"2024-09-17T05:22:21.007293+0000","last_became_active":"2024-09-17T05:22:19.438299+0000","last_became_peered":"2024-09-17T05:22:19.438299+0000","last_unstale":"2024-09-17T05:22:21.007293+0000","last_undegraded":"2024-09-17T05:22:21.007293+0000","last_fullsized":"2024-09-17T05:22:21.007293+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:57.072075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295653+0000","last_change":"2024-09-17T05:22:18.431383+0000","last_active":"2024-09-17T05:22:21.295653+0000","last_peered":"2024-09-17T05:22:21.295653+0000","last_clean":"2024-09-17T05:22:21.295653+0000","last_became_active":"2024-09-17T05:22:18.431115+0000","last_became_peered":"2024-09-17T05:22:18.431115+0000","last_unstale":"2024-09-17T05:22:21.295653+0000","last_undegraded":"2024-09-17T05:22:21.295653+0000","last_fullsized":"2024-09-17T05:22:21.295653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:09.892453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435067+0000","last_change":"2024-09-17T05:22:19.432969+0000","last_active":"2024-09-17T05:22:20.435067+0000","last_peered":"2024-09-17T05:22:20.435067+0000","last_clean":"2024-09-17T05:22:20.435067+0000","last_became_active":"2024-09-17T05:22:19.432466+0000","last_became_peered":"2024-09-17T05:22:19.432466+0000","last_unstale":"2024-09-17T05:22:20.435067+0000","last_undegraded":"2024-09-17T05:22:20.435067+0000","last_fullsized":"2024-09-17T05:22:20.435067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:11.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436110+0000","last_change":"2024-09-17T05:22:18.431419+0000","last_active":"2024-09-17T05:22:20.436110+0000","last_peered":"2024-09-17T05:22:20.436110+0000","last_clean":"2024-09-17T05:22:20.436110+0000","last_became_active":"2024-09-17T05:22:18.430589+0000","last_became_peered":"2024-09-17T05:22:18.430589+0000","last_unstale":"2024-09-17T05:22:20.436110+0000","last_undegraded":"2024-09-17T05:22:20.436110+0000","last_fullsized":"2024-09-17T05:22:20.436110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:39.998483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432851+0000","last_change":"2024-09-17T05:22:19.427627+0000","last_active":"2024-09-17T05:22:20.432851+0000","last_peered":"2024-09-17T05:22:20.432851+0000","last_clean":"2024-09-17T05:22:20.432851+0000","last_became_active":"2024-09-17T05:22:19.427370+0000","last_became_peered":"2024-09-17T05:22:19.427370+0000","last_unstale":"2024-09-17T05:22:20.432851+0000","last_undegraded":"2024-09-17T05:22:20.432851+0000","last_fullsized":"2024-09-17T05:22:20.432851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:36.555054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295310+0000","last_change":"2024-09-17T05:22:18.428001+0000","last_active":"2024-09-17T05:22:21.295310+0000","last_peered":"2024-09-17T05:22:21.295310+0000","last_clean":"2024-09-17T05:22:21.295310+0000","last_became_active":"2024-09-17T05:22:18.427739+0000","last_became_peered":"2024-09-17T05:22:18.427739+0000","last_unstale":"2024-09-17T05:22:21.295310+0000","last_undegraded":"2024-09-17T05:22:21.295310+0000","last_fullsized":"2024-09-17T05:22:21.295310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:10.556798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432875+0000","last_change":"2024-09-17T05:22:18.423744+0000","last_active":"2024-09-17T05:22:20.432875+0000","last_peered":"2024-09-17T05:22:20.432875+0000","last_clean":"2024-09-17T05:22:20.432875+0000","last_became_active":"2024-09-17T05:22:18.423474+0000","last_became_peered":"2024-09-17T05:22:18.423474+0000","last_unstale":"2024-09-17T05:22:20.432875+0000","last_undegraded":"2024-09-17T05:22:20.432875+0000","last_fullsized":"2024-09-17T05:22:20.432875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:20.141453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007512+0000","last_change":"2024-09-17T05:22:19.443778+0000","last_active":"2024-09-17T05:22:21.007512+0000","last_peered":"2024-09-17T05:22:21.007512+0000","last_clean":"2024-09-17T05:22:21.007512+0000","last_became_active":"2024-09-17T05:22:19.443519+0000","last_became_peered":"2024-09-17T05:22:19.443519+0000","last_unstale":"2024-09-17T05:22:21.007512+0000","last_undegraded":"2024-09-17T05:22:21.007512+0000","last_fullsized":"2024-09-17T05:22:21.007512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435207+0000","last_change":"2024-09-17T05:22:18.427480+0000","last_active":"2024-09-17T05:22:20.435207+0000","last_peered":"2024-09-17T05:22:20.435207+0000","last_clean":"2024-09-17T05:22:20.435207+0000","last_became_active":"2024-09-17T05:22:18.427197+0000","last_became_peered":"2024-09-17T05:22:18.427197+0000","last_unstale":"2024-09-17T05:22:20.435207+0000","last_undegraded":"2024-09-17T05:22:20.435207+0000","last_fullsized":"2024-09-17T05:22:20.435207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:18.433977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029862+0000","last_change":"2024-09-17T05:22:19.437340+0000","last_active":"2024-09-17T05:22:21.029862+0000","last_peered":"2024-09-17T05:22:21.029862+0000","last_clean":"2024-09-17T05:22:21.029862+0000","last_became_active":"2024-09-17T05:22:19.437078+0000","last_became_peered":"2024-09-17T05:22:19.437078+0000","last_unstale":"2024-09-17T05:22:21.029862+0000","last_undegraded":"2024-09-17T05:22:21.029862+0000","last_fullsized":"2024-09-17T05:22:21.029862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:27.525759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436753+0000","last_change":"2024-09-17T05:22:18.434179+0000","last_active":"2024-09-17T05:22:20.436753+0000","last_peered":"2024-09-17T05:22:20.436753+0000","last_clean":"2024-09-17T05:22:20.436753+0000","last_became_active":"2024-09-17T05:22:18.433907+0000","last_became_peered":"2024-09-17T05:22:18.433907+0000","last_unstale":"2024-09-17T05:22:20.436753+0000","last_undegraded":"2024-09-17T05:22:20.436753+0000","last_fullsized":"2024-09-17T05:22:20.436753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:34.301087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436901+0000","last_change":"2024-09-17T05:22:19.431778+0000","last_active":"2024-09-17T05:22:20.436901+0000","last_peered":"2024-09-17T05:22:20.436901+0000","last_clean":"2024-09-17T05:22:20.436901+0000","last_became_active":"2024-09-17T05:22:19.430979+0000","last_became_peered":"2024-09-17T05:22:19.430979+0000","last_unstale":"2024-09-17T05:22:20.436901+0000","last_undegraded":"2024-09-17T05:22:20.436901+0000","last_fullsized":"2024-09-17T05:22:20.436901+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295407+0000","last_change":"2024-09-17T05:22:18.435917+0000","last_active":"2024-09-17T05:22:21.295407+0000","last_peered":"2024-09-17T05:22:21.295407+0000","last_clean":"2024-09-17T05:22:21.295407+0000","last_became_active":"2024-09-17T05:22:18.435593+0000","last_became_peered":"2024-09-17T05:22:18.435593+0000","last_unstale":"2024-09-17T05:22:21.295407+0000","last_undegraded":"2024-09-17T05:22:21.295407+0000","last_fullsized":"2024-09-17T05:22:21.295407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.139854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433175+0000","last_change":"2024-09-17T05:22:19.439603+0000","last_active":"2024-09-17T05:22:20.433175+0000","last_peered":"2024-09-17T05:22:20.433175+0000","last_clean":"2024-09-17T05:22:20.433175+0000","last_became_active":"2024-09-17T05:22:19.439330+0000","last_became_peered":"2024-09-17T05:22:19.439330+0000","last_unstale":"2024-09-17T05:22:20.433175+0000","last_undegraded":"2024-09-17T05:22:20.433175+0000","last_fullsized":"2024-09-17T05:22:20.433175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:11.001407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296073+0000","last_change":"2024-09-17T05:22:18.424114+0000","last_active":"2024-09-17T05:22:21.296073+0000","last_peered":"2024-09-17T05:22:21.296073+0000","last_clean":"2024-09-17T05:22:21.296073+0000","last_became_active":"2024-09-17T05:22:18.423841+0000","last_became_peered":"2024-09-17T05:22:18.423841+0000","last_unstale":"2024-09-17T05:22:21.296073+0000","last_undegraded":"2024-09-17T05:22:21.296073+0000","last_fullsized":"2024-09-17T05:22:21.296073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029395+0000","last_change":"2024-09-17T05:22:19.438635+0000","last_active":"2024-09-17T05:22:21.029395+0000","last_peered":"2024-09-17T05:22:21.029395+0000","last_clean":"2024-09-17T05:22:21.029395+0000","last_became_active":"2024-09-17T05:22:19.438317+0000","last_became_peered":"2024-09-17T05:22:19.438317+0000","last_unstale":"2024-09-17T05:22:21.029395+0000","last_undegraded":"2024-09-17T05:22:21.029395+0000","last_fullsized":"2024-09-17T05:22:21.029395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:16.873928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295623+0000","last_change":"2024-09-17T05:22:18.430649+0000","last_active":"2024-09-17T05:22:21.295623+0000","last_peered":"2024-09-17T05:22:21.295623+0000","last_clean":"2024-09-17T05:22:21.295623+0000","last_became_active":"2024-09-17T05:22:18.430347+0000","last_became_peered":"2024-09-17T05:22:18.430347+0000","last_unstale":"2024-09-17T05:22:21.295623+0000","last_undegraded":"2024-09-17T05:22:21.295623+0000","last_fullsized":"2024-09-17T05:22:21.295623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:35.076714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007332+0000","last_change":"2024-09-17T05:22:19.435957+0000","last_active":"2024-09-17T05:22:21.007332+0000","last_peered":"2024-09-17T05:22:21.007332+0000","last_clean":"2024-09-17T05:22:21.007332+0000","last_became_active":"2024-09-17T05:22:19.435711+0000","last_became_peered":"2024-09-17T05:22:19.435711+0000","last_unstale":"2024-09-17T05:22:21.007332+0000","last_undegraded":"2024-09-17T05:22:21.007332+0000","last_fullsized":"2024-09-17T05:22:21.007332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.631571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436227+0000","last_change":"2024-09-17T05:22:18.432090+0000","last_active":"2024-09-17T05:22:20.436227+0000","last_peered":"2024-09-17T05:22:20.436227+0000","last_clean":"2024-09-17T05:22:20.436227+0000","last_became_active":"2024-09-17T05:22:18.431771+0000","last_became_peered":"2024-09-17T05:22:18.431771+0000","last_unstale":"2024-09-17T05:22:20.436227+0000","last_undegraded":"2024-09-17T05:22:20.436227+0000","last_fullsized":"2024-09-17T05:22:20.436227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:26.966895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007157+0000","last_change":"2024-09-17T05:22:18.438120+0000","last_active":"2024-09-17T05:22:21.007157+0000","last_peered":"2024-09-17T05:22:21.007157+0000","last_clean":"2024-09-17T05:22:21.007157+0000","last_became_active":"2024-09-17T05:22:18.437867+0000","last_became_peered":"2024-09-17T05:22:18.437867+0000","last_unstale":"2024-09-17T05:22:21.007157+0000","last_undegraded":"2024-09-17T05:22:21.007157+0000","last_fullsized":"2024-09-17T05:22:21.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:25.421633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433049+0000","last_change":"2024-09-17T05:22:19.428773+0000","last_active":"2024-09-17T05:22:20.433049+0000","last_peered":"2024-09-17T05:22:20.433049+0000","last_clean":"2024-09-17T05:22:20.433049+0000","last_became_active":"2024-09-17T05:22:19.427978+0000","last_became_peered":"2024-09-17T05:22:19.427978+0000","last_unstale":"2024-09-17T05:22:20.433049+0000","last_undegraded":"2024-09-17T05:22:20.433049+0000","last_fullsized":"2024-09-17T05:22:20.433049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:01.994688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434550+0000","last_change":"2024-09-17T05:22:18.430819+0000","last_active":"2024-09-17T05:22:20.434550+0000","last_peered":"2024-09-17T05:22:20.434550+0000","last_clean":"2024-09-17T05:22:20.434550+0000","last_became_active":"2024-09-17T05:22:18.430534+0000","last_became_peered":"2024-09-17T05:22:18.430534+0000","last_unstale":"2024-09-17T05:22:20.434550+0000","last_undegraded":"2024-09-17T05:22:20.434550+0000","last_fullsized":"2024-09-17T05:22:20.434550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:23.764199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435617+0000","last_change":"2024-09-17T05:22:19.437170+0000","last_active":"2024-09-17T05:22:20.435617+0000","last_peered":"2024-09-17T05:22:20.435617+0000","last_clean":"2024-09-17T05:22:20.435617+0000","last_became_active":"2024-09-17T05:22:19.436924+0000","last_became_peered":"2024-09-17T05:22:19.436924+0000","last_unstale":"2024-09-17T05:22:20.435617+0000","last_undegraded":"2024-09-17T05:22:20.435617+0000","last_fullsized":"2024-09-17T05:22:20.435617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:25.019162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436440+0000","last_change":"2024-09-17T05:22:18.426844+0000","last_active":"2024-09-17T05:22:20.436440+0000","last_peered":"2024-09-17T05:22:20.436440+0000","last_clean":"2024-09-17T05:22:20.436440+0000","last_became_active":"2024-09-17T05:22:18.426464+0000","last_became_peered":"2024-09-17T05:22:18.426464+0000","last_unstale":"2024-09-17T05:22:20.436440+0000","last_undegraded":"2024-09-17T05:22:20.436440+0000","last_fullsized":"2024-09-17T05:22:20.436440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:42.575528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.030025+0000","last_change":"2024-09-17T05:22:19.445918+0000","last_active":"2024-09-17T05:22:21.030025+0000","last_peered":"2024-09-17T05:22:21.030025+0000","last_clean":"2024-09-17T05:22:21.030025+0000","last_became_active":"2024-09-17T05:22:19.445591+0000","last_became_peered":"2024-09-17T05:22:19.445591+0000","last_unstale":"2024-09-17T05:22:21.030025+0000","last_undegraded":"2024-09-17T05:22:21.030025+0000","last_fullsized":"2024-09-17T05:22:21.030025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:10.894386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435745+0000","last_change":"2024-09-17T05:22:18.428672+0000","last_active":"2024-09-17T05:22:20.435745+0000","last_peered":"2024-09-17T05:22:20.435745+0000","last_clean":"2024-09-17T05:22:20.435745+0000","last_became_active":"2024-09-17T05:22:18.428286+0000","last_became_peered":"2024-09-17T05:22:18.428286+0000","last_unstale":"2024-09-17T05:22:20.435745+0000","last_undegraded":"2024-09-17T05:22:20.435745+0000","last_fullsized":"2024-09-17T05:22:20.435745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:01.168568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296016+0000","last_change":"2024-09-17T05:22:19.445238+0000","last_active":"2024-09-17T05:22:21.296016+0000","last_peered":"2024-09-17T05:22:21.296016+0000","last_clean":"2024-09-17T05:22:21.296016+0000","last_became_active":"2024-09-17T05:22:19.444427+0000","last_became_peered":"2024-09-17T05:22:19.444427+0000","last_unstale":"2024-09-17T05:22:21.296016+0000","last_undegraded":"2024-09-17T05:22:21.296016+0000","last_fullsized":"2024-09-17T05:22:21.296016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:15.940887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436323+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436323+0000","last_peered":"2024-09-17T05:22:20.436323+0000","last_clean":"2024-09-17T05:22:20.436323+0000","last_became_active":"2024-09-17T05:22:18.425366+0000","last_became_peered":"2024-09-17T05:22:18.425366+0000","last_unstale":"2024-09-17T05:22:20.436323+0000","last_undegraded":"2024-09-17T05:22:20.436323+0000","last_fullsized":"2024-09-17T05:22:20.436323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:31.206646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433306+0000","last_change":"2024-09-17T05:22:19.431613+0000","last_active":"2024-09-17T05:22:20.433306+0000","last_peered":"2024-09-17T05:22:20.433306+0000","last_clean":"2024-09-17T05:22:20.433306+0000","last_became_active":"2024-09-17T05:22:19.431303+0000","last_became_peered":"2024-09-17T05:22:19.431303+0000","last_unstale":"2024-09-17T05:22:20.433306+0000","last_undegraded":"2024-09-17T05:22:20.433306+0000","last_fullsized":"2024-09-17T05:22:20.433306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:33.110557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029435+0000","last_change":"2024-09-17T05:22:18.433627+0000","last_active":"2024-09-17T05:22:21.029435+0000","last_peered":"2024-09-17T05:22:21.029435+0000","last_clean":"2024-09-17T05:22:21.029435+0000","last_became_active":"2024-09-17T05:22:18.433349+0000","last_became_peered":"2024-09-17T05:22:18.433349+0000","last_unstale":"2024-09-17T05:22:21.029435+0000","last_undegraded":"2024-09-17T05:22:21.029435+0000","last_fullsized":"2024-09-17T05:22:21.029435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295581+0000","last_change":"2024-09-17T05:22:19.436894+0000","last_active":"2024-09-17T05:22:21.295581+0000","last_peered":"2024-09-17T05:22:21.295581+0000","last_clean":"2024-09-17T05:22:21.295581+0000","last_became_active":"2024-09-17T05:22:19.436645+0000","last_became_peered":"2024-09-17T05:22:19.436645+0000","last_unstale":"2024-09-17T05:22:21.295581+0000","last_undegraded":"2024-09-17T05:22:21.295581+0000","last_fullsized":"2024-09-17T05:22:21.295581+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:03.311936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436274+0000","last_change":"2024-09-17T05:22:18.431369+0000","last_active":"2024-09-17T05:22:20.436274+0000","last_peered":"2024-09-17T05:22:20.436274+0000","last_clean":"2024-09-17T05:22:20.436274+0000","last_became_active":"2024-09-17T05:22:18.429959+0000","last_became_peered":"2024-09-17T05:22:18.429959+0000","last_unstale":"2024-09-17T05:22:20.436274+0000","last_undegraded":"2024-09-17T05:22:20.436274+0000","last_fullsized":"2024-09-17T05:22:20.436274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294832+0000","last_change":"2024-09-17T05:22:19.432750+0000","last_active":"2024-09-17T05:22:21.294832+0000","last_peered":"2024-09-17T05:22:21.294832+0000","last_clean":"2024-09-17T05:22:21.294832+0000","last_became_active":"2024-09-17T05:22:19.432494+0000","last_became_peered":"2024-09-17T05:22:19.432494+0000","last_unstale":"2024-09-17T05:22:21.294832+0000","last_undegraded":"2024-09-17T05:22:21.294832+0000","last_fullsized":"2024-09-17T05:22:21.294832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.854203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007473+0000","last_change":"2024-09-17T05:22:18.434348+0000","last_active":"2024-09-17T05:22:21.007473+0000","last_peered":"2024-09-17T05:22:21.007473+0000","last_clean":"2024-09-17T05:22:21.007473+0000","last_became_active":"2024-09-17T05:22:18.434070+0000","last_became_peered":"2024-09-17T05:22:18.434070+0000","last_unstale":"2024-09-17T05:22:21.007473+0000","last_undegraded":"2024-09-17T05:22:21.007473+0000","last_fullsized":"2024-09-17T05:22:21.007473+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295990+0000","last_change":"2024-09-17T05:22:19.433227+0000","last_active":"2024-09-17T05:22:21.295990+0000","last_peered":"2024-09-17T05:22:21.295990+0000","last_clean":"2024-09-17T05:22:21.295990+0000","last_became_active":"2024-09-17T05:22:19.432973+0000","last_became_peered":"2024-09-17T05:22:19.432973+0000","last_unstale":"2024-09-17T05:22:21.295990+0000","last_undegraded":"2024-09-17T05:22:21.295990+0000","last_fullsized":"2024-09-17T05:22:21.295990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:44.832519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421131+0000","last_change":"2024-09-17T05:22:18.421131+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421131+0000","last_undegraded":"2024-09-17T05:22:18.421131+0000","last_fullsized":"2024-09-17T05:22:18.421131+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":["0","2"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:22:18.404765+0000","last_change":"2024-09-17T05:22:18.404765+0000","last_active":"2024-09-17T05:22:18.404765+0000","last_peered":"2024-09-17T05:22:18.404765+0000","last_clean":"2024-09-17T05:22:18.404765+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.404765+0000","last_undegraded":"2024-09-17T05:22:18.404765+0000","last_fullsized":"2024-09-17T05:22:18.404765+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436476+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436476+0000","last_peered":"2024-09-17T05:22:20.436476+0000","last_clean":"2024-09-17T05:22:20.436476+0000","last_became_active":"2024-09-17T05:22:18.425188+0000","last_became_peered":"2024-09-17T05:22:18.425188+0000","last_unstale":"2024-09-17T05:22:20.436476+0000","last_undegraded":"2024-09-17T05:22:20.436476+0000","last_fullsized":"2024-09-17T05:22:20.436476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:53.421290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007439+0000","last_change":"2024-09-17T05:22:19.440882+0000","last_active":"2024-09-17T05:22:21.007439+0000","last_peered":"2024-09-17T05:22:21.007439+0000","last_clean":"2024-09-17T05:22:21.007439+0000","last_became_active":"2024-09-17T05:22:19.440554+0000","last_became_peered":"2024-09-17T05:22:19.440554+0000","last_unstale":"2024-09-17T05:22:21.007439+0000","last_undegraded":"2024-09-17T05:22:21.007439+0000","last_fullsized":"2024-09-17T05:22:21.007439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.420404+0000","last_change":"2024-09-17T05:22:18.438129+0000","last_active":"2024-09-17T05:22:21.420404+0000","last_peered":"2024-09-17T05:22:21.420404+0000","last_clean":"2024-09-17T05:22:21.420404+0000","last_became_active":"2024-09-17T05:22:18.437872+0000","last_became_peered":"2024-09-17T05:22:18.437872+0000","last_unstale":"2024-09-17T05:22:21.420404+0000","last_undegraded":"2024-09-17T05:22:21.420404+0000","last_fullsized":"2024-09-17T05:22:21.420404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:01.605305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029489+0000","last_change":"2024-09-17T05:22:19.436359+0000","last_active":"2024-09-17T05:22:21.029489+0000","last_peered":"2024-09-17T05:22:21.029489+0000","last_clean":"2024-09-17T05:22:21.029489+0000","last_became_active":"2024-09-17T05:22:19.435752+0000","last_became_peered":"2024-09-17T05:22:19.435752+0000","last_unstale":"2024-09-17T05:22:21.029489+0000","last_undegraded":"2024-09-17T05:22:21.029489+0000","last_fullsized":"2024-09-17T05:22:21.029489+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433248+0000","last_change":"2024-09-17T05:22:18.429079+0000","last_active":"2024-09-17T05:22:20.433248+0000","last_peered":"2024-09-17T05:22:20.433248+0000","last_clean":"2024-09-17T05:22:20.433248+0000","last_became_active":"2024-09-17T05:22:18.428828+0000","last_became_peered":"2024-09-17T05:22:18.428828+0000","last_unstale":"2024-09-17T05:22:20.433248+0000","last_undegraded":"2024-09-17T05:22:20.433248+0000","last_fullsized":"2024-09-17T05:22:20.433248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:32.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029857+0000","last_change":"2024-09-17T05:22:19.436981+0000","last_active":"2024-09-17T05:22:21.029857+0000","last_peered":"2024-09-17T05:22:21.029857+0000","last_clean":"2024-09-17T05:22:21.029857+0000","last_became_active":"2024-09-17T05:22:19.436256+0000","last_became_peered":"2024-09-17T05:22:19.436256+0000","last_unstale":"2024-09-17T05:22:21.029857+0000","last_undegraded":"2024-09-17T05:22:21.029857+0000","last_fullsized":"2024-09-17T05:22:21.029857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:36.324734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":3,"reported_epoch":67,"state":"creating+activating","last_fresh":"2024-09-17T05:22:18.421339+0000","last_change":"2024-09-17T05:22:18.421339+0000","last_active":"2024-09-17T05:22:17.402832+0000","last_peered":"2024-09-17T05:22:17.402832+0000","last_clean":"2024-09-17T05:22:17.402832+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:22:18.421339+0000","last_undegraded":"2024-09-17T05:22:18.421339+0000","last_fullsized":"2024-09-17T05:22:18.421339+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":["0","4"],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433029+0000","last_change":"2024-09-17T05:22:19.428711+0000","last_active":"2024-09-17T05:22:20.433029+0000","last_peered":"2024-09-17T05:22:20.433029+0000","last_clean":"2024-09-17T05:22:20.433029+0000","last_became_active":"2024-09-17T05:22:19.428345+0000","last_became_peered":"2024-09-17T05:22:19.428345+0000","last_unstale":"2024-09-17T05:22:20.433029+0000","last_undegraded":"2024-09-17T05:22:20.433029+0000","last_fullsized":"2024-09-17T05:22:20.433029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:34.010700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433341+0000","last_change":"2024-09-17T05:22:18.435789+0000","last_active":"2024-09-17T05:22:20.433341+0000","last_peered":"2024-09-17T05:22:20.433341+0000","last_clean":"2024-09-17T05:22:20.433341+0000","last_became_active":"2024-09-17T05:22:18.435509+0000","last_became_peered":"2024-09-17T05:22:18.435509+0000","last_unstale":"2024-09-17T05:22:20.433341+0000","last_undegraded":"2024-09-17T05:22:20.433341+0000","last_fullsized":"2024-09-17T05:22:20.433341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:07.895200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436640+0000","last_change":"2024-09-17T05:22:19.440009+0000","last_active":"2024-09-17T05:22:20.436640+0000","last_peered":"2024-09-17T05:22:20.436640+0000","last_clean":"2024-09-17T05:22:20.436640+0000","last_became_active":"2024-09-17T05:22:19.439695+0000","last_became_peered":"2024-09-17T05:22:19.439695+0000","last_unstale":"2024-09-17T05:22:20.436640+0000","last_undegraded":"2024-09-17T05:22:20.436640+0000","last_fullsized":"2024-09-17T05:22:20.436640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:10.705338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295403+0000","last_change":"2024-09-17T05:22:18.429070+0000","last_active":"2024-09-17T05:22:21.295403+0000","last_peered":"2024-09-17T05:22:21.295403+0000","last_clean":"2024-09-17T05:22:21.295403+0000","last_became_active":"2024-09-17T05:22:18.428814+0000","last_became_peered":"2024-09-17T05:22:18.428814+0000","last_unstale":"2024-09-17T05:22:21.295403+0000","last_undegraded":"2024-09-17T05:22:21.295403+0000","last_fullsized":"2024-09-17T05:22:21.295403+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:58.148752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295114+0000","last_change":"2024-09-17T05:22:19.441198+0000","last_active":"2024-09-17T05:22:21.295114+0000","last_peered":"2024-09-17T05:22:21.295114+0000","last_clean":"2024-09-17T05:22:21.295114+0000","last_became_active":"2024-09-17T05:22:19.440716+0000","last_became_peered":"2024-09-17T05:22:19.440716+0000","last_unstale":"2024-09-17T05:22:21.295114+0000","last_undegraded":"2024-09-17T05:22:21.295114+0000","last_fullsized":"2024-09-17T05:22:21.295114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:39.204819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434595+0000","last_change":"2024-09-17T05:22:18.428067+0000","last_active":"2024-09-17T05:22:20.434595+0000","last_peered":"2024-09-17T05:22:20.434595+0000","last_clean":"2024-09-17T05:22:20.434595+0000","last_became_active":"2024-09-17T05:22:18.427698+0000","last_became_peered":"2024-09-17T05:22:18.427698+0000","last_unstale":"2024-09-17T05:22:20.434595+0000","last_undegraded":"2024-09-17T05:22:20.434595+0000","last_fullsized":"2024-09-17T05:22:20.434595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:26.273038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.428856+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.428509+0000","last_became_peered":"2024-09-17T05:22:19.428509+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:04.873956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436222+0000","last_change":"2024-09-17T05:22:18.427604+0000","last_active":"2024-09-17T05:22:20.436222+0000","last_peered":"2024-09-17T05:22:20.436222+0000","last_clean":"2024-09-17T05:22:20.436222+0000","last_became_active":"2024-09-17T05:22:18.427324+0000","last_became_peered":"2024-09-17T05:22:18.427324+0000","last_unstale":"2024-09-17T05:22:20.436222+0000","last_undegraded":"2024-09-17T05:22:20.436222+0000","last_fullsized":"2024-09-17T05:22:20.436222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:54.627943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294931+0000","last_change":"2024-09-17T05:22:19.439418+0000","last_active":"2024-09-17T05:22:21.294931+0000","last_peered":"2024-09-17T05:22:21.294931+0000","last_clean":"2024-09-17T05:22:21.294931+0000","last_became_active":"2024-09-17T05:22:19.439146+0000","last_became_peered":"2024-09-17T05:22:19.439146+0000","last_unstale":"2024-09-17T05:22:21.294931+0000","last_undegraded":"2024-09-17T05:22:21.294931+0000","last_fullsized":"2024-09-17T05:22:21.294931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:01.545980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436507+0000","last_change":"2024-09-17T05:22:18.428890+0000","last_active":"2024-09-17T05:22:20.436507+0000","last_peered":"2024-09-17T05:22:20.436507+0000","last_clean":"2024-09-17T05:22:20.436507+0000","last_became_active":"2024-09-17T05:22:18.428073+0000","last_became_peered":"2024-09-17T05:22:18.428073+0000","last_unstale":"2024-09-17T05:22:20.436507+0000","last_undegraded":"2024-09-17T05:22:20.436507+0000","last_fullsized":"2024-09-17T05:22:20.436507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:19.470799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":192,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029128+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:22:21.029128+0000","last_peered":"2024-09-17T05:22:21.029128+0000","last_clean":"2024-09-17T05:22:21.029128+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:22:21.029128+0000","last_undegraded":"2024-09-17T05:22:21.029128+0000","last_fullsized":"2024-09-17T05:22:21.029128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":116,"acting":116,"num_store_stats":7},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":937153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":346261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":339959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":346239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":339981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":843776,"data_stored":347781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":342097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32544,"kb_used_data":1356,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339296,"statfs":{"total":96636764160,"available":96603439104,"internally_reserved":0,"allocated":1388544,"data_stored":917187,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:PG 11.33 is not active+clean 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:18.404765+0000', 'last_change': '2024-09-17T05:22:18.404765+0000', 'last_active': '2024-09-17T05:22:18.404765+0000', 'last_peered': '2024-09-17T05:22:18.404765+0000', 'last_clean': '2024-09-17T05:22:18.404765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.404765+0000', 'last_undegraded': '2024-09-17T05:22:18.404765+0000', 'last_fullsized': '2024-09-17T05:22:18.404765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:PG 11.31 is not active+clean 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:18.404765+0000', 'last_change': '2024-09-17T05:22:18.404765+0000', 'last_active': '2024-09-17T05:22:18.404765+0000', 'last_peered': '2024-09-17T05:22:18.404765+0000', 'last_clean': '2024-09-17T05:22:18.404765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.404765+0000', 'last_undegraded': '2024-09-17T05:22:18.404765+0000', 'last_fullsized': '2024-09-17T05:22:18.404765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:PG 11.2c is not active+clean 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:18.404765+0000', 'last_change': '2024-09-17T05:22:18.404765+0000', 'last_active': '2024-09-17T05:22:18.404765+0000', 'last_peered': '2024-09-17T05:22:18.404765+0000', 'last_clean': '2024-09-17T05:22:18.404765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.404765+0000', 'last_undegraded': '2024-09-17T05:22:18.404765+0000', 'last_fullsized': '2024-09-17T05:22:18.404765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:PG 10.1e is not active+clean 2024-09-17T05:22:23.078 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 67, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:22:18.421267+0000', 'last_change': '2024-09-17T05:22:18.421267+0000', 'last_active': '2024-09-17T05:22:17.402832+0000', 'last_peered': '2024-09-17T05:22:17.402832+0000', 'last_clean': '2024-09-17T05:22:17.402832+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.421267+0000', 'last_undegraded': '2024-09-17T05:22:18.421267+0000', 'last_fullsized': '2024-09-17T05:22:18.421267+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:PG 11.19 is not active+clean 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:18.404765+0000', 'last_change': '2024-09-17T05:22:18.404765+0000', 'last_active': '2024-09-17T05:22:18.404765+0000', 'last_peered': '2024-09-17T05:22:18.404765+0000', 'last_clean': '2024-09-17T05:22:18.404765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.404765+0000', 'last_undegraded': '2024-09-17T05:22:18.404765+0000', 'last_fullsized': '2024-09-17T05:22:18.404765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:PG 11.10 is not active+clean 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:18.404765+0000', 'last_change': '2024-09-17T05:22:18.404765+0000', 'last_active': '2024-09-17T05:22:18.404765+0000', 'last_peered': '2024-09-17T05:22:18.404765+0000', 'last_clean': '2024-09-17T05:22:18.404765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.404765+0000', 'last_undegraded': '2024-09-17T05:22:18.404765+0000', 'last_fullsized': '2024-09-17T05:22:18.404765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:PG 10.8 is not active+clean 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 67, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:22:18.421131+0000', 'last_change': '2024-09-17T05:22:18.421131+0000', 'last_active': '2024-09-17T05:22:17.402832+0000', 'last_peered': '2024-09-17T05:22:17.402832+0000', 'last_clean': '2024-09-17T05:22:17.402832+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.421131+0000', 'last_undegraded': '2024-09-17T05:22:18.421131+0000', 'last_fullsized': '2024-09-17T05:22:18.421131+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': ['0', '2'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:PG 11.6 is not active+clean 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:22:18.404765+0000', 'last_change': '2024-09-17T05:22:18.404765+0000', 'last_active': '2024-09-17T05:22:18.404765+0000', 'last_peered': '2024-09-17T05:22:18.404765+0000', 'last_clean': '2024-09-17T05:22:18.404765+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.404765+0000', 'last_undegraded': '2024-09-17T05:22:18.404765+0000', 'last_fullsized': '2024-09-17T05:22:18.404765+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:18.404765+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:PG 10.4 is not active+clean 2024-09-17T05:22:23.079 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 3, 'reported_epoch': 67, 'state': 'creating+activating', 'last_fresh': '2024-09-17T05:22:18.421339+0000', 'last_change': '2024-09-17T05:22:18.421339+0000', 'last_active': '2024-09-17T05:22:17.402832+0000', 'last_peered': '2024-09-17T05:22:17.402832+0000', 'last_clean': '2024-09-17T05:22:17.402832+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:22:18.421339+0000', 'last_undegraded': '2024-09-17T05:22:18.421339+0000', 'last_fullsized': '2024-09-17T05:22:18.421339+0000', 'mapping_epoch': 66, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 66, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'last_clean_scrub_stamp': '2024-09-17T05:22:17.402832+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': ['0', '4'], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:22:23.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:22:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 -- 172.21.15.81:0/2922730882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1201551b0 msgr2=0x7fa1200704d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 --2- 172.21.15.81:0/2922730882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1201551b0 0x7fa1200704d0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fa110009820 tx=0x7fa11002a510 comp rx=0 tx=0).stop 2024-09-17T05:22:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 -- 172.21.15.81:0/2922730882 shutdown_connections 2024-09-17T05:22:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 --2- 172.21.15.81:0/2922730882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12015f020 0x7fa1200b3640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 --2- 172.21.15.81:0/2922730882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1201551b0 0x7fa1200704d0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 -- 172.21.15.81:0/2922730882 >> 172.21.15.81:0/2922730882 conn(0x7fa12006cf60 msgr2=0x7fa12006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 -- 172.21.15.81:0/2922730882 shutdown_connections 2024-09-17T05:22:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.213+0000 7fa12508c640 1 -- 172.21.15.81:0/2922730882 wait complete. 2024-09-17T05:22:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.214+0000 7fa12508c640 1 Processor -- start 2024-09-17T05:22:23.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.214+0000 7fa12508c640 1 -- start start 2024-09-17T05:22:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa12508c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1200736b0 0x7fa120149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa12508c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1201551b0 0x7fa1201f3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa12508c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12015f020 0x7fa1201f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa12508c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa120073ef0 con 0x7fa1201551b0 2024-09-17T05:22:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa12508c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa120073d70 con 0x7fa1200736b0 2024-09-17T05:22:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa12508c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa120149c80 con 0x7fa12015f020 2024-09-17T05:22:23.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1201551b0 0x7fa1201f3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1201551b0 0x7fa1201f3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47408/0 (socket says 172.21.15.81:47408) 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 -- 172.21.15.81:0/3255945297 learned_addr learned my addr 172.21.15.81:0/3255945297 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa11ed9d640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1200736b0 0x7fa120149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa11f59e640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12015f020 0x7fa1201f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 -- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12015f020 msgr2=0x7fa1201f6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12015f020 0x7fa1201f6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 -- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1200736b0 msgr2=0x7fa120149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1200736b0 0x7fa120149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.215+0000 7fa117fff640 1 -- 172.21.15.81:0/3255945297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1201f2d00 con 0x7fa1201551b0 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.216+0000 7fa117fff640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1201551b0 0x7fa1201f3750 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e9f0 tx=0x7fa10800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.216+0000 7fa1177fe640 1 -- 172.21.15.81:0/3255945297 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa10800cd80 con 0x7fa1201551b0 2024-09-17T05:22:23.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.216+0000 7fa1177fe640 1 -- 172.21.15.81:0/3255945297 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa108010430 con 0x7fa1201551b0 2024-09-17T05:22:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.216+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1201f2f70 con 0x7fa1201551b0 2024-09-17T05:22:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.216+0000 7fa1177fe640 1 -- 172.21.15.81:0/3255945297 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa108010860 con 0x7fa1201551b0 2024-09-17T05:22:23.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.216+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1201f70a0 con 0x7fa1201551b0 2024-09-17T05:22:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.217+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1201f72a0 con 0x7fa1201551b0 2024-09-17T05:22:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.218+0000 7fa1177fe640 1 -- 172.21.15.81:0/3255945297 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fa108009400 con 0x7fa1201551b0 2024-09-17T05:22:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.218+0000 7fa1177fe640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078ef0 0x7fa10007b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.218+0000 7fa1177fe640 1 -- 172.21.15.81:0/3255945297 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fa10809bda0 con 0x7fa1201551b0 2024-09-17T05:22:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.218+0000 7fa11ed9d640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078ef0 0x7fa10007b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.219+0000 7fa11ed9d640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078ef0 0x7fa10007b3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa110034000 tx=0x7fa110004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:23.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.222+0000 7fa1177fe640 1 -- 172.21.15.81:0/3255945297 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa108063700 con 0x7fa1201551b0 2024-09-17T05:22:23.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.467+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7fa12015ba30 con 0x7fa1201551b0 2024-09-17T05:22:23.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.468+0000 7fa1177fe640 1 -- 172.21.15.81:0/3255945297 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1055 (secure 0 0 0) 0x7fa108068130 con 0x7fa1201551b0 2024-09-17T05:22:23.469 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:23.469 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":240,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":69,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550316,"num_in_osds":8,"osd_in_since":1726550306,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"active+clean","count":97}],"num_pgs":97,"num_pools":3,"num_objects":24,"data_bytes":592778,"bytes_used":237817856,"bytes_avail":772856295424,"bytes_total":773094113280,"write_bytes_sec":2388,"read_op_per_sec":0,"write_op_per_sec":7},"fsmap":{"epoch":39,"btime":"2024-09-17T05:22:21:431616+0000","id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"c","status":"up:active","gid":6183}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2024-09-17T05:21:09.408358+0000","services":{}},"progress_events":{}} 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078ef0 msgr2=0x7fa10007b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078ef0 0x7fa10007b3b0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fa110034000 tx=0x7fa110004730 comp rx=0 tx=0).stop 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1201551b0 msgr2=0x7fa1201f3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1201551b0 0x7fa1201f3750 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7fa10800e9f0 tx=0x7fa10800edf0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 shutdown_connections 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa100078ef0 0x7fa10007b3b0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa12015f020 0x7fa1201f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1201551b0 0x7fa1201f3750 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 --2- 172.21.15.81:0/3255945297 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1200736b0 0x7fa120149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 >> 172.21.15.81:0/3255945297 conn(0x7fa12006cf60 msgr2=0x7fa12015d8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 shutdown_connections 2024-09-17T05:22:23.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.470+0000 7fa12508c640 1 -- 172.21.15.81:0/3255945297 wait complete. 2024-09-17T05:22:23.482 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:22:23.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.582+0000 7fbdc0132640 1 -- 172.21.15.81:0/2438250958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 msgr2=0x7fbda40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.582+0000 7fbdc0132640 1 --2- 172.21.15.81:0/2438250958 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 0x7fbda40051c0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7fbdb0006fd0 tx=0x7fbda4005830 comp rx=0 tx=0).stop 2024-09-17T05:22:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.582+0000 7fbdbe6cf640 1 -- 172.21.15.81:0/2438250958 reap_dead start 2024-09-17T05:22:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.582+0000 7fbdc0132640 1 -- 172.21.15.81:0/2438250958 shutdown_connections 2024-09-17T05:22:23.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.582+0000 7fbdc0132640 1 -- 172.21.15.81:0/2438250958 >> 172.21.15.81:0/2438250958 conn(0x7fbdb80741f0 msgr2=0x7fbdb8074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.582+0000 7fbdc0132640 1 -- 172.21.15.81:0/2438250958 shutdown_connections 2024-09-17T05:22:23.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.582+0000 7fbdc0132640 1 -- 172.21.15.81:0/2438250958 wait complete. 2024-09-17T05:22:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.583+0000 7fbdc0132640 1 Processor -- start 2024-09-17T05:22:23.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdc0132640 1 -- start start 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdc0132640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 0x7fbdb815b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdc0132640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdb814f260 0x7fbdb80b5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdc0132640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdb815a030 0x7fbdb8157ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdc0132640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80cf5e0 con 0x7fbda4004d40 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdc0132640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbdb80cf460 con 0x7fbdb814f260 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdc0132640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbdb80d0f40 con 0x7fbdb815a030 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdbdece640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 0x7fbdb815b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdbdece640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 0x7fbdb815b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47438/0 (socket says 172.21.15.81:47438) 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.584+0000 7fbdbdece640 1 -- 172.21.15.81:0/431059645 learned_addr learned my addr 172.21.15.81:0/431059645 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:23.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdbd6cd640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdb814f260 0x7fbdb80b5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdbdece640 1 -- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdb815a030 msgr2=0x7fbdb8157ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdbdece640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdb815a030 0x7fbdb8157ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdbdece640 1 -- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdb814f260 msgr2=0x7fbdb80b5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdbdece640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdb814f260 0x7fbdb80b5ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdbdece640 1 -- 172.21.15.81:0/431059645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbdb815bce0 con 0x7fbda4004d40 2024-09-17T05:22:23.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdbdece640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 0x7fbdb815b210 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400fa60 tx=0x7fbdb400ff20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdae7fc640 1 -- 172.21.15.81:0/431059645 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb4015070 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdae7fc640 1 -- 172.21.15.81:0/431059645 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbdb400b820 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbdb815bf50 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdae7fc640 1 -- 172.21.15.81:0/431059645 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbdb400bc50 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.585+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbdb815c510 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.586+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbdb8068cd0 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.587+0000 7fbdae7fc640 1 -- 172.21.15.81:0/431059645 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fbdb40035f0 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.587+0000 7fbdae7fc640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbd9c078f20 0x7fbd9c07b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.588+0000 7fbdae7fc640 1 -- 172.21.15.81:0/431059645 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fbdb409bee0 con 0x7fbda4004d40 2024-09-17T05:22:23.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.588+0000 7fbdbd6cd640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbd9c078f20 0x7fbd9c07b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.588+0000 7fbdbd6cd640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbd9c078f20 0x7fbd9c07b3e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80705a0 tx=0x7fbda800e420 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:23.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.592+0000 7fbdae7fc640 1 -- 172.21.15.81:0/431059645 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbdb4063ea0 con 0x7fbda4004d40 2024-09-17T05:22:23.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.765+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbdb80747a0 con 0x7fbd9c078f20 2024-09-17T05:22:23.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.769+0000 7fbdae7fc640 1 -- 172.21.15.81:0/431059645 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252056 (secure 0 0 0) 0x7fbdb80747a0 con 0x7fbd9c078f20 2024-09-17T05:22:23.773 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:23.774 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:22:23.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.772+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbd9c078f20 msgr2=0x7fbd9c07b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.772+0000 7fbdc0132640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbd9c078f20 0x7fbd9c07b3e0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7fbdb80705a0 tx=0x7fbda800e420 comp rx=0 tx=0).stop 2024-09-17T05:22:23.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.772+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 msgr2=0x7fbdb815b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:23.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.772+0000 7fbdc0132640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 0x7fbdb815b210 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fbdb400fa60 tx=0x7fbdb400ff20 comp rx=0 tx=0).stop 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 shutdown_connections 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fbd9c078f20 0x7fbd9c07b3e0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbdb815a030 0x7fbdb8157ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbdb814f260 0x7fbdb80b5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 --2- 172.21.15.81:0/431059645 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbda4004d40 0x7fbdb815b210 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 >> 172.21.15.81:0/431059645 conn(0x7fbdb80741f0 msgr2=0x7fbdb80cf790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 shutdown_connections 2024-09-17T05:22:23.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:23.773+0000 7fbdc0132640 1 -- 172.21.15.81:0/431059645 wait complete. 2024-09-17T05:22:23.785 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":177,"stamp":"2024-09-17T05:22:23.426797+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232244,"kb_used_data":7684,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742476,"statfs":{"total":773094113280,"available":772856295424,"internally_reserved":0,"allocated":7868416,"data_stored":3936008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001655"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029833+0000","last_change":"2024-09-17T05:22:19.438662+0000","last_active":"2024-09-17T05:22:21.029833+0000","last_peered":"2024-09-17T05:22:21.029833+0000","last_clean":"2024-09-17T05:22:21.029833+0000","last_became_active":"2024-09-17T05:22:19.438390+0000","last_became_peered":"2024-09-17T05:22:19.438390+0000","last_unstale":"2024-09-17T05:22:21.029833+0000","last_undegraded":"2024-09-17T05:22:21.029833+0000","last_fullsized":"2024-09-17T05:22:21.029833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:05.760603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436833+0000","last_change":"2024-09-17T05:22:19.428772+0000","last_active":"2024-09-17T05:22:20.436833+0000","last_peered":"2024-09-17T05:22:20.436833+0000","last_clean":"2024-09-17T05:22:20.436833+0000","last_became_active":"2024-09-17T05:22:19.427862+0000","last_became_peered":"2024-09-17T05:22:19.427862+0000","last_unstale":"2024-09-17T05:22:20.436833+0000","last_undegraded":"2024-09-17T05:22:20.436833+0000","last_fullsized":"2024-09-17T05:22:20.436833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295130+0000","last_change":"2024-09-17T05:22:19.434335+0000","last_active":"2024-09-17T05:22:21.295130+0000","last_peered":"2024-09-17T05:22:21.295130+0000","last_clean":"2024-09-17T05:22:21.295130+0000","last_became_active":"2024-09-17T05:22:19.434058+0000","last_became_peered":"2024-09-17T05:22:19.434058+0000","last_unstale":"2024-09-17T05:22:21.295130+0000","last_undegraded":"2024-09-17T05:22:21.295130+0000","last_fullsized":"2024-09-17T05:22:21.295130+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:29.970938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295867+0000","last_change":"2024-09-17T05:22:19.445535+0000","last_active":"2024-09-17T05:22:21.295867+0000","last_peered":"2024-09-17T05:22:21.295867+0000","last_clean":"2024-09-17T05:22:21.295867+0000","last_became_active":"2024-09-17T05:22:19.444870+0000","last_became_peered":"2024-09-17T05:22:19.444870+0000","last_unstale":"2024-09-17T05:22:21.295867+0000","last_undegraded":"2024-09-17T05:22:21.295867+0000","last_fullsized":"2024-09-17T05:22:21.295867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:36.729817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433254+0000","last_change":"2024-09-17T05:22:19.438404+0000","last_active":"2024-09-17T05:22:20.433254+0000","last_peered":"2024-09-17T05:22:20.433254+0000","last_clean":"2024-09-17T05:22:20.433254+0000","last_became_active":"2024-09-17T05:22:19.438134+0000","last_became_peered":"2024-09-17T05:22:19.438134+0000","last_unstale":"2024-09-17T05:22:20.433254+0000","last_undegraded":"2024-09-17T05:22:20.433254+0000","last_fullsized":"2024-09-17T05:22:20.433254+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:41.699191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436163+0000","last_change":"2024-09-17T05:22:19.426534+0000","last_active":"2024-09-17T05:22:20.436163+0000","last_peered":"2024-09-17T05:22:20.436163+0000","last_clean":"2024-09-17T05:22:20.436163+0000","last_became_active":"2024-09-17T05:22:19.426215+0000","last_became_peered":"2024-09-17T05:22:19.426215+0000","last_unstale":"2024-09-17T05:22:20.436163+0000","last_undegraded":"2024-09-17T05:22:20.436163+0000","last_fullsized":"2024-09-17T05:22:20.436163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:22.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007121+0000","last_change":"2024-09-17T05:22:19.440259+0000","last_active":"2024-09-17T05:22:21.007121+0000","last_peered":"2024-09-17T05:22:21.007121+0000","last_clean":"2024-09-17T05:22:21.007121+0000","last_became_active":"2024-09-17T05:22:19.439993+0000","last_became_peered":"2024-09-17T05:22:19.439993+0000","last_unstale":"2024-09-17T05:22:21.007121+0000","last_undegraded":"2024-09-17T05:22:21.007121+0000","last_fullsized":"2024-09-17T05:22:21.007121+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.223827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436770+0000","last_change":"2024-09-17T05:22:19.437945+0000","last_active":"2024-09-17T05:22:20.436770+0000","last_peered":"2024-09-17T05:22:20.436770+0000","last_clean":"2024-09-17T05:22:20.436770+0000","last_became_active":"2024-09-17T05:22:19.437670+0000","last_became_peered":"2024-09-17T05:22:19.437670+0000","last_unstale":"2024-09-17T05:22:20.436770+0000","last_undegraded":"2024-09-17T05:22:20.436770+0000","last_fullsized":"2024-09-17T05:22:20.436770+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:26.423565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433544+0000","last_change":"2024-09-17T05:22:19.430604+0000","last_active":"2024-09-17T05:22:20.433544+0000","last_peered":"2024-09-17T05:22:20.433544+0000","last_clean":"2024-09-17T05:22:20.433544+0000","last_became_active":"2024-09-17T05:22:19.430136+0000","last_became_peered":"2024-09-17T05:22:19.430136+0000","last_unstale":"2024-09-17T05:22:20.433544+0000","last_undegraded":"2024-09-17T05:22:20.433544+0000","last_fullsized":"2024-09-17T05:22:20.433544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:15.751408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435427+0000","last_change":"2024-09-17T05:22:19.427898+0000","last_active":"2024-09-17T05:22:20.435427+0000","last_peered":"2024-09-17T05:22:20.435427+0000","last_clean":"2024-09-17T05:22:20.435427+0000","last_became_active":"2024-09-17T05:22:19.427591+0000","last_became_peered":"2024-09-17T05:22:19.427591+0000","last_unstale":"2024-09-17T05:22:20.435427+0000","last_undegraded":"2024-09-17T05:22:20.435427+0000","last_fullsized":"2024-09-17T05:22:20.435427+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:01.861609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029667+0000","last_change":"2024-09-17T05:22:19.442877+0000","last_active":"2024-09-17T05:22:21.029667+0000","last_peered":"2024-09-17T05:22:21.029667+0000","last_clean":"2024-09-17T05:22:21.029667+0000","last_became_active":"2024-09-17T05:22:19.442514+0000","last_became_peered":"2024-09-17T05:22:19.442514+0000","last_unstale":"2024-09-17T05:22:21.029667+0000","last_undegraded":"2024-09-17T05:22:21.029667+0000","last_fullsized":"2024-09-17T05:22:21.029667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:45.208300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296004+0000","last_change":"2024-09-17T05:22:19.447642+0000","last_active":"2024-09-17T05:22:21.296004+0000","last_peered":"2024-09-17T05:22:21.296004+0000","last_clean":"2024-09-17T05:22:21.296004+0000","last_became_active":"2024-09-17T05:22:19.447297+0000","last_became_peered":"2024-09-17T05:22:19.447297+0000","last_unstale":"2024-09-17T05:22:21.296004+0000","last_undegraded":"2024-09-17T05:22:21.296004+0000","last_fullsized":"2024-09-17T05:22:21.296004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:48.971688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295216+0000","last_change":"2024-09-17T05:22:19.442039+0000","last_active":"2024-09-17T05:22:21.295216+0000","last_peered":"2024-09-17T05:22:21.295216+0000","last_clean":"2024-09-17T05:22:21.295216+0000","last_became_active":"2024-09-17T05:22:19.441775+0000","last_became_peered":"2024-09-17T05:22:19.441775+0000","last_unstale":"2024-09-17T05:22:21.295216+0000","last_undegraded":"2024-09-17T05:22:21.295216+0000","last_fullsized":"2024-09-17T05:22:21.295216+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:24.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433151+0000","last_change":"2024-09-17T05:22:19.436649+0000","last_active":"2024-09-17T05:22:20.433151+0000","last_peered":"2024-09-17T05:22:20.433151+0000","last_clean":"2024-09-17T05:22:20.433151+0000","last_became_active":"2024-09-17T05:22:19.436379+0000","last_became_peered":"2024-09-17T05:22:19.436379+0000","last_unstale":"2024-09-17T05:22:20.433151+0000","last_undegraded":"2024-09-17T05:22:20.433151+0000","last_fullsized":"2024-09-17T05:22:20.433151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:44.750380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295723+0000","last_change":"2024-09-17T05:22:19.443458+0000","last_active":"2024-09-17T05:22:21.295723+0000","last_peered":"2024-09-17T05:22:21.295723+0000","last_clean":"2024-09-17T05:22:21.295723+0000","last_became_active":"2024-09-17T05:22:19.443180+0000","last_became_peered":"2024-09-17T05:22:19.443180+0000","last_unstale":"2024-09-17T05:22:21.295723+0000","last_undegraded":"2024-09-17T05:22:21.295723+0000","last_fullsized":"2024-09-17T05:22:21.295723+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:10.223222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434649+0000","last_change":"2024-09-17T05:22:19.433093+0000","last_active":"2024-09-17T05:22:20.434649+0000","last_peered":"2024-09-17T05:22:20.434649+0000","last_clean":"2024-09-17T05:22:20.434649+0000","last_became_active":"2024-09-17T05:22:19.432601+0000","last_became_peered":"2024-09-17T05:22:19.432601+0000","last_unstale":"2024-09-17T05:22:20.434649+0000","last_undegraded":"2024-09-17T05:22:20.434649+0000","last_fullsized":"2024-09-17T05:22:20.434649+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433524+0000","last_change":"2024-09-17T05:22:19.427959+0000","last_active":"2024-09-17T05:22:20.433524+0000","last_peered":"2024-09-17T05:22:20.433524+0000","last_clean":"2024-09-17T05:22:20.433524+0000","last_became_active":"2024-09-17T05:22:19.427723+0000","last_became_peered":"2024-09-17T05:22:19.427723+0000","last_unstale":"2024-09-17T05:22:20.433524+0000","last_undegraded":"2024-09-17T05:22:20.433524+0000","last_fullsized":"2024-09-17T05:22:20.433524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:37.815920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295801+0000","last_change":"2024-09-17T05:22:19.445081+0000","last_active":"2024-09-17T05:22:21.295801+0000","last_peered":"2024-09-17T05:22:21.295801+0000","last_clean":"2024-09-17T05:22:21.295801+0000","last_became_active":"2024-09-17T05:22:19.444827+0000","last_became_peered":"2024-09-17T05:22:19.444827+0000","last_unstale":"2024-09-17T05:22:21.295801+0000","last_undegraded":"2024-09-17T05:22:21.295801+0000","last_fullsized":"2024-09-17T05:22:21.295801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:37.186334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436123+0000","last_change":"2024-09-17T05:22:19.438688+0000","last_active":"2024-09-17T05:22:20.436123+0000","last_peered":"2024-09-17T05:22:20.436123+0000","last_clean":"2024-09-17T05:22:20.436123+0000","last_became_active":"2024-09-17T05:22:19.438382+0000","last_became_peered":"2024-09-17T05:22:19.438382+0000","last_unstale":"2024-09-17T05:22:20.436123+0000","last_undegraded":"2024-09-17T05:22:20.436123+0000","last_fullsized":"2024-09-17T05:22:20.436123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:32.110192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295300+0000","last_change":"2024-09-17T05:22:19.439143+0000","last_active":"2024-09-17T05:22:21.295300+0000","last_peered":"2024-09-17T05:22:21.295300+0000","last_clean":"2024-09-17T05:22:21.295300+0000","last_became_active":"2024-09-17T05:22:19.438852+0000","last_became_peered":"2024-09-17T05:22:19.438852+0000","last_unstale":"2024-09-17T05:22:21.295300+0000","last_undegraded":"2024-09-17T05:22:21.295300+0000","last_fullsized":"2024-09-17T05:22:21.295300+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:03.928065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434924+0000","last_change":"2024-09-17T05:22:19.430871+0000","last_active":"2024-09-17T05:22:20.434924+0000","last_peered":"2024-09-17T05:22:20.434924+0000","last_clean":"2024-09-17T05:22:20.434924+0000","last_became_active":"2024-09-17T05:22:19.430608+0000","last_became_peered":"2024-09-17T05:22:19.430608+0000","last_unstale":"2024-09-17T05:22:20.434924+0000","last_undegraded":"2024-09-17T05:22:20.434924+0000","last_fullsized":"2024-09-17T05:22:20.434924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434847+0000","last_change":"2024-09-17T05:22:19.422392+0000","last_active":"2024-09-17T05:22:20.434847+0000","last_peered":"2024-09-17T05:22:20.434847+0000","last_clean":"2024-09-17T05:22:20.434847+0000","last_became_active":"2024-09-17T05:22:19.421987+0000","last_became_peered":"2024-09-17T05:22:19.421987+0000","last_unstale":"2024-09-17T05:22:20.434847+0000","last_undegraded":"2024-09-17T05:22:20.434847+0000","last_fullsized":"2024-09-17T05:22:20.434847+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:08.730503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029409+0000","last_change":"2024-09-17T05:22:19.435845+0000","last_active":"2024-09-17T05:22:21.029409+0000","last_peered":"2024-09-17T05:22:21.029409+0000","last_clean":"2024-09-17T05:22:21.029409+0000","last_became_active":"2024-09-17T05:22:19.435535+0000","last_became_peered":"2024-09-17T05:22:19.435535+0000","last_unstale":"2024-09-17T05:22:21.029409+0000","last_undegraded":"2024-09-17T05:22:21.029409+0000","last_fullsized":"2024-09-17T05:22:21.029409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:17.679119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029229+0000","last_change":"2024-09-17T05:22:19.438687+0000","last_active":"2024-09-17T05:22:21.029229+0000","last_peered":"2024-09-17T05:22:21.029229+0000","last_clean":"2024-09-17T05:22:21.029229+0000","last_became_active":"2024-09-17T05:22:19.438347+0000","last_became_peered":"2024-09-17T05:22:19.438347+0000","last_unstale":"2024-09-17T05:22:21.029229+0000","last_undegraded":"2024-09-17T05:22:21.029229+0000","last_fullsized":"2024-09-17T05:22:21.029229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435155+0000","last_change":"2024-09-17T05:22:19.436133+0000","last_active":"2024-09-17T05:22:20.435155+0000","last_peered":"2024-09-17T05:22:20.435155+0000","last_clean":"2024-09-17T05:22:20.435155+0000","last_became_active":"2024-09-17T05:22:19.434918+0000","last_became_peered":"2024-09-17T05:22:19.434918+0000","last_unstale":"2024-09-17T05:22:20.435155+0000","last_undegraded":"2024-09-17T05:22:20.435155+0000","last_fullsized":"2024-09-17T05:22:20.435155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:33.154454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007447+0000","last_change":"2024-09-17T05:22:19.434518+0000","last_active":"2024-09-17T05:22:21.007447+0000","last_peered":"2024-09-17T05:22:21.007447+0000","last_clean":"2024-09-17T05:22:21.007447+0000","last_became_active":"2024-09-17T05:22:19.434257+0000","last_became_peered":"2024-09-17T05:22:19.434257+0000","last_unstale":"2024-09-17T05:22:21.007447+0000","last_undegraded":"2024-09-17T05:22:21.007447+0000","last_fullsized":"2024-09-17T05:22:21.007447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:14.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295312+0000","last_change":"2024-09-17T05:22:19.440746+0000","last_active":"2024-09-17T05:22:21.295312+0000","last_peered":"2024-09-17T05:22:21.295312+0000","last_clean":"2024-09-17T05:22:21.295312+0000","last_became_active":"2024-09-17T05:22:19.440478+0000","last_became_peered":"2024-09-17T05:22:19.440478+0000","last_unstale":"2024-09-17T05:22:21.295312+0000","last_undegraded":"2024-09-17T05:22:21.295312+0000","last_fullsized":"2024-09-17T05:22:21.295312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:39.556732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435163+0000","last_change":"2024-09-17T05:22:19.423204+0000","last_active":"2024-09-17T05:22:20.435163+0000","last_peered":"2024-09-17T05:22:20.435163+0000","last_clean":"2024-09-17T05:22:20.435163+0000","last_became_active":"2024-09-17T05:22:19.422837+0000","last_became_peered":"2024-09-17T05:22:19.422837+0000","last_unstale":"2024-09-17T05:22:20.435163+0000","last_undegraded":"2024-09-17T05:22:20.435163+0000","last_fullsized":"2024-09-17T05:22:20.435163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:48.167633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295557+0000","last_change":"2024-09-17T05:22:19.436288+0000","last_active":"2024-09-17T05:22:21.295557+0000","last_peered":"2024-09-17T05:22:21.295557+0000","last_clean":"2024-09-17T05:22:21.295557+0000","last_became_active":"2024-09-17T05:22:19.435852+0000","last_became_peered":"2024-09-17T05:22:19.435852+0000","last_unstale":"2024-09-17T05:22:21.295557+0000","last_undegraded":"2024-09-17T05:22:21.295557+0000","last_fullsized":"2024-09-17T05:22:21.295557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:19.404495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007353+0000","last_change":"2024-09-17T05:22:19.435208+0000","last_active":"2024-09-17T05:22:21.007353+0000","last_peered":"2024-09-17T05:22:21.007353+0000","last_clean":"2024-09-17T05:22:21.007353+0000","last_became_active":"2024-09-17T05:22:19.434972+0000","last_became_peered":"2024-09-17T05:22:19.434972+0000","last_unstale":"2024-09-17T05:22:21.007353+0000","last_undegraded":"2024-09-17T05:22:21.007353+0000","last_fullsized":"2024-09-17T05:22:21.007353+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:44.946507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007493+0000","last_change":"2024-09-17T05:22:19.436850+0000","last_active":"2024-09-17T05:22:21.007493+0000","last_peered":"2024-09-17T05:22:21.007493+0000","last_clean":"2024-09-17T05:22:21.007493+0000","last_became_active":"2024-09-17T05:22:19.436593+0000","last_became_peered":"2024-09-17T05:22:19.436593+0000","last_unstale":"2024-09-17T05:22:21.007493+0000","last_undegraded":"2024-09-17T05:22:21.007493+0000","last_fullsized":"2024-09-17T05:22:21.007493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:04.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.430122+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.429844+0000","last_became_peered":"2024-09-17T05:22:19.429844+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:31.556861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029745+0000","last_change":"2024-09-17T05:22:19.439394+0000","last_active":"2024-09-17T05:22:21.029745+0000","last_peered":"2024-09-17T05:22:21.029745+0000","last_clean":"2024-09-17T05:22:21.029745+0000","last_became_active":"2024-09-17T05:22:19.437506+0000","last_became_peered":"2024-09-17T05:22:19.437506+0000","last_unstale":"2024-09-17T05:22:21.029745+0000","last_undegraded":"2024-09-17T05:22:21.029745+0000","last_fullsized":"2024-09-17T05:22:21.029745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.824838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029965+0000","last_change":"2024-09-17T05:22:18.429837+0000","last_active":"2024-09-17T05:22:21.029965+0000","last_peered":"2024-09-17T05:22:21.029965+0000","last_clean":"2024-09-17T05:22:21.029965+0000","last_became_active":"2024-09-17T05:22:18.429576+0000","last_became_peered":"2024-09-17T05:22:18.429576+0000","last_unstale":"2024-09-17T05:22:21.029965+0000","last_undegraded":"2024-09-17T05:22:21.029965+0000","last_fullsized":"2024-09-17T05:22:21.029965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:33.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433624+0000","last_change":"2024-09-17T05:22:19.430787+0000","last_active":"2024-09-17T05:22:20.433624+0000","last_peered":"2024-09-17T05:22:20.433624+0000","last_clean":"2024-09-17T05:22:20.433624+0000","last_became_active":"2024-09-17T05:22:19.430454+0000","last_became_peered":"2024-09-17T05:22:19.430454+0000","last_unstale":"2024-09-17T05:22:20.433624+0000","last_undegraded":"2024-09-17T05:22:20.433624+0000","last_fullsized":"2024-09-17T05:22:20.433624+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:01.979709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295480+0000","last_change":"2024-09-17T05:22:18.432849+0000","last_active":"2024-09-17T05:22:21.295480+0000","last_peered":"2024-09-17T05:22:21.295480+0000","last_clean":"2024-09-17T05:22:21.295480+0000","last_became_active":"2024-09-17T05:22:18.432567+0000","last_became_peered":"2024-09-17T05:22:18.432567+0000","last_unstale":"2024-09-17T05:22:21.295480+0000","last_undegraded":"2024-09-17T05:22:21.295480+0000","last_fullsized":"2024-09-17T05:22:21.295480+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:41.002862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436839+0000","last_change":"2024-09-17T05:22:19.434321+0000","last_active":"2024-09-17T05:22:20.436839+0000","last_peered":"2024-09-17T05:22:20.436839+0000","last_clean":"2024-09-17T05:22:20.436839+0000","last_became_active":"2024-09-17T05:22:19.433934+0000","last_became_peered":"2024-09-17T05:22:19.433934+0000","last_unstale":"2024-09-17T05:22:20.436839+0000","last_undegraded":"2024-09-17T05:22:20.436839+0000","last_fullsized":"2024-09-17T05:22:20.436839+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:15.805658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435078+0000","last_change":"2024-09-17T05:22:18.428988+0000","last_active":"2024-09-17T05:22:20.435078+0000","last_peered":"2024-09-17T05:22:20.435078+0000","last_clean":"2024-09-17T05:22:20.435078+0000","last_became_active":"2024-09-17T05:22:18.428719+0000","last_became_peered":"2024-09-17T05:22:18.428719+0000","last_unstale":"2024-09-17T05:22:20.435078+0000","last_undegraded":"2024-09-17T05:22:20.435078+0000","last_fullsized":"2024-09-17T05:22:20.435078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.794624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029706+0000","last_change":"2024-09-17T05:22:19.436635+0000","last_active":"2024-09-17T05:22:21.029706+0000","last_peered":"2024-09-17T05:22:21.029706+0000","last_clean":"2024-09-17T05:22:21.029706+0000","last_became_active":"2024-09-17T05:22:19.435951+0000","last_became_peered":"2024-09-17T05:22:19.435951+0000","last_unstale":"2024-09-17T05:22:21.029706+0000","last_undegraded":"2024-09-17T05:22:21.029706+0000","last_fullsized":"2024-09-17T05:22:21.029706+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.075149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436933+0000","last_change":"2024-09-17T05:22:18.427589+0000","last_active":"2024-09-17T05:22:20.436933+0000","last_peered":"2024-09-17T05:22:20.436933+0000","last_clean":"2024-09-17T05:22:20.436933+0000","last_became_active":"2024-09-17T05:22:18.427294+0000","last_became_peered":"2024-09-17T05:22:18.427294+0000","last_unstale":"2024-09-17T05:22:20.436933+0000","last_undegraded":"2024-09-17T05:22:20.436933+0000","last_fullsized":"2024-09-17T05:22:20.436933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:50.823087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007293+0000","last_change":"2024-09-17T05:22:19.438589+0000","last_active":"2024-09-17T05:22:21.007293+0000","last_peered":"2024-09-17T05:22:21.007293+0000","last_clean":"2024-09-17T05:22:21.007293+0000","last_became_active":"2024-09-17T05:22:19.438299+0000","last_became_peered":"2024-09-17T05:22:19.438299+0000","last_unstale":"2024-09-17T05:22:21.007293+0000","last_undegraded":"2024-09-17T05:22:21.007293+0000","last_fullsized":"2024-09-17T05:22:21.007293+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:57.072075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295653+0000","last_change":"2024-09-17T05:22:18.431383+0000","last_active":"2024-09-17T05:22:21.295653+0000","last_peered":"2024-09-17T05:22:21.295653+0000","last_clean":"2024-09-17T05:22:21.295653+0000","last_became_active":"2024-09-17T05:22:18.431115+0000","last_became_peered":"2024-09-17T05:22:18.431115+0000","last_unstale":"2024-09-17T05:22:21.295653+0000","last_undegraded":"2024-09-17T05:22:21.295653+0000","last_fullsized":"2024-09-17T05:22:21.295653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:09.892453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435067+0000","last_change":"2024-09-17T05:22:19.432969+0000","last_active":"2024-09-17T05:22:20.435067+0000","last_peered":"2024-09-17T05:22:20.435067+0000","last_clean":"2024-09-17T05:22:20.435067+0000","last_became_active":"2024-09-17T05:22:19.432466+0000","last_became_peered":"2024-09-17T05:22:19.432466+0000","last_unstale":"2024-09-17T05:22:20.435067+0000","last_undegraded":"2024-09-17T05:22:20.435067+0000","last_fullsized":"2024-09-17T05:22:20.435067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:11.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436110+0000","last_change":"2024-09-17T05:22:18.431419+0000","last_active":"2024-09-17T05:22:20.436110+0000","last_peered":"2024-09-17T05:22:20.436110+0000","last_clean":"2024-09-17T05:22:20.436110+0000","last_became_active":"2024-09-17T05:22:18.430589+0000","last_became_peered":"2024-09-17T05:22:18.430589+0000","last_unstale":"2024-09-17T05:22:20.436110+0000","last_undegraded":"2024-09-17T05:22:20.436110+0000","last_fullsized":"2024-09-17T05:22:20.436110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:39.998483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432851+0000","last_change":"2024-09-17T05:22:19.427627+0000","last_active":"2024-09-17T05:22:20.432851+0000","last_peered":"2024-09-17T05:22:20.432851+0000","last_clean":"2024-09-17T05:22:20.432851+0000","last_became_active":"2024-09-17T05:22:19.427370+0000","last_became_peered":"2024-09-17T05:22:19.427370+0000","last_unstale":"2024-09-17T05:22:20.432851+0000","last_undegraded":"2024-09-17T05:22:20.432851+0000","last_fullsized":"2024-09-17T05:22:20.432851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:36.555054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295310+0000","last_change":"2024-09-17T05:22:18.428001+0000","last_active":"2024-09-17T05:22:21.295310+0000","last_peered":"2024-09-17T05:22:21.295310+0000","last_clean":"2024-09-17T05:22:21.295310+0000","last_became_active":"2024-09-17T05:22:18.427739+0000","last_became_peered":"2024-09-17T05:22:18.427739+0000","last_unstale":"2024-09-17T05:22:21.295310+0000","last_undegraded":"2024-09-17T05:22:21.295310+0000","last_fullsized":"2024-09-17T05:22:21.295310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:10.556798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295791+0000","last_change":"2024-09-17T05:22:19.438341+0000","last_active":"2024-09-17T05:22:21.295791+0000","last_peered":"2024-09-17T05:22:21.295791+0000","last_clean":"2024-09-17T05:22:21.295791+0000","last_became_active":"2024-09-17T05:22:19.438039+0000","last_became_peered":"2024-09-17T05:22:19.438039+0000","last_unstale":"2024-09-17T05:22:21.295791+0000","last_undegraded":"2024-09-17T05:22:21.295791+0000","last_fullsized":"2024-09-17T05:22:21.295791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:57.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432875+0000","last_change":"2024-09-17T05:22:18.423744+0000","last_active":"2024-09-17T05:22:20.432875+0000","last_peered":"2024-09-17T05:22:20.432875+0000","last_clean":"2024-09-17T05:22:20.432875+0000","last_became_active":"2024-09-17T05:22:18.423474+0000","last_became_peered":"2024-09-17T05:22:18.423474+0000","last_unstale":"2024-09-17T05:22:20.432875+0000","last_undegraded":"2024-09-17T05:22:20.432875+0000","last_fullsized":"2024-09-17T05:22:20.432875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:20.141453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007512+0000","last_change":"2024-09-17T05:22:19.443778+0000","last_active":"2024-09-17T05:22:21.007512+0000","last_peered":"2024-09-17T05:22:21.007512+0000","last_clean":"2024-09-17T05:22:21.007512+0000","last_became_active":"2024-09-17T05:22:19.443519+0000","last_became_peered":"2024-09-17T05:22:19.443519+0000","last_unstale":"2024-09-17T05:22:21.007512+0000","last_undegraded":"2024-09-17T05:22:21.007512+0000","last_fullsized":"2024-09-17T05:22:21.007512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435207+0000","last_change":"2024-09-17T05:22:18.427480+0000","last_active":"2024-09-17T05:22:20.435207+0000","last_peered":"2024-09-17T05:22:20.435207+0000","last_clean":"2024-09-17T05:22:20.435207+0000","last_became_active":"2024-09-17T05:22:18.427197+0000","last_became_peered":"2024-09-17T05:22:18.427197+0000","last_unstale":"2024-09-17T05:22:20.435207+0000","last_undegraded":"2024-09-17T05:22:20.435207+0000","last_fullsized":"2024-09-17T05:22:20.435207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:18.433977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029862+0000","last_change":"2024-09-17T05:22:19.437340+0000","last_active":"2024-09-17T05:22:21.029862+0000","last_peered":"2024-09-17T05:22:21.029862+0000","last_clean":"2024-09-17T05:22:21.029862+0000","last_became_active":"2024-09-17T05:22:19.437078+0000","last_became_peered":"2024-09-17T05:22:19.437078+0000","last_unstale":"2024-09-17T05:22:21.029862+0000","last_undegraded":"2024-09-17T05:22:21.029862+0000","last_fullsized":"2024-09-17T05:22:21.029862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:27.525759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436753+0000","last_change":"2024-09-17T05:22:18.434179+0000","last_active":"2024-09-17T05:22:20.436753+0000","last_peered":"2024-09-17T05:22:20.436753+0000","last_clean":"2024-09-17T05:22:20.436753+0000","last_became_active":"2024-09-17T05:22:18.433907+0000","last_became_peered":"2024-09-17T05:22:18.433907+0000","last_unstale":"2024-09-17T05:22:20.436753+0000","last_undegraded":"2024-09-17T05:22:20.436753+0000","last_fullsized":"2024-09-17T05:22:20.436753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:34.301087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436901+0000","last_change":"2024-09-17T05:22:19.431778+0000","last_active":"2024-09-17T05:22:20.436901+0000","last_peered":"2024-09-17T05:22:20.436901+0000","last_clean":"2024-09-17T05:22:20.436901+0000","last_became_active":"2024-09-17T05:22:19.430979+0000","last_became_peered":"2024-09-17T05:22:19.430979+0000","last_unstale":"2024-09-17T05:22:20.436901+0000","last_undegraded":"2024-09-17T05:22:20.436901+0000","last_fullsized":"2024-09-17T05:22:20.436901+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295407+0000","last_change":"2024-09-17T05:22:18.435917+0000","last_active":"2024-09-17T05:22:21.295407+0000","last_peered":"2024-09-17T05:22:21.295407+0000","last_clean":"2024-09-17T05:22:21.295407+0000","last_became_active":"2024-09-17T05:22:18.435593+0000","last_became_peered":"2024-09-17T05:22:18.435593+0000","last_unstale":"2024-09-17T05:22:21.295407+0000","last_undegraded":"2024-09-17T05:22:21.295407+0000","last_fullsized":"2024-09-17T05:22:21.295407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.139854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433175+0000","last_change":"2024-09-17T05:22:19.439603+0000","last_active":"2024-09-17T05:22:20.433175+0000","last_peered":"2024-09-17T05:22:20.433175+0000","last_clean":"2024-09-17T05:22:20.433175+0000","last_became_active":"2024-09-17T05:22:19.439330+0000","last_became_peered":"2024-09-17T05:22:19.439330+0000","last_unstale":"2024-09-17T05:22:20.433175+0000","last_undegraded":"2024-09-17T05:22:20.433175+0000","last_fullsized":"2024-09-17T05:22:20.433175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:11.001407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296073+0000","last_change":"2024-09-17T05:22:18.424114+0000","last_active":"2024-09-17T05:22:21.296073+0000","last_peered":"2024-09-17T05:22:21.296073+0000","last_clean":"2024-09-17T05:22:21.296073+0000","last_became_active":"2024-09-17T05:22:18.423841+0000","last_became_peered":"2024-09-17T05:22:18.423841+0000","last_unstale":"2024-09-17T05:22:21.296073+0000","last_undegraded":"2024-09-17T05:22:21.296073+0000","last_fullsized":"2024-09-17T05:22:21.296073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029395+0000","last_change":"2024-09-17T05:22:19.438635+0000","last_active":"2024-09-17T05:22:21.029395+0000","last_peered":"2024-09-17T05:22:21.029395+0000","last_clean":"2024-09-17T05:22:21.029395+0000","last_became_active":"2024-09-17T05:22:19.438317+0000","last_became_peered":"2024-09-17T05:22:19.438317+0000","last_unstale":"2024-09-17T05:22:21.029395+0000","last_undegraded":"2024-09-17T05:22:21.029395+0000","last_fullsized":"2024-09-17T05:22:21.029395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:16.873928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295623+0000","last_change":"2024-09-17T05:22:18.430649+0000","last_active":"2024-09-17T05:22:21.295623+0000","last_peered":"2024-09-17T05:22:21.295623+0000","last_clean":"2024-09-17T05:22:21.295623+0000","last_became_active":"2024-09-17T05:22:18.430347+0000","last_became_peered":"2024-09-17T05:22:18.430347+0000","last_unstale":"2024-09-17T05:22:21.295623+0000","last_undegraded":"2024-09-17T05:22:21.295623+0000","last_fullsized":"2024-09-17T05:22:21.295623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:35.076714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007332+0000","last_change":"2024-09-17T05:22:19.435957+0000","last_active":"2024-09-17T05:22:21.007332+0000","last_peered":"2024-09-17T05:22:21.007332+0000","last_clean":"2024-09-17T05:22:21.007332+0000","last_became_active":"2024-09-17T05:22:19.435711+0000","last_became_peered":"2024-09-17T05:22:19.435711+0000","last_unstale":"2024-09-17T05:22:21.007332+0000","last_undegraded":"2024-09-17T05:22:21.007332+0000","last_fullsized":"2024-09-17T05:22:21.007332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.631571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436227+0000","last_change":"2024-09-17T05:22:18.432090+0000","last_active":"2024-09-17T05:22:20.436227+0000","last_peered":"2024-09-17T05:22:20.436227+0000","last_clean":"2024-09-17T05:22:20.436227+0000","last_became_active":"2024-09-17T05:22:18.431771+0000","last_became_peered":"2024-09-17T05:22:18.431771+0000","last_unstale":"2024-09-17T05:22:20.436227+0000","last_undegraded":"2024-09-17T05:22:20.436227+0000","last_fullsized":"2024-09-17T05:22:20.436227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:26.966895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294932+0000","last_change":"2024-09-17T05:22:19.443096+0000","last_active":"2024-09-17T05:22:21.294932+0000","last_peered":"2024-09-17T05:22:21.294932+0000","last_clean":"2024-09-17T05:22:21.294932+0000","last_became_active":"2024-09-17T05:22:19.442871+0000","last_became_peered":"2024-09-17T05:22:19.442871+0000","last_unstale":"2024-09-17T05:22:21.294932+0000","last_undegraded":"2024-09-17T05:22:21.294932+0000","last_fullsized":"2024-09-17T05:22:21.294932+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:35.099482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007157+0000","last_change":"2024-09-17T05:22:18.438120+0000","last_active":"2024-09-17T05:22:21.007157+0000","last_peered":"2024-09-17T05:22:21.007157+0000","last_clean":"2024-09-17T05:22:21.007157+0000","last_became_active":"2024-09-17T05:22:18.437867+0000","last_became_peered":"2024-09-17T05:22:18.437867+0000","last_unstale":"2024-09-17T05:22:21.007157+0000","last_undegraded":"2024-09-17T05:22:21.007157+0000","last_fullsized":"2024-09-17T05:22:21.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:25.421633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433049+0000","last_change":"2024-09-17T05:22:19.428773+0000","last_active":"2024-09-17T05:22:20.433049+0000","last_peered":"2024-09-17T05:22:20.433049+0000","last_clean":"2024-09-17T05:22:20.433049+0000","last_became_active":"2024-09-17T05:22:19.427978+0000","last_became_peered":"2024-09-17T05:22:19.427978+0000","last_unstale":"2024-09-17T05:22:20.433049+0000","last_undegraded":"2024-09-17T05:22:20.433049+0000","last_fullsized":"2024-09-17T05:22:20.433049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:01.994688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434550+0000","last_change":"2024-09-17T05:22:18.430819+0000","last_active":"2024-09-17T05:22:20.434550+0000","last_peered":"2024-09-17T05:22:20.434550+0000","last_clean":"2024-09-17T05:22:20.434550+0000","last_became_active":"2024-09-17T05:22:18.430534+0000","last_became_peered":"2024-09-17T05:22:18.430534+0000","last_unstale":"2024-09-17T05:22:20.434550+0000","last_undegraded":"2024-09-17T05:22:20.434550+0000","last_fullsized":"2024-09-17T05:22:20.434550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:23.764199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435617+0000","last_change":"2024-09-17T05:22:19.437170+0000","last_active":"2024-09-17T05:22:20.435617+0000","last_peered":"2024-09-17T05:22:20.435617+0000","last_clean":"2024-09-17T05:22:20.435617+0000","last_became_active":"2024-09-17T05:22:19.436924+0000","last_became_peered":"2024-09-17T05:22:19.436924+0000","last_unstale":"2024-09-17T05:22:20.435617+0000","last_undegraded":"2024-09-17T05:22:20.435617+0000","last_fullsized":"2024-09-17T05:22:20.435617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:25.019162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436440+0000","last_change":"2024-09-17T05:22:18.426844+0000","last_active":"2024-09-17T05:22:20.436440+0000","last_peered":"2024-09-17T05:22:20.436440+0000","last_clean":"2024-09-17T05:22:20.436440+0000","last_became_active":"2024-09-17T05:22:18.426464+0000","last_became_peered":"2024-09-17T05:22:18.426464+0000","last_unstale":"2024-09-17T05:22:20.436440+0000","last_undegraded":"2024-09-17T05:22:20.436440+0000","last_fullsized":"2024-09-17T05:22:20.436440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:42.575528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.030025+0000","last_change":"2024-09-17T05:22:19.445918+0000","last_active":"2024-09-17T05:22:21.030025+0000","last_peered":"2024-09-17T05:22:21.030025+0000","last_clean":"2024-09-17T05:22:21.030025+0000","last_became_active":"2024-09-17T05:22:19.445591+0000","last_became_peered":"2024-09-17T05:22:19.445591+0000","last_unstale":"2024-09-17T05:22:21.030025+0000","last_undegraded":"2024-09-17T05:22:21.030025+0000","last_fullsized":"2024-09-17T05:22:21.030025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:10.894386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435745+0000","last_change":"2024-09-17T05:22:18.428672+0000","last_active":"2024-09-17T05:22:20.435745+0000","last_peered":"2024-09-17T05:22:20.435745+0000","last_clean":"2024-09-17T05:22:20.435745+0000","last_became_active":"2024-09-17T05:22:18.428286+0000","last_became_peered":"2024-09-17T05:22:18.428286+0000","last_unstale":"2024-09-17T05:22:20.435745+0000","last_undegraded":"2024-09-17T05:22:20.435745+0000","last_fullsized":"2024-09-17T05:22:20.435745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:01.168568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296016+0000","last_change":"2024-09-17T05:22:19.445238+0000","last_active":"2024-09-17T05:22:21.296016+0000","last_peered":"2024-09-17T05:22:21.296016+0000","last_clean":"2024-09-17T05:22:21.296016+0000","last_became_active":"2024-09-17T05:22:19.444427+0000","last_became_peered":"2024-09-17T05:22:19.444427+0000","last_unstale":"2024-09-17T05:22:21.296016+0000","last_undegraded":"2024-09-17T05:22:21.296016+0000","last_fullsized":"2024-09-17T05:22:21.296016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:15.940887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436323+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436323+0000","last_peered":"2024-09-17T05:22:20.436323+0000","last_clean":"2024-09-17T05:22:20.436323+0000","last_became_active":"2024-09-17T05:22:18.425366+0000","last_became_peered":"2024-09-17T05:22:18.425366+0000","last_unstale":"2024-09-17T05:22:20.436323+0000","last_undegraded":"2024-09-17T05:22:20.436323+0000","last_fullsized":"2024-09-17T05:22:20.436323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:31.206646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433306+0000","last_change":"2024-09-17T05:22:19.431613+0000","last_active":"2024-09-17T05:22:20.433306+0000","last_peered":"2024-09-17T05:22:20.433306+0000","last_clean":"2024-09-17T05:22:20.433306+0000","last_became_active":"2024-09-17T05:22:19.431303+0000","last_became_peered":"2024-09-17T05:22:19.431303+0000","last_unstale":"2024-09-17T05:22:20.433306+0000","last_undegraded":"2024-09-17T05:22:20.433306+0000","last_fullsized":"2024-09-17T05:22:20.433306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:33.110557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029435+0000","last_change":"2024-09-17T05:22:18.433627+0000","last_active":"2024-09-17T05:22:21.029435+0000","last_peered":"2024-09-17T05:22:21.029435+0000","last_clean":"2024-09-17T05:22:21.029435+0000","last_became_active":"2024-09-17T05:22:18.433349+0000","last_became_peered":"2024-09-17T05:22:18.433349+0000","last_unstale":"2024-09-17T05:22:21.029435+0000","last_undegraded":"2024-09-17T05:22:21.029435+0000","last_fullsized":"2024-09-17T05:22:21.029435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295581+0000","last_change":"2024-09-17T05:22:19.436894+0000","last_active":"2024-09-17T05:22:21.295581+0000","last_peered":"2024-09-17T05:22:21.295581+0000","last_clean":"2024-09-17T05:22:21.295581+0000","last_became_active":"2024-09-17T05:22:19.436645+0000","last_became_peered":"2024-09-17T05:22:19.436645+0000","last_unstale":"2024-09-17T05:22:21.295581+0000","last_undegraded":"2024-09-17T05:22:21.295581+0000","last_fullsized":"2024-09-17T05:22:21.295581+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:03.311936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436274+0000","last_change":"2024-09-17T05:22:18.431369+0000","last_active":"2024-09-17T05:22:20.436274+0000","last_peered":"2024-09-17T05:22:20.436274+0000","last_clean":"2024-09-17T05:22:20.436274+0000","last_became_active":"2024-09-17T05:22:18.429959+0000","last_became_peered":"2024-09-17T05:22:18.429959+0000","last_unstale":"2024-09-17T05:22:20.436274+0000","last_undegraded":"2024-09-17T05:22:20.436274+0000","last_fullsized":"2024-09-17T05:22:20.436274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294832+0000","last_change":"2024-09-17T05:22:19.432750+0000","last_active":"2024-09-17T05:22:21.294832+0000","last_peered":"2024-09-17T05:22:21.294832+0000","last_clean":"2024-09-17T05:22:21.294832+0000","last_became_active":"2024-09-17T05:22:19.432494+0000","last_became_peered":"2024-09-17T05:22:19.432494+0000","last_unstale":"2024-09-17T05:22:21.294832+0000","last_undegraded":"2024-09-17T05:22:21.294832+0000","last_fullsized":"2024-09-17T05:22:21.294832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.854203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007473+0000","last_change":"2024-09-17T05:22:18.434348+0000","last_active":"2024-09-17T05:22:21.007473+0000","last_peered":"2024-09-17T05:22:21.007473+0000","last_clean":"2024-09-17T05:22:21.007473+0000","last_became_active":"2024-09-17T05:22:18.434070+0000","last_became_peered":"2024-09-17T05:22:18.434070+0000","last_unstale":"2024-09-17T05:22:21.007473+0000","last_undegraded":"2024-09-17T05:22:21.007473+0000","last_fullsized":"2024-09-17T05:22:21.007473+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295990+0000","last_change":"2024-09-17T05:22:19.433227+0000","last_active":"2024-09-17T05:22:21.295990+0000","last_peered":"2024-09-17T05:22:21.295990+0000","last_clean":"2024-09-17T05:22:21.295990+0000","last_became_active":"2024-09-17T05:22:19.432973+0000","last_became_peered":"2024-09-17T05:22:19.432973+0000","last_unstale":"2024-09-17T05:22:21.295990+0000","last_undegraded":"2024-09-17T05:22:21.295990+0000","last_fullsized":"2024-09-17T05:22:21.295990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:44.832519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294686+0000","last_change":"2024-09-17T05:22:18.432573+0000","last_active":"2024-09-17T05:22:21.294686+0000","last_peered":"2024-09-17T05:22:21.294686+0000","last_clean":"2024-09-17T05:22:21.294686+0000","last_became_active":"2024-09-17T05:22:18.432245+0000","last_became_peered":"2024-09-17T05:22:18.432245+0000","last_unstale":"2024-09-17T05:22:21.294686+0000","last_undegraded":"2024-09-17T05:22:21.294686+0000","last_fullsized":"2024-09-17T05:22:21.294686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:25.972053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295569+0000","last_change":"2024-09-17T05:22:19.443549+0000","last_active":"2024-09-17T05:22:21.295569+0000","last_peered":"2024-09-17T05:22:21.295569+0000","last_clean":"2024-09-17T05:22:21.295569+0000","last_became_active":"2024-09-17T05:22:19.443162+0000","last_became_peered":"2024-09-17T05:22:19.443162+0000","last_unstale":"2024-09-17T05:22:21.295569+0000","last_undegraded":"2024-09-17T05:22:21.295569+0000","last_fullsized":"2024-09-17T05:22:21.295569+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:00.541979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436476+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436476+0000","last_peered":"2024-09-17T05:22:20.436476+0000","last_clean":"2024-09-17T05:22:20.436476+0000","last_became_active":"2024-09-17T05:22:18.425188+0000","last_became_peered":"2024-09-17T05:22:18.425188+0000","last_unstale":"2024-09-17T05:22:20.436476+0000","last_undegraded":"2024-09-17T05:22:20.436476+0000","last_fullsized":"2024-09-17T05:22:20.436476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:53.421290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007439+0000","last_change":"2024-09-17T05:22:19.440882+0000","last_active":"2024-09-17T05:22:21.007439+0000","last_peered":"2024-09-17T05:22:21.007439+0000","last_clean":"2024-09-17T05:22:21.007439+0000","last_became_active":"2024-09-17T05:22:19.440554+0000","last_became_peered":"2024-09-17T05:22:19.440554+0000","last_unstale":"2024-09-17T05:22:21.007439+0000","last_undegraded":"2024-09-17T05:22:21.007439+0000","last_fullsized":"2024-09-17T05:22:21.007439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.420404+0000","last_change":"2024-09-17T05:22:18.438129+0000","last_active":"2024-09-17T05:22:21.420404+0000","last_peered":"2024-09-17T05:22:21.420404+0000","last_clean":"2024-09-17T05:22:21.420404+0000","last_became_active":"2024-09-17T05:22:18.437872+0000","last_became_peered":"2024-09-17T05:22:18.437872+0000","last_unstale":"2024-09-17T05:22:21.420404+0000","last_undegraded":"2024-09-17T05:22:21.420404+0000","last_fullsized":"2024-09-17T05:22:21.420404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:01.605305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029489+0000","last_change":"2024-09-17T05:22:19.436359+0000","last_active":"2024-09-17T05:22:21.029489+0000","last_peered":"2024-09-17T05:22:21.029489+0000","last_clean":"2024-09-17T05:22:21.029489+0000","last_became_active":"2024-09-17T05:22:19.435752+0000","last_became_peered":"2024-09-17T05:22:19.435752+0000","last_unstale":"2024-09-17T05:22:21.029489+0000","last_undegraded":"2024-09-17T05:22:21.029489+0000","last_fullsized":"2024-09-17T05:22:21.029489+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433248+0000","last_change":"2024-09-17T05:22:18.429079+0000","last_active":"2024-09-17T05:22:20.433248+0000","last_peered":"2024-09-17T05:22:20.433248+0000","last_clean":"2024-09-17T05:22:20.433248+0000","last_became_active":"2024-09-17T05:22:18.428828+0000","last_became_peered":"2024-09-17T05:22:18.428828+0000","last_unstale":"2024-09-17T05:22:20.433248+0000","last_undegraded":"2024-09-17T05:22:20.433248+0000","last_fullsized":"2024-09-17T05:22:20.433248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:32.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029857+0000","last_change":"2024-09-17T05:22:19.436981+0000","last_active":"2024-09-17T05:22:21.029857+0000","last_peered":"2024-09-17T05:22:21.029857+0000","last_clean":"2024-09-17T05:22:21.029857+0000","last_became_active":"2024-09-17T05:22:19.436256+0000","last_became_peered":"2024-09-17T05:22:19.436256+0000","last_unstale":"2024-09-17T05:22:21.029857+0000","last_undegraded":"2024-09-17T05:22:21.029857+0000","last_fullsized":"2024-09-17T05:22:21.029857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:36.324734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295358+0000","last_change":"2024-09-17T05:22:18.429253+0000","last_active":"2024-09-17T05:22:21.295358+0000","last_peered":"2024-09-17T05:22:21.295358+0000","last_clean":"2024-09-17T05:22:21.295358+0000","last_became_active":"2024-09-17T05:22:18.428966+0000","last_became_peered":"2024-09-17T05:22:18.428966+0000","last_unstale":"2024-09-17T05:22:21.295358+0000","last_undegraded":"2024-09-17T05:22:21.295358+0000","last_fullsized":"2024-09-17T05:22:21.295358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:21.497094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433029+0000","last_change":"2024-09-17T05:22:19.428711+0000","last_active":"2024-09-17T05:22:20.433029+0000","last_peered":"2024-09-17T05:22:20.433029+0000","last_clean":"2024-09-17T05:22:20.433029+0000","last_became_active":"2024-09-17T05:22:19.428345+0000","last_became_peered":"2024-09-17T05:22:19.428345+0000","last_unstale":"2024-09-17T05:22:20.433029+0000","last_undegraded":"2024-09-17T05:22:20.433029+0000","last_fullsized":"2024-09-17T05:22:20.433029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:34.010700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433341+0000","last_change":"2024-09-17T05:22:18.435789+0000","last_active":"2024-09-17T05:22:20.433341+0000","last_peered":"2024-09-17T05:22:20.433341+0000","last_clean":"2024-09-17T05:22:20.433341+0000","last_became_active":"2024-09-17T05:22:18.435509+0000","last_became_peered":"2024-09-17T05:22:18.435509+0000","last_unstale":"2024-09-17T05:22:20.433341+0000","last_undegraded":"2024-09-17T05:22:20.433341+0000","last_fullsized":"2024-09-17T05:22:20.433341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:07.895200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436640+0000","last_change":"2024-09-17T05:22:19.440009+0000","last_active":"2024-09-17T05:22:20.436640+0000","last_peered":"2024-09-17T05:22:20.436640+0000","last_clean":"2024-09-17T05:22:20.436640+0000","last_became_active":"2024-09-17T05:22:19.439695+0000","last_became_peered":"2024-09-17T05:22:19.439695+0000","last_unstale":"2024-09-17T05:22:20.436640+0000","last_undegraded":"2024-09-17T05:22:20.436640+0000","last_fullsized":"2024-09-17T05:22:20.436640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:10.705338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295403+0000","last_change":"2024-09-17T05:22:18.429070+0000","last_active":"2024-09-17T05:22:21.295403+0000","last_peered":"2024-09-17T05:22:21.295403+0000","last_clean":"2024-09-17T05:22:21.295403+0000","last_became_active":"2024-09-17T05:22:18.428814+0000","last_became_peered":"2024-09-17T05:22:18.428814+0000","last_unstale":"2024-09-17T05:22:21.295403+0000","last_undegraded":"2024-09-17T05:22:21.295403+0000","last_fullsized":"2024-09-17T05:22:21.295403+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:58.148752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295114+0000","last_change":"2024-09-17T05:22:19.441198+0000","last_active":"2024-09-17T05:22:21.295114+0000","last_peered":"2024-09-17T05:22:21.295114+0000","last_clean":"2024-09-17T05:22:21.295114+0000","last_became_active":"2024-09-17T05:22:19.440716+0000","last_became_peered":"2024-09-17T05:22:19.440716+0000","last_unstale":"2024-09-17T05:22:21.295114+0000","last_undegraded":"2024-09-17T05:22:21.295114+0000","last_fullsized":"2024-09-17T05:22:21.295114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:39.204819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434595+0000","last_change":"2024-09-17T05:22:18.428067+0000","last_active":"2024-09-17T05:22:20.434595+0000","last_peered":"2024-09-17T05:22:20.434595+0000","last_clean":"2024-09-17T05:22:20.434595+0000","last_became_active":"2024-09-17T05:22:18.427698+0000","last_became_peered":"2024-09-17T05:22:18.427698+0000","last_unstale":"2024-09-17T05:22:20.434595+0000","last_undegraded":"2024-09-17T05:22:20.434595+0000","last_fullsized":"2024-09-17T05:22:20.434595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:26.273038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.428856+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.428509+0000","last_became_peered":"2024-09-17T05:22:19.428509+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:04.873956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436222+0000","last_change":"2024-09-17T05:22:18.427604+0000","last_active":"2024-09-17T05:22:20.436222+0000","last_peered":"2024-09-17T05:22:20.436222+0000","last_clean":"2024-09-17T05:22:20.436222+0000","last_became_active":"2024-09-17T05:22:18.427324+0000","last_became_peered":"2024-09-17T05:22:18.427324+0000","last_unstale":"2024-09-17T05:22:20.436222+0000","last_undegraded":"2024-09-17T05:22:20.436222+0000","last_fullsized":"2024-09-17T05:22:20.436222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:54.627943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294931+0000","last_change":"2024-09-17T05:22:19.439418+0000","last_active":"2024-09-17T05:22:21.294931+0000","last_peered":"2024-09-17T05:22:21.294931+0000","last_clean":"2024-09-17T05:22:21.294931+0000","last_became_active":"2024-09-17T05:22:19.439146+0000","last_became_peered":"2024-09-17T05:22:19.439146+0000","last_unstale":"2024-09-17T05:22:21.294931+0000","last_undegraded":"2024-09-17T05:22:21.294931+0000","last_fullsized":"2024-09-17T05:22:21.294931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:01.545980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436507+0000","last_change":"2024-09-17T05:22:18.428890+0000","last_active":"2024-09-17T05:22:20.436507+0000","last_peered":"2024-09-17T05:22:20.436507+0000","last_clean":"2024-09-17T05:22:20.436507+0000","last_became_active":"2024-09-17T05:22:18.428073+0000","last_became_peered":"2024-09-17T05:22:18.428073+0000","last_unstale":"2024-09-17T05:22:20.436507+0000","last_undegraded":"2024-09-17T05:22:20.436507+0000","last_fullsized":"2024-09-17T05:22:20.436507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:19.470799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":192,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029128+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:22:21.029128+0000","last_peered":"2024-09-17T05:22:21.029128+0000","last_clean":"2024-09-17T05:22:21.029128+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:22:21.029128+0000","last_undegraded":"2024-09-17T05:22:21.029128+0000","last_fullsized":"2024-09-17T05:22:21.029128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":937153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":346261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":339959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":346239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":339981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":843776,"data_stored":347781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":342097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1425408,"data_stored":936537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:25.390 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-17T05:22:25.390+0000 7fe390272640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:22:26.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:22:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.902+0000 7f0306447640 1 -- 172.21.15.81:0/3884100043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f030015fe60 msgr2=0x7f03000ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.902+0000 7f0306447640 1 --2- 172.21.15.81:0/3884100043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f030015fe60 0x7f03000ceac0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f02f8005fd0 tx=0x7f02f802aa90 comp rx=0 tx=0).stop 2024-09-17T05:22:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.902+0000 7f0306447640 1 -- 172.21.15.81:0/3884100043 shutdown_connections 2024-09-17T05:22:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.902+0000 7f0306447640 1 --2- 172.21.15.81:0/3884100043 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f030015fe60 0x7f03000ceac0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.902+0000 7f0306447640 1 -- 172.21.15.81:0/3884100043 >> 172.21.15.81:0/3884100043 conn(0x7f03000b1690 msgr2=0x7f03000b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.902+0000 7f0306447640 1 -- 172.21.15.81:0/3884100043 shutdown_connections 2024-09-17T05:22:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.902+0000 7f0306447640 1 -- 172.21.15.81:0/3884100043 wait complete. 2024-09-17T05:22:26.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.903+0000 7f0306447640 1 Processor -- start 2024-09-17T05:22:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.904+0000 7f0306447640 1 -- start start 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.904+0000 7f0306447640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03000cc490 0x7f03001524f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.904+0000 7f0306447640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300159680 0x7f0300141fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.904+0000 7f0306447640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030015fe60 0x7f03001f6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.904+0000 7f0306447640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f030006f160 con 0x7f0300159680 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.904+0000 7f0306447640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f03000ccb10 con 0x7f03000cc490 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.904+0000 7f0306447640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f03000cf000 con 0x7f030015fe60 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300159680 0x7f0300141fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300159680 0x7f0300141fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47468/0 (socket says 172.21.15.81:47468) 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 -- 172.21.15.81:0/1825968632 learned_addr learned my addr 172.21.15.81:0/1825968632 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02fffff640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03000cc490 0x7f03001524f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f03049e4640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030015fe60 0x7f03001f6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 -- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030015fe60 msgr2=0x7f03001f6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030015fe60 0x7f03001f6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 -- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03000cc490 msgr2=0x7f03001524f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03000cc490 0x7f03001524f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 -- 172.21.15.81:0/1825968632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0300152c40 con 0x7f0300159680 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02fffff640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03000cc490 0x7f03001524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02ff7fe640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300159680 0x7f0300141fd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c460 tx=0x7f02f400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02fcff9640 1 -- 172.21.15.81:0/1825968632 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4016020 con 0x7f0300159680 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02fcff9640 1 -- 172.21.15.81:0/1825968632 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02f4012960 con 0x7f0300159680 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f02fcff9640 1 -- 172.21.15.81:0/1825968632 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02f4012db0 con 0x7f0300159680 2024-09-17T05:22:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03001414f0 con 0x7f0300159680 2024-09-17T05:22:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.905+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0300152f20 con 0x7f0300159680 2024-09-17T05:22:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.906+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03000afbf0 con 0x7f0300159680 2024-09-17T05:22:26.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.907+0000 7f02fcff9640 1 -- 172.21.15.81:0/1825968632 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f02f4019020 con 0x7f0300159680 2024-09-17T05:22:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.907+0000 7f02fcff9640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f02ec078ef0 0x7f02ec07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.908+0000 7f02fcff9640 1 -- 172.21.15.81:0/1825968632 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f02f409b020 con 0x7f0300159680 2024-09-17T05:22:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.908+0000 7f02fffff640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f02ec078ef0 0x7f02ec07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.908+0000 7f02fffff640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f02ec078ef0 0x7f02ec07b3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f02f0000f60 tx=0x7f02f0009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:26.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:26.912+0000 7f02fcff9640 1 -- 172.21.15.81:0/1825968632 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f03000afbf0 con 0x7f0300159680 2024-09-17T05:22:27.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.083+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f03000735c0 con 0x7f02ec078ef0 2024-09-17T05:22:27.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.088+0000 7f02fcff9640 1 -- 172.21.15.81:0/1825968632 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252056 (secure 0 0 0) 0x7f03000735c0 con 0x7f02ec078ef0 2024-09-17T05:22:27.092 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:27.094 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f02ec078ef0 msgr2=0x7f02ec07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f02ec078ef0 0x7f02ec07b3b0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f02f0000f60 tx=0x7f02f0009040 comp rx=0 tx=0).stop 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300159680 msgr2=0x7f0300141fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300159680 0x7f0300141fd0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f02f400c460 tx=0x7f02f400c920 comp rx=0 tx=0).stop 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 shutdown_connections 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f02ec078ef0 0x7f02ec07b3b0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f030015fe60 0x7f03001f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0300159680 0x7f0300141fd0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 --2- 172.21.15.81:0/1825968632 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03000cc490 0x7f03001524f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 >> 172.21.15.81:0/1825968632 conn(0x7f03000b1690 msgr2=0x7f03000b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 shutdown_connections 2024-09-17T05:22:27.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.091+0000 7f0306447640 1 -- 172.21.15.81:0/1825968632 wait complete. 2024-09-17T05:22:27.103 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-17T05:22:25.427269+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":146,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":113,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":232244,"kb_used_data":7684,"kb_used_omap":12,"kb_used_meta":224371,"kb_avail":754742476,"statfs":{"total":773094113280,"available":772856295424,"internally_reserved":0,"allocated":7868416,"data_stored":3936008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":229756464},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":29,"apply_latency_ms":29,"commit_latency_ns":29000000,"apply_latency_ns":29000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.012225"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029833+0000","last_change":"2024-09-17T05:22:19.438662+0000","last_active":"2024-09-17T05:22:21.029833+0000","last_peered":"2024-09-17T05:22:21.029833+0000","last_clean":"2024-09-17T05:22:21.029833+0000","last_became_active":"2024-09-17T05:22:19.438390+0000","last_became_peered":"2024-09-17T05:22:19.438390+0000","last_unstale":"2024-09-17T05:22:21.029833+0000","last_undegraded":"2024-09-17T05:22:21.029833+0000","last_fullsized":"2024-09-17T05:22:21.029833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:05.760603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436833+0000","last_change":"2024-09-17T05:22:19.428772+0000","last_active":"2024-09-17T05:22:20.436833+0000","last_peered":"2024-09-17T05:22:20.436833+0000","last_clean":"2024-09-17T05:22:20.436833+0000","last_became_active":"2024-09-17T05:22:19.427862+0000","last_became_peered":"2024-09-17T05:22:19.427862+0000","last_unstale":"2024-09-17T05:22:20.436833+0000","last_undegraded":"2024-09-17T05:22:20.436833+0000","last_fullsized":"2024-09-17T05:22:20.436833+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295130+0000","last_change":"2024-09-17T05:22:19.434335+0000","last_active":"2024-09-17T05:22:21.295130+0000","last_peered":"2024-09-17T05:22:21.295130+0000","last_clean":"2024-09-17T05:22:21.295130+0000","last_became_active":"2024-09-17T05:22:19.434058+0000","last_became_peered":"2024-09-17T05:22:19.434058+0000","last_unstale":"2024-09-17T05:22:21.295130+0000","last_undegraded":"2024-09-17T05:22:21.295130+0000","last_fullsized":"2024-09-17T05:22:21.295130+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:13:29.970938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295867+0000","last_change":"2024-09-17T05:22:19.445535+0000","last_active":"2024-09-17T05:22:21.295867+0000","last_peered":"2024-09-17T05:22:21.295867+0000","last_clean":"2024-09-17T05:22:21.295867+0000","last_became_active":"2024-09-17T05:22:19.444870+0000","last_became_peered":"2024-09-17T05:22:19.444870+0000","last_unstale":"2024-09-17T05:22:21.295867+0000","last_undegraded":"2024-09-17T05:22:21.295867+0000","last_fullsized":"2024-09-17T05:22:21.295867+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:36.729817+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433254+0000","last_change":"2024-09-17T05:22:19.438404+0000","last_active":"2024-09-17T05:22:20.433254+0000","last_peered":"2024-09-17T05:22:20.433254+0000","last_clean":"2024-09-17T05:22:20.433254+0000","last_became_active":"2024-09-17T05:22:19.438134+0000","last_became_peered":"2024-09-17T05:22:19.438134+0000","last_unstale":"2024-09-17T05:22:20.433254+0000","last_undegraded":"2024-09-17T05:22:20.433254+0000","last_fullsized":"2024-09-17T05:22:20.433254+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:41.699191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436163+0000","last_change":"2024-09-17T05:22:19.426534+0000","last_active":"2024-09-17T05:22:20.436163+0000","last_peered":"2024-09-17T05:22:20.436163+0000","last_clean":"2024-09-17T05:22:20.436163+0000","last_became_active":"2024-09-17T05:22:19.426215+0000","last_became_peered":"2024-09-17T05:22:19.426215+0000","last_unstale":"2024-09-17T05:22:20.436163+0000","last_undegraded":"2024-09-17T05:22:20.436163+0000","last_fullsized":"2024-09-17T05:22:20.436163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:22.640856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007121+0000","last_change":"2024-09-17T05:22:19.440259+0000","last_active":"2024-09-17T05:22:21.007121+0000","last_peered":"2024-09-17T05:22:21.007121+0000","last_clean":"2024-09-17T05:22:21.007121+0000","last_became_active":"2024-09-17T05:22:19.439993+0000","last_became_peered":"2024-09-17T05:22:19.439993+0000","last_unstale":"2024-09-17T05:22:21.007121+0000","last_undegraded":"2024-09-17T05:22:21.007121+0000","last_fullsized":"2024-09-17T05:22:21.007121+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:40.223827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436770+0000","last_change":"2024-09-17T05:22:19.437945+0000","last_active":"2024-09-17T05:22:20.436770+0000","last_peered":"2024-09-17T05:22:20.436770+0000","last_clean":"2024-09-17T05:22:20.436770+0000","last_became_active":"2024-09-17T05:22:19.437670+0000","last_became_peered":"2024-09-17T05:22:19.437670+0000","last_unstale":"2024-09-17T05:22:20.436770+0000","last_undegraded":"2024-09-17T05:22:20.436770+0000","last_fullsized":"2024-09-17T05:22:20.436770+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:26.423565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433544+0000","last_change":"2024-09-17T05:22:19.430604+0000","last_active":"2024-09-17T05:22:20.433544+0000","last_peered":"2024-09-17T05:22:20.433544+0000","last_clean":"2024-09-17T05:22:20.433544+0000","last_became_active":"2024-09-17T05:22:19.430136+0000","last_became_peered":"2024-09-17T05:22:19.430136+0000","last_unstale":"2024-09-17T05:22:20.433544+0000","last_undegraded":"2024-09-17T05:22:20.433544+0000","last_fullsized":"2024-09-17T05:22:20.433544+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:29:15.751408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435427+0000","last_change":"2024-09-17T05:22:19.427898+0000","last_active":"2024-09-17T05:22:20.435427+0000","last_peered":"2024-09-17T05:22:20.435427+0000","last_clean":"2024-09-17T05:22:20.435427+0000","last_became_active":"2024-09-17T05:22:19.427591+0000","last_became_peered":"2024-09-17T05:22:19.427591+0000","last_unstale":"2024-09-17T05:22:20.435427+0000","last_undegraded":"2024-09-17T05:22:20.435427+0000","last_fullsized":"2024-09-17T05:22:20.435427+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:01.861609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029667+0000","last_change":"2024-09-17T05:22:19.442877+0000","last_active":"2024-09-17T05:22:21.029667+0000","last_peered":"2024-09-17T05:22:21.029667+0000","last_clean":"2024-09-17T05:22:21.029667+0000","last_became_active":"2024-09-17T05:22:19.442514+0000","last_became_peered":"2024-09-17T05:22:19.442514+0000","last_unstale":"2024-09-17T05:22:21.029667+0000","last_undegraded":"2024-09-17T05:22:21.029667+0000","last_fullsized":"2024-09-17T05:22:21.029667+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:45.208300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296004+0000","last_change":"2024-09-17T05:22:19.447642+0000","last_active":"2024-09-17T05:22:21.296004+0000","last_peered":"2024-09-17T05:22:21.296004+0000","last_clean":"2024-09-17T05:22:21.296004+0000","last_became_active":"2024-09-17T05:22:19.447297+0000","last_became_peered":"2024-09-17T05:22:19.447297+0000","last_unstale":"2024-09-17T05:22:21.296004+0000","last_undegraded":"2024-09-17T05:22:21.296004+0000","last_fullsized":"2024-09-17T05:22:21.296004+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:48.971688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295216+0000","last_change":"2024-09-17T05:22:19.442039+0000","last_active":"2024-09-17T05:22:21.295216+0000","last_peered":"2024-09-17T05:22:21.295216+0000","last_clean":"2024-09-17T05:22:21.295216+0000","last_became_active":"2024-09-17T05:22:19.441775+0000","last_became_peered":"2024-09-17T05:22:19.441775+0000","last_unstale":"2024-09-17T05:22:21.295216+0000","last_undegraded":"2024-09-17T05:22:21.295216+0000","last_fullsized":"2024-09-17T05:22:21.295216+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:36:24.235108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433151+0000","last_change":"2024-09-17T05:22:19.436649+0000","last_active":"2024-09-17T05:22:20.433151+0000","last_peered":"2024-09-17T05:22:20.433151+0000","last_clean":"2024-09-17T05:22:20.433151+0000","last_became_active":"2024-09-17T05:22:19.436379+0000","last_became_peered":"2024-09-17T05:22:19.436379+0000","last_unstale":"2024-09-17T05:22:20.433151+0000","last_undegraded":"2024-09-17T05:22:20.433151+0000","last_fullsized":"2024-09-17T05:22:20.433151+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:44.750380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295723+0000","last_change":"2024-09-17T05:22:19.443458+0000","last_active":"2024-09-17T05:22:21.295723+0000","last_peered":"2024-09-17T05:22:21.295723+0000","last_clean":"2024-09-17T05:22:21.295723+0000","last_became_active":"2024-09-17T05:22:19.443180+0000","last_became_peered":"2024-09-17T05:22:19.443180+0000","last_unstale":"2024-09-17T05:22:21.295723+0000","last_undegraded":"2024-09-17T05:22:21.295723+0000","last_fullsized":"2024-09-17T05:22:21.295723+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:10.223222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434649+0000","last_change":"2024-09-17T05:22:19.433093+0000","last_active":"2024-09-17T05:22:20.434649+0000","last_peered":"2024-09-17T05:22:20.434649+0000","last_clean":"2024-09-17T05:22:20.434649+0000","last_became_active":"2024-09-17T05:22:19.432601+0000","last_became_peered":"2024-09-17T05:22:19.432601+0000","last_unstale":"2024-09-17T05:22:20.434649+0000","last_undegraded":"2024-09-17T05:22:20.434649+0000","last_fullsized":"2024-09-17T05:22:20.434649+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:02.607238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433524+0000","last_change":"2024-09-17T05:22:19.427959+0000","last_active":"2024-09-17T05:22:20.433524+0000","last_peered":"2024-09-17T05:22:20.433524+0000","last_clean":"2024-09-17T05:22:20.433524+0000","last_became_active":"2024-09-17T05:22:19.427723+0000","last_became_peered":"2024-09-17T05:22:19.427723+0000","last_unstale":"2024-09-17T05:22:20.433524+0000","last_undegraded":"2024-09-17T05:22:20.433524+0000","last_fullsized":"2024-09-17T05:22:20.433524+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:37.815920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295801+0000","last_change":"2024-09-17T05:22:19.445081+0000","last_active":"2024-09-17T05:22:21.295801+0000","last_peered":"2024-09-17T05:22:21.295801+0000","last_clean":"2024-09-17T05:22:21.295801+0000","last_became_active":"2024-09-17T05:22:19.444827+0000","last_became_peered":"2024-09-17T05:22:19.444827+0000","last_unstale":"2024-09-17T05:22:21.295801+0000","last_undegraded":"2024-09-17T05:22:21.295801+0000","last_fullsized":"2024-09-17T05:22:21.295801+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:33:37.186334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436123+0000","last_change":"2024-09-17T05:22:19.438688+0000","last_active":"2024-09-17T05:22:20.436123+0000","last_peered":"2024-09-17T05:22:20.436123+0000","last_clean":"2024-09-17T05:22:20.436123+0000","last_became_active":"2024-09-17T05:22:19.438382+0000","last_became_peered":"2024-09-17T05:22:19.438382+0000","last_unstale":"2024-09-17T05:22:20.436123+0000","last_undegraded":"2024-09-17T05:22:20.436123+0000","last_fullsized":"2024-09-17T05:22:20.436123+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:32.110192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295300+0000","last_change":"2024-09-17T05:22:19.439143+0000","last_active":"2024-09-17T05:22:21.295300+0000","last_peered":"2024-09-17T05:22:21.295300+0000","last_clean":"2024-09-17T05:22:21.295300+0000","last_became_active":"2024-09-17T05:22:19.438852+0000","last_became_peered":"2024-09-17T05:22:19.438852+0000","last_unstale":"2024-09-17T05:22:21.295300+0000","last_undegraded":"2024-09-17T05:22:21.295300+0000","last_fullsized":"2024-09-17T05:22:21.295300+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:20:03.928065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434924+0000","last_change":"2024-09-17T05:22:19.430871+0000","last_active":"2024-09-17T05:22:20.434924+0000","last_peered":"2024-09-17T05:22:20.434924+0000","last_clean":"2024-09-17T05:22:20.434924+0000","last_became_active":"2024-09-17T05:22:19.430608+0000","last_became_peered":"2024-09-17T05:22:19.430608+0000","last_unstale":"2024-09-17T05:22:20.434924+0000","last_undegraded":"2024-09-17T05:22:20.434924+0000","last_fullsized":"2024-09-17T05:22:20.434924+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434847+0000","last_change":"2024-09-17T05:22:19.422392+0000","last_active":"2024-09-17T05:22:20.434847+0000","last_peered":"2024-09-17T05:22:20.434847+0000","last_clean":"2024-09-17T05:22:20.434847+0000","last_became_active":"2024-09-17T05:22:19.421987+0000","last_became_peered":"2024-09-17T05:22:19.421987+0000","last_unstale":"2024-09-17T05:22:20.434847+0000","last_undegraded":"2024-09-17T05:22:20.434847+0000","last_fullsized":"2024-09-17T05:22:20.434847+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:08.730503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029409+0000","last_change":"2024-09-17T05:22:19.435845+0000","last_active":"2024-09-17T05:22:21.029409+0000","last_peered":"2024-09-17T05:22:21.029409+0000","last_clean":"2024-09-17T05:22:21.029409+0000","last_became_active":"2024-09-17T05:22:19.435535+0000","last_became_peered":"2024-09-17T05:22:19.435535+0000","last_unstale":"2024-09-17T05:22:21.029409+0000","last_undegraded":"2024-09-17T05:22:21.029409+0000","last_fullsized":"2024-09-17T05:22:21.029409+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:17.679119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029229+0000","last_change":"2024-09-17T05:22:19.438687+0000","last_active":"2024-09-17T05:22:21.029229+0000","last_peered":"2024-09-17T05:22:21.029229+0000","last_clean":"2024-09-17T05:22:21.029229+0000","last_became_active":"2024-09-17T05:22:19.438347+0000","last_became_peered":"2024-09-17T05:22:19.438347+0000","last_unstale":"2024-09-17T05:22:21.029229+0000","last_undegraded":"2024-09-17T05:22:21.029229+0000","last_fullsized":"2024-09-17T05:22:21.029229+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435155+0000","last_change":"2024-09-17T05:22:19.436133+0000","last_active":"2024-09-17T05:22:20.435155+0000","last_peered":"2024-09-17T05:22:20.435155+0000","last_clean":"2024-09-17T05:22:20.435155+0000","last_became_active":"2024-09-17T05:22:19.434918+0000","last_became_peered":"2024-09-17T05:22:19.434918+0000","last_unstale":"2024-09-17T05:22:20.435155+0000","last_undegraded":"2024-09-17T05:22:20.435155+0000","last_fullsized":"2024-09-17T05:22:20.435155+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:12:33.154454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007447+0000","last_change":"2024-09-17T05:22:19.434518+0000","last_active":"2024-09-17T05:22:21.007447+0000","last_peered":"2024-09-17T05:22:21.007447+0000","last_clean":"2024-09-17T05:22:21.007447+0000","last_became_active":"2024-09-17T05:22:19.434257+0000","last_became_peered":"2024-09-17T05:22:19.434257+0000","last_unstale":"2024-09-17T05:22:21.007447+0000","last_undegraded":"2024-09-17T05:22:21.007447+0000","last_fullsized":"2024-09-17T05:22:21.007447+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:14.472171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295312+0000","last_change":"2024-09-17T05:22:19.440746+0000","last_active":"2024-09-17T05:22:21.295312+0000","last_peered":"2024-09-17T05:22:21.295312+0000","last_clean":"2024-09-17T05:22:21.295312+0000","last_became_active":"2024-09-17T05:22:19.440478+0000","last_became_peered":"2024-09-17T05:22:19.440478+0000","last_unstale":"2024-09-17T05:22:21.295312+0000","last_undegraded":"2024-09-17T05:22:21.295312+0000","last_fullsized":"2024-09-17T05:22:21.295312+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:39.556732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435163+0000","last_change":"2024-09-17T05:22:19.423204+0000","last_active":"2024-09-17T05:22:20.435163+0000","last_peered":"2024-09-17T05:22:20.435163+0000","last_clean":"2024-09-17T05:22:20.435163+0000","last_became_active":"2024-09-17T05:22:19.422837+0000","last_became_peered":"2024-09-17T05:22:19.422837+0000","last_unstale":"2024-09-17T05:22:20.435163+0000","last_undegraded":"2024-09-17T05:22:20.435163+0000","last_fullsized":"2024-09-17T05:22:20.435163+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:28:48.167633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295557+0000","last_change":"2024-09-17T05:22:19.436288+0000","last_active":"2024-09-17T05:22:21.295557+0000","last_peered":"2024-09-17T05:22:21.295557+0000","last_clean":"2024-09-17T05:22:21.295557+0000","last_became_active":"2024-09-17T05:22:19.435852+0000","last_became_peered":"2024-09-17T05:22:19.435852+0000","last_unstale":"2024-09-17T05:22:21.295557+0000","last_undegraded":"2024-09-17T05:22:21.295557+0000","last_fullsized":"2024-09-17T05:22:21.295557+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:04:19.404495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007353+0000","last_change":"2024-09-17T05:22:19.435208+0000","last_active":"2024-09-17T05:22:21.007353+0000","last_peered":"2024-09-17T05:22:21.007353+0000","last_clean":"2024-09-17T05:22:21.007353+0000","last_became_active":"2024-09-17T05:22:19.434972+0000","last_became_peered":"2024-09-17T05:22:19.434972+0000","last_unstale":"2024-09-17T05:22:21.007353+0000","last_undegraded":"2024-09-17T05:22:21.007353+0000","last_fullsized":"2024-09-17T05:22:21.007353+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:44.946507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007493+0000","last_change":"2024-09-17T05:22:19.436850+0000","last_active":"2024-09-17T05:22:21.007493+0000","last_peered":"2024-09-17T05:22:21.007493+0000","last_clean":"2024-09-17T05:22:21.007493+0000","last_became_active":"2024-09-17T05:22:19.436593+0000","last_became_peered":"2024-09-17T05:22:19.436593+0000","last_unstale":"2024-09-17T05:22:21.007493+0000","last_undegraded":"2024-09-17T05:22:21.007493+0000","last_fullsized":"2024-09-17T05:22:21.007493+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:04.797910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.430122+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.429844+0000","last_became_peered":"2024-09-17T05:22:19.429844+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:31.556861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029745+0000","last_change":"2024-09-17T05:22:19.439394+0000","last_active":"2024-09-17T05:22:21.029745+0000","last_peered":"2024-09-17T05:22:21.029745+0000","last_clean":"2024-09-17T05:22:21.029745+0000","last_became_active":"2024-09-17T05:22:19.437506+0000","last_became_peered":"2024-09-17T05:22:19.437506+0000","last_unstale":"2024-09-17T05:22:21.029745+0000","last_undegraded":"2024-09-17T05:22:21.029745+0000","last_fullsized":"2024-09-17T05:22:21.029745+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.824838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"68'4","reported_seq":19,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029965+0000","last_change":"2024-09-17T05:22:18.429837+0000","last_active":"2024-09-17T05:22:21.029965+0000","last_peered":"2024-09-17T05:22:21.029965+0000","last_clean":"2024-09-17T05:22:21.029965+0000","last_became_active":"2024-09-17T05:22:18.429576+0000","last_became_peered":"2024-09-17T05:22:18.429576+0000","last_unstale":"2024-09-17T05:22:21.029965+0000","last_undegraded":"2024-09-17T05:22:21.029965+0000","last_fullsized":"2024-09-17T05:22:21.029965+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:33.585275+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433624+0000","last_change":"2024-09-17T05:22:19.430787+0000","last_active":"2024-09-17T05:22:20.433624+0000","last_peered":"2024-09-17T05:22:20.433624+0000","last_clean":"2024-09-17T05:22:20.433624+0000","last_became_active":"2024-09-17T05:22:19.430454+0000","last_became_peered":"2024-09-17T05:22:19.430454+0000","last_unstale":"2024-09-17T05:22:20.433624+0000","last_undegraded":"2024-09-17T05:22:20.433624+0000","last_fullsized":"2024-09-17T05:22:20.433624+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:01.979709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295480+0000","last_change":"2024-09-17T05:22:18.432849+0000","last_active":"2024-09-17T05:22:21.295480+0000","last_peered":"2024-09-17T05:22:21.295480+0000","last_clean":"2024-09-17T05:22:21.295480+0000","last_became_active":"2024-09-17T05:22:18.432567+0000","last_became_peered":"2024-09-17T05:22:18.432567+0000","last_unstale":"2024-09-17T05:22:21.295480+0000","last_undegraded":"2024-09-17T05:22:21.295480+0000","last_fullsized":"2024-09-17T05:22:21.295480+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:07:41.002862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436839+0000","last_change":"2024-09-17T05:22:19.434321+0000","last_active":"2024-09-17T05:22:20.436839+0000","last_peered":"2024-09-17T05:22:20.436839+0000","last_clean":"2024-09-17T05:22:20.436839+0000","last_became_active":"2024-09-17T05:22:19.433934+0000","last_became_peered":"2024-09-17T05:22:19.433934+0000","last_unstale":"2024-09-17T05:22:20.436839+0000","last_undegraded":"2024-09-17T05:22:20.436839+0000","last_fullsized":"2024-09-17T05:22:20.436839+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:15.805658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435078+0000","last_change":"2024-09-17T05:22:18.428988+0000","last_active":"2024-09-17T05:22:20.435078+0000","last_peered":"2024-09-17T05:22:20.435078+0000","last_clean":"2024-09-17T05:22:20.435078+0000","last_became_active":"2024-09-17T05:22:18.428719+0000","last_became_peered":"2024-09-17T05:22:18.428719+0000","last_unstale":"2024-09-17T05:22:20.435078+0000","last_undegraded":"2024-09-17T05:22:20.435078+0000","last_fullsized":"2024-09-17T05:22:20.435078+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:15:34.794624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029706+0000","last_change":"2024-09-17T05:22:19.436635+0000","last_active":"2024-09-17T05:22:21.029706+0000","last_peered":"2024-09-17T05:22:21.029706+0000","last_clean":"2024-09-17T05:22:21.029706+0000","last_became_active":"2024-09-17T05:22:19.435951+0000","last_became_peered":"2024-09-17T05:22:19.435951+0000","last_unstale":"2024-09-17T05:22:21.029706+0000","last_undegraded":"2024-09-17T05:22:21.029706+0000","last_fullsized":"2024-09-17T05:22:21.029706+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:36:51.075149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436933+0000","last_change":"2024-09-17T05:22:18.427589+0000","last_active":"2024-09-17T05:22:20.436933+0000","last_peered":"2024-09-17T05:22:20.436933+0000","last_clean":"2024-09-17T05:22:20.436933+0000","last_became_active":"2024-09-17T05:22:18.427294+0000","last_became_peered":"2024-09-17T05:22:18.427294+0000","last_unstale":"2024-09-17T05:22:20.436933+0000","last_undegraded":"2024-09-17T05:22:20.436933+0000","last_fullsized":"2024-09-17T05:22:20.436933+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:01:50.823087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007293+0000","last_change":"2024-09-17T05:22:19.438589+0000","last_active":"2024-09-17T05:22:21.007293+0000","last_peered":"2024-09-17T05:22:21.007293+0000","last_clean":"2024-09-17T05:22:21.007293+0000","last_became_active":"2024-09-17T05:22:19.438299+0000","last_became_peered":"2024-09-17T05:22:19.438299+0000","last_unstale":"2024-09-17T05:22:21.007293+0000","last_undegraded":"2024-09-17T05:22:21.007293+0000","last_fullsized":"2024-09-17T05:22:21.007293+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:23:57.072075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295653+0000","last_change":"2024-09-17T05:22:18.431383+0000","last_active":"2024-09-17T05:22:21.295653+0000","last_peered":"2024-09-17T05:22:21.295653+0000","last_clean":"2024-09-17T05:22:21.295653+0000","last_became_active":"2024-09-17T05:22:18.431115+0000","last_became_peered":"2024-09-17T05:22:18.431115+0000","last_unstale":"2024-09-17T05:22:21.295653+0000","last_undegraded":"2024-09-17T05:22:21.295653+0000","last_fullsized":"2024-09-17T05:22:21.295653+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:09.892453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435067+0000","last_change":"2024-09-17T05:22:19.432969+0000","last_active":"2024-09-17T05:22:20.435067+0000","last_peered":"2024-09-17T05:22:20.435067+0000","last_clean":"2024-09-17T05:22:20.435067+0000","last_became_active":"2024-09-17T05:22:19.432466+0000","last_became_peered":"2024-09-17T05:22:19.432466+0000","last_unstale":"2024-09-17T05:22:20.435067+0000","last_undegraded":"2024-09-17T05:22:20.435067+0000","last_fullsized":"2024-09-17T05:22:20.435067+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:11.734487+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436110+0000","last_change":"2024-09-17T05:22:18.431419+0000","last_active":"2024-09-17T05:22:20.436110+0000","last_peered":"2024-09-17T05:22:20.436110+0000","last_clean":"2024-09-17T05:22:20.436110+0000","last_became_active":"2024-09-17T05:22:18.430589+0000","last_became_peered":"2024-09-17T05:22:18.430589+0000","last_unstale":"2024-09-17T05:22:20.436110+0000","last_undegraded":"2024-09-17T05:22:20.436110+0000","last_fullsized":"2024-09-17T05:22:20.436110+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:26:39.998483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432851+0000","last_change":"2024-09-17T05:22:19.427627+0000","last_active":"2024-09-17T05:22:20.432851+0000","last_peered":"2024-09-17T05:22:20.432851+0000","last_clean":"2024-09-17T05:22:20.432851+0000","last_became_active":"2024-09-17T05:22:19.427370+0000","last_became_peered":"2024-09-17T05:22:19.427370+0000","last_unstale":"2024-09-17T05:22:20.432851+0000","last_undegraded":"2024-09-17T05:22:20.432851+0000","last_fullsized":"2024-09-17T05:22:20.432851+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:36.555054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295310+0000","last_change":"2024-09-17T05:22:18.428001+0000","last_active":"2024-09-17T05:22:21.295310+0000","last_peered":"2024-09-17T05:22:21.295310+0000","last_clean":"2024-09-17T05:22:21.295310+0000","last_became_active":"2024-09-17T05:22:18.427739+0000","last_became_peered":"2024-09-17T05:22:18.427739+0000","last_unstale":"2024-09-17T05:22:21.295310+0000","last_undegraded":"2024-09-17T05:22:21.295310+0000","last_fullsized":"2024-09-17T05:22:21.295310+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:43:10.556798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295791+0000","last_change":"2024-09-17T05:22:19.438341+0000","last_active":"2024-09-17T05:22:21.295791+0000","last_peered":"2024-09-17T05:22:21.295791+0000","last_clean":"2024-09-17T05:22:21.295791+0000","last_became_active":"2024-09-17T05:22:19.438039+0000","last_became_peered":"2024-09-17T05:22:19.438039+0000","last_unstale":"2024-09-17T05:22:21.295791+0000","last_undegraded":"2024-09-17T05:22:21.295791+0000","last_fullsized":"2024-09-17T05:22:21.295791+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:57.687090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.432875+0000","last_change":"2024-09-17T05:22:18.423744+0000","last_active":"2024-09-17T05:22:20.432875+0000","last_peered":"2024-09-17T05:22:20.432875+0000","last_clean":"2024-09-17T05:22:20.432875+0000","last_became_active":"2024-09-17T05:22:18.423474+0000","last_became_peered":"2024-09-17T05:22:18.423474+0000","last_unstale":"2024-09-17T05:22:20.432875+0000","last_undegraded":"2024-09-17T05:22:20.432875+0000","last_fullsized":"2024-09-17T05:22:20.432875+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:59:20.141453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007512+0000","last_change":"2024-09-17T05:22:19.443778+0000","last_active":"2024-09-17T05:22:21.007512+0000","last_peered":"2024-09-17T05:22:21.007512+0000","last_clean":"2024-09-17T05:22:21.007512+0000","last_became_active":"2024-09-17T05:22:19.443519+0000","last_became_peered":"2024-09-17T05:22:19.443519+0000","last_unstale":"2024-09-17T05:22:21.007512+0000","last_undegraded":"2024-09-17T05:22:21.007512+0000","last_fullsized":"2024-09-17T05:22:21.007512+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435207+0000","last_change":"2024-09-17T05:22:18.427480+0000","last_active":"2024-09-17T05:22:20.435207+0000","last_peered":"2024-09-17T05:22:20.435207+0000","last_clean":"2024-09-17T05:22:20.435207+0000","last_became_active":"2024-09-17T05:22:18.427197+0000","last_became_peered":"2024-09-17T05:22:18.427197+0000","last_unstale":"2024-09-17T05:22:20.435207+0000","last_undegraded":"2024-09-17T05:22:20.435207+0000","last_fullsized":"2024-09-17T05:22:20.435207+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:18.433977+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029862+0000","last_change":"2024-09-17T05:22:19.437340+0000","last_active":"2024-09-17T05:22:21.029862+0000","last_peered":"2024-09-17T05:22:21.029862+0000","last_clean":"2024-09-17T05:22:21.029862+0000","last_became_active":"2024-09-17T05:22:19.437078+0000","last_became_peered":"2024-09-17T05:22:19.437078+0000","last_unstale":"2024-09-17T05:22:21.029862+0000","last_undegraded":"2024-09-17T05:22:21.029862+0000","last_fullsized":"2024-09-17T05:22:21.029862+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:38:27.525759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436753+0000","last_change":"2024-09-17T05:22:18.434179+0000","last_active":"2024-09-17T05:22:20.436753+0000","last_peered":"2024-09-17T05:22:20.436753+0000","last_clean":"2024-09-17T05:22:20.436753+0000","last_became_active":"2024-09-17T05:22:18.433907+0000","last_became_peered":"2024-09-17T05:22:18.433907+0000","last_unstale":"2024-09-17T05:22:20.436753+0000","last_undegraded":"2024-09-17T05:22:20.436753+0000","last_fullsized":"2024-09-17T05:22:20.436753+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:34.301087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436901+0000","last_change":"2024-09-17T05:22:19.431778+0000","last_active":"2024-09-17T05:22:20.436901+0000","last_peered":"2024-09-17T05:22:20.436901+0000","last_clean":"2024-09-17T05:22:20.436901+0000","last_became_active":"2024-09-17T05:22:19.430979+0000","last_became_peered":"2024-09-17T05:22:19.430979+0000","last_unstale":"2024-09-17T05:22:20.436901+0000","last_undegraded":"2024-09-17T05:22:20.436901+0000","last_fullsized":"2024-09-17T05:22:20.436901+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:29:34.587208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"68'3","reported_seq":18,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295407+0000","last_change":"2024-09-17T05:22:18.435917+0000","last_active":"2024-09-17T05:22:21.295407+0000","last_peered":"2024-09-17T05:22:21.295407+0000","last_clean":"2024-09-17T05:22:21.295407+0000","last_became_active":"2024-09-17T05:22:18.435593+0000","last_became_peered":"2024-09-17T05:22:18.435593+0000","last_unstale":"2024-09-17T05:22:21.295407+0000","last_undegraded":"2024-09-17T05:22:21.295407+0000","last_fullsized":"2024-09-17T05:22:21.295407+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:27:55.139854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433175+0000","last_change":"2024-09-17T05:22:19.439603+0000","last_active":"2024-09-17T05:22:20.433175+0000","last_peered":"2024-09-17T05:22:20.433175+0000","last_clean":"2024-09-17T05:22:20.433175+0000","last_became_active":"2024-09-17T05:22:19.439330+0000","last_became_peered":"2024-09-17T05:22:19.439330+0000","last_unstale":"2024-09-17T05:22:20.433175+0000","last_undegraded":"2024-09-17T05:22:20.433175+0000","last_fullsized":"2024-09-17T05:22:20.433175+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:03:11.001407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"68'6","reported_seq":21,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296073+0000","last_change":"2024-09-17T05:22:18.424114+0000","last_active":"2024-09-17T05:22:21.296073+0000","last_peered":"2024-09-17T05:22:21.296073+0000","last_clean":"2024-09-17T05:22:21.296073+0000","last_became_active":"2024-09-17T05:22:18.423841+0000","last_became_peered":"2024-09-17T05:22:18.423841+0000","last_unstale":"2024-09-17T05:22:21.296073+0000","last_undegraded":"2024-09-17T05:22:21.296073+0000","last_fullsized":"2024-09-17T05:22:21.296073+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029395+0000","last_change":"2024-09-17T05:22:19.438635+0000","last_active":"2024-09-17T05:22:21.029395+0000","last_peered":"2024-09-17T05:22:21.029395+0000","last_clean":"2024-09-17T05:22:21.029395+0000","last_became_active":"2024-09-17T05:22:19.438317+0000","last_became_peered":"2024-09-17T05:22:19.438317+0000","last_unstale":"2024-09-17T05:22:21.029395+0000","last_undegraded":"2024-09-17T05:22:21.029395+0000","last_fullsized":"2024-09-17T05:22:21.029395+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:16.873928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295623+0000","last_change":"2024-09-17T05:22:18.430649+0000","last_active":"2024-09-17T05:22:21.295623+0000","last_peered":"2024-09-17T05:22:21.295623+0000","last_clean":"2024-09-17T05:22:21.295623+0000","last_became_active":"2024-09-17T05:22:18.430347+0000","last_became_peered":"2024-09-17T05:22:18.430347+0000","last_unstale":"2024-09-17T05:22:21.295623+0000","last_undegraded":"2024-09-17T05:22:21.295623+0000","last_fullsized":"2024-09-17T05:22:21.295623+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:35.076714+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007332+0000","last_change":"2024-09-17T05:22:19.435957+0000","last_active":"2024-09-17T05:22:21.007332+0000","last_peered":"2024-09-17T05:22:21.007332+0000","last_clean":"2024-09-17T05:22:21.007332+0000","last_became_active":"2024-09-17T05:22:19.435711+0000","last_became_peered":"2024-09-17T05:22:19.435711+0000","last_unstale":"2024-09-17T05:22:21.007332+0000","last_undegraded":"2024-09-17T05:22:21.007332+0000","last_fullsized":"2024-09-17T05:22:21.007332+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:54:14.631571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436227+0000","last_change":"2024-09-17T05:22:18.432090+0000","last_active":"2024-09-17T05:22:20.436227+0000","last_peered":"2024-09-17T05:22:20.436227+0000","last_clean":"2024-09-17T05:22:20.436227+0000","last_became_active":"2024-09-17T05:22:18.431771+0000","last_became_peered":"2024-09-17T05:22:18.431771+0000","last_unstale":"2024-09-17T05:22:20.436227+0000","last_undegraded":"2024-09-17T05:22:20.436227+0000","last_fullsized":"2024-09-17T05:22:20.436227+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:19:26.966895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294932+0000","last_change":"2024-09-17T05:22:19.443096+0000","last_active":"2024-09-17T05:22:21.294932+0000","last_peered":"2024-09-17T05:22:21.294932+0000","last_clean":"2024-09-17T05:22:21.294932+0000","last_became_active":"2024-09-17T05:22:19.442871+0000","last_became_peered":"2024-09-17T05:22:19.442871+0000","last_unstale":"2024-09-17T05:22:21.294932+0000","last_undegraded":"2024-09-17T05:22:21.294932+0000","last_fullsized":"2024-09-17T05:22:21.294932+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:35.099482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007157+0000","last_change":"2024-09-17T05:22:18.438120+0000","last_active":"2024-09-17T05:22:21.007157+0000","last_peered":"2024-09-17T05:22:21.007157+0000","last_clean":"2024-09-17T05:22:21.007157+0000","last_became_active":"2024-09-17T05:22:18.437867+0000","last_became_peered":"2024-09-17T05:22:18.437867+0000","last_unstale":"2024-09-17T05:22:21.007157+0000","last_undegraded":"2024-09-17T05:22:21.007157+0000","last_fullsized":"2024-09-17T05:22:21.007157+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:49:25.421633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433049+0000","last_change":"2024-09-17T05:22:19.428773+0000","last_active":"2024-09-17T05:22:20.433049+0000","last_peered":"2024-09-17T05:22:20.433049+0000","last_clean":"2024-09-17T05:22:20.433049+0000","last_became_active":"2024-09-17T05:22:19.427978+0000","last_became_peered":"2024-09-17T05:22:19.427978+0000","last_unstale":"2024-09-17T05:22:20.433049+0000","last_undegraded":"2024-09-17T05:22:20.433049+0000","last_fullsized":"2024-09-17T05:22:20.433049+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:46:01.994688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"68'8","reported_seq":23,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434550+0000","last_change":"2024-09-17T05:22:18.430819+0000","last_active":"2024-09-17T05:22:20.434550+0000","last_peered":"2024-09-17T05:22:20.434550+0000","last_clean":"2024-09-17T05:22:20.434550+0000","last_became_active":"2024-09-17T05:22:18.430534+0000","last_became_peered":"2024-09-17T05:22:18.430534+0000","last_unstale":"2024-09-17T05:22:20.434550+0000","last_undegraded":"2024-09-17T05:22:20.434550+0000","last_fullsized":"2024-09-17T05:22:20.434550+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:23.764199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435617+0000","last_change":"2024-09-17T05:22:19.437170+0000","last_active":"2024-09-17T05:22:20.435617+0000","last_peered":"2024-09-17T05:22:20.435617+0000","last_clean":"2024-09-17T05:22:20.435617+0000","last_became_active":"2024-09-17T05:22:19.436924+0000","last_became_peered":"2024-09-17T05:22:19.436924+0000","last_unstale":"2024-09-17T05:22:20.435617+0000","last_undegraded":"2024-09-17T05:22:20.435617+0000","last_fullsized":"2024-09-17T05:22:20.435617+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:25.019162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436440+0000","last_change":"2024-09-17T05:22:18.426844+0000","last_active":"2024-09-17T05:22:20.436440+0000","last_peered":"2024-09-17T05:22:20.436440+0000","last_clean":"2024-09-17T05:22:20.436440+0000","last_became_active":"2024-09-17T05:22:18.426464+0000","last_became_peered":"2024-09-17T05:22:18.426464+0000","last_unstale":"2024-09-17T05:22:20.436440+0000","last_undegraded":"2024-09-17T05:22:20.436440+0000","last_fullsized":"2024-09-17T05:22:20.436440+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:42.575528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.030025+0000","last_change":"2024-09-17T05:22:19.445918+0000","last_active":"2024-09-17T05:22:21.030025+0000","last_peered":"2024-09-17T05:22:21.030025+0000","last_clean":"2024-09-17T05:22:21.030025+0000","last_became_active":"2024-09-17T05:22:19.445591+0000","last_became_peered":"2024-09-17T05:22:19.445591+0000","last_unstale":"2024-09-17T05:22:21.030025+0000","last_undegraded":"2024-09-17T05:22:21.030025+0000","last_fullsized":"2024-09-17T05:22:21.030025+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:19:10.894386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.435745+0000","last_change":"2024-09-17T05:22:18.428672+0000","last_active":"2024-09-17T05:22:20.435745+0000","last_peered":"2024-09-17T05:22:20.435745+0000","last_clean":"2024-09-17T05:22:20.435745+0000","last_became_active":"2024-09-17T05:22:18.428286+0000","last_became_peered":"2024-09-17T05:22:18.428286+0000","last_unstale":"2024-09-17T05:22:20.435745+0000","last_undegraded":"2024-09-17T05:22:20.435745+0000","last_fullsized":"2024-09-17T05:22:20.435745+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:45:01.168568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.296016+0000","last_change":"2024-09-17T05:22:19.445238+0000","last_active":"2024-09-17T05:22:21.296016+0000","last_peered":"2024-09-17T05:22:21.296016+0000","last_clean":"2024-09-17T05:22:21.296016+0000","last_became_active":"2024-09-17T05:22:19.444427+0000","last_became_peered":"2024-09-17T05:22:19.444427+0000","last_unstale":"2024-09-17T05:22:21.296016+0000","last_undegraded":"2024-09-17T05:22:21.296016+0000","last_fullsized":"2024-09-17T05:22:21.296016+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:09:15.940887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"68'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436323+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436323+0000","last_peered":"2024-09-17T05:22:20.436323+0000","last_clean":"2024-09-17T05:22:20.436323+0000","last_became_active":"2024-09-17T05:22:18.425366+0000","last_became_peered":"2024-09-17T05:22:18.425366+0000","last_unstale":"2024-09-17T05:22:20.436323+0000","last_undegraded":"2024-09-17T05:22:20.436323+0000","last_fullsized":"2024-09-17T05:22:20.436323+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:52:31.206646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433306+0000","last_change":"2024-09-17T05:22:19.431613+0000","last_active":"2024-09-17T05:22:20.433306+0000","last_peered":"2024-09-17T05:22:20.433306+0000","last_clean":"2024-09-17T05:22:20.433306+0000","last_became_active":"2024-09-17T05:22:19.431303+0000","last_became_peered":"2024-09-17T05:22:19.431303+0000","last_unstale":"2024-09-17T05:22:20.433306+0000","last_undegraded":"2024-09-17T05:22:20.433306+0000","last_fullsized":"2024-09-17T05:22:20.433306+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:33.110557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029435+0000","last_change":"2024-09-17T05:22:18.433627+0000","last_active":"2024-09-17T05:22:21.029435+0000","last_peered":"2024-09-17T05:22:21.029435+0000","last_clean":"2024-09-17T05:22:21.029435+0000","last_became_active":"2024-09-17T05:22:18.433349+0000","last_became_peered":"2024-09-17T05:22:18.433349+0000","last_unstale":"2024-09-17T05:22:21.029435+0000","last_undegraded":"2024-09-17T05:22:21.029435+0000","last_fullsized":"2024-09-17T05:22:21.029435+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295581+0000","last_change":"2024-09-17T05:22:19.436894+0000","last_active":"2024-09-17T05:22:21.295581+0000","last_peered":"2024-09-17T05:22:21.295581+0000","last_clean":"2024-09-17T05:22:21.295581+0000","last_became_active":"2024-09-17T05:22:19.436645+0000","last_became_peered":"2024-09-17T05:22:19.436645+0000","last_unstale":"2024-09-17T05:22:21.295581+0000","last_undegraded":"2024-09-17T05:22:21.295581+0000","last_fullsized":"2024-09-17T05:22:21.295581+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:03.311936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436274+0000","last_change":"2024-09-17T05:22:18.431369+0000","last_active":"2024-09-17T05:22:20.436274+0000","last_peered":"2024-09-17T05:22:20.436274+0000","last_clean":"2024-09-17T05:22:20.436274+0000","last_became_active":"2024-09-17T05:22:18.429959+0000","last_became_peered":"2024-09-17T05:22:18.429959+0000","last_unstale":"2024-09-17T05:22:20.436274+0000","last_undegraded":"2024-09-17T05:22:20.436274+0000","last_fullsized":"2024-09-17T05:22:20.436274+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:11:00.646703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294832+0000","last_change":"2024-09-17T05:22:19.432750+0000","last_active":"2024-09-17T05:22:21.294832+0000","last_peered":"2024-09-17T05:22:21.294832+0000","last_clean":"2024-09-17T05:22:21.294832+0000","last_became_active":"2024-09-17T05:22:19.432494+0000","last_became_peered":"2024-09-17T05:22:19.432494+0000","last_unstale":"2024-09-17T05:22:21.294832+0000","last_undegraded":"2024-09-17T05:22:21.294832+0000","last_fullsized":"2024-09-17T05:22:21.294832+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:08.854203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007473+0000","last_change":"2024-09-17T05:22:18.434348+0000","last_active":"2024-09-17T05:22:21.007473+0000","last_peered":"2024-09-17T05:22:21.007473+0000","last_clean":"2024-09-17T05:22:21.007473+0000","last_became_active":"2024-09-17T05:22:18.434070+0000","last_became_peered":"2024-09-17T05:22:18.434070+0000","last_unstale":"2024-09-17T05:22:21.007473+0000","last_undegraded":"2024-09-17T05:22:21.007473+0000","last_fullsized":"2024-09-17T05:22:21.007473+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:54:07.728571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295990+0000","last_change":"2024-09-17T05:22:19.433227+0000","last_active":"2024-09-17T05:22:21.295990+0000","last_peered":"2024-09-17T05:22:21.295990+0000","last_clean":"2024-09-17T05:22:21.295990+0000","last_became_active":"2024-09-17T05:22:19.432973+0000","last_became_peered":"2024-09-17T05:22:19.432973+0000","last_unstale":"2024-09-17T05:22:21.295990+0000","last_undegraded":"2024-09-17T05:22:21.295990+0000","last_fullsized":"2024-09-17T05:22:21.295990+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:44.832519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294686+0000","last_change":"2024-09-17T05:22:18.432573+0000","last_active":"2024-09-17T05:22:21.294686+0000","last_peered":"2024-09-17T05:22:21.294686+0000","last_clean":"2024-09-17T05:22:21.294686+0000","last_became_active":"2024-09-17T05:22:18.432245+0000","last_became_peered":"2024-09-17T05:22:18.432245+0000","last_unstale":"2024-09-17T05:22:21.294686+0000","last_undegraded":"2024-09-17T05:22:21.294686+0000","last_fullsized":"2024-09-17T05:22:21.294686+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:25.972053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295569+0000","last_change":"2024-09-17T05:22:19.443549+0000","last_active":"2024-09-17T05:22:21.295569+0000","last_peered":"2024-09-17T05:22:21.295569+0000","last_clean":"2024-09-17T05:22:21.295569+0000","last_became_active":"2024-09-17T05:22:19.443162+0000","last_became_peered":"2024-09-17T05:22:19.443162+0000","last_unstale":"2024-09-17T05:22:21.295569+0000","last_undegraded":"2024-09-17T05:22:21.295569+0000","last_fullsized":"2024-09-17T05:22:21.295569+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:00.541979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436476+0000","last_change":"2024-09-17T05:22:18.425902+0000","last_active":"2024-09-17T05:22:20.436476+0000","last_peered":"2024-09-17T05:22:20.436476+0000","last_clean":"2024-09-17T05:22:20.436476+0000","last_became_active":"2024-09-17T05:22:18.425188+0000","last_became_peered":"2024-09-17T05:22:18.425188+0000","last_unstale":"2024-09-17T05:22:20.436476+0000","last_undegraded":"2024-09-17T05:22:20.436476+0000","last_fullsized":"2024-09-17T05:22:20.436476+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:53.421290+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.007439+0000","last_change":"2024-09-17T05:22:19.440882+0000","last_active":"2024-09-17T05:22:21.007439+0000","last_peered":"2024-09-17T05:22:21.007439+0000","last_clean":"2024-09-17T05:22:21.007439+0000","last_became_active":"2024-09-17T05:22:19.440554+0000","last_became_peered":"2024-09-17T05:22:19.440554+0000","last_unstale":"2024-09-17T05:22:21.007439+0000","last_undegraded":"2024-09-17T05:22:21.007439+0000","last_fullsized":"2024-09-17T05:22:21.007439+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:20.278246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"69'1","reported_seq":16,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.420404+0000","last_change":"2024-09-17T05:22:18.438129+0000","last_active":"2024-09-17T05:22:21.420404+0000","last_peered":"2024-09-17T05:22:21.420404+0000","last_clean":"2024-09-17T05:22:21.420404+0000","last_became_active":"2024-09-17T05:22:18.437872+0000","last_became_peered":"2024-09-17T05:22:18.437872+0000","last_unstale":"2024-09-17T05:22:21.420404+0000","last_undegraded":"2024-09-17T05:22:21.420404+0000","last_fullsized":"2024-09-17T05:22:21.420404+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:01.605305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029489+0000","last_change":"2024-09-17T05:22:19.436359+0000","last_active":"2024-09-17T05:22:21.029489+0000","last_peered":"2024-09-17T05:22:21.029489+0000","last_clean":"2024-09-17T05:22:21.029489+0000","last_became_active":"2024-09-17T05:22:19.435752+0000","last_became_peered":"2024-09-17T05:22:19.435752+0000","last_unstale":"2024-09-17T05:22:21.029489+0000","last_undegraded":"2024-09-17T05:22:21.029489+0000","last_fullsized":"2024-09-17T05:22:21.029489+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:33:33.861562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433248+0000","last_change":"2024-09-17T05:22:18.429079+0000","last_active":"2024-09-17T05:22:20.433248+0000","last_peered":"2024-09-17T05:22:20.433248+0000","last_clean":"2024-09-17T05:22:20.433248+0000","last_became_active":"2024-09-17T05:22:18.428828+0000","last_became_peered":"2024-09-17T05:22:18.428828+0000","last_unstale":"2024-09-17T05:22:20.433248+0000","last_undegraded":"2024-09-17T05:22:20.433248+0000","last_fullsized":"2024-09-17T05:22:20.433248+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:32.986062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029857+0000","last_change":"2024-09-17T05:22:19.436981+0000","last_active":"2024-09-17T05:22:21.029857+0000","last_peered":"2024-09-17T05:22:21.029857+0000","last_clean":"2024-09-17T05:22:21.029857+0000","last_became_active":"2024-09-17T05:22:19.436256+0000","last_became_peered":"2024-09-17T05:22:19.436256+0000","last_unstale":"2024-09-17T05:22:21.029857+0000","last_undegraded":"2024-09-17T05:22:21.029857+0000","last_fullsized":"2024-09-17T05:22:21.029857+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:36.324734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295358+0000","last_change":"2024-09-17T05:22:18.429253+0000","last_active":"2024-09-17T05:22:21.295358+0000","last_peered":"2024-09-17T05:22:21.295358+0000","last_clean":"2024-09-17T05:22:21.295358+0000","last_became_active":"2024-09-17T05:22:18.428966+0000","last_became_peered":"2024-09-17T05:22:18.428966+0000","last_unstale":"2024-09-17T05:22:21.295358+0000","last_undegraded":"2024-09-17T05:22:21.295358+0000","last_fullsized":"2024-09-17T05:22:21.295358+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:22:21.497094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433029+0000","last_change":"2024-09-17T05:22:19.428711+0000","last_active":"2024-09-17T05:22:20.433029+0000","last_peered":"2024-09-17T05:22:20.433029+0000","last_clean":"2024-09-17T05:22:20.433029+0000","last_became_active":"2024-09-17T05:22:19.428345+0000","last_became_peered":"2024-09-17T05:22:19.428345+0000","last_unstale":"2024-09-17T05:22:20.433029+0000","last_undegraded":"2024-09-17T05:22:20.433029+0000","last_fullsized":"2024-09-17T05:22:20.433029+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:48:34.010700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.433341+0000","last_change":"2024-09-17T05:22:18.435789+0000","last_active":"2024-09-17T05:22:20.433341+0000","last_peered":"2024-09-17T05:22:20.433341+0000","last_clean":"2024-09-17T05:22:20.433341+0000","last_became_active":"2024-09-17T05:22:18.435509+0000","last_became_peered":"2024-09-17T05:22:18.435509+0000","last_unstale":"2024-09-17T05:22:20.433341+0000","last_undegraded":"2024-09-17T05:22:20.433341+0000","last_fullsized":"2024-09-17T05:22:20.433341+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:46:07.895200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436640+0000","last_change":"2024-09-17T05:22:19.440009+0000","last_active":"2024-09-17T05:22:20.436640+0000","last_peered":"2024-09-17T05:22:20.436640+0000","last_clean":"2024-09-17T05:22:20.436640+0000","last_became_active":"2024-09-17T05:22:19.439695+0000","last_became_peered":"2024-09-17T05:22:19.439695+0000","last_unstale":"2024-09-17T05:22:20.436640+0000","last_undegraded":"2024-09-17T05:22:20.436640+0000","last_fullsized":"2024-09-17T05:22:20.436640+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:10.705338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295403+0000","last_change":"2024-09-17T05:22:18.429070+0000","last_active":"2024-09-17T05:22:21.295403+0000","last_peered":"2024-09-17T05:22:21.295403+0000","last_clean":"2024-09-17T05:22:21.295403+0000","last_became_active":"2024-09-17T05:22:18.428814+0000","last_became_peered":"2024-09-17T05:22:18.428814+0000","last_unstale":"2024-09-17T05:22:21.295403+0000","last_undegraded":"2024-09-17T05:22:21.295403+0000","last_fullsized":"2024-09-17T05:22:21.295403+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:58.148752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.295114+0000","last_change":"2024-09-17T05:22:19.441198+0000","last_active":"2024-09-17T05:22:21.295114+0000","last_peered":"2024-09-17T05:22:21.295114+0000","last_clean":"2024-09-17T05:22:21.295114+0000","last_became_active":"2024-09-17T05:22:19.440716+0000","last_became_peered":"2024-09-17T05:22:19.440716+0000","last_unstale":"2024-09-17T05:22:21.295114+0000","last_undegraded":"2024-09-17T05:22:21.295114+0000","last_fullsized":"2024-09-17T05:22:21.295114+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:23:39.204819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.434595+0000","last_change":"2024-09-17T05:22:18.428067+0000","last_active":"2024-09-17T05:22:20.434595+0000","last_peered":"2024-09-17T05:22:20.434595+0000","last_clean":"2024-09-17T05:22:20.434595+0000","last_became_active":"2024-09-17T05:22:18.427698+0000","last_became_peered":"2024-09-17T05:22:18.427698+0000","last_unstale":"2024-09-17T05:22:20.434595+0000","last_undegraded":"2024-09-17T05:22:20.434595+0000","last_fullsized":"2024-09-17T05:22:20.434595+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:05:26.273038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436113+0000","last_change":"2024-09-17T05:22:19.428856+0000","last_active":"2024-09-17T05:22:20.436113+0000","last_peered":"2024-09-17T05:22:20.436113+0000","last_clean":"2024-09-17T05:22:20.436113+0000","last_became_active":"2024-09-17T05:22:19.428509+0000","last_became_peered":"2024-09-17T05:22:19.428509+0000","last_unstale":"2024-09-17T05:22:20.436113+0000","last_undegraded":"2024-09-17T05:22:20.436113+0000","last_fullsized":"2024-09-17T05:22:20.436113+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:04.873956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":15,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436222+0000","last_change":"2024-09-17T05:22:18.427604+0000","last_active":"2024-09-17T05:22:20.436222+0000","last_peered":"2024-09-17T05:22:20.436222+0000","last_clean":"2024-09-17T05:22:20.436222+0000","last_became_active":"2024-09-17T05:22:18.427324+0000","last_became_peered":"2024-09-17T05:22:18.427324+0000","last_unstale":"2024-09-17T05:22:20.436222+0000","last_undegraded":"2024-09-17T05:22:20.436222+0000","last_fullsized":"2024-09-17T05:22:20.436222+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:54.627943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":13,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.294931+0000","last_change":"2024-09-17T05:22:19.439418+0000","last_active":"2024-09-17T05:22:21.294931+0000","last_peered":"2024-09-17T05:22:21.294931+0000","last_clean":"2024-09-17T05:22:21.294931+0000","last_became_active":"2024-09-17T05:22:19.439146+0000","last_became_peered":"2024-09-17T05:22:19.439146+0000","last_unstale":"2024-09-17T05:22:21.294931+0000","last_undegraded":"2024-09-17T05:22:21.294931+0000","last_fullsized":"2024-09-17T05:22:21.294931+0000","mapping_epoch":67,"log_start":"0'0","ondisk_log_start":"0'0","created":67,"last_epoch_clean":68,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:18.404765+0000","last_clean_scrub_stamp":"2024-09-17T05:22:18.404765+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:18:01.545980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"68'2","reported_seq":17,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:20.436507+0000","last_change":"2024-09-17T05:22:18.428890+0000","last_active":"2024-09-17T05:22:20.436507+0000","last_peered":"2024-09-17T05:22:20.436507+0000","last_clean":"2024-09-17T05:22:20.436507+0000","last_became_active":"2024-09-17T05:22:18.428073+0000","last_became_peered":"2024-09-17T05:22:18.428073+0000","last_unstale":"2024-09-17T05:22:20.436507+0000","last_undegraded":"2024-09-17T05:22:20.436507+0000","last_fullsized":"2024-09-17T05:22:20.436507+0000","mapping_epoch":66,"log_start":"0'0","ondisk_log_start":"0'0","created":66,"last_epoch_clean":67,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:17.402832+0000","last_clean_scrub_stamp":"2024-09-17T05:22:17.402832+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:19.470799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"19'72","reported_seq":192,"reported_epoch":69,"state":"active+clean","last_fresh":"2024-09-17T05:22:21.029128+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:22:21.029128+0000","last_peered":"2024-09-17T05:22:21.029128+0000","last_clean":"2024-09-17T05:22:21.029128+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:22:21.029128+0000","last_undegraded":"2024-09-17T05:22:21.029128+0000","last_fullsized":"2024-09-17T05:22:21.029128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509489,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28428,"kb_used_data":1400,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343412,"statfs":{"total":96636764160,"available":96607653888,"internally_reserved":0,"allocated":1433600,"data_stored":937153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509489,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":346261,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509488,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27836,"kb_used_data":804,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344004,"statfs":{"total":96636764160,"available":96608260096,"internally_reserved":0,"allocated":823296,"data_stored":339959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509488,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27844,"kb_used_data":816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343996,"statfs":{"total":96636764160,"available":96608251904,"internally_reserved":0,"allocated":835584,"data_stored":346239,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509488,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32004,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339836,"statfs":{"total":96636764160,"available":96603992064,"internally_reserved":0,"allocated":827392,"data_stored":339981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509489,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27856,"kb_used_data":824,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343984,"statfs":{"total":96636764160,"available":96608239616,"internally_reserved":0,"allocated":843776,"data_stored":347781,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509488,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27848,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343992,"statfs":{"total":96636764160,"available":96608247808,"internally_reserved":0,"allocated":839680,"data_stored":342097,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574897,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32580,"kb_used_data":1392,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339260,"statfs":{"total":96636764160,"available":96603402240,"internally_reserved":0,"allocated":1425408,"data_stored":936537,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":2228,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":10,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":11,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:22:27.107 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:22:27.108 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:22:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.253+0000 7f1af9d32640 1 -- 172.21.15.81:0/3512916329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 msgr2=0x7f1adc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.253+0000 7f1af9d32640 1 --2- 172.21.15.81:0/3512916329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 0x7f1adc004c80 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8001830 tx=0x7f1adc005830 comp rx=0 tx=0).stop 2024-09-17T05:22:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.253+0000 7f1af3fff640 1 -- 172.21.15.81:0/3512916329 reap_dead start 2024-09-17T05:22:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.253+0000 7f1af9d32640 1 -- 172.21.15.81:0/3512916329 shutdown_connections 2024-09-17T05:22:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.253+0000 7f1af9d32640 1 -- 172.21.15.81:0/3512916329 >> 172.21.15.81:0/3512916329 conn(0x7f1af40b1700 msgr2=0x7f1af40b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.253+0000 7f1af9d32640 1 -- 172.21.15.81:0/3512916329 shutdown_connections 2024-09-17T05:22:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.253+0000 7f1af9d32640 1 -- 172.21.15.81:0/3512916329 wait complete. 2024-09-17T05:22:27.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.254+0000 7f1af9d32640 1 Processor -- start 2024-09-17T05:22:27.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.254+0000 7f1af9d32640 1 -- start start 2024-09-17T05:22:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af9d32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 0x7f1af40af050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af9d32640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1af414ed30 0x7f1af414e720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af9d32640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af40ad8b0 0x7f1af40c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af9d32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1af40ccb00 con 0x7f1adc004800 2024-09-17T05:22:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af9d32640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1af40cc980 con 0x7f1af40ad8b0 2024-09-17T05:22:27.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af9d32640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1af40ccc80 con 0x7f1af414ed30 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 0x7f1af40af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 0x7f1af40af050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47478/0 (socket says 172.21.15.81:47478) 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 -- 172.21.15.81:0/2854008120 learned_addr learned my addr 172.21.15.81:0/2854008120 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af2ffd640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1af414ed30 0x7f1af414e720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 -- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1af414ed30 msgr2=0x7f1af414e720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1af414ed30 0x7f1af414e720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 -- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af40ad8b0 msgr2=0x7f1af40c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af40ad8b0 0x7f1af40c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 -- 172.21.15.81:0/2854008120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1af40add30 con 0x7f1adc004800 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1af37fe640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 0x7f1af40af050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4011d60 tx=0x7f1ae400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1adbfff640 1 -- 172.21.15.81:0/2854008120 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4003d80 con 0x7f1adc004800 2024-09-17T05:22:27.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.255+0000 7f1adbfff640 1 -- 172.21.15.81:0/2854008120 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1ae4004b20 con 0x7f1adc004800 2024-09-17T05:22:27.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.256+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1af40adfb0 con 0x7f1adc004800 2024-09-17T05:22:27.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.256+0000 7f1adbfff640 1 -- 172.21.15.81:0/2854008120 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ae4004050 con 0x7f1adc004800 2024-09-17T05:22:27.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.256+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1af40ae570 con 0x7f1adc004800 2024-09-17T05:22:27.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.256+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1af4051400 con 0x7f1adc004800 2024-09-17T05:22:27.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.257+0000 7f1adbfff640 1 -- 172.21.15.81:0/2854008120 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f1ae40041f0 con 0x7f1adc004800 2024-09-17T05:22:27.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.257+0000 7f1adbfff640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ae0078f20 0x7f1ae007b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.258+0000 7f1adbfff640 1 -- 172.21.15.81:0/2854008120 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7f1ae409c370 con 0x7f1adc004800 2024-09-17T05:22:27.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.258+0000 7f1af2ffd640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ae0078f20 0x7f1ae007b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.258+0000 7f1af2ffd640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ae0078f20 0x7f1ae007b3e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8032000 tx=0x7f1ae8001360 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.262+0000 7f1adbfff640 1 -- 172.21.15.81:0/2854008120 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1af4051400 con 0x7f1adc004800 2024-09-17T05:22:27.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.512+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f1af40cb4c0 con 0x7f1adc004800 2024-09-17T05:22:27.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.514+0000 7f1adbfff640 1 -- 172.21.15.81:0/2854008120 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) ==== 190+0+147 (secure 0 0 0) 0x7f1af40add30 con 0x7f1adc004800 2024-09-17T05:22:27.515 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:22:27.515 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:22:27.515 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:22:27.515 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:22:27.515 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:22:27.516 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:22:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ae0078f20 msgr2=0x7f1ae007b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ae0078f20 0x7f1ae007b3e0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f1ae8032000 tx=0x7f1ae8001360 comp rx=0 tx=0).stop 2024-09-17T05:22:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 msgr2=0x7f1af40af050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 0x7f1af40af050 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f1ae4011d60 tx=0x7f1ae400f790 comp rx=0 tx=0).stop 2024-09-17T05:22:27.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 shutdown_connections 2024-09-17T05:22:27.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f1ae0078f20 0x7f1ae007b3e0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1af40ad8b0 0x7f1af40c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1af414ed30 0x7f1af414e720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 --2- 172.21.15.81:0/2854008120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1adc004800 0x7f1af40af050 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 >> 172.21.15.81:0/2854008120 conn(0x7f1af40b1700 msgr2=0x7f1af415c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 shutdown_connections 2024-09-17T05:22:27.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.516+0000 7f1af9d32640 1 -- 172.21.15.81:0/2854008120 wait complete. 2024-09-17T05:22:27.528 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.627+0000 7fa5d2cef640 1 -- 172.21.15.81:0/1758537667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 msgr2=0x7fa5cc0cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.627+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/1758537667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0cbb80 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0727b0 tx=0x7fa5b402a560 comp rx=0 tx=0).stop 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.627+0000 7fa5d2cef640 1 -- 172.21.15.81:0/1758537667 shutdown_connections 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.627+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/1758537667 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0cbb80 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.627+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/1758537667 >> v2:172.21.15.160:3300/0 conn(0x7fa5cc06f0b0 0x7fa5cc0cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.627+0000 7fa5d2cef640 1 -- 172.21.15.81:0/1758537667 >> 172.21.15.81:0/1758537667 conn(0x7fa5cc0741f0 msgr2=0x7fa5cc074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.628+0000 7fa5d2cef640 1 -- 172.21.15.81:0/1758537667 shutdown_connections 2024-09-17T05:22:27.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.628+0000 7fa5d2cef640 1 -- 172.21.15.81:0/1758537667 wait complete. 2024-09-17T05:22:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.629+0000 7fa5d2cef640 1 Processor -- start 2024-09-17T05:22:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.629+0000 7fa5d2cef640 1 -- start start 2024-09-17T05:22:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5cc06f0b0 0x7fa5cc0b2770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5cc06f490 0x7fa5cc0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc0cc0c0 con 0x7fa5cc0ce950 2024-09-17T05:22:27.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa5cc15e670 con 0x7fa5cc06f0b0 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa5cc0cc240 con 0x7fa5cc06f490 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47510/0 (socket says 172.21.15.81:47510) 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 -- 172.21.15.81:0/673065378 learned_addr learned my addr 172.21.15.81:0/673065378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d0a8b640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5cc06f0b0 0x7fa5cc0b2770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5cbfff640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5cc06f490 0x7fa5cc0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 -- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5cc06f490 msgr2=0x7fa5cc0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5cc06f490 0x7fa5cc0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 -- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5cc06f0b0 msgr2=0x7fa5cc0b2770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5cc06f0b0 0x7fa5cc0b2770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 -- 172.21.15.81:0/673065378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5cc0c5f30 con 0x7fa5cc0ce950 2024-09-17T05:22:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5cbfff640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5cc06f490 0x7fa5cc0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d128c640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0d0880 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4034040 tx=0x7fa5b4003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5c97fa640 1 -- 172.21.15.81:0/673065378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b403e030 con 0x7fa5cc0ce950 2024-09-17T05:22:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5c97fa640 1 -- 172.21.15.81:0/673065378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa5b4003e50 con 0x7fa5cc0ce950 2024-09-17T05:22:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa5cc1f8380 con 0x7fa5cc0ce950 2024-09-17T05:22:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5c97fa640 1 -- 172.21.15.81:0/673065378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5b4035040 con 0x7fa5cc0ce950 2024-09-17T05:22:27.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.630+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5cc1f8940 con 0x7fa5cc0ce950 2024-09-17T05:22:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.631+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5cc0cd3e0 con 0x7fa5cc0ce950 2024-09-17T05:22:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.632+0000 7fa5c97fa640 1 -- 172.21.15.81:0/673065378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fa5b4041030 con 0x7fa5cc0ce950 2024-09-17T05:22:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.632+0000 7fa5c97fa640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa5ac078ef0 0x7fa5ac07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.632+0000 7fa5c97fa640 1 -- 172.21.15.81:0/673065378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fa5b40bb970 con 0x7fa5cc0ce950 2024-09-17T05:22:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.633+0000 7fa5d0a8b640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa5ac078ef0 0x7fa5ac07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:27.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.633+0000 7fa5d0a8b640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa5ac078ef0 0x7fa5ac07b3b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0b1db0 tx=0x7fa5c400a2d0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:27.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.637+0000 7fa5c97fa640 1 -- 172.21.15.81:0/673065378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa5b4083920 con 0x7fa5cc0ce950 2024-09-17T05:22:27.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.848+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa5cc075070 con 0x7fa5cc0ce950 2024-09-17T05:22:27.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.848+0000 7fa5c97fa640 1 -- 172.21.15.81:0/673065378 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+5225 (secure 0 0 0) 0x7fa5b4083220 con 0x7fa5cc0ce950 2024-09-17T05:22:27.849 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:27.849 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":39,"btime":"2024-09-17T05:22:21:431616+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:27.850 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 39 2024-09-17T05:22:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa5ac078ef0 msgr2=0x7fa5ac07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa5ac078ef0 0x7fa5ac07b3b0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7fa5cc0b1db0 tx=0x7fa5c400a2d0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 msgr2=0x7fa5cc0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0d0880 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fa5b4034040 tx=0x7fa5b4003960 comp rx=0 tx=0).stop 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 shutdown_connections 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fa5ac078ef0 0x7fa5ac07b3b0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5cc0ce950 0x7fa5cc0d0880 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5cc06f490 0x7fa5cc0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 --2- 172.21.15.81:0/673065378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5cc06f0b0 0x7fa5cc0b2770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 >> 172.21.15.81:0/673065378 conn(0x7fa5cc0741f0 msgr2=0x7fa5cc0b58e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 shutdown_connections 2024-09-17T05:22:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:27.850+0000 7fa5d2cef640 1 -- 172.21.15.81:0/673065378 wait complete. 2024-09-17T05:22:28.264 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 39, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:22:18.771210+0000', 'modified': '2024-09-17T05:22:20.767341+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6183}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6183': {'gid': 6183, 'name': 'c', 'rank': 0, 'incarnation': 37, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.81:6834/603929383', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 603929383}, {'type': 'v1', 'addr': '172.21.15.81:6834', 'nonce': 603929383}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6183, 'qdb_cluster': [6183]} 2024-09-17T05:22:28.265 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:22:28.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 -- 172.21.15.81:0/1483422415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba94159680 msgr2=0x7fba9415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/1483422415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba94159680 0x7fba9415d270 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fba90009830 tx=0x7fba9002a510 comp rx=0 tx=0).stop 2024-09-17T05:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 -- 172.21.15.81:0/1483422415 shutdown_connections 2024-09-17T05:22:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/1483422415 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba940cc490 0x7fba9415f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/1483422415 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba94159680 0x7fba9415d270 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 -- 172.21.15.81:0/1483422415 >> 172.21.15.81:0/1483422415 conn(0x7fba940b1690 msgr2=0x7fba940b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 -- 172.21.15.81:0/1483422415 shutdown_connections 2024-09-17T05:22:28.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.367+0000 7fba9c5d3640 1 -- 172.21.15.81:0/1483422415 wait complete. 2024-09-17T05:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.368+0000 7fba9c5d3640 1 Processor -- start 2024-09-17T05:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.368+0000 7fba9c5d3640 1 -- start start 2024-09-17T05:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba940cc490 0x7fba941f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba940cc8d0 0x7fba940aa8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba94159680 0x7fba940aae10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba940cf350 con 0x7fba94159680 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba940cf1d0 con 0x7fba940cc8d0 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fba940cf4d0 con 0x7fba940cc490 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba94159680 0x7fba940aae10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba94159680 0x7fba940aae10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47516/0 (socket says 172.21.15.81:47516) 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 -- 172.21.15.81:0/197337615 learned_addr learned my addr 172.21.15.81:0/197337615 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba99b6e640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba940cc8d0 0x7fba940aa8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9a36f640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba940cc490 0x7fba941f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 -- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba940cc490 msgr2=0x7fba941f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba940cc490 0x7fba941f28c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 -- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba940cc8d0 msgr2=0x7fba940aa8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba940cc8d0 0x7fba940aa8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 -- 172.21.15.81:0/197337615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba940ab470 con 0x7fba94159680 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9ab70640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba94159680 0x7fba940aae10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00cbc0 tx=0x7fba8c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba8affd640 1 -- 172.21.15.81:0/197337615 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c016020 con 0x7fba94159680 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba8affd640 1 -- 172.21.15.81:0/197337615 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba8c00add0 con 0x7fba94159680 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba940a9630 con 0x7fba94159680 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba8affd640 1 -- 172.21.15.81:0/197337615 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c012680 con 0x7fba94159680 2024-09-17T05:22:28.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.369+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba940a9bf0 con 0x7fba94159680 2024-09-17T05:22:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.371+0000 7fba8affd640 1 -- 172.21.15.81:0/197337615 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fba8c019020 con 0x7fba94159680 2024-09-17T05:22:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.371+0000 7fba8affd640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba78078ef0 0x7fba7807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.372+0000 7fba8affd640 1 -- 172.21.15.81:0/197337615 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fba8c09b6a0 con 0x7fba94159680 2024-09-17T05:22:28.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.372+0000 7fba9a36f640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba78078ef0 0x7fba7807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.372+0000 7fba9a36f640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba78078ef0 0x7fba7807b3b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba90034000 tx=0x7fba90004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.372+0000 7fba9f47f740 1 Processor -- start 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9f47f740 1 -- start start 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadb83090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadb89310 0x562aadbab2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbce260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9f47f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aadafa820 con 0x562aadbaaef0 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562aadae9c50 con 0x562aadb89310 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x562aadaeda60 con 0x562aadbcddf0 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9a36f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadb83090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.373+0000 7fba9a36f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadb83090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47520/0 (socket says 172.21.15.81:47520) 2024-09-17T05:22:28.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9a36f640 1 -- 172.21.15.81:0/2360284910 learned_addr learned my addr 172.21.15.81:0/2360284910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba99b6e640 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadb89310 0x562aadbab2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9ab70640 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbce260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9a36f640 1 -- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 msgr2=0x562aadbce260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9a36f640 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbce260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9a36f640 1 -- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadb89310 msgr2=0x562aadbab2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9a36f640 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadb89310 0x562aadbab2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9a36f640 1 -- 172.21.15.81:0/2360284910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aad84b850 con 0x562aadbaaef0 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba9a36f640 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadb83090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fba9002ab00 tx=0x7fba90033050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d0d2ebb44b9e490 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba77fff640 1 -- 172.21.15.81:0/2360284910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90003970 con 0x562aadbaaef0 2024-09-17T05:22:28.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba77fff640 1 -- 172.21.15.81:0/2360284910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba90003c00 con 0x562aadbaaef0 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.374+0000 7fba77fff640 1 -- 172.21.15.81:0/2360284910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba900486b0 con 0x562aadbaaef0 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 -- 172.21.15.81:0/2360284910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 msgr2=0x562aadb83090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadb83090 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fba9002ab00 tx=0x7fba90033050 comp rx=0 tx=0).stop 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 -- 172.21.15.81:0/2360284910 shutdown_connections 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbce260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadb89310 0x562aadbab2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2360284910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadb83090 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 -- 172.21.15.81:0/2360284910 >> 172.21.15.81:0/2360284910 conn(0x562aadb846a0 msgr2=0x562aadb880c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 -- 172.21.15.81:0/2360284910 shutdown_connections 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 -- 172.21.15.81:0/2360284910 wait complete. 2024-09-17T05:22:28.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.375+0000 7fba9f47f740 1 -- start start 2024-09-17T05:22:28.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.376+0000 7fba9f47f740 1 Processor -- start 2024-09-17T05:22:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.376+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadba7bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.376+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbc8c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.376+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbc9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.376+0000 7fba9f47f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aad85a620 con 0x562aadbaaef0 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.376+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562aada8f5f0 con 0x562aadbc9950 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.376+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x562aadb835d0 con 0x562aadbcddf0 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9f47f740 10 client.0 _ll_register_callbacks cb 0x562aada930a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadba7bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadba7bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47530/0 (socket says 172.21.15.81:47530) 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 -- 172.21.15.81:0/1343914686 learned_addr learned my addr 172.21.15.81:0/1343914686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba99b6e640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbc8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9ab70640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbc9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 -- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 msgr2=0x562aadbc8c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbc8c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 -- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 msgr2=0x562aadbc9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbc9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 -- 172.21.15.81:0/1343914686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aad8c26b0 con 0x562aadbaaef0 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba99b6e640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbc8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9ab70640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbc9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9a36f640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadba7bf0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fba90000c00 tx=0x7fba90005b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=403dfa64490cd566 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba757fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba757fa640 1 -- 172.21.15.81:0/1343914686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba90048860 con 0x562aadbaaef0 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba757fa640 1 -- 172.21.15.81:0/1343914686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fba90048a00 con 0x562aadbaaef0 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba90003c00 con 0x562aadbaaef0 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba757fa640 1 -- 172.21.15.81:0/1343914686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fba90065050 con 0x562aadbaaef0 2024-09-17T05:22:28.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9f47f740 10 client.6342 fetch_fsmap learned FSMap version 39 2024-09-17T05:22:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x562aadba8dc0 con 0x562aadbaaef0 2024-09-17T05:22:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.377+0000 7fba757fa640 1 -- 172.21.15.81:0/1343914686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba90003c00 con 0x562aadbaaef0 2024-09-17T05:22:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba757fa640 1 -- 172.21.15.81:0/1343914686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 39) ==== 3502+0+0 (secure 0 0 0) 0x7fba90068020 con 0x562aadbaaef0 2024-09-17T05:22:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba9f47f740 10 client.6342 fetch_fsmap finished waiting for FSMap version 39 2024-09-17T05:22:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba9f47f740 10 client.6342 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:22:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba9f47f740 20 client.6342 populate_metadata read hostname 'smithi081' 2024-09-17T05:22:28.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba9f47f740 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadbcc810 0x562aadbccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba9f47f740 4 client.6342 mds_command: new command op to 6183 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:22:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 --> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562aadafc770 con 0x562aadbcc810 2024-09-17T05:22:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba99b6e640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadbcc810 0x562aadbccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba99b6e640 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadbcc810 0x562aadbccbf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf5f0eaf7600deb8 server_cookie=287133ae1e2ba714 in_seq=0 out_seq=0 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.378+0000 7fba757fa640 10 client.6342 ms_handle_connect on v2:172.21.15.81:6832/603929383 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba757fa640 1 -- 172.21.15.81:0/1343914686 <== mds.0 v2:172.21.15.81:6832/603929383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x562aadafc770 con 0x562aadbcc810 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba757fa640 10 client.6342 handle_command_reply: tid=0 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 client.6342 shutdown 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 msgr2=0x562aadba7bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadba7bf0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fba90000c00 tx=0x7fba90005b10 comp rx=0 tx=0).stop 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 shutdown_connections 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadbcc810 0x562aadbccbf0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbc9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbcddf0 0x562aadbc8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 --2- 172.21.15.81:0/1343914686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbaaef0 0x562aadba7bf0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba757fa640 0 client.6342 ms_handle_reset on v2:172.21.15.81:6832/603929383 2024-09-17T05:22:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 >> 172.21.15.81:0/1343914686 conn(0x562aadb89310 msgr2=0x562aadb872d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 shutdown_connections 2024-09-17T05:22:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 1 -- 172.21.15.81:0/1343914686 wait complete. 2024-09-17T05:22:28.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.379+0000 7fba9f47f740 20 client.6342 trim_cache size 0 max 16384 2024-09-17T05:22:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.397+0000 7fba9f47f740 1 Processor -- start 2024-09-17T05:22:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.397+0000 7fba9f47f740 1 -- start start 2024-09-17T05:22:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbaaef0 0x562aadc48840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbcced0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadbcd410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9f47f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba940b3e40 con 0x562aadbcddf0 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba94073310 con 0x562aadbc9950 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fba941f6230 con 0x562aadbaaef0 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadbcd410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadbcd410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47532/0 (socket says 172.21.15.81:47532) 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 -- 172.21.15.81:0/3734887240 learned_addr learned my addr 172.21.15.81:0/3734887240 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba99b6e640 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbcced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9a36f640 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbaaef0 0x562aadc48840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 -- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbaaef0 msgr2=0x562aadc48840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbaaef0 0x562aadc48840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 -- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 msgr2=0x562aadbcced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbcced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 -- 172.21.15.81:0/3734887240 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562aadb7dfa0 con 0x562aadbcddf0 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba9ab70640 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadbcd410 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00a930 tx=0x7fba8c062bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ce4e6055c1d6a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba777fe640 1 -- 172.21.15.81:0/3734887240 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c089070 con 0x562aadbcddf0 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba777fe640 1 -- 172.21.15.81:0/3734887240 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba8c067ac0 con 0x562aadbcddf0 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.398+0000 7fba777fe640 1 -- 172.21.15.81:0/3734887240 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c06c970 con 0x562aadbcddf0 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 -- 172.21.15.81:0/3734887240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 msgr2=0x562aadbcd410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadbcd410 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00a930 tx=0x7fba8c062bb0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 -- 172.21.15.81:0/3734887240 shutdown_connections 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadbcd410 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbc9950 0x562aadbcced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 --2- 172.21.15.81:0/3734887240 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbaaef0 0x562aadc48840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 -- 172.21.15.81:0/3734887240 >> 172.21.15.81:0/3734887240 conn(0x562aadb89310 msgr2=0x562aadba77e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 -- 172.21.15.81:0/3734887240 shutdown_connections 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 -- 172.21.15.81:0/3734887240 wait complete. 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.399+0000 7fba9f47f740 1 -- start start 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.400+0000 7fba9f47f740 1 Processor -- start 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.400+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbaaef0 0x562aadbc8270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.400+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbc9950 0x562aadc48680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.400+0000 7fba9f47f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadc559d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.400+0000 7fba9f47f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x562aadba9640 con 0x562aadbcddf0 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.400+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x562aad85a620 con 0x562aadbaaef0 2024-09-17T05:22:28.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.400+0000 7fba9f47f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x562aadbc9360 con 0x562aadbc9950 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9f47f740 10 client.0 _ll_register_callbacks cb 0x7fba800036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadc559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadc559d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47538/0 (socket says 172.21.15.81:47538) 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 -- 172.21.15.81:0/2309623877 learned_addr learned my addr 172.21.15.81:0/2309623877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9a36f640 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbaaef0 0x562aadbc8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba99b6e640 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbc9950 0x562aadc48680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 -- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbc9950 msgr2=0x562aadc48680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbc9950 0x562aadc48680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 -- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbaaef0 msgr2=0x562aadbc8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbaaef0 0x562aadbc8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 -- 172.21.15.81:0/2309623877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562aadc48bc0 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9ab70640 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadc559d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fba8c062f70 tx=0x7fba8c089410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2370aa1fe59ff341 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba757fa640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba757fa640 1 -- 172.21.15.81:0/2309623877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba8c081070 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba757fa640 1 -- 172.21.15.81:0/2309623877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(69..69 src has 1..69) ==== 5709+0+0 (secure 0 0 0) 0x7fba8c0853f0 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fba8c067ac0 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba757fa640 1 -- 172.21.15.81:0/2309623877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=39) ==== 24+0+0 (secure 0 0 0) 0x7fba8c089040 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9f47f740 10 client.6348 fetch_fsmap learned FSMap version 39 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=39,monmap=2+}) -- 0x562aadbcd4e0 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba757fa640 1 -- 172.21.15.81:0/2309623877 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba8c067ac0 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.401+0000 7fba757fa640 1 -- 172.21.15.81:0/2309623877 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 39) ==== 3502+0+0 (secure 0 0 0) 0x7fba8c06cbc0 con 0x562aadbcddf0 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 10 client.6348 fetch_fsmap finished waiting for FSMap version 39 2024-09-17T05:22:28.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 10 client.6348 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 20 client.6348 populate_metadata read hostname 'smithi081' 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadb81800 0x562aadbe2820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 4 client.6348 mds_command: new command op to 6183 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 --> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] -- command(tid 0: {"prefix": "status"}) -- 0x562aadaf8220 con 0x562aadb81800 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9a36f640 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadb81800 0x562aadbe2820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba757fa640 10 client.6348 ms_handle_connect on v2:172.21.15.81:6832/603929383 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9a36f640 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadb81800 0x562aadbe2820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59f1d907c1f9372c server_cookie=8756528acb3311e6 in_seq=0 out_seq=0 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba757fa640 1 -- 172.21.15.81:0/2309623877 <== mds.0 v2:172.21.15.81:6832/603929383 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x562aadaf8220 con 0x562aadb81800 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba757fa640 10 client.6348 handle_command_reply: tid=0 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 client.6348 shutdown 2024-09-17T05:22:28.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 msgr2=0x562aadc559d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadc559d0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7fba8c062f70 tx=0x7fba8c089410 comp rx=0 tx=0).stop 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 shutdown_connections 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:6832/603929383,v1:172.21.15.81:6834/603929383] conn(0x562aadb81800 0x562aadbe2820 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x562aadbcddf0 0x562aadc559d0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x562aadbc9950 0x562aadc48680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba757fa640 0 client.6348 ms_handle_reset on v2:172.21.15.81:6832/603929383 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 --2- 172.21.15.81:0/2309623877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x562aadbaaef0 0x562aadbc8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 >> 172.21.15.81:0/2309623877 conn(0x562aadb89310 msgr2=0x562aadbcb7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 shutdown_connections 2024-09-17T05:22:28.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.402+0000 7fba9f47f740 1 -- 172.21.15.81:0/2309623877 wait complete. 2024-09-17T05:22:28.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9f47f740 20 client.6348 trim_cache size 0 max 16384 2024-09-17T05:22:28.413 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:22:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:22:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:22:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6183, 2024-09-17T05:22:28.413 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 8.9881957359999998, 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 39, 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 69, 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 69, 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 13.736851027 2024-09-17T05:22:28.414 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:22:28.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba78078ef0 msgr2=0x7fba7807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba78078ef0 0x7fba7807b3b0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7fba90034000 tx=0x7fba90004730 comp rx=0 tx=0).stop 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba94159680 msgr2=0x7fba940aae10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba94159680 0x7fba940aae10 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7fba8c00cbc0 tx=0x7fba8c00a430 comp rx=0 tx=0).stop 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 shutdown_connections 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fba78078ef0 0x7fba7807b3b0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba94159680 0x7fba940aae10 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba940cc8d0 0x7fba940aa8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 --2- 172.21.15.81:0/197337615 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba940cc490 0x7fba941f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 >> 172.21.15.81:0/197337615 conn(0x7fba940b1690 msgr2=0x7fba94158970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 shutdown_connections 2024-09-17T05:22:28.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.403+0000 7fba9c5d3640 1 -- 172.21.15.81:0/197337615 wait complete. 2024-09-17T05:22:28.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:28.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.518+0000 7f2134d0e640 1 -- 172.21.15.81:0/2594875131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213015aa70 msgr2=0x7f21300b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.518+0000 7f2134d0e640 1 --2- 172.21.15.81:0/2594875131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213015aa70 0x7f21300b4690 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f2120005fd0 tx=0x7f212002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.519+0000 7f2134d0e640 1 -- 172.21.15.81:0/2594875131 shutdown_connections 2024-09-17T05:22:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.519+0000 7f2134d0e640 1 --2- 172.21.15.81:0/2594875131 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2130070690 0x7f21300739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.519+0000 7f2134d0e640 1 --2- 172.21.15.81:0/2594875131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f213015aa70 0x7f21300b4690 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.519+0000 7f2134d0e640 1 -- 172.21.15.81:0/2594875131 >> 172.21.15.81:0/2594875131 conn(0x7f21300b1690 msgr2=0x7f21300b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.519+0000 7f2134d0e640 1 -- 172.21.15.81:0/2594875131 shutdown_connections 2024-09-17T05:22:28.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.519+0000 7f2134d0e640 1 -- 172.21.15.81:0/2594875131 wait complete. 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.520+0000 7f2134d0e640 1 Processor -- start 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.520+0000 7f2134d0e640 1 -- start start 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f2134d0e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2130070690 0x7f21301e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f2134d0e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21300735a0 0x7f2130154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f2134d0e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f213015aa70 0x7f21300c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f2134d0e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f21300cd270 con 0x7f2130070690 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f2134d0e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21300cd0f0 con 0x7f213015aa70 2024-09-17T05:22:28.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f2134d0e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f21300cd3f0 con 0x7f21300735a0 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2130070690 0x7f21301e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2130070690 0x7f21301e6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47562/0 (socket says 172.21.15.81:47562) 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 -- 172.21.15.81:0/222211976 learned_addr learned my addr 172.21.15.81:0/222211976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212dd9b640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21300735a0 0x7f2130154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 -- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21300735a0 msgr2=0x7f2130154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21300735a0 0x7f2130154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 -- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f213015aa70 msgr2=0x7f21300c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f213015aa70 0x7f21300c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 -- 172.21.15.81:0/222211976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21301e6a40 con 0x7f2130070690 2024-09-17T05:22:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f212e59c640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2130070690 0x7f21301e6500 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2120034040 tx=0x7f21200035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f211effd640 1 -- 172.21.15.81:0/222211976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f212003e030 con 0x7f2130070690 2024-09-17T05:22:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.521+0000 7f211effd640 1 -- 172.21.15.81:0/222211976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2120003ae0 con 0x7f2130070690 2024-09-17T05:22:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.522+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2130154ba0 con 0x7f2130070690 2024-09-17T05:22:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.522+0000 7f211effd640 1 -- 172.21.15.81:0/222211976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2120035040 con 0x7f2130070690 2024-09-17T05:22:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.522+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21301f5ac0 con 0x7f2130070690 2024-09-17T05:22:28.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.523+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21300cd910 con 0x7f2130070690 2024-09-17T05:22:28.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.523+0000 7f211effd640 1 -- 172.21.15.81:0/222211976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f2120041030 con 0x7f2130070690 2024-09-17T05:22:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.524+0000 7f211effd640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2110078ef0 0x7f211007b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.524+0000 7f211effd640 1 -- 172.21.15.81:0/222211976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(70..70 src has 1..70) ==== 5767+0+0 (secure 0 0 0) 0x7f21200bbb80 con 0x7f2130070690 2024-09-17T05:22:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.524+0000 7f212dd9b640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2110078ef0 0x7f211007b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:28.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.525+0000 7f212dd9b640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2110078ef0 0x7f211007b3b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f21300cec50 tx=0x7f2124009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:28.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.528+0000 7f211effd640 1 -- 172.21.15.81:0/222211976 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2130154ba0 con 0x7f2130070690 2024-09-17T05:22:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.742+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f21300cede0 con 0x7f2130070690 2024-09-17T05:22:28.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.742+0000 7f211effd640 1 -- 172.21.15.81:0/222211976 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7f2120083af0 con 0x7f2130070690 2024-09-17T05:22:28.743 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:28.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2110078ef0 msgr2=0x7f211007b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2110078ef0 0x7f211007b3b0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f21300cec50 tx=0x7f2124009040 comp rx=0 tx=0).stop 2024-09-17T05:22:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2130070690 msgr2=0x7f21301e6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2130070690 0x7f21301e6500 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f2120034040 tx=0x7f21200035f0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 shutdown_connections 2024-09-17T05:22:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f2110078ef0 0x7f211007b3b0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f213015aa70 0x7f21300c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21300735a0 0x7f2130154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 --2- 172.21.15.81:0/222211976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2130070690 0x7f21301e6500 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 >> 172.21.15.81:0/222211976 conn(0x7f21300b1690 msgr2=0x7f213015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 shutdown_connections 2024-09-17T05:22:28.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28.744+0000 7f2134d0e640 1 -- 172.21.15.81:0/222211976 wait complete. 2024-09-17T05:22:28.756 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:22:28.756 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:28.756 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:22:28.756 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:22:28.756 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:28.756 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:22:28.757 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:22:28.757 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:28.757 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:28.757 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:28.757 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:22:28.773 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:28.773 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:28.774 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42569sec preferred_lft 42569sec 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:28.775 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:28.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:28.777 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:28.837 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:22:28.839 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:28.839 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:22:28.895 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:22:28.895 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:28.895 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:28.895 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:28.895 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:28.896 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:28.896 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:22:28.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:28.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:28.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:28.896 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:22:28.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:29.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:29.020 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:29.021 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:22:29.036 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:22:29.036 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:22:29.036 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:29.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:29.036 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:22:29.100 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:22:29.100 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:29.100 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:29.156 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:22:29.156 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:29.156 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:29.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:22:29.277 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:22:29.333 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:22:29.333 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:22:29.333 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:22:29.333 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:22:29.333 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:22:29.333 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:22:29.334 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:22:29.335 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:22:29.336 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:29.336 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:22:29.389 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:22:29.389 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:22:29.431 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:22:29.455 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:22:29.512 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:22:29.513 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:22:29.514 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:22:29.515 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:22:29.516 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:29.516 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:22:29.516 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:22:29.516 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:22:29.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:29.517 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:22:29.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:22:29.511+0000 7f1c9698a480 -1 init, newargv = 0x55613ad1a5e0 newargc=15 2024-09-17T05:22:29.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[58445]: starting ceph client 2024-09-17T05:22:29.518 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[58445]: starting fuse 2024-09-17T05:22:29.533 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:22:29.534 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:22:29.534 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:22:29.535 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:22:29.536 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:22:29.536 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:22:29.536 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:22:29.536 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:22:29.536 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:22:29.536 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:22:29.651 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.58445.asok 2024-09-17T05:22:29.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:29.662 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.58445.asok 2024-09-17T05:22:29.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:29.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.58445.asok status 2024-09-17T05:22:29.795 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:22:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:22:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:22:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:22:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:22:29.795 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "58445", 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6360, 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:22:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6360 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2550741218 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:22:29.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2550741218 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.6360 192.168.0.1:0/2550741218", 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2550741218", 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 39, 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 70, 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:22:29.798 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:22:29.803 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:29.803 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:22:29.804 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:29.819 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:22:29.820 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:29.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:29.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:29.886 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:22:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.025+0000 7fcc21060640 1 -- 172.21.15.81:0/99914969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc04003a30 msgr2=0x7fcc04003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:30.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.025+0000 7fcc21060640 1 --2- 172.21.15.81:0/99914969 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc04003a30 0x7fcc04003e50 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c001dc0 tx=0x7fcc04005830 comp rx=0 tx=0).stop 2024-09-17T05:22:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.025+0000 7fcc1b59e640 1 -- 172.21.15.81:0/99914969 reap_dead start 2024-09-17T05:22:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.025+0000 7fcc21060640 1 -- 172.21.15.81:0/99914969 shutdown_connections 2024-09-17T05:22:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.025+0000 7fcc21060640 1 -- 172.21.15.81:0/99914969 >> 172.21.15.81:0/99914969 conn(0x7fcc1c0b1690 msgr2=0x7fcc1c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.025+0000 7fcc21060640 1 -- 172.21.15.81:0/99914969 shutdown_connections 2024-09-17T05:22:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.025+0000 7fcc21060640 1 -- 172.21.15.81:0/99914969 wait complete. 2024-09-17T05:22:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 Processor -- start 2024-09-17T05:22:30.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 -- start start 2024-09-17T05:22:30.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc04003a30 0x7fcc1c152370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:30.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1c13ec90 0x7fcc1c1543c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:30.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc1c154900 0x7fcc1c15ad50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:30.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0ceac0 con 0x7fcc1c154900 2024-09-17T05:22:30.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcc1c0ccb10 con 0x7fcc04003a30 2024-09-17T05:22:30.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc21060640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcc1c0cec40 con 0x7fcc1c13ec90 2024-09-17T05:22:30.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.027+0000 7fcc1b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc1c154900 0x7fcc1c15ad50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc1c154900 0x7fcc1c15ad50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47574/0 (socket says 172.21.15.81:47574) 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 -- 172.21.15.81:0/1465829728 learned_addr learned my addr 172.21.15.81:0/1465829728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1a59c640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1c13ec90 0x7fcc1c1543c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1ad9d640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc04003a30 0x7fcc1c152370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 -- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1c13ec90 msgr2=0x7fcc1c1543c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1c13ec90 0x7fcc1c1543c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 -- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc04003a30 msgr2=0x7fcc1c152370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc04003a30 0x7fcc1c152370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 -- 172.21.15.81:0/1465829728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc1c14f980 con 0x7fcc1c154900 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc1b59e640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc1c154900 0x7fcc1c15ad50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcc140058c0 tx=0x7fcc1400fa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:30.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc037fe640 1 -- 172.21.15.81:0/1465829728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14004230 con 0x7fcc1c154900 2024-09-17T05:22:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc037fe640 1 -- 172.21.15.81:0/1465829728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcc14005020 con 0x7fcc1c154900 2024-09-17T05:22:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc1c1f6f20 con 0x7fcc1c154900 2024-09-17T05:22:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc037fe640 1 -- 172.21.15.81:0/1465829728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc14005470 con 0x7fcc1c154900 2024-09-17T05:22:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.028+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc1c14ff20 con 0x7fcc1c154900 2024-09-17T05:22:30.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.029+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc1c0cf1d0 con 0x7fcc1c154900 2024-09-17T05:22:30.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.030+0000 7fcc037fe640 1 -- 172.21.15.81:0/1465829728 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fcc14019070 con 0x7fcc1c154900 2024-09-17T05:22:30.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.030+0000 7fcc037fe640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcc08078f20 0x7fcc0807b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:30.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.030+0000 7fcc037fe640 1 -- 172.21.15.81:0/1465829728 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fcc1409b5b0 con 0x7fcc1c154900 2024-09-17T05:22:30.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.031+0000 7fcc1ad9d640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcc08078f20 0x7fcc0807b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:30.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.031+0000 7fcc1ad9d640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcc08078f20 0x7fcc0807b3e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c032000 tx=0x7fcc0c001510 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:30.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.035+0000 7fcc037fe640 1 -- 172.21.15.81:0/1465829728 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcc14062f60 con 0x7fcc1c154900 2024-09-17T05:22:30.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.247+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fcc1c15c170 con 0x7fcc1c154900 2024-09-17T05:22:30.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.248+0000 7fcc037fe640 1 -- 172.21.15.81:0/1465829728 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v39) ==== 53+0+73 (secure 0 0 0) 0x7fcc14067990 con 0x7fcc1c154900 2024-09-17T05:22:30.249 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:22:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcc08078f20 msgr2=0x7fcc0807b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcc08078f20 0x7fcc0807b3e0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c032000 tx=0x7fcc0c001510 comp rx=0 tx=0).stop 2024-09-17T05:22:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc1c154900 msgr2=0x7fcc1c15ad50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:30.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc1c154900 0x7fcc1c15ad50 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fcc140058c0 tx=0x7fcc1400fa90 comp rx=0 tx=0).stop 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 shutdown_connections 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fcc08078f20 0x7fcc0807b3e0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcc1c154900 0x7fcc1c15ad50 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcc1c13ec90 0x7fcc1c1543c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 --2- 172.21.15.81:0/1465829728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcc04003a30 0x7fcc1c152370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 >> 172.21.15.81:0/1465829728 conn(0x7fcc1c0b1690 msgr2=0x7fcc1c159cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 shutdown_connections 2024-09-17T05:22:30.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:30.250+0000 7fcc21060640 1 -- 172.21.15.81:0/1465829728 wait complete. 2024-09-17T05:22:30.261 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:22:30.262 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:30.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:30.262 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:22:30.283 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42565sec preferred_lft 42565sec 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:22:30.284 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:22:30.285 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:22:30.286 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:30.286 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:22:30.351 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:22:30.353 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:30.353 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:22:30.412 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:22:30.412 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:22:30.412 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:22:30.413 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:22:30.413 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:22:30.413 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:22:30.413 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:22:30.413 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:22:30.413 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:22:30.413 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:22:30.413 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:22:30.506 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:22:30 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:22:30.540 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:22:30 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:30.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:30.549 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:22:30.565 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:22:30.565 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:22:30.566 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:30.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:30.566 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:22:30.631 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:22:30.632 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:30.632 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:30.687 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:22:30.688 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:22:30.688 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:30.743 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:22:30.809 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:22:30.866 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:22:30.866 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:22:30.866 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:22:30.866 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:22:30.867 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:22:30.867 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:22:30.867 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:22:30.867 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:22:30.867 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:22:30.867 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:22:30.867 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:22:30.868 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:22:30.869 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:22:30.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:30.870 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:22:30.923 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:22:30.923 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:22:30.966 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:22:30.990 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:22:31.046 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:22:31.046 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:22:31.046 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:22:31.046 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:22:31.046 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:22:31.047 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:22:31.048 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:22:31.049 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:22:31.049 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:31.049 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:22:31.049 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:22:31.049 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:22:31.050 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:31.050 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:22:31.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:22:31.046+0000 7f9a72df9480 -1 init, newargv = 0x563e53e505b0 newargc=15 2024-09-17T05:22:31.051 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[46033]: starting ceph client 2024-09-17T05:22:31.052 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[46033]: starting fuse 2024-09-17T05:22:31.067 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:22:31.067 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:22:31.068 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:22:31.069 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:22:31.070 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:22:31.070 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:22:31.185 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.46033.asok 2024-09-17T05:22:31.188 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:22:31 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:22:31.196 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.46033.asok 2024-09-17T05:22:31.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:31.196 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.46033.asok status 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "46033", 2024-09-17T05:22:31.340 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 5833, 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 5833 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:22:31.341 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1982954564 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1982954564 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.5833 192.168.0.1:0/1982954564", 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/1982954564", 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:22:31.342 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 39, 2024-09-17T05:22:31.343 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 71, 2024-09-17T05:22:31.343 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:22:31.343 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:22:31.343 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:22:31.343 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:22:31.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:31.348 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:22:31.348 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:31.366 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:22:31.366 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:31.366 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:31.366 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:31.432 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:22:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 -- 172.21.15.81:0/3398932665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 msgr2=0x7fb958072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 --2- 172.21.15.81:0/3398932665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb958072530 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7fb958074dd0 tx=0x7fb95402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 -- 172.21.15.81:0/3398932665 shutdown_connections 2024-09-17T05:22:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 --2- 172.21.15.81:0/3398932665 >> v2:172.21.15.160:3300/0 conn(0x7fb958070210 0x7fb958072a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 --2- 172.21.15.81:0/3398932665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb958072530 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 -- 172.21.15.81:0/3398932665 >> 172.21.15.81:0/3398932665 conn(0x7fb9580b1620 msgr2=0x7fb9580b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:31.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 -- 172.21.15.81:0/3398932665 shutdown_connections 2024-09-17T05:22:31.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.549+0000 7fb9600f6640 1 -- 172.21.15.81:0/3398932665 wait complete. 2024-09-17T05:22:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 Processor -- start 2024-09-17T05:22:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 -- start start 2024-09-17T05:22:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb958070210 0x7fb9581571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb958072fb0 0x7fb958141b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb9581f8af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9580aece0 con 0x7fb95815db80 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb958161ec0 con 0x7fb958072fb0 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb9600f6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb958157880 con 0x7fb958070210 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.551+0000 7fb95e693640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb9581f8af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb9581f8af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47594/0 (socket says 172.21.15.81:47594) 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 -- 172.21.15.81:0/2983464830 learned_addr learned my addr 172.21.15.81:0/2983464830 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95de92640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb958070210 0x7fb9581571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95d691640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb958072fb0 0x7fb958141b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 -- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb958070210 msgr2=0x7fb9581571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb958070210 0x7fb9581571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 -- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb958072fb0 msgr2=0x7fb958141b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb958072fb0 0x7fb958141b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 -- 172.21.15.81:0/2983464830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb958157b60 con 0x7fb95815db80 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb95e693640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb9581f8af0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb95000c7b0 tx=0x7fb95000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb94e7fc640 1 -- 172.21.15.81:0/2983464830 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb950004b60 con 0x7fb95815db80 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb94e7fc640 1 -- 172.21.15.81:0/2983464830 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb950004df0 con 0x7fb95815db80 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb958157e40 con 0x7fb95815db80 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb94e7fc640 1 -- 172.21.15.81:0/2983464830 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb95000aa90 con 0x7fb95815db80 2024-09-17T05:22:31.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.552+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb958158400 con 0x7fb95815db80 2024-09-17T05:22:31.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.553+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb958162420 con 0x7fb95815db80 2024-09-17T05:22:31.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.554+0000 7fb94e7fc640 1 -- 172.21.15.81:0/2983464830 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fb95000ac30 con 0x7fb95815db80 2024-09-17T05:22:31.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.555+0000 7fb94e7fc640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb93c078ef0 0x7fb93c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:31.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.555+0000 7fb94e7fc640 1 -- 172.21.15.81:0/2983464830 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fb95009b5a0 con 0x7fb95815db80 2024-09-17T05:22:31.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.555+0000 7fb95de92640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb93c078ef0 0x7fb93c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:31.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.555+0000 7fb95de92640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb93c078ef0 0x7fb93c07b3b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb954033000 tx=0x7fb954004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:31.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.559+0000 7fb94e7fc640 1 -- 172.21.15.81:0/2983464830 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb950020070 con 0x7fb95815db80 2024-09-17T05:22:31.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:31.771+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb9580cbec0 con 0x7fb95815db80 2024-09-17T05:22:32.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.530+0000 7fb94e7fc640 1 -- 172.21.15.81:0/2983464830 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v40) ==== 136+0+0 (secure 0 0 0) 0x7fb950062dc0 con 0x7fb95815db80 2024-09-17T05:22:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.532+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb93c078ef0 msgr2=0x7fb93c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.532+0000 7fb9600f6640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb93c078ef0 0x7fb93c07b3b0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fb954033000 tx=0x7fb954004730 comp rx=0 tx=0).stop 2024-09-17T05:22:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 msgr2=0x7fb9581f8af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb9581f8af0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7fb95000c7b0 tx=0x7fb95000cc70 comp rx=0 tx=0).stop 2024-09-17T05:22:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 shutdown_connections 2024-09-17T05:22:32.534 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb93c078ef0 0x7fb93c07b3b0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb95815db80 0x7fb9581f8af0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb958072fb0 0x7fb958141b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 --2- 172.21.15.81:0/2983464830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb958070210 0x7fb9581571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 >> 172.21.15.81:0/2983464830 conn(0x7fb9580b1620 msgr2=0x7fb9580b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 shutdown_connections 2024-09-17T05:22:32.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.533+0000 7fb9600f6640 1 -- 172.21.15.81:0/2983464830 wait complete. 2024-09-17T05:22:32.547 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:22:32.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.653+0000 7f7f134e6640 1 -- 172.21.15.81:0/615231810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 msgr2=0x7f7ef8003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.653+0000 7f7f134e6640 1 --2- 172.21.15.81:0/615231810 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 0x7f7ef8003e20 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009b50 tx=0x7f7ef8005830 comp rx=0 tx=0).stop 2024-09-17T05:22:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.653+0000 7f7f11a83640 1 -- 172.21.15.81:0/615231810 reap_dead start 2024-09-17T05:22:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.653+0000 7f7f134e6640 1 -- 172.21.15.81:0/615231810 shutdown_connections 2024-09-17T05:22:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.653+0000 7f7f134e6640 1 -- 172.21.15.81:0/615231810 >> 172.21.15.81:0/615231810 conn(0x7f7f0c0d3ea0 msgr2=0x7f7f0c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.653+0000 7f7f134e6640 1 -- 172.21.15.81:0/615231810 shutdown_connections 2024-09-17T05:22:32.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.653+0000 7f7f134e6640 1 -- 172.21.15.81:0/615231810 wait complete. 2024-09-17T05:22:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.654+0000 7f7f134e6640 1 Processor -- start 2024-09-17T05:22:32.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.654+0000 7f7f134e6640 1 -- start start 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f134e6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 0x7f7f0c0b97e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f134e6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f0c0cd2e0 0x7f7f0c1f5340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f134e6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f0c0caf70 0x7f7f0c0cb3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f134e6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c0cfd40 con 0x7f7ef8003a00 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f134e6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7f0c0cfbc0 con 0x7f7f0c0caf70 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f134e6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7f0c0d0b70 con 0x7f7f0c0cd2e0 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 0x7f7f0c0b97e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 0x7f7f0c0b97e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47616/0 (socket says 172.21.15.81:47616) 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 -- 172.21.15.81:0/947489025 learned_addr learned my addr 172.21.15.81:0/947489025 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:32.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 -- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f0c0cd2e0 msgr2=0x7f7f0c1f5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f0c0cd2e0 0x7f7f0c1f5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 -- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f0c0caf70 msgr2=0x7f7f0c0cb3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f0c0caf70 0x7f7f0c0cb3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 -- 172.21.15.81:0/947489025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0c0cda50 con 0x7f7ef8003a00 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7f11282640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 0x7f7f0c0b97e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009a70 tx=0x7f7f08033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.655+0000 7f7efdffb640 1 -- 172.21.15.81:0/947489025 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08043070 con 0x7f7ef8003a00 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.656+0000 7f7efdffb640 1 -- 172.21.15.81:0/947489025 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7f08004320 con 0x7f7ef8003a00 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.656+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0c0cdd30 con 0x7f7ef8003a00 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.656+0000 7f7efdffb640 1 -- 172.21.15.81:0/947489025 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f08038040 con 0x7f7ef8003a00 2024-09-17T05:22:32.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.656+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f0c158ae0 con 0x7f7ef8003a00 2024-09-17T05:22:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.657+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f0c0d0630 con 0x7f7ef8003a00 2024-09-17T05:22:32.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.657+0000 7f7efdffb640 1 -- 172.21.15.81:0/947489025 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f7f08046070 con 0x7f7ef8003a00 2024-09-17T05:22:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.658+0000 7f7efdffb640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7ef0078ef0 0x7f7ef007b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.658+0000 7f7efdffb640 1 -- 172.21.15.81:0/947489025 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f7f080bb760 con 0x7f7ef8003a00 2024-09-17T05:22:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.658+0000 7f7f10a81640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7ef0078ef0 0x7f7ef007b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.659+0000 7f7f10a81640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7ef0078ef0 0x7f7ef007b3b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c158940 tx=0x7f7f00009530 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:32.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.663+0000 7f7efdffb640 1 -- 172.21.15.81:0/947489025 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7f08083090 con 0x7f7ef8003a00 2024-09-17T05:22:32.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.863+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7f0c08d590 con 0x7f7ef0078ef0 2024-09-17T05:22:32.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.866+0000 7f7efdffb640 1 -- 172.21.15.81:0/947489025 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7f0c08d590 con 0x7f7ef0078ef0 2024-09-17T05:22:32.866 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:22:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:22:32.866 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:32.867 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:22:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7ef0078ef0 msgr2=0x7f7ef007b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7ef0078ef0 0x7f7ef007b3b0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7f0c158940 tx=0x7f7f00009530 comp rx=0 tx=0).stop 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 msgr2=0x7f7f0c0b97e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 0x7f7f0c0b97e0 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7f08009a70 tx=0x7f7f08033670 comp rx=0 tx=0).stop 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 shutdown_connections 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f7ef0078ef0 0x7f7ef007b3b0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7f0c0caf70 0x7f7f0c0cb3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7f0c0cd2e0 0x7f7f0c1f5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 --2- 172.21.15.81:0/947489025 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ef8003a00 0x7f7f0c0b97e0 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 >> 172.21.15.81:0/947489025 conn(0x7f7f0c0d3ea0 msgr2=0x7f7f0c0b2060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 shutdown_connections 2024-09-17T05:22:32.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.867+0000 7f7f134e6640 1 -- 172.21.15.81:0/947489025 wait complete. 2024-09-17T05:22:32.879 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:22:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 -- 172.21.15.81:0/921679446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 msgr2=0x7fda480cabc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/921679446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 0x7fda480cabc0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda40005fd0 tx=0x7fda4002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 -- 172.21.15.81:0/921679446 shutdown_connections 2024-09-17T05:22:32.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/921679446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 0x7fda480cabc0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/921679446 >> v2:172.21.15.160:3300/0 conn(0x7fda4815b380 0x7fda48072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 -- 172.21.15.81:0/921679446 >> 172.21.15.81:0/921679446 conn(0x7fda480b1700 msgr2=0x7fda480b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 -- 172.21.15.81:0/921679446 shutdown_connections 2024-09-17T05:22:32.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.982+0000 7fda4dfa3640 1 -- 172.21.15.81:0/921679446 wait complete. 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.983+0000 7fda4dfa3640 1 Processor -- start 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.983+0000 7fda4dfa3640 1 -- start start 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda4dfa3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda48073090 0x7fda481f7d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda4dfa3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 0x7fda48154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda4dfa3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda4815b380 0x7fda480c5ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda4dfa3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda480cb490 con 0x7fda48073090 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda4dfa3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fda480cb310 con 0x7fda4815b380 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda4dfa3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fda480cb610 con 0x7fda480ce120 2024-09-17T05:22:32.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda48073090 0x7fda481f7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda48073090 0x7fda481f7d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47626/0 (socket says 172.21.15.81:47626) 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 -- 172.21.15.81:0/2146977729 learned_addr learned my addr 172.21.15.81:0/2146977729 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda46ffd640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 0x7fda48154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda47fff640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda4815b380 0x7fda480c5ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 -- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 msgr2=0x7fda48154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 0x7fda48154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 -- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda4815b380 msgr2=0x7fda480c5ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda4815b380 0x7fda480c5ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 -- 172.21.15.81:0/2146977729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda480b14b0 con 0x7fda48073090 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda46ffd640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 0x7fda48154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.984+0000 7fda477fe640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda48073090 0x7fda481f7d30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fda3800e790 tx=0x7fda3800ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.985+0000 7fda2ffff640 1 -- 172.21.15.81:0/2146977729 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda3800eea0 con 0x7fda48073090 2024-09-17T05:22:32.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.985+0000 7fda2ffff640 1 -- 172.21.15.81:0/2146977729 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda3800cdb0 con 0x7fda48073090 2024-09-17T05:22:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.985+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda481f8430 con 0x7fda48073090 2024-09-17T05:22:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.985+0000 7fda2ffff640 1 -- 172.21.15.81:0/2146977729 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda38010690 con 0x7fda48073090 2024-09-17T05:22:32.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.985+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda481f89f0 con 0x7fda48073090 2024-09-17T05:22:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.986+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda480cbba0 con 0x7fda48073090 2024-09-17T05:22:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.986+0000 7fda2ffff640 1 -- 172.21.15.81:0/2146977729 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fda38010830 con 0x7fda48073090 2024-09-17T05:22:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.987+0000 7fda2ffff640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda34078ef0 0x7fda3407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.987+0000 7fda2ffff640 1 -- 172.21.15.81:0/2146977729 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fda3809be10 con 0x7fda48073090 2024-09-17T05:22:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.987+0000 7fda46ffd640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda34078ef0 0x7fda3407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:32.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.987+0000 7fda46ffd640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda34078ef0 0x7fda3407b3b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fda3c001240 tx=0x7fda3c009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:32.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:32.992+0000 7fda2ffff640 1 -- 172.21.15.81:0/2146977729 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fda480b14b0 con 0x7fda48073090 2024-09-17T05:22:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.166+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fda480cc6e0 con 0x7fda48073090 2024-09-17T05:22:33.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.167+0000 7fda2ffff640 1 -- 172.21.15.81:0/2146977729 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v34)=0 v34) ==== 122+0+0 (secure 0 0 0) 0x7fda38063d00 con 0x7fda48073090 2024-09-17T05:22:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda34078ef0 msgr2=0x7fda3407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda34078ef0 0x7fda3407b3b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fda3c001240 tx=0x7fda3c009040 comp rx=0 tx=0).stop 2024-09-17T05:22:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda48073090 msgr2=0x7fda481f7d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda48073090 0x7fda481f7d30 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7fda3800e790 tx=0x7fda3800ec50 comp rx=0 tx=0).stop 2024-09-17T05:22:33.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 shutdown_connections 2024-09-17T05:22:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda34078ef0 0x7fda3407b3b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda4815b380 0x7fda480c5ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda480ce120 0x7fda48154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 --2- 172.21.15.81:0/2146977729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda48073090 0x7fda481f7d30 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 >> 172.21.15.81:0/2146977729 conn(0x7fda480b1700 msgr2=0x7fda48072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 shutdown_connections 2024-09-17T05:22:33.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.169+0000 7fda4dfa3640 1 -- 172.21.15.81:0/2146977729 wait complete. 2024-09-17T05:22:33.181 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:33.182 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:33.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 -- 172.21.15.81:0/1717054787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 msgr2=0x7fdaa80cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 --2- 172.21.15.81:0/1717054787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cf9b0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fdaa80d1c90 tx=0x7fda9c02a560 comp rx=0 tx=0).stop 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 -- 172.21.15.81:0/1717054787 shutdown_connections 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 --2- 172.21.15.81:0/1717054787 >> v2:172.21.15.160:3300/0 conn(0x7fdaa80d49c0 0x7fdaa80d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 --2- 172.21.15.81:0/1717054787 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cf9b0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 -- 172.21.15.81:0/1717054787 >> 172.21.15.81:0/1717054787 conn(0x7fdaa80d3ea0 msgr2=0x7fdaa80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 -- 172.21.15.81:0/1717054787 shutdown_connections 2024-09-17T05:22:33.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.338+0000 7fdaaf717640 1 -- 172.21.15.81:0/1717054787 wait complete. 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 Processor -- start 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 -- start start 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdaa80d49c0 0x7fdaa815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaa8162480 0x7fdaa80cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa80d0f00 con 0x7fdaa815df90 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdaa80d0d80 con 0x7fdaa8162480 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaf717640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdaa80b3f10 con 0x7fdaa80d49c0 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.340+0000 7fdaaccb2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cd9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43684/0 (socket says 172.21.15.81:43684) 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 -- 172.21.15.81:0/624580983 learned_addr learned my addr 172.21.15.81:0/624580983 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:33.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaad4b3640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdaa80d49c0 0x7fdaa815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaadcb4640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaa8162480 0x7fdaa80cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 -- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdaa80d49c0 msgr2=0x7fdaa815ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdaa80d49c0 0x7fdaa815ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 -- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaa8162480 msgr2=0x7fdaa80cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaa8162480 0x7fdaa80cdee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 -- 172.21.15.81:0/624580983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaa81f48c0 con 0x7fdaa815df90 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaadcb4640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaa8162480 0x7fdaa80cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaccb2640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cd9a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c920 tx=0x7fdaa400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fda99ffb640 1 -- 172.21.15.81:0/624580983 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4007c70 con 0x7fdaa815df90 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fda99ffb640 1 -- 172.21.15.81:0/624580983 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdaa400f450 con 0x7fdaa815df90 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaa81f4ba0 con 0x7fdaa815df90 2024-09-17T05:22:33.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fda99ffb640 1 -- 172.21.15.81:0/624580983 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa400f8a0 con 0x7fdaa815df90 2024-09-17T05:22:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.341+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaa81f5160 con 0x7fdaa815df90 2024-09-17T05:22:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.342+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdaa80b55b0 con 0x7fdaa815df90 2024-09-17T05:22:33.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.343+0000 7fda99ffb640 1 -- 172.21.15.81:0/624580983 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fdaa400fa40 con 0x7fdaa815df90 2024-09-17T05:22:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.343+0000 7fda99ffb640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda8c078ef0 0x7fda8c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.343+0000 7fda99ffb640 1 -- 172.21.15.81:0/624580983 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fdaa409bc30 con 0x7fdaa815df90 2024-09-17T05:22:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.343+0000 7fdaad4b3640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda8c078ef0 0x7fda8c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.344+0000 7fdaad4b3640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda8c078ef0 0x7fda8c07b3b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fda9c033000 tx=0x7fda9c004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.347+0000 7fda99ffb640 1 -- 172.21.15.81:0/624580983 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdaa4014030 con 0x7fdaa815df90 2024-09-17T05:22:33.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.535+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fdaa808d590 con 0x7fdaa815df90 2024-09-17T05:22:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.536+0000 7fda99ffb640 1 -- 172.21.15.81:0/624580983 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7fdaa4063b30 con 0x7fdaa815df90 2024-09-17T05:22:33.537 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:22:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda8c078ef0 msgr2=0x7fda8c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda8c078ef0 0x7fda8c07b3b0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fda9c033000 tx=0x7fda9c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 msgr2=0x7fdaa80cd9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cd9a0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400c920 tx=0x7fdaa400cde0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 shutdown_connections 2024-09-17T05:22:33.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fda8c078ef0 0x7fda8c07b3b0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdaa8162480 0x7fdaa80cdee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdaa815df90 0x7fdaa80cd9a0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 --2- 172.21.15.81:0/624580983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdaa80d49c0 0x7fdaa815ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 >> 172.21.15.81:0/624580983 conn(0x7fdaa80d3ea0 msgr2=0x7fdaa80b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 shutdown_connections 2024-09-17T05:22:33.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.538+0000 7fdaaf717640 1 -- 172.21.15.81:0/624580983 wait complete. 2024-09-17T05:22:33.550 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:33.550 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:33.566 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 -- 172.21.15.81:0/2257025460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c8159680 msgr2=0x7fb9c815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 --2- 172.21.15.81:0/2257025460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c8159680 0x7fb9c815d270 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8005fd0 tx=0x7fb9b802eca0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 -- 172.21.15.81:0/2257025460 shutdown_connections 2024-09-17T05:22:33.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 --2- 172.21.15.81:0/2257025460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9c815fe60 0x7fb9c80ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 --2- 172.21.15.81:0/2257025460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c8159680 0x7fb9c815d270 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 -- 172.21.15.81:0/2257025460 >> 172.21.15.81:0/2257025460 conn(0x7fb9c80b1690 msgr2=0x7fb9c80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 -- 172.21.15.81:0/2257025460 shutdown_connections 2024-09-17T05:22:33.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.707+0000 7fb9ce247640 1 -- 172.21.15.81:0/2257025460 wait complete. 2024-09-17T05:22:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.708+0000 7fb9ce247640 1 Processor -- start 2024-09-17T05:22:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.708+0000 7fb9ce247640 1 -- start start 2024-09-17T05:22:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9ce247640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9c80cc490 0x7fb9c80740d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9ce247640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9c8159680 0x7fb9c80af870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9ce247640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c815fe60 0x7fb9c8155060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9ce247640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80cca80 con 0x7fb9c815fe60 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9ce247640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb9c80cc900 con 0x7fb9c8159680 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9ce247640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb9c80ccc00 con 0x7fb9c80cc490 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c815fe60 0x7fb9c8155060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c815fe60 0x7fb9c8155060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43706/0 (socket says 172.21.15.81:43706) 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 -- 172.21.15.81:0/1323828812 learned_addr learned my addr 172.21.15.81:0/1323828812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 -- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9c80cc490 msgr2=0x7fb9c80740d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9c80cc490 0x7fb9c80740d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 -- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9c8159680 msgr2=0x7fb9c80af870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9c8159680 0x7fb9c80af870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 -- 172.21.15.81:0/1323828812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9c81f0570 con 0x7fb9c815fe60 2024-09-17T05:22:33.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9c7fff640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c815fe60 0x7fb9c8155060 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000e740 tx=0x7fb9c000ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9affff640 1 -- 172.21.15.81:0/1323828812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c000ccc0 con 0x7fb9c815fe60 2024-09-17T05:22:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9affff640 1 -- 172.21.15.81:0/1323828812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb9c000ce80 con 0x7fb9c815fe60 2024-09-17T05:22:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.709+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9c81f0850 con 0x7fb9c815fe60 2024-09-17T05:22:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.710+0000 7fb9affff640 1 -- 172.21.15.81:0/1323828812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9c0005280 con 0x7fb9c815fe60 2024-09-17T05:22:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.710+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9c8074610 con 0x7fb9c815fe60 2024-09-17T05:22:33.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.711+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb9c81effe0 con 0x7fb9c815fe60 2024-09-17T05:22:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.711+0000 7fb9affff640 1 -- 172.21.15.81:0/1323828812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7fb9c0005420 con 0x7fb9c815fe60 2024-09-17T05:22:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.711+0000 7fb9affff640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9b4078ef0 0x7fb9b407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.712+0000 7fb9affff640 1 -- 172.21.15.81:0/1323828812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7fb9c009bcf0 con 0x7fb9c815fe60 2024-09-17T05:22:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.712+0000 7fb9c77fe640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9b4078ef0 0x7fb9b407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:33.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.712+0000 7fb9c77fe640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9b4078ef0 0x7fb9b407b3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8038000 tx=0x7fb9b8004a40 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:33.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.716+0000 7fb9affff640 1 -- 172.21.15.81:0/1323828812 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb9c0063bf0 con 0x7fb9c815fe60 2024-09-17T05:22:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.902+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fb9c80725a0 con 0x7fb9c815fe60 2024-09-17T05:22:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.903+0000 7fb9affff640 1 -- 172.21.15.81:0/1323828812 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7fb9c00634f0 con 0x7fb9c815fe60 2024-09-17T05:22:33.903 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:22:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9b4078ef0 msgr2=0x7fb9b407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9b4078ef0 0x7fb9b407b3b0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fb9b8038000 tx=0x7fb9b8004a40 comp rx=0 tx=0).stop 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c815fe60 msgr2=0x7fb9c8155060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c815fe60 0x7fb9c8155060 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fb9c000e740 tx=0x7fb9c000ec00 comp rx=0 tx=0).stop 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 shutdown_connections 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7fb9b4078ef0 0x7fb9b407b3b0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9c815fe60 0x7fb9c8155060 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9c8159680 0x7fb9c80af870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 --2- 172.21.15.81:0/1323828812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9c80cc490 0x7fb9c80740d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 >> 172.21.15.81:0/1323828812 conn(0x7fb9c80b1690 msgr2=0x7fb9c8159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 shutdown_connections 2024-09-17T05:22:33.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:33.905+0000 7fb9ce247640 1 -- 172.21.15.81:0/1323828812 wait complete. 2024-09-17T05:22:33.915 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:22:33.916 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:33.916 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:22:33.939 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[58445]: fuse finished with error 0 and tester_r 0 2024-09-17T05:22:33.940 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:40.042 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:22:40.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:40.043 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:22:40.063 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:40.063 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:40.083 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 -- 172.21.15.81:0/3781843911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 msgr2=0x7ffa980725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3781843911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 0x7ffa980725a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7ffa8c005fd0 tx=0x7ffa8c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 -- 172.21.15.81:0/3781843911 shutdown_connections 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3781843911 >> v2:172.21.15.160:3300/0 conn(0x7ffa980b3140 0x7ffa98072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3781843911 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 0x7ffa980725a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 -- 172.21.15.81:0/3781843911 >> 172.21.15.81:0/3781843911 conn(0x7ffa980b1690 msgr2=0x7ffa980b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 -- 172.21.15.81:0/3781843911 shutdown_connections 2024-09-17T05:22:40.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.213+0000 7ffa9caef640 1 -- 172.21.15.81:0/3781843911 wait complete. 2024-09-17T05:22:40.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 Processor -- start 2024-09-17T05:22:40.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 -- start start 2024-09-17T05:22:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa980b3140 0x7ffa98147260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 0x7ffa98154300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa98151370 0x7ffa980cdad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9806ec10 con 0x7ffa98151370 2024-09-17T05:22:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffa9806ea90 con 0x7ffa980b3140 2024-09-17T05:22:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.215+0000 7ffa9caef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ffa9806f9f0 con 0x7ffa980cf640 2024-09-17T05:22:40.218 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa98151370 0x7ffa980cdad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa98151370 0x7ffa980cdad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43720/0 (socket says 172.21.15.81:43720) 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 -- 172.21.15.81:0/3426661497 learned_addr learned my addr 172.21.15.81:0/3426661497 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa95d9b640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 0x7ffa98154300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa9659c640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa980b3140 0x7ffa98147260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 -- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 msgr2=0x7ffa98154300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 0x7ffa98154300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 -- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa980b3140 msgr2=0x7ffa98147260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa980b3140 0x7ffa98147260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 -- 172.21.15.81:0/3426661497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa981f7c50 con 0x7ffa98151370 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa96d9d640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa98151370 0x7ffa980cdad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800eb10 tx=0x7ffa8800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa86ffd640 1 -- 172.21.15.81:0/3426661497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88004b20 con 0x7ffa98151370 2024-09-17T05:22:40.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa981f7f30 con 0x7ffa98151370 2024-09-17T05:22:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa86ffd640 1 -- 172.21.15.81:0/3426661497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa88004ce0 con 0x7ffa98151370 2024-09-17T05:22:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa86ffd640 1 -- 172.21.15.81:0/3426661497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa88005280 con 0x7ffa98151370 2024-09-17T05:22:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.216+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa981f84f0 con 0x7ffa98151370 2024-09-17T05:22:40.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.217+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa980cef30 con 0x7ffa98151370 2024-09-17T05:22:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.218+0000 7ffa86ffd640 1 -- 172.21.15.81:0/3426661497 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7ffa88005420 con 0x7ffa98151370 2024-09-17T05:22:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.218+0000 7ffa86ffd640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffa78078ef0 0x7ffa7807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.218+0000 7ffa86ffd640 1 -- 172.21.15.81:0/3426661497 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7ffa8809c090 con 0x7ffa98151370 2024-09-17T05:22:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.219+0000 7ffa9659c640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffa78078ef0 0x7ffa7807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.219+0000 7ffa9659c640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffa78078ef0 0x7ffa7807b3b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001720 tx=0x7ffa90009040 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.223+0000 7ffa86ffd640 1 -- 172.21.15.81:0/3426661497 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ffa880638c0 con 0x7ffa98151370 2024-09-17T05:22:40.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.409+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7ffa980697e0 con 0x7ffa98151370 2024-09-17T05:22:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.410+0000 7ffa86ffd640 1 -- 172.21.15.81:0/3426661497 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7ffa880682f0 con 0x7ffa98151370 2024-09-17T05:22:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:22:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffa78078ef0 msgr2=0x7ffa7807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffa78078ef0 0x7ffa7807b3b0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7ffa90001720 tx=0x7ffa90009040 comp rx=0 tx=0).stop 2024-09-17T05:22:40.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa98151370 msgr2=0x7ffa980cdad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa98151370 0x7ffa980cdad0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7ffa8800eb10 tx=0x7ffa8800c2d0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 shutdown_connections 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ffa78078ef0 0x7ffa7807b3b0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa98151370 0x7ffa980cdad0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa980cf640 0x7ffa98154300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 --2- 172.21.15.81:0/3426661497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa980b3140 0x7ffa98147260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 >> 172.21.15.81:0/3426661497 conn(0x7ffa980b1690 msgr2=0x7ffa980b3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 shutdown_connections 2024-09-17T05:22:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.412+0000 7ffa9caef640 1 -- 172.21.15.81:0/3426661497 wait complete. 2024-09-17T05:22:40.425 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:40.425 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:40.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:22:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.546+0000 7f60cec33640 1 -- 172.21.15.81:0/2578499563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80d0b60 msgr2=0x7f60c8068ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.546+0000 7f60cec33640 1 --2- 172.21.15.81:0/2578499563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80d0b60 0x7f60c8068ac0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f60c4009830 tx=0x7f60c402a480 comp rx=0 tx=0).stop 2024-09-17T05:22:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.547+0000 7f60cec33640 1 -- 172.21.15.81:0/2578499563 shutdown_connections 2024-09-17T05:22:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.547+0000 7f60cec33640 1 --2- 172.21.15.81:0/2578499563 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80d0b60 0x7f60c8068ac0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.547+0000 7f60cec33640 1 -- 172.21.15.81:0/2578499563 >> 172.21.15.81:0/2578499563 conn(0x7f60c80741f0 msgr2=0x7f60c8074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.547+0000 7f60cec33640 1 -- 172.21.15.81:0/2578499563 shutdown_connections 2024-09-17T05:22:40.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.547+0000 7f60cec33640 1 -- 172.21.15.81:0/2578499563 wait complete. 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.548+0000 7f60cec33640 1 Processor -- start 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.548+0000 7f60cec33640 1 -- start start 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60c80cc4c0 0x7f60c80c6040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80cd760 0x7f60c80c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60c80d0b60 0x7f60c80b1340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f60c815ccf0 con 0x7f60c80cd760 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f60c815cb70 con 0x7f60c80cc4c0 2024-09-17T05:22:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f60c815ce70 con 0x7f60c80d0b60 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80cd760 0x7f60c80c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80cd760 0x7f60c80c6580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43728/0 (socket says 172.21.15.81:43728) 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 -- 172.21.15.81:0/1650789650 learned_addr learned my addr 172.21.15.81:0/1650789650 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 -- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60c80d0b60 msgr2=0x7f60c80b1340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cd1d0640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60c80d0b60 0x7f60c80b1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cc9cf640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60c80cc4c0 0x7f60c80c6040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60c80d0b60 0x7f60c80b1340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 -- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60c80cc4c0 msgr2=0x7f60c80c6040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60c80cc4c0 0x7f60c80c6040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 -- 172.21.15.81:0/1650789650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60c80aec50 con 0x7f60c80cd760 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cc9cf640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60c80cc4c0 0x7f60c80c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cd1d0640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60c80d0b60 0x7f60c80b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bffff640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80cd760 0x7f60c80c6580 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f60b800c450 tx=0x7f60b800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bd7fa640 1 -- 172.21.15.81:0/1650789650 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b8016020 con 0x7f60c80cd760 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bd7fa640 1 -- 172.21.15.81:0/1650789650 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f60b8012920 con 0x7f60c80cd760 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60c80aeef0 con 0x7f60c80cd760 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60bd7fa640 1 -- 172.21.15.81:0/1650789650 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60b8012d70 con 0x7f60c80cd760 2024-09-17T05:22:40.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.549+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60c80b25f0 con 0x7f60c80cd760 2024-09-17T05:22:40.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.550+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60c815dae0 con 0x7f60c80cd760 2024-09-17T05:22:40.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.551+0000 7f60bd7fa640 1 -- 172.21.15.81:0/1650789650 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f60b8019020 con 0x7f60c80cd760 2024-09-17T05:22:40.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.551+0000 7f60bd7fa640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60b4078ef0 0x7f60b407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.552+0000 7f60bd7fa640 1 -- 172.21.15.81:0/1650789650 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f60b809b110 con 0x7f60c80cd760 2024-09-17T05:22:40.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.552+0000 7f60cc9cf640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60b4078ef0 0x7f60b407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.552+0000 7f60cc9cf640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60b4078ef0 0x7f60b407b3b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f60c4034000 tx=0x7f60c4004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.557+0000 7f60bd7fa640 1 -- 172.21.15.81:0/1650789650 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f60b8020030 con 0x7f60c80cd760 2024-09-17T05:22:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.742+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f60c806ddc0 con 0x7f60c80cd760 2024-09-17T05:22:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.742+0000 7f60bd7fa640 1 -- 172.21.15.81:0/1650789650 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v71) ==== 80+0+0 (secure 0 0 0) 0x7f60b8063080 con 0x7f60c80cd760 2024-09-17T05:22:40.743 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:22:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60b4078ef0 msgr2=0x7f60b407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60b4078ef0 0x7f60b407b3b0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f60c4034000 tx=0x7f60c4004730 comp rx=0 tx=0).stop 2024-09-17T05:22:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80cd760 msgr2=0x7f60c80c6580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80cd760 0x7f60c80c6580 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f60b800c450 tx=0x7f60b800c910 comp rx=0 tx=0).stop 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 shutdown_connections 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f60b4078ef0 0x7f60b407b3b0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60c80d0b60 0x7f60c80b1340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f60c80cd760 0x7f60c80c6580 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 --2- 172.21.15.81:0/1650789650 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60c80cc4c0 0x7f60c80c6040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 >> 172.21.15.81:0/1650789650 conn(0x7f60c80741f0 msgr2=0x7f60c80ae540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 shutdown_connections 2024-09-17T05:22:40.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.744+0000 7f60cec33640 1 -- 172.21.15.81:0/1650789650 wait complete. 2024-09-17T05:22:40.756 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:22:40.756 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:40.756 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:22:40.786 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[46033]: fuse finished with error 0 and tester_r 0 2024-09-17T05:22:40.787 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:40.849 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:22:40.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:22:40.850 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:22:40.868 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 -- 172.21.15.81:0/3607777369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 msgr2=0x7f9ae40b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 --2- 172.21.15.81:0/3607777369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 0x7f9ae40b3800 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005fd0 tx=0x7f9adc02a840 comp rx=0 tx=0).stop 2024-09-17T05:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 -- 172.21.15.81:0/3607777369 shutdown_connections 2024-09-17T05:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 --2- 172.21.15.81:0/3607777369 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d49c0 0x7f9ae40b3800 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 --2- 172.21.15.81:0/3607777369 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae40d0d40 0x7f9ae40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 -- 172.21.15.81:0/3607777369 >> 172.21.15.81:0/3607777369 conn(0x7f9ae40d3ea0 msgr2=0x7f9ae40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 -- 172.21.15.81:0/3607777369 shutdown_connections 2024-09-17T05:22:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.969+0000 7f9aeae87640 1 -- 172.21.15.81:0/3607777369 wait complete. 2024-09-17T05:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.970+0000 7f9aeae87640 1 Processor -- start 2024-09-17T05:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.970+0000 7f9aeae87640 1 -- start start 2024-09-17T05:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9aeae87640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d0d40 0x7f9ae41f4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9aeae87640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae40d49c0 0x7f9ae406e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9aeae87640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae415df90 0x7f9ae415cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9aeae87640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae40b3d40 con 0x7f9ae415df90 2024-09-17T05:22:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9aeae87640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9ae4162710 con 0x7f9ae40d0d40 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9aeae87640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9ae40b3ec0 con 0x7f9ae40d49c0 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae415df90 0x7f9ae415cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae415df90 0x7f9ae415cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43740/0 (socket says 172.21.15.81:43740) 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 -- 172.21.15.81:0/2671320228 learned_addr learned my addr 172.21.15.81:0/2671320228 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae3fff640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae40d49c0 0x7f9ae406e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae8c23640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d0d40 0x7f9ae41f4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 -- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae40d49c0 msgr2=0x7f9ae406e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae40d49c0 0x7f9ae406e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 -- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d0d40 msgr2=0x7f9ae41f4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d0d40 0x7f9ae41f4870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:40.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 -- 172.21.15.81:0/2671320228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ae41f5a40 con 0x7f9ae415df90 2024-09-17T05:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae9424640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae415df90 0x7f9ae415cfa0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005fd0 tx=0x7f9adc032cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.971+0000 7f9ae17fa640 1 -- 172.21.15.81:0/2671320228 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc040070 con 0x7f9ae415df90 2024-09-17T05:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.972+0000 7f9ae17fa640 1 -- 172.21.15.81:0/2671320228 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9adc004560 con 0x7f9ae415df90 2024-09-17T05:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.972+0000 7f9ae17fa640 1 -- 172.21.15.81:0/2671320228 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9adc003e60 con 0x7f9ae415df90 2024-09-17T05:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.972+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ae41f4ee0 con 0x7f9ae415df90 2024-09-17T05:22:40.975 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.972+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ae41f5720 con 0x7f9ae415df90 2024-09-17T05:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.973+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ae41f5c10 con 0x7f9ae415df90 2024-09-17T05:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.973+0000 7f9ae17fa640 1 -- 172.21.15.81:0/2671320228 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f9adc043070 con 0x7f9ae415df90 2024-09-17T05:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.974+0000 7f9ae17fa640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac8078ef0 0x7f9ac807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.974+0000 7f9ae17fa640 1 -- 172.21.15.81:0/2671320228 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f9adc0bc410 con 0x7f9ae415df90 2024-09-17T05:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.974+0000 7f9ae8c23640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac8078ef0 0x7f9ac807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:40.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.975+0000 7f9ae8c23640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac8078ef0 0x7f9ac807b3b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40cdc20 tx=0x7f9ad8001290 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:40.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:40.978+0000 7f9ae17fa640 1 -- 172.21.15.81:0/2671320228 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9ae41f4ee0 con 0x7f9ae415df90 2024-09-17T05:22:41.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.190+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9ae40b4330 con 0x7f9ae415df90 2024-09-17T05:22:41.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.191+0000 7f9ae17fa640 1 -- 172.21.15.81:0/2671320228 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f9adc083d30 con 0x7f9ae415df90 2024-09-17T05:22:41.192 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:41.192 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-17T05:22:32:523944+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:41.193 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-17T05:22:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac8078ef0 msgr2=0x7f9ac807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac8078ef0 0x7f9ac807b3b0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f9ae40cdc20 tx=0x7f9ad8001290 comp rx=0 tx=0).stop 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae415df90 msgr2=0x7f9ae415cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae415df90 0x7f9ae415cfa0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f9adc005fd0 tx=0x7f9adc032cf0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 shutdown_connections 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f9ac8078ef0 0x7f9ac807b3b0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ae415df90 0x7f9ae415cfa0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ae40d49c0 0x7f9ae406e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 --2- 172.21.15.81:0/2671320228 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ae40d0d40 0x7f9ae41f4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 >> 172.21.15.81:0/2671320228 conn(0x7f9ae40d3ea0 msgr2=0x7f9ae40b9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 shutdown_connections 2024-09-17T05:22:41.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.193+0000 7f9aeae87640 1 -- 172.21.15.81:0/2671320228 wait complete. 2024-09-17T05:22:41.209 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T05:22:41.325 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-17T05:22:41.325 DEBUG:tasks.cephfs.filesystem:_json_asok output [] 2024-09-17T05:22:41.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol12910 2024-09-17T05:22:41.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.430+0000 7f3b97752640 1 -- 172.21.15.81:0/64868741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900d01b0 msgr2=0x7f3b900d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.430+0000 7f3b97752640 1 --2- 172.21.15.81:0/64868741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900d01b0 0x7f3b900d2440 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f3b80005fd0 tx=0x7f3b8002a540 comp rx=0 tx=0).stop 2024-09-17T05:22:41.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.430+0000 7f3b97752640 1 -- 172.21.15.81:0/64868741 shutdown_connections 2024-09-17T05:22:41.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.430+0000 7f3b97752640 1 --2- 172.21.15.81:0/64868741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900d01b0 0x7f3b900d2440 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.430+0000 7f3b97752640 1 -- 172.21.15.81:0/64868741 >> 172.21.15.81:0/64868741 conn(0x7f3b900d3e30 msgr2=0x7f3b900d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:41.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.430+0000 7f3b97752640 1 -- 172.21.15.81:0/64868741 shutdown_connections 2024-09-17T05:22:41.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.430+0000 7f3b97752640 1 -- 172.21.15.81:0/64868741 wait complete. 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.431+0000 7f3b97752640 1 Processor -- start 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.431+0000 7f3b97752640 1 -- start start 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b97752640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900b3de0 0x7f3b9009db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b97752640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b900d01b0 0x7f3b90154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b97752640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b901617f0 0x7f3b900b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b97752640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900b4a80 con 0x7f3b900b3de0 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b97752640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3b900b4900 con 0x7f3b900d01b0 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b97752640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3b900b4c00 con 0x7f3b901617f0 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900b3de0 0x7f3b9009db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900b3de0 0x7f3b9009db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43750/0 (socket says 172.21.15.81:43750) 2024-09-17T05:22:41.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 -- 172.21.15.81:0/3438680431 learned_addr learned my addr 172.21.15.81:0/3438680431 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 -- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b901617f0 msgr2=0x7f3b900b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b94ced640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b900d01b0 0x7f3b90154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b95cef640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b901617f0 0x7f3b900b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b901617f0 0x7f3b900b8e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 -- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b900d01b0 msgr2=0x7f3b90154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b900d01b0 0x7f3b90154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b954ee640 1 -- 172.21.15.81:0/3438680431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b900ce0a0 con 0x7f3b900b3de0 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.432+0000 7f3b94ced640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b900d01b0 0x7f3b90154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.433+0000 7f3b954ee640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900b3de0 0x7f3b9009db30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c370 tx=0x7f3b8c00c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.433+0000 7f3b85ffb640 1 -- 172.21.15.81:0/3438680431 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c0052d0 con 0x7f3b900b3de0 2024-09-17T05:22:41.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.433+0000 7f3b85ffb640 1 -- 172.21.15.81:0/3438680431 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b8c007020 con 0x7f3b900b3de0 2024-09-17T05:22:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.433+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b9009f580 con 0x7f3b900b3de0 2024-09-17T05:22:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.433+0000 7f3b85ffb640 1 -- 172.21.15.81:0/3438680431 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b8c007470 con 0x7f3b900b3de0 2024-09-17T05:22:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.433+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b9009fb40 con 0x7f3b900b3de0 2024-09-17T05:22:41.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.434+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b900b41f0 con 0x7f3b900b3de0 2024-09-17T05:22:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.435+0000 7f3b85ffb640 1 -- 172.21.15.81:0/3438680431 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f3b8c0067d0 con 0x7f3b900b3de0 2024-09-17T05:22:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.435+0000 7f3b85ffb640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b74078ef0 0x7f3b7407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.435+0000 7f3b85ffb640 1 -- 172.21.15.81:0/3438680431 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f3b8c09a750 con 0x7f3b900b3de0 2024-09-17T05:22:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.435+0000 7f3b94ced640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b74078ef0 0x7f3b7407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.436+0000 7f3b94ced640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b74078ef0 0x7f3b7407b3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3b80033000 tx=0x7f3b80004730 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:41.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.439+0000 7f3b85ffb640 1 -- 172.21.15.81:0/3438680431 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3b8c062790 con 0x7f3b900b3de0 2024-09-17T05:22:41.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.643+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 --> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol12910", "target": ["mon-mgr", ""]}) -- 0x7f3b900b3570 con 0x7f3b74078ef0 2024-09-17T05:22:41.650 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:41.650+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:41.650 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:41.650+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:41.651 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:41.650+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:41.651 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:41.650+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:41.651 INFO:tasks.ceph.mgr.x.smithi160.stderr:2024-09-17T05:22:41.650+0000 7f03c8fcb640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:41.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.680+0000 7f3b85ffb640 1 -- 172.21.15.81:0/3438680431 <== mgr.4108 v2:172.21.15.160:6800/3031880469 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3b900b3570 con 0x7f3b74078ef0 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b74078ef0 msgr2=0x7f3b7407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b74078ef0 0x7f3b7407b3b0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f3b80033000 tx=0x7f3b80004730 comp rx=0 tx=0).stop 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900b3de0 msgr2=0x7f3b9009db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900b3de0 0x7f3b9009db30 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f3b8c00c370 tx=0x7f3b8c00c830 comp rx=0 tx=0).stop 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 shutdown_connections 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f3b74078ef0 0x7f3b7407b3b0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b901617f0 0x7f3b900b8e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b900d01b0 0x7f3b90154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 --2- 172.21.15.81:0/3438680431 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b900b3de0 0x7f3b9009db30 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 >> 172.21.15.81:0/3438680431 conn(0x7f3b900d3e30 msgr2=0x7f3b900d4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 shutdown_connections 2024-09-17T05:22:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.682+0000 7f3b97752640 1 -- 172.21.15.81:0/3438680431 wait complete. 2024-09-17T05:22:41.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:41.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 -- 172.21.15.81:0/779736541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0b1920 msgr2=0x7f172c0d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 --2- 172.21.15.81:0/779736541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0b1920 0x7f172c0d1d10 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f172c0ce360 tx=0x7f171402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 -- 172.21.15.81:0/779736541 shutdown_connections 2024-09-17T05:22:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 --2- 172.21.15.81:0/779736541 >> v2:172.21.15.160:3300/0 conn(0x7f172c0d2250 0x7f172c0b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 --2- 172.21.15.81:0/779736541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0b1920 0x7f172c0d1d10 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 --2- 172.21.15.81:0/779736541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f172c15bdc0 0x7f172c0b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 -- 172.21.15.81:0/779736541 >> 172.21.15.81:0/779736541 conn(0x7f172c074cb0 msgr2=0x7f172c09b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 -- 172.21.15.81:0/779736541 shutdown_connections 2024-09-17T05:22:41.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.793+0000 7f17314e4640 1 -- 172.21.15.81:0/779736541 wait complete. 2024-09-17T05:22:41.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.794+0000 7f17314e4640 1 Processor -- start 2024-09-17T05:22:41.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.794+0000 7f17314e4640 1 -- start start 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f17314e4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0b1920 0x7f172c15f1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f17314e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0d2250 0x7f172c155510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f17314e4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f172c15bdc0 0x7f172c1f8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f17314e4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f172c0cdc40 con 0x7f172c0d2250 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f17314e4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f172c0cdac0 con 0x7f172c0b1920 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f17314e4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f172c0b2370 con 0x7f172c15bdc0 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0d2250 0x7f172c155510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0d2250 0x7f172c155510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43766/0 (socket says 172.21.15.81:43766) 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 -- 172.21.15.81:0/1575163182 learned_addr learned my addr 172.21.15.81:0/1575163182 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172b7fe640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f172c15bdc0 0x7f172c1f8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172affd640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0b1920 0x7f172c15f1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 -- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f172c15bdc0 msgr2=0x7f172c1f8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f172c15bdc0 0x7f172c1f8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 -- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0b1920 msgr2=0x7f172c15f1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0b1920 0x7f172c15f1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172a7fc640 1 -- 172.21.15.81:0/1575163182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f172c1f8d90 con 0x7f172c0d2250 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.795+0000 7f172affd640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0b1920 0x7f172c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.796+0000 7f172a7fc640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0d2250 0x7f172c155510 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f17140039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.796+0000 7f17237fe640 1 -- 172.21.15.81:0/1575163182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f171403e030 con 0x7f172c0d2250 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.796+0000 7f17237fe640 1 -- 172.21.15.81:0/1575163182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17140047a0 con 0x7f172c0d2250 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.796+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f172c0ca610 con 0x7f172c0d2250 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.796+0000 7f17237fe640 1 -- 172.21.15.81:0/1575163182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1714035040 con 0x7f172c0d2250 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.796+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f172c15e9c0 con 0x7f172c0d2250 2024-09-17T05:22:41.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.797+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f172c15e4d0 con 0x7f172c0d2250 2024-09-17T05:22:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.797+0000 7f17237fe640 1 -- 172.21.15.81:0/1575163182 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f1714041030 con 0x7f172c0d2250 2024-09-17T05:22:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.798+0000 7f17237fe640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f170c078ef0 0x7f170c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.798+0000 7f17237fe640 1 -- 172.21.15.81:0/1575163182 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f17140bbaf0 con 0x7f172c0d2250 2024-09-17T05:22:41.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.798+0000 7f172affd640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f170c078ef0 0x7f170c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:41.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.799+0000 7f172affd640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f170c078ef0 0x7f170c07b3b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f171c009fa0 tx=0x7f171c009570 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:41.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:41.802+0000 7f17237fe640 1 -- 172.21.15.81:0/1575163182 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f172c1f8d90 con 0x7f172c0d2250 2024-09-17T05:22:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.014+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f172c0b2890 con 0x7f172c0d2250 2024-09-17T05:22:42.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.014+0000 7f17237fe640 1 -- 172.21.15.81:0/1575163182 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7f1714083a60 con 0x7f172c0d2250 2024-09-17T05:22:42.016 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:42.016 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-17T05:22:32:523944+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:42.016 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-17T05:22:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f170c078ef0 msgr2=0x7f170c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f170c078ef0 0x7f170c07b3b0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f171c009fa0 tx=0x7f171c009570 comp rx=0 tx=0).stop 2024-09-17T05:22:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0d2250 msgr2=0x7f172c155510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0d2250 0x7f172c155510 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f1714000c00 tx=0x7f17140039e0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 shutdown_connections 2024-09-17T05:22:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f170c078ef0 0x7f170c07b3b0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f172c15bdc0 0x7f172c1f8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f172c0d2250 0x7f172c155510 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 --2- 172.21.15.81:0/1575163182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f172c0b1920 0x7f172c15f1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 >> 172.21.15.81:0/1575163182 conn(0x7f172c074cb0 msgr2=0x7f172c0d1b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 shutdown_connections 2024-09-17T05:22:42.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.017+0000 7f17314e4640 1 -- 172.21.15.81:0/1575163182 wait complete. 2024-09-17T05:22:42.029 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T05:22:42.145 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":5624,"entity":{"name":{"type":"client","num":5624},"addr":{"type":"any","addr":"172.21.15.160:0","nonce":3189324365}},"state":"open","num_leases":1,"num_caps":7,"request_load_avg":15,"uptime":0.48299072300000001,"requests_in_flight":2,"num_completed_requests":0,"num_completed_flushes":1,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":21.976021406427336,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":15,"last_trim_completed_flushes_tid":2,"delegated_inos":[{"start":"0x10000000005","length":500}],"inst":"client.5624 172.21.15.160:0/3189324365","completed_requests":[],"prealloc_inos":[{"start":"0x10000000005","length":996}],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"x","hostname":"smithi160","pid":"36107","root":"/"}}] 2024-09-17T05:22:42.145 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "x", "hostname": "smithi160", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36107", "root": "/" }, "completed_requests": [], "delegated_inos": [ { "length": 500, "start": "0x10000000005" } ], "entity": { "addr": { "addr": "172.21.15.160:0", "nonce": 3189324365, "type": "any" }, "name": { "num": 5624, "type": "client" } }, "id": 5624, "inst": "client.5624 172.21.15.160:0/3189324365", "last_trim_completed_flushes_tid": 2, "last_trim_completed_requests_tid": 15, "num_caps": 7, "num_completed_flushes": 1, "num_completed_requests": 0, "num_leases": 1, "prealloc_inos": [ { "length": 996, "start": "0x10000000005" } ], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 15, "requests_in_flight": 2, "session_cache_liveness": { "halflife": 300, "value": 21.976021406427336 }, "state": "open", "uptime": 0.482990723 } ] 2024-09-17T05:22:42.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-17T05:22:42.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 -- 172.21.15.81:0/3751377261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea80d49c0 msgr2=0x7f5ea80b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/3751377261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea80d49c0 0x7f5ea80b3800 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f5ea0009830 tx=0x7f5ea002a480 comp rx=0 tx=0).stop 2024-09-17T05:22:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 -- 172.21.15.81:0/3751377261 shutdown_connections 2024-09-17T05:22:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/3751377261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea80d49c0 0x7f5ea80b3800 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/3751377261 >> v2:172.21.15.160:3300/0 conn(0x7f5ea80d0d40 0x7f5ea80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 -- 172.21.15.81:0/3751377261 >> 172.21.15.81:0/3751377261 conn(0x7f5ea80d3ea0 msgr2=0x7f5ea80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 -- 172.21.15.81:0/3751377261 shutdown_connections 2024-09-17T05:22:42.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.245+0000 7f5eb00cf640 1 -- 172.21.15.81:0/3751377261 wait complete. 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 Processor -- start 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 -- start start 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea80d0d40 0x7f5ea81f8a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea80d49c0 0x7f5ea80b8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea815df90 0x7f5ea815a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea80b3d40 con 0x7f5ea80d0d40 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea8162710 con 0x7f5ea80d49c0 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eb00cf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea80b3ec0 con 0x7f5ea815df90 2024-09-17T05:22:42.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eade6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea80d0d40 0x7f5ea81f8a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eade6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea80d0d40 0x7f5ea81f8a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:43778/0 (socket says 172.21.15.81:43778) 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eade6b640 1 -- 172.21.15.81:0/1945109933 learned_addr learned my addr 172.21.15.81:0/1945109933 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5eae66c640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea815df90 0x7f5ea815a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.247+0000 7f5ead66a640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea80d49c0 0x7f5ea80b8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eade6b640 1 -- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea815df90 msgr2=0x7f5ea815a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eade6b640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea815df90 0x7f5ea815a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eade6b640 1 -- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea80d49c0 msgr2=0x7f5ea80b8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eade6b640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea80d49c0 0x7f5ea80b8880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eade6b640 1 -- 172.21.15.81:0/1945109933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea815aa40 con 0x7f5ea80d0d40 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eade6b640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea80d0d40 0x7f5ea81f8a00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c7a0 tx=0x7f5e9800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5ea67fc640 1 -- 172.21.15.81:0/1945109933 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e98017070 con 0x7f5ea80d0d40 2024-09-17T05:22:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea80b8fd0 con 0x7f5ea80d0d40 2024-09-17T05:22:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5ea67fc640 1 -- 172.21.15.81:0/1945109933 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e9800ce50 con 0x7f5ea80d0d40 2024-09-17T05:22:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5ea67fc640 1 -- 172.21.15.81:0/1945109933 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e980052d0 con 0x7f5ea80d0d40 2024-09-17T05:22:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.248+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea81f4d80 con 0x7f5ea80d0d40 2024-09-17T05:22:42.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.249+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea80b43b0 con 0x7f5ea80d0d40 2024-09-17T05:22:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.250+0000 7f5ea67fc640 1 -- 172.21.15.81:0/1945109933 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 11) ==== 101747+0+0 (secure 0 0 0) 0x7f5e9801a070 con 0x7f5ea80d0d40 2024-09-17T05:22:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.250+0000 7f5ea67fc640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5e94078ef0 0x7f5e9407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.250+0000 7f5ea67fc640 1 -- 172.21.15.81:0/1945109933 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7f5e9809a970 con 0x7f5ea80d0d40 2024-09-17T05:22:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.250+0000 7f5ead66a640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5e94078ef0 0x7f5e9407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:42.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.251+0000 7f5ead66a640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5e94078ef0 0x7f5e9407b3b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80b3920 tx=0x7f5e9c005f90 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.254+0000 7f5ea67fc640 1 -- 172.21.15.81:0/1945109933 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5ea80ce970 con 0x7f5ea80d0d40 2024-09-17T05:22:42.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.477+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f5ea808d590 con 0x7f5ea80d0d40 2024-09-17T05:22:42.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.482+0000 7f5ea67fc640 1 -- 172.21.15.81:0/1945109933 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v11) ==== 81+0+530962 (secure 0 0 0) 0x7f5e98062210 con 0x7f5ea80d0d40 2024-09-17T05:22:42.489 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:42.489 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "epoch": 11, 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "active_gid": 4108, 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "active_name": "x", 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addrs": { 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:6800", 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3031880469 2024-09-17T05:22:42.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:6801", 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3031880469 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: "active_addr": "172.21.15.160:6801/3031880469", 2024-09-17T05:22:42.491 INFO:teuthology.orchestra.run.smithi081.stdout: "active_change": "2024-09-17T05:18:27.366532+0000", 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "active_mgr_features": 4540719139924082687, 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "available": true, 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "standbys": [ 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 4119, 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "y", 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr_features": 4540719139924082687, 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-17T05:22:42.492 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-17T05:22:42.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.495 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.497 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.498 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-17T05:22:42.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-17T05:22:42.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-17T05:22:42.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.506 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-17T05:22:42.507 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-17T05:22:42.510 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-17T05:22:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-17T05:22:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.511 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.512 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.513 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:42.514 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.515 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.516 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.517 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-17T05:22:42.518 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-17T05:22:42.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.522 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.523 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.526 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.527 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.528 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.530 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-17T05:22:42.535 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.536 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.537 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.539 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.540 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.542 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-17T05:22:42.543 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.544 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.546 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.547 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-17T05:22:42.548 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-17T05:22:42.550 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-17T05:22:42.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-17T05:22:42.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.556 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.557 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.558 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.560 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-17T05:22:42.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nginx": { 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nginx", 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nginx container image", 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.564 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-17T05:22:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.565 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.566 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_oauth2_proxy": { 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_oauth2_proxy", 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.567 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "oauth2-proxy container image", 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.568 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-17T05:22:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-17T05:22:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-17T05:22:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.569 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-17T05:22:42.570 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.571 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.572 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba_metrics": { 2024-09-17T05:22:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba_metrics", 2024-09-17T05:22:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.574 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.575 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-17T05:22:42.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.579 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.580 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-17T05:22:42.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.583 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.584 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-17T05:22:42.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-17T05:22:42.591 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-17T05:22:42.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.598 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.599 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.600 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.605 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.608 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.611 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.612 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.614 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-17T05:22:42.615 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_count_max": { 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_count_max", 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.616 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_interval": { 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_interval", 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.619 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.621 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.624 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.626 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.627 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.628 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.629 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.630 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.631 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.634 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.635 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-17T05:22:42.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-17T05:22:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.637 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.638 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-17T05:22:42.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.640 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.641 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.642 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.643 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.644 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.645 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-17T05:22:42.646 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.647 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.648 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.649 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.650 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.651 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-17T05:22:42.652 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.653 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.654 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.655 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.656 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.657 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.658 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.659 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-17T05:22:42.660 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.661 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "[]", 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.662 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "MULTICLUSTER_CONFIG": { 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "{}", 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.663 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.664 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.665 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.666 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-17T05:22:42.667 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.668 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.669 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.670 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-17T05:22:42.671 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.673 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.674 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.675 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.676 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-17T05:22:42.677 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.678 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.679 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.680 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-17T05:22:42.681 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.682 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.683 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.684 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.685 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.686 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.687 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-17T05:22:42.688 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.689 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.690 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.691 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.692 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.693 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-17T05:22:42.694 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.695 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.696 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.697 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.698 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.699 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.700 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.701 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.702 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.703 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.704 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-17T05:22:42.705 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.706 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.707 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.708 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.709 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.710 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-17T05:22:42.711 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.712 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "sso_oauth2": { 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sso_oauth2", 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.713 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.714 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.715 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.716 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.717 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-17T05:22:42.718 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.719 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.720 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.721 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.722 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.723 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.724 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.725 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.726 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.727 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.728 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.729 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.730 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.731 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.732 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.733 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-17T05:22:42.734 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.735 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.736 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.737 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.738 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.739 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.740 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.741 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.742 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-17T05:22:42.743 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.744 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.745 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.746 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.747 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.748 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.749 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.750 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.751 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.752 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.753 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.754 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.755 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.756 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.757 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-17T05:22:42.758 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.759 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.760 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.761 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.762 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-17T05:22:42.763 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.764 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.765 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.766 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.767 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.768 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.769 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.770 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.771 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.772 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.773 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.774 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.775 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.776 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.777 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.778 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.779 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.780 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.781 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.782 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.783 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-17T05:22:42.784 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.785 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.786 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.787 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.788 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.789 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.790 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.791 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-17T05:22:42.792 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.793 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.794 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-17T05:22:42.795 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.796 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.797 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.798 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.799 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.800 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.801 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.802 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.803 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.805 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.806 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.807 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.808 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.809 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.810 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.811 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.812 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.813 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.814 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.815 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.816 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.817 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.818 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.819 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.820 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.821 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.822 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.823 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.824 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.825 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.826 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.827 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.828 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.829 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.830 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.831 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.832 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.833 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.834 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.835 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.836 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.837 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.838 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.839 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-17T05:22:42.840 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.841 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.842 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.843 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.844 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.845 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.846 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.847 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.848 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.849 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.850 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.851 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.852 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.853 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.854 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.855 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.856 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:42.857 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.858 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.859 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.860 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.861 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.862 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.863 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.864 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.865 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.866 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.867 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-17T05:22:42.868 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.869 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-17T05:22:42.870 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.870 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.870 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.870 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.870 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.870 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.870 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.871 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.872 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-17T05:22:42.873 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.874 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.875 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.876 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.877 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.878 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.879 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.880 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.881 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.882 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-17T05:22:42.883 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.884 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-17T05:22:42.885 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.886 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.887 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.888 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.889 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.890 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.891 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.892 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.893 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.894 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.895 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.896 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.897 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.898 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-17T05:22:42.899 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.900 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.901 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.902 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.903 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.904 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.905 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.906 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.907 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.908 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.909 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.910 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.911 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "max_requests": { 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_requests", 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.912 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.913 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.914 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.915 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.916 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.917 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.918 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.919 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.920 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.921 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.922 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "secondary_zone_period_retry_limit": { 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.923 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.924 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.925 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.926 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.927 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.928 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.929 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.930 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.931 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.932 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.933 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.934 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.935 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.936 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.937 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.938 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.939 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.940 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.941 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.942 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.943 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.944 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:42.945 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.946 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.947 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.948 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.949 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.950 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.951 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.952 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.953 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.954 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.955 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smb", 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.956 INFO:teuthology.orchestra.run.smithi081.stdout: "internal_store_backend": { 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "internal_store_backend", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.957 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.958 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.959 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.960 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.961 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.962 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.963 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.964 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "update_orchestration": { 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "update_orchestration", 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.965 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.966 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.967 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.968 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.969 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.970 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.971 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.972 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.973 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.974 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.975 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.976 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.977 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.978 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.979 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.980 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.981 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.982 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.983 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.984 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.985 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.986 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.987 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.988 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.989 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.990 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:42.991 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-17T05:22:42.992 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.993 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:42.994 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.995 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.996 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:42.997 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:42.998 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:42.999 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.000 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.001 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.002 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.003 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.004 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-17T05:22:43.005 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.006 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.007 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-17T05:22:43.008 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.009 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.010 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.011 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-17T05:22:43.012 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.013 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.014 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.015 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.017 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.018 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.019 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.020 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.021 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.022 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.023 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.024 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.025 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.026 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.027 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.028 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.029 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.030 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.031 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.032 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.033 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.034 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.035 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.036 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.037 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.038 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.039 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.040 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.041 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.042 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-17T05:22:43.043 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.044 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.045 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.046 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.047 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.048 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.049 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.050 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.051 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.052 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.053 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.054 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.055 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.056 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.057 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.058 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.059 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.060 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-17T05:22:43.061 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.062 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.063 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "modules": [ 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "iostat", 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "nfs", 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "restful" 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "available_modules": [ 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "alerts", 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.064 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How frequently to reexamine health status", 2024-09-17T05:22:43.065 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.066 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.067 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.068 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.069 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.070 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.071 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_destination": { 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_destination", 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.072 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email address to send alerts to, use commas to separate multiple", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_from_name": { 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_from_name", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "Ceph", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.073 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Email From: name", 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_host": { 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_host", 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.074 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP server", 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_password": { 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_password", 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.075 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Password to authenticate with", 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_port": { 2024-09-17T05:22:43.076 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_port", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "465", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP port", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_sender": { 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_sender", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SMTP envelope sender", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.078 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_ssl": { 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_ssl", 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.079 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "smtp_user": { 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smtp_user", 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.080 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "User to authenticate as", 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.081 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.082 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "balancer", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "active": { 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "active", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.083 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically balance PGs across cluster", 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_time": { 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_time", 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0000", 2024-09-17T05:22:43.084 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "beginning time of day to automatically balance", 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "begin_weekday": { 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "begin_weekday", 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.085 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_max_iterations": { 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_max_iterations", 2024-09-17T05:22:43.086 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "25", 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "250", 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.087 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_metrics": { 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_metrics", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "pgs,objects,bytes", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.088 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "crush_compat_step": { 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crush_compat_step", 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.5", 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0.001", 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "0.999", 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "aggressiveness of optimization", 2024-09-17T05:22:43.089 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "end_time": { 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_time", 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2359", 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.090 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ending time of day to automatically balance", 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "end_weekday": { 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "end_weekday", 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "0", 2024-09-17T05:22:43.091 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "6", 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.092 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.093 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.094 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.095 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.096 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.097 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "min_score": { 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_score", 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.098 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.099 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "upmap", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "crush-compat", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "none", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "read", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap", 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap-read" 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.100 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Balancer mode", 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_ids": { 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_ids", 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.101 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.102 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.103 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_deviation": { 2024-09-17T05:22:43.104 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_deviation", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "upmap_max_optimizations": { 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "upmap_max_optimizations", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.106 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm", 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_down_multiplier": { 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_down_multiplier", 2024-09-17T05:22:43.107 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.108 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_refresh_rate": { 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_refresh_rate", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "20", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.109 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "agent_starting_port": { 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "agent_starting_port", 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4721", 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-17T05:22:43.110 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_ptrace": { 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_ptrace", 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.111 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_interval": { 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_interval", 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.112 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "autotune_memory_target_ratio": { 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "autotune_memory_target_ratio", 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:43.113 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0.7", 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm_log_destination": { 2024-09-17T05:22:43.114 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephadm_log_destination", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "file", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "file,syslog", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "syslog" 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-17T05:22:43.115 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "cgroups_split": { 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cgroups_split", 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.116 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "config_checks_enabled": { 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_checks_enabled", 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.117 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "config_dashboard": { 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "config_dashboard", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.118 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_alertmanager": { 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_alertmanager", 2024-09-17T05:22:43.119 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.27.0", 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.120 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_base": { 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_base", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Container image name, without the tag", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.121 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_elasticsearch": { 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_elasticsearch", 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "elasticsearch container image", 2024-09-17T05:22:43.122 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_grafana": { 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_grafana", 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/grafana:10.4.0", 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.123 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_haproxy": { 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_haproxy", 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-17T05:22:43.124 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "HAproxy container image", 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_agent": { 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_agent", 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.125 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger agent container image", 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_collector": { 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_collector", 2024-09-17T05:22:43.126 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger collector container image", 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_jaeger_query": { 2024-09-17T05:22:43.127 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_jaeger_query", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Jaeger query container image", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.128 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_keepalived": { 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_keepalived", 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Keepalived container image", 2024-09-17T05:22:43.129 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_loki": { 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_loki", 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.130 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Loki container image", 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nginx": { 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nginx", 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nginx:sclorg-nginx-126", 2024-09-17T05:22:43.131 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nginx container image", 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_node_exporter": { 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_node_exporter", 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.132 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.7.0", 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_nvmeof": { 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_nvmeof", 2024-09-17T05:22:43.133 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.17", 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Nvme-of container image", 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_oauth2_proxy": { 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_oauth2_proxy", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/oauth2-proxy/oauth2-proxy:v7.6.0", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "oauth2-proxy container image", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.135 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_prometheus": { 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_prometheus", 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/prometheus/prometheus:v2.51.0", 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.136 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Prometheus container image", 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_promtail": { 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_promtail", 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.137 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Promtail container image", 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba": { 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba", 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.138 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB container image", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_samba_metrics": { 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_samba_metrics", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.139 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "quay.io/samba.org/samba-metrics:latest", 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Samba/SMB metrics exporter container image", 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "container_image_snmp_gateway": { 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_image_snmp_gateway", 2024-09-17T05:22:43.140 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "SNMP Gateway container image", 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.141 INFO:teuthology.orchestra.run.smithi081.stdout: "container_init": { 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "container_init", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Run podman/docker with `--init`", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.142 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "daemon_cache_timeout": { 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "daemon_cache_timeout", 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-17T05:22:43.143 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "default_cephadm_command_timeout": { 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_cephadm_command_timeout", 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "900", 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.144 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "default_registry": { 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "default_registry", 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.145 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "docker.io", 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "device_cache_timeout": { 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_cache_timeout", 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.146 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1800", 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache device inventory", 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "device_enhanced_scan": { 2024-09-17T05:22:43.147 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_enhanced_scan", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.148 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "facts_cache_timeout": { 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "facts_cache_timeout", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "seconds to cache host facts data", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.149 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "grafana_dashboards_path": { 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "grafana_dashboards_path", 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.150 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "host_check_interval": { 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "host_check_interval", 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:43.151 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to perform a host check", 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "hw_monitoring": { 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hw_monitoring", 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.152 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "inventory_list_all": { 2024-09-17T05:22:43.153 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "inventory_list_all", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.154 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.155 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "log_refresh_metadata": { 2024-09-17T05:22:43.156 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_refresh_metadata", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.157 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-17T05:22:43.158 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.159 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.160 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.161 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.162 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.163 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "*", 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "max_count_per_host": { 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_count_per_host", 2024-09-17T05:22:43.164 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of daemons per service per host", 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.165 INFO:teuthology.orchestra.run.smithi081.stdout: "max_osd_draining_count": { 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_osd_draining_count", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.166 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "migration_current": { 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "migration_current", 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.167 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "internal - do not modify", 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": { 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mode", 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "root", 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.168 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm-package", 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "root" 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "mode for remote execution of cephadm", 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "oob_default_addr": { 2024-09-17T05:22:43.169 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "oob_default_addr", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "169.254.1.1", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.170 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "prometheus_alerts_path": { 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus_alerts_path", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.171 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_insecure": { 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_insecure", 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.172 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_password": { 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_password", 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.173 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_url": { 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_url", 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.174 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "registry_username": { 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "registry_username", 2024-09-17T05:22:43.175 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.176 INFO:teuthology.orchestra.run.smithi081.stdout: "secure_monitoring_stack": { 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secure_monitoring_stack", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.177 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "service_discovery_port": { 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "service_discovery_port", 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8765", 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "cephadm service discovery port", 2024-09-17T05:22:43.178 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.179 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_config_file": { 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_config_file", 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.180 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_count_max": { 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_count_max", 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.181 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many times ssh connections can fail liveness checks before the host is marked offline", 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "ssh_keepalive_interval": { 2024-09-17T05:22:43.182 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssh_keepalive_interval", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How often ssh connections are checked for liveness", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.183 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "use_agent": { 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_agent", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.184 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "use_repo_digest": { 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "use_repo_digest", 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.185 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_failed_host_check": { 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_failed_host_check", 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.186 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if the host check fails", 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_daemons": { 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_daemons", 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.187 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_on_stray_hosts": { 2024-09-17T05:22:43.188 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_on_stray_hosts", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.189 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crash", 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.190 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.191 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.192 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.193 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.194 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.195 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "retain_interval": { 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retain_interval", 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.196 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "31536000", 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.197 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_recent_interval": { 2024-09-17T05:22:43.198 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_recent_interval", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1209600", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.199 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dashboard", 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.200 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_HOST": { 2024-09-17T05:22:43.201 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.202 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.203 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_ENABLED": { 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_ENABLED", 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.204 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.205 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "ENABLE_BROWSABLE_API": { 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.206 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-17T05:22:43.207 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.208 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.209 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.210 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.211 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.212 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.213 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-17T05:22:43.214 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.215 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.216 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_PASSWORD": { 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.217 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.218 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_URL": { 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_URL", 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.219 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_API_USERNAME": { 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-17T05:22:43.220 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.221 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.222 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.223 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.224 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.225 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "MANAGED_BY_CLUSTERS": { 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MANAGED_BY_CLUSTERS", 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.226 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "[]", 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "MULTICLUSTER_CONFIG": { 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "MULTICLUSTER_CONFIG", 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.227 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "{}", 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_HOST": { 2024-09-17T05:22:43.228 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.230 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.231 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.232 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.233 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.234 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-17T05:22:43.235 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.236 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.237 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.238 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_ENABLED": { 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.239 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.240 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-17T05:22:43.241 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.242 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.243 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "45", 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.244 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ACCESS_KEY": { 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.245 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.246 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "admin", 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SECRET_KEY": { 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-17T05:22:43.247 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.248 INFO:teuthology.orchestra.run.smithi081.stdout: "RGW_API_SSL_VERIFY": { 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.249 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "UNSAFE_TLS_v1_2": { 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "UNSAFE_TLS_v1_2", 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.250 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.251 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-17T05:22:43.252 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.253 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.254 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.255 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "cross_origin_url": { 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cross_origin_url", 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.256 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "crt_file": { 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "crt_file", 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.257 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "debug": { 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "debug", 2024-09-17T05:22:43.258 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Enable/disable debug options", 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.259 INFO:teuthology.orchestra.run.smithi081.stdout: "jwt_token_ttl": { 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "jwt_token_ttl", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "28800", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.260 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.261 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.262 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.263 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.264 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.265 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.266 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.267 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "motd": { 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "motd", 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "The message of the day", 2024-09-17T05:22:43.268 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect_resolve_ip_addr": { 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "redirect_resolve_ip_addr", 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.269 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.270 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.271 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8080", 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.272 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-17T05:22:43.273 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.274 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl_server_port": { 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl_server_port", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8443", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.275 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "sso_oauth2": { 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sso_oauth2", 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.276 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "redirect", 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.277 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "redirect" 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.278 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "url_prefix": { 2024-09-17T05:22:43.279 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url_prefix", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.280 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_monitoring": { 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_monitoring", 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.281 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "monitor device health metrics", 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.282 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.283 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.284 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.285 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.286 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.287 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "mark_out_threshold": { 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mark_out_threshold", 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.288 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "2419200", 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_name": { 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pool_name", 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.289 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "device_health_metrics", 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "retention_period": { 2024-09-17T05:22:43.290 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "retention_period", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15552000", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long to retain device health metrics", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.291 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_frequency": { 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_frequency", 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-17T05:22:43.292 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "self_heal": { 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "self_heal", 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.293 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.294 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how frequently to wake up and check device health", 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.295 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "warn_threshold": { 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "warn_threshold", 2024-09-17T05:22:43.296 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "7257600", 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.297 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "diskprediction_local", 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.298 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.299 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.300 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.301 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.302 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.303 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "predict_interval": { 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predict_interval", 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "86400", 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.304 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "predictor_model": { 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "predictor_model", 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "prophetstor", 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.305 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "600", 2024-09-17T05:22:43.306 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.307 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.308 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "influx", 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": false, 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "influxdb python module not found", 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "batch_size": { 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "batch_size", 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5000", 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.309 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "database": { 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "database", 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "ceph", 2024-09-17T05:22:43.310 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": { 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "hostname", 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.311 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server hostname", 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:43.312 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "30", 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "5", 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.313 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.314 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.315 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.316 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.317 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.318 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "password": { 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "password", 2024-09-17T05:22:43.319 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "password of InfluxDB server user", 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.320 INFO:teuthology.orchestra.run.smithi081.stdout: "port": { 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "port", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "8086", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "InfluxDB server port", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.321 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.322 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "ssl": { 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "ssl", 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "false", 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.323 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "threads": { 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threads", 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:43.324 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "32", 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "username": { 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "username", 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.325 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "username of InfluxDB server user", 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "verify_ssl": { 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "verify_ssl", 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.326 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "true", 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.327 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "insights", 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.328 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.329 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.330 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.331 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.332 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.333 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.334 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.335 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.336 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "iostat", 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.337 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.338 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.339 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.340 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.341 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.342 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.343 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.344 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "localpool", 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "failure_domain": { 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "failure_domain", 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "host", 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.345 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "failure domain for any created local pool", 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.346 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.347 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.348 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.349 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.350 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.351 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "min_size": { 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "min_size", 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.352 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default min_size for any created local pool", 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "num_rep": { 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "num_rep", 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.353 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3", 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default replica count for any created local pool", 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_num": { 2024-09-17T05:22:43.354 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_num", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "128", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "default pg_num for any created local pool", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.355 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "prefix": { 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prefix", 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "name prefix for any created local pool", 2024-09-17T05:22:43.356 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.357 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "subtree": { 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subtree", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "rack", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.358 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mds_autoscaler", 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.359 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.360 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.361 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.362 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.363 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.364 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.365 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.366 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirroring", 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.367 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.368 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.369 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.370 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.371 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.372 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.373 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.374 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.375 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "nfs", 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.376 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.377 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.378 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.379 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.380 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.381 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.382 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.383 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "fail_fs": { 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fail_fs", 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.384 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.385 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.386 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.387 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.388 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.389 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.390 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator": { 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "orchestrator", 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.391 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "cephadm", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "rook", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "test_orchestrator" 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Orchestrator backend", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.392 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.393 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_perf_query", 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.394 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.395 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.396 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.397 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.398 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.399 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.400 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.401 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "osd_support", 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.402 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.403 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.404 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.405 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.406 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.407 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.408 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.409 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "pg_autoscaler", 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.410 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.411 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.412 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.413 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.414 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.415 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:43.416 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.417 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.418 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "threshold": { 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "threshold", 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "3.0", 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1.0", 2024-09-17T05:22:43.419 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "scaling threshold", 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "progress", 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.420 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_pg_recovery_event": { 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_pg_recovery_event", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-17T05:22:43.421 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.422 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.423 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.424 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.425 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.426 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.427 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.428 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.429 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max_completed_events": { 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_completed_events", 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "50", 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "number of past completed events to remember", 2024-09-17T05:22:43.430 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "sleep_interval": { 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sleep_interval", 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.431 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "how long the module is going to sleep", 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.432 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "prometheus", 2024-09-17T05:22:43.433 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "cache": { 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cache", 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.434 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "exclude_perf_counters": { 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "exclude_perf_counters", 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.435 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.436 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.437 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.438 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.439 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.440 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.441 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools": { 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools", 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.442 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.443 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "300", 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "scrape_interval": { 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "scrape_interval", 2024-09-17T05:22:43.444 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15.0", 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.445 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "::", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.446 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "9283", 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-17T05:22:43.447 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.448 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "stale_cache_strategy": { 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stale_cache_strategy", 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "log", 2024-09-17T05:22:43.449 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_behaviour": { 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_behaviour", 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.450 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "default", 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "default", 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "error" 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.451 INFO:teuthology.orchestra.run.smithi081.stdout: "standby_error_status_code": { 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "standby_error_status_code", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "400", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "599", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.452 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.453 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.454 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.455 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.456 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.457 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.458 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.459 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.460 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_snap_create": { 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_snap_create", 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10", 2024-09-17T05:22:43.461 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "mirror_snapshot_schedule": { 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "mirror_snapshot_schedule", 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.462 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.463 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "trash_purge_schedule": { 2024-09-17T05:22:43.464 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "trash_purge_schedule", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "restful", 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "enable_auth": { 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enable_auth", 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.466 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "key_file": { 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "key_file", 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.467 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.468 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.469 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.470 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.471 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.472 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.473 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.474 INFO:teuthology.orchestra.run.smithi081.stdout: "max_requests": { 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_requests", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "500", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.475 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "server_addr": { 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_addr", 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.476 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "server_port": { 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "server_port", 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.477 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.478 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rgw", 2024-09-17T05:22:43.479 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.480 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.481 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.482 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.483 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.484 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.485 INFO:teuthology.orchestra.run.smithi081.stdout: "secondary_zone_period_retry_limit": { 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "5", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.486 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.487 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rook", 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.488 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.489 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.490 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.491 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.492 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.493 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.494 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "storage_class": { 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "storage_class", 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.495 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "local", 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.496 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "selftest", 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.497 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.498 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.499 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.500 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.501 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.502 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "roption1": { 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption1", 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.503 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "roption2": { 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "roption2", 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "xyz", 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.504 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption1": { 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption1", 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.505 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption2": { 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption2", 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.506 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption3": { 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption3", 2024-09-17T05:22:43.507 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "float", 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.508 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption4": { 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption4", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption5": { 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption5", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.510 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption6": { 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption6", 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.511 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "rwoption7": { 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rwoption7", 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "1", 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "42", 2024-09-17T05:22:43.512 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.513 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "testkey": { 2024-09-17T05:22:43.514 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testkey", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.515 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "testlkey": { 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testlkey", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.516 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "testnewline": { 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "testnewline", 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.517 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "smb", 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.518 INFO:teuthology.orchestra.run.smithi081.stdout: "internal_store_backend": { 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "internal_store_backend", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "set internal store backend. for develoment and testing only", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.519 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.520 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.521 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.522 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.523 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.524 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.525 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.526 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "update_orchestration": { 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "update_orchestration", 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.527 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "automatically update orchestration when smb resources are changed", 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.528 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snap_schedule", 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "allow_m_granularity": { 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "allow_m_granularity", 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.529 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "allow minute scheduled snapshots", 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "dump_on_update": { 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "dump_on_update", 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.530 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "dump database to debug log on update", 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.531 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.532 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.533 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.534 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.535 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.536 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.537 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.538 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "stats", 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.539 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.540 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.541 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.542 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.543 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.544 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.545 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "status", 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.546 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.547 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.548 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.549 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.550 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.551 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.552 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.553 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telegraf", 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "address": { 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "address", 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.554 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:43.555 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "15", 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.556 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.557 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.558 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.559 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.560 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.561 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.562 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.563 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "telemetry", 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_basic": { 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_basic", 2024-09-17T05:22:43.564 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.565 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_crash": { 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_crash", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.566 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_device": { 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_device", 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-17T05:22:43.567 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_ident": { 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_ident", 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.568 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "channel_perf": { 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "channel_perf", 2024-09-17T05:22:43.569 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.570 INFO:teuthology.orchestra.run.smithi081.stdout: "contact": { 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "contact", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.571 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "description": { 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "description", 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.572 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "device_url": { 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "device_url", 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "enabled": { 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "enabled", 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "24", 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "8", 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "last_opt_revision": { 2024-09-17T05:22:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "last_opt_revision", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "1", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.577 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard": { 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.578 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "leaderboard_description": { 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "leaderboard_description", 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.579 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.580 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.581 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.582 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.583 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.584 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.585 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "organization": { 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "organization", 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.586 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "proxy": { 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "proxy", 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.587 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.588 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "url": { 2024-09-17T05:22:43.589 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "url", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "test_orchestrator", 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.591 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.592 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.593 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.594 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.595 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.596 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.597 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.598 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.599 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.600 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.601 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.602 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.603 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.604 INFO:teuthology.orchestra.run.smithi081.stdout: "max_concurrent_clones": { 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "max_concurrent_clones", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "4", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.605 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "periodic_async_work": { 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "periodic_async_work", 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Periodically check for async work", 2024-09-17T05:22:43.606 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_delay": { 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_delay", 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.607 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot_clone_no_wait": { 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "snapshot_clone_no_wait", 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "True", 2024-09-17T05:22:43.608 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.609 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.610 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix", 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "can_run": true, 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "error_string": "", 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "module_options": { 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "discovery_interval": { 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "discovery_interval", 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "uint", 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.611 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "100", 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "identifier": { 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "identifier", 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.612 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.613 INFO:teuthology.orchestra.run.smithi081.stdout: "interval": { 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "interval", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "secs", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "60", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "log_level": { 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_level", 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.615 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.616 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster": { 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.617 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_cluster_level": { 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_cluster_level", 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "info", 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [ 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "", 2024-09-17T05:22:43.618 INFO:teuthology.orchestra.run.smithi081.stdout: "critical", 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "debug", 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "error", 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "info", 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "warning" 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.619 INFO:teuthology.orchestra.run.smithi081.stdout: "log_to_file": { 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "log_to_file", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "bool", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "False", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.620 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "sqlite3_killpoint": { 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "sqlite3_killpoint", 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "dev", 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 1, 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "0", 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.621 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_host": { 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_host", 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "", 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.622 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_port": { 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_port", 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "int", 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "10051", 2024-09-17T05:22:43.623 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "zabbix_sender": { 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "zabbix_sender", 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "str", 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "level": "advanced", 2024-09-17T05:22:43.624 INFO:teuthology.orchestra.run.smithi081.stdout: "flags": 0, 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "min": "", 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "max": "", 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "enum_allowed": [], 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "desc": "", 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "long_desc": "", 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "tags": [], 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: "see_also": [] 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.625 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "services": {}, 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "always_on_modules": { 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "octopus": [ 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-17T05:22:43.626 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pacific": [ 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-17T05:22:43.627 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "quincy": [ 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-17T05:22:43.628 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "reef": [ 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-17T05:22:43.629 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "squid": [ 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "balancer", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "crash", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "devicehealth", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "orchestrator", 2024-09-17T05:22:43.630 INFO:teuthology.orchestra.run.smithi081.stdout: "pg_autoscaler", 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "progress", 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "rbd_support", 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "status", 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "telemetry", 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "volumes" 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "last_failure_osd_epoch": 0, 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "active_clients": [ 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "devicehealth", 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.631 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3351927694 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "libcephsqlite", 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.632 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3080399496 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "rbd_support", 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3804699421 2024-09-17T05:22:43.633 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1489157457 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.634 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1768307905 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.635 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2536755070 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.636 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3576223037 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.637 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3431006755 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 697047706 2024-09-17T05:22:43.638 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "volumes", 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addrvec": [ 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v2", 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "172.21.15.160:0", 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 3087237031 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.639 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:43.640 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:43.640 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:22:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5e94078ef0 msgr2=0x7f5e9407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5e94078ef0 0x7f5e9407b3b0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f5ea80b3920 tx=0x7f5e9c005f90 comp rx=0 tx=0).stop 2024-09-17T05:22:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea80d0d40 msgr2=0x7f5ea81f8a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea80d0d40 0x7f5ea81f8a00 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5e9800c7a0 tx=0x7f5e9800cc60 comp rx=0 tx=0).stop 2024-09-17T05:22:43.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 shutdown_connections 2024-09-17T05:22:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7f5e94078ef0 0x7f5e9407b3b0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea815df90 0x7f5ea815a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea80d49c0 0x7f5ea80b8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 --2- 172.21.15.81:0/1945109933 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea80d0d40 0x7f5ea81f8a00 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 >> 172.21.15.81:0/1945109933 conn(0x7f5ea80d3ea0 msgr2=0x7f5ea8161630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 shutdown_connections 2024-09-17T05:22:43.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:42.487+0000 7f5eb00cf640 1 -- 172.21.15.81:0/1945109933 wait complete. 2024-09-17T05:22:43.647 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr fail x 2024-09-17T05:22:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 -- 172.21.15.81:0/3713636843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c151370 msgr2=0x7ff06c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 --2- 172.21.15.81:0/3713636843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c151370 0x7ff06c0cef30 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7ff05c005fd0 tx=0x7ff05c02aa50 comp rx=0 tx=0).stop 2024-09-17T05:22:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 -- 172.21.15.81:0/3713636843 shutdown_connections 2024-09-17T05:22:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 --2- 172.21.15.81:0/3713636843 >> v2:172.21.15.160:3300/0 conn(0x7ff06c072cb0 0x7ff06c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 --2- 172.21.15.81:0/3713636843 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c151370 0x7ff06c0cef30 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 -- 172.21.15.81:0/3713636843 >> 172.21.15.81:0/3713636843 conn(0x7ff06c0b1690 msgr2=0x7ff06c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:43.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 -- 172.21.15.81:0/3713636843 shutdown_connections 2024-09-17T05:22:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.759+0000 7ff072110640 1 -- 172.21.15.81:0/3713636843 wait complete. 2024-09-17T05:22:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.760+0000 7ff072110640 1 Processor -- start 2024-09-17T05:22:43.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.760+0000 7ff072110640 1 -- start start 2024-09-17T05:22:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff072110640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c072cb0 0x7ff06c12ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff072110640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c0b3140 0x7ff06c12f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff072110640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c151370 0x7ff06c0ce9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff072110640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c06ebe0 con 0x7ff06c0b3140 2024-09-17T05:22:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff072110640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c06ea60 con 0x7ff06c072cb0 2024-09-17T05:22:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff072110640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff06c06f9f0 con 0x7ff06c151370 2024-09-17T05:22:43.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c0b3140 0x7ff06c12f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c0b3140 0x7ff06c12f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:59912/0 (socket says 172.21.15.81:59912) 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 -- 172.21.15.81:0/2058797905 learned_addr learned my addr 172.21.15.81:0/2058797905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06bfff640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c151370 0x7ff06c0ce9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06b7fe640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c072cb0 0x7ff06c12ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 -- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c151370 msgr2=0x7ff06c0ce9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c151370 0x7ff06c0ce9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 -- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c072cb0 msgr2=0x7ff06c12ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c072cb0 0x7ff06c12ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 -- 172.21.15.81:0/2058797905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c147700 con 0x7ff06c0b3140 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06b7fe640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c072cb0 0x7ff06c12ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.761+0000 7ff06affd640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c0b3140 0x7ff06c12f440 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff06000c430 tx=0x7ff06000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:43.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.762+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060011790 con 0x7ff06c0b3140 2024-09-17T05:22:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.762+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff060017070 con 0x7ff06c0b3140 2024-09-17T05:22:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.762+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff060011d00 con 0x7ff06c0b3140 2024-09-17T05:22:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.762+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c1f3660 con 0x7ff06c0b3140 2024-09-17T05:22:43.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.762+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c1f3040 con 0x7ff06c0b3140 2024-09-17T05:22:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.763+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06c0725a0 con 0x7ff06c0b3140 2024-09-17T05:22:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.763+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 12) ==== 101798+0+0 (secure 0 0 0) 0x7ff06001c460 con 0x7ff06c0b3140 2024-09-17T05:22:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.764+0000 7ff053fff640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff058078f80 0x7ff05807b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.764+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(71..71 src has 1..71) ==== 5767+0+0 (secure 0 0 0) 0x7ff06009b3f0 con 0x7ff06c0b3140 2024-09-17T05:22:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.764+0000 7ff06b7fe640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff058078f80 0x7ff05807b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:43.766 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.765+0000 7ff06b7fe640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff058078f80 0x7ff05807b440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff05c035000 tx=0x7ff05c004ab0 comp rx=0 tx=0).ready entity=mgr.4108 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:43.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.768+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff060063220 con 0x7ff06c0b3140 2024-09-17T05:22:43.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.989+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "mgr fail", "who": "x"} v 0) -- 0x7ff06c0b38a0 con 0x7ff06c0b3140 2024-09-17T05:22:43.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.995+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "mgr fail", "who": "x"}]=0 v13) ==== 68+0+0 (secure 0 0 0) 0x7ff060062b20 con 0x7ff06c0b3140 2024-09-17T05:22:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mgrmap(e 13) ==== 50742+0+0 (secure 0 0 0) 0x7ff06009b0c0 con 0x7ff06c0b3140 2024-09-17T05:22:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff053fff640 1 -- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff058078f80 msgr2=0x7ff05807b440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff053fff640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff058078f80 0x7ff05807b440 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7ff05c035000 tx=0x7ff05c004ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c0b3140 msgr2=0x7ff06c12f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff072110640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c0b3140 0x7ff06c12f440 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7ff06000c430 tx=0x7ff06000c8f0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 shutdown_connections 2024-09-17T05:22:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff072110640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:6800/3031880469,v1:172.21.15.160:6801/3031880469] conn(0x7ff058078f80 0x7ff05807b440 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff072110640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c151370 0x7ff06c0ce9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:43.999+0000 7ff072110640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff06c0b3140 0x7ff06c12f440 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.000+0000 7ff072110640 1 --2- 172.21.15.81:0/2058797905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c072cb0 0x7ff06c12ddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.000+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 >> 172.21.15.81:0/2058797905 conn(0x7ff06c0b1690 msgr2=0x7ff06c0aff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.000+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 shutdown_connections 2024-09-17T05:22:44.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.000+0000 7ff072110640 1 -- 172.21.15.81:0/2058797905 wait complete. 2024-09-17T05:22:44.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:44.090 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.090 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.090 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.091 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:22:44.089+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.143+0000 7fb04cba9640 1 -- 172.21.15.81:0/3018778316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 msgr2=0x7fb0480cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.143+0000 7fb04cba9640 1 --2- 172.21.15.81:0/3018778316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480cef30 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fb0480cc0c0 tx=0x7fb03802a560 comp rx=0 tx=0).stop 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.144+0000 7fb04cba9640 1 -- 172.21.15.81:0/3018778316 shutdown_connections 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.144+0000 7fb04cba9640 1 --2- 172.21.15.81:0/3018778316 >> v2:172.21.15.160:3300/0 conn(0x7fb0480725a0 0x7fb048072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.144+0000 7fb04cba9640 1 --2- 172.21.15.81:0/3018778316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0480b3140 0x7fb0480cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.144+0000 7fb04cba9640 1 --2- 172.21.15.81:0/3018778316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480cef30 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.144+0000 7fb04cba9640 1 -- 172.21.15.81:0/3018778316 >> 172.21.15.81:0/3018778316 conn(0x7fb0480b1690 msgr2=0x7fb0480b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:44.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.144+0000 7fb04cba9640 1 -- 172.21.15.81:0/3018778316 shutdown_connections 2024-09-17T05:22:44.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.144+0000 7fb04cba9640 1 -- 172.21.15.81:0/3018778316 wait complete. 2024-09-17T05:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.145+0000 7fb04cba9640 1 Processor -- start 2024-09-17T05:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.145+0000 7fb04cba9640 1 -- start start 2024-09-17T05:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04cba9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0480725a0 0x7fb0481f3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04cba9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0480b3140 0x7fb04814e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04cba9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480b3650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04cba9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb04806fe30 con 0x7fb048151370 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04cba9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb04806fcb0 con 0x7fb0480b3140 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04cba9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb04806ffb0 con 0x7fb0480725a0 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480b3650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480b3650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60036/0 (socket says 172.21.15.81:60036) 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 -- 172.21.15.81:0/2210396262 learned_addr learned my addr 172.21.15.81:0/2210396262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04659c640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0480725a0 0x7fb0481f3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb045d9b640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0480b3140 0x7fb04814e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 -- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0480725a0 msgr2=0x7fb0481f3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0480725a0 0x7fb0481f3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 -- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0480b3140 msgr2=0x7fb04814e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0480b3140 0x7fb04814e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 -- 172.21.15.81:0/2210396262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb04814f180 con 0x7fb048151370 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb046d9d640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480b3650 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb04000b9a0 tx=0x7fb04000bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb036ffd640 1 -- 172.21.15.81:0/2210396262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040019070 con 0x7fb048151370 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb036ffd640 1 -- 172.21.15.81:0/2210396262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb04000cbb0 con 0x7fb048151370 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb04814f460 con 0x7fb048151370 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.146+0000 7fb036ffd640 1 -- 172.21.15.81:0/2210396262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb040014440 con 0x7fb048151370 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.147+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb04814fa20 con 0x7fb048151370 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.147+0000 7fb036ffd640 1 -- 172.21.15.81:0/2210396262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50742+0+0 (secure 0 0 0) 0x7fb04001c070 con 0x7fb048151370 2024-09-17T05:22:44.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.147+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0480707d0 con 0x7fb048151370 2024-09-17T05:22:44.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.148+0000 7fb036ffd640 1 -- 172.21.15.81:0/2210396262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7fb040053220 con 0x7fb048151370 2024-09-17T05:22:44.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.152+0000 7fb036ffd640 1 -- 172.21.15.81:0/2210396262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb0480707d0 con 0x7fb048151370 2024-09-17T05:22:44.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.361+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb048070550 con 0x7fb048151370 2024-09-17T05:22:44.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.362+0000 7fb036ffd640 1 -- 172.21.15.81:0/2210396262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7fb04001dd50 con 0x7fb048151370 2024-09-17T05:22:44.363 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:44.363 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-17T05:22:32:523944+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:44.364 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-17T05:22:44.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 msgr2=0x7fb0480b3650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480b3650 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7fb04000b9a0 tx=0x7fb04000bda0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 shutdown_connections 2024-09-17T05:22:44.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb048151370 0x7fb0480b3650 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0480b3140 0x7fb04814e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 --2- 172.21.15.81:0/2210396262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0480725a0 0x7fb0481f3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 >> 172.21.15.81:0/2210396262 conn(0x7fb0480b1690 msgr2=0x7fb0480ce5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:44.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 shutdown_connections 2024-09-17T05:22:44.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.364+0000 7fb04cba9640 1 -- 172.21.15.81:0/2210396262 wait complete. 2024-09-17T05:22:44.377 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json session ls 2024-09-17T05:22:44.492 INFO:teuthology.orchestra.run.smithi081.stdout:[{"id":6489,"entity":{"name":{"type":"client","num":6489},"addr":{"type":"any","addr":"172.21.15.81:0","nonce":344659830}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.39099249000000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9982102054980422,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6489 172.21.15.81:0/344659830","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"y","hostname":"smithi081","pid":"36360","root":"/"}},{"id":6492,"entity":{"name":{"type":"client","num":6492},"addr":{"type":"any","addr":"172.21.15.81:0","nonce":1679066778}},"state":"open","num_leases":0,"num_caps":2,"request_load_avg":2,"uptime":0.39099249000000003,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":1.9982102054980422,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":2,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.6492 172.21.15.81:0/1679066778","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000003fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"820f760e4779dafd30d668ecea7aba6355dfd3d8","ceph_version":"ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)","entity_id":"y","hostname":"smithi081","pid":"36360","root":"/"}}] 2024-09-17T05:22:44.493 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi081", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36360", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 344659830, "type": "any" }, "name": { "num": 6489, "type": "client" } }, "id": 6489, "inst": "client.6489 172.21.15.81:0/344659830", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9982102054980422 }, "state": "open", "uptime": 0.39099249 }, { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", "client_features": { "feature_bits": "0x00000000003fffff" }, "entity_id": "y", "hostname": "smithi081", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "pid": "36360", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.81:0", "nonce": 1679066778, "type": "any" }, "name": { "num": 6492, "type": "client" } }, "id": 6492, "inst": "client.6492 172.21.15.81:0/1679066778", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 2, "num_caps": 2, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 2, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 1.9982102054980422 }, "state": "open", "uptime": 0.39099249 } ] 2024-09-17T05:22:44.493 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2024-09-17T05:22:44.493 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:22:44.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:44.526 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:44.571 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:22:44.571 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:44.571 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:44.572 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:44.587 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:44.588 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:44.588 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:44.588 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:44.604 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:44.605 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:44.605 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:44.605 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:44.643 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:44.643 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:22:44.643 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:44.643 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:44.660 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:44.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 -- 172.21.15.81:0/2181112286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 msgr2=0x7fe840072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 --2- 172.21.15.81:0/2181112286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840072a10 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fe840069dc0 tx=0x7fe82802a560 comp rx=0 tx=0).stop 2024-09-17T05:22:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 -- 172.21.15.81:0/2181112286 shutdown_connections 2024-09-17T05:22:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 --2- 172.21.15.81:0/2181112286 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840072a10 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 --2- 172.21.15.81:0/2181112286 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8400b3140 0x7fe8400cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 --2- 172.21.15.81:0/2181112286 >> v2:172.21.15.160:3300/0 conn(0x7fe840151370 0x7fe8400cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 -- 172.21.15.81:0/2181112286 >> 172.21.15.81:0/2181112286 conn(0x7fe8400b1690 msgr2=0x7fe8400b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 -- 172.21.15.81:0/2181112286 shutdown_connections 2024-09-17T05:22:44.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.782+0000 7fe847039640 1 -- 172.21.15.81:0/2181112286 wait complete. 2024-09-17T05:22:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.784+0000 7fe847039640 1 Processor -- start 2024-09-17T05:22:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.784+0000 7fe847039640 1 -- start start 2024-09-17T05:22:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.784+0000 7fe847039640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840154470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.784+0000 7fe847039640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8400b3140 0x7fe840151e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe847039640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe840151370 0x7fe840152390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:44.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe847039640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe84006fe30 con 0x7fe8400725a0 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe847039640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe84006fcb0 con 0x7fe840151370 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe847039640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe84006ffb0 con 0x7fe8400b3140 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840154470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840154470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60044/0 (socket says 172.21.15.81:60044) 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 -- 172.21.15.81:0/2780812917 learned_addr learned my addr 172.21.15.81:0/2780812917 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe83ffff640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8400b3140 0x7fe840151e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe8455d6640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe840151370 0x7fe840152390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 -- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8400b3140 msgr2=0x7fe840151e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8400b3140 0x7fe840151e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 -- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe840151370 msgr2=0x7fe840152390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe840151370 0x7fe840152390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:44.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 -- 172.21.15.81:0/2780812917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8401f8610 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe844dd5640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840154470 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe83800d770 tx=0x7fe83800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe838017070 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe838009cc0 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8401549b0 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8380106c0 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.785+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8401529c0 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.786+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 13) ==== 50742+0+0 (secure 0 0 0) 0x7fe83801a070 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.786+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8400cc110 con 0x7fe8400725a0 2024-09-17T05:22:44.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.786+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7fe838053740 con 0x7fe8400725a0 2024-09-17T05:22:44.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.791+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe8400cc110 con 0x7fe8400725a0 2024-09-17T05:22:44.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.998+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 14) ==== 50869+0+0 (secure 0 0 0) 0x7fe838010860 con 0x7fe8400725a0 2024-09-17T05:22:45.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.999+0000 7fe83d7fa640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe820044370 0x7fe820046760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:44.999+0000 7fe83ffff640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe820044370 0x7fe820046760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.001+0000 7fe83ffff640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe820044370 0x7fe820046760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8401ec110 tx=0x7fe830009600 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.006+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8400704d0 con 0x7fe8400725a0 2024-09-17T05:22:45.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.006+0000 7fe83d7fa640 1 -- 172.21.15.81:0/2780812917 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7fe8380088d0 con 0x7fe8400725a0 2024-09-17T05:22:45.007 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:45.007 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-17T05:22:32:523944+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:45.008 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-17T05:22:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe820044370 msgr2=0x7fe820046760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe820044370 0x7fe820046760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fe8401ec110 tx=0x7fe830009600 comp rx=0 tx=0).stop 2024-09-17T05:22:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 msgr2=0x7fe840154470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840154470 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fe83800d770 tx=0x7fe83800dc30 comp rx=0 tx=0).stop 2024-09-17T05:22:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 shutdown_connections 2024-09-17T05:22:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe820044370 0x7fe820046760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe840151370 0x7fe840152390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8400b3140 0x7fe840151e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 --2- 172.21.15.81:0/2780812917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8400725a0 0x7fe840154470 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 >> 172.21.15.81:0/2780812917 conn(0x7fe8400b1690 msgr2=0x7fe84014f970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 shutdown_connections 2024-09-17T05:22:45.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.009+0000 7fe847039640 1 -- 172.21.15.81:0/2780812917 wait complete. 2024-09-17T05:22:45.021 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 -- 172.21.15.81:0/3732905235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 msgr2=0x7fd7840cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3732905235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840cf920 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fd7840d2ce0 tx=0x7fd77402a560 comp rx=0 tx=0).stop 2024-09-17T05:22:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 -- 172.21.15.81:0/3732905235 shutdown_connections 2024-09-17T05:22:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3732905235 >> v2:172.21.15.160:3300/0 conn(0x7fd784160ac0 0x7fd784160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3732905235 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7840d1a10 0x7fd784161f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3732905235 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840cf920 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 -- 172.21.15.81:0/3732905235 >> 172.21.15.81:0/3732905235 conn(0x7fd7840d3e40 msgr2=0x7fd7840d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 -- 172.21.15.81:0/3732905235 shutdown_connections 2024-09-17T05:22:45.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.121+0000 7fd7898c6640 1 -- 172.21.15.81:0/3732905235 wait complete. 2024-09-17T05:22:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.123+0000 7fd7898c6640 1 Processor -- start 2024-09-17T05:22:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.123+0000 7fd7898c6640 1 -- start start 2024-09-17T05:22:45.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7840d1a10 0x7fd784153240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd784160ac0 0x7fd7840cd840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840c93f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd784161820 con 0x7fd784161b30 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd7841616a0 con 0x7fd784160ac0 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd7840d0710 con 0x7fd7840d1a10 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840c93f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840c93f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60062/0 (socket says 172.21.15.81:60062) 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 -- 172.21.15.81:0/3181757712 learned_addr learned my addr 172.21.15.81:0/3181757712 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd782ffd640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7840d1a10 0x7fd784153240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7827fc640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd784160ac0 0x7fd7840cd840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 -- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7840d1a10 msgr2=0x7fd784153240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7840d1a10 0x7fd784153240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 -- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd784160ac0 msgr2=0x7fd7840cd840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd784160ac0 0x7fd7840cd840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 -- 172.21.15.81:0/3181757712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7841f5a80 con 0x7fd784161b30 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7837fe640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840c93f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00ead0 tx=0x7fd77c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd76bfff640 1 -- 172.21.15.81:0/3181757712 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c00cde0 con 0x7fd784161b30 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd76bfff640 1 -- 172.21.15.81:0/3181757712 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd77c004c10 con 0x7fd784161b30 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd76bfff640 1 -- 172.21.15.81:0/3181757712 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77c005020 con 0x7fd784161b30 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7840c7620 con 0x7fd784161b30 2024-09-17T05:22:45.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.124+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7841f57a0 con 0x7fd784161b30 2024-09-17T05:22:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.125+0000 7fd76bfff640 1 -- 172.21.15.81:0/3181757712 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 50869+0+0 (secure 0 0 0) 0x7fd77c0051c0 con 0x7fd784161b30 2024-09-17T05:22:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.125+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd784160f50 con 0x7fd784161b30 2024-09-17T05:22:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.125+0000 7fd76bfff640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd77003e670 0x7fd770040b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.126+0000 7fd76bfff640 1 -- 172.21.15.81:0/3181757712 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7fd77c054190 con 0x7fd784161b30 2024-09-17T05:22:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.126+0000 7fd782ffd640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd77003e670 0x7fd770040b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.126+0000 7fd782ffd640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd77003e670 0x7fd770040b30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd774033000 tx=0x7fd774004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.130+0000 7fd76bfff640 1 -- 172.21.15.81:0/3181757712 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd77c016030 con 0x7fd784161b30 2024-09-17T05:22:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.341+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd7840b3580 con 0x7fd784161b30 2024-09-17T05:22:45.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.341+0000 7fd76bfff640 1 -- 172.21.15.81:0/3181757712 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7fd77c0114c0 con 0x7fd784161b30 2024-09-17T05:22:45.342 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:45.343 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-17T05:22:32:523944+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:45.343 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-17T05:22:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd77003e670 msgr2=0x7fd770040b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd77003e670 0x7fd770040b30 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fd774033000 tx=0x7fd774004730 comp rx=0 tx=0).stop 2024-09-17T05:22:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 msgr2=0x7fd7840c93f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840c93f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fd77c00ead0 tx=0x7fd77c00ef90 comp rx=0 tx=0).stop 2024-09-17T05:22:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 shutdown_connections 2024-09-17T05:22:45.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd784161b30 0x7fd7840c93f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd77003e670 0x7fd770040b30 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd784160ac0 0x7fd7840cd840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 --2- 172.21.15.81:0/3181757712 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7840d1a10 0x7fd784153240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 >> 172.21.15.81:0/3181757712 conn(0x7fd7840d3e40 msgr2=0x7fd78406e120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 shutdown_connections 2024-09-17T05:22:45.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.344+0000 7fd7898c6640 1 -- 172.21.15.81:0/3181757712 wait complete. 2024-09-17T05:22:45.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:45.348 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:22:45.356 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:45.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.495+0000 7f6451dc2640 1 -- 172.21.15.81:0/743907992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 msgr2=0x7f644c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.495+0000 7f6451dc2640 1 --2- 172.21.15.81:0/743907992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c0cf9b0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6440009830 tx=0x7f644002a5c0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.495+0000 7f6451dc2640 1 -- 172.21.15.81:0/743907992 shutdown_connections 2024-09-17T05:22:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.495+0000 7f6451dc2640 1 --2- 172.21.15.81:0/743907992 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c0cf9b0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.495+0000 7f6451dc2640 1 -- 172.21.15.81:0/743907992 >> 172.21.15.81:0/743907992 conn(0x7f644c0d3ea0 msgr2=0x7f644c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.495+0000 7f6451dc2640 1 -- 172.21.15.81:0/743907992 shutdown_connections 2024-09-17T05:22:45.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.495+0000 7f6451dc2640 1 -- 172.21.15.81:0/743907992 wait complete. 2024-09-17T05:22:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.496+0000 7f6451dc2640 1 Processor -- start 2024-09-17T05:22:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f6451dc2640 1 -- start start 2024-09-17T05:22:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f6451dc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c14aff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f6451dc2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f644c0d49c0 0x7f644c1f8da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f6451dc2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f644c15df90 0x7f644c0cd950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f6451dc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f644c162690 con 0x7f644c0d0d40 2024-09-17T05:22:45.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f6451dc2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f644c0b3f10 con 0x7f644c0d49c0 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f6451dc2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f644c1f5d60 con 0x7f644c15df90 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c14aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f644b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c14aff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60072/0 (socket says 172.21.15.81:60072) 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f644b7fe640 1 -- 172.21.15.81:0/907455678 learned_addr learned my addr 172.21.15.81:0/907455678 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f644affd640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f644c0d49c0 0x7f644c1f8da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.497+0000 7f644bfff640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f644c15df90 0x7f644c0cd950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f644b7fe640 1 -- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f644c15df90 msgr2=0x7f644c0cd950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f644b7fe640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f644c15df90 0x7f644c0cd950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f644b7fe640 1 -- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f644c0d49c0 msgr2=0x7f644c1f8da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f644b7fe640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f644c0d49c0 0x7f644c1f8da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f644b7fe640 1 -- 172.21.15.81:0/907455678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f644c1f92e0 con 0x7f644c0d0d40 2024-09-17T05:22:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f644b7fe640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c14aff0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f643c00cbc0 tx=0x7f643c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f6433fff640 1 -- 172.21.15.81:0/907455678 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c016020 con 0x7f644c0d0d40 2024-09-17T05:22:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f6433fff640 1 -- 172.21.15.81:0/907455678 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f643c00add0 con 0x7f644c0d0d40 2024-09-17T05:22:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f644c1f51e0 con 0x7f644c0d0d40 2024-09-17T05:22:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f6433fff640 1 -- 172.21.15.81:0/907455678 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f643c012680 con 0x7f644c0d0d40 2024-09-17T05:22:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.498+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f644c1f57a0 con 0x7f644c0d0d40 2024-09-17T05:22:45.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.499+0000 7f6433fff640 1 -- 172.21.15.81:0/907455678 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 50869+0+0 (secure 0 0 0) 0x7f643c019020 con 0x7f644c0d0d40 2024-09-17T05:22:45.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.499+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f644c0b4430 con 0x7f644c0d0d40 2024-09-17T05:22:45.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.499+0000 7f6433fff640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f643803e670 0x7f6438040b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.499+0000 7f6433fff640 1 -- 172.21.15.81:0/907455678 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7f643c0539c0 con 0x7f644c0d0d40 2024-09-17T05:22:45.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.499+0000 7f644affd640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f643803e670 0x7f6438040b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.500+0000 7f644affd640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f643803e670 0x7f6438040b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6440034000 tx=0x7f6440004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.504+0000 7f6433fff640 1 -- 172.21.15.81:0/907455678 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f643c020030 con 0x7f644c0d0d40 2024-09-17T05:22:45.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.679+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f644c0cb6a0 con 0x7f644c0d0d40 2024-09-17T05:22:45.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.680+0000 7f6433fff640 1 -- 172.21.15.81:0/907455678 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+17649 (secure 0 0 0) 0x7f644c0ce970 con 0x7f644c0d0d40 2024-09-17T05:22:45.681 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:45.681 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:43.991297+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:16.749294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:17.729305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1c","mappings":[{"from":6,"to":0}]},{"pgid":"11.26","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:0/697047706":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3351927694":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3080399496":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/1489157457":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3576223037":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3189324365":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3431006755":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/2536755070":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3804699421":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/1768307905":"2024-09-18T05:22:43.991254+0000","172.21.15.160:6801/3031880469":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3087237031":"2024-09-18T05:22:43.991254+0000","172.21.15.160:6800/3031880469":"2024-09-18T05:22:43.991254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f643803e670 msgr2=0x7f6438040b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f643803e670 0x7f6438040b30 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f6440034000 tx=0x7f6440004730 comp rx=0 tx=0).stop 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 msgr2=0x7f644c14aff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c14aff0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f643c00cbc0 tx=0x7f643c00a430 comp rx=0 tx=0).stop 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 shutdown_connections 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f644c15df90 0x7f644c0cd950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f643803e670 0x7f6438040b30 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f644c0d49c0 0x7f644c1f8da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 --2- 172.21.15.81:0/907455678 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f644c0d0d40 0x7f644c14aff0 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.682+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 >> 172.21.15.81:0/907455678 conn(0x7f644c0d3ea0 msgr2=0x7f644c0b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.683+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 shutdown_connections 2024-09-17T05:22:45.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.683+0000 7f6451dc2640 1 -- 172.21.15.81:0/907455678 wait complete. 2024-09-17T05:22:45.694 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:22:45.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 -- 172.21.15.81:0/1772289830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc0735a0 msgr2=0x7faccc0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 --2- 172.21.15.81:0/1772289830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc0735a0 0x7faccc0739a0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7facc0005fd0 tx=0x7facc002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 -- 172.21.15.81:0/1772289830 shutdown_connections 2024-09-17T05:22:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 --2- 172.21.15.81:0/1772289830 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc0735a0 0x7faccc0739a0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 --2- 172.21.15.81:0/1772289830 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faccc15aa70 0x7faccc0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 -- 172.21.15.81:0/1772289830 >> 172.21.15.81:0/1772289830 conn(0x7faccc0b1690 msgr2=0x7faccc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 -- 172.21.15.81:0/1772289830 shutdown_connections 2024-09-17T05:22:45.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.794+0000 7facd1e60640 1 -- 172.21.15.81:0/1772289830 wait complete. 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.795+0000 7facd1e60640 1 Processor -- start 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.795+0000 7facd1e60640 1 -- start start 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7facd1e60640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faccc06ff80 0x7faccc13f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7facd1e60640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faccc0735a0 0x7faccc1e8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7facd1e60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc15aa70 0x7faccc1e8860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7facd1e60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faccc0707c0 con 0x7faccc15aa70 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7facd1e60640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faccc070640 con 0x7faccc06ff80 2024-09-17T05:22:45.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7facd1e60640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faccc0cd5f0 con 0x7faccc0735a0 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7faccbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc15aa70 0x7faccc1e8860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7faccbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc15aa70 0x7faccc1e8860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60082/0 (socket says 172.21.15.81:60082) 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7faccbfff640 1 -- 172.21.15.81:0/2911335179 learned_addr learned my addr 172.21.15.81:0/2911335179 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7faccaffd640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faccc0735a0 0x7faccc1e8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.796+0000 7faccb7fe640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faccc06ff80 0x7faccc13f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7faccbfff640 1 -- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faccc0735a0 msgr2=0x7faccc1e8320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7faccbfff640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faccc0735a0 0x7faccc1e8320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7faccbfff640 1 -- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faccc06ff80 msgr2=0x7faccc13f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7faccbfff640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faccc06ff80 0x7faccc13f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7faccbfff640 1 -- 172.21.15.81:0/2911335179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faccc1e4d20 con 0x7faccc15aa70 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7faccbfff640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc15aa70 0x7faccc1e8860 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7facc400c3d0 tx=0x7facc400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4017070 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7facc40035f0 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facc4003a40 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faccc13f8a0 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.797+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faccc13fe60 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.798+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 14) ==== 50869+0+0 (secure 0 0 0) 0x7facc401a070 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.798+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faccc0739a0 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.798+0000 7facb3fff640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7facb803e670 0x7facb8040b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.798+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7facc4052a00 con 0x7faccc15aa70 2024-09-17T05:22:45.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.798+0000 7faccb7fe640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7facb803e670 0x7facb8040b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:45.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.799+0000 7faccb7fe640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7facb803e670 0x7facb8040b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faccc1f5da0 tx=0x7facbc0095e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:45.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:45.803+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7facc401ad40 con 0x7faccc15aa70 2024-09-17T05:22:46.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.003+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 15) ==== 51077+0+0 (secure 0 0 0) 0x7facc401b8d0 con 0x7faccc15aa70 2024-09-17T05:22:46.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.013+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7faccc0cf380 con 0x7faccc15aa70 2024-09-17T05:22:46.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.013+0000 7facb3fff640 1 -- 172.21.15.81:0/2911335179 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7facc4022480 con 0x7faccc15aa70 2024-09-17T05:22:46.014 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:46.014 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-17T05:22:32:523944+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:46.015 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7facb803e670 msgr2=0x7facb8040b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7facb803e670 0x7facb8040b30 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7faccc1f5da0 tx=0x7facbc0095e0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc15aa70 msgr2=0x7faccc1e8860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc15aa70 0x7faccc1e8860 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7facc400c3d0 tx=0x7facc400c890 comp rx=0 tx=0).stop 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 shutdown_connections 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faccc15aa70 0x7faccc1e8860 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faccc0735a0 0x7faccc1e8320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7facb803e670 0x7facb8040b30 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.015+0000 7facd1e60640 1 --2- 172.21.15.81:0/2911335179 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faccc06ff80 0x7faccc13f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.016+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 >> 172.21.15.81:0/2911335179 conn(0x7faccc0b1690 msgr2=0x7faccc0ce590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.016+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 shutdown_connections 2024-09-17T05:22:46.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.016+0000 7facd1e60640 1 -- 172.21.15.81:0/2911335179 wait complete. 2024-09-17T05:22:46.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:46.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.131+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/2313035230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 msgr2=0x7fdbf00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.131+0000 7fdc0b5b5640 1 --2- 172.21.15.81:0/2313035230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 0x7fdbf00051c0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fdbfc009ed0 tx=0x7fdbf0005830 comp rx=0 tx=0).stop 2024-09-17T05:22:46.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.131+0000 7fdc09b52640 1 -- 172.21.15.81:0/2313035230 reap_dead start 2024-09-17T05:22:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.131+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/2313035230 shutdown_connections 2024-09-17T05:22:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.131+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/2313035230 >> 172.21.15.81:0/2313035230 conn(0x7fdc040b1690 msgr2=0x7fdc040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.131+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/2313035230 shutdown_connections 2024-09-17T05:22:46.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.131+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/2313035230 wait complete. 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.132+0000 7fdc0b5b5640 1 Processor -- start 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.132+0000 7fdc0b5b5640 1 -- start start 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc0b5b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 0x7fdc04134200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc0b5b5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04149910 0x7fdc041f8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc0b5b5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc0414c360 0x7fdc04159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc0b5b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0406e760 con 0x7fdbf0004d40 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc0b5b5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdc0406e5e0 con 0x7fdc04149910 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc0b5b5640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdc0406e8e0 con 0x7fdc0414c360 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 0x7fdc04134200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 0x7fdc04134200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60106/0 (socket says 172.21.15.81:60106) 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 -- 172.21.15.81:0/1934784503 learned_addr learned my addr 172.21.15.81:0/1934784503 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc08b50640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04149910 0x7fdc041f8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09b52640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc0414c360 0x7fdc04159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 -- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc0414c360 msgr2=0x7fdc04159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc0414c360 0x7fdc04159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 -- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04149910 msgr2=0x7fdc041f8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04149910 0x7fdc041f8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 -- 172.21.15.81:0/1934784503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc04134740 con 0x7fdbf0004d40 2024-09-17T05:22:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.133+0000 7fdc09351640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 0x7fdc04134200 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdc00011b50 tx=0x7fdc00011f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.134+0000 7fdbf5ffb640 1 -- 172.21.15.81:0/1934784503 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc0001e070 con 0x7fdbf0004d40 2024-09-17T05:22:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.134+0000 7fdbf5ffb640 1 -- 172.21.15.81:0/1934784503 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc00019430 con 0x7fdbf0004d40 2024-09-17T05:22:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.134+0000 7fdbf5ffb640 1 -- 172.21.15.81:0/1934784503 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc00019820 con 0x7fdbf0004d40 2024-09-17T05:22:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.134+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc041f8c90 con 0x7fdbf0004d40 2024-09-17T05:22:46.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.134+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc0414b880 con 0x7fdbf0004d40 2024-09-17T05:22:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.135+0000 7fdbf5ffb640 1 -- 172.21.15.81:0/1934784503 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 51077+0+0 (secure 0 0 0) 0x7fdc00021070 con 0x7fdbf0004d40 2024-09-17T05:22:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.135+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc040cef30 con 0x7fdbf0004d40 2024-09-17T05:22:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.135+0000 7fdbf5ffb640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbe803e8b0 0x7fdbe8040d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.135+0000 7fdbf5ffb640 1 -- 172.21.15.81:0/1934784503 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7fdc00054830 con 0x7fdbf0004d40 2024-09-17T05:22:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.135+0000 7fdc08b50640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbe803e8b0 0x7fdbe8040d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.136+0000 7fdc08b50640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbe803e8b0 0x7fdbe8040d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc041f7ca0 tx=0x7fdbf8001b90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.140+0000 7fdbf5ffb640 1 -- 172.21.15.81:0/1934784503 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdc041f8c90 con 0x7fdbf0004d40 2024-09-17T05:22:46.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.349+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc04072a70 con 0x7fdbf0004d40 2024-09-17T05:22:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.350+0000 7fdbf5ffb640 1 -- 172.21.15.81:0/1934784503 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) ==== 94+0+5225 (secure 0 0 0) 0x7fdc00018da0 con 0x7fdbf0004d40 2024-09-17T05:22:46.351 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:46.351 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":40,"btime":"2024-09-17T05:22:32:523944+0000","default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36}],"filesystems":[{"mdsmap":{"epoch":39,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:18.771210+0000","modified":"2024-09-17T05:22:20.767341+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"c","rank":0,"incarnation":37,"state":"up:active","state_seq":3,"addr":"172.21.15.81:6834/603929383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":603929383},{"type":"v1","addr":"172.21.15.81:6834","nonce":603929383}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6183,"qdb_cluster":[6183]},"id":5}]} 2024-09-17T05:22:46.351 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 40 2024-09-17T05:22:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbe803e8b0 msgr2=0x7fdbe8040d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbe803e8b0 0x7fdbe8040d70 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fdc041f7ca0 tx=0x7fdbf8001b90 comp rx=0 tx=0).stop 2024-09-17T05:22:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 msgr2=0x7fdc04134200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 0x7fdc04134200 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fdc00011b50 tx=0x7fdc00011f50 comp rx=0 tx=0).stop 2024-09-17T05:22:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 shutdown_connections 2024-09-17T05:22:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc0414c360 0x7fdc04159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbe803e8b0 0x7fdbe8040d70 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc04149910 0x7fdc041f8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 --2- 172.21.15.81:0/1934784503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbf0004d40 0x7fdc04134200 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 >> 172.21.15.81:0/1934784503 conn(0x7fdc040b1690 msgr2=0x7fdc0414ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 shutdown_connections 2024-09-17T05:22:46.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.352+0000 7fdc0b5b5640 1 -- 172.21.15.81:0/1934784503 wait complete. 2024-09-17T05:22:46.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:46.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 -- 172.21.15.81:0/1382913326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d0d40 msgr2=0x7f4f900b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/1382913326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d0d40 0x7f4f900b3800 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f4f88005fd0 tx=0x7f4f8802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 -- 172.21.15.81:0/1382913326 shutdown_connections 2024-09-17T05:22:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/1382913326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d0d40 0x7f4f900b3800 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/1382913326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f9015df90 0x7f4f900cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 -- 172.21.15.81:0/1382913326 >> 172.21.15.81:0/1382913326 conn(0x7f4f900d3ea0 msgr2=0x7f4f900d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 -- 172.21.15.81:0/1382913326 shutdown_connections 2024-09-17T05:22:46.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.463+0000 7f4f97eb1640 1 -- 172.21.15.81:0/1382913326 wait complete. 2024-09-17T05:22:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.464+0000 7f4f97eb1640 1 Processor -- start 2024-09-17T05:22:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.464+0000 7f4f97eb1640 1 -- start start 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f97eb1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f900d0d40 0x7f4f90161190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f97eb1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d49c0 0x7f4f90154cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f97eb1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f9015df90 0x7f4f9015f9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f97eb1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4f90162690 con 0x7f4f900d49c0 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f97eb1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4f900b3d40 con 0x7f4f9015df90 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f97eb1640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4f9015f520 con 0x7f4f900d0d40 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f9544c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d49c0 0x7f4f90154cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f95c4d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f900d0d40 0x7f4f90161190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f9544c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d49c0 0x7f4f90154cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60112/0 (socket says 172.21.15.81:60112) 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f9544c640 1 -- 172.21.15.81:0/3755571762 learned_addr learned my addr 172.21.15.81:0/3755571762 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.465+0000 7f4f9644e640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f9015df90 0x7f4f9015f9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f95c4d640 1 -- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f9015df90 msgr2=0x7f4f9015f9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f95c4d640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f9015df90 0x7f4f9015f9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f95c4d640 1 -- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d49c0 msgr2=0x7f4f90154cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f95c4d640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d49c0 0x7f4f90154cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f95c4d640 1 -- 172.21.15.81:0/3755571762 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f9015e910 con 0x7f4f900d0d40 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f9544c640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d49c0 0x7f4f90154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f95c4d640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f900d0d40 0x7f4f90161190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000ea80 tx=0x7f4f8000ef40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3755571762 <== mon.2 v2:172.21.15.160:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f8000cea0 con 0x7f4f900d0d40 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f9015ebf0 con 0x7f4f900d0d40 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3755571762 <== mon.2 v2:172.21.15.160:3301/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f80010430 con 0x7f4f900d0d40 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3755571762 <== mon.2 v2:172.21.15.160:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f80010800 con 0x7f4f900d0d40 2024-09-17T05:22:46.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.466+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f9015f1b0 con 0x7f4f900d0d40 2024-09-17T05:22:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.467+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f900b4290 con 0x7f4f900d0d40 2024-09-17T05:22:46.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.467+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3755571762 <== mon.2 v2:172.21.15.160:3301/0 4 ==== mgrmap(e 15) ==== 51077+0+0 (secure 0 0 0) 0x7f4f800109a0 con 0x7f4f900d0d40 2024-09-17T05:22:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.467+0000 7f4f8e7fc640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f7c03e8b0 0x7f4f7c040d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.467+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3755571762 <== mon.2 v2:172.21.15.160:3301/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7f4f80054aa0 con 0x7f4f900d0d40 2024-09-17T05:22:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.467+0000 7f4f9544c640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f7c03e8b0 0x7f4f7c040d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.468+0000 7f4f9544c640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f7c03e8b0 0x7f4f7c040d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ce450 tx=0x7f4f84009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.476+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3755571762 <== mon.2 v2:172.21.15.160:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4f80021c40 con 0x7f4f900d0d40 2024-09-17T05:22:46.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.653+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f900c7770 con 0x7f4f900d0d40 2024-09-17T05:22:46.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.654+0000 7f4f8e7fc640 1 -- 172.21.15.81:0/3755571762 <== mon.2 v2:172.21.15.160:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v72) ==== 74+0+17649 (secure 0 0 0) 0x7f4f800203a0 con 0x7f4f900d0d40 2024-09-17T05:22:46.656 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:46.656 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":72,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:43.991297+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:16.749294+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"68","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:17.729305+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"69","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.1c","mappings":[{"from":6,"to":0}]},{"pgid":"11.26","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:0/697047706":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3351927694":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3080399496":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/1489157457":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3576223037":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3189324365":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3431006755":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/2536755070":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3804699421":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/1768307905":"2024-09-18T05:22:43.991254+0000","172.21.15.160:6801/3031880469":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3087237031":"2024-09-18T05:22:43.991254+0000","172.21.15.160:6800/3031880469":"2024-09-18T05:22:43.991254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f7c03e8b0 msgr2=0x7f4f7c040d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f7c03e8b0 0x7f4f7c040d70 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f4f900ce450 tx=0x7f4f84009040 comp rx=0 tx=0).stop 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f900d0d40 msgr2=0x7f4f90161190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f900d0d40 0x7f4f90161190 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4f8000ea80 tx=0x7f4f8000ef40 comp rx=0 tx=0).stop 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 shutdown_connections 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f7c03e8b0 0x7f4f7c040d70 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f9015df90 0x7f4f9015f9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f900d49c0 0x7f4f90154cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 --2- 172.21.15.81:0/3755571762 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f900d0d40 0x7f4f90161190 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 >> 172.21.15.81:0/3755571762 conn(0x7f4f900d3ea0 msgr2=0x7f4f900b0b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 shutdown_connections 2024-09-17T05:22:46.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.657+0000 7f4f97eb1640 1 -- 172.21.15.81:0/3755571762 wait complete. 2024-09-17T05:22:46.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 -- 172.21.15.81:0/3373668335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf806ff80 msgr2=0x7faaf8070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 --2- 172.21.15.81:0/3373668335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf806ff80 0x7faaf8070410 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7faaf80b26e0 tx=0x7faaf002aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 -- 172.21.15.81:0/3373668335 shutdown_connections 2024-09-17T05:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 --2- 172.21.15.81:0/3373668335 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf806ff80 0x7faaf8070410 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 --2- 172.21.15.81:0/3373668335 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaf80735a0 0x7faaf80739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 --2- 172.21.15.81:0/3373668335 >> v2:172.21.15.160:3300/0 conn(0x7faaf815aa70 0x7faaf80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 -- 172.21.15.81:0/3373668335 >> 172.21.15.81:0/3373668335 conn(0x7faaf80b1690 msgr2=0x7faaf80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 -- 172.21.15.81:0/3373668335 shutdown_connections 2024-09-17T05:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.769+0000 7faafff5d640 1 -- 172.21.15.81:0/3373668335 wait complete. 2024-09-17T05:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.770+0000 7faafff5d640 1 Processor -- start 2024-09-17T05:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.770+0000 7faafff5d640 1 -- start start 2024-09-17T05:22:46.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafff5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaf806ff80 0x7faaf815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafff5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf80735a0 0x7faaf80a9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafff5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaf815aa70 0x7faaf80b0b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafff5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faaf80cd060 con 0x7faaf80735a0 2024-09-17T05:22:46.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafff5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faaf80ccee0 con 0x7faaf815aa70 2024-09-17T05:22:46.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafff5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faaf80cd1e0 con 0x7faaf806ff80 2024-09-17T05:22:46.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf80735a0 0x7faaf80a9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf80735a0 0x7faaf80a9620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60130/0 (socket says 172.21.15.81:60130) 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 -- 172.21.15.81:0/2008321882 learned_addr learned my addr 172.21.15.81:0/2008321882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafdcf9640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaf806ff80 0x7faaf815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafe4fa640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaf815aa70 0x7faaf80b0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 -- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaf806ff80 msgr2=0x7faaf815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaf806ff80 0x7faaf815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 -- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaf815aa70 msgr2=0x7faaf80b0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaf815aa70 0x7faaf80b0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 -- 172.21.15.81:0/2008321882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faaf81f2670 con 0x7faaf80735a0 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faafd4f8640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf80735a0 0x7faaf80a9620 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faae800d750 tx=0x7faae800dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.771+0000 7faaee7fc640 1 -- 172.21.15.81:0/2008321882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae8017070 con 0x7faaf80735a0 2024-09-17T05:22:46.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.772+0000 7faaee7fc640 1 -- 172.21.15.81:0/2008321882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7faae8009cc0 con 0x7faaf80735a0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.772+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faaf81f2bf0 con 0x7faaf80735a0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.772+0000 7faaee7fc640 1 -- 172.21.15.81:0/2008321882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faae800de60 con 0x7faaf80735a0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.772+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faaf81f33f0 con 0x7faaf80735a0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.772+0000 7faaee7fc640 1 -- 172.21.15.81:0/2008321882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 51077+0+0 (secure 0 0 0) 0x7faae8005280 con 0x7faaf80735a0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.773+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faaf80739a0 con 0x7faaf80735a0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.773+0000 7faaee7fc640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7faadc03e8b0 0x7faadc040d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.773+0000 7faaee7fc640 1 -- 172.21.15.81:0/2008321882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6326+0+0 (secure 0 0 0) 0x7faae8053d20 con 0x7faaf80735a0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.773+0000 7faafdcf9640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7faadc03e8b0 0x7faadc040d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:46.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.773+0000 7faafdcf9640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7faadc03e8b0 0x7faadc040d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faaf8155eb0 tx=0x7faaf400b390 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:46.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.777+0000 7faaee7fc640 1 -- 172.21.15.81:0/2008321882 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7faae8058070 con 0x7faaf80735a0 2024-09-17T05:22:46.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.988+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7faaf80b3150 con 0x7faaf80735a0 2024-09-17T05:22:46.990 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:22:46.989+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:22:46.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.990+0000 7faaee7fc640 1 -- 172.21.15.81:0/2008321882 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v41) ==== 161+0+0 (secure 0 0 0) 0x7faae8005570 con 0x7faaf80735a0 2024-09-17T05:22:46.991 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:22:47.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7faadc03e8b0 msgr2=0x7faadc040d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7faadc03e8b0 0x7faadc040d70 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7faaf8155eb0 tx=0x7faaf400b390 comp rx=0 tx=0).stop 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf80735a0 msgr2=0x7faaf80a9620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf80735a0 0x7faaf80a9620 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7faae800d750 tx=0x7faae800dc10 comp rx=0 tx=0).stop 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 shutdown_connections 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7faadc03e8b0 0x7faadc040d70 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faaf815aa70 0x7faaf80b0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faaf80735a0 0x7faaf80a9620 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 --2- 172.21.15.81:0/2008321882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faaf806ff80 0x7faaf815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 >> 172.21.15.81:0/2008321882 conn(0x7faaf80b1690 msgr2=0x7faaf815da10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 shutdown_connections 2024-09-17T05:22:47.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:46.993+0000 7faafff5d640 1 -- 172.21.15.81:0/2008321882 wait complete. 2024-09-17T05:22:47.008 INFO:tasks.ceph.mds.c.smithi081.stderr: -7318> 2024-09-17T05:22:25.390+0000 7fe390272640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:22:47.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:22:47.032 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:22:47.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 -- 172.21.15.81:0/108242063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414815b380 msgr2=0x7f4148072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 --2- 172.21.15.81:0/108242063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414815b380 0x7f4148072b50 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7f41480cf9a0 tx=0x7f414402b880 comp rx=0 tx=0).stop 2024-09-17T05:22:47.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 -- 172.21.15.81:0/108242063 shutdown_connections 2024-09-17T05:22:47.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 --2- 172.21.15.81:0/108242063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41480cdf50 0x7f414815de50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 --2- 172.21.15.81:0/108242063 >> v2:172.21.15.160:3300/0 conn(0x7f4148073090 0x7f41480cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 --2- 172.21.15.81:0/108242063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f414815b380 0x7f4148072b50 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 -- 172.21.15.81:0/108242063 >> 172.21.15.81:0/108242063 conn(0x7f41480b1700 msgr2=0x7f41480b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:47.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 -- 172.21.15.81:0/108242063 shutdown_connections 2024-09-17T05:22:47.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.114+0000 7f4150594640 1 -- 172.21.15.81:0/108242063 wait complete. 2024-09-17T05:22:47.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.115+0000 7f4150594640 1 Processor -- start 2024-09-17T05:22:47.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.115+0000 7f4150594640 1 -- start start 2024-09-17T05:22:47.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f4150594640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4148073090 0x7f41481f69d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f4150594640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41480cdf50 0x7f4148154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f4150594640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414815b380 0x7f41480c27b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f4150594640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41480cc730 con 0x7f41480cdf50 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f4150594640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f41480cc5b0 con 0x7f414815b380 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f4150594640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f41480cc8b0 con 0x7f4148073090 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41480cdf50 0x7f4148154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41480cdf50 0x7f4148154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60164/0 (socket says 172.21.15.81:60164) 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 -- 172.21.15.81:0/140232610 learned_addr learned my addr 172.21.15.81:0/140232610 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414e330640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4148073090 0x7f41481f69d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414eb31640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414815b380 0x7f41480c27b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 -- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4148073090 msgr2=0x7f41481f69d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4148073090 0x7f41481f69d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 -- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414815b380 msgr2=0x7f41480c27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414815b380 0x7f41480c27b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.116+0000 7f414db2f640 1 -- 172.21.15.81:0/140232610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4148153080 con 0x7f41480cdf50 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.117+0000 7f414db2f640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41480cdf50 0x7f4148154380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f413800d950 tx=0x7f413800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.117+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4138017070 con 0x7f41480cdf50 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.117+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4138009d20 con 0x7f41480cdf50 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.117+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4148153300 con 0x7f41480cdf50 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.117+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41380106c0 con 0x7f41480cdf50 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.117+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41481538a0 con 0x7f41480cdf50 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.118+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41480cda10 con 0x7f41480cdf50 2024-09-17T05:22:47.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.118+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 15) ==== 51077+0+0 (secure 0 0 0) 0x7f4138010860 con 0x7f41480cdf50 2024-09-17T05:22:47.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.118+0000 7f413effd640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f412c03e8b0 0x7f412c040d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:47.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.118+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6412+0+0 (secure 0 0 0) 0x7f4138054110 con 0x7f41480cdf50 2024-09-17T05:22:47.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.118+0000 7f414e330640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f412c03e8b0 0x7f412c040d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:47.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.119+0000 7f414e330640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f412c03e8b0 0x7f412c040d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4144035000 tx=0x7f4144004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:47.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.123+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4148153080 con 0x7f41480cdf50 2024-09-17T05:22:47.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:47.336+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f4148070300 con 0x7f41480cdf50 2024-09-17T05:22:48.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.012+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f413800f740 con 0x7f41480cdf50 2024-09-17T05:22:48.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.018+0000 7f413effd640 1 -- 172.21.15.81:0/140232610 <== mon.0 v2:172.21.15.81:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f4138067300 con 0x7f41480cdf50 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f412c03e8b0 msgr2=0x7f412c040d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f412c03e8b0 0x7f412c040d70 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f4144035000 tx=0x7f4144004730 comp rx=0 tx=0).stop 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41480cdf50 msgr2=0x7f4148154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41480cdf50 0x7f4148154380 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7f413800d950 tx=0x7f413800de10 comp rx=0 tx=0).stop 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 shutdown_connections 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f412c03e8b0 0x7f412c040d70 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f414815b380 0x7f41480c27b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:48.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41480cdf50 0x7f4148154380 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 --2- 172.21.15.81:0/140232610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4148073090 0x7f41481f69d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 >> 172.21.15.81:0/140232610 conn(0x7f41480b1700 msgr2=0x7f4148150c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 shutdown_connections 2024-09-17T05:22:48.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.021+0000 7f4150594640 1 -- 172.21.15.81:0/140232610 wait complete. 2024-09-17T05:22:48.034 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:22:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.181+0000 7f38d42ef640 1 -- 172.21.15.81:0/1612015541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 msgr2=0x7f38b40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.181+0000 7f38d42ef640 1 --2- 172.21.15.81:0/1612015541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 0x7f38b40051c0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f38c4001700 tx=0x7f38b4005830 comp rx=0 tx=0).stop 2024-09-17T05:22:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.181+0000 7f38d288c640 1 -- 172.21.15.81:0/1612015541 reap_dead start 2024-09-17T05:22:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.181+0000 7f38d42ef640 1 -- 172.21.15.81:0/1612015541 shutdown_connections 2024-09-17T05:22:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.181+0000 7f38d42ef640 1 -- 172.21.15.81:0/1612015541 >> 172.21.15.81:0/1612015541 conn(0x7f38cc0d3e20 msgr2=0x7f38cc0d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.181+0000 7f38d42ef640 1 -- 172.21.15.81:0/1612015541 shutdown_connections 2024-09-17T05:22:48.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.181+0000 7f38d42ef640 1 -- 172.21.15.81:0/1612015541 wait complete. 2024-09-17T05:22:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.182+0000 7f38d42ef640 1 Processor -- start 2024-09-17T05:22:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.182+0000 7f38d42ef640 1 -- start start 2024-09-17T05:22:48.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d42ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 0x7f38cc0b7ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d42ef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38cc1f4800 0x7f38cc1573f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d42ef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38cc0b9620 0x7f38cc158160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d42ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc0cf8d0 con 0x7f38b4004d40 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d42ef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38cc0cf750 con 0x7f38cc0b9620 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d42ef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f38cc0c7770 con 0x7f38cc1f4800 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 0x7f38cc0b7ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 0x7f38cc0b7ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60190/0 (socket says 172.21.15.81:60190) 2024-09-17T05:22:48.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 -- 172.21.15.81:0/3569614513 learned_addr learned my addr 172.21.15.81:0/3569614513 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d288c640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38cc0b9620 0x7f38cc158160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 -- 172.21.15.81:0/3569614513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38cc1f4800 msgr2=0x7f38cc1573f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38cc1f4800 0x7f38cc1573f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 -- 172.21.15.81:0/3569614513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38cc0b9620 msgr2=0x7f38cc158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38cc0b9620 0x7f38cc158160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.183+0000 7f38d208b640 1 -- 172.21.15.81:0/3569614513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38cc0b9ad0 con 0x7f38b4004d40 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.184+0000 7f38d208b640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 0x7f38cc0b7ca0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f38bc006660 tx=0x7f38bc003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.184+0000 7f38caffd640 1 -- 172.21.15.81:0/3569614513 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc015070 con 0x7f38b4004d40 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.184+0000 7f38caffd640 1 -- 172.21.15.81:0/3569614513 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38bc011920 con 0x7f38b4004d40 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.184+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38cc1f4e50 con 0x7f38b4004d40 2024-09-17T05:22:48.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.184+0000 7f38caffd640 1 -- 172.21.15.81:0/3569614513 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38bc011d70 con 0x7f38b4004d40 2024-09-17T05:22:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.184+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38cc1f5410 con 0x7f38b4004d40 2024-09-17T05:22:48.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.185+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38cc0d1c90 con 0x7f38b4004d40 2024-09-17T05:22:48.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.185+0000 7f38caffd640 1 -- 172.21.15.81:0/3569614513 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f38bc0103c0 con 0x7f38b4004d40 2024-09-17T05:22:48.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.186+0000 7f38caffd640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38b8078ce0 0x7f38b807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:48.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.186+0000 7f38d188a640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38b8078ce0 0x7f38b807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:48.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.186+0000 7f38caffd640 1 -- 172.21.15.81:0/3569614513 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6412+0+0 (secure 0 0 0) 0x7f38bc09bf20 con 0x7f38b4004d40 2024-09-17T05:22:48.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.186+0000 7f38d188a640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38b8078ce0 0x7f38b807b1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0b95d0 tx=0x7f38c00099f0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:48.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.190+0000 7f38caffd640 1 -- 172.21.15.81:0/3569614513 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f38bc063f20 con 0x7f38b4004d40 2024-09-17T05:22:48.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:48.364+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f38cc06d7c0 con 0x7f38b4004d40 2024-09-17T05:22:49.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.027+0000 7f38caffd640 1 -- 172.21.15.81:0/3569614513 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v74) ==== 181+0+0 (secure 0 0 0) 0x7f38bc063820 con 0x7f38b4004d40 2024-09-17T05:22:49.028 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:22:49.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38b8078ce0 msgr2=0x7f38b807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38b8078ce0 0x7f38b807b1a0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f38cc0b95d0 tx=0x7f38c00099f0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 msgr2=0x7f38cc0b7ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 0x7f38cc0b7ca0 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f38bc006660 tx=0x7f38bc003a80 comp rx=0 tx=0).stop 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 shutdown_connections 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38b8078ce0 0x7f38b807b1a0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38cc0b9620 0x7f38cc158160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38cc1f4800 0x7f38cc1573f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 --2- 172.21.15.81:0/3569614513 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38b4004d40 0x7f38cc0b7ca0 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 >> 172.21.15.81:0/3569614513 conn(0x7f38cc0d3e20 msgr2=0x7f38cc0b5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:49.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.031+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 shutdown_connections 2024-09-17T05:22:49.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.032+0000 7f38d42ef640 1 -- 172.21.15.81:0/3569614513 wait complete. 2024-09-17T05:22:49.047 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:22:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.158+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2689640652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc60003aa0 msgr2=0x7fdc60003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.158+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2689640652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc60003aa0 0x7fdc60003ec0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fdc68005fd0 tx=0x7fdc60005830 comp rx=0 tx=0).stop 2024-09-17T05:22:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.158+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2689640652 shutdown_connections 2024-09-17T05:22:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.158+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2689640652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc60003aa0 0x7fdc60003ec0 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.158+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2689640652 >> 172.21.15.81:0/2689640652 conn(0x7fdc780d3e20 msgr2=0x7fdc780d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:49.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.158+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2689640652 shutdown_connections 2024-09-17T05:22:49.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.158+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2689640652 wait complete. 2024-09-17T05:22:49.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.159+0000 7fdc7fda3640 1 Processor -- start 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.159+0000 7fdc7fda3640 1 -- start start 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7fda3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc60003aa0 0x7fdc781573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7fda3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc7815ac10 0x7fdc7815d620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7fda3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc7815db60 0x7fdc7815b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7fda3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc780d4b50 con 0x7fdc7815db60 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7fda3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdc780d2d30 con 0x7fdc7815ac10 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7fda3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdc780d4cd0 con 0x7fdc60003aa0 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc7815db60 0x7fdc7815b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc7815db60 0x7fdc7815b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60218/0 (socket says 172.21.15.81:60218) 2024-09-17T05:22:49.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 -- 172.21.15.81:0/2293802360 learned_addr learned my addr 172.21.15.81:0/2293802360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 -- 172.21.15.81:0/2293802360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc60003aa0 msgr2=0x7fdc781573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc60003aa0 0x7fdc781573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 -- 172.21.15.81:0/2293802360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc7815ac10 msgr2=0x7fdc7815d620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc7815ac10 0x7fdc7815d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 -- 172.21.15.81:0/2293802360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc78159c10 con 0x7fdc7815db60 2024-09-17T05:22:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7e340640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc7815db60 0x7fdc7815b4e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fdc780ce6c0 tx=0x7fdc70001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:49.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc767fc640 1 -- 172.21.15.81:0/2293802360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70015020 con 0x7fdc7815db60 2024-09-17T05:22:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc767fc640 1 -- 172.21.15.81:0/2293802360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc70011770 con 0x7fdc7815db60 2024-09-17T05:22:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.160+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc78159ef0 con 0x7fdc7815db60 2024-09-17T05:22:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.161+0000 7fdc767fc640 1 -- 172.21.15.81:0/2293802360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc70011bc0 con 0x7fdc7815db60 2024-09-17T05:22:49.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.161+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc7815a4b0 con 0x7fdc7815db60 2024-09-17T05:22:49.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.162+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc780d2280 con 0x7fdc7815db60 2024-09-17T05:22:49.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.162+0000 7fdc767fc640 1 -- 172.21.15.81:0/2293802360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fdc70018020 con 0x7fdc7815db60 2024-09-17T05:22:49.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.163+0000 7fdc767fc640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc64078cb0 0x7fdc6407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:49.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.163+0000 7fdc767fc640 1 -- 172.21.15.81:0/2293802360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(74..74 src has 1..74) ==== 5974+0+0 (secure 0 0 0) 0x7fdc7009b640 con 0x7fdc7815db60 2024-09-17T05:22:49.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.163+0000 7fdc7db3f640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc64078cb0 0x7fdc6407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:49.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.163+0000 7fdc7db3f640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc64078cb0 0x7fdc6407b170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc68035000 tx=0x7fdc68004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:49.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.167+0000 7fdc767fc640 1 -- 172.21.15.81:0/2293802360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdc7001f020 con 0x7fdc7815db60 2024-09-17T05:22:49.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:49.341+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fdc780b9470 con 0x7fdc7815db60 2024-09-17T05:22:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.032+0000 7fdc767fc640 1 -- 172.21.15.81:0/2293802360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v75) ==== 169+0+0 (secure 0 0 0) 0x7fdc70063870 con 0x7fdc7815db60 2024-09-17T05:22:50.033 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:22:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.035+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc64078cb0 msgr2=0x7fdc6407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.035+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc64078cb0 0x7fdc6407b170 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fdc68035000 tx=0x7fdc68004ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.035+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc7815db60 msgr2=0x7fdc7815b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.035+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc7815db60 0x7fdc7815b4e0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fdc780ce6c0 tx=0x7fdc70001630 comp rx=0 tx=0).stop 2024-09-17T05:22:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 shutdown_connections 2024-09-17T05:22:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc7815db60 0x7fdc7815b4e0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc64078cb0 0x7fdc6407b170 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc7815ac10 0x7fdc7815d620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 --2- 172.21.15.81:0/2293802360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc60003aa0 0x7fdc781573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 >> 172.21.15.81:0/2293802360 conn(0x7fdc780d3e20 msgr2=0x7fdc780cfec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:50.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 shutdown_connections 2024-09-17T05:22:50.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.036+0000 7fdc7fda3640 1 -- 172.21.15.81:0/2293802360 wait complete. 2024-09-17T05:22:50.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.151+0000 7f8f361e8640 1 -- 172.21.15.81:0/85784963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f3006ff80 msgr2=0x7f8f30070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.151+0000 7f8f361e8640 1 --2- 172.21.15.81:0/85784963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f3006ff80 0x7f8f30070410 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f8f300b26e0 tx=0x7f8f2802aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.151+0000 7f8f361e8640 1 -- 172.21.15.81:0/85784963 shutdown_connections 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.151+0000 7f8f361e8640 1 --2- 172.21.15.81:0/85784963 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f3006ff80 0x7f8f30070410 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.152+0000 7f8f361e8640 1 --2- 172.21.15.81:0/85784963 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f300735a0 0x7f8f300739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.152+0000 7f8f361e8640 1 --2- 172.21.15.81:0/85784963 >> v2:172.21.15.160:3300/0 conn(0x7f8f3015aa70 0x7f8f300b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.152+0000 7f8f361e8640 1 -- 172.21.15.81:0/85784963 >> 172.21.15.81:0/85784963 conn(0x7f8f300b1690 msgr2=0x7f8f300b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:50.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.152+0000 7f8f361e8640 1 -- 172.21.15.81:0/85784963 shutdown_connections 2024-09-17T05:22:50.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.152+0000 7f8f361e8640 1 -- 172.21.15.81:0/85784963 wait complete. 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.153+0000 7f8f361e8640 1 Processor -- start 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.153+0000 7f8f361e8640 1 -- start start 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3006ff80 0x7f8f301f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f300735a0 0x7f8f301e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f3015aa70 0x7f8f3015ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8f300cd060 con 0x7f8f300735a0 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8f300ccee0 con 0x7f8f3006ff80 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8f300cd1e0 con 0x7f8f3015aa70 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f300735a0 0x7f8f301e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f300735a0 0x7f8f301e9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60248/0 (socket says 172.21.15.81:60248) 2024-09-17T05:22:50.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 -- 172.21.15.81:0/1828579510 learned_addr learned my addr 172.21.15.81:0/1828579510 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2f7fe640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3006ff80 0x7f8f301f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2ffff640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f3015aa70 0x7f8f3015ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 -- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f3015aa70 msgr2=0x7f8f3015ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f3015aa70 0x7f8f3015ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 -- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3006ff80 msgr2=0x7f8f301f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3006ff80 0x7f8f301f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 -- 172.21.15.81:0/1828579510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f301445a0 con 0x7f8f300735a0 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2ffff640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f3015aa70 0x7f8f3015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f2effd640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f300735a0 0x7f8f301e9890 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c920 tx=0x7f8f2400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f17fff640 1 -- 172.21.15.81:0/1828579510 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f24007c70 con 0x7f8f300735a0 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f17fff640 1 -- 172.21.15.81:0/1828579510 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8f2400f450 con 0x7f8f300735a0 2024-09-17T05:22:50.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f30144880 con 0x7f8f300735a0 2024-09-17T05:22:50.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f17fff640 1 -- 172.21.15.81:0/1828579510 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f2400f8a0 con 0x7f8f300735a0 2024-09-17T05:22:50.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.154+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f301f45f0 con 0x7f8f300735a0 2024-09-17T05:22:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.155+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f300739a0 con 0x7f8f300735a0 2024-09-17T05:22:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.156+0000 7f8f17fff640 1 -- 172.21.15.81:0/1828579510 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f8f2400fa40 con 0x7f8f300735a0 2024-09-17T05:22:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.156+0000 7f8f17fff640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8f1c078ce0 0x7f8f1c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.157+0000 7f8f2f7fe640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8f1c078ce0 0x7f8f1c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.157+0000 7f8f17fff640 1 -- 172.21.15.81:0/1828579510 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f8f2409b6f0 con 0x7f8f300735a0 2024-09-17T05:22:50.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.157+0000 7f8f2f7fe640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8f1c078ce0 0x7f8f1c07b1a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8f30073c60 tx=0x7f8f2000a250 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:50.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.161+0000 7f8f17fff640 1 -- 172.21.15.81:0/1828579510 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8f24014030 con 0x7f8f300735a0 2024-09-17T05:22:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.336+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f8f300ce3a0 con 0x7f8f300735a0 2024-09-17T05:22:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.339+0000 7f8f17fff640 1 -- 172.21.15.81:0/1828579510 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v35) ==== 71+0+0 (secure 0 0 0) 0x7f8f240639e0 con 0x7f8f300735a0 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8f1c078ce0 msgr2=0x7f8f1c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8f1c078ce0 0x7f8f1c07b1a0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f8f30073c60 tx=0x7f8f2000a250 comp rx=0 tx=0).stop 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f300735a0 msgr2=0x7f8f301e9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f300735a0 0x7f8f301e9890 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f8f2400c920 tx=0x7f8f2400cde0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 shutdown_connections 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8f3015aa70 0x7f8f3015ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8f300735a0 0x7f8f301e9890 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8f1c078ce0 0x7f8f1c07b1a0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 --2- 172.21.15.81:0/1828579510 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8f3006ff80 0x7f8f301f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 >> 172.21.15.81:0/1828579510 conn(0x7f8f300b1690 msgr2=0x7f8f300cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 shutdown_connections 2024-09-17T05:22:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.342+0000 7f8f361e8640 1 -- 172.21.15.81:0/1828579510 wait complete. 2024-09-17T05:22:50.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction' 2024-09-17T05:22:50.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 -- 172.21.15.81:0/4210110460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d0d40 msgr2=0x7fa7d00b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 --2- 172.21.15.81:0/4210110460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d0d40 0x7fa7d00b3800 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fa7d008cf10 tx=0x7fa7c802a530 comp rx=0 tx=0).stop 2024-09-17T05:22:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 -- 172.21.15.81:0/4210110460 shutdown_connections 2024-09-17T05:22:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 --2- 172.21.15.81:0/4210110460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d0d40 0x7fa7d00b3800 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 --2- 172.21.15.81:0/4210110460 >> v2:172.21.15.160:3300/0 conn(0x7fa7d015df90 0x7fa7d00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 -- 172.21.15.81:0/4210110460 >> 172.21.15.81:0/4210110460 conn(0x7fa7d00d3ea0 msgr2=0x7fa7d00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 -- 172.21.15.81:0/4210110460 shutdown_connections 2024-09-17T05:22:50.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.456+0000 7fa7d8047640 1 -- 172.21.15.81:0/4210110460 wait complete. 2024-09-17T05:22:50.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.457+0000 7fa7d8047640 1 Processor -- start 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d8047640 1 -- start start 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d8047640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7d00d0d40 0x7fa7d01610d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d8047640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d49c0 0x7fa7d00ca580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d8047640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d015df90 0x7fa7d00cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d8047640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d0162690 con 0x7fa7d00d49c0 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d8047640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa7d00b3d40 con 0x7fa7d015df90 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d8047640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa7d015d7c0 con 0x7fa7d00d0d40 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d55e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d49c0 0x7fa7d00ca580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d55e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d49c0 0x7fa7d00ca580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60264/0 (socket says 172.21.15.81:60264) 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d55e2640 1 -- 172.21.15.81:0/3350368639 learned_addr learned my addr 172.21.15.81:0/3350368639 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:50.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.458+0000 7fa7d5de3640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7d00d0d40 0x7fa7d01610d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d65e4640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d015df90 0x7fa7d00cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d55e2640 1 -- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7d00d0d40 msgr2=0x7fa7d01610d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d55e2640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7d00d0d40 0x7fa7d01610d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d55e2640 1 -- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d015df90 msgr2=0x7fa7d00cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d55e2640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d015df90 0x7fa7d00cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d55e2640 1 -- 172.21.15.81:0/3350368639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7d014afb0 con 0x7fa7d00d49c0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d5de3640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7d00d0d40 0x7fa7d01610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d55e2640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d49c0 0x7fa7d00ca580 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c760 tx=0x7fa7c400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7ce7fc640 1 -- 172.21.15.81:0/3350368639 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c4005070 con 0x7fa7d00d49c0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7ce7fc640 1 -- 172.21.15.81:0/3350368639 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa7c4005230 con 0x7fa7d00d49c0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7d01e7da0 con 0x7fa7d00d49c0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7ce7fc640 1 -- 172.21.15.81:0/3350368639 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400a640 con 0x7fa7d00d49c0 2024-09-17T05:22:50.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.459+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7d014b250 con 0x7fa7d00d49c0 2024-09-17T05:22:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.460+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7d00b5510 con 0x7fa7d00d49c0 2024-09-17T05:22:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.461+0000 7fa7ce7fc640 1 -- 172.21.15.81:0/3350368639 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fa7c400a7e0 con 0x7fa7d00d49c0 2024-09-17T05:22:50.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.461+0000 7fa7ce7fc640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7bc078cb0 0x7fa7bc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.461+0000 7fa7d5de3640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7bc078cb0 0x7fa7bc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.461+0000 7fa7ce7fc640 1 -- 172.21.15.81:0/3350368639 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7fa7c409aa60 con 0x7fa7d00d49c0 2024-09-17T05:22:50.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.462+0000 7fa7d5de3640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7bc078cb0 0x7fa7bc07b170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000ae00 tx=0x7fa7c000a7e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:50.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.465+0000 7fa7ce7fc640 1 -- 172.21.15.81:0/3350368639 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa7d00b5510 con 0x7fa7d00d49c0 2024-09-17T05:22:50.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:50.709+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]} v 0) -- 0x7fa7d00b4260 con 0x7fa7d00d49c0 2024-09-17T05:22:51.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.033+0000 7fa7ce7fc640 1 -- 172.21.15.81:0/3350368639 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_mgr_eviction"]}]=0 v223) ==== 131+0+0 (secure 0 0 0) 0x7fa7d00ce970 con 0x7fa7d00d49c0 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7bc078cb0 msgr2=0x7fa7bc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7bc078cb0 0x7fa7bc07b170 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fa7c000ae00 tx=0x7fa7c000a7e0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d49c0 msgr2=0x7fa7d00ca580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d49c0 0x7fa7d00ca580 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400c760 tx=0x7fa7c400cc20 comp rx=0 tx=0).stop 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 shutdown_connections 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7bc078cb0 0x7fa7bc07b170 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa7d015df90 0x7fa7d00cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7d00d49c0 0x7fa7d00ca580 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 --2- 172.21.15.81:0/3350368639 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa7d00d0d40 0x7fa7d01610d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 >> 172.21.15.81:0/3350368639 conn(0x7fa7d00d3ea0 msgr2=0x7fa7d00cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 shutdown_connections 2024-09-17T05:22:51.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.036+0000 7fa7d8047640 1 -- 172.21.15.81:0/3350368639 wait complete. 2024-09-17T05:22:51.048 INFO:tasks.cephfs_test_runner:test_mgr_eviction (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-17T05:22:51.048 INFO:tasks.cephfs_test_runner:Starting test: test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) Test the creating vols, subvols subvolgroups fails when their names uses 2024-09-17T05:22:51.048 INFO:tasks.cephfs_test_runner:test_names_can_only_be_goodchars (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:22:51.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:51.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.148+0000 7fa8a44bd640 1 -- 172.21.15.81:0/347437989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c072cb0 msgr2=0x7fa89c06f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.148+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/347437989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c072cb0 0x7fa89c06f9f0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7fa88c005fd0 tx=0x7fa88c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.148+0000 7fa8a44bd640 1 -- 172.21.15.81:0/347437989 shutdown_connections 2024-09-17T05:22:51.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.148+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/347437989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c072cb0 0x7fa89c06f9f0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.148+0000 7fa8a44bd640 1 -- 172.21.15.81:0/347437989 >> 172.21.15.81:0/347437989 conn(0x7fa89c0b1690 msgr2=0x7fa89c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.148+0000 7fa8a44bd640 1 -- 172.21.15.81:0/347437989 shutdown_connections 2024-09-17T05:22:51.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.148+0000 7fa8a44bd640 1 -- 172.21.15.81:0/347437989 wait complete. 2024-09-17T05:22:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.149+0000 7fa8a44bd640 1 Processor -- start 2024-09-17T05:22:51.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.149+0000 7fa8a44bd640 1 -- start start 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a44bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa89c072cb0 0x7fa89c0cf080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a44bd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa89c0cf640 0x7fa89c1460c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a44bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c151370 0x7fa89c147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a44bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c0702c0 con 0x7fa89c151370 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a44bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa89c070140 con 0x7fa89c072cb0 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a44bd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa89c070440 con 0x7fa89c0cf640 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c151370 0x7fa89c147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c151370 0x7fa89c147280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60286/0 (socket says 172.21.15.81:60286) 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 -- 172.21.15.81:0/236070241 learned_addr learned my addr 172.21.15.81:0/236070241 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:51.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2259640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa89c072cb0 0x7fa89c0cf080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a1a58640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa89c0cf640 0x7fa89c1460c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 -- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa89c0cf640 msgr2=0x7fa89c1460c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa89c0cf640 0x7fa89c1460c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 -- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa89c072cb0 msgr2=0x7fa89c0cf080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa89c072cb0 0x7fa89c0cf080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.150+0000 7fa8a2a5a640 1 -- 172.21.15.81:0/236070241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa89c146600 con 0x7fa89c151370 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.151+0000 7fa8a2a5a640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c151370 0x7fa89c147280 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009cd0 tx=0x7fa88c003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.151+0000 7fa89affd640 1 -- 172.21.15.81:0/236070241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c040070 con 0x7fa89c151370 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.151+0000 7fa89affd640 1 -- 172.21.15.81:0/236070241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa88c004330 con 0x7fa89c151370 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.151+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa89c1f2810 con 0x7fa89c151370 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.151+0000 7fa89affd640 1 -- 172.21.15.81:0/236070241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa88c004760 con 0x7fa89c151370 2024-09-17T05:22:51.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.151+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa89c1f2dd0 con 0x7fa89c151370 2024-09-17T05:22:51.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.152+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa89c06f9f0 con 0x7fa89c151370 2024-09-17T05:22:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.152+0000 7fa89affd640 1 -- 172.21.15.81:0/236070241 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fa88c039040 con 0x7fa89c151370 2024-09-17T05:22:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.153+0000 7fa89affd640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa888078cb0 0x7fa88807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.153+0000 7fa89affd640 1 -- 172.21.15.81:0/236070241 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7fa88c0bc670 con 0x7fa89c151370 2024-09-17T05:22:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.153+0000 7fa8a2259640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa888078cb0 0x7fa88807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.153+0000 7fa8a2259640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa888078cb0 0x7fa88807b170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa894007fd0 tx=0x7fa894009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.157+0000 7fa89affd640 1 -- 172.21.15.81:0/236070241 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa88c0849f0 con 0x7fa89c151370 2024-09-17T05:22:51.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.337+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa89c14fa10 con 0x7fa89c151370 2024-09-17T05:22:51.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.338+0000 7fa89affd640 1 -- 172.21.15.81:0/236070241 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v75) ==== 74+0+13855 (secure 0 0 0) 0x7fa88c0842f0 con 0x7fa89c151370 2024-09-17T05:22:51.339 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:51.339 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":75,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:50.029083+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":70,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":67,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6832/603929383":"2024-09-18T05:22:46.990110+0000","172.21.15.160:6800/3031880469":"2024-09-18T05:22:43.991254+0000","172.21.15.160:6801/3031880469":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3804699421":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/2536755070":"2024-09-18T05:22:43.991254+0000","172.21.15.81:6834/603929383":"2024-09-18T05:22:46.990110+0000","172.21.15.160:0/3576223037":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/1489157457":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/1768307905":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3080399496":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3087237031":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3431006755":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3189324365":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/3351927694":"2024-09-18T05:22:43.991254+0000","172.21.15.160:0/697047706":"2024-09-18T05:22:43.991254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:51.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa888078cb0 msgr2=0x7fa88807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa888078cb0 0x7fa88807b170 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fa894007fd0 tx=0x7fa894009040 comp rx=0 tx=0).stop 2024-09-17T05:22:51.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c151370 msgr2=0x7fa89c147280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c151370 0x7fa89c147280 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7fa88c009cd0 tx=0x7fa88c003ba0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 shutdown_connections 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa89c151370 0x7fa89c147280 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa89c0cf640 0x7fa89c1460c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa888078cb0 0x7fa88807b170 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 --2- 172.21.15.81:0/236070241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa89c072cb0 0x7fa89c0cf080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 >> 172.21.15.81:0/236070241 conn(0x7fa89c0b1690 msgr2=0x7fa89c0af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 shutdown_connections 2024-09-17T05:22:51.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.340+0000 7fa8a44bd640 1 -- 172.21.15.81:0/236070241 wait complete. 2024-09-17T05:22:51.352 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:22:51.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3207192771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 msgr2=0x7f6ee4072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3207192771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee4072b50 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4005fd0 tx=0x7f6ed402aa90 comp rx=0 tx=0).stop 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3207192771 shutdown_connections 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3207192771 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ee4073090 0x7f6ee40cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3207192771 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee4072b50 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3207192771 >> 172.21.15.81:0/3207192771 conn(0x7f6ee40b1700 msgr2=0x7f6ee40b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3207192771 shutdown_connections 2024-09-17T05:22:51.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.457+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3207192771 wait complete. 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 Processor -- start 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 -- start start 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee4073090 0x7f6ee414fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ee40cdf50 0x7f6ee41f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee406eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee40cbd50 con 0x7f6ee415b380 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ee40cbbd0 con 0x7f6ee4073090 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee8a39640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6ee40cbed0 con 0x7f6ee40cdf50 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee406eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee2d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee406eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60308/0 (socket says 172.21.15.81:60308) 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.459+0000 7f6ee2d9d640 1 -- 172.21.15.81:0/3734380833 learned_addr learned my addr 172.21.15.81:0/3734380833 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee1d9b640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ee40cdf50 0x7f6ee41f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee259c640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee4073090 0x7f6ee414fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee2d9d640 1 -- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ee40cdf50 msgr2=0x7f6ee41f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee2d9d640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ee40cdf50 0x7f6ee41f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee2d9d640 1 -- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee4073090 msgr2=0x7f6ee414fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee2d9d640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee4073090 0x7f6ee414fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee2d9d640 1 -- 172.21.15.81:0/3734380833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ee40c6620 con 0x7f6ee415b380 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee2d9d640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee406eed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c390 tx=0x7f6edc00c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ed2ffd640 1 -- 172.21.15.81:0/3734380833 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc0052d0 con 0x7f6ee415b380 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ed2ffd640 1 -- 172.21.15.81:0/3734380833 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6edc007020 con 0x7f6ee415b380 2024-09-17T05:22:51.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ee40c6060 con 0x7f6ee415b380 2024-09-17T05:22:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ed2ffd640 1 -- 172.21.15.81:0/3734380833 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6edc007470 con 0x7f6ee415b380 2024-09-17T05:22:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.460+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ee41f7ed0 con 0x7f6ee415b380 2024-09-17T05:22:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.461+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ee40cda10 con 0x7f6ee415b380 2024-09-17T05:22:51.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.462+0000 7f6ed2ffd640 1 -- 172.21.15.81:0/3734380833 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f6edc0067d0 con 0x7f6ee415b380 2024-09-17T05:22:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.462+0000 7f6ed2ffd640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ec4078cb0 0x7f6ec407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.462+0000 7f6ee259c640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ec4078cb0 0x7f6ec407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.462+0000 7f6ed2ffd640 1 -- 172.21.15.81:0/3734380833 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f6edc09a340 con 0x7f6ee415b380 2024-09-17T05:22:51.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.463+0000 7f6ee259c640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ec4078cb0 0x7f6ec407b170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4035000 tx=0x7f6ed4038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.467+0000 7f6ed2ffd640 1 -- 172.21.15.81:0/3734380833 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6edc0626c0 con 0x7f6ee415b380 2024-09-17T05:22:51.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.641+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6ee40b4db0 con 0x7f6ee415b380 2024-09-17T05:22:51.642 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.641+0000 7f6ed2ffd640 1 -- 172.21.15.81:0/3734380833 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v75) ==== 93+0+10 (secure 0 0 0) 0x7f6edc061fc0 con 0x7f6ee415b380 2024-09-17T05:22:51.642 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ec4078cb0 msgr2=0x7f6ec407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ec4078cb0 0x7f6ec407b170 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6ed4035000 tx=0x7f6ed4038040 comp rx=0 tx=0).stop 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 msgr2=0x7f6ee406eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee406eed0 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f6edc00c390 tx=0x7f6edc00c850 comp rx=0 tx=0).stop 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 shutdown_connections 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ee415b380 0x7f6ee406eed0 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ee40cdf50 0x7f6ee41f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ec4078cb0 0x7f6ec407b170 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 --2- 172.21.15.81:0/3734380833 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ee4073090 0x7f6ee414fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 >> 172.21.15.81:0/3734380833 conn(0x7f6ee40b1700 msgr2=0x7f6ee415e580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.643+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 shutdown_connections 2024-09-17T05:22:51.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.644+0000 7f6ee8a39640 1 -- 172.21.15.81:0/3734380833 wait complete. 2024-09-17T05:22:51.655 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 -- 172.21.15.81:0/393815879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec0ccc10 msgr2=0x7f63ec070990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 --2- 172.21.15.81:0/393815879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec0ccc10 0x7f63ec070990 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f63e4005fd0 tx=0x7f63e402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 -- 172.21.15.81:0/393815879 shutdown_connections 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 --2- 172.21.15.81:0/393815879 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec0ccc10 0x7f63ec070990 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 --2- 172.21.15.81:0/393815879 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63ec074130 0x7f63ec0cc6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 -- 172.21.15.81:0/393815879 >> 172.21.15.81:0/393815879 conn(0x7f63ec0d0c20 msgr2=0x7f63ec0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 -- 172.21.15.81:0/393815879 shutdown_connections 2024-09-17T05:22:51.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.756+0000 7f63f37f8640 1 -- 172.21.15.81:0/393815879 wait complete. 2024-09-17T05:22:51.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 Processor -- start 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 -- start start 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec06d590 0x7f63ec1e51f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63ec074130 0x7f63ec1e43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec0ccc10 0x7f63ec1e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec06ce70 con 0x7f63ec0ccc10 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f63ec06ccf0 con 0x7f63ec06d590 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f37f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f63ec070ed0 con 0x7f63ec074130 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.758+0000 7f63f1d95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec0ccc10 0x7f63ec1e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec0ccc10 0x7f63ec1e64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60322/0 (socket says 172.21.15.81:60322) 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 -- 172.21.15.81:0/1248250638 learned_addr learned my addr 172.21.15.81:0/1248250638 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:51.761 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f0d93640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63ec074130 0x7f63ec1e43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1594640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec06d590 0x7f63ec1e51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 -- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63ec074130 msgr2=0x7f63ec1e43b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63ec074130 0x7f63ec1e43b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 -- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec06d590 msgr2=0x7f63ec1e51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec06d590 0x7f63ec1e51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 -- 172.21.15.81:0/1248250638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63ec0cb060 con 0x7f63ec0ccc10 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f1d95640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec0ccc10 0x7f63ec1e64d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009cd0 tx=0x7f63e4033f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63e1ffb640 1 -- 172.21.15.81:0/1248250638 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e4031990 con 0x7f63ec0ccc10 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63e1ffb640 1 -- 172.21.15.81:0/1248250638 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f63e4031c20 con 0x7f63ec0ccc10 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63ec0cad80 con 0x7f63ec0ccc10 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63e1ffb640 1 -- 172.21.15.81:0/1248250638 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e40330d0 con 0x7f63ec0ccc10 2024-09-17T05:22:51.762 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.759+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63ec15ba20 con 0x7f63ec0ccc10 2024-09-17T05:22:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.760+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f63ec071380 con 0x7f63ec0ccc10 2024-09-17T05:22:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.761+0000 7f63e1ffb640 1 -- 172.21.15.81:0/1248250638 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f63e4033270 con 0x7f63ec0ccc10 2024-09-17T05:22:51.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.761+0000 7f63e1ffb640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f63d0078ce0 0x7f63d007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.762+0000 7f63e1ffb640 1 -- 172.21.15.81:0/1248250638 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f63e40bc120 con 0x7f63ec0ccc10 2024-09-17T05:22:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.762+0000 7f63f1594640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f63d0078ce0 0x7f63d007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:51.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.762+0000 7f63f1594640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f63d0078ce0 0x7f63d007b1a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f63e80017c0 tx=0x7f63e8007e90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:51.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:51.766+0000 7f63e1ffb640 1 -- 172.21.15.81:0/1248250638 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f63e403f030 con 0x7f63ec0ccc10 2024-09-17T05:22:52.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.012+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7f63ec15f480 con 0x7f63ec0ccc10 2024-09-17T05:22:52.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.041+0000 7f63e1ffb640 1 -- 172.21.15.81:0/1248250638 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v224) ==== 149+0+0 (secure 0 0 0) 0x7f63e40317b0 con 0x7f63ec0ccc10 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f63d0078ce0 msgr2=0x7f63d007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f63d0078ce0 0x7f63d007b1a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f63e80017c0 tx=0x7f63e8007e90 comp rx=0 tx=0).stop 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec0ccc10 msgr2=0x7f63ec1e64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec0ccc10 0x7f63ec1e64d0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f63e4009cd0 tx=0x7f63e4033f70 comp rx=0 tx=0).stop 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 shutdown_connections 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63ec0ccc10 0x7f63ec1e64d0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63ec074130 0x7f63ec1e43b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f63d0078ce0 0x7f63d007b1a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 --2- 172.21.15.81:0/1248250638 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63ec06d590 0x7f63ec1e51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 >> 172.21.15.81:0/1248250638 conn(0x7f63ec0d0c20 msgr2=0x7f63ec0cb250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 shutdown_connections 2024-09-17T05:22:52.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.043+0000 7f63f37f8640 1 -- 172.21.15.81:0/1248250638 wait complete. 2024-09-17T05:22:52.055 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:22:52.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 -- 172.21.15.81:0/1188445307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c0d0d40 msgr2=0x7f887c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 --2- 172.21.15.81:0/1188445307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c0d0d40 0x7f887c0cf9b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8868009830 tx=0x7f886802a480 comp rx=0 tx=0).stop 2024-09-17T05:22:52.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 -- 172.21.15.81:0/1188445307 shutdown_connections 2024-09-17T05:22:52.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 --2- 172.21.15.81:0/1188445307 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f887c0d49c0 0x7f887c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 --2- 172.21.15.81:0/1188445307 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c0d0d40 0x7f887c0cf9b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 -- 172.21.15.81:0/1188445307 >> 172.21.15.81:0/1188445307 conn(0x7f887c0d3ea0 msgr2=0x7f887c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 -- 172.21.15.81:0/1188445307 shutdown_connections 2024-09-17T05:22:52.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.159+0000 7f8882abd640 1 -- 172.21.15.81:0/1188445307 wait complete. 2024-09-17T05:22:52.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.160+0000 7f8882abd640 1 Processor -- start 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.160+0000 7f8882abd640 1 -- start start 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8882abd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887c0d0d40 0x7f887c1610e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8882abd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f887c0d49c0 0x7f887c15ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8882abd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c15df90 0x7f887c14b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8882abd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f887c0b3d40 con 0x7f887c0d0d40 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8882abd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f887c162710 con 0x7f887c15df90 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8882abd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f887c0b3ec0 con 0x7f887c0d49c0 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887c0d0d40 0x7f887c1610e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887c0d0d40 0x7f887c1610e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60338/0 (socket says 172.21.15.81:60338) 2024-09-17T05:22:52.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 -- 172.21.15.81:0/2313815815 learned_addr learned my addr 172.21.15.81:0/2313815815 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f888105a640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c15df90 0x7f887c14b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f887bfff640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f887c0d49c0 0x7f887c15ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 -- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f887c0d49c0 msgr2=0x7f887c15ef80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f887c0d49c0 0x7f887c15ef80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 -- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c15df90 msgr2=0x7f887c14b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c15df90 0x7f887c14b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.161+0000 7f8880859640 1 -- 172.21.15.81:0/2313815815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f887c160040 con 0x7f887c0d0d40 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.162+0000 7f8880859640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887c0d0d40 0x7f887c1610e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f887000c3a0 tx=0x7f887000c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.162+0000 7f88797fa640 1 -- 172.21.15.81:0/2313815815 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870011790 con 0x7f887c0d0d40 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.162+0000 7f88797fa640 1 -- 172.21.15.81:0/2313815815 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8870017070 con 0x7f887c0d0d40 2024-09-17T05:22:52.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.162+0000 7f88797fa640 1 -- 172.21.15.81:0/2313815815 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8870011cc0 con 0x7f887c0d0d40 2024-09-17T05:22:52.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.162+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f887c160320 con 0x7f887c0d0d40 2024-09-17T05:22:52.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.162+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f887c1608e0 con 0x7f887c0d0d40 2024-09-17T05:22:52.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.163+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f887c0b43b0 con 0x7f887c0d0d40 2024-09-17T05:22:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.163+0000 7f88797fa640 1 -- 172.21.15.81:0/2313815815 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f887001c460 con 0x7f887c0d0d40 2024-09-17T05:22:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.164+0000 7f88797fa640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8860078cb0 0x7f886007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.164+0000 7f887bfff640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8860078cb0 0x7f886007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.164+0000 7f88797fa640 1 -- 172.21.15.81:0/2313815815 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f887009ac50 con 0x7f887c0d0d40 2024-09-17T05:22:52.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.164+0000 7f887bfff640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8860078cb0 0x7f886007b170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8868034000 tx=0x7f8868004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.168+0000 7f88797fa640 1 -- 172.21.15.81:0/2313815815 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f88700a0020 con 0x7f887c0d0d40 2024-09-17T05:22:52.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.344+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f887c0b5450 con 0x7f887c0d0d40 2024-09-17T05:22:52.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.344+0000 7f88797fa640 1 -- 172.21.15.81:0/2313815815 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v35) ==== 59+0+1998 (secure 0 0 0) 0x7f887c0ce970 con 0x7f887c0d0d40 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:22:52.346 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:22:52.347 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:22:52.348 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:22:52.348 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:22:52.348 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:22:52.348 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:22:52.348 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:22:52.348 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:22:52.348 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:22:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.346+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8860078cb0 msgr2=0x7f886007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.346+0000 7f8882abd640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8860078cb0 0x7f886007b170 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8868034000 tx=0x7f8868004730 comp rx=0 tx=0).stop 2024-09-17T05:22:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.346+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887c0d0d40 msgr2=0x7f887c1610e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.346+0000 7f8882abd640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887c0d0d40 0x7f887c1610e0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f887000c3a0 tx=0x7f887000c860 comp rx=0 tx=0).stop 2024-09-17T05:22:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 shutdown_connections 2024-09-17T05:22:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8860078cb0 0x7f886007b170 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f887c15df90 0x7f887c14b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f887c0d49c0 0x7f887c15ef80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 --2- 172.21.15.81:0/2313815815 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f887c0d0d40 0x7f887c1610e0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 >> 172.21.15.81:0/2313815815 conn(0x7f887c0d3ea0 msgr2=0x7f887c0d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 shutdown_connections 2024-09-17T05:22:52.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.347+0000 7f8882abd640 1 -- 172.21.15.81:0/2313815815 wait complete. 2024-09-17T05:22:52.358 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:22:52.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 -- 172.21.15.81:0/807026898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4151e30 msgr2=0x7fc1a406fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/807026898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4151e30 0x7fc1a406fb90 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7fc1a40cd200 tx=0x7fc1a002a560 comp rx=0 tx=0).stop 2024-09-17T05:22:52.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 -- 172.21.15.81:0/807026898 shutdown_connections 2024-09-17T05:22:52.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/807026898 >> v2:172.21.15.160:3300/0 conn(0x7fc1a40cc540 0x7fc1a40cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/807026898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a4151e30 0x7fc1a406fb90 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 -- 172.21.15.81:0/807026898 >> 172.21.15.81:0/807026898 conn(0x7fc1a40b1700 msgr2=0x7fc1a40b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 -- 172.21.15.81:0/807026898 shutdown_connections 2024-09-17T05:22:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.462+0000 7fc1abcd6640 1 -- 172.21.15.81:0/807026898 wait complete. 2024-09-17T05:22:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.463+0000 7fc1abcd6640 1 Processor -- start 2024-09-17T05:22:52.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.463+0000 7fc1abcd6640 1 -- start start 2024-09-17T05:22:52.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1abcd6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a40cc540 0x7fc1a40b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1abcd6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1a4151e30 0x7fc1a41f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1abcd6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1a415b3d0 0x7fc1a4151050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1abcd6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a40cb000 con 0x7fc1a40cc540 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1abcd6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc1a40cae80 con 0x7fc1a4151e30 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1abcd6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc1a40cb180 con 0x7fc1a415b3d0 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a40cc540 0x7fc1a40b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a40cc540 0x7fc1a40b4b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60358/0 (socket says 172.21.15.81:60358) 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 -- 172.21.15.81:0/2134837042 learned_addr learned my addr 172.21.15.81:0/2134837042 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9271640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1a4151e30 0x7fc1a41f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1aa273640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1a415b3d0 0x7fc1a4151050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 -- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1a415b3d0 msgr2=0x7fc1a4151050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1a415b3d0 0x7fc1a4151050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 -- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1a4151e30 msgr2=0x7fc1a41f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1a4151e30 0x7fc1a41f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9a72640 1 -- 172.21.15.81:0/2134837042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1a40b5200 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.464+0000 7fc1a9271640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1a4151e30 0x7fc1a41f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.465+0000 7fc1a9a72640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a40cc540 0x7fc1a40b4b00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009850 tx=0x7fc1a0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.465+0000 7fc19a7fc640 1 -- 172.21.15.81:0/2134837042 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a003f070 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.465+0000 7fc19a7fc640 1 -- 172.21.15.81:0/2134837042 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1a00047a0 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.465+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1a40b2a00 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.465+0000 7fc19a7fc640 1 -- 172.21.15.81:0/2134837042 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1a0035030 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.465+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1a40b2fc0 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.466+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1a40cb630 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.466+0000 7fc19a7fc640 1 -- 172.21.15.81:0/2134837042 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fc1a0042070 con 0x7fc1a40cc540 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.467+0000 7fc19a7fc640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc188078cb0 0x7fc18807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.467+0000 7fc1a9271640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc188078cb0 0x7fc18807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.467+0000 7fc19a7fc640 1 -- 172.21.15.81:0/2134837042 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7fc1a00bbcd0 con 0x7fc1a40cc540 2024-09-17T05:22:52.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.467+0000 7fc1a9271640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc188078cb0 0x7fc18807b170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc1940058c0 tx=0x7fc194005850 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.471+0000 7fc19a7fc640 1 -- 172.21.15.81:0/2134837042 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc1a00840e0 con 0x7fc1a40cc540 2024-09-17T05:22:52.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.646+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fc1a4070580 con 0x7fc1a40cc540 2024-09-17T05:22:52.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.649+0000 7fc19a7fc640 1 -- 172.21.15.81:0/2134837042 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7fc1a00839e0 con 0x7fc1a40cc540 2024-09-17T05:22:52.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc188078cb0 msgr2=0x7fc18807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc188078cb0 0x7fc18807b170 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fc1940058c0 tx=0x7fc194005850 comp rx=0 tx=0).stop 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a40cc540 msgr2=0x7fc1a40b4b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a40cc540 0x7fc1a40b4b00 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7fc1a0009850 tx=0x7fc1a0003910 comp rx=0 tx=0).stop 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 shutdown_connections 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1a415b3d0 0x7fc1a4151050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc188078cb0 0x7fc18807b170 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1a4151e30 0x7fc1a41f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 --2- 172.21.15.81:0/2134837042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1a40cc540 0x7fc1a40b4b00 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 >> 172.21.15.81:0/2134837042 conn(0x7fc1a40b1700 msgr2=0x7fc1a415d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 shutdown_connections 2024-09-17T05:22:52.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.651+0000 7fc1abcd6640 1 -- 172.21.15.81:0/2134837042 wait complete. 2024-09-17T05:22:52.664 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:22:52.664 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:52.700 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:22:52.740 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:22:52.740 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:52.740 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.756 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:52.756 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:52.756 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.799 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:52.799 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:22:52.800 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.816 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:22:52.816 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:22:52.816 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:22:52.858 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:22:52.858 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:22:52.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 -- 172.21.15.81:0/734981045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0d49c0 msgr2=0x7f757c0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 --2- 172.21.15.81:0/734981045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0d49c0 0x7f757c0b3800 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f7574005fd0 tx=0x7f757402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 -- 172.21.15.81:0/734981045 shutdown_connections 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 --2- 172.21.15.81:0/734981045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c0d49c0 0x7f757c0b3800 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 --2- 172.21.15.81:0/734981045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f757c0d0d40 0x7f757c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 -- 172.21.15.81:0/734981045 >> 172.21.15.81:0/734981045 conn(0x7f757c0d3ea0 msgr2=0x7f757c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 -- 172.21.15.81:0/734981045 shutdown_connections 2024-09-17T05:22:52.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.957+0000 7f7580c60640 1 -- 172.21.15.81:0/734981045 wait complete. 2024-09-17T05:22:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 Processor -- start 2024-09-17T05:22:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 -- start start 2024-09-17T05:22:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f757c0d0d40 0x7f757c0a1690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f757c0d49c0 0x7f757c15ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c15df90 0x7f757c0cd7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f757c0b3d40 con 0x7f757c15df90 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f757c162710 con 0x7f757c0d0d40 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f7580c60640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f757c0b3ec0 con 0x7f757c0d49c0 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f757ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c15df90 0x7f757c0cd7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f757ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c15df90 0x7f757c0cd7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:60368/0 (socket says 172.21.15.81:60368) 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.959+0000 7f757ad9d640 1 -- 172.21.15.81:0/2153515232 learned_addr learned my addr 172.21.15.81:0/2153515232 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f7573fff640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f757c0d49c0 0x7f757c15ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757a59c640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f757c0d0d40 0x7f757c0a1690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757ad9d640 1 -- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f757c0d49c0 msgr2=0x7f757c15ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757ad9d640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f757c0d49c0 0x7f757c15ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757ad9d640 1 -- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f757c0d0d40 msgr2=0x7f757c0a1690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757ad9d640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f757c0d0d40 0x7f757c0a1690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757ad9d640 1 -- 172.21.15.81:0/2153515232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f757c160940 con 0x7f757c15df90 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757a59c640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f757c0d0d40 0x7f757c0a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f757ad9d640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c15df90 0x7f757c0cd7e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7574009cd0 tx=0x7f7574003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f7572ffd640 1 -- 172.21.15.81:0/2153515232 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574040070 con 0x7f757c15df90 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f7572ffd640 1 -- 172.21.15.81:0/2153515232 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7574004130 con 0x7f757c15df90 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f757c160c20 con 0x7f757c15df90 2024-09-17T05:22:52.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f7572ffd640 1 -- 172.21.15.81:0/2153515232 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7574004540 con 0x7f757c15df90 2024-09-17T05:22:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.960+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f757c1492b0 con 0x7f757c15df90 2024-09-17T05:22:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.961+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f757c0b4310 con 0x7f757c15df90 2024-09-17T05:22:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.962+0000 7f7572ffd640 1 -- 172.21.15.81:0/2153515232 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f7574039040 con 0x7f757c15df90 2024-09-17T05:22:52.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.962+0000 7f7572ffd640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f755c078cb0 0x7f755c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.962+0000 7f7572ffd640 1 -- 172.21.15.81:0/2153515232 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f75740bc400 con 0x7f757c15df90 2024-09-17T05:22:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.962+0000 7f757a59c640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f755c078cb0 0x7f755c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:52.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.962+0000 7f757a59c640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f755c078cb0 0x7f755c07b170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f756c0016a0 tx=0x7f756c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:52.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:52.966+0000 7f7572ffd640 1 -- 172.21.15.81:0/2153515232 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7574084810 con 0x7f757c15df90 2024-09-17T05:22:53.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.180+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f757c149480 con 0x7f757c15df90 2024-09-17T05:22:53.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.181+0000 7f7572ffd640 1 -- 172.21.15.81:0/2153515232 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 42 v42) ==== 94+0+3914 (secure 0 0 0) 0x7f7574084110 con 0x7f757c15df90 2024-09-17T05:22:53.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:53.183 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":42,"btime":"2024-09-17T05:22:48:006751+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5471,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6837/890792138","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6835","nonce":890792138},{"type":"v1","addr":"172.21.15.160:6837","nonce":890792138}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5716,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3984895074","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3984895074},{"type":"v1","addr":"172.21.15.81:6835","nonce":3984895074}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":5725,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6836/1173681680","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":1173681680},{"type":"v1","addr":"172.21.15.160:6836","nonce":1173681680}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":36},{"gid":6561,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/2417288259","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2417288259},{"type":"v1","addr":"172.21.15.81:6834","nonce":2417288259}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":42}],"filesystems":[]} 2024-09-17T05:22:53.183 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 42 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f755c078cb0 msgr2=0x7f755c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f755c078cb0 0x7f755c07b170 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f756c0016a0 tx=0x7f756c009040 comp rx=0 tx=0).stop 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c15df90 msgr2=0x7f757c0cd7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c15df90 0x7f757c0cd7e0 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f7574009cd0 tx=0x7f7574003970 comp rx=0 tx=0).stop 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 shutdown_connections 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f757c15df90 0x7f757c0cd7e0 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f757c0d49c0 0x7f757c15ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f755c078cb0 0x7f755c07b170 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 --2- 172.21.15.81:0/2153515232 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f757c0d0d40 0x7f757c0a1690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 >> 172.21.15.81:0/2153515232 conn(0x7f757c0d3ea0 msgr2=0x7f757c0b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 shutdown_connections 2024-09-17T05:22:53.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.183+0000 7f7580c60640 1 -- 172.21.15.81:0/2153515232 wait complete. 2024-09-17T05:22:53.196 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:22:53.196 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:22:53.196 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:22:53.196 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:53.196 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:22:53.196 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:22:53.197 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:22:53.197 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:53.197 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:22:53.197 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:22:53.197 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:22:53.197 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:53.197 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:22:53.197 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:22:53.198 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:22:53.198 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:22:53.206 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:22:53.206 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:22:53.207 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:22:53.207 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:22:53.210 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:22:53.210 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:22:53.211 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:22:53.211 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:22:53.248 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:22:53.249 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:53.249 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:22:53.249 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:53.253 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:22:53.253 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:53.253 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:22:53.254 DEBUG:teuthology.parallel:result is None 2024-09-17T05:22:53.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:22:53.322 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:22:53.322 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:22:53.334 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:22:53.334 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:22:53.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.359+0000 7f18ea416640 1 -- 172.21.15.81:0/3596180999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 msgr2=0x7f18e40cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.359+0000 7f18ea416640 1 --2- 172.21.15.81:0/3596180999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 0x7f18e40cf9b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f18e40cf6a0 tx=0x7f18d402a5c0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.359+0000 7f18ea416640 1 -- 172.21.15.81:0/3596180999 shutdown_connections 2024-09-17T05:22:53.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.359+0000 7f18ea416640 1 --2- 172.21.15.81:0/3596180999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 0x7f18e40cf9b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.359+0000 7f18ea416640 1 -- 172.21.15.81:0/3596180999 >> 172.21.15.81:0/3596180999 conn(0x7f18e40d3ea0 msgr2=0x7f18e40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:53.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.359+0000 7f18ea416640 1 -- 172.21.15.81:0/3596180999 shutdown_connections 2024-09-17T05:22:53.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.359+0000 7f18ea416640 1 -- 172.21.15.81:0/3596180999 wait complete. 2024-09-17T05:22:53.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.360+0000 7f18ea416640 1 Processor -- start 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.360+0000 7f18ea416640 1 -- start start 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18ea416640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e40d0d40 0x7f18e41f7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18ea416640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18e40d49c0 0x7f18e41f82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18ea416640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 0x7f18e41f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18ea416640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18e4162690 con 0x7f18e40d0d40 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18ea416640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f18e40b3f10 con 0x7f18e415df90 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18ea416640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f18e40c9460 con 0x7f18e40d49c0 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e40d0d40 0x7f18e41f7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18e3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e40d0d40 0x7f18e41f7d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51918/0 (socket says 172.21.15.81:51918) 2024-09-17T05:22:53.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18e3fff640 1 -- 172.21.15.81:0/2382403160 learned_addr learned my addr 172.21.15.81:0/2382403160 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18e89b3640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 0x7f18e41f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.361+0000 7f18e37fe640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18e40d49c0 0x7f18e41f82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e3fff640 1 -- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18e40d49c0 msgr2=0x7f18e41f82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e3fff640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18e40d49c0 0x7f18e41f82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e3fff640 1 -- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 msgr2=0x7f18e41f87e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:53.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e3fff640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 0x7f18e41f87e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e3fff640 1 -- 172.21.15.81:0/2382403160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e40c8850 con 0x7f18e40d0d40 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e3fff640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e40d0d40 0x7f18e41f7d60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009920 tx=0x7f18d4033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e0ff9640 1 -- 172.21.15.81:0/2382403160 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4031d60 con 0x7f18e40d0d40 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e0ff9640 1 -- 172.21.15.81:0/2382403160 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f18d4033e10 con 0x7f18e40d0d40 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18e0ff9640 1 -- 172.21.15.81:0/2382403160 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4005260 con 0x7f18e40d0d40 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e40c8b30 con 0x7f18e40d0d40 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.362+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e40c90f0 con 0x7f18e40d0d40 2024-09-17T05:22:53.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.363+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18e40b4c20 con 0x7f18e40d0d40 2024-09-17T05:22:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.364+0000 7f18e0ff9640 1 -- 172.21.15.81:0/2382403160 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f18d4005400 con 0x7f18e40d0d40 2024-09-17T05:22:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.364+0000 7f18e0ff9640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f18d0078cb0 0x7f18d007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.364+0000 7f18e0ff9640 1 -- 172.21.15.81:0/2382403160 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 5502+0+0 (secure 0 0 0) 0x7f18d40bbdf0 con 0x7f18e40d0d40 2024-09-17T05:22:53.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.364+0000 7f18e37fe640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f18d0078cb0 0x7f18d007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:53.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.365+0000 7f18e37fe640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f18d0078cb0 0x7f18d007b170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007fd0 tx=0x7f18d8009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:53.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.368+0000 7f18e0ff9640 1 -- 172.21.15.81:0/2382403160 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f18d403f030 con 0x7f18e40d0d40 2024-09-17T05:22:53.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:53.555+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f18e408d590 con 0x7f18e40d0d40 2024-09-17T05:22:54.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.058+0000 7f18e0ff9640 1 -- 172.21.15.81:0/2382403160 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v77) ==== 97+0+0 (secure 0 0 0) 0x7f18d4083b20 con 0x7f18e40d0d40 2024-09-17T05:22:54.060 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:22:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f18d0078cb0 msgr2=0x7f18d007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f18d0078cb0 0x7f18d007b170 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f18d8007fd0 tx=0x7f18d8009040 comp rx=0 tx=0).stop 2024-09-17T05:22:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e40d0d40 msgr2=0x7f18e41f7d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e40d0d40 0x7f18e41f7d60 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009920 tx=0x7f18d4033c20 comp rx=0 tx=0).stop 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 shutdown_connections 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f18d0078cb0 0x7f18d007b170 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18e415df90 0x7f18e41f87e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18e40d49c0 0x7f18e41f82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 --2- 172.21.15.81:0/2382403160 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18e40d0d40 0x7f18e41f7d60 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 >> 172.21.15.81:0/2382403160 conn(0x7f18e40d3ea0 msgr2=0x7f18e406e8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 shutdown_connections 2024-09-17T05:22:54.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.061+0000 7f18ea416640 1 -- 172.21.15.81:0/2382403160 wait complete. 2024-09-17T05:22:54.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:22:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 -- 172.21.15.81:0/143733809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 msgr2=0x7f322c0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 --2- 172.21.15.81:0/143733809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c0b4690 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f322c06ee40 tx=0x7f321c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 -- 172.21.15.81:0/143733809 shutdown_connections 2024-09-17T05:22:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 --2- 172.21.15.81:0/143733809 >> v2:172.21.15.160:3300/0 conn(0x7f322c0735a0 0x7f322c0739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 --2- 172.21.15.81:0/143733809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c0b4690 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 -- 172.21.15.81:0/143733809 >> 172.21.15.81:0/143733809 conn(0x7f322c0b1690 msgr2=0x7f322c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 -- 172.21.15.81:0/143733809 shutdown_connections 2024-09-17T05:22:54.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.178+0000 7f32326cd640 1 -- 172.21.15.81:0/143733809 wait complete. 2024-09-17T05:22:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.179+0000 7f32326cd640 1 Processor -- start 2024-09-17T05:22:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.179+0000 7f32326cd640 1 -- start start 2024-09-17T05:22:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f32326cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c06ff80 0x7f322c0aa3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f32326cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f322c0735a0 0x7f322c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f32326cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f32326cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f322c070570 con 0x7f322c15aa70 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f32326cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f322c0703f0 con 0x7f322c06ff80 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f32326cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f322c0706f0 con 0x7f322c0735a0 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c06f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51940/0 (socket says 172.21.15.81:51940) 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 -- 172.21.15.81:0/1178438629 learned_addr learned my addr 172.21.15.81:0/1178438629 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f322bfff640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c06ff80 0x7f322c0aa3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f322b7fe640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f322c0735a0 0x7f322c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 -- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f322c0735a0 msgr2=0x7f322c06ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.183 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f322c0735a0 0x7f322c06ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 -- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c06ff80 msgr2=0x7f322c0aa3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c06ff80 0x7f322c0aa3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 -- 172.21.15.81:0/1178438629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322c1f8580 con 0x7f322c15aa70 2024-09-17T05:22:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f322b7fe640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f322c0735a0 0x7f322c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3230c6a640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c06f3b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f322400c770 tx=0x7f322400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3228ff9640 1 -- 172.21.15.81:0/1178438629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3224017070 con 0x7f322c15aa70 2024-09-17T05:22:54.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3228ff9640 1 -- 172.21.15.81:0/1178438629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3224005070 con 0x7f322c15aa70 2024-09-17T05:22:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322c1f4520 con 0x7f322c15aa70 2024-09-17T05:22:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.180+0000 7f3228ff9640 1 -- 172.21.15.81:0/1178438629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32240054c0 con 0x7f322c15aa70 2024-09-17T05:22:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.181+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f322c1f41f0 con 0x7f322c15aa70 2024-09-17T05:22:54.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.181+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f322c0739d0 con 0x7f322c15aa70 2024-09-17T05:22:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.182+0000 7f3228ff9640 1 -- 172.21.15.81:0/1178438629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f322401a070 con 0x7f322c15aa70 2024-09-17T05:22:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.183+0000 7f3228ff9640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3218078cb0 0x7f321807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.183+0000 7f322bfff640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3218078cb0 0x7f321807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.183+0000 7f3228ff9640 1 -- 172.21.15.81:0/1178438629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7f322409a2e0 con 0x7f322c15aa70 2024-09-17T05:22:54.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.183+0000 7f322bfff640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3218078cb0 0x7f321807b170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f321c033000 tx=0x7f321c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.187+0000 7f3228ff9640 1 -- 172.21.15.81:0/1178438629 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f32240628e0 con 0x7f322c15aa70 2024-09-17T05:22:54.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.428+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f322c1f46f0 con 0x7f322c15aa70 2024-09-17T05:22:54.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.429+0000 7f3228ff9640 1 -- 172.21.15.81:0/1178438629 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v20) ==== 80+0+5304 (secure 0 0 0) 0x7f32240621e0 con 0x7f322c15aa70 2024-09-17T05:22:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:54.430 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:22:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:22:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:22:54.430 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:22:54.431 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.432 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:54.433 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.434 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.435 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:22:54.436 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.437 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.438 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:22:54.439 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.440 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:22:54.441 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.442 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.443 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:22:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:22:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.444 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:22:54.445 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:22:54.446 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:22:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:22:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.447 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:22:54.447 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:22:54.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3218078cb0 msgr2=0x7f321807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3218078cb0 0x7f321807b170 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f321c033000 tx=0x7f321c004730 comp rx=0 tx=0).stop 2024-09-17T05:22:54.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 msgr2=0x7f322c06f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c06f3b0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f322400c770 tx=0x7f322400cc30 comp rx=0 tx=0).stop 2024-09-17T05:22:54.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 shutdown_connections 2024-09-17T05:22:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f322c15aa70 0x7f322c06f3b0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f322c0735a0 0x7f322c06ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3218078cb0 0x7f321807b170 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 --2- 172.21.15.81:0/1178438629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f322c06ff80 0x7f322c0aa3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 >> 172.21.15.81:0/1178438629 conn(0x7f322c0b1690 msgr2=0x7f322c15d7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 shutdown_connections 2024-09-17T05:22:54.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.431+0000 7f32326cd640 1 -- 172.21.15.81:0/1178438629 wait complete. 2024-09-17T05:22:54.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:22:54.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 -- 172.21.15.81:0/1952161565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc815aa70 msgr2=0x7efcc80b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 --2- 172.21.15.81:0/1952161565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc815aa70 0x7efcc80b4690 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7efcc80cf960 tx=0x7efcb802aa30 comp rx=0 tx=0).stop 2024-09-17T05:22:54.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 -- 172.21.15.81:0/1952161565 shutdown_connections 2024-09-17T05:22:54.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 --2- 172.21.15.81:0/1952161565 >> v2:172.21.15.160:3300/0 conn(0x7efcc806ff80 0x7efcc8070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 --2- 172.21.15.81:0/1952161565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcc80735a0 0x7efcc80739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 --2- 172.21.15.81:0/1952161565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc815aa70 0x7efcc80b4690 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 -- 172.21.15.81:0/1952161565 >> 172.21.15.81:0/1952161565 conn(0x7efcc80b1690 msgr2=0x7efcc80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 -- 172.21.15.81:0/1952161565 shutdown_connections 2024-09-17T05:22:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.551+0000 7efccf1fb640 1 -- 172.21.15.81:0/1952161565 wait complete. 2024-09-17T05:22:54.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.552+0000 7efccf1fb640 1 Processor -- start 2024-09-17T05:22:54.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.552+0000 7efccf1fb640 1 -- start start 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efccf1fb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcc806ff80 0x7efcc8142b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efccf1fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc80735a0 0x7efcc81e7900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efccf1fb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcc815aa70 0x7efcc81e7e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efccf1fb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80cd060 con 0x7efcc80735a0 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efccf1fb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efcc80ccee0 con 0x7efcc815aa70 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efccf1fb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efcc80cd1e0 con 0x7efcc806ff80 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc80735a0 0x7efcc81e7900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efcc7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc80735a0 0x7efcc81e7900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51958/0 (socket says 172.21.15.81:51958) 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efcc7fff640 1 -- 172.21.15.81:0/2860078677 learned_addr learned my addr 172.21.15.81:0/2860078677 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efccd798640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcc815aa70 0x7efcc81e7e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.553+0000 7efcccf97640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcc806ff80 0x7efcc8142b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc7fff640 1 -- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcc806ff80 msgr2=0x7efcc8142b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc7fff640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcc806ff80 0x7efcc8142b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc7fff640 1 -- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcc815aa70 msgr2=0x7efcc81e7e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc7fff640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcc815aa70 0x7efcc81e7e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc7fff640 1 -- 172.21.15.81:0/2860078677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcc81f7a30 con 0x7efcc80735a0 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efccd798640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcc815aa70 0x7efcc81e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcccf97640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcc806ff80 0x7efcc8142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc7fff640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc80735a0 0x7efcc81e7900 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c970 tx=0x7efcb000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc57fa640 1 -- 172.21.15.81:0/2860078677 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0007bb0 con 0x7efcc80735a0 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc57fa640 1 -- 172.21.15.81:0/2860078677 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efcb0005020 con 0x7efcc80735a0 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcc81f7cd0 con 0x7efcc80735a0 2024-09-17T05:22:54.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efcc57fa640 1 -- 172.21.15.81:0/2860078677 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efcb0007e60 con 0x7efcc80735a0 2024-09-17T05:22:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.554+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcc81f8290 con 0x7efcc80735a0 2024-09-17T05:22:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.555+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcc80739a0 con 0x7efcc80735a0 2024-09-17T05:22:54.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.556+0000 7efcc57fa640 1 -- 172.21.15.81:0/2860078677 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7efcb0005470 con 0x7efcc80735a0 2024-09-17T05:22:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.556+0000 7efcc57fa640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efca8078ce0 0x7efca807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.556+0000 7efcc57fa640 1 -- 172.21.15.81:0/2860078677 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7efcb009b090 con 0x7efcc80735a0 2024-09-17T05:22:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.556+0000 7efcccf97640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efca8078ce0 0x7efca807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.557+0000 7efcccf97640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efca8078ce0 0x7efca807b1a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcb8035000 tx=0x7efcb8004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.560+0000 7efcc57fa640 1 -- 172.21.15.81:0/2860078677 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7efcb0014030 con 0x7efcc80735a0 2024-09-17T05:22:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.739+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7efcc80b2ec0 con 0x7efcc80735a0 2024-09-17T05:22:54.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.739+0000 7efcc57fa640 1 -- 172.21.15.81:0/2860078677 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v79) ==== 84+0+65 (secure 0 0 0) 0x7efcb0063720 con 0x7efcc80735a0 2024-09-17T05:22:54.740 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:54.741 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:22:54.741 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:22:54.741 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:22:54.741 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:22:54.741 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:22:54.741 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efca8078ce0 msgr2=0x7efca807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efca8078ce0 0x7efca807b1a0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efcb8035000 tx=0x7efcb8004ab0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc80735a0 msgr2=0x7efcc81e7900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc80735a0 0x7efcc81e7900 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7efcb000c970 tx=0x7efcb000ce30 comp rx=0 tx=0).stop 2024-09-17T05:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 shutdown_connections 2024-09-17T05:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efca8078ce0 0x7efca807b1a0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efcc815aa70 0x7efcc81e7e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efcc80735a0 0x7efcc81e7900 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 --2- 172.21.15.81:0/2860078677 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efcc806ff80 0x7efcc8142b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.741+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 >> 172.21.15.81:0/2860078677 conn(0x7efcc80b1690 msgr2=0x7efcc815d6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.742+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 shutdown_connections 2024-09-17T05:22:54.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.742+0000 7efccf1fb640 1 -- 172.21.15.81:0/2860078677 wait complete. 2024-09-17T05:22:54.753 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:22:54.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:22:54.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.858+0000 7f7e95bb5640 1 -- 172.21.15.81:0/1591496795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 msgr2=0x7f7e7800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.858+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/1591496795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e7800b9c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f7e88009e20 tx=0x7f7e78005830 comp rx=0 tx=0).stop 2024-09-17T05:22:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.858+0000 7f7e95bb5640 1 -- 172.21.15.81:0/1591496795 shutdown_connections 2024-09-17T05:22:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.858+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/1591496795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e7800b9c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.858+0000 7f7e95bb5640 1 -- 172.21.15.81:0/1591496795 >> 172.21.15.81:0/1591496795 conn(0x7f7e900b1620 msgr2=0x7f7e900b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.858+0000 7f7e95bb5640 1 -- 172.21.15.81:0/1591496795 shutdown_connections 2024-09-17T05:22:54.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.858+0000 7f7e95bb5640 1 -- 172.21.15.81:0/1591496795 wait complete. 2024-09-17T05:22:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.859+0000 7f7e95bb5640 1 Processor -- start 2024-09-17T05:22:54.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e95bb5640 1 -- start start 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e95bb5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e9014b4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e95bb5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e900b2a20 0x7f7e900add20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e95bb5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e901f46c0 0x7f7e901f4b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e95bb5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7e901564a0 con 0x7f7e780052c0 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e95bb5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7e90156320 con 0x7f7e900b2a20 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e95bb5640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7e90070160 con 0x7f7e901f46c0 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e9014b4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e8f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e9014b4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51970/0 (socket says 172.21.15.81:51970) 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.860+0000 7f7e8f7fe640 1 -- 172.21.15.81:0/2629073856 learned_addr learned my addr 172.21.15.81:0/2629073856 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e8effd640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e900b2a20 0x7f7e900add20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e8f7fe640 1 -- 172.21.15.81:0/2629073856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e901f46c0 msgr2=0x7f7e901f4b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e8f7fe640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e901f46c0 0x7f7e901f4b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e8f7fe640 1 -- 172.21.15.81:0/2629073856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e900b2a20 msgr2=0x7f7e900add20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e8f7fe640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e900b2a20 0x7f7e900add20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e8f7fe640 1 -- 172.21.15.81:0/2629073856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7e900b2f20 con 0x7f7e780052c0 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e8f7fe640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e9014b4a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000e5c0 tx=0x7f7e8000ea80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e77fff640 1 -- 172.21.15.81:0/2629073856 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e80015070 con 0x7f7e780052c0 2024-09-17T05:22:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e77fff640 1 -- 172.21.15.81:0/2629073856 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7e8000ca00 con 0x7f7e780052c0 2024-09-17T05:22:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e77fff640 1 -- 172.21.15.81:0/2629073856 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7e8000ce30 con 0x7f7e780052c0 2024-09-17T05:22:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7e900b3200 con 0x7f7e780052c0 2024-09-17T05:22:54.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.861+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7e900b3aa0 con 0x7f7e780052c0 2024-09-17T05:22:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.862+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7e9015f9e0 con 0x7f7e780052c0 2024-09-17T05:22:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.863+0000 7f7e77fff640 1 -- 172.21.15.81:0/2629073856 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f7e80018070 con 0x7f7e780052c0 2024-09-17T05:22:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.863+0000 7f7e77fff640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7e7c078ce0 0x7f7e7c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.863+0000 7f7e8effd640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7e7c078ce0 0x7f7e7c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.863+0000 7f7e77fff640 1 -- 172.21.15.81:0/2629073856 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(79..79 src has 1..79) ==== 4857+0+0 (secure 0 0 0) 0x7f7e8009afc0 con 0x7f7e780052c0 2024-09-17T05:22:54.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.864+0000 7f7e8effd640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7e7c078ce0 0x7f7e7c07b1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e900748c0 tx=0x7f7e84006b70 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:54.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:54.868+0000 7f7e77fff640 1 -- 172.21.15.81:0/2629073856 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7e80063650 con 0x7f7e780052c0 2024-09-17T05:22:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.047+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7f7e90074100 con 0x7f7e780052c0 2024-09-17T05:22:55.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.080+0000 7f7e77fff640 1 -- 172.21.15.81:0/2629073856 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v80) ==== 138+0+0 (secure 0 0 0) 0x7f7e80062f50 con 0x7f7e780052c0 2024-09-17T05:22:55.081 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:22:55.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7e7c078ce0 msgr2=0x7f7e7c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7e7c078ce0 0x7f7e7c07b1a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7e900748c0 tx=0x7f7e84006b70 comp rx=0 tx=0).stop 2024-09-17T05:22:55.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 msgr2=0x7f7e9014b4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e9014b4a0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f7e8000e5c0 tx=0x7f7e8000ea80 comp rx=0 tx=0).stop 2024-09-17T05:22:55.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 shutdown_connections 2024-09-17T05:22:55.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7e901f46c0 0x7f7e901f4b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7e7c078ce0 0x7f7e7c07b1a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7e900b2a20 0x7f7e900add20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 --2- 172.21.15.81:0/2629073856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7e780052c0 0x7f7e9014b4a0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 >> 172.21.15.81:0/2629073856 conn(0x7f7e900b1620 msgr2=0x7f7e900ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:55.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 shutdown_connections 2024-09-17T05:22:55.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.083+0000 7f7e95bb5640 1 -- 172.21.15.81:0/2629073856 wait complete. 2024-09-17T05:22:55.098 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:22:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 -- 172.21.15.81:0/808170622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c15b380 msgr2=0x7fe73c072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 --2- 172.21.15.81:0/808170622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c15b380 0x7fe73c072b50 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7fe73c0b2770 tx=0x7fe73802a9e0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 -- 172.21.15.81:0/808170622 shutdown_connections 2024-09-17T05:22:55.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 --2- 172.21.15.81:0/808170622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73c073090 0x7fe73c0cda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 --2- 172.21.15.81:0/808170622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c15b380 0x7fe73c072b50 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 -- 172.21.15.81:0/808170622 >> 172.21.15.81:0/808170622 conn(0x7fe73c0b1700 msgr2=0x7fe73c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:55.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 -- 172.21.15.81:0/808170622 shutdown_connections 2024-09-17T05:22:55.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.206+0000 7fe74455d640 1 -- 172.21.15.81:0/808170622 wait complete. 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.207+0000 7fe74455d640 1 Processor -- start 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.207+0000 7fe74455d640 1 -- start start 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe74455d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c073090 0x7fe73c1e7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe74455d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe73c0cdf50 0x7fe73c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe74455d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73c15b380 0x7fe73c1e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe74455d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c0cbd50 con 0x7fe73c073090 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe74455d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe73c0cbbd0 con 0x7fe73c0cdf50 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe74455d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe73c0cbed0 con 0x7fe73c15b380 2024-09-17T05:22:55.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c073090 0x7fe73c1e7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c073090 0x7fe73c1e7880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:51996/0 (socket says 172.21.15.81:51996) 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 -- 172.21.15.81:0/2009256905 learned_addr learned my addr 172.21.15.81:0/2009256905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 -- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73c15b380 msgr2=0x7fe73c1e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe742afa640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73c15b380 0x7fe73c1e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe741af8640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe73c0cdf50 0x7fe73c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73c15b380 0x7fe73c1e5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 -- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe73c0cdf50 msgr2=0x7fe73c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe73c0cdf50 0x7fe73c0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:55.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 -- 172.21.15.81:0/2009256905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe73c1e6640 con 0x7fe73c073090 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe741af8640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe73c0cdf50 0x7fe73c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe742afa640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73c15b380 0x7fe73c1e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.208+0000 7fe7422f9640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c073090 0x7fe73c1e7880 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe738000f80 tx=0x7fe738003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.209+0000 7fe732ffd640 1 -- 172.21.15.81:0/2009256905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738033050 con 0x7fe73c073090 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.209+0000 7fe732ffd640 1 -- 172.21.15.81:0/2009256905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe738004550 con 0x7fe73c073090 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.209+0000 7fe732ffd640 1 -- 172.21.15.81:0/2009256905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe738038450 con 0x7fe73c073090 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.209+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe73c1e6920 con 0x7fe73c073090 2024-09-17T05:22:55.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.209+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe73c0c4860 con 0x7fe73c073090 2024-09-17T05:22:55.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.210+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe73c0cda10 con 0x7fe73c073090 2024-09-17T05:22:55.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.210+0000 7fe732ffd640 1 -- 172.21.15.81:0/2009256905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fe738036070 con 0x7fe73c073090 2024-09-17T05:22:55.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.211+0000 7fe732ffd640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe720078cb0 0x7fe72007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:55.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.211+0000 7fe741af8640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe720078cb0 0x7fe72007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:55.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.211+0000 7fe732ffd640 1 -- 172.21.15.81:0/2009256905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 5227+0+0 (secure 0 0 0) 0x7fe7380bc0a0 con 0x7fe73c073090 2024-09-17T05:22:55.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.212+0000 7fe741af8640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe720078cb0 0x7fe72007b170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe72c006fd0 tx=0x7fe72c008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:55.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.216+0000 7fe732ffd640 1 -- 172.21.15.81:0/2009256905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe7380845c0 con 0x7fe73c073090 2024-09-17T05:22:55.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:55.395+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fe73c0b5040 con 0x7fe73c073090 2024-09-17T05:22:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.084+0000 7fe732ffd640 1 -- 172.21.15.81:0/2009256905 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v81) ==== 170+0+0 (secure 0 0 0) 0x7fe738083ec0 con 0x7fe73c073090 2024-09-17T05:22:56.085 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:22:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.089+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe720078cb0 msgr2=0x7fe72007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.089+0000 7fe74455d640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe720078cb0 0x7fe72007b170 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fe72c006fd0 tx=0x7fe72c008040 comp rx=0 tx=0).stop 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.089+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c073090 msgr2=0x7fe73c1e7880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.089+0000 7fe74455d640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c073090 0x7fe73c1e7880 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe738000f80 tx=0x7fe738003f90 comp rx=0 tx=0).stop 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.094+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 shutdown_connections 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.094+0000 7fe74455d640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe73c15b380 0x7fe73c1e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.094+0000 7fe74455d640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe720078cb0 0x7fe72007b170 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.094+0000 7fe74455d640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe73c0cdf50 0x7fe73c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.094+0000 7fe74455d640 1 --2- 172.21.15.81:0/2009256905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe73c073090 0x7fe73c1e7880 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.094+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 >> 172.21.15.81:0/2009256905 conn(0x7fe73c0b1700 msgr2=0x7fe73c15bc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:56.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.097+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 shutdown_connections 2024-09-17T05:22:56.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.100+0000 7fe74455d640 1 -- 172.21.15.81:0/2009256905 wait complete. 2024-09-17T05:22:56.116 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:22:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.221+0000 7f276c3ad640 1 -- 172.21.15.81:0/262626195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c003a30 msgr2=0x7f274c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.221+0000 7f276c3ad640 1 --2- 172.21.15.81:0/262626195 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f274c003a30 0x7f274c003e50 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f27640ca8b0 tx=0x7f274c005830 comp rx=0 tx=0).stop 2024-09-17T05:22:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.221+0000 7f276a94a640 1 -- 172.21.15.81:0/262626195 reap_dead start 2024-09-17T05:22:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.221+0000 7f276c3ad640 1 -- 172.21.15.81:0/262626195 shutdown_connections 2024-09-17T05:22:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.221+0000 7f276c3ad640 1 -- 172.21.15.81:0/262626195 >> 172.21.15.81:0/262626195 conn(0x7f27640b1700 msgr2=0x7f27640b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.221+0000 7f276c3ad640 1 -- 172.21.15.81:0/262626195 shutdown_connections 2024-09-17T05:22:56.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.221+0000 7f276c3ad640 1 -- 172.21.15.81:0/262626195 wait complete. 2024-09-17T05:22:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.222+0000 7f276c3ad640 1 Processor -- start 2024-09-17T05:22:56.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.222+0000 7f276c3ad640 1 -- start start 2024-09-17T05:22:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f274c003a30 0x7f27641f3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2764150cb0 0x7f2764151980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27640c8c10 0x7f27640c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27640cdda0 con 0x7f2764150cb0 2024-09-17T05:22:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f27640cdc20 con 0x7f27640c8c10 2024-09-17T05:22:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f27641f2920 con 0x7f274c003a30 2024-09-17T05:22:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2764150cb0 0x7f2764151980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2764150cb0 0x7f2764151980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52002/0 (socket says 172.21.15.81:52002) 2024-09-17T05:22:56.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 -- 172.21.15.81:0/1861785520 learned_addr learned my addr 172.21.15.81:0/1861785520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276a149640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f274c003a30 0x7f27641f3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276a94a640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27640c8c10 0x7f27640c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 -- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f274c003a30 msgr2=0x7f27641f3390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f274c003a30 0x7f27641f3390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 -- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27640c8c10 msgr2=0x7f27640c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27640c8c10 0x7f27640c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 -- 172.21.15.81:0/1861785520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27640b55a0 con 0x7f2764150cb0 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2769948640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2764150cb0 0x7f2764151980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2758011ae0 tx=0x7f2758009e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2762ffd640 1 -- 172.21.15.81:0/1861785520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f275800fdb0 con 0x7f2764150cb0 2024-09-17T05:22:56.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2762ffd640 1 -- 172.21.15.81:0/1861785520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2758016070 con 0x7f2764150cb0 2024-09-17T05:22:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27641f2b90 con 0x7f2764150cb0 2024-09-17T05:22:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f2762ffd640 1 -- 172.21.15.81:0/1861785520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2758012690 con 0x7f2764150cb0 2024-09-17T05:22:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.223+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2764151ec0 con 0x7f2764150cb0 2024-09-17T05:22:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.224+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27640cabc0 con 0x7f2764150cb0 2024-09-17T05:22:56.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.225+0000 7f2762ffd640 1 -- 172.21.15.81:0/1861785520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f2758018030 con 0x7f2764150cb0 2024-09-17T05:22:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.225+0000 7f2762ffd640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2750078ce0 0x7f275007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.226+0000 7f2762ffd640 1 -- 172.21.15.81:0/1861785520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 5609+0+0 (secure 0 0 0) 0x7f275809b590 con 0x7f2764150cb0 2024-09-17T05:22:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.226+0000 7f276a149640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2750078ce0 0x7f275007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:56.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.226+0000 7f276a149640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2750078ce0 0x7f275007b1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2754033000 tx=0x7f275402d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:56.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.230+0000 7f2762ffd640 1 -- 172.21.15.81:0/1861785520 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f27580632e0 con 0x7f2764150cb0 2024-09-17T05:22:56.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:56.441+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f276415cab0 con 0x7f2764150cb0 2024-09-17T05:22:57.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.095+0000 7f2762ffd640 1 -- 172.21.15.81:0/1861785520 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v45) ==== 174+0+0 (secure 0 0 0) 0x7f2758067d10 con 0x7f2764150cb0 2024-09-17T05:22:57.096 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 12 and data pool 13 2024-09-17T05:22:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.099+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2750078ce0 msgr2=0x7f275007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.099+0000 7f276c3ad640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2750078ce0 0x7f275007b1a0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f2754033000 tx=0x7f275402d040 comp rx=0 tx=0).stop 2024-09-17T05:22:57.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.099+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2764150cb0 msgr2=0x7f2764151980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.099+0000 7f276c3ad640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2764150cb0 0x7f2764151980 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f2758011ae0 tx=0x7f2758009e00 comp rx=0 tx=0).stop 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 shutdown_connections 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2750078ce0 0x7f275007b1a0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f27640c8c10 0x7f27640c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2764150cb0 0x7f2764151980 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 --2- 172.21.15.81:0/1861785520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f274c003a30 0x7f27641f3390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 >> 172.21.15.81:0/1861785520 conn(0x7f27640b1700 msgr2=0x7f27640cbdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 shutdown_connections 2024-09-17T05:22:57.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.100+0000 7f276c3ad640 1 -- 172.21.15.81:0/1861785520 wait complete. 2024-09-17T05:22:57.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:57.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 -- 172.21.15.81:0/284592396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940b1920 msgr2=0x7ffb940d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 --2- 172.21.15.81:0/284592396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940b1920 0x7ffb940d1d10 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c005fd0 tx=0x7ffb7c02a540 comp rx=0 tx=0).stop 2024-09-17T05:22:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 -- 172.21.15.81:0/284592396 shutdown_connections 2024-09-17T05:22:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 --2- 172.21.15.81:0/284592396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940b1920 0x7ffb940d1d10 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 --2- 172.21.15.81:0/284592396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb9415bdc0 0x7ffb940b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 -- 172.21.15.81:0/284592396 >> 172.21.15.81:0/284592396 conn(0x7ffb94074cb0 msgr2=0x7ffb9409b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 -- 172.21.15.81:0/284592396 shutdown_connections 2024-09-17T05:22:57.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.224+0000 7ffb996ef640 1 -- 172.21.15.81:0/284592396 wait complete. 2024-09-17T05:22:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 Processor -- start 2024-09-17T05:22:57.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 -- start start 2024-09-17T05:22:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb940b1920 0x7ffb941f4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940d2250 0x7ffb940b7580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb9415bdc0 0x7ffb9415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb940cdc40 con 0x7ffb940d2250 2024-09-17T05:22:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb940cdac0 con 0x7ffb940b1920 2024-09-17T05:22:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb996ef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ffb940b2540 con 0x7ffb9415bdc0 2024-09-17T05:22:57.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.226+0000 7ffb927fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940d2250 0x7ffb940b7580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940d2250 0x7ffb940b7580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52018/0 (socket says 172.21.15.81:52018) 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 -- 172.21.15.81:0/1063781742 learned_addr learned my addr 172.21.15.81:0/1063781742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb92ffd640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb940b1920 0x7ffb941f4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb937fe640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb9415bdc0 0x7ffb9415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 -- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb9415bdc0 msgr2=0x7ffb9415a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb9415bdc0 0x7ffb9415a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 -- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb940b1920 msgr2=0x7ffb941f4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb940b1920 0x7ffb941f4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 -- 172.21.15.81:0/1063781742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb940b5140 con 0x7ffb940d2250 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb937fe640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb9415bdc0 0x7ffb9415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb927fc640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940d2250 0x7ffb940b7580 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c034040 tx=0x7ffb7c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb8b7fe640 1 -- 172.21.15.81:0/1063781742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c03e030 con 0x7ffb940d2250 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb8b7fe640 1 -- 172.21.15.81:0/1063781742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb7c003d90 con 0x7ffb940d2250 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb940b5480 con 0x7ffb940d2250 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb8b7fe640 1 -- 172.21.15.81:0/1063781742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb7c035040 con 0x7ffb940d2250 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.227+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb940b5cc0 con 0x7ffb940d2250 2024-09-17T05:22:57.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.228+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb940d1d10 con 0x7ffb940d2250 2024-09-17T05:22:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.229+0000 7ffb8b7fe640 1 -- 172.21.15.81:0/1063781742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7ffb7c041030 con 0x7ffb940d2250 2024-09-17T05:22:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.229+0000 7ffb8b7fe640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb74078cb0 0x7ffb7407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.229+0000 7ffb8b7fe640 1 -- 172.21.15.81:0/1063781742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7ffb7c0bb8b0 con 0x7ffb940d2250 2024-09-17T05:22:57.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.230+0000 7ffb92ffd640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb74078cb0 0x7ffb7407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.230+0000 7ffb92ffd640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb74078cb0 0x7ffb7407b170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb940b1750 tx=0x7ffb84009680 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.234+0000 7ffb8b7fe640 1 -- 172.21.15.81:0/1063781742 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ffb940b5480 con 0x7ffb940d2250 2024-09-17T05:22:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.413+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffb940b5e90 con 0x7ffb940d2250 2024-09-17T05:22:57.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.414+0000 7ffb8b7fe640 1 -- 172.21.15.81:0/1063781742 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16733 (secure 0 0 0) 0x7ffb7c0835a0 con 0x7ffb940d2250 2024-09-17T05:22:57.417 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:57.418 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:56.443217+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:55.051902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:55.400475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb74078cb0 msgr2=0x7ffb7407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb74078cb0 0x7ffb7407b170 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7ffb940b1750 tx=0x7ffb84009680 comp rx=0 tx=0).stop 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940d2250 msgr2=0x7ffb940b7580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940d2250 0x7ffb940b7580 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7ffb7c034040 tx=0x7ffb7c0038a0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 shutdown_connections 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb9415bdc0 0x7ffb9415a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb940d2250 0x7ffb940b7580 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb74078cb0 0x7ffb7407b170 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 --2- 172.21.15.81:0/1063781742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb940b1920 0x7ffb941f4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 >> 172.21.15.81:0/1063781742 conn(0x7ffb94074cb0 msgr2=0x7ffb940713e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 shutdown_connections 2024-09-17T05:22:57.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.416+0000 7ffb996ef640 1 -- 172.21.15.81:0/1063781742 wait complete. 2024-09-17T05:22:57.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:22:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.536+0000 7f0a74e7f640 1 -- 172.21.15.81:0/2778945577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c003a00 msgr2=0x7f0a5c003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.536+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/2778945577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c003a00 0x7f0a5c003e20 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800c780 tx=0x7f0a5c005830 comp rx=0 tx=0).stop 2024-09-17T05:22:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.536+0000 7f0a74e7f640 1 -- 172.21.15.81:0/2778945577 shutdown_connections 2024-09-17T05:22:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.536+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/2778945577 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a5c003a00 0x7f0a5c003e20 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.536+0000 7f0a74e7f640 1 -- 172.21.15.81:0/2778945577 >> 172.21.15.81:0/2778945577 conn(0x7f0a700d3ea0 msgr2=0x7f0a700d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.536+0000 7f0a74e7f640 1 -- 172.21.15.81:0/2778945577 shutdown_connections 2024-09-17T05:22:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.536+0000 7f0a74e7f640 1 -- 172.21.15.81:0/2778945577 wait complete. 2024-09-17T05:22:57.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.537+0000 7f0a74e7f640 1 Processor -- start 2024-09-17T05:22:57.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.537+0000 7f0a74e7f640 1 -- start start 2024-09-17T05:22:57.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a74e7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a5c003a00 0x7f0a700cdc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a74e7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7015fd10 0x7f0a701f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a74e7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a70160190 0x7f0a701f8590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a74e7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a700cf9b0 con 0x7f0a7015fd10 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a74e7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a701627a0 con 0x7f0a70160190 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a74e7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0a700cfb30 con 0x7f0a5c003a00 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7015fd10 0x7f0a701f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7015fd10 0x7f0a701f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52032/0 (socket says 172.21.15.81:52032) 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 -- 172.21.15.81:0/1203314283 learned_addr learned my addr 172.21.15.81:0/1203314283 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6ed9d640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a70160190 0x7f0a701f8590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6e59c640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a5c003a00 0x7f0a700cdc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 -- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a5c003a00 msgr2=0x7f0a700cdc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a5c003a00 0x7f0a700cdc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 -- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a70160190 msgr2=0x7f0a701f8590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a70160190 0x7f0a701f8590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6dd9b640 1 -- 172.21.15.81:0/1203314283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a700ce2c0 con 0x7f0a7015fd10 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.538+0000 7f0a6ed9d640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a70160190 0x7f0a701f8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.539+0000 7f0a6dd9b640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7015fd10 0x7f0a701f8050 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800fa00 tx=0x7f0a5800fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.539+0000 7f0a66ffd640 1 -- 172.21.15.81:0/1203314283 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5800bcb0 con 0x7f0a7015fd10 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.539+0000 7f0a66ffd640 1 -- 172.21.15.81:0/1203314283 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a58004030 con 0x7f0a7015fd10 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.539+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a700b7dc0 con 0x7f0a7015fd10 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.539+0000 7f0a66ffd640 1 -- 172.21.15.81:0/1203314283 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58004460 con 0x7f0a7015fd10 2024-09-17T05:22:57.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.539+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a700b8380 con 0x7f0a7015fd10 2024-09-17T05:22:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.540+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a700d07a0 con 0x7f0a7015fd10 2024-09-17T05:22:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.540+0000 7f0a66ffd640 1 -- 172.21.15.81:0/1203314283 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f0a580035f0 con 0x7f0a7015fd10 2024-09-17T05:22:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.541+0000 7f0a66ffd640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a50078cb0 0x7f0a5007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.541+0000 7f0a66ffd640 1 -- 172.21.15.81:0/1203314283 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7f0a5809b870 con 0x7f0a7015fd10 2024-09-17T05:22:57.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.541+0000 7f0a6e59c640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a50078cb0 0x7f0a5007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.541+0000 7f0a6e59c640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a50078cb0 0x7f0a5007b170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0a68033000 tx=0x7f0a68038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.545+0000 7f0a66ffd640 1 -- 172.21.15.81:0/1203314283 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0a580634d0 con 0x7f0a7015fd10 2024-09-17T05:22:57.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.724+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0a700b49b0 con 0x7f0a7015fd10 2024-09-17T05:22:57.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.725+0000 7f0a66ffd640 1 -- 172.21.15.81:0/1203314283 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) ==== 74+0+16733 (secure 0 0 0) 0x7f0a58067f00 con 0x7f0a7015fd10 2024-09-17T05:22:57.726 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:22:57.727 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":82,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:56.443217+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:55.051902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:55.400475+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a50078cb0 msgr2=0x7f0a5007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a50078cb0 0x7f0a5007b170 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f0a68033000 tx=0x7f0a68038040 comp rx=0 tx=0).stop 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7015fd10 msgr2=0x7f0a701f8050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7015fd10 0x7f0a701f8050 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f0a5800fa00 tx=0x7f0a5800fec0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 shutdown_connections 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a50078cb0 0x7f0a5007b170 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a70160190 0x7f0a701f8590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7015fd10 0x7f0a701f8050 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 --2- 172.21.15.81:0/1203314283 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a5c003a00 0x7f0a700cdc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.727+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 >> 172.21.15.81:0/1203314283 conn(0x7f0a700d3ea0 msgr2=0x7f0a700b1620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.728+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 shutdown_connections 2024-09-17T05:22:57.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.728+0000 7f0a74e7f640 1 -- 172.21.15.81:0/1203314283 wait complete. 2024-09-17T05:22:57.740 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:22:57.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1108188714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8081617f0 msgr2=0x7fe8080d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1108188714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8081617f0 0x7fe8080d1d30 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8005fd0 tx=0x7fe7f802a540 comp rx=0 tx=0).stop 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1108188714 shutdown_connections 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1108188714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8080d01b0 0x7fe8080d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1108188714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8081617f0 0x7fe8080d1d30 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1108188714 >> 172.21.15.81:0/1108188714 conn(0x7fe8080d3e30 msgr2=0x7fe8080d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1108188714 shutdown_connections 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.844+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1108188714 wait complete. 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 Processor -- start 2024-09-17T05:22:57.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 -- start start 2024-09-17T05:22:57.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080d01b0 0x7fe8081f8370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080d27b0 0x7fe8080b90a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8081617f0 0x7fe8081f55f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe8080d0f50 con 0x7fe8080d27b0 2024-09-17T05:22:57.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe8080b5000 con 0x7fe8080d01b0 2024-09-17T05:22:57.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe80d4d4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe8080d10d0 con 0x7fe8081617f0 2024-09-17T05:22:57.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe8067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080d27b0 0x7fe8080b90a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe8067fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080d27b0 0x7fe8080b90a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52046/0 (socket says 172.21.15.81:52046) 2024-09-17T05:22:57.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.846+0000 7fe8067fc640 1 -- 172.21.15.81:0/1013613026 learned_addr learned my addr 172.21.15.81:0/1013613026 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:57.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe8067fc640 1 -- 172.21.15.81:0/1013613026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8081617f0 msgr2=0x7fe8081f55f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe8067fc640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8081617f0 0x7fe8081f55f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe8067fc640 1 -- 172.21.15.81:0/1013613026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080d01b0 msgr2=0x7fe8081f8370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe8067fc640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080d01b0 0x7fe8081f8370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe8067fc640 1 -- 172.21.15.81:0/1013613026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8081f8c00 con 0x7fe8080d27b0 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe8067fc640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080d27b0 0x7fe8080b90a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d770 tx=0x7fe7fc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe7ef7fe640 1 -- 172.21.15.81:0/1013613026 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc017070 con 0x7fe8080d27b0 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe7ef7fe640 1 -- 172.21.15.81:0/1013613026 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe7fc009d20 con 0x7fe8080d27b0 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8081f8ee0 con 0x7fe8080d27b0 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe7ef7fe640 1 -- 172.21.15.81:0/1013613026 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7fc004280 con 0x7fe8080d27b0 2024-09-17T05:22:57.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.847+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8081f4d80 con 0x7fe8080d27b0 2024-09-17T05:22:57.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.848+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8080d15f0 con 0x7fe8080d27b0 2024-09-17T05:22:57.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.849+0000 7fe7ef7fe640 1 -- 172.21.15.81:0/1013613026 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fe7fc0035f0 con 0x7fe8080d27b0 2024-09-17T05:22:57.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.849+0000 7fe7ef7fe640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe7f4078cb0 0x7fe7f407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:57.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.850+0000 7fe7ef7fe640 1 -- 172.21.15.81:0/1013613026 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 5709+0+0 (secure 0 0 0) 0x7fe7fc09b0a0 con 0x7fe8080d27b0 2024-09-17T05:22:57.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.850+0000 7fe806ffd640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe7f4078cb0 0x7fe7f407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:57.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.850+0000 7fe806ffd640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe7f4078cb0 0x7fe7f407b170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8033000 tx=0x7fe7f80046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:57.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:57.854+0000 7fe7ef7fe640 1 -- 172.21.15.81:0/1013613026 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe7fc063350 con 0x7fe8080d27b0 2024-09-17T05:22:58.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.067+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe8081f90b0 con 0x7fe8080d27b0 2024-09-17T05:22:58.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.832+0000 7fe7ef7fe640 1 -- 172.21.15.81:0/1013613026 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v47) ==== 118+0+0 (secure 0 0 0) 0x7fe7fc062c50 con 0x7fe8080d27b0 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe7f4078cb0 msgr2=0x7fe7f407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe7f4078cb0 0x7fe7f407b170 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fe7f8033000 tx=0x7fe7f80046c0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080d27b0 msgr2=0x7fe8080b90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080d27b0 0x7fe8080b90a0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7fe7fc00d770 tx=0x7fe7fc00dc30 comp rx=0 tx=0).stop 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 shutdown_connections 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe8081617f0 0x7fe8081f55f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe8080d27b0 0x7fe8080b90a0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe7f4078cb0 0x7fe7f407b170 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.834+0000 7fe80d4d4640 1 --2- 172.21.15.81:0/1013613026 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe8080d01b0 0x7fe8081f8370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.835+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 >> 172.21.15.81:0/1013613026 conn(0x7fe8080d3e30 msgr2=0x7fe8080b2c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.835+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 shutdown_connections 2024-09-17T05:22:58.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.835+0000 7fe80d4d4640 1 -- 172.21.15.81:0/1013613026 wait complete. 2024-09-17T05:22:58.847 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:22:58.847 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:22:58.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 -- 172.21.15.81:0/2414130038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8415f240 msgr2=0x7f5e840ce430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 --2- 172.21.15.81:0/2414130038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8415f240 0x7f5e840ce430 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f5e840d2b20 tx=0x7f5e7402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 -- 172.21.15.81:0/2414130038 shutdown_connections 2024-09-17T05:22:58.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 --2- 172.21.15.81:0/2414130038 >> v2:172.21.15.160:3300/0 conn(0x7f5e840d2540 0x7f5e840ce970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 --2- 172.21.15.81:0/2414130038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e8415f240 0x7f5e840ce430 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 -- 172.21.15.81:0/2414130038 >> 172.21.15.81:0/2414130038 conn(0x7f5e840d1a20 msgr2=0x7f5e840d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:22:58.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 -- 172.21.15.81:0/2414130038 shutdown_connections 2024-09-17T05:22:58.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.953+0000 7f5e8919f640 1 -- 172.21.15.81:0/2414130038 wait complete. 2024-09-17T05:22:58.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.954+0000 7f5e8919f640 1 Processor -- start 2024-09-17T05:22:58.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.954+0000 7f5e8919f640 1 -- start start 2024-09-17T05:22:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e8919f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e840b3030 0x7f5e84156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e8919f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e840d2540 0x7f5e841f8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e8919f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e8415f240 0x7f5e8414afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e8919f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840d01b0 con 0x7f5e840b3030 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e8919f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5e840b6330 con 0x7f5e840d2540 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e8919f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5e840d0330 con 0x7f5e8415f240 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e840b3030 0x7f5e84156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e840b3030 0x7f5e84156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52072/0 (socket says 172.21.15.81:52072) 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e83fff640 1 -- 172.21.15.81:0/3543489497 learned_addr learned my addr 172.21.15.81:0/3543489497 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e837fe640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e840d2540 0x7f5e841f8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.955+0000 7f5e8899e640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e8415f240 0x7f5e8414afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e83fff640 1 -- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e8415f240 msgr2=0x7f5e8414afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e83fff640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e8415f240 0x7f5e8414afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e83fff640 1 -- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e840d2540 msgr2=0x7f5e841f8970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e83fff640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e840d2540 0x7f5e841f8970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e83fff640 1 -- 172.21.15.81:0/3543489497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e840c7900 con 0x7f5e840b3030 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e83fff640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e840b3030 0x7f5e84156030 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5e740099d0 tx=0x7f5e740050c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e80ff9640 1 -- 172.21.15.81:0/3543489497 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e74031950 con 0x7f5e840b3030 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e80ff9640 1 -- 172.21.15.81:0/3543489497 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e74031be0 con 0x7f5e840b3030 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e84157bf0 con 0x7f5e840b3030 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e80ff9640 1 -- 172.21.15.81:0/3543489497 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e740330d0 con 0x7f5e840b3030 2024-09-17T05:22:58.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.956+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e840c7bc0 con 0x7f5e840b3030 2024-09-17T05:22:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.957+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e840d0860 con 0x7f5e840b3030 2024-09-17T05:22:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.958+0000 7f5e80ff9640 1 -- 172.21.15.81:0/3543489497 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f5e74033270 con 0x7f5e840b3030 2024-09-17T05:22:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.958+0000 7f5e80ff9640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e70078cb0 0x7f5e7007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:22:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.958+0000 7f5e80ff9640 1 -- 172.21.15.81:0/3543489497 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f5e740bbeb0 con 0x7f5e840b3030 2024-09-17T05:22:58.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.958+0000 7f5e837fe640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e70078cb0 0x7f5e7007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:22:58.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.959+0000 7f5e837fe640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e70078cb0 0x7f5e7007b170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e840c8aa0 tx=0x7f5e78009110 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:22:58.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:58.962+0000 7f5e80ff9640 1 -- 172.21.15.81:0/3543489497 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5e7403f030 con 0x7f5e840b3030 2024-09-17T05:22:59.060 INFO:tasks.ceph.mds.a.smithi081.stderr:2024-09-17T05:22:59.059+0000 7fd2a8962640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:22:59.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:22:59.176+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f5e84070600 con 0x7f5e840b3030 2024-09-17T05:23:00.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.084+0000 7f5e80ff9640 1 -- 172.21.15.81:0/3543489497 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f5e74031770 con 0x7f5e840b3030 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e70078cb0 msgr2=0x7f5e7007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e70078cb0 0x7f5e7007b170 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f5e840c8aa0 tx=0x7f5e78009110 comp rx=0 tx=0).stop 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e840b3030 msgr2=0x7f5e84156030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e840b3030 0x7f5e84156030 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f5e740099d0 tx=0x7f5e740050c0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 shutdown_connections 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e8415f240 0x7f5e8414afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e70078cb0 0x7f5e7007b170 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e840d2540 0x7f5e841f8970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 --2- 172.21.15.81:0/3543489497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e840b3030 0x7f5e84156030 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 >> 172.21.15.81:0/3543489497 conn(0x7f5e840d1a20 msgr2=0x7f5e84070e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 shutdown_connections 2024-09-17T05:23:00.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.087+0000 7f5e8919f640 1 -- 172.21.15.81:0/3543489497 wait complete. 2024-09-17T05:23:00.100 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:23:00.101 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:00.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 -- 172.21.15.81:0/2118647899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d1f50 msgr2=0x7f5f700b1620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/2118647899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d1f50 0x7f5f700b1620 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f5f70074010 tx=0x7f5f6802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 -- 172.21.15.81:0/2118647899 shutdown_connections 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/2118647899 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d1f50 0x7f5f700b1620 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/2118647899 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f700d0230 0x7f5f700d1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/2118647899 >> v2:172.21.15.160:3300/0 conn(0x7f5f70159820 0x7f5f700cf900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 -- 172.21.15.81:0/2118647899 >> 172.21.15.81:0/2118647899 conn(0x7f5f7009aa30 msgr2=0x7f5f7009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 -- 172.21.15.81:0/2118647899 shutdown_connections 2024-09-17T05:23:00.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.205+0000 7f5f6f59e640 1 -- 172.21.15.81:0/2118647899 wait complete. 2024-09-17T05:23:00.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 Processor -- start 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 -- start start 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d0230 0x7f5f701efb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f700d1f50 0x7f5f70145400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f70159820 0x7f5f701f5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f700d07f0 con 0x7f5f700d0230 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5f700d0670 con 0x7f5f700d1f50 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6f59e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5f700b1b60 con 0x7f5f70159820 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d0230 0x7f5f701efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d0230 0x7f5f701efb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52092/0 (socket says 172.21.15.81:52092) 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.207+0000 7f5f6e59c640 1 -- 172.21.15.81:0/112717045 learned_addr learned my addr 172.21.15.81:0/112717045 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:00.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6dd9b640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f700d1f50 0x7f5f70145400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6ed9d640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f70159820 0x7f5f701f5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6e59c640 1 -- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f70159820 msgr2=0x7f5f701f5c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6e59c640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f70159820 0x7f5f701f5c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6e59c640 1 -- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f700d1f50 msgr2=0x7f5f70145400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6e59c640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f700d1f50 0x7f5f70145400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6e59c640 1 -- 172.21.15.81:0/112717045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f70145940 con 0x7f5f700d0230 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6e59c640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d0230 0x7f5f701efb20 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cce0 tx=0x7f5f60007610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f66ffd640 1 -- 172.21.15.81:0/112717045 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60004b20 con 0x7f5f700d0230 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f66ffd640 1 -- 172.21.15.81:0/112717045 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f60004db0 con 0x7f5f700d0230 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f66ffd640 1 -- 172.21.15.81:0/112717045 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f60005280 con 0x7f5f700d0230 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f700c5cb0 con 0x7f5f700d0230 2024-09-17T05:23:00.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.208+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f700c8050 con 0x7f5f700d0230 2024-09-17T05:23:00.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.209+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f70157510 con 0x7f5f700d0230 2024-09-17T05:23:00.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.210+0000 7f5f66ffd640 1 -- 172.21.15.81:0/112717045 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f5f60005420 con 0x7f5f700d0230 2024-09-17T05:23:00.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.210+0000 7f5f66ffd640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f50078cb0 0x7f5f5007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.210+0000 7f5f6dd9b640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f50078cb0 0x7f5f5007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.210+0000 7f5f66ffd640 1 -- 172.21.15.81:0/112717045 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f5f6009b5a0 con 0x7f5f700d0230 2024-09-17T05:23:00.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.211+0000 7f5f6dd9b640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f50078cb0 0x7f5f5007b170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f58005910 tx=0x7f5f580058a0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.215 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.214+0000 7f5f66ffd640 1 -- 172.21.15.81:0/112717045 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5f60014030 con 0x7f5f700d0230 2024-09-17T05:23:00.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.430+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f700b3510 con 0x7f5f700d0230 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.431+0000 7f5f66ffd640 1 -- 172.21.15.81:0/112717045 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7f5f60063200 con 0x7f5f700d0230 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":48,"btime":"2024-09-17T05:23:00:080501+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3004752015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3004752015},{"type":"v1","addr":"172.21.15.81:6835","nonce":3004752015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4151219415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4151219415},{"type":"v1","addr":"172.21.15.160:6835","nonce":4151219415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6046,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/3249546675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3249546675},{"type":"v1","addr":"172.21.15.160:6801","nonce":3249546675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:56.443180+0000","modified":"2024-09-17T05:22:59.178373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6834/3405352353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3405352353},{"type":"v1","addr":"172.21.15.81:6834","nonce":3405352353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6636,"qdb_cluster":[6636]},"id":6}]} 2024-09-17T05:23:00.432 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 48 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f50078cb0 msgr2=0x7f5f5007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f50078cb0 0x7f5f5007b170 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5f58005910 tx=0x7f5f580058a0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d0230 msgr2=0x7f5f701efb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d0230 0x7f5f701efb20 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5f6000cce0 tx=0x7f5f60007610 comp rx=0 tx=0).stop 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 shutdown_connections 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f70159820 0x7f5f701f5c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f50078cb0 0x7f5f5007b170 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f700d1f50 0x7f5f70145400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 --2- 172.21.15.81:0/112717045 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f700d0230 0x7f5f701efb20 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 >> 172.21.15.81:0/112717045 conn(0x7f5f7009aa30 msgr2=0x7f5f700aec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 shutdown_connections 2024-09-17T05:23:00.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.433+0000 7f5f6f59e640 1 -- 172.21.15.81:0/112717045 wait complete. 2024-09-17T05:23:00.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.546+0000 7f7c9ba60640 1 -- 172.21.15.81:0/3348026692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 msgr2=0x7f7c7c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.546+0000 7f7c9ba60640 1 --2- 172.21.15.81:0/3348026692 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 0x7f7c7c004c80 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f7c88009c00 tx=0x7f7c7c005830 comp rx=0 tx=0).stop 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.546+0000 7f7c99ffd640 1 -- 172.21.15.81:0/3348026692 reap_dead start 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.546+0000 7f7c9ba60640 1 -- 172.21.15.81:0/3348026692 shutdown_connections 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.546+0000 7f7c9ba60640 1 -- 172.21.15.81:0/3348026692 >> 172.21.15.81:0/3348026692 conn(0x7f7c940b1690 msgr2=0x7f7c940b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.546+0000 7f7c9ba60640 1 -- 172.21.15.81:0/3348026692 shutdown_connections 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.546+0000 7f7c9ba60640 1 -- 172.21.15.81:0/3348026692 wait complete. 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.547+0000 7f7c9ba60640 1 Processor -- start 2024-09-17T05:23:00.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.547+0000 7f7c9ba60640 1 -- start start 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c9ba60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 0x7f7c941e2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c9ba60640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c941501c0 0x7f7c941496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c9ba60640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c94150990 0x7f7c940b3d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c9ba60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9406e760 con 0x7f7c7c004800 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c9ba60640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c9406e5e0 con 0x7f7c941501c0 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c9ba60640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7c9406e8e0 con 0x7f7c94150990 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 0x7f7c941e2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 0x7f7c941e2d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52100/0 (socket says 172.21.15.81:52100) 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 -- 172.21.15.81:0/127593407 learned_addr learned my addr 172.21.15.81:0/127593407 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c99ffd640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c94150990 0x7f7c940b3d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c98ffb640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c941501c0 0x7f7c941496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 -- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c94150990 msgr2=0x7f7c940b3d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c94150990 0x7f7c940b3d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 -- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c941501c0 msgr2=0x7f7c941496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c941501c0 0x7f7c941496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.548+0000 7f7c997fc640 1 -- 172.21.15.81:0/127593407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c941f62a0 con 0x7f7c7c004800 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.549+0000 7f7c997fc640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 0x7f7c941e2d90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7c84010cb0 tx=0x7f7c8400e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.549+0000 7f7c91ffb640 1 -- 172.21.15.81:0/127593407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84004d20 con 0x7f7c7c004800 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.549+0000 7f7c91ffb640 1 -- 172.21.15.81:0/127593407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c84010e60 con 0x7f7c7c004800 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.549+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c941f6580 con 0x7f7c7c004800 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.549+0000 7f7c91ffb640 1 -- 172.21.15.81:0/127593407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c84005260 con 0x7f7c7c004800 2024-09-17T05:23:00.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.549+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c941f6b40 con 0x7f7c7c004800 2024-09-17T05:23:00.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.550+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c940cef30 con 0x7f7c7c004800 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.550+0000 7f7c91ffb640 1 -- 172.21.15.81:0/127593407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f7c8401a030 con 0x7f7c7c004800 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.551+0000 7f7c91ffb640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c80078cb0 0x7f7c8007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.551+0000 7f7c91ffb640 1 -- 172.21.15.81:0/127593407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f7c8409b9d0 con 0x7f7c7c004800 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.551+0000 7f7c98ffb640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c80078cb0 0x7f7c8007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.551+0000 7f7c98ffb640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c80078cb0 0x7f7c8007b170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c88036000 tx=0x7f7c880046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.555+0000 7f7c91ffb640 1 -- 172.21.15.81:0/127593407 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7c840636c0 con 0x7f7c7c004800 2024-09-17T05:23:00.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.731+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7c94072f00 con 0x7f7c7c004800 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.732+0000 7f7c91ffb640 1 -- 172.21.15.81:0/127593407 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+16720 (secure 0 0 0) 0x7f7c840680f0 con 0x7f7c7c004800 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:00.733 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":83,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:22:58.067150+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:55.051902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:55.400475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":81,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c80078cb0 msgr2=0x7f7c8007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c80078cb0 0x7f7c8007b170 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7c88036000 tx=0x7f7c880046c0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 msgr2=0x7f7c941e2d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 0x7f7c941e2d90 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f7c84010cb0 tx=0x7f7c8400e6c0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 shutdown_connections 2024-09-17T05:23:00.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c94150990 0x7f7c940b3d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c80078cb0 0x7f7c8007b170 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c941501c0 0x7f7c941496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 --2- 172.21.15.81:0/127593407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c004800 0x7f7c941e2d90 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 >> 172.21.15.81:0/127593407 conn(0x7f7c940b1690 msgr2=0x7f7c9414b610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 shutdown_connections 2024-09-17T05:23:00.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.734+0000 7f7c9ba60640 1 -- 172.21.15.81:0/127593407 wait complete. 2024-09-17T05:23:00.746 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:23:00.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.846+0000 7f287bc33640 1 -- 172.21.15.81:0/2114570476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 msgr2=0x7f28600051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.846+0000 7f287bc33640 1 --2- 172.21.15.81:0/2114570476 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 0x7f28600051c0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f286c00f490 tx=0x7f2860005830 comp rx=0 tx=0).stop 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.846+0000 7f287a1d0640 1 -- 172.21.15.81:0/2114570476 reap_dead start 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.846+0000 7f287bc33640 1 -- 172.21.15.81:0/2114570476 shutdown_connections 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.846+0000 7f287bc33640 1 -- 172.21.15.81:0/2114570476 >> 172.21.15.81:0/2114570476 conn(0x7f28740b1690 msgr2=0x7f28740b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.846+0000 7f287bc33640 1 -- 172.21.15.81:0/2114570476 shutdown_connections 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.846+0000 7f287bc33640 1 -- 172.21.15.81:0/2114570476 wait complete. 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.847+0000 7f287bc33640 1 Processor -- start 2024-09-17T05:23:00.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287bc33640 1 -- start start 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287bc33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 0x7f28740cb250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287bc33640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28740c59b0 0x7f28740c5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287bc33640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28741f49a0 0x7f28741f4de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287bc33640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2874072930 con 0x7f2860004d40 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287bc33640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f28740727b0 con 0x7f28740c59b0 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287bc33640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2874072ab0 con 0x7f28741f49a0 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f28799cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 0x7f28740cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f28799cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 0x7f28740cb250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52112/0 (socket says 172.21.15.81:52112) 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f28799cf640 1 -- 172.21.15.81:0/1039775739 learned_addr learned my addr 172.21.15.81:0/1039775739 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.848+0000 7f287a1d0640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28741f49a0 0x7f28741f4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28791ce640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28740c59b0 0x7f28740c5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28799cf640 1 -- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28741f49a0 msgr2=0x7f28741f4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28799cf640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28741f49a0 0x7f28741f4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28799cf640 1 -- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28740c59b0 msgr2=0x7f28740c5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28799cf640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28740c59b0 0x7f28740c5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28799cf640 1 -- 172.21.15.81:0/1039775739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2874133fa0 con 0x7f2860004d40 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28791ce640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28740c59b0 0x7f28740c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f28799cf640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 0x7f28740cb250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2870006600 tx=0x7f28700039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f286a7fc640 1 -- 172.21.15.81:0/1039775739 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287000f760 con 0x7f2860004d40 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f286a7fc640 1 -- 172.21.15.81:0/1039775739 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2870016020 con 0x7f2860004d40 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f286a7fc640 1 -- 172.21.15.81:0/1039775739 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287000fbc0 con 0x7f2860004d40 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2874134260 con 0x7f2860004d40 2024-09-17T05:23:00.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.849+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2874134820 con 0x7f2860004d40 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.850+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2874134b50 con 0x7f2860004d40 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.851+0000 7f286a7fc640 1 -- 172.21.15.81:0/1039775739 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f2870011430 con 0x7f2860004d40 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.851+0000 7f286a7fc640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2858078ce0 0x7f285807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:00.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.851+0000 7f28791ce640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2858078ce0 0x7f285807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.851+0000 7f286a7fc640 1 -- 172.21.15.81:0/1039775739 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f287009ba10 con 0x7f2860004d40 2024-09-17T05:23:00.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.852+0000 7f28791ce640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2858078ce0 0x7f285807b1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f287413cb60 tx=0x7f2864005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:00.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:00.856+0000 7f286a7fc640 1 -- 172.21.15.81:0/1039775739 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2870020020 con 0x7f2860004d40 2024-09-17T05:23:01.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.028+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f287415b620 con 0x7f2858078ce0 2024-09-17T05:23:01.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.033+0000 7f286a7fc640 1 -- 172.21.15.81:0/1039775739 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252078 (secure 0 0 0) 0x7f287415b620 con 0x7f2858078ce0 2024-09-17T05:23:01.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2858078ce0 msgr2=0x7f285807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2858078ce0 0x7f285807b1a0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f287413cb60 tx=0x7f2864005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 msgr2=0x7f28740cb250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 0x7f28740cb250 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f2870006600 tx=0x7f28700039c0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 shutdown_connections 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f28741f49a0 0x7f28741f4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2858078ce0 0x7f285807b1a0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f28740c59b0 0x7f28740c5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 --2- 172.21.15.81:0/1039775739 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2860004d40 0x7f28740cb250 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 >> 172.21.15.81:0/1039775739 conn(0x7f28740b1690 msgr2=0x7f287415c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 shutdown_connections 2024-09-17T05:23:01.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.036+0000 7f287bc33640 1 -- 172.21.15.81:0/1039775739 wait complete. 2024-09-17T05:23:01.048 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T05:23:00.025899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254512,"kb_used_data":9128,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720208,"statfs":{"total":773094113280,"available":772833492992,"internally_reserved":0,"allocated":9347072,"data_stored":4635980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.941361"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223105+0000","last_change":"2024-09-17T05:22:57.085338+0000","last_active":"2024-09-17T05:22:58.223105+0000","last_peered":"2024-09-17T05:22:58.223105+0000","last_clean":"2024-09-17T05:22:58.223105+0000","last_became_active":"2024-09-17T05:22:57.085060+0000","last_became_peered":"2024-09-17T05:22:57.085060+0000","last_unstale":"2024-09-17T05:22:58.223105+0000","last_undegraded":"2024-09-17T05:22:58.223105+0000","last_fullsized":"2024-09-17T05:22:58.223105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:17.277113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102459+0000","last_change":"2024-09-17T05:22:57.094505+0000","last_active":"2024-09-17T05:22:58.102459+0000","last_peered":"2024-09-17T05:22:58.102459+0000","last_clean":"2024-09-17T05:22:58.102459+0000","last_became_active":"2024-09-17T05:22:57.094154+0000","last_became_peered":"2024-09-17T05:22:57.094154+0000","last_unstale":"2024-09-17T05:22:58.102459+0000","last_undegraded":"2024-09-17T05:22:58.102459+0000","last_fullsized":"2024-09-17T05:22:58.102459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:59.980730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074751+0000","last_change":"2024-09-17T05:22:57.094524+0000","last_active":"2024-09-17T05:22:58.074751+0000","last_peered":"2024-09-17T05:22:58.074751+0000","last_clean":"2024-09-17T05:22:58.074751+0000","last_became_active":"2024-09-17T05:22:57.094253+0000","last_became_peered":"2024-09-17T05:22:57.094253+0000","last_unstale":"2024-09-17T05:22:58.074751+0000","last_undegraded":"2024-09-17T05:22:58.074751+0000","last_fullsized":"2024-09-17T05:22:58.074751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:23.294619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221805+0000","last_change":"2024-09-17T05:22:57.090848+0000","last_active":"2024-09-17T05:22:58.221805+0000","last_peered":"2024-09-17T05:22:58.221805+0000","last_clean":"2024-09-17T05:22:58.221805+0000","last_became_active":"2024-09-17T05:22:57.090582+0000","last_became_peered":"2024-09-17T05:22:57.090582+0000","last_unstale":"2024-09-17T05:22:58.221805+0000","last_undegraded":"2024-09-17T05:22:58.221805+0000","last_fullsized":"2024-09-17T05:22:58.221805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:42.550928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074747+0000","last_change":"2024-09-17T05:22:57.092132+0000","last_active":"2024-09-17T05:22:58.074747+0000","last_peered":"2024-09-17T05:22:58.074747+0000","last_clean":"2024-09-17T05:22:58.074747+0000","last_became_active":"2024-09-17T05:22:57.091334+0000","last_became_peered":"2024-09-17T05:22:57.091334+0000","last_unstale":"2024-09-17T05:22:58.074747+0000","last_undegraded":"2024-09-17T05:22:58.074747+0000","last_fullsized":"2024-09-17T05:22:58.074747+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:54.574890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222639+0000","last_change":"2024-09-17T05:22:57.086975+0000","last_active":"2024-09-17T05:22:58.222639+0000","last_peered":"2024-09-17T05:22:58.222639+0000","last_clean":"2024-09-17T05:22:58.222639+0000","last_became_active":"2024-09-17T05:22:57.085923+0000","last_became_peered":"2024-09-17T05:22:57.085923+0000","last_unstale":"2024-09-17T05:22:58.222639+0000","last_undegraded":"2024-09-17T05:22:58.222639+0000","last_fullsized":"2024-09-17T05:22:58.222639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:14.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221707+0000","last_change":"2024-09-17T05:22:57.087396+0000","last_active":"2024-09-17T05:22:58.221707+0000","last_peered":"2024-09-17T05:22:58.221707+0000","last_clean":"2024-09-17T05:22:58.221707+0000","last_became_active":"2024-09-17T05:22:57.087047+0000","last_became_peered":"2024-09-17T05:22:57.087047+0000","last_unstale":"2024-09-17T05:22:58.221707+0000","last_undegraded":"2024-09-17T05:22:58.221707+0000","last_fullsized":"2024-09-17T05:22:58.221707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:39.832920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222564+0000","last_change":"2024-09-17T05:22:57.091657+0000","last_active":"2024-09-17T05:22:58.222564+0000","last_peered":"2024-09-17T05:22:58.222564+0000","last_clean":"2024-09-17T05:22:58.222564+0000","last_became_active":"2024-09-17T05:22:57.091336+0000","last_became_peered":"2024-09-17T05:22:57.091336+0000","last_unstale":"2024-09-17T05:22:58.222564+0000","last_undegraded":"2024-09-17T05:22:58.222564+0000","last_fullsized":"2024-09-17T05:22:58.222564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.725930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222651+0000","last_change":"2024-09-17T05:22:57.087411+0000","last_active":"2024-09-17T05:22:58.222651+0000","last_peered":"2024-09-17T05:22:58.222651+0000","last_clean":"2024-09-17T05:22:58.222651+0000","last_became_active":"2024-09-17T05:22:57.087115+0000","last_became_peered":"2024-09-17T05:22:57.087115+0000","last_unstale":"2024-09-17T05:22:58.222651+0000","last_undegraded":"2024-09-17T05:22:58.222651+0000","last_fullsized":"2024-09-17T05:22:58.222651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:06.202461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222898+0000","last_change":"2024-09-17T05:22:57.088921+0000","last_active":"2024-09-17T05:22:58.222898+0000","last_peered":"2024-09-17T05:22:58.222898+0000","last_clean":"2024-09-17T05:22:58.222898+0000","last_became_active":"2024-09-17T05:22:57.088459+0000","last_became_peered":"2024-09-17T05:22:57.088459+0000","last_unstale":"2024-09-17T05:22:58.222898+0000","last_undegraded":"2024-09-17T05:22:58.222898+0000","last_fullsized":"2024-09-17T05:22:58.222898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:48.840658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102582+0000","last_change":"2024-09-17T05:22:57.094683+0000","last_active":"2024-09-17T05:22:58.102582+0000","last_peered":"2024-09-17T05:22:58.102582+0000","last_clean":"2024-09-17T05:22:58.102582+0000","last_became_active":"2024-09-17T05:22:57.094256+0000","last_became_peered":"2024-09-17T05:22:57.094256+0000","last_unstale":"2024-09-17T05:22:58.102582+0000","last_undegraded":"2024-09-17T05:22:58.102582+0000","last_fullsized":"2024-09-17T05:22:58.102582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:42.002682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222335+0000","last_change":"2024-09-17T05:22:57.085818+0000","last_active":"2024-09-17T05:22:58.222335+0000","last_peered":"2024-09-17T05:22:58.222335+0000","last_clean":"2024-09-17T05:22:58.222335+0000","last_became_active":"2024-09-17T05:22:57.085448+0000","last_became_peered":"2024-09-17T05:22:57.085448+0000","last_unstale":"2024-09-17T05:22:58.222335+0000","last_undegraded":"2024-09-17T05:22:58.222335+0000","last_fullsized":"2024-09-17T05:22:58.222335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:04.589542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.073994+0000","last_change":"2024-09-17T05:22:57.088192+0000","last_active":"2024-09-17T05:22:58.073994+0000","last_peered":"2024-09-17T05:22:58.073994+0000","last_clean":"2024-09-17T05:22:58.073994+0000","last_became_active":"2024-09-17T05:22:57.087073+0000","last_became_peered":"2024-09-17T05:22:57.087073+0000","last_unstale":"2024-09-17T05:22:58.073994+0000","last_undegraded":"2024-09-17T05:22:58.073994+0000","last_fullsized":"2024-09-17T05:22:58.073994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.001016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221713+0000","last_change":"2024-09-17T05:22:57.089268+0000","last_active":"2024-09-17T05:22:58.221713+0000","last_peered":"2024-09-17T05:22:58.221713+0000","last_clean":"2024-09-17T05:22:58.221713+0000","last_became_active":"2024-09-17T05:22:57.088984+0000","last_became_peered":"2024-09-17T05:22:57.088984+0000","last_unstale":"2024-09-17T05:22:58.221713+0000","last_undegraded":"2024-09-17T05:22:58.221713+0000","last_fullsized":"2024-09-17T05:22:58.221713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:15.541495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074789+0000","last_change":"2024-09-17T05:22:57.086147+0000","last_active":"2024-09-17T05:22:58.074789+0000","last_peered":"2024-09-17T05:22:58.074789+0000","last_clean":"2024-09-17T05:22:58.074789+0000","last_became_active":"2024-09-17T05:22:57.085831+0000","last_became_peered":"2024-09-17T05:22:57.085831+0000","last_unstale":"2024-09-17T05:22:58.074789+0000","last_undegraded":"2024-09-17T05:22:58.074789+0000","last_fullsized":"2024-09-17T05:22:58.074789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:26.273000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074880+0000","last_change":"2024-09-17T05:22:57.091464+0000","last_active":"2024-09-17T05:22:58.074880+0000","last_peered":"2024-09-17T05:22:58.074880+0000","last_clean":"2024-09-17T05:22:58.074880+0000","last_became_active":"2024-09-17T05:22:57.091183+0000","last_became_peered":"2024-09-17T05:22:57.091183+0000","last_unstale":"2024-09-17T05:22:58.074880+0000","last_undegraded":"2024-09-17T05:22:58.074880+0000","last_fullsized":"2024-09-17T05:22:58.074880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:04.589542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075054+0000","last_change":"2024-09-17T05:22:57.080209+0000","last_active":"2024-09-17T05:22:58.075054+0000","last_peered":"2024-09-17T05:22:58.075054+0000","last_clean":"2024-09-17T05:22:58.075054+0000","last_became_active":"2024-09-17T05:22:57.079938+0000","last_became_peered":"2024-09-17T05:22:57.079938+0000","last_unstale":"2024-09-17T05:22:58.075054+0000","last_undegraded":"2024-09-17T05:22:58.075054+0000","last_fullsized":"2024-09-17T05:22:58.075054+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.725930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221946+0000","last_change":"2024-09-17T05:22:57.091722+0000","last_active":"2024-09-17T05:22:58.221946+0000","last_peered":"2024-09-17T05:22:58.221946+0000","last_clean":"2024-09-17T05:22:58.221946+0000","last_became_active":"2024-09-17T05:22:57.091435+0000","last_became_peered":"2024-09-17T05:22:57.091435+0000","last_unstale":"2024-09-17T05:22:58.221946+0000","last_undegraded":"2024-09-17T05:22:58.221946+0000","last_fullsized":"2024-09-17T05:22:58.221946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:08.503843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104432+0000","last_change":"2024-09-17T05:22:57.077537+0000","last_active":"2024-09-17T05:22:58.104432+0000","last_peered":"2024-09-17T05:22:58.104432+0000","last_clean":"2024-09-17T05:22:58.104432+0000","last_became_active":"2024-09-17T05:22:57.077252+0000","last_became_peered":"2024-09-17T05:22:57.077252+0000","last_unstale":"2024-09-17T05:22:58.104432+0000","last_undegraded":"2024-09-17T05:22:58.104432+0000","last_fullsized":"2024-09-17T05:22:58.104432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:46.422234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221940+0000","last_change":"2024-09-17T05:22:57.078926+0000","last_active":"2024-09-17T05:22:58.221940+0000","last_peered":"2024-09-17T05:22:58.221940+0000","last_clean":"2024-09-17T05:22:58.221940+0000","last_became_active":"2024-09-17T05:22:57.078301+0000","last_became_peered":"2024-09-17T05:22:57.078301+0000","last_unstale":"2024-09-17T05:22:58.221940+0000","last_undegraded":"2024-09-17T05:22:58.221940+0000","last_fullsized":"2024-09-17T05:22:58.221940+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:37.848893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221972+0000","last_change":"2024-09-17T05:22:57.080499+0000","last_active":"2024-09-17T05:22:58.221972+0000","last_peered":"2024-09-17T05:22:58.221972+0000","last_clean":"2024-09-17T05:22:58.221972+0000","last_became_active":"2024-09-17T05:22:57.080223+0000","last_became_peered":"2024-09-17T05:22:57.080223+0000","last_unstale":"2024-09-17T05:22:58.221972+0000","last_undegraded":"2024-09-17T05:22:58.221972+0000","last_fullsized":"2024-09-17T05:22:58.221972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:48.382310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102418+0000","last_change":"2024-09-17T05:22:57.089408+0000","last_active":"2024-09-17T05:22:58.102418+0000","last_peered":"2024-09-17T05:22:58.102418+0000","last_clean":"2024-09-17T05:22:58.102418+0000","last_became_active":"2024-09-17T05:22:57.088951+0000","last_became_peered":"2024-09-17T05:22:57.088951+0000","last_unstale":"2024-09-17T05:22:58.102418+0000","last_undegraded":"2024-09-17T05:22:58.102418+0000","last_fullsized":"2024-09-17T05:22:58.102418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:41.670826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222773+0000","last_change":"2024-09-17T05:22:57.088218+0000","last_active":"2024-09-17T05:22:58.222773+0000","last_peered":"2024-09-17T05:22:58.222773+0000","last_clean":"2024-09-17T05:22:58.222773+0000","last_became_active":"2024-09-17T05:22:57.087839+0000","last_became_peered":"2024-09-17T05:22:57.087839+0000","last_unstale":"2024-09-17T05:22:58.222773+0000","last_undegraded":"2024-09-17T05:22:58.222773+0000","last_fullsized":"2024-09-17T05:22:58.222773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.725930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221921+0000","last_change":"2024-09-17T05:22:57.080468+0000","last_active":"2024-09-17T05:22:58.221921+0000","last_peered":"2024-09-17T05:22:58.221921+0000","last_clean":"2024-09-17T05:22:58.221921+0000","last_became_active":"2024-09-17T05:22:57.080180+0000","last_became_peered":"2024-09-17T05:22:57.080180+0000","last_unstale":"2024-09-17T05:22:58.221921+0000","last_undegraded":"2024-09-17T05:22:58.221921+0000","last_fullsized":"2024-09-17T05:22:58.221921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:43.331128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102422+0000","last_change":"2024-09-17T05:22:57.094733+0000","last_active":"2024-09-17T05:22:58.102422+0000","last_peered":"2024-09-17T05:22:58.102422+0000","last_clean":"2024-09-17T05:22:58.102422+0000","last_became_active":"2024-09-17T05:22:57.094400+0000","last_became_peered":"2024-09-17T05:22:57.094400+0000","last_unstale":"2024-09-17T05:22:58.102422+0000","last_undegraded":"2024-09-17T05:22:58.102422+0000","last_fullsized":"2024-09-17T05:22:58.102422+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:22.885272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074261+0000","last_change":"2024-09-17T05:22:57.095047+0000","last_active":"2024-09-17T05:22:58.074261+0000","last_peered":"2024-09-17T05:22:58.074261+0000","last_clean":"2024-09-17T05:22:58.074261+0000","last_became_active":"2024-09-17T05:22:57.094763+0000","last_became_peered":"2024-09-17T05:22:57.094763+0000","last_unstale":"2024-09-17T05:22:58.074261+0000","last_undegraded":"2024-09-17T05:22:58.074261+0000","last_fullsized":"2024-09-17T05:22:58.074261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:22.483082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075094+0000","last_change":"2024-09-17T05:22:57.078025+0000","last_active":"2024-09-17T05:22:58.075094+0000","last_peered":"2024-09-17T05:22:58.075094+0000","last_clean":"2024-09-17T05:22:58.075094+0000","last_became_active":"2024-09-17T05:22:57.077727+0000","last_became_peered":"2024-09-17T05:22:57.077727+0000","last_unstale":"2024-09-17T05:22:58.075094+0000","last_undegraded":"2024-09-17T05:22:58.075094+0000","last_fullsized":"2024-09-17T05:22:58.075094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:14.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222577+0000","last_change":"2024-09-17T05:22:57.086837+0000","last_active":"2024-09-17T05:22:58.222577+0000","last_peered":"2024-09-17T05:22:58.222577+0000","last_clean":"2024-09-17T05:22:58.222577+0000","last_became_active":"2024-09-17T05:22:57.086290+0000","last_became_peered":"2024-09-17T05:22:57.086290+0000","last_unstale":"2024-09-17T05:22:58.222577+0000","last_undegraded":"2024-09-17T05:22:58.222577+0000","last_fullsized":"2024-09-17T05:22:58.222577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:06.202461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102554+0000","last_change":"2024-09-17T05:22:57.090279+0000","last_active":"2024-09-17T05:22:58.102554+0000","last_peered":"2024-09-17T05:22:58.102554+0000","last_clean":"2024-09-17T05:22:58.102554+0000","last_became_active":"2024-09-17T05:22:57.089886+0000","last_became_peered":"2024-09-17T05:22:57.089886+0000","last_unstale":"2024-09-17T05:22:58.102554+0000","last_undegraded":"2024-09-17T05:22:58.102554+0000","last_fullsized":"2024-09-17T05:22:58.102554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:58.588334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102614+0000","last_change":"2024-09-17T05:22:57.092465+0000","last_active":"2024-09-17T05:22:58.102614+0000","last_peered":"2024-09-17T05:22:58.102614+0000","last_clean":"2024-09-17T05:22:58.102614+0000","last_became_active":"2024-09-17T05:22:57.092136+0000","last_became_peered":"2024-09-17T05:22:57.092136+0000","last_unstale":"2024-09-17T05:22:58.102614+0000","last_undegraded":"2024-09-17T05:22:58.102614+0000","last_fullsized":"2024-09-17T05:22:58.102614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:14.001706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074766+0000","last_change":"2024-09-17T05:22:57.078211+0000","last_active":"2024-09-17T05:22:58.074766+0000","last_peered":"2024-09-17T05:22:58.074766+0000","last_clean":"2024-09-17T05:22:58.074766+0000","last_became_active":"2024-09-17T05:22:57.077925+0000","last_became_peered":"2024-09-17T05:22:57.077925+0000","last_unstale":"2024-09-17T05:22:58.074766+0000","last_undegraded":"2024-09-17T05:22:58.074766+0000","last_fullsized":"2024-09-17T05:22:58.074766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:55.067983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222261+0000","last_change":"2024-09-17T05:22:57.090564+0000","last_active":"2024-09-17T05:22:58.222261+0000","last_peered":"2024-09-17T05:22:58.222261+0000","last_clean":"2024-09-17T05:22:58.222261+0000","last_became_active":"2024-09-17T05:22:57.090297+0000","last_became_peered":"2024-09-17T05:22:57.090297+0000","last_unstale":"2024-09-17T05:22:58.222261+0000","last_undegraded":"2024-09-17T05:22:58.222261+0000","last_fullsized":"2024-09-17T05:22:58.222261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:55.067983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074888+0000","last_change":"2024-09-17T05:22:57.090126+0000","last_active":"2024-09-17T05:22:58.074888+0000","last_peered":"2024-09-17T05:22:58.074888+0000","last_clean":"2024-09-17T05:22:58.074888+0000","last_became_active":"2024-09-17T05:22:57.089847+0000","last_became_peered":"2024-09-17T05:22:57.089847+0000","last_unstale":"2024-09-17T05:22:58.074888+0000","last_undegraded":"2024-09-17T05:22:58.074888+0000","last_fullsized":"2024-09-17T05:22:58.074888+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:40.988908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223392+0000","last_change":"2024-09-17T05:22:56.105084+0000","last_active":"2024-09-17T05:22:58.223392+0000","last_peered":"2024-09-17T05:22:58.223392+0000","last_clean":"2024-09-17T05:22:58.223392+0000","last_became_active":"2024-09-17T05:22:56.104334+0000","last_became_peered":"2024-09-17T05:22:56.104334+0000","last_unstale":"2024-09-17T05:22:58.223392+0000","last_undegraded":"2024-09-17T05:22:58.223392+0000","last_fullsized":"2024-09-17T05:22:58.223392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:57.584571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223284+0000","last_change":"2024-09-17T05:22:57.092861+0000","last_active":"2024-09-17T05:22:58.223284+0000","last_peered":"2024-09-17T05:22:58.223284+0000","last_clean":"2024-09-17T05:22:58.223284+0000","last_became_active":"2024-09-17T05:22:57.092526+0000","last_became_peered":"2024-09-17T05:22:57.092526+0000","last_unstale":"2024-09-17T05:22:58.223284+0000","last_undegraded":"2024-09-17T05:22:58.223284+0000","last_fullsized":"2024-09-17T05:22:58.223284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:05.507457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075100+0000","last_change":"2024-09-17T05:22:56.103190+0000","last_active":"2024-09-17T05:22:58.075100+0000","last_peered":"2024-09-17T05:22:58.075100+0000","last_clean":"2024-09-17T05:22:58.075100+0000","last_became_active":"2024-09-17T05:22:56.102720+0000","last_became_peered":"2024-09-17T05:22:56.102720+0000","last_unstale":"2024-09-17T05:22:58.075100+0000","last_undegraded":"2024-09-17T05:22:58.075100+0000","last_fullsized":"2024-09-17T05:22:58.075100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:04.198968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222833+0000","last_change":"2024-09-17T05:22:57.091182+0000","last_active":"2024-09-17T05:22:58.222833+0000","last_peered":"2024-09-17T05:22:58.222833+0000","last_clean":"2024-09-17T05:22:58.222833+0000","last_became_active":"2024-09-17T05:22:57.090729+0000","last_became_peered":"2024-09-17T05:22:57.090729+0000","last_unstale":"2024-09-17T05:22:58.222833+0000","last_undegraded":"2024-09-17T05:22:58.222833+0000","last_fullsized":"2024-09-17T05:22:58.222833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:14.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104359+0000","last_change":"2024-09-17T05:22:56.096995+0000","last_active":"2024-09-17T05:22:58.104359+0000","last_peered":"2024-09-17T05:22:58.104359+0000","last_clean":"2024-09-17T05:22:58.104359+0000","last_became_active":"2024-09-17T05:22:56.096720+0000","last_became_peered":"2024-09-17T05:22:56.096720+0000","last_unstale":"2024-09-17T05:22:58.104359+0000","last_undegraded":"2024-09-17T05:22:58.104359+0000","last_fullsized":"2024-09-17T05:22:58.104359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.467131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074658+0000","last_change":"2024-09-17T05:22:57.094280+0000","last_active":"2024-09-17T05:22:58.074658+0000","last_peered":"2024-09-17T05:22:58.074658+0000","last_clean":"2024-09-17T05:22:58.074658+0000","last_became_active":"2024-09-17T05:22:57.093992+0000","last_became_peered":"2024-09-17T05:22:57.093992+0000","last_unstale":"2024-09-17T05:22:58.074658+0000","last_undegraded":"2024-09-17T05:22:58.074658+0000","last_fullsized":"2024-09-17T05:22:58.074658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:30.185473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104283+0000","last_change":"2024-09-17T05:22:56.097098+0000","last_active":"2024-09-17T05:22:58.104283+0000","last_peered":"2024-09-17T05:22:58.104283+0000","last_clean":"2024-09-17T05:22:58.104283+0000","last_became_active":"2024-09-17T05:22:56.096832+0000","last_became_peered":"2024-09-17T05:22:56.096832+0000","last_unstale":"2024-09-17T05:22:58.104283+0000","last_undegraded":"2024-09-17T05:22:58.104283+0000","last_fullsized":"2024-09-17T05:22:58.104283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:25.187182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102797+0000","last_change":"2024-09-17T05:22:57.096130+0000","last_active":"2024-09-17T05:22:58.102797+0000","last_peered":"2024-09-17T05:22:58.102797+0000","last_clean":"2024-09-17T05:22:58.102797+0000","last_became_active":"2024-09-17T05:22:57.095629+0000","last_became_peered":"2024-09-17T05:22:57.095629+0000","last_unstale":"2024-09-17T05:22:58.102797+0000","last_undegraded":"2024-09-17T05:22:58.102797+0000","last_fullsized":"2024-09-17T05:22:58.102797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:12.104046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075158+0000","last_change":"2024-09-17T05:22:56.105448+0000","last_active":"2024-09-17T05:22:58.075158+0000","last_peered":"2024-09-17T05:22:58.075158+0000","last_clean":"2024-09-17T05:22:58.075158+0000","last_became_active":"2024-09-17T05:22:56.105180+0000","last_became_peered":"2024-09-17T05:22:56.105180+0000","last_unstale":"2024-09-17T05:22:58.075158+0000","last_undegraded":"2024-09-17T05:22:58.075158+0000","last_fullsized":"2024-09-17T05:22:58.075158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:42.433812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075193+0000","last_change":"2024-09-17T05:22:57.084285+0000","last_active":"2024-09-17T05:22:58.075193+0000","last_peered":"2024-09-17T05:22:58.075193+0000","last_clean":"2024-09-17T05:22:58.075193+0000","last_became_active":"2024-09-17T05:22:57.083554+0000","last_became_peered":"2024-09-17T05:22:57.083554+0000","last_unstale":"2024-09-17T05:22:58.075193+0000","last_undegraded":"2024-09-17T05:22:58.075193+0000","last_fullsized":"2024-09-17T05:22:58.075193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:42.761225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074008+0000","last_change":"2024-09-17T05:22:56.100854+0000","last_active":"2024-09-17T05:22:58.074008+0000","last_peered":"2024-09-17T05:22:58.074008+0000","last_clean":"2024-09-17T05:22:58.074008+0000","last_became_active":"2024-09-17T05:22:56.100416+0000","last_became_peered":"2024-09-17T05:22:56.100416+0000","last_unstale":"2024-09-17T05:22:58.074008+0000","last_undegraded":"2024-09-17T05:22:58.074008+0000","last_fullsized":"2024-09-17T05:22:58.074008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:10.429911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.073872+0000","last_change":"2024-09-17T05:22:57.090086+0000","last_active":"2024-09-17T05:22:58.073872+0000","last_peered":"2024-09-17T05:22:58.073872+0000","last_clean":"2024-09-17T05:22:58.073872+0000","last_became_active":"2024-09-17T05:22:57.089793+0000","last_became_peered":"2024-09-17T05:22:57.089793+0000","last_unstale":"2024-09-17T05:22:58.073872+0000","last_undegraded":"2024-09-17T05:22:58.073872+0000","last_fullsized":"2024-09-17T05:22:58.073872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:17.277113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104139+0000","last_change":"2024-09-17T05:22:56.103354+0000","last_active":"2024-09-17T05:22:58.104139+0000","last_peered":"2024-09-17T05:22:58.104139+0000","last_clean":"2024-09-17T05:22:58.104139+0000","last_became_active":"2024-09-17T05:22:56.103098+0000","last_became_peered":"2024-09-17T05:22:56.103098+0000","last_unstale":"2024-09-17T05:22:58.104139+0000","last_undegraded":"2024-09-17T05:22:58.104139+0000","last_fullsized":"2024-09-17T05:22:58.104139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:48.686589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074821+0000","last_change":"2024-09-17T05:22:57.085988+0000","last_active":"2024-09-17T05:22:58.074821+0000","last_peered":"2024-09-17T05:22:58.074821+0000","last_clean":"2024-09-17T05:22:58.074821+0000","last_became_active":"2024-09-17T05:22:57.085702+0000","last_became_peered":"2024-09-17T05:22:57.085702+0000","last_unstale":"2024-09-17T05:22:58.074821+0000","last_undegraded":"2024-09-17T05:22:58.074821+0000","last_fullsized":"2024-09-17T05:22:58.074821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:37.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102314+0000","last_change":"2024-09-17T05:22:56.099870+0000","last_active":"2024-09-17T05:22:58.102314+0000","last_peered":"2024-09-17T05:22:58.102314+0000","last_clean":"2024-09-17T05:22:58.102314+0000","last_became_active":"2024-09-17T05:22:56.099534+0000","last_became_peered":"2024-09-17T05:22:56.099534+0000","last_unstale":"2024-09-17T05:22:58.102314+0000","last_undegraded":"2024-09-17T05:22:58.102314+0000","last_fullsized":"2024-09-17T05:22:58.102314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:11.260417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075043+0000","last_change":"2024-09-17T05:22:57.088586+0000","last_active":"2024-09-17T05:22:58.075043+0000","last_peered":"2024-09-17T05:22:58.075043+0000","last_clean":"2024-09-17T05:22:58.075043+0000","last_became_active":"2024-09-17T05:22:57.088294+0000","last_became_peered":"2024-09-17T05:22:57.088294+0000","last_unstale":"2024-09-17T05:22:58.075043+0000","last_undegraded":"2024-09-17T05:22:58.075043+0000","last_fullsized":"2024-09-17T05:22:58.075043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:02.837914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223416+0000","last_change":"2024-09-17T05:22:56.107410+0000","last_active":"2024-09-17T05:22:58.223416+0000","last_peered":"2024-09-17T05:22:58.223416+0000","last_clean":"2024-09-17T05:22:58.223416+0000","last_became_active":"2024-09-17T05:22:56.107187+0000","last_became_peered":"2024-09-17T05:22:56.107187+0000","last_unstale":"2024-09-17T05:22:58.223416+0000","last_undegraded":"2024-09-17T05:22:58.223416+0000","last_fullsized":"2024-09-17T05:22:58.223416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.998919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222776+0000","last_change":"2024-09-17T05:22:57.092416+0000","last_active":"2024-09-17T05:22:58.222776+0000","last_peered":"2024-09-17T05:22:58.222776+0000","last_clean":"2024-09-17T05:22:58.222776+0000","last_became_active":"2024-09-17T05:22:57.092157+0000","last_became_peered":"2024-09-17T05:22:57.092157+0000","last_unstale":"2024-09-17T05:22:58.222776+0000","last_undegraded":"2024-09-17T05:22:58.222776+0000","last_fullsized":"2024-09-17T05:22:58.222776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:48.840658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223005+0000","last_change":"2024-09-17T05:22:56.104357+0000","last_active":"2024-09-17T05:22:58.223005+0000","last_peered":"2024-09-17T05:22:58.223005+0000","last_clean":"2024-09-17T05:22:58.223005+0000","last_became_active":"2024-09-17T05:22:56.104082+0000","last_became_peered":"2024-09-17T05:22:56.104082+0000","last_unstale":"2024-09-17T05:22:58.223005+0000","last_undegraded":"2024-09-17T05:22:58.223005+0000","last_fullsized":"2024-09-17T05:22:58.223005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:58.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104360+0000","last_change":"2024-09-17T05:22:57.088018+0000","last_active":"2024-09-17T05:22:58.104360+0000","last_peered":"2024-09-17T05:22:58.104360+0000","last_clean":"2024-09-17T05:22:58.104360+0000","last_became_active":"2024-09-17T05:22:57.087736+0000","last_became_peered":"2024-09-17T05:22:57.087736+0000","last_unstale":"2024-09-17T05:22:58.104360+0000","last_undegraded":"2024-09-17T05:22:58.104360+0000","last_fullsized":"2024-09-17T05:22:58.104360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.478356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222597+0000","last_change":"2024-09-17T05:22:56.105725+0000","last_active":"2024-09-17T05:22:58.222597+0000","last_peered":"2024-09-17T05:22:58.222597+0000","last_clean":"2024-09-17T05:22:58.222597+0000","last_became_active":"2024-09-17T05:22:56.105454+0000","last_became_peered":"2024-09-17T05:22:56.105454+0000","last_unstale":"2024-09-17T05:22:58.222597+0000","last_undegraded":"2024-09-17T05:22:58.222597+0000","last_fullsized":"2024-09-17T05:22:58.222597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.551807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075294+0000","last_change":"2024-09-17T05:22:57.085120+0000","last_active":"2024-09-17T05:22:58.075294+0000","last_peered":"2024-09-17T05:22:58.075294+0000","last_clean":"2024-09-17T05:22:58.075294+0000","last_became_active":"2024-09-17T05:22:57.084826+0000","last_became_peered":"2024-09-17T05:22:57.084826+0000","last_unstale":"2024-09-17T05:22:58.075294+0000","last_undegraded":"2024-09-17T05:22:58.075294+0000","last_fullsized":"2024-09-17T05:22:58.075294+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:17.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"82'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222424+0000","last_change":"2024-09-17T05:22:56.098957+0000","last_active":"2024-09-17T05:22:58.222424+0000","last_peered":"2024-09-17T05:22:58.222424+0000","last_clean":"2024-09-17T05:22:58.222424+0000","last_became_active":"2024-09-17T05:22:56.098659+0000","last_became_peered":"2024-09-17T05:22:56.098659+0000","last_unstale":"2024-09-17T05:22:58.222424+0000","last_undegraded":"2024-09-17T05:22:58.222424+0000","last_fullsized":"2024-09-17T05:22:58.222424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:03.090979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104193+0000","last_change":"2024-09-17T05:22:57.077890+0000","last_active":"2024-09-17T05:22:58.104193+0000","last_peered":"2024-09-17T05:22:58.104193+0000","last_clean":"2024-09-17T05:22:58.104193+0000","last_became_active":"2024-09-17T05:22:57.077555+0000","last_became_peered":"2024-09-17T05:22:57.077555+0000","last_unstale":"2024-09-17T05:22:58.104193+0000","last_undegraded":"2024-09-17T05:22:58.104193+0000","last_fullsized":"2024-09-17T05:22:58.104193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:58.321062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102522+0000","last_change":"2024-09-17T05:22:56.097665+0000","last_active":"2024-09-17T05:22:58.102522+0000","last_peered":"2024-09-17T05:22:58.102522+0000","last_clean":"2024-09-17T05:22:58.102522+0000","last_became_active":"2024-09-17T05:22:56.097427+0000","last_became_peered":"2024-09-17T05:22:56.097427+0000","last_unstale":"2024-09-17T05:22:58.102522+0000","last_undegraded":"2024-09-17T05:22:58.102522+0000","last_fullsized":"2024-09-17T05:22:58.102522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:48.407696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074215+0000","last_change":"2024-09-17T05:22:57.089210+0000","last_active":"2024-09-17T05:22:58.074215+0000","last_peered":"2024-09-17T05:22:58.074215+0000","last_clean":"2024-09-17T05:22:58.074215+0000","last_became_active":"2024-09-17T05:22:57.088904+0000","last_became_peered":"2024-09-17T05:22:57.088904+0000","last_unstale":"2024-09-17T05:22:58.074215+0000","last_undegraded":"2024-09-17T05:22:58.074215+0000","last_fullsized":"2024-09-17T05:22:58.074215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:03.732906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074782+0000","last_change":"2024-09-17T05:22:56.101489+0000","last_active":"2024-09-17T05:22:58.074782+0000","last_peered":"2024-09-17T05:22:58.074782+0000","last_clean":"2024-09-17T05:22:58.074782+0000","last_became_active":"2024-09-17T05:22:56.101232+0000","last_became_peered":"2024-09-17T05:22:56.101232+0000","last_unstale":"2024-09-17T05:22:58.074782+0000","last_undegraded":"2024-09-17T05:22:58.074782+0000","last_fullsized":"2024-09-17T05:22:58.074782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:29.181710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102299+0000","last_change":"2024-09-17T05:22:57.088346+0000","last_active":"2024-09-17T05:22:58.102299+0000","last_peered":"2024-09-17T05:22:58.102299+0000","last_clean":"2024-09-17T05:22:58.102299+0000","last_became_active":"2024-09-17T05:22:57.088047+0000","last_became_peered":"2024-09-17T05:22:57.088047+0000","last_unstale":"2024-09-17T05:22:58.102299+0000","last_undegraded":"2024-09-17T05:22:58.102299+0000","last_fullsized":"2024-09-17T05:22:58.102299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:29.555570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222321+0000","last_change":"2024-09-17T05:22:56.098939+0000","last_active":"2024-09-17T05:22:58.222321+0000","last_peered":"2024-09-17T05:22:58.222321+0000","last_clean":"2024-09-17T05:22:58.222321+0000","last_became_active":"2024-09-17T05:22:56.098634+0000","last_became_peered":"2024-09-17T05:22:56.098634+0000","last_unstale":"2024-09-17T05:22:58.222321+0000","last_undegraded":"2024-09-17T05:22:58.222321+0000","last_fullsized":"2024-09-17T05:22:58.222321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:43.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102217+0000","last_change":"2024-09-17T05:22:57.087286+0000","last_active":"2024-09-17T05:22:58.102217+0000","last_peered":"2024-09-17T05:22:58.102217+0000","last_clean":"2024-09-17T05:22:58.102217+0000","last_became_active":"2024-09-17T05:22:57.086944+0000","last_became_peered":"2024-09-17T05:22:57.086944+0000","last_unstale":"2024-09-17T05:22:58.102217+0000","last_undegraded":"2024-09-17T05:22:58.102217+0000","last_fullsized":"2024-09-17T05:22:58.102217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:55.356091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"82'8","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104029+0000","last_change":"2024-09-17T05:22:56.103763+0000","last_active":"2024-09-17T05:22:58.104029+0000","last_peered":"2024-09-17T05:22:58.104029+0000","last_clean":"2024-09-17T05:22:58.104029+0000","last_became_active":"2024-09-17T05:22:56.103483+0000","last_became_peered":"2024-09-17T05:22:56.103483+0000","last_unstale":"2024-09-17T05:22:58.104029+0000","last_undegraded":"2024-09-17T05:22:58.104029+0000","last_fullsized":"2024-09-17T05:22:58.104029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:59.384436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074487+0000","last_change":"2024-09-17T05:22:57.091153+0000","last_active":"2024-09-17T05:22:58.074487+0000","last_peered":"2024-09-17T05:22:58.074487+0000","last_clean":"2024-09-17T05:22:58.074487+0000","last_became_active":"2024-09-17T05:22:57.090885+0000","last_became_peered":"2024-09-17T05:22:57.090885+0000","last_unstale":"2024-09-17T05:22:58.074487+0000","last_undegraded":"2024-09-17T05:22:58.074487+0000","last_fullsized":"2024-09-17T05:22:58.074487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:06.067666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223509+0000","last_change":"2024-09-17T05:22:56.103951+0000","last_active":"2024-09-17T05:22:58.223509+0000","last_peered":"2024-09-17T05:22:58.223509+0000","last_clean":"2024-09-17T05:22:58.223509+0000","last_became_active":"2024-09-17T05:22:56.103651+0000","last_became_peered":"2024-09-17T05:22:56.103651+0000","last_unstale":"2024-09-17T05:22:58.223509+0000","last_undegraded":"2024-09-17T05:22:58.223509+0000","last_fullsized":"2024-09-17T05:22:58.223509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:12.997943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223327+0000","last_change":"2024-09-17T05:22:57.086582+0000","last_active":"2024-09-17T05:22:58.223327+0000","last_peered":"2024-09-17T05:22:58.223327+0000","last_clean":"2024-09-17T05:22:58.223327+0000","last_became_active":"2024-09-17T05:22:57.085729+0000","last_became_peered":"2024-09-17T05:22:57.085729+0000","last_unstale":"2024-09-17T05:22:58.223327+0000","last_undegraded":"2024-09-17T05:22:58.223327+0000","last_fullsized":"2024-09-17T05:22:58.223327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:44.108164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104377+0000","last_change":"2024-09-17T05:22:56.103024+0000","last_active":"2024-09-17T05:22:58.104377+0000","last_peered":"2024-09-17T05:22:58.104377+0000","last_clean":"2024-09-17T05:22:58.104377+0000","last_became_active":"2024-09-17T05:22:56.102772+0000","last_became_peered":"2024-09-17T05:22:56.102772+0000","last_unstale":"2024-09-17T05:22:58.104377+0000","last_undegraded":"2024-09-17T05:22:58.104377+0000","last_fullsized":"2024-09-17T05:22:58.104377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:26.340735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075314+0000","last_change":"2024-09-17T05:22:57.093458+0000","last_active":"2024-09-17T05:22:58.075314+0000","last_peered":"2024-09-17T05:22:58.075314+0000","last_clean":"2024-09-17T05:22:58.075314+0000","last_became_active":"2024-09-17T05:22:57.092768+0000","last_became_peered":"2024-09-17T05:22:57.092768+0000","last_unstale":"2024-09-17T05:22:58.075314+0000","last_undegraded":"2024-09-17T05:22:58.075314+0000","last_fullsized":"2024-09-17T05:22:58.075314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.568249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104411+0000","last_change":"2024-09-17T05:22:56.102351+0000","last_active":"2024-09-17T05:22:58.104411+0000","last_peered":"2024-09-17T05:22:58.104411+0000","last_clean":"2024-09-17T05:22:58.104411+0000","last_became_active":"2024-09-17T05:22:56.101726+0000","last_became_peered":"2024-09-17T05:22:56.101726+0000","last_unstale":"2024-09-17T05:22:58.104411+0000","last_undegraded":"2024-09-17T05:22:58.104411+0000","last_fullsized":"2024-09-17T05:22:58.104411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:59.955575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221742+0000","last_change":"2024-09-17T05:22:57.088801+0000","last_active":"2024-09-17T05:22:58.221742+0000","last_peered":"2024-09-17T05:22:58.221742+0000","last_clean":"2024-09-17T05:22:58.221742+0000","last_became_active":"2024-09-17T05:22:57.088291+0000","last_became_peered":"2024-09-17T05:22:57.088291+0000","last_unstale":"2024-09-17T05:22:58.221742+0000","last_undegraded":"2024-09-17T05:22:58.221742+0000","last_fullsized":"2024-09-17T05:22:58.221742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:33.215396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074795+0000","last_change":"2024-09-17T05:22:56.099881+0000","last_active":"2024-09-17T05:22:58.074795+0000","last_peered":"2024-09-17T05:22:58.074795+0000","last_clean":"2024-09-17T05:22:58.074795+0000","last_became_active":"2024-09-17T05:22:56.099606+0000","last_became_peered":"2024-09-17T05:22:56.099606+0000","last_unstale":"2024-09-17T05:22:58.074795+0000","last_undegraded":"2024-09-17T05:22:58.074795+0000","last_fullsized":"2024-09-17T05:22:58.074795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:40.656528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222276+0000","last_change":"2024-09-17T05:22:57.088049+0000","last_active":"2024-09-17T05:22:58.222276+0000","last_peered":"2024-09-17T05:22:58.222276+0000","last_clean":"2024-09-17T05:22:58.222276+0000","last_became_active":"2024-09-17T05:22:57.087530+0000","last_became_peered":"2024-09-17T05:22:57.087530+0000","last_unstale":"2024-09-17T05:22:58.222276+0000","last_undegraded":"2024-09-17T05:22:58.222276+0000","last_fullsized":"2024-09-17T05:22:58.222276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:04.589542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221817+0000","last_change":"2024-09-17T05:22:56.097651+0000","last_active":"2024-09-17T05:22:58.221817+0000","last_peered":"2024-09-17T05:22:58.221817+0000","last_clean":"2024-09-17T05:22:58.221817+0000","last_became_active":"2024-09-17T05:22:56.097227+0000","last_became_peered":"2024-09-17T05:22:56.097227+0000","last_unstale":"2024-09-17T05:22:58.221817+0000","last_undegraded":"2024-09-17T05:22:58.221817+0000","last_fullsized":"2024-09-17T05:22:58.221817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:22.314210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221614+0000","last_change":"2024-09-17T05:22:57.083794+0000","last_active":"2024-09-17T05:22:58.221614+0000","last_peered":"2024-09-17T05:22:58.221614+0000","last_clean":"2024-09-17T05:22:58.221614+0000","last_became_active":"2024-09-17T05:22:57.083473+0000","last_became_peered":"2024-09-17T05:22:57.083473+0000","last_unstale":"2024-09-17T05:22:58.221614+0000","last_undegraded":"2024-09-17T05:22:58.221614+0000","last_fullsized":"2024-09-17T05:22:58.221614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:13.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221663+0000","last_change":"2024-09-17T05:22:56.105756+0000","last_active":"2024-09-17T05:22:58.221663+0000","last_peered":"2024-09-17T05:22:58.221663+0000","last_clean":"2024-09-17T05:22:58.221663+0000","last_became_active":"2024-09-17T05:22:56.105445+0000","last_became_peered":"2024-09-17T05:22:56.105445+0000","last_unstale":"2024-09-17T05:22:58.221663+0000","last_undegraded":"2024-09-17T05:22:58.221663+0000","last_fullsized":"2024-09-17T05:22:58.221663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:31.096431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222194+0000","last_change":"2024-09-17T05:22:57.093332+0000","last_active":"2024-09-17T05:22:58.222194+0000","last_peered":"2024-09-17T05:22:58.222194+0000","last_clean":"2024-09-17T05:22:58.222194+0000","last_became_active":"2024-09-17T05:22:57.093075+0000","last_became_peered":"2024-09-17T05:22:57.093075+0000","last_unstale":"2024-09-17T05:22:58.222194+0000","last_undegraded":"2024-09-17T05:22:58.222194+0000","last_fullsized":"2024-09-17T05:22:58.222194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:55.067983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074629+0000","last_change":"2024-09-17T05:22:56.100691+0000","last_active":"2024-09-17T05:22:58.074629+0000","last_peered":"2024-09-17T05:22:58.074629+0000","last_clean":"2024-09-17T05:22:58.074629+0000","last_became_active":"2024-09-17T05:22:56.100448+0000","last_became_peered":"2024-09-17T05:22:56.100448+0000","last_unstale":"2024-09-17T05:22:58.074629+0000","last_undegraded":"2024-09-17T05:22:58.074629+0000","last_fullsized":"2024-09-17T05:22:58.074629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:05.063904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075102+0000","last_change":"2024-09-17T05:22:57.090556+0000","last_active":"2024-09-17T05:22:58.075102+0000","last_peered":"2024-09-17T05:22:58.075102+0000","last_clean":"2024-09-17T05:22:58.075102+0000","last_became_active":"2024-09-17T05:22:57.090019+0000","last_became_peered":"2024-09-17T05:22:57.090019+0000","last_unstale":"2024-09-17T05:22:58.075102+0000","last_undegraded":"2024-09-17T05:22:58.075102+0000","last_fullsized":"2024-09-17T05:22:58.075102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:34.748220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102482+0000","last_change":"2024-09-17T05:22:56.102945+0000","last_active":"2024-09-17T05:22:58.102482+0000","last_peered":"2024-09-17T05:22:58.102482+0000","last_clean":"2024-09-17T05:22:58.102482+0000","last_became_active":"2024-09-17T05:22:56.102646+0000","last_became_peered":"2024-09-17T05:22:56.102646+0000","last_unstale":"2024-09-17T05:22:58.102482+0000","last_undegraded":"2024-09-17T05:22:58.102482+0000","last_fullsized":"2024-09-17T05:22:58.102482+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:24.840842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074354+0000","last_change":"2024-09-17T05:22:57.088816+0000","last_active":"2024-09-17T05:22:58.074354+0000","last_peered":"2024-09-17T05:22:58.074354+0000","last_clean":"2024-09-17T05:22:58.074354+0000","last_became_active":"2024-09-17T05:22:57.088542+0000","last_became_peered":"2024-09-17T05:22:57.088542+0000","last_unstale":"2024-09-17T05:22:58.074354+0000","last_undegraded":"2024-09-17T05:22:58.074354+0000","last_fullsized":"2024-09-17T05:22:58.074354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:41.660291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"83'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.103558+0000","last_change":"2024-09-17T05:22:56.100322+0000","last_active":"2024-09-17T05:22:58.103558+0000","last_peered":"2024-09-17T05:22:58.103558+0000","last_clean":"2024-09-17T05:22:58.103558+0000","last_became_active":"2024-09-17T05:22:56.099438+0000","last_became_peered":"2024-09-17T05:22:56.099438+0000","last_unstale":"2024-09-17T05:22:58.103558+0000","last_undegraded":"2024-09-17T05:22:58.103558+0000","last_fullsized":"2024-09-17T05:22:58.103558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:09.827663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223186+0000","last_change":"2024-09-17T05:22:57.083199+0000","last_active":"2024-09-17T05:22:58.223186+0000","last_peered":"2024-09-17T05:22:58.223186+0000","last_clean":"2024-09-17T05:22:58.223186+0000","last_became_active":"2024-09-17T05:22:57.082939+0000","last_became_peered":"2024-09-17T05:22:57.082939+0000","last_unstale":"2024-09-17T05:22:58.223186+0000","last_undegraded":"2024-09-17T05:22:58.223186+0000","last_fullsized":"2024-09-17T05:22:58.223186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.568249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222780+0000","last_change":"2024-09-17T05:22:56.105466+0000","last_active":"2024-09-17T05:22:58.222780+0000","last_peered":"2024-09-17T05:22:58.222780+0000","last_clean":"2024-09-17T05:22:58.222780+0000","last_became_active":"2024-09-17T05:22:56.105192+0000","last_became_peered":"2024-09-17T05:22:56.105192+0000","last_unstale":"2024-09-17T05:22:58.222780+0000","last_undegraded":"2024-09-17T05:22:58.222780+0000","last_fullsized":"2024-09-17T05:22:58.222780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:40.667063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075456+0000","last_change":"2024-09-17T05:22:57.078264+0000","last_active":"2024-09-17T05:22:58.075456+0000","last_peered":"2024-09-17T05:22:58.075456+0000","last_clean":"2024-09-17T05:22:58.075456+0000","last_became_active":"2024-09-17T05:22:57.077976+0000","last_became_peered":"2024-09-17T05:22:57.077976+0000","last_unstale":"2024-09-17T05:22:58.075456+0000","last_undegraded":"2024-09-17T05:22:58.075456+0000","last_fullsized":"2024-09-17T05:22:58.075456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:05.507457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223046+0000","last_change":"2024-09-17T05:22:56.105840+0000","last_active":"2024-09-17T05:22:58.223046+0000","last_peered":"2024-09-17T05:22:58.223046+0000","last_clean":"2024-09-17T05:22:58.223046+0000","last_became_active":"2024-09-17T05:22:56.105560+0000","last_became_peered":"2024-09-17T05:22:56.105560+0000","last_unstale":"2024-09-17T05:22:58.223046+0000","last_undegraded":"2024-09-17T05:22:58.223046+0000","last_fullsized":"2024-09-17T05:22:58.223046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:47.947025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222868+0000","last_change":"2024-09-17T05:22:57.087376+0000","last_active":"2024-09-17T05:22:58.222868+0000","last_peered":"2024-09-17T05:22:58.222868+0000","last_clean":"2024-09-17T05:22:58.222868+0000","last_became_active":"2024-09-17T05:22:57.086552+0000","last_became_peered":"2024-09-17T05:22:57.086552+0000","last_unstale":"2024-09-17T05:22:58.222868+0000","last_undegraded":"2024-09-17T05:22:58.222868+0000","last_fullsized":"2024-09-17T05:22:58.222868+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:42.761225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104322+0000","last_change":"2024-09-17T05:22:56.102246+0000","last_active":"2024-09-17T05:22:58.104322+0000","last_peered":"2024-09-17T05:22:58.104322+0000","last_clean":"2024-09-17T05:22:58.104322+0000","last_became_active":"2024-09-17T05:22:56.101974+0000","last_became_peered":"2024-09-17T05:22:56.101974+0000","last_unstale":"2024-09-17T05:22:58.104322+0000","last_undegraded":"2024-09-17T05:22:58.104322+0000","last_fullsized":"2024-09-17T05:22:58.104322+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:17.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104367+0000","last_change":"2024-09-17T05:22:57.081269+0000","last_active":"2024-09-17T05:22:58.104367+0000","last_peered":"2024-09-17T05:22:58.104367+0000","last_clean":"2024-09-17T05:22:58.104367+0000","last_became_active":"2024-09-17T05:22:57.079778+0000","last_became_peered":"2024-09-17T05:22:57.079778+0000","last_unstale":"2024-09-17T05:22:58.104367+0000","last_undegraded":"2024-09-17T05:22:58.104367+0000","last_fullsized":"2024-09-17T05:22:58.104367+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:16.819706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074650+0000","last_change":"2024-09-17T05:22:56.099633+0000","last_active":"2024-09-17T05:22:58.074650+0000","last_peered":"2024-09-17T05:22:58.074650+0000","last_clean":"2024-09-17T05:22:58.074650+0000","last_became_active":"2024-09-17T05:22:56.099369+0000","last_became_peered":"2024-09-17T05:22:56.099369+0000","last_unstale":"2024-09-17T05:22:58.074650+0000","last_undegraded":"2024-09-17T05:22:58.074650+0000","last_fullsized":"2024-09-17T05:22:58.074650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:42.498047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074145+0000","last_change":"2024-09-17T05:22:57.094919+0000","last_active":"2024-09-17T05:22:58.074145+0000","last_peered":"2024-09-17T05:22:58.074145+0000","last_clean":"2024-09-17T05:22:58.074145+0000","last_became_active":"2024-09-17T05:22:57.094637+0000","last_became_peered":"2024-09-17T05:22:57.094637+0000","last_unstale":"2024-09-17T05:22:58.074145+0000","last_undegraded":"2024-09-17T05:22:58.074145+0000","last_fullsized":"2024-09-17T05:22:58.074145+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:32.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223021+0000","last_change":"2024-09-17T05:22:56.103275+0000","last_active":"2024-09-17T05:22:58.223021+0000","last_peered":"2024-09-17T05:22:58.223021+0000","last_clean":"2024-09-17T05:22:58.223021+0000","last_became_active":"2024-09-17T05:22:56.102923+0000","last_became_peered":"2024-09-17T05:22:56.102923+0000","last_unstale":"2024-09-17T05:22:58.223021+0000","last_undegraded":"2024-09-17T05:22:58.223021+0000","last_fullsized":"2024-09-17T05:22:58.223021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:27.748358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223093+0000","last_change":"2024-09-17T05:22:57.081355+0000","last_active":"2024-09-17T05:22:58.223093+0000","last_peered":"2024-09-17T05:22:58.223093+0000","last_clean":"2024-09-17T05:22:58.223093+0000","last_became_active":"2024-09-17T05:22:57.081055+0000","last_became_peered":"2024-09-17T05:22:57.081055+0000","last_unstale":"2024-09-17T05:22:58.223093+0000","last_undegraded":"2024-09-17T05:22:58.223093+0000","last_fullsized":"2024-09-17T05:22:58.223093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:42.761225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074977+0000","last_change":"2024-09-17T05:22:56.105909+0000","last_active":"2024-09-17T05:22:58.074977+0000","last_peered":"2024-09-17T05:22:58.074977+0000","last_clean":"2024-09-17T05:22:58.074977+0000","last_became_active":"2024-09-17T05:22:56.105535+0000","last_became_peered":"2024-09-17T05:22:56.105535+0000","last_unstale":"2024-09-17T05:22:58.074977+0000","last_undegraded":"2024-09-17T05:22:58.074977+0000","last_fullsized":"2024-09-17T05:22:58.074977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:21.881509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102732+0000","last_change":"2024-09-17T05:22:57.094581+0000","last_active":"2024-09-17T05:22:58.102732+0000","last_peered":"2024-09-17T05:22:58.102732+0000","last_clean":"2024-09-17T05:22:58.102732+0000","last_became_active":"2024-09-17T05:22:57.094280+0000","last_became_peered":"2024-09-17T05:22:57.094280+0000","last_unstale":"2024-09-17T05:22:58.102732+0000","last_undegraded":"2024-09-17T05:22:58.102732+0000","last_fullsized":"2024-09-17T05:22:58.102732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:48.950788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074779+0000","last_change":"2024-09-17T05:22:56.105466+0000","last_active":"2024-09-17T05:22:58.074779+0000","last_peered":"2024-09-17T05:22:58.074779+0000","last_clean":"2024-09-17T05:22:58.074779+0000","last_became_active":"2024-09-17T05:22:56.105197+0000","last_became_peered":"2024-09-17T05:22:56.105197+0000","last_unstale":"2024-09-17T05:22:58.074779+0000","last_undegraded":"2024-09-17T05:22:58.074779+0000","last_fullsized":"2024-09-17T05:22:58.074779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:52.630100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":243,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074007+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:22:58.074007+0000","last_peered":"2024-09-17T05:22:58.074007+0000","last_clean":"2024-09-17T05:22:58.074007+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:22:58.074007+0000","last_undegraded":"2024-09-17T05:22:58.074007+0000","last_fullsized":"2024-09-17T05:22:58.074007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28604,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343236,"statfs":{"total":96636764160,"available":96607473664,"internally_reserved":0,"allocated":1609728,"data_stored":1021741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1024000,"data_stored":431997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1028096,"data_stored":432937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1011712,"data_stored":431303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1024000,"data_stored":432915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1015808,"data_stored":431885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1024000,"data_stored":431497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":1021705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:01.052 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:01.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 -- 172.21.15.81:0/573361800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e415df90 msgr2=0x7fa8e40cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/573361800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e415df90 0x7fa8e40cf9b0 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7fa8e40d1c90 tx=0x7fa8d402aac0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 -- 172.21.15.81:0/573361800 shutdown_connections 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/573361800 >> v2:172.21.15.160:3300/0 conn(0x7fa8e40d49c0 0x7fa8e40d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/573361800 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e415df90 0x7fa8e40cf9b0 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 -- 172.21.15.81:0/573361800 >> 172.21.15.81:0/573361800 conn(0x7fa8e40d3ea0 msgr2=0x7fa8e40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 -- 172.21.15.81:0/573361800 shutdown_connections 2024-09-17T05:23:01.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.187+0000 7fa8e8f84640 1 -- 172.21.15.81:0/573361800 wait complete. 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 Processor -- start 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 -- start start 2024-09-17T05:23:01.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e40d49c0 0x7fa8e40cb0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8e415df90 0x7fa8e40b46b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8e4162480 0x7fa8e40b4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e40d0f00 con 0x7fa8e40d49c0 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa8e40d0d80 con 0x7fa8e415df90 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e8f84640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa8e40b3f10 con 0x7fa8e4162480 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e40d49c0 0x7fa8e40cb0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e40d49c0 0x7fa8e40cb0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52140/0 (socket says 172.21.15.81:52140) 2024-09-17T05:23:01.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.189+0000 7fa8e259c640 1 -- 172.21.15.81:0/2816780562 learned_addr learned my addr 172.21.15.81:0/2816780562 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e1d9b640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8e415df90 0x7fa8e40b46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e2d9d640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8e4162480 0x7fa8e40b4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e259c640 1 -- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8e4162480 msgr2=0x7fa8e40b4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e259c640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8e4162480 0x7fa8e40b4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e259c640 1 -- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8e415df90 msgr2=0x7fa8e40b46b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e259c640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8e415df90 0x7fa8e40b46b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e259c640 1 -- 172.21.15.81:0/2816780562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8e414ddc0 con 0x7fa8e40d49c0 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e2d9d640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8e4162480 0x7fa8e40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e259c640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e40d49c0 0x7fa8e40cb0d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009bf0 tx=0x7fa8d4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8daffd640 1 -- 172.21.15.81:0/2816780562 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4044070 con 0x7fa8e40d49c0 2024-09-17T05:23:01.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8daffd640 1 -- 172.21.15.81:0/2816780562 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8d4004250 con 0x7fa8e40d49c0 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8e414e060 con 0x7fa8e40d49c0 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8daffd640 1 -- 172.21.15.81:0/2816780562 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d4004680 con 0x7fa8e40d49c0 2024-09-17T05:23:01.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.190+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8e414e620 con 0x7fa8e40d49c0 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.191+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8e414ea60 con 0x7fa8e40d49c0 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.192+0000 7fa8daffd640 1 -- 172.21.15.81:0/2816780562 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fa8d402c8c0 con 0x7fa8e40d49c0 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.192+0000 7fa8daffd640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8c4078ce0 0x7fa8c407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.193+0000 7fa8e1d9b640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8c4078ce0 0x7fa8c407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.193+0000 7fa8daffd640 1 -- 172.21.15.81:0/2816780562 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fa8d40bb570 con 0x7fa8e40d49c0 2024-09-17T05:23:01.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.193+0000 7fa8e1d9b640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8c4078ce0 0x7fa8c407b1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005fd0 tx=0x7fa8cc005850 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:01.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.197+0000 7fa8daffd640 1 -- 172.21.15.81:0/2816780562 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa8d4032030 con 0x7fa8e40d49c0 2024-09-17T05:23:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.367+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa8e408d590 con 0x7fa8c4078ce0 2024-09-17T05:23:01.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.371+0000 7fa8daffd640 1 -- 172.21.15.81:0/2816780562 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252078 (secure 0 0 0) 0x7fa8e408d590 con 0x7fa8c4078ce0 2024-09-17T05:23:01.375 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:01.376 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8c4078ce0 msgr2=0x7fa8c407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8c4078ce0 0x7fa8c407b1a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc005fd0 tx=0x7fa8cc005850 comp rx=0 tx=0).stop 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e40d49c0 msgr2=0x7fa8e40cb0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e40d49c0 0x7fa8e40cb0d0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7fa8d4009bf0 tx=0x7fa8d4003f10 comp rx=0 tx=0).stop 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 shutdown_connections 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa8e4162480 0x7fa8e40b4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8c4078ce0 0x7fa8c407b1a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa8e415df90 0x7fa8e40b46b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 --2- 172.21.15.81:0/2816780562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8e40d49c0 0x7fa8e40cb0d0 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 >> 172.21.15.81:0/2816780562 conn(0x7fa8e40d3ea0 msgr2=0x7fa8e406eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:01.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 shutdown_connections 2024-09-17T05:23:01.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.374+0000 7fa8e8f84640 1 -- 172.21.15.81:0/2816780562 wait complete. 2024-09-17T05:23:01.387 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-17T05:23:00.025899+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":175,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":254512,"kb_used_data":9128,"kb_used_omap":12,"kb_used_meta":245171,"kb_avail":754720208,"statfs":{"total":773094113280,"available":772833492992,"internally_reserved":0,"allocated":9347072,"data_stored":4635980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":251055664},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.941361"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223105+0000","last_change":"2024-09-17T05:22:57.085338+0000","last_active":"2024-09-17T05:22:58.223105+0000","last_peered":"2024-09-17T05:22:58.223105+0000","last_clean":"2024-09-17T05:22:58.223105+0000","last_became_active":"2024-09-17T05:22:57.085060+0000","last_became_peered":"2024-09-17T05:22:57.085060+0000","last_unstale":"2024-09-17T05:22:58.223105+0000","last_undegraded":"2024-09-17T05:22:58.223105+0000","last_fullsized":"2024-09-17T05:22:58.223105+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:17.277113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102459+0000","last_change":"2024-09-17T05:22:57.094505+0000","last_active":"2024-09-17T05:22:58.102459+0000","last_peered":"2024-09-17T05:22:58.102459+0000","last_clean":"2024-09-17T05:22:58.102459+0000","last_became_active":"2024-09-17T05:22:57.094154+0000","last_became_peered":"2024-09-17T05:22:57.094154+0000","last_unstale":"2024-09-17T05:22:58.102459+0000","last_undegraded":"2024-09-17T05:22:58.102459+0000","last_fullsized":"2024-09-17T05:22:58.102459+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:59.980730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074751+0000","last_change":"2024-09-17T05:22:57.094524+0000","last_active":"2024-09-17T05:22:58.074751+0000","last_peered":"2024-09-17T05:22:58.074751+0000","last_clean":"2024-09-17T05:22:58.074751+0000","last_became_active":"2024-09-17T05:22:57.094253+0000","last_became_peered":"2024-09-17T05:22:57.094253+0000","last_unstale":"2024-09-17T05:22:58.074751+0000","last_undegraded":"2024-09-17T05:22:58.074751+0000","last_fullsized":"2024-09-17T05:22:58.074751+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:23.294619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221805+0000","last_change":"2024-09-17T05:22:57.090848+0000","last_active":"2024-09-17T05:22:58.221805+0000","last_peered":"2024-09-17T05:22:58.221805+0000","last_clean":"2024-09-17T05:22:58.221805+0000","last_became_active":"2024-09-17T05:22:57.090582+0000","last_became_peered":"2024-09-17T05:22:57.090582+0000","last_unstale":"2024-09-17T05:22:58.221805+0000","last_undegraded":"2024-09-17T05:22:58.221805+0000","last_fullsized":"2024-09-17T05:22:58.221805+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:42.550928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074747+0000","last_change":"2024-09-17T05:22:57.092132+0000","last_active":"2024-09-17T05:22:58.074747+0000","last_peered":"2024-09-17T05:22:58.074747+0000","last_clean":"2024-09-17T05:22:58.074747+0000","last_became_active":"2024-09-17T05:22:57.091334+0000","last_became_peered":"2024-09-17T05:22:57.091334+0000","last_unstale":"2024-09-17T05:22:58.074747+0000","last_undegraded":"2024-09-17T05:22:58.074747+0000","last_fullsized":"2024-09-17T05:22:58.074747+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:41:54.574890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222639+0000","last_change":"2024-09-17T05:22:57.086975+0000","last_active":"2024-09-17T05:22:58.222639+0000","last_peered":"2024-09-17T05:22:58.222639+0000","last_clean":"2024-09-17T05:22:58.222639+0000","last_became_active":"2024-09-17T05:22:57.085923+0000","last_became_peered":"2024-09-17T05:22:57.085923+0000","last_unstale":"2024-09-17T05:22:58.222639+0000","last_undegraded":"2024-09-17T05:22:58.222639+0000","last_fullsized":"2024-09-17T05:22:58.222639+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:14.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221707+0000","last_change":"2024-09-17T05:22:57.087396+0000","last_active":"2024-09-17T05:22:58.221707+0000","last_peered":"2024-09-17T05:22:58.221707+0000","last_clean":"2024-09-17T05:22:58.221707+0000","last_became_active":"2024-09-17T05:22:57.087047+0000","last_became_peered":"2024-09-17T05:22:57.087047+0000","last_unstale":"2024-09-17T05:22:58.221707+0000","last_undegraded":"2024-09-17T05:22:58.221707+0000","last_fullsized":"2024-09-17T05:22:58.221707+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:39.832920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222564+0000","last_change":"2024-09-17T05:22:57.091657+0000","last_active":"2024-09-17T05:22:58.222564+0000","last_peered":"2024-09-17T05:22:58.222564+0000","last_clean":"2024-09-17T05:22:58.222564+0000","last_became_active":"2024-09-17T05:22:57.091336+0000","last_became_peered":"2024-09-17T05:22:57.091336+0000","last_unstale":"2024-09-17T05:22:58.222564+0000","last_undegraded":"2024-09-17T05:22:58.222564+0000","last_fullsized":"2024-09-17T05:22:58.222564+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.725930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222651+0000","last_change":"2024-09-17T05:22:57.087411+0000","last_active":"2024-09-17T05:22:58.222651+0000","last_peered":"2024-09-17T05:22:58.222651+0000","last_clean":"2024-09-17T05:22:58.222651+0000","last_became_active":"2024-09-17T05:22:57.087115+0000","last_became_peered":"2024-09-17T05:22:57.087115+0000","last_unstale":"2024-09-17T05:22:58.222651+0000","last_undegraded":"2024-09-17T05:22:58.222651+0000","last_fullsized":"2024-09-17T05:22:58.222651+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:06.202461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222898+0000","last_change":"2024-09-17T05:22:57.088921+0000","last_active":"2024-09-17T05:22:58.222898+0000","last_peered":"2024-09-17T05:22:58.222898+0000","last_clean":"2024-09-17T05:22:58.222898+0000","last_became_active":"2024-09-17T05:22:57.088459+0000","last_became_peered":"2024-09-17T05:22:57.088459+0000","last_unstale":"2024-09-17T05:22:58.222898+0000","last_undegraded":"2024-09-17T05:22:58.222898+0000","last_fullsized":"2024-09-17T05:22:58.222898+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:48.840658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102582+0000","last_change":"2024-09-17T05:22:57.094683+0000","last_active":"2024-09-17T05:22:58.102582+0000","last_peered":"2024-09-17T05:22:58.102582+0000","last_clean":"2024-09-17T05:22:58.102582+0000","last_became_active":"2024-09-17T05:22:57.094256+0000","last_became_peered":"2024-09-17T05:22:57.094256+0000","last_unstale":"2024-09-17T05:22:58.102582+0000","last_undegraded":"2024-09-17T05:22:58.102582+0000","last_fullsized":"2024-09-17T05:22:58.102582+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:42.002682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222335+0000","last_change":"2024-09-17T05:22:57.085818+0000","last_active":"2024-09-17T05:22:58.222335+0000","last_peered":"2024-09-17T05:22:58.222335+0000","last_clean":"2024-09-17T05:22:58.222335+0000","last_became_active":"2024-09-17T05:22:57.085448+0000","last_became_peered":"2024-09-17T05:22:57.085448+0000","last_unstale":"2024-09-17T05:22:58.222335+0000","last_undegraded":"2024-09-17T05:22:58.222335+0000","last_fullsized":"2024-09-17T05:22:58.222335+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:04.589542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.073994+0000","last_change":"2024-09-17T05:22:57.088192+0000","last_active":"2024-09-17T05:22:58.073994+0000","last_peered":"2024-09-17T05:22:58.073994+0000","last_clean":"2024-09-17T05:22:58.073994+0000","last_became_active":"2024-09-17T05:22:57.087073+0000","last_became_peered":"2024-09-17T05:22:57.087073+0000","last_unstale":"2024-09-17T05:22:58.073994+0000","last_undegraded":"2024-09-17T05:22:58.073994+0000","last_fullsized":"2024-09-17T05:22:58.073994+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:47.001016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221713+0000","last_change":"2024-09-17T05:22:57.089268+0000","last_active":"2024-09-17T05:22:58.221713+0000","last_peered":"2024-09-17T05:22:58.221713+0000","last_clean":"2024-09-17T05:22:58.221713+0000","last_became_active":"2024-09-17T05:22:57.088984+0000","last_became_peered":"2024-09-17T05:22:57.088984+0000","last_unstale":"2024-09-17T05:22:58.221713+0000","last_undegraded":"2024-09-17T05:22:58.221713+0000","last_fullsized":"2024-09-17T05:22:58.221713+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:16:15.541495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074789+0000","last_change":"2024-09-17T05:22:57.086147+0000","last_active":"2024-09-17T05:22:58.074789+0000","last_peered":"2024-09-17T05:22:58.074789+0000","last_clean":"2024-09-17T05:22:58.074789+0000","last_became_active":"2024-09-17T05:22:57.085831+0000","last_became_peered":"2024-09-17T05:22:57.085831+0000","last_unstale":"2024-09-17T05:22:58.074789+0000","last_undegraded":"2024-09-17T05:22:58.074789+0000","last_fullsized":"2024-09-17T05:22:58.074789+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:26.273000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074880+0000","last_change":"2024-09-17T05:22:57.091464+0000","last_active":"2024-09-17T05:22:58.074880+0000","last_peered":"2024-09-17T05:22:58.074880+0000","last_clean":"2024-09-17T05:22:58.074880+0000","last_became_active":"2024-09-17T05:22:57.091183+0000","last_became_peered":"2024-09-17T05:22:57.091183+0000","last_unstale":"2024-09-17T05:22:58.074880+0000","last_undegraded":"2024-09-17T05:22:58.074880+0000","last_fullsized":"2024-09-17T05:22:58.074880+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:04.589542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075054+0000","last_change":"2024-09-17T05:22:57.080209+0000","last_active":"2024-09-17T05:22:58.075054+0000","last_peered":"2024-09-17T05:22:58.075054+0000","last_clean":"2024-09-17T05:22:58.075054+0000","last_became_active":"2024-09-17T05:22:57.079938+0000","last_became_peered":"2024-09-17T05:22:57.079938+0000","last_unstale":"2024-09-17T05:22:58.075054+0000","last_undegraded":"2024-09-17T05:22:58.075054+0000","last_fullsized":"2024-09-17T05:22:58.075054+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.725930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221946+0000","last_change":"2024-09-17T05:22:57.091722+0000","last_active":"2024-09-17T05:22:58.221946+0000","last_peered":"2024-09-17T05:22:58.221946+0000","last_clean":"2024-09-17T05:22:58.221946+0000","last_became_active":"2024-09-17T05:22:57.091435+0000","last_became_peered":"2024-09-17T05:22:57.091435+0000","last_unstale":"2024-09-17T05:22:58.221946+0000","last_undegraded":"2024-09-17T05:22:58.221946+0000","last_fullsized":"2024-09-17T05:22:58.221946+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:05:08.503843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104432+0000","last_change":"2024-09-17T05:22:57.077537+0000","last_active":"2024-09-17T05:22:58.104432+0000","last_peered":"2024-09-17T05:22:58.104432+0000","last_clean":"2024-09-17T05:22:58.104432+0000","last_became_active":"2024-09-17T05:22:57.077252+0000","last_became_peered":"2024-09-17T05:22:57.077252+0000","last_unstale":"2024-09-17T05:22:58.104432+0000","last_undegraded":"2024-09-17T05:22:58.104432+0000","last_fullsized":"2024-09-17T05:22:58.104432+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:02:46.422234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221940+0000","last_change":"2024-09-17T05:22:57.078926+0000","last_active":"2024-09-17T05:22:58.221940+0000","last_peered":"2024-09-17T05:22:58.221940+0000","last_clean":"2024-09-17T05:22:58.221940+0000","last_became_active":"2024-09-17T05:22:57.078301+0000","last_became_peered":"2024-09-17T05:22:57.078301+0000","last_unstale":"2024-09-17T05:22:58.221940+0000","last_undegraded":"2024-09-17T05:22:58.221940+0000","last_fullsized":"2024-09-17T05:22:58.221940+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:22:37.848893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221972+0000","last_change":"2024-09-17T05:22:57.080499+0000","last_active":"2024-09-17T05:22:58.221972+0000","last_peered":"2024-09-17T05:22:58.221972+0000","last_clean":"2024-09-17T05:22:58.221972+0000","last_became_active":"2024-09-17T05:22:57.080223+0000","last_became_peered":"2024-09-17T05:22:57.080223+0000","last_unstale":"2024-09-17T05:22:58.221972+0000","last_undegraded":"2024-09-17T05:22:58.221972+0000","last_fullsized":"2024-09-17T05:22:58.221972+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:48.382310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102418+0000","last_change":"2024-09-17T05:22:57.089408+0000","last_active":"2024-09-17T05:22:58.102418+0000","last_peered":"2024-09-17T05:22:58.102418+0000","last_clean":"2024-09-17T05:22:58.102418+0000","last_became_active":"2024-09-17T05:22:57.088951+0000","last_became_peered":"2024-09-17T05:22:57.088951+0000","last_unstale":"2024-09-17T05:22:58.102418+0000","last_undegraded":"2024-09-17T05:22:58.102418+0000","last_fullsized":"2024-09-17T05:22:58.102418+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:41.670826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222773+0000","last_change":"2024-09-17T05:22:57.088218+0000","last_active":"2024-09-17T05:22:58.222773+0000","last_peered":"2024-09-17T05:22:58.222773+0000","last_clean":"2024-09-17T05:22:58.222773+0000","last_became_active":"2024-09-17T05:22:57.087839+0000","last_became_peered":"2024-09-17T05:22:57.087839+0000","last_unstale":"2024-09-17T05:22:58.222773+0000","last_undegraded":"2024-09-17T05:22:58.222773+0000","last_fullsized":"2024-09-17T05:22:58.222773+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.725930+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221921+0000","last_change":"2024-09-17T05:22:57.080468+0000","last_active":"2024-09-17T05:22:58.221921+0000","last_peered":"2024-09-17T05:22:58.221921+0000","last_clean":"2024-09-17T05:22:58.221921+0000","last_became_active":"2024-09-17T05:22:57.080180+0000","last_became_peered":"2024-09-17T05:22:57.080180+0000","last_unstale":"2024-09-17T05:22:58.221921+0000","last_undegraded":"2024-09-17T05:22:58.221921+0000","last_fullsized":"2024-09-17T05:22:58.221921+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:43.331128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102422+0000","last_change":"2024-09-17T05:22:57.094733+0000","last_active":"2024-09-17T05:22:58.102422+0000","last_peered":"2024-09-17T05:22:58.102422+0000","last_clean":"2024-09-17T05:22:58.102422+0000","last_became_active":"2024-09-17T05:22:57.094400+0000","last_became_peered":"2024-09-17T05:22:57.094400+0000","last_unstale":"2024-09-17T05:22:58.102422+0000","last_undegraded":"2024-09-17T05:22:58.102422+0000","last_fullsized":"2024-09-17T05:22:58.102422+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:22.885272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074261+0000","last_change":"2024-09-17T05:22:57.095047+0000","last_active":"2024-09-17T05:22:58.074261+0000","last_peered":"2024-09-17T05:22:58.074261+0000","last_clean":"2024-09-17T05:22:58.074261+0000","last_became_active":"2024-09-17T05:22:57.094763+0000","last_became_peered":"2024-09-17T05:22:57.094763+0000","last_unstale":"2024-09-17T05:22:58.074261+0000","last_undegraded":"2024-09-17T05:22:58.074261+0000","last_fullsized":"2024-09-17T05:22:58.074261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:22.483082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075094+0000","last_change":"2024-09-17T05:22:57.078025+0000","last_active":"2024-09-17T05:22:58.075094+0000","last_peered":"2024-09-17T05:22:58.075094+0000","last_clean":"2024-09-17T05:22:58.075094+0000","last_became_active":"2024-09-17T05:22:57.077727+0000","last_became_peered":"2024-09-17T05:22:57.077727+0000","last_unstale":"2024-09-17T05:22:58.075094+0000","last_undegraded":"2024-09-17T05:22:58.075094+0000","last_fullsized":"2024-09-17T05:22:58.075094+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:14.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222577+0000","last_change":"2024-09-17T05:22:57.086837+0000","last_active":"2024-09-17T05:22:58.222577+0000","last_peered":"2024-09-17T05:22:58.222577+0000","last_clean":"2024-09-17T05:22:58.222577+0000","last_became_active":"2024-09-17T05:22:57.086290+0000","last_became_peered":"2024-09-17T05:22:57.086290+0000","last_unstale":"2024-09-17T05:22:58.222577+0000","last_undegraded":"2024-09-17T05:22:58.222577+0000","last_fullsized":"2024-09-17T05:22:58.222577+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:21:06.202461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102554+0000","last_change":"2024-09-17T05:22:57.090279+0000","last_active":"2024-09-17T05:22:58.102554+0000","last_peered":"2024-09-17T05:22:58.102554+0000","last_clean":"2024-09-17T05:22:58.102554+0000","last_became_active":"2024-09-17T05:22:57.089886+0000","last_became_peered":"2024-09-17T05:22:57.089886+0000","last_unstale":"2024-09-17T05:22:58.102554+0000","last_undegraded":"2024-09-17T05:22:58.102554+0000","last_fullsized":"2024-09-17T05:22:58.102554+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:58.588334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102614+0000","last_change":"2024-09-17T05:22:57.092465+0000","last_active":"2024-09-17T05:22:58.102614+0000","last_peered":"2024-09-17T05:22:58.102614+0000","last_clean":"2024-09-17T05:22:58.102614+0000","last_became_active":"2024-09-17T05:22:57.092136+0000","last_became_peered":"2024-09-17T05:22:57.092136+0000","last_unstale":"2024-09-17T05:22:58.102614+0000","last_undegraded":"2024-09-17T05:22:58.102614+0000","last_fullsized":"2024-09-17T05:22:58.102614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:14.001706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074766+0000","last_change":"2024-09-17T05:22:57.078211+0000","last_active":"2024-09-17T05:22:58.074766+0000","last_peered":"2024-09-17T05:22:58.074766+0000","last_clean":"2024-09-17T05:22:58.074766+0000","last_became_active":"2024-09-17T05:22:57.077925+0000","last_became_peered":"2024-09-17T05:22:57.077925+0000","last_unstale":"2024-09-17T05:22:58.074766+0000","last_undegraded":"2024-09-17T05:22:58.074766+0000","last_fullsized":"2024-09-17T05:22:58.074766+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:55.067983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222261+0000","last_change":"2024-09-17T05:22:57.090564+0000","last_active":"2024-09-17T05:22:58.222261+0000","last_peered":"2024-09-17T05:22:58.222261+0000","last_clean":"2024-09-17T05:22:58.222261+0000","last_became_active":"2024-09-17T05:22:57.090297+0000","last_became_peered":"2024-09-17T05:22:57.090297+0000","last_unstale":"2024-09-17T05:22:58.222261+0000","last_undegraded":"2024-09-17T05:22:58.222261+0000","last_fullsized":"2024-09-17T05:22:58.222261+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:55.067983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074888+0000","last_change":"2024-09-17T05:22:57.090126+0000","last_active":"2024-09-17T05:22:58.074888+0000","last_peered":"2024-09-17T05:22:58.074888+0000","last_clean":"2024-09-17T05:22:58.074888+0000","last_became_active":"2024-09-17T05:22:57.089847+0000","last_became_peered":"2024-09-17T05:22:57.089847+0000","last_unstale":"2024-09-17T05:22:58.074888+0000","last_undegraded":"2024-09-17T05:22:58.074888+0000","last_fullsized":"2024-09-17T05:22:58.074888+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:21:40.988908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"82'4","reported_seq":19,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223392+0000","last_change":"2024-09-17T05:22:56.105084+0000","last_active":"2024-09-17T05:22:58.223392+0000","last_peered":"2024-09-17T05:22:58.223392+0000","last_clean":"2024-09-17T05:22:58.223392+0000","last_became_active":"2024-09-17T05:22:56.104334+0000","last_became_peered":"2024-09-17T05:22:56.104334+0000","last_unstale":"2024-09-17T05:22:58.223392+0000","last_undegraded":"2024-09-17T05:22:58.223392+0000","last_fullsized":"2024-09-17T05:22:58.223392+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:57.584571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223284+0000","last_change":"2024-09-17T05:22:57.092861+0000","last_active":"2024-09-17T05:22:58.223284+0000","last_peered":"2024-09-17T05:22:58.223284+0000","last_clean":"2024-09-17T05:22:58.223284+0000","last_became_active":"2024-09-17T05:22:57.092526+0000","last_became_peered":"2024-09-17T05:22:57.092526+0000","last_unstale":"2024-09-17T05:22:58.223284+0000","last_undegraded":"2024-09-17T05:22:58.223284+0000","last_fullsized":"2024-09-17T05:22:58.223284+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:05.507457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075100+0000","last_change":"2024-09-17T05:22:56.103190+0000","last_active":"2024-09-17T05:22:58.075100+0000","last_peered":"2024-09-17T05:22:58.075100+0000","last_clean":"2024-09-17T05:22:58.075100+0000","last_became_active":"2024-09-17T05:22:56.102720+0000","last_became_peered":"2024-09-17T05:22:56.102720+0000","last_unstale":"2024-09-17T05:22:58.075100+0000","last_undegraded":"2024-09-17T05:22:58.075100+0000","last_fullsized":"2024-09-17T05:22:58.075100+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:04.198968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222833+0000","last_change":"2024-09-17T05:22:57.091182+0000","last_active":"2024-09-17T05:22:58.222833+0000","last_peered":"2024-09-17T05:22:58.222833+0000","last_clean":"2024-09-17T05:22:58.222833+0000","last_became_active":"2024-09-17T05:22:57.090729+0000","last_became_peered":"2024-09-17T05:22:57.090729+0000","last_unstale":"2024-09-17T05:22:58.222833+0000","last_undegraded":"2024-09-17T05:22:58.222833+0000","last_fullsized":"2024-09-17T05:22:58.222833+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:14.999112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104359+0000","last_change":"2024-09-17T05:22:56.096995+0000","last_active":"2024-09-17T05:22:58.104359+0000","last_peered":"2024-09-17T05:22:58.104359+0000","last_clean":"2024-09-17T05:22:58.104359+0000","last_became_active":"2024-09-17T05:22:56.096720+0000","last_became_peered":"2024-09-17T05:22:56.096720+0000","last_unstale":"2024-09-17T05:22:58.104359+0000","last_undegraded":"2024-09-17T05:22:58.104359+0000","last_fullsized":"2024-09-17T05:22:58.104359+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:01.467131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074658+0000","last_change":"2024-09-17T05:22:57.094280+0000","last_active":"2024-09-17T05:22:58.074658+0000","last_peered":"2024-09-17T05:22:58.074658+0000","last_clean":"2024-09-17T05:22:58.074658+0000","last_became_active":"2024-09-17T05:22:57.093992+0000","last_became_peered":"2024-09-17T05:22:57.093992+0000","last_unstale":"2024-09-17T05:22:58.074658+0000","last_undegraded":"2024-09-17T05:22:58.074658+0000","last_fullsized":"2024-09-17T05:22:58.074658+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:30.185473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104283+0000","last_change":"2024-09-17T05:22:56.097098+0000","last_active":"2024-09-17T05:22:58.104283+0000","last_peered":"2024-09-17T05:22:58.104283+0000","last_clean":"2024-09-17T05:22:58.104283+0000","last_became_active":"2024-09-17T05:22:56.096832+0000","last_became_peered":"2024-09-17T05:22:56.096832+0000","last_unstale":"2024-09-17T05:22:58.104283+0000","last_undegraded":"2024-09-17T05:22:58.104283+0000","last_fullsized":"2024-09-17T05:22:58.104283+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:04:25.187182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102797+0000","last_change":"2024-09-17T05:22:57.096130+0000","last_active":"2024-09-17T05:22:58.102797+0000","last_peered":"2024-09-17T05:22:58.102797+0000","last_clean":"2024-09-17T05:22:58.102797+0000","last_became_active":"2024-09-17T05:22:57.095629+0000","last_became_peered":"2024-09-17T05:22:57.095629+0000","last_unstale":"2024-09-17T05:22:58.102797+0000","last_undegraded":"2024-09-17T05:22:58.102797+0000","last_fullsized":"2024-09-17T05:22:58.102797+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:57:12.104046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075158+0000","last_change":"2024-09-17T05:22:56.105448+0000","last_active":"2024-09-17T05:22:58.075158+0000","last_peered":"2024-09-17T05:22:58.075158+0000","last_clean":"2024-09-17T05:22:58.075158+0000","last_became_active":"2024-09-17T05:22:56.105180+0000","last_became_peered":"2024-09-17T05:22:56.105180+0000","last_unstale":"2024-09-17T05:22:58.075158+0000","last_undegraded":"2024-09-17T05:22:58.075158+0000","last_fullsized":"2024-09-17T05:22:58.075158+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:42.433812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075193+0000","last_change":"2024-09-17T05:22:57.084285+0000","last_active":"2024-09-17T05:22:58.075193+0000","last_peered":"2024-09-17T05:22:58.075193+0000","last_clean":"2024-09-17T05:22:58.075193+0000","last_became_active":"2024-09-17T05:22:57.083554+0000","last_became_peered":"2024-09-17T05:22:57.083554+0000","last_unstale":"2024-09-17T05:22:58.075193+0000","last_undegraded":"2024-09-17T05:22:58.075193+0000","last_fullsized":"2024-09-17T05:22:58.075193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:42.761225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074008+0000","last_change":"2024-09-17T05:22:56.100854+0000","last_active":"2024-09-17T05:22:58.074008+0000","last_peered":"2024-09-17T05:22:58.074008+0000","last_clean":"2024-09-17T05:22:58.074008+0000","last_became_active":"2024-09-17T05:22:56.100416+0000","last_became_peered":"2024-09-17T05:22:56.100416+0000","last_unstale":"2024-09-17T05:22:58.074008+0000","last_undegraded":"2024-09-17T05:22:58.074008+0000","last_fullsized":"2024-09-17T05:22:58.074008+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:46:10.429911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.073872+0000","last_change":"2024-09-17T05:22:57.090086+0000","last_active":"2024-09-17T05:22:58.073872+0000","last_peered":"2024-09-17T05:22:58.073872+0000","last_clean":"2024-09-17T05:22:58.073872+0000","last_became_active":"2024-09-17T05:22:57.089793+0000","last_became_peered":"2024-09-17T05:22:57.089793+0000","last_unstale":"2024-09-17T05:22:58.073872+0000","last_undegraded":"2024-09-17T05:22:58.073872+0000","last_fullsized":"2024-09-17T05:22:58.073872+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:53:17.277113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104139+0000","last_change":"2024-09-17T05:22:56.103354+0000","last_active":"2024-09-17T05:22:58.104139+0000","last_peered":"2024-09-17T05:22:58.104139+0000","last_clean":"2024-09-17T05:22:58.104139+0000","last_became_active":"2024-09-17T05:22:56.103098+0000","last_became_peered":"2024-09-17T05:22:56.103098+0000","last_unstale":"2024-09-17T05:22:58.104139+0000","last_undegraded":"2024-09-17T05:22:58.104139+0000","last_fullsized":"2024-09-17T05:22:58.104139+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:25:48.686589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074821+0000","last_change":"2024-09-17T05:22:57.085988+0000","last_active":"2024-09-17T05:22:58.074821+0000","last_peered":"2024-09-17T05:22:58.074821+0000","last_clean":"2024-09-17T05:22:58.074821+0000","last_became_active":"2024-09-17T05:22:57.085702+0000","last_became_peered":"2024-09-17T05:22:57.085702+0000","last_unstale":"2024-09-17T05:22:58.074821+0000","last_undegraded":"2024-09-17T05:22:58.074821+0000","last_fullsized":"2024-09-17T05:22:58.074821+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:37.404809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102314+0000","last_change":"2024-09-17T05:22:56.099870+0000","last_active":"2024-09-17T05:22:58.102314+0000","last_peered":"2024-09-17T05:22:58.102314+0000","last_clean":"2024-09-17T05:22:58.102314+0000","last_became_active":"2024-09-17T05:22:56.099534+0000","last_became_peered":"2024-09-17T05:22:56.099534+0000","last_unstale":"2024-09-17T05:22:58.102314+0000","last_undegraded":"2024-09-17T05:22:58.102314+0000","last_fullsized":"2024-09-17T05:22:58.102314+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:30:11.260417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075043+0000","last_change":"2024-09-17T05:22:57.088586+0000","last_active":"2024-09-17T05:22:58.075043+0000","last_peered":"2024-09-17T05:22:58.075043+0000","last_clean":"2024-09-17T05:22:58.075043+0000","last_became_active":"2024-09-17T05:22:57.088294+0000","last_became_peered":"2024-09-17T05:22:57.088294+0000","last_unstale":"2024-09-17T05:22:58.075043+0000","last_undegraded":"2024-09-17T05:22:58.075043+0000","last_fullsized":"2024-09-17T05:22:58.075043+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:59:02.837914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223416+0000","last_change":"2024-09-17T05:22:56.107410+0000","last_active":"2024-09-17T05:22:58.223416+0000","last_peered":"2024-09-17T05:22:58.223416+0000","last_clean":"2024-09-17T05:22:58.223416+0000","last_became_active":"2024-09-17T05:22:56.107187+0000","last_became_peered":"2024-09-17T05:22:56.107187+0000","last_unstale":"2024-09-17T05:22:58.223416+0000","last_undegraded":"2024-09-17T05:22:58.223416+0000","last_fullsized":"2024-09-17T05:22:58.223416+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:40.998919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222776+0000","last_change":"2024-09-17T05:22:57.092416+0000","last_active":"2024-09-17T05:22:58.222776+0000","last_peered":"2024-09-17T05:22:58.222776+0000","last_clean":"2024-09-17T05:22:58.222776+0000","last_became_active":"2024-09-17T05:22:57.092157+0000","last_became_peered":"2024-09-17T05:22:57.092157+0000","last_unstale":"2024-09-17T05:22:58.222776+0000","last_undegraded":"2024-09-17T05:22:58.222776+0000","last_fullsized":"2024-09-17T05:22:58.222776+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:48.840658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223005+0000","last_change":"2024-09-17T05:22:56.104357+0000","last_active":"2024-09-17T05:22:58.223005+0000","last_peered":"2024-09-17T05:22:58.223005+0000","last_clean":"2024-09-17T05:22:58.223005+0000","last_became_active":"2024-09-17T05:22:56.104082+0000","last_became_peered":"2024-09-17T05:22:56.104082+0000","last_unstale":"2024-09-17T05:22:58.223005+0000","last_undegraded":"2024-09-17T05:22:58.223005+0000","last_fullsized":"2024-09-17T05:22:58.223005+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:54:58.976967+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104360+0000","last_change":"2024-09-17T05:22:57.088018+0000","last_active":"2024-09-17T05:22:58.104360+0000","last_peered":"2024-09-17T05:22:58.104360+0000","last_clean":"2024-09-17T05:22:58.104360+0000","last_became_active":"2024-09-17T05:22:57.087736+0000","last_became_peered":"2024-09-17T05:22:57.087736+0000","last_unstale":"2024-09-17T05:22:58.104360+0000","last_undegraded":"2024-09-17T05:22:58.104360+0000","last_fullsized":"2024-09-17T05:22:58.104360+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:38:25.478356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"82'3","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222597+0000","last_change":"2024-09-17T05:22:56.105725+0000","last_active":"2024-09-17T05:22:58.222597+0000","last_peered":"2024-09-17T05:22:58.222597+0000","last_clean":"2024-09-17T05:22:58.222597+0000","last_became_active":"2024-09-17T05:22:56.105454+0000","last_became_peered":"2024-09-17T05:22:56.105454+0000","last_unstale":"2024-09-17T05:22:58.222597+0000","last_undegraded":"2024-09-17T05:22:58.222597+0000","last_fullsized":"2024-09-17T05:22:58.222597+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:28.551807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075294+0000","last_change":"2024-09-17T05:22:57.085120+0000","last_active":"2024-09-17T05:22:58.075294+0000","last_peered":"2024-09-17T05:22:58.075294+0000","last_clean":"2024-09-17T05:22:58.075294+0000","last_became_active":"2024-09-17T05:22:57.084826+0000","last_became_peered":"2024-09-17T05:22:57.084826+0000","last_unstale":"2024-09-17T05:22:58.075294+0000","last_undegraded":"2024-09-17T05:22:58.075294+0000","last_fullsized":"2024-09-17T05:22:58.075294+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:17.857628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"82'6","reported_seq":21,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222424+0000","last_change":"2024-09-17T05:22:56.098957+0000","last_active":"2024-09-17T05:22:58.222424+0000","last_peered":"2024-09-17T05:22:58.222424+0000","last_clean":"2024-09-17T05:22:58.222424+0000","last_became_active":"2024-09-17T05:22:56.098659+0000","last_became_peered":"2024-09-17T05:22:56.098659+0000","last_unstale":"2024-09-17T05:22:58.222424+0000","last_undegraded":"2024-09-17T05:22:58.222424+0000","last_fullsized":"2024-09-17T05:22:58.222424+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:00:03.090979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104193+0000","last_change":"2024-09-17T05:22:57.077890+0000","last_active":"2024-09-17T05:22:58.104193+0000","last_peered":"2024-09-17T05:22:58.104193+0000","last_clean":"2024-09-17T05:22:58.104193+0000","last_became_active":"2024-09-17T05:22:57.077555+0000","last_became_peered":"2024-09-17T05:22:57.077555+0000","last_unstale":"2024-09-17T05:22:58.104193+0000","last_undegraded":"2024-09-17T05:22:58.104193+0000","last_fullsized":"2024-09-17T05:22:58.104193+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:58.321062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102522+0000","last_change":"2024-09-17T05:22:56.097665+0000","last_active":"2024-09-17T05:22:58.102522+0000","last_peered":"2024-09-17T05:22:58.102522+0000","last_clean":"2024-09-17T05:22:58.102522+0000","last_became_active":"2024-09-17T05:22:56.097427+0000","last_became_peered":"2024-09-17T05:22:56.097427+0000","last_unstale":"2024-09-17T05:22:58.102522+0000","last_undegraded":"2024-09-17T05:22:58.102522+0000","last_fullsized":"2024-09-17T05:22:58.102522+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:45:48.407696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074215+0000","last_change":"2024-09-17T05:22:57.089210+0000","last_active":"2024-09-17T05:22:58.074215+0000","last_peered":"2024-09-17T05:22:58.074215+0000","last_clean":"2024-09-17T05:22:58.074215+0000","last_became_active":"2024-09-17T05:22:57.088904+0000","last_became_peered":"2024-09-17T05:22:57.088904+0000","last_unstale":"2024-09-17T05:22:58.074215+0000","last_undegraded":"2024-09-17T05:22:58.074215+0000","last_fullsized":"2024-09-17T05:22:58.074215+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:03.732906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074782+0000","last_change":"2024-09-17T05:22:56.101489+0000","last_active":"2024-09-17T05:22:58.074782+0000","last_peered":"2024-09-17T05:22:58.074782+0000","last_clean":"2024-09-17T05:22:58.074782+0000","last_became_active":"2024-09-17T05:22:56.101232+0000","last_became_peered":"2024-09-17T05:22:56.101232+0000","last_unstale":"2024-09-17T05:22:58.074782+0000","last_undegraded":"2024-09-17T05:22:58.074782+0000","last_fullsized":"2024-09-17T05:22:58.074782+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:29.181710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102299+0000","last_change":"2024-09-17T05:22:57.088346+0000","last_active":"2024-09-17T05:22:58.102299+0000","last_peered":"2024-09-17T05:22:58.102299+0000","last_clean":"2024-09-17T05:22:58.102299+0000","last_became_active":"2024-09-17T05:22:57.088047+0000","last_became_peered":"2024-09-17T05:22:57.088047+0000","last_unstale":"2024-09-17T05:22:58.102299+0000","last_undegraded":"2024-09-17T05:22:58.102299+0000","last_fullsized":"2024-09-17T05:22:58.102299+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:29.555570+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222321+0000","last_change":"2024-09-17T05:22:56.098939+0000","last_active":"2024-09-17T05:22:58.222321+0000","last_peered":"2024-09-17T05:22:58.222321+0000","last_clean":"2024-09-17T05:22:58.222321+0000","last_became_active":"2024-09-17T05:22:56.098634+0000","last_became_peered":"2024-09-17T05:22:56.098634+0000","last_unstale":"2024-09-17T05:22:58.222321+0000","last_undegraded":"2024-09-17T05:22:58.222321+0000","last_fullsized":"2024-09-17T05:22:58.222321+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:43.627806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102217+0000","last_change":"2024-09-17T05:22:57.087286+0000","last_active":"2024-09-17T05:22:58.102217+0000","last_peered":"2024-09-17T05:22:58.102217+0000","last_clean":"2024-09-17T05:22:58.102217+0000","last_became_active":"2024-09-17T05:22:57.086944+0000","last_became_peered":"2024-09-17T05:22:57.086944+0000","last_unstale":"2024-09-17T05:22:58.102217+0000","last_undegraded":"2024-09-17T05:22:58.102217+0000","last_fullsized":"2024-09-17T05:22:58.102217+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:55.356091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"82'8","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104029+0000","last_change":"2024-09-17T05:22:56.103763+0000","last_active":"2024-09-17T05:22:58.104029+0000","last_peered":"2024-09-17T05:22:58.104029+0000","last_clean":"2024-09-17T05:22:58.104029+0000","last_became_active":"2024-09-17T05:22:56.103483+0000","last_became_peered":"2024-09-17T05:22:56.103483+0000","last_unstale":"2024-09-17T05:22:58.104029+0000","last_undegraded":"2024-09-17T05:22:58.104029+0000","last_fullsized":"2024-09-17T05:22:58.104029+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:40:59.384436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074487+0000","last_change":"2024-09-17T05:22:57.091153+0000","last_active":"2024-09-17T05:22:58.074487+0000","last_peered":"2024-09-17T05:22:58.074487+0000","last_clean":"2024-09-17T05:22:58.074487+0000","last_became_active":"2024-09-17T05:22:57.090885+0000","last_became_peered":"2024-09-17T05:22:57.090885+0000","last_unstale":"2024-09-17T05:22:58.074487+0000","last_undegraded":"2024-09-17T05:22:58.074487+0000","last_fullsized":"2024-09-17T05:22:58.074487+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:06.067666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223509+0000","last_change":"2024-09-17T05:22:56.103951+0000","last_active":"2024-09-17T05:22:58.223509+0000","last_peered":"2024-09-17T05:22:58.223509+0000","last_clean":"2024-09-17T05:22:58.223509+0000","last_became_active":"2024-09-17T05:22:56.103651+0000","last_became_peered":"2024-09-17T05:22:56.103651+0000","last_unstale":"2024-09-17T05:22:58.223509+0000","last_undegraded":"2024-09-17T05:22:58.223509+0000","last_fullsized":"2024-09-17T05:22:58.223509+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:57:12.997943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223327+0000","last_change":"2024-09-17T05:22:57.086582+0000","last_active":"2024-09-17T05:22:58.223327+0000","last_peered":"2024-09-17T05:22:58.223327+0000","last_clean":"2024-09-17T05:22:58.223327+0000","last_became_active":"2024-09-17T05:22:57.085729+0000","last_became_peered":"2024-09-17T05:22:57.085729+0000","last_unstale":"2024-09-17T05:22:58.223327+0000","last_undegraded":"2024-09-17T05:22:58.223327+0000","last_fullsized":"2024-09-17T05:22:58.223327+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:57:44.108164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104377+0000","last_change":"2024-09-17T05:22:56.103024+0000","last_active":"2024-09-17T05:22:58.104377+0000","last_peered":"2024-09-17T05:22:58.104377+0000","last_clean":"2024-09-17T05:22:58.104377+0000","last_became_active":"2024-09-17T05:22:56.102772+0000","last_became_peered":"2024-09-17T05:22:56.102772+0000","last_unstale":"2024-09-17T05:22:58.104377+0000","last_undegraded":"2024-09-17T05:22:58.104377+0000","last_fullsized":"2024-09-17T05:22:58.104377+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:51:26.340735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075314+0000","last_change":"2024-09-17T05:22:57.093458+0000","last_active":"2024-09-17T05:22:58.075314+0000","last_peered":"2024-09-17T05:22:58.075314+0000","last_clean":"2024-09-17T05:22:58.075314+0000","last_became_active":"2024-09-17T05:22:57.092768+0000","last_became_peered":"2024-09-17T05:22:57.092768+0000","last_unstale":"2024-09-17T05:22:58.075314+0000","last_undegraded":"2024-09-17T05:22:58.075314+0000","last_fullsized":"2024-09-17T05:22:58.075314+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.568249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104411+0000","last_change":"2024-09-17T05:22:56.102351+0000","last_active":"2024-09-17T05:22:58.104411+0000","last_peered":"2024-09-17T05:22:58.104411+0000","last_clean":"2024-09-17T05:22:58.104411+0000","last_became_active":"2024-09-17T05:22:56.101726+0000","last_became_peered":"2024-09-17T05:22:56.101726+0000","last_unstale":"2024-09-17T05:22:58.104411+0000","last_undegraded":"2024-09-17T05:22:58.104411+0000","last_fullsized":"2024-09-17T05:22:58.104411+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:59.955575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221742+0000","last_change":"2024-09-17T05:22:57.088801+0000","last_active":"2024-09-17T05:22:58.221742+0000","last_peered":"2024-09-17T05:22:58.221742+0000","last_clean":"2024-09-17T05:22:58.221742+0000","last_became_active":"2024-09-17T05:22:57.088291+0000","last_became_peered":"2024-09-17T05:22:57.088291+0000","last_unstale":"2024-09-17T05:22:58.221742+0000","last_undegraded":"2024-09-17T05:22:58.221742+0000","last_fullsized":"2024-09-17T05:22:58.221742+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:42:33.215396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074795+0000","last_change":"2024-09-17T05:22:56.099881+0000","last_active":"2024-09-17T05:22:58.074795+0000","last_peered":"2024-09-17T05:22:58.074795+0000","last_clean":"2024-09-17T05:22:58.074795+0000","last_became_active":"2024-09-17T05:22:56.099606+0000","last_became_peered":"2024-09-17T05:22:56.099606+0000","last_unstale":"2024-09-17T05:22:58.074795+0000","last_undegraded":"2024-09-17T05:22:58.074795+0000","last_fullsized":"2024-09-17T05:22:58.074795+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:40.656528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222276+0000","last_change":"2024-09-17T05:22:57.088049+0000","last_active":"2024-09-17T05:22:58.222276+0000","last_peered":"2024-09-17T05:22:58.222276+0000","last_clean":"2024-09-17T05:22:58.222276+0000","last_became_active":"2024-09-17T05:22:57.087530+0000","last_became_peered":"2024-09-17T05:22:57.087530+0000","last_unstale":"2024-09-17T05:22:58.222276+0000","last_undegraded":"2024-09-17T05:22:58.222276+0000","last_fullsized":"2024-09-17T05:22:58.222276+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:53:04.589542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221817+0000","last_change":"2024-09-17T05:22:56.097651+0000","last_active":"2024-09-17T05:22:58.221817+0000","last_peered":"2024-09-17T05:22:58.221817+0000","last_clean":"2024-09-17T05:22:58.221817+0000","last_became_active":"2024-09-17T05:22:56.097227+0000","last_became_peered":"2024-09-17T05:22:56.097227+0000","last_unstale":"2024-09-17T05:22:58.221817+0000","last_undegraded":"2024-09-17T05:22:58.221817+0000","last_fullsized":"2024-09-17T05:22:58.221817+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:22.314210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221614+0000","last_change":"2024-09-17T05:22:57.083794+0000","last_active":"2024-09-17T05:22:58.221614+0000","last_peered":"2024-09-17T05:22:58.221614+0000","last_clean":"2024-09-17T05:22:58.221614+0000","last_became_active":"2024-09-17T05:22:57.083473+0000","last_became_peered":"2024-09-17T05:22:57.083473+0000","last_unstale":"2024-09-17T05:22:58.221614+0000","last_undegraded":"2024-09-17T05:22:58.221614+0000","last_fullsized":"2024-09-17T05:22:58.221614+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:13.473528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.221663+0000","last_change":"2024-09-17T05:22:56.105756+0000","last_active":"2024-09-17T05:22:58.221663+0000","last_peered":"2024-09-17T05:22:58.221663+0000","last_clean":"2024-09-17T05:22:58.221663+0000","last_became_active":"2024-09-17T05:22:56.105445+0000","last_became_peered":"2024-09-17T05:22:56.105445+0000","last_unstale":"2024-09-17T05:22:58.221663+0000","last_undegraded":"2024-09-17T05:22:58.221663+0000","last_fullsized":"2024-09-17T05:22:58.221663+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:52:31.096431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222194+0000","last_change":"2024-09-17T05:22:57.093332+0000","last_active":"2024-09-17T05:22:58.222194+0000","last_peered":"2024-09-17T05:22:58.222194+0000","last_clean":"2024-09-17T05:22:58.222194+0000","last_became_active":"2024-09-17T05:22:57.093075+0000","last_became_peered":"2024-09-17T05:22:57.093075+0000","last_unstale":"2024-09-17T05:22:58.222194+0000","last_undegraded":"2024-09-17T05:22:58.222194+0000","last_fullsized":"2024-09-17T05:22:58.222194+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:55.067983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074629+0000","last_change":"2024-09-17T05:22:56.100691+0000","last_active":"2024-09-17T05:22:58.074629+0000","last_peered":"2024-09-17T05:22:58.074629+0000","last_clean":"2024-09-17T05:22:58.074629+0000","last_became_active":"2024-09-17T05:22:56.100448+0000","last_became_peered":"2024-09-17T05:22:56.100448+0000","last_unstale":"2024-09-17T05:22:58.074629+0000","last_undegraded":"2024-09-17T05:22:58.074629+0000","last_fullsized":"2024-09-17T05:22:58.074629+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:05.063904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075102+0000","last_change":"2024-09-17T05:22:57.090556+0000","last_active":"2024-09-17T05:22:58.075102+0000","last_peered":"2024-09-17T05:22:58.075102+0000","last_clean":"2024-09-17T05:22:58.075102+0000","last_became_active":"2024-09-17T05:22:57.090019+0000","last_became_peered":"2024-09-17T05:22:57.090019+0000","last_unstale":"2024-09-17T05:22:58.075102+0000","last_undegraded":"2024-09-17T05:22:58.075102+0000","last_fullsized":"2024-09-17T05:22:58.075102+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:34.748220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"82'2","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102482+0000","last_change":"2024-09-17T05:22:56.102945+0000","last_active":"2024-09-17T05:22:58.102482+0000","last_peered":"2024-09-17T05:22:58.102482+0000","last_clean":"2024-09-17T05:22:58.102482+0000","last_became_active":"2024-09-17T05:22:56.102646+0000","last_became_peered":"2024-09-17T05:22:56.102646+0000","last_unstale":"2024-09-17T05:22:58.102482+0000","last_undegraded":"2024-09-17T05:22:58.102482+0000","last_fullsized":"2024-09-17T05:22:58.102482+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:24.840842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074354+0000","last_change":"2024-09-17T05:22:57.088816+0000","last_active":"2024-09-17T05:22:58.074354+0000","last_peered":"2024-09-17T05:22:58.074354+0000","last_clean":"2024-09-17T05:22:58.074354+0000","last_became_active":"2024-09-17T05:22:57.088542+0000","last_became_peered":"2024-09-17T05:22:57.088542+0000","last_unstale":"2024-09-17T05:22:58.074354+0000","last_undegraded":"2024-09-17T05:22:58.074354+0000","last_fullsized":"2024-09-17T05:22:58.074354+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:36:41.660291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"83'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.103558+0000","last_change":"2024-09-17T05:22:56.100322+0000","last_active":"2024-09-17T05:22:58.103558+0000","last_peered":"2024-09-17T05:22:58.103558+0000","last_clean":"2024-09-17T05:22:58.103558+0000","last_became_active":"2024-09-17T05:22:56.099438+0000","last_became_peered":"2024-09-17T05:22:56.099438+0000","last_unstale":"2024-09-17T05:22:58.103558+0000","last_undegraded":"2024-09-17T05:22:58.103558+0000","last_fullsized":"2024-09-17T05:22:58.103558+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:13:09.827663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223186+0000","last_change":"2024-09-17T05:22:57.083199+0000","last_active":"2024-09-17T05:22:58.223186+0000","last_peered":"2024-09-17T05:22:58.223186+0000","last_clean":"2024-09-17T05:22:58.223186+0000","last_became_active":"2024-09-17T05:22:57.082939+0000","last_became_peered":"2024-09-17T05:22:57.082939+0000","last_unstale":"2024-09-17T05:22:58.223186+0000","last_undegraded":"2024-09-17T05:22:58.223186+0000","last_fullsized":"2024-09-17T05:22:58.223186+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:06:39.568249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222780+0000","last_change":"2024-09-17T05:22:56.105466+0000","last_active":"2024-09-17T05:22:58.222780+0000","last_peered":"2024-09-17T05:22:58.222780+0000","last_clean":"2024-09-17T05:22:58.222780+0000","last_became_active":"2024-09-17T05:22:56.105192+0000","last_became_peered":"2024-09-17T05:22:56.105192+0000","last_unstale":"2024-09-17T05:22:58.222780+0000","last_undegraded":"2024-09-17T05:22:58.222780+0000","last_fullsized":"2024-09-17T05:22:58.222780+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:39:40.667063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.075456+0000","last_change":"2024-09-17T05:22:57.078264+0000","last_active":"2024-09-17T05:22:58.075456+0000","last_peered":"2024-09-17T05:22:58.075456+0000","last_clean":"2024-09-17T05:22:58.075456+0000","last_became_active":"2024-09-17T05:22:57.077976+0000","last_became_peered":"2024-09-17T05:22:57.077976+0000","last_unstale":"2024-09-17T05:22:58.075456+0000","last_undegraded":"2024-09-17T05:22:58.075456+0000","last_fullsized":"2024-09-17T05:22:58.075456+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:05.507457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223046+0000","last_change":"2024-09-17T05:22:56.105840+0000","last_active":"2024-09-17T05:22:58.223046+0000","last_peered":"2024-09-17T05:22:58.223046+0000","last_clean":"2024-09-17T05:22:58.223046+0000","last_became_active":"2024-09-17T05:22:56.105560+0000","last_became_peered":"2024-09-17T05:22:56.105560+0000","last_unstale":"2024-09-17T05:22:58.223046+0000","last_undegraded":"2024-09-17T05:22:58.223046+0000","last_fullsized":"2024-09-17T05:22:58.223046+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:47.947025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.222868+0000","last_change":"2024-09-17T05:22:57.087376+0000","last_active":"2024-09-17T05:22:58.222868+0000","last_peered":"2024-09-17T05:22:58.222868+0000","last_clean":"2024-09-17T05:22:58.222868+0000","last_became_active":"2024-09-17T05:22:57.086552+0000","last_became_peered":"2024-09-17T05:22:57.086552+0000","last_unstale":"2024-09-17T05:22:58.222868+0000","last_undegraded":"2024-09-17T05:22:58.222868+0000","last_fullsized":"2024-09-17T05:22:58.222868+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:42.761225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104322+0000","last_change":"2024-09-17T05:22:56.102246+0000","last_active":"2024-09-17T05:22:58.104322+0000","last_peered":"2024-09-17T05:22:58.104322+0000","last_clean":"2024-09-17T05:22:58.104322+0000","last_became_active":"2024-09-17T05:22:56.101974+0000","last_became_peered":"2024-09-17T05:22:56.101974+0000","last_unstale":"2024-09-17T05:22:58.104322+0000","last_undegraded":"2024-09-17T05:22:58.104322+0000","last_fullsized":"2024-09-17T05:22:58.104322+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:37:17.220419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.104367+0000","last_change":"2024-09-17T05:22:57.081269+0000","last_active":"2024-09-17T05:22:58.104367+0000","last_peered":"2024-09-17T05:22:58.104367+0000","last_clean":"2024-09-17T05:22:58.104367+0000","last_became_active":"2024-09-17T05:22:57.079778+0000","last_became_peered":"2024-09-17T05:22:57.079778+0000","last_unstale":"2024-09-17T05:22:58.104367+0000","last_undegraded":"2024-09-17T05:22:58.104367+0000","last_fullsized":"2024-09-17T05:22:58.104367+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:16.819706+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074650+0000","last_change":"2024-09-17T05:22:56.099633+0000","last_active":"2024-09-17T05:22:58.074650+0000","last_peered":"2024-09-17T05:22:58.074650+0000","last_clean":"2024-09-17T05:22:58.074650+0000","last_became_active":"2024-09-17T05:22:56.099369+0000","last_became_peered":"2024-09-17T05:22:56.099369+0000","last_unstale":"2024-09-17T05:22:58.074650+0000","last_undegraded":"2024-09-17T05:22:58.074650+0000","last_fullsized":"2024-09-17T05:22:58.074650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:42.498047+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074145+0000","last_change":"2024-09-17T05:22:57.094919+0000","last_active":"2024-09-17T05:22:58.074145+0000","last_peered":"2024-09-17T05:22:58.074145+0000","last_clean":"2024-09-17T05:22:58.074145+0000","last_became_active":"2024-09-17T05:22:57.094637+0000","last_became_peered":"2024-09-17T05:22:57.094637+0000","last_unstale":"2024-09-17T05:22:58.074145+0000","last_undegraded":"2024-09-17T05:22:58.074145+0000","last_fullsized":"2024-09-17T05:22:58.074145+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:20:32.949203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223021+0000","last_change":"2024-09-17T05:22:56.103275+0000","last_active":"2024-09-17T05:22:58.223021+0000","last_peered":"2024-09-17T05:22:58.223021+0000","last_clean":"2024-09-17T05:22:58.223021+0000","last_became_active":"2024-09-17T05:22:56.102923+0000","last_became_peered":"2024-09-17T05:22:56.102923+0000","last_unstale":"2024-09-17T05:22:58.223021+0000","last_undegraded":"2024-09-17T05:22:58.223021+0000","last_fullsized":"2024-09-17T05:22:58.223021+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:37:27.748358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.223093+0000","last_change":"2024-09-17T05:22:57.081355+0000","last_active":"2024-09-17T05:22:58.223093+0000","last_peered":"2024-09-17T05:22:58.223093+0000","last_clean":"2024-09-17T05:22:58.223093+0000","last_became_active":"2024-09-17T05:22:57.081055+0000","last_became_peered":"2024-09-17T05:22:57.081055+0000","last_unstale":"2024-09-17T05:22:58.223093+0000","last_undegraded":"2024-09-17T05:22:58.223093+0000","last_fullsized":"2024-09-17T05:22:58.223093+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:38:42.761225+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074977+0000","last_change":"2024-09-17T05:22:56.105909+0000","last_active":"2024-09-17T05:22:58.074977+0000","last_peered":"2024-09-17T05:22:58.074977+0000","last_clean":"2024-09-17T05:22:58.074977+0000","last_became_active":"2024-09-17T05:22:56.105535+0000","last_became_peered":"2024-09-17T05:22:56.105535+0000","last_unstale":"2024-09-17T05:22:58.074977+0000","last_undegraded":"2024-09-17T05:22:58.074977+0000","last_fullsized":"2024-09-17T05:22:58.074977+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:21.881509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":13,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.102732+0000","last_change":"2024-09-17T05:22:57.094581+0000","last_active":"2024-09-17T05:22:58.102732+0000","last_peered":"2024-09-17T05:22:58.102732+0000","last_clean":"2024-09-17T05:22:58.102732+0000","last_became_active":"2024-09-17T05:22:57.094280+0000","last_became_peered":"2024-09-17T05:22:57.094280+0000","last_unstale":"2024-09-17T05:22:58.102732+0000","last_undegraded":"2024-09-17T05:22:58.102732+0000","last_fullsized":"2024-09-17T05:22:58.102732+0000","mapping_epoch":81,"log_start":"0'0","ondisk_log_start":"0'0","created":81,"last_epoch_clean":82,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:56.081737+0000","last_clean_scrub_stamp":"2024-09-17T05:22:56.081737+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:48.950788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"82'1","reported_seq":16,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074779+0000","last_change":"2024-09-17T05:22:56.105466+0000","last_active":"2024-09-17T05:22:58.074779+0000","last_peered":"2024-09-17T05:22:58.074779+0000","last_clean":"2024-09-17T05:22:58.074779+0000","last_became_active":"2024-09-17T05:22:56.105197+0000","last_became_peered":"2024-09-17T05:22:56.105197+0000","last_unstale":"2024-09-17T05:22:58.074779+0000","last_undegraded":"2024-09-17T05:22:58.074779+0000","last_fullsized":"2024-09-17T05:22:58.074779+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:22:55.077974+0000","last_clean_scrub_stamp":"2024-09-17T05:22:55.077974+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:01:52.630100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":243,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-17T05:22:58.074007+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:22:58.074007+0000","last_peered":"2024-09-17T05:22:58.074007+0000","last_clean":"2024-09-17T05:22:58.074007+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:22:58.074007+0000","last_undegraded":"2024-09-17T05:22:58.074007+0000","last_fullsized":"2024-09-17T05:22:58.074007+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509497,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28604,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343236,"statfs":{"total":96636764160,"available":96607473664,"internally_reserved":0,"allocated":1609728,"data_stored":1021741,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509497,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1024000,"data_stored":431997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509496,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1028096,"data_stored":432937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509496,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32180,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339660,"statfs":{"total":96636764160,"available":96603811840,"internally_reserved":0,"allocated":1011712,"data_stored":431303,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509496,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32192,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339648,"statfs":{"total":96636764160,"available":96603799552,"internally_reserved":0,"allocated":1024000,"data_stored":432915,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509497,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32188,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339652,"statfs":{"total":96636764160,"available":96603803648,"internally_reserved":0,"allocated":1015808,"data_stored":431885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509496,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32196,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339644,"statfs":{"total":96636764160,"available":96603795456,"internally_reserved":0,"allocated":1024000,"data_stored":431497,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1609728,"data_stored":1021705,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":12,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":13,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:01.390 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:23:01.391 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 -- 172.21.15.81:0/2759135493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 msgr2=0x7f56ec0cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 --2- 172.21.15.81:0/2759135493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 0x7f56ec0cc800 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f56e4009830 tx=0x7f56e402a480 comp rx=0 tx=0).stop 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 -- 172.21.15.81:0/2759135493 shutdown_connections 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 --2- 172.21.15.81:0/2759135493 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 0x7f56ec0cc800 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 --2- 172.21.15.81:0/2759135493 >> v2:172.21.15.160:3300/0 conn(0x7f56ec15f270 0x7f56ec072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 -- 172.21.15.81:0/2759135493 >> 172.21.15.81:0/2759135493 conn(0x7f56ec0b1700 msgr2=0x7f56ec0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 -- 172.21.15.81:0/2759135493 shutdown_connections 2024-09-17T05:23:01.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.535+0000 7f56f1789640 1 -- 172.21.15.81:0/2759135493 wait complete. 2024-09-17T05:23:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 Processor -- start 2024-09-17T05:23:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 -- start start 2024-09-17T05:23:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 0x7f56ec14bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15aa00 0x7f56ec0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56ec15f270 0x7f56ec0c7140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec06f590 con 0x7f56ec15f270 2024-09-17T05:23:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f56ec06f410 con 0x7f56ec15aa00 2024-09-17T05:23:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.537+0000 7f56f1789640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f56ec06f710 con 0x7f56ec0cc3f0 2024-09-17T05:23:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56ec15f270 0x7f56ec0c7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56ec15f270 0x7f56ec0c7140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52144/0 (socket says 172.21.15.81:52144) 2024-09-17T05:23:01.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 -- 172.21.15.81:0/264514732 learned_addr learned my addr 172.21.15.81:0/264514732 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56ea7fc640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15aa00 0x7f56ec0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eaffd640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 0x7f56ec14bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 -- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 msgr2=0x7f56ec14bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 0x7f56ec14bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 -- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15aa00 msgr2=0x7f56ec0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15aa00 0x7f56ec0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 -- 172.21.15.81:0/264514732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56ec14c4b0 con 0x7f56ec15f270 2024-09-17T05:23:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56eb7fe640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56ec15f270 0x7f56ec0c7140 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f56e402aa70 tx=0x7f56e4032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56e37fe640 1 -- 172.21.15.81:0/264514732 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4040070 con 0x7f56ec15f270 2024-09-17T05:23:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56e37fe640 1 -- 172.21.15.81:0/264514732 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f56e40038e0 con 0x7f56ec15f270 2024-09-17T05:23:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56e37fe640 1 -- 172.21.15.81:0/264514732 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56e4005c90 con 0x7f56ec15f270 2024-09-17T05:23:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56ec0c94f0 con 0x7f56ec15f270 2024-09-17T05:23:01.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.538+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56ec1e4730 con 0x7f56ec15f270 2024-09-17T05:23:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.539+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f56ec0cc800 con 0x7f56ec15f270 2024-09-17T05:23:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.540+0000 7f56e37fe640 1 -- 172.21.15.81:0/264514732 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f56e4039040 con 0x7f56ec15f270 2024-09-17T05:23:01.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.540+0000 7f56e37fe640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f56cc078cb0 0x7f56cc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.540+0000 7f56e37fe640 1 -- 172.21.15.81:0/264514732 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f56e40bc4e0 con 0x7f56ec15f270 2024-09-17T05:23:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.540+0000 7f56eaffd640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f56cc078cb0 0x7f56cc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.541+0000 7f56eaffd640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f56cc078cb0 0x7f56cc07b170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00f290 tx=0x7f56dc001a90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.545+0000 7f56e37fe640 1 -- 172.21.15.81:0/264514732 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f56e4084150 con 0x7f56ec15f270 2024-09-17T05:23:01.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.789+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f56ec0cfbf0 con 0x7f56ec15f270 2024-09-17T05:23:01.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.791+0000 7f56e37fe640 1 -- 172.21.15.81:0/264514732 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v21) ==== 190+0+147 (secure 0 0 0) 0x7f56e4088b80 con 0x7f56ec15f270 2024-09-17T05:23:01.792 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:23:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:23:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:23:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:23:01.792 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:23:01.793 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:23:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f56cc078cb0 msgr2=0x7f56cc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f56cc078cb0 0x7f56cc07b170 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f56dc00f290 tx=0x7f56dc001a90 comp rx=0 tx=0).stop 2024-09-17T05:23:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56ec15f270 msgr2=0x7f56ec0c7140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56ec15f270 0x7f56ec0c7140 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f56e402aa70 tx=0x7f56e4032c10 comp rx=0 tx=0).stop 2024-09-17T05:23:01.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 shutdown_connections 2024-09-17T05:23:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f56ec15f270 0x7f56ec0c7140 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f56cc078cb0 0x7f56cc07b170 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f56ec15aa00 0x7f56ec0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 --2- 172.21.15.81:0/264514732 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f56ec0cc3f0 0x7f56ec14bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 >> 172.21.15.81:0/264514732 conn(0x7f56ec0b1700 msgr2=0x7f56ec0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 shutdown_connections 2024-09-17T05:23:01.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.793+0000 7f56f1789640 1 -- 172.21.15.81:0/264514732 wait complete. 2024-09-17T05:23:01.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 -- 172.21.15.81:0/4140739253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc14159680 msgr2=0x7fbc1415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 --2- 172.21.15.81:0/4140739253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc14159680 0x7fbc1415d270 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7fbc1415f6b0 tx=0x7fbc0c02aac0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 -- 172.21.15.81:0/4140739253 shutdown_connections 2024-09-17T05:23:01.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 --2- 172.21.15.81:0/4140739253 >> v2:172.21.15.160:3300/0 conn(0x7fbc1415fe60 0x7fbc140ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 --2- 172.21.15.81:0/4140739253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc14159680 0x7fbc1415d270 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 -- 172.21.15.81:0/4140739253 >> 172.21.15.81:0/4140739253 conn(0x7fbc140b1690 msgr2=0x7fbc140b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:01.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 -- 172.21.15.81:0/4140739253 shutdown_connections 2024-09-17T05:23:01.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.905+0000 7fbc1c717640 1 -- 172.21.15.81:0/4140739253 wait complete. 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.906+0000 7fbc1c717640 1 Processor -- start 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.906+0000 7fbc1c717640 1 -- start start 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1c717640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc140cc490 0x7fbc14152bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1c717640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc14159680 0x7fbc1413ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1c717640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc1415fe60 0x7fbc14141f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1c717640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140cca80 con 0x7fbc140cc490 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1c717640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc140cc900 con 0x7fbc14159680 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1c717640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbc140ccc00 con 0x7fbc1415fe60 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc140cc490 0x7fbc14152bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc140cc490 0x7fbc14152bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52164/0 (socket says 172.21.15.81:52164) 2024-09-17T05:23:01.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 -- 172.21.15.81:0/165415657 learned_addr learned my addr 172.21.15.81:0/165415657 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:01.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1acb4640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc1415fe60 0x7fbc14141f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 -- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc1415fe60 msgr2=0x7fbc14141f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc19cb2640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc14159680 0x7fbc1413ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc1415fe60 0x7fbc14141f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 -- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc14159680 msgr2=0x7fbc1413ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:01.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc14159680 0x7fbc1413ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:01.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 -- 172.21.15.81:0/165415657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc141529e0 con 0x7fbc140cc490 2024-09-17T05:23:01.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1acb4640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc1415fe60 0x7fbc14141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:01.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc19cb2640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc14159680 0x7fbc1413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc1a4b3640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc140cc490 0x7fbc14152bd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c000f80 tx=0x7fbc0c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.907+0000 7fbc0affd640 1 -- 172.21.15.81:0/165415657 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c044070 con 0x7fbc140cc490 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.908+0000 7fbc0affd640 1 -- 172.21.15.81:0/165415657 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc0c004250 con 0x7fbc140cc490 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.908+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc14153490 con 0x7fbc140cc490 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.908+0000 7fbc0affd640 1 -- 172.21.15.81:0/165415657 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc0c004680 con 0x7fbc140cc490 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.908+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc141f60a0 con 0x7fbc140cc490 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.908+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc1415d270 con 0x7fbc140cc490 2024-09-17T05:23:01.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.909+0000 7fbc0affd640 1 -- 172.21.15.81:0/165415657 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fbc0c036400 con 0x7fbc140cc490 2024-09-17T05:23:01.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.909+0000 7fbc0affd640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbbf8078cb0 0x7fbbf807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:01.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.910+0000 7fbc0affd640 1 -- 172.21.15.81:0/165415657 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fbc0c0bb720 con 0x7fbc140cc490 2024-09-17T05:23:01.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.910+0000 7fbc19cb2640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbbf8078cb0 0x7fbbf807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:01.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.910+0000 7fbc19cb2640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbbf8078cb0 0x7fbbf807b170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc14156100 tx=0x7fbc04009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:01.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:01.914+0000 7fbc0affd640 1 -- 172.21.15.81:0/165415657 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbc14153490 con 0x7fbc140cc490 2024-09-17T05:23:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.125+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbc14160410 con 0x7fbc140cc490 2024-09-17T05:23:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.125+0000 7fbc0affd640 1 -- 172.21.15.81:0/165415657 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 48 v48) ==== 94+0+5231 (secure 0 0 0) 0x7fbc0c032030 con 0x7fbc140cc490 2024-09-17T05:23:02.127 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:02.127 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":48,"btime":"2024-09-17T05:23:00:080501+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3004752015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3004752015},{"type":"v1","addr":"172.21.15.81:6835","nonce":3004752015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4151219415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4151219415},{"type":"v1","addr":"172.21.15.160:6835","nonce":4151219415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":6046,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/3249546675","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3249546675},{"type":"v1","addr":"172.21.15.160:6801","nonce":3249546675}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:56.443180+0000","modified":"2024-09-17T05:22:59.178373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6834/3405352353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3405352353},{"type":"v1","addr":"172.21.15.81:6834","nonce":3405352353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6636,"qdb_cluster":[6636]},"id":6}]} 2024-09-17T05:23:02.127 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 48 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.127+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbbf8078cb0 msgr2=0x7fbbf807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbbf8078cb0 0x7fbbf807b170 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fbc14156100 tx=0x7fbc04009040 comp rx=0 tx=0).stop 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc140cc490 msgr2=0x7fbc14152bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc140cc490 0x7fbc14152bd0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fbc0c000f80 tx=0x7fbc0c003f10 comp rx=0 tx=0).stop 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 shutdown_connections 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc1415fe60 0x7fbc14141f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbbf8078cb0 0x7fbbf807b170 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc14159680 0x7fbc1413ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 --2- 172.21.15.81:0/165415657 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc140cc490 0x7fbc14152bd0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 >> 172.21.15.81:0/165415657 conn(0x7fbc140b1690 msgr2=0x7fbc140af850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 shutdown_connections 2024-09-17T05:23:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.128+0000 7fbc1c717640 1 -- 172.21.15.81:0/165415657 wait complete. 2024-09-17T05:23:02.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 48, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:22:56.443180+0000', 'modified': '2024-09-17T05:22:59.178373+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6636}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6636': {'gid': 6636, 'name': 'a', 'rank': 0, 'incarnation': 45, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.81:6834/3405352353', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6832', 'nonce': 3405352353}, {'type': 'v1', 'addr': '172.21.15.81:6834', 'nonce': 3405352353}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 6636, 'qdb_cluster': [6636]} 2024-09-17T05:23:02.543 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:23:02.543 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-09-17T05:23:02.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.644+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3533242959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2015df90 msgr2=0x7fcd200cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.644+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3533242959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2015df90 0x7fcd200cf9b0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fcd200cf6a0 tx=0x7fcd1802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.644+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3533242959 shutdown_connections 2024-09-17T05:23:02.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.644+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3533242959 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd2015df90 0x7fcd200cf9b0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.644+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3533242959 >> 172.21.15.81:0/3533242959 conn(0x7fcd200d3ea0 msgr2=0x7fcd200d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.644+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3533242959 shutdown_connections 2024-09-17T05:23:02.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.644+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3533242959 wait complete. 2024-09-17T05:23:02.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.645+0000 7fcd26a6b640 1 Processor -- start 2024-09-17T05:23:02.647 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.645+0000 7fcd26a6b640 1 -- start start 2024-09-17T05:23:02.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd26a6b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200d0d40 0x7fcd200b88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd26a6b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd200d49c0 0x7fcd200b1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd26a6b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2015df90 0x7fcd200b2480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd26a6b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd20162690 con 0x7fcd200d0d40 2024-09-17T05:23:02.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd26a6b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcd200b3f10 con 0x7fcd200d49c0 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd26a6b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcd201f8490 con 0x7fcd2015df90 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd24807640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200d0d40 0x7fcd200b88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd24807640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200d0d40 0x7fcd200b88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52184/0 (socket says 172.21.15.81:52184) 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.646+0000 7fcd24807640 1 -- 172.21.15.81:0/3888044652 learned_addr learned my addr 172.21.15.81:0/3888044652 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd200d49c0 0x7fcd200b1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd25008640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2015df90 0x7fcd200b2480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd24807640 1 -- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2015df90 msgr2=0x7fcd200b2480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd24807640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2015df90 0x7fcd200b2480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd24807640 1 -- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd200d49c0 msgr2=0x7fcd200b1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd24807640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd200d49c0 0x7fcd200b1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd24807640 1 -- 172.21.15.81:0/3888044652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd201f8730 con 0x7fcd200d0d40 2024-09-17T05:23:02.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd25008640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2015df90 0x7fcd200b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:02.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd24807640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200d0d40 0x7fcd200b88e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034040 tx=0x7fcd180038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd1d7fa640 1 -- 172.21.15.81:0/3888044652 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd1803e030 con 0x7fcd200d0d40 2024-09-17T05:23:02.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd1d7fa640 1 -- 172.21.15.81:0/3888044652 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd18003db0 con 0x7fcd200d0d40 2024-09-17T05:23:02.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd1d7fa640 1 -- 172.21.15.81:0/3888044652 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18035040 con 0x7fcd200d0d40 2024-09-17T05:23:02.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd201f8a10 con 0x7fcd200d0d40 2024-09-17T05:23:02.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.647+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd201f8fd0 con 0x7fcd200d0d40 2024-09-17T05:23:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.649+0000 7fcd1d7fa640 1 -- 172.21.15.81:0/3888044652 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fcd18041030 con 0x7fcd200d0d40 2024-09-17T05:23:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.649+0000 7fcd1d7fa640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd00078cb0 0x7fcd0007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.649+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd00078cb0 0x7fcd0007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.649+0000 7fcd1d7fa640 1 -- 172.21.15.81:0/3888044652 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fcd180bb470 con 0x7fcd200d0d40 2024-09-17T05:23:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.650+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd00078cb0 0x7fcd0007b170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd2015bbb0 tx=0x7fcd08009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.650+0000 7fcd29830740 1 Processor -- start 2024-09-17T05:23:02.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.650+0000 7fcd29830740 1 -- start start 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e523ab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e52831f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd29830740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e52385f0 0x55a0e5238a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd29830740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a0e51af820 con 0x55a0e52385f0 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a0e519ec50 con 0x55a0e52631b0 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55a0e51a2a60 con 0x55a0e5282df0 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e52385f0 0x55a0e5238a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e52385f0 0x55a0e5238a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52190/0 (socket says 172.21.15.81:52190) 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 -- 172.21.15.81:0/346426065 learned_addr learned my addr 172.21.15.81:0/346426065 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd24807640 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e523ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e52831f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 -- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 msgr2=0x55a0e52831f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e52831f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 -- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 msgr2=0x55a0e523ab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e523ab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 -- 172.21.15.81:0/346426065 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e4f00850 con 0x55a0e52385f0 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd24807640 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e523ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd25008640 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e52385f0 0x55a0e5238a40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fcd10001e40 tx=0x7fcd1000d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18f3f0b68ab15380 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd167fc640 1 -- 172.21.15.81:0/346426065 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10018070 con 0x55a0e52385f0 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd167fc640 1 -- 172.21.15.81:0/346426065 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd10003970 con 0x55a0e52385f0 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.651+0000 7fcd167fc640 1 -- 172.21.15.81:0/346426065 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10003dc0 con 0x55a0e52385f0 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 -- 172.21.15.81:0/346426065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e52385f0 msgr2=0x55a0e5238a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e52385f0 0x55a0e5238a40 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fcd10001e40 tx=0x7fcd1000d520 comp rx=0 tx=0).stop 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 -- 172.21.15.81:0/346426065 shutdown_connections 2024-09-17T05:23:02.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e52385f0 0x55a0e5238a40 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e52831f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 --2- 172.21.15.81:0/346426065 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e523ab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 -- 172.21.15.81:0/346426065 >> 172.21.15.81:0/346426065 conn(0x55a0e52396a0 msgr2=0x55a0e523d0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 -- 172.21.15.81:0/346426065 shutdown_connections 2024-09-17T05:23:02.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.652+0000 7fcd29830740 1 -- 172.21.15.81:0/346426065 wait complete. 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.653+0000 7fcd29830740 1 -- start start 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.653+0000 7fcd29830740 1 Processor -- start 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e5294df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e527b300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52365d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a0e4f0f620 con 0x55a0e525b140 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a0e51445f0 con 0x55a0e52631b0 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55a0e5237b30 con 0x55a0e5282df0 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 10 client.0 _ll_register_callbacks cb 0x55a0e51480a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52365d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52365d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52206/0 (socket says 172.21.15.81:52206) 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 -- 172.21.15.81:0/4042869924 learned_addr learned my addr 172.21.15.81:0/4042869924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd24807640 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e5294df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e527b300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 -- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 msgr2=0x55a0e527b300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e527b300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 -- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 msgr2=0x55a0e5294df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e5294df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 -- 172.21.15.81:0/4042869924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e4f776b0 con 0x55a0e525b140 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd25008640 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52365d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x55a0e5283c30 tx=0x7fcd10006f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=275097b49aede34d server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fccff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fccff7fe640 1 -- 172.21.15.81:0/4042869924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10023060 con 0x55a0e525b140 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fccff7fe640 1 -- 172.21.15.81:0/4042869924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fcd10003d30 con 0x55a0e525b140 2024-09-17T05:23:02.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd10003970 con 0x55a0e525b140 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fccff7fe640 1 -- 172.21.15.81:0/4042869924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fcd10029050 con 0x55a0e525b140 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 10 client.6765 fetch_fsmap learned FSMap version 48 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x55a0e525f5a0 con 0x55a0e525b140 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.654+0000 7fccff7fe640 1 -- 172.21.15.81:0/4042869924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd10003970 con 0x55a0e525b140 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fccff7fe640 1 -- 172.21.15.81:0/4042869924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7fcd100050d0 con 0x55a0e525b140 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd29830740 10 client.6765 fetch_fsmap finished waiting for FSMap version 48 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd29830740 10 client.6765 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd29830740 20 client.6765 populate_metadata read hostname 'smithi081' 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd29830740 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e525c570 0x55a0e525e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd29830740 4 client.6765 mds_command: new command op to 6636 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 --> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0e51b1770 con 0x55a0e525c570 2024-09-17T05:23:02.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd24807640 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e525c570 0x55a0e525e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fccff7fe640 10 client.6765 ms_handle_connect on v2:172.21.15.81:6832/3405352353 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.655+0000 7fcd24807640 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e525c570 0x55a0e525e760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a8da407cfe195586 server_cookie=cfe945d7782edc8c in_seq=0 out_seq=0 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fccff7fe640 1 -- 172.21.15.81:0/4042869924 <== mds.0 v2:172.21.15.81:6832/3405352353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55a0e51b1770 con 0x55a0e525c570 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fccff7fe640 10 client.6765 handle_command_reply: tid=0 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 client.6765 shutdown 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 msgr2=0x55a0e52365d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52365d0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x55a0e5283c30 tx=0x7fcd10006f80 comp rx=0 tx=0).stop 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 shutdown_connections 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e525c570 0x55a0e525e760 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fccff7fe640 0 client.6765 ms_handle_reset on v2:172.21.15.81:6832/3405352353 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52365d0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e527b300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 --2- 172.21.15.81:0/4042869924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e5294df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 >> 172.21.15.81:0/4042869924 conn(0x55a0e52385f0 msgr2=0x55a0e523d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 shutdown_connections 2024-09-17T05:23:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 1 -- 172.21.15.81:0/4042869924 wait complete. 2024-09-17T05:23:02.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.656+0000 7fcd29830740 20 client.6765 trim_cache size 0 max 16384 2024-09-17T05:23:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.674+0000 7fcd29830740 1 Processor -- start 2024-09-17T05:23:02.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.674+0000 7fcd29830740 1 -- start start 2024-09-17T05:23:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e525b140 0x55a0e5263ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e52631b0 0x55a0e5263ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd29830740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e5282df0 0x55a0e525e730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd29830740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd202004f0 con 0x55a0e5282df0 2024-09-17T05:23:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcd200c8330 con 0x55a0e525b140 2024-09-17T05:23:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcd201f56b0 con 0x55a0e52631b0 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e5282df0 0x55a0e525e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e5282df0 0x55a0e525e730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52220/0 (socket says 172.21.15.81:52220) 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 -- 172.21.15.81:0/2207451755 learned_addr learned my addr 172.21.15.81:0/2207451755 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 -- 172.21.15.81:0/2207451755 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e52631b0 msgr2=0x55a0e5263ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 --2- 172.21.15.81:0/2207451755 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e52631b0 0x55a0e5263ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 -- 172.21.15.81:0/2207451755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e525b140 msgr2=0x55a0e5263ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 --2- 172.21.15.81:0/2207451755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e525b140 0x55a0e5263ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 -- 172.21.15.81:0/2207451755 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0e5237c10 con 0x55a0e5282df0 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.675+0000 7fcd25008640 1 --2- 172.21.15.81:0/2207451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e5282df0 0x55a0e525e730 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fcd10001c90 tx=0x7fcd10001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6057e6c1547f21db server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd15ffb640 1 -- 172.21.15.81:0/2207451755 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd10018070 con 0x55a0e5282df0 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd15ffb640 1 -- 172.21.15.81:0/2207451755 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd10019040 con 0x55a0e5282df0 2024-09-17T05:23:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd15ffb640 1 -- 172.21.15.81:0/2207451755 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd100014a0 con 0x55a0e5282df0 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 -- 172.21.15.81:0/2207451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e5282df0 msgr2=0x55a0e525e730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 --2- 172.21.15.81:0/2207451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e5282df0 0x55a0e525e730 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7fcd10001c90 tx=0x7fcd10001cc0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 -- 172.21.15.81:0/2207451755 shutdown_connections 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 --2- 172.21.15.81:0/2207451755 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e5282df0 0x55a0e525e730 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 --2- 172.21.15.81:0/2207451755 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e52631b0 0x55a0e5263ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 --2- 172.21.15.81:0/2207451755 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e525b140 0x55a0e5263ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 -- 172.21.15.81:0/2207451755 >> 172.21.15.81:0/2207451755 conn(0x55a0e52385f0 msgr2=0x55a0e525a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 -- 172.21.15.81:0/2207451755 shutdown_connections 2024-09-17T05:23:02.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.676+0000 7fcd29830740 1 -- 172.21.15.81:0/2207451755 wait complete. 2024-09-17T05:23:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.677+0000 7fcd29830740 1 -- start start 2024-09-17T05:23:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.677+0000 7fcd29830740 1 Processor -- start 2024-09-17T05:23:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52a5440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e52a5980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e5260300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55a0e525c3f0 con 0x55a0e525b140 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55a0e527b840 con 0x55a0e52631b0 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55a0e525c9f0 con 0x55a0e5282df0 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 10 client.0 _ll_register_callbacks cb 0x7fcd10016070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52a5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52a5440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52224/0 (socket says 172.21.15.81:52224) 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 -- 172.21.15.81:0/547840276 learned_addr learned my addr 172.21.15.81:0/547840276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd25008640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e5260300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e52a5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 -- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 msgr2=0x55a0e5260300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e5260300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 -- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 msgr2=0x55a0e52a5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e52a5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 -- 172.21.15.81:0/547840276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0e5301e40 con 0x55a0e525b140 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd25008640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e5260300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e52a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd24807640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52a5440 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcd18082db0 tx=0x7fcd18005a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70d64ff7c8e0c1ad server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fccff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fccff7fe640 1 -- 172.21.15.81:0/547840276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd18048040 con 0x55a0e525b140 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fccff7fe640 1 -- 172.21.15.81:0/547840276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fcd1807f320 con 0x55a0e525b140 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.678+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcd10019040 con 0x55a0e525b140 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fccff7fe640 1 -- 172.21.15.81:0/547840276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=48) ==== 24+0+0 (secure 0 0 0) 0x7fcd180837b0 con 0x55a0e525b140 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 10 client.6771 fetch_fsmap learned FSMap version 48 2024-09-17T05:23:02.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=48,monmap=2+}) -- 0x55a0e529ab80 con 0x55a0e525b140 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fccff7fe640 1 -- 172.21.15.81:0/547840276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd10019040 con 0x55a0e525b140 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fccff7fe640 1 -- 172.21.15.81:0/547840276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 48) ==== 3502+0+0 (secure 0 0 0) 0x7fcd180bb0b0 con 0x55a0e525b140 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 10 client.6771 fetch_fsmap finished waiting for FSMap version 48 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 10 client.6771 resolve_mds: resolved name 'a' to daemon mds.a 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 20 client.6771 populate_metadata read hostname 'smithi081' 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e5299d10 0x55a0e529a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 4 client.6771 mds_command: new command op to 6636 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 --> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] -- command(tid 0: {"prefix": "status"}) -- 0x55a0e51ad220 con 0x55a0e5299d10 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e5299d10 0x55a0e529a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fccff7fe640 10 client.6771 ms_handle_connect on v2:172.21.15.81:6832/3405352353 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.679+0000 7fcd1ffff640 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e5299d10 0x55a0e529a0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2df85149db610fd8 server_cookie=b5652a8d34077ca9 in_seq=0 out_seq=0 2024-09-17T05:23:02.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fccff7fe640 1 -- 172.21.15.81:0/547840276 <== mds.0 v2:172.21.15.81:6832/3405352353 1 ==== command_reply(tid 0: 0 ) ==== 8+0+324 (crc 0 0 0) 0x55a0e51ad220 con 0x55a0e5299d10 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fccff7fe640 10 client.6771 handle_command_reply: tid=0 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 client.6771 shutdown 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 msgr2=0x55a0e52a5440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52a5440 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7fcd18082db0 tx=0x7fcd18005a60 comp rx=0 tx=0).stop 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 shutdown_connections 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:6832/3405352353,v1:172.21.15.81:6834/3405352353] conn(0x55a0e5299d10 0x55a0e529a0f0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55a0e5282df0 0x55a0e5260300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55a0e52631b0 0x55a0e52a5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fccff7fe640 0 client.6771 ms_handle_reset on v2:172.21.15.81:6832/3405352353 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 --2- 172.21.15.81:0/547840276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55a0e525b140 0x55a0e52a5440 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 >> 172.21.15.81:0/547840276 conn(0x55a0e52385f0 msgr2=0x55a0e5263ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 shutdown_connections 2024-09-17T05:23:02.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 1 -- 172.21.15.81:0/547840276 wait complete. 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd29830740 20 client.6771 trim_cache size 0 max 16384 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6636, 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:23:02.688 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.583862055, 2024-09-17T05:23:02.689 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 48, 2024-09-17T05:23:02.689 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 83, 2024-09-17T05:23:02.689 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 83, 2024-09-17T05:23:02.689 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 9.3571719790000003 2024-09-17T05:23:02.689 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd00078cb0 msgr2=0x7fcd0007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd00078cb0 0x7fcd0007b170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fcd2015bbb0 tx=0x7fcd08009040 comp rx=0 tx=0).stop 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200d0d40 msgr2=0x7fcd200b88e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200d0d40 0x7fcd200b88e0 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fcd18034040 tx=0x7fcd180038a0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 shutdown_connections 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd2015df90 0x7fcd200b2480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd00078cb0 0x7fcd0007b170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd200d49c0 0x7fcd200b1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.680+0000 7fcd26a6b640 1 --2- 172.21.15.81:0/3888044652 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd200d0d40 0x7fcd200b88e0 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.681+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 >> 172.21.15.81:0/3888044652 conn(0x7fcd200d3ea0 msgr2=0x7fcd200cf9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.681+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 shutdown_connections 2024-09-17T05:23:02.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.681+0000 7fcd26a6b640 1 -- 172.21.15.81:0/3888044652 wait complete. 2024-09-17T05:23:02.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.791+0000 7fc2638cd640 1 -- 172.21.15.81:0/807735044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 msgr2=0x7fc25c0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.791+0000 7fc2638cd640 1 --2- 172.21.15.81:0/807735044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c0739d0 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7fc250005fd0 tx=0x7fc25002a810 comp rx=0 tx=0).stop 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.791+0000 7fc2638cd640 1 -- 172.21.15.81:0/807735044 shutdown_connections 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.791+0000 7fc2638cd640 1 --2- 172.21.15.81:0/807735044 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc25c06ff80 0x7fc25c070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.791+0000 7fc2638cd640 1 --2- 172.21.15.81:0/807735044 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c0739d0 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.791+0000 7fc2638cd640 1 -- 172.21.15.81:0/807735044 >> 172.21.15.81:0/807735044 conn(0x7fc25c0b1690 msgr2=0x7fc25c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.792+0000 7fc2638cd640 1 -- 172.21.15.81:0/807735044 shutdown_connections 2024-09-17T05:23:02.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.792+0000 7fc2638cd640 1 -- 172.21.15.81:0/807735044 wait complete. 2024-09-17T05:23:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 Processor -- start 2024-09-17T05:23:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 -- start start 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc25c06ff80 0x7fc25c13ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c1e3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc25c15aa70 0x7fc25c1e3550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c0cd270 con 0x7fc25c0735a0 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc25c0cd0f0 con 0x7fc25c15aa70 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.793+0000 7fc2638cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc25c0cd3f0 con 0x7fc25c06ff80 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c1e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c1e3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:52228/0 (socket says 172.21.15.81:52228) 2024-09-17T05:23:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 -- 172.21.15.81:0/3417429951 learned_addr learned my addr 172.21.15.81:0/3417429951 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc261669640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc25c06ff80 0x7fc25c13ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc261e6a640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc25c15aa70 0x7fc25c1e3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 -- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc25c06ff80 msgr2=0x7fc25c13ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc25c06ff80 0x7fc25c13ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 -- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc25c15aa70 msgr2=0x7fc25c1e3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc25c15aa70 0x7fc25c1e3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 -- 172.21.15.81:0/3417429951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc25c152aa0 con 0x7fc25c0735a0 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc260e68640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c1e3010 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc250009b30 tx=0x7fc250031650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc259ffb640 1 -- 172.21.15.81:0/3417429951 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250041070 con 0x7fc25c0735a0 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc259ffb640 1 -- 172.21.15.81:0/3417429951 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc250031b40 con 0x7fc25c0735a0 2024-09-17T05:23:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc25c13f360 con 0x7fc25c0735a0 2024-09-17T05:23:02.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.794+0000 7fc259ffb640 1 -- 172.21.15.81:0/3417429951 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc250037040 con 0x7fc25c0735a0 2024-09-17T05:23:02.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.795+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc25c1e3f00 con 0x7fc25c0735a0 2024-09-17T05:23:02.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.796+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc25c0cd8a0 con 0x7fc25c0735a0 2024-09-17T05:23:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.796+0000 7fc259ffb640 1 -- 172.21.15.81:0/3417429951 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fc250044070 con 0x7fc25c0735a0 2024-09-17T05:23:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.797+0000 7fc259ffb640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc248078cb0 0x7fc24807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.797+0000 7fc261669640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc248078cb0 0x7fc24807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.797+0000 7fc259ffb640 1 -- 172.21.15.81:0/3417429951 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fc2500bbe90 con 0x7fc25c0735a0 2024-09-17T05:23:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.797+0000 7fc261669640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc248078cb0 0x7fc24807b170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001720 tx=0x7fc24c007e90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:02.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:02.801+0000 7fc259ffb640 1 -- 172.21.15.81:0/3417429951 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc25c152aa0 con 0x7fc25c0735a0 2024-09-17T05:23:03.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.014+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc25c0cdd70 con 0x7fc25c0735a0 2024-09-17T05:23:03.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.014+0000 7fc259ffb640 1 -- 172.21.15.81:0/3417429951 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7fc250083af0 con 0x7fc25c0735a0 2024-09-17T05:23:03.016 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:23:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc248078cb0 msgr2=0x7fc24807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc248078cb0 0x7fc24807b170 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc24c001720 tx=0x7fc24c007e90 comp rx=0 tx=0).stop 2024-09-17T05:23:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 msgr2=0x7fc25c1e3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c1e3010 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7fc250009b30 tx=0x7fc250031650 comp rx=0 tx=0).stop 2024-09-17T05:23:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 shutdown_connections 2024-09-17T05:23:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc248078cb0 0x7fc24807b170 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc25c15aa70 0x7fc25c1e3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc25c0735a0 0x7fc25c1e3010 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 --2- 172.21.15.81:0/3417429951 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc25c06ff80 0x7fc25c13ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 >> 172.21.15.81:0/3417429951 conn(0x7fc25c0b1690 msgr2=0x7fc25c15b660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 shutdown_connections 2024-09-17T05:23:03.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03.017+0000 7fc2638cd640 1 -- 172.21.15.81:0/3417429951 wait complete. 2024-09-17T05:23:03.028 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:23:03.028 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:23:03.028 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:23:03.028 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:23:03.028 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:03.029 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:23:03.029 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:23:03.029 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:23:03.029 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:23:03.029 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.029 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:23:03.045 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:23:03.045 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:23:03.045 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:23:03.045 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:03.045 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:03.046 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42535sec preferred_lft 42535sec 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:23:03.047 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:03.048 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:03.048 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:03.048 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:23:03.048 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:03.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.048 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:23:03.109 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:23:03.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.111 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:23:03.167 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:23:03.167 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:23:03.167 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:23:03.167 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:23:03.167 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:23:03.167 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:23:03.168 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:23:03.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:23:03.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:23:03.168 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:23:03.168 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:23:03.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:23:03.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:03.292 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.292 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:23:03.308 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:23:03.308 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:23:03.308 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:23:03.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.308 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:23:03.372 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:23:03.372 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:03.373 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:03.428 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:23:03.428 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:03.428 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:03.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:23:03.550 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:03.608 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:23:03.609 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:23:03.610 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:03.611 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:03.612 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.612 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:23:03.664 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:23:03.664 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:23:03.706 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:23:03.731 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:23:03.787 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:03.788 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:03.789 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:03.790 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:03.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.790 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:23:03.790 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:23:03.786+0000 7f7f89087480 -1 init, newargv = 0x560fb38e8670 newargc=15 2024-09-17T05:23:03.791 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[61427]: starting ceph client 2024-09-17T05:23:03.791 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[61427]: starting fuse 2024-09-17T05:23:03.805 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:23:03.805 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:23:03.806 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:23:03.807 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:23:03.808 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:03.808 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:23:03.808 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:23:03.924 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.61427.asok 2024-09-17T05:23:03.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:03.934 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.61427.asok 2024-09-17T05:23:03.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:03.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.61427.asok status 2024-09-17T05:23:04.068 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:04.068 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:23:04.068 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:23:04.068 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:23:04.068 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "61427", 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 6786, 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:23:04.069 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 6786 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2158675916 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2158675916 2024-09-17T05:23:04.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.6786 192.168.0.1:0/2158675916", 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2158675916", 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 48, 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 83, 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:23:04.071 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:04.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:04.076 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:23:04.077 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:04.092 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:23:04.092 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:04.093 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:04.093 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:04.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:23:04.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.298+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1261143898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a4003a00 msgr2=0x7fc4a4003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.298+0000 7fc4c0bdb640 1 --2- 172.21.15.81:0/1261143898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4a4003a00 0x7fc4a4003e20 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac006fd0 tx=0x7fc4a4005830 comp rx=0 tx=0).stop 2024-09-17T05:23:04.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.298+0000 7fc4bad9d640 1 -- 172.21.15.81:0/1261143898 reap_dead start 2024-09-17T05:23:04.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.299+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1261143898 shutdown_connections 2024-09-17T05:23:04.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.299+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1261143898 >> 172.21.15.81:0/1261143898 conn(0x7fc4bc0d0c20 msgr2=0x7fc4bc0d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:04.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.299+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1261143898 shutdown_connections 2024-09-17T05:23:04.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.299+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1261143898 wait complete. 2024-09-17T05:23:04.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.300+0000 7fc4c0bdb640 1 Processor -- start 2024-09-17T05:23:04.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.300+0000 7fc4c0bdb640 1 -- start start 2024-09-17T05:23:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4c0bdb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4a4003a00 0x7fc4bc157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4c0bdb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4bc0b66f0 0x7fc4bc15c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4c0bdb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4bc15daf0 0x7fc4bc15ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4c0bdb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc0d0820 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4c0bdb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc4bc0d06a0 con 0x7fc4bc15daf0 2024-09-17T05:23:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4c0bdb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc4bc0cb890 con 0x7fc4a4003a00 2024-09-17T05:23:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4bc0b66f0 0x7fc4bc15c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4bc0b66f0 0x7fc4bc15c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49118/0 (socket says 172.21.15.81:49118) 2024-09-17T05:23:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 -- 172.21.15.81:0/1250140910 learned_addr learned my addr 172.21.15.81:0/1250140910 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4bad9d640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4bc15daf0 0x7fc4bc15ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4ba59c640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4a4003a00 0x7fc4bc157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 -- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4a4003a00 msgr2=0x7fc4bc157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4a4003a00 0x7fc4bc157c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 -- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4bc15daf0 msgr2=0x7fc4bc15ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4bc15daf0 0x7fc4bc15ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 -- 172.21.15.81:0/1250140910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4bc1f84f0 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4bad9d640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4bc15daf0 0x7fc4bc15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:04.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4b9d9b640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4bc0b66f0 0x7fc4bc15c8d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000fa00 tx=0x7fc4b000fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4aaffd640 1 -- 172.21.15.81:0/1250140910 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b000bc50 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4aaffd640 1 -- 172.21.15.81:0/1250140910 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc4b0011440 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4bc15d5a0 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.301+0000 7fc4aaffd640 1 -- 172.21.15.81:0/1250140910 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0011890 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.302+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4bc09eee0 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.303+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc4bc0b6ba0 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.303+0000 7fc4aaffd640 1 -- 172.21.15.81:0/1250140910 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fc4b0019020 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.304+0000 7fc4aaffd640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc49c078cb0 0x7fc49c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.304+0000 7fc4ba59c640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc49c078cb0 0x7fc49c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.304+0000 7fc4aaffd640 1 -- 172.21.15.81:0/1250140910 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fc4b009b820 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.304+0000 7fc4ba59c640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc49c078cb0 0x7fc49c07b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac033000 tx=0x7fc4bc0d0150 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:04.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.308+0000 7fc4aaffd640 1 -- 172.21.15.81:0/1250140910 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc4b0063ad0 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.518+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fc4bc0b4870 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.519+0000 7fc4aaffd640 1 -- 172.21.15.81:0/1250140910 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v48) ==== 53+0+73 (secure 0 0 0) 0x7fc4b00633d0 con 0x7fc4bc0b66f0 2024-09-17T05:23:04.520 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc49c078cb0 msgr2=0x7fc49c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc49c078cb0 0x7fc49c07b170 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc4ac033000 tx=0x7fc4bc0d0150 comp rx=0 tx=0).stop 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4bc0b66f0 msgr2=0x7fc4bc15c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4bc0b66f0 0x7fc4bc15c8d0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7fc4b000fa00 tx=0x7fc4b000fec0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 shutdown_connections 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc49c078cb0 0x7fc49c07b170 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc4bc15daf0 0x7fc4bc15ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc4bc0b66f0 0x7fc4bc15c8d0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 --2- 172.21.15.81:0/1250140910 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc4a4003a00 0x7fc4bc157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 >> 172.21.15.81:0/1250140910 conn(0x7fc4bc0d0c20 msgr2=0x7fc4bc0b5490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 shutdown_connections 2024-09-17T05:23:04.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:04.521+0000 7fc4c0bdb640 1 -- 172.21.15.81:0/1250140910 wait complete. 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:23:04.533 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:23:04.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:04.534 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:04.554 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:04.555 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42531sec preferred_lft 42531sec 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:23:04.556 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:04.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:04.558 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:23:04.622 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:23:04.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:04.624 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:23:04.683 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:23:04.683 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:23:04.683 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:23:04.683 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:23:04.684 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:23:04.684 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:23:04.684 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:23:04.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:23:04.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:23:04.684 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:23:04.684 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:23:04.775 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:23:04 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:23:04.809 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:23:04 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:04.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:04.815 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:23:04.831 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:23:04.831 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:23:04.832 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:23:04.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:04.832 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:23:04.897 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:23:04.897 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:04.897 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:04.953 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:23:04.953 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:04.953 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:05.008 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:23:05.074 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:05.131 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:23:05.131 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:05.132 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:23:05.133 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:05.134 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:05.134 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:23:05.187 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:23:05.187 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:23:05.229 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:23:05.253 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:23:05.310 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:05.311 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:23:05.312 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:23:05.313 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:05.313 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:05.313 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:05.313 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:05.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:05.313 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:23:05.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:23:05.311+0000 7fe8527d4480 -1 init, newargv = 0x559bc5a40560 newargc=15 2024-09-17T05:23:05.314 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[46725]: starting ceph client 2024-09-17T05:23:05.316 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[46725]: starting fuse 2024-09-17T05:23:05.329 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:23:05.330 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:23:05.330 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:23:05.331 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:23:05.332 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:23:05.332 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:23:05.332 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:05.332 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:23:05.332 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:23:05.447 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.46725.asok 2024-09-17T05:23:05.450 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:23:05 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:05.458 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.46725.asok 2024-09-17T05:23:05.458 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:05.458 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.46725.asok status 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "46725", 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:23:05.593 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:05.594 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:23:05.594 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:23:05.594 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 5855, 2024-09-17T05:23:05.594 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:23:05.594 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:23:05.594 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:23:05.594 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 5855 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 4100170597 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:05.595 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 4100170597 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.5855 192.168.0.1:0/4100170597", 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/4100170597", 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 48, 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 83, 2024-09-17T05:23:05.596 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:23:05.597 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:23:05.597 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:23:05.597 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:23:05.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:05.603 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:23:05.603 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:05.618 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:23:05.619 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:05.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:05.619 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:05.684 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:23:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.801+0000 7fb8abe62640 1 -- 172.21.15.81:0/3109295981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4158770 msgr2=0x7fb8a415ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.801+0000 7fb8abe62640 1 --2- 172.21.15.81:0/3109295981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4158770 0x7fb8a415ba50 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0009830 tx=0x7fb8a002a480 comp rx=0 tx=0).stop 2024-09-17T05:23:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.801+0000 7fb8abe62640 1 -- 172.21.15.81:0/3109295981 shutdown_connections 2024-09-17T05:23:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.801+0000 7fb8abe62640 1 --2- 172.21.15.81:0/3109295981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8a4070590 0x7fb8a41595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.801+0000 7fb8abe62640 1 --2- 172.21.15.81:0/3109295981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a4158770 0x7fb8a415ba50 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.801+0000 7fb8abe62640 1 -- 172.21.15.81:0/3109295981 >> 172.21.15.81:0/3109295981 conn(0x7fb8a40b1620 msgr2=0x7fb8a40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.801+0000 7fb8abe62640 1 -- 172.21.15.81:0/3109295981 shutdown_connections 2024-09-17T05:23:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.802+0000 7fb8abe62640 1 -- 172.21.15.81:0/3109295981 wait complete. 2024-09-17T05:23:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.803+0000 7fb8abe62640 1 Processor -- start 2024-09-17T05:23:05.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.803+0000 7fb8abe62640 1 -- start start 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.803+0000 7fb8abe62640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a4070590 0x7fb8a41f8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.803+0000 7fb8abe62640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8a4073190 0x7fb8a41e5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.803+0000 7fb8abe62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a41f5aa0 0x7fb8a41f4600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8abe62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a415a150 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8abe62640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb8a4159fd0 con 0x7fb8a4070590 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8abe62640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb8a415a2d0 con 0x7fb8a4073190 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a41f5aa0 0x7fb8a41f4600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a41f5aa0 0x7fb8a41f4600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49132/0 (socket says 172.21.15.81:49132) 2024-09-17T05:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 -- 172.21.15.81:0/550638325 learned_addr learned my addr 172.21.15.81:0/550638325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8a9bfe640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a4070590 0x7fb8a41f8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8a93fd640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8a4073190 0x7fb8a41e5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 -- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8a4073190 msgr2=0x7fb8a41e5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8a4073190 0x7fb8a41e5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 -- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a4070590 msgr2=0x7fb8a41f8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a4070590 0x7fb8a41f8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 -- 172.21.15.81:0/550638325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8a41e65a0 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8aa3ff640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a41f5aa0 0x7fb8a41f4600 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00ea00 tx=0x7fb89c00eec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb89a7fc640 1 -- 172.21.15.81:0/550638325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c00cd80 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb89a7fc640 1 -- 172.21.15.81:0/550638325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb89c004c30 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8a41f4fc0 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb89a7fc640 1 -- 172.21.15.81:0/550638325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb89c005280 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.804+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8a41f5580 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.805+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8a415a780 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.806+0000 7fb89a7fc640 1 -- 172.21.15.81:0/550638325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fb89c005420 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.807+0000 7fb89a7fc640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb888078cb0 0x7fb88807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:05.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.807+0000 7fb8a9bfe640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb888078cb0 0x7fb88807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:05.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.807+0000 7fb89a7fc640 1 -- 172.21.15.81:0/550638325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fb89c09b940 con 0x7fb8a41f5aa0 2024-09-17T05:23:05.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.807+0000 7fb8a9bfe640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb888078cb0 0x7fb88807b170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0034000 tx=0x7fb8a0004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:05.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:05.811+0000 7fb89a7fc640 1 -- 172.21.15.81:0/550638325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb89c016030 con 0x7fb8a41f5aa0 2024-09-17T05:23:06.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.023+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7fb8a41f5750 con 0x7fb8a41f5aa0 2024-09-17T05:23:06.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.097+0000 7fb89a7fc640 1 -- 172.21.15.81:0/550638325 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v49) ==== 136+0+0 (secure 0 0 0) 0x7fb89c063bf0 con 0x7fb8a41f5aa0 2024-09-17T05:23:06.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb888078cb0 msgr2=0x7fb88807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb888078cb0 0x7fb88807b170 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fb8a0034000 tx=0x7fb8a0004730 comp rx=0 tx=0).stop 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a41f5aa0 msgr2=0x7fb8a41f4600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a41f5aa0 0x7fb8a41f4600 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb89c00ea00 tx=0x7fb89c00eec0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 shutdown_connections 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8a41f5aa0 0x7fb8a41f4600 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8a4073190 0x7fb8a41e5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb888078cb0 0x7fb88807b170 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 --2- 172.21.15.81:0/550638325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8a4070590 0x7fb8a41f8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 >> 172.21.15.81:0/550638325 conn(0x7fb8a40b1620 msgr2=0x7fb8a415c7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 shutdown_connections 2024-09-17T05:23:06.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.100+0000 7fb8abe62640 1 -- 172.21.15.81:0/550638325 wait complete. 2024-09-17T05:23:06.114 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:23:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.215+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2302446347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 msgr2=0x7fcee0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.215+0000 7fcefe8bd640 1 --2- 172.21.15.81:0/2302446347 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 0x7fcee0004c80 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7fceec00baf0 tx=0x7fcee0005830 comp rx=0 tx=0).stop 2024-09-17T05:23:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.215+0000 7fcefce5a640 1 -- 172.21.15.81:0/2302446347 reap_dead start 2024-09-17T05:23:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.215+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2302446347 shutdown_connections 2024-09-17T05:23:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.215+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2302446347 >> 172.21.15.81:0/2302446347 conn(0x7fcef80b1690 msgr2=0x7fcef80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.215+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2302446347 shutdown_connections 2024-09-17T05:23:06.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.215+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2302446347 wait complete. 2024-09-17T05:23:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.216+0000 7fcefe8bd640 1 Processor -- start 2024-09-17T05:23:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcefe8bd640 1 -- start start 2024-09-17T05:23:06.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcefe8bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 0x7fcef8146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcefe8bd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcef81f6710 0x7fcef8152200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcefe8bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef81f5ac0 0x7fcef81f5f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcefe8bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcef806e760 con 0x7fcee0004800 2024-09-17T05:23:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcefe8bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcef806e5e0 con 0x7fcef81f5ac0 2024-09-17T05:23:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcefe8bd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcef806e8e0 con 0x7fcef81f6710 2024-09-17T05:23:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.217+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 0x7fcef8146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 0x7fcef8146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49140/0 (socket says 172.21.15.81:49140) 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 -- 172.21.15.81:0/2691351881 learned_addr learned my addr 172.21.15.81:0/2691351881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef77fe640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcef81f6710 0x7fcef8152200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcefce5a640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef81f5ac0 0x7fcef81f5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 -- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcef81f6710 msgr2=0x7fcef8152200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcef81f6710 0x7fcef8152200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 -- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef81f5ac0 msgr2=0x7fcef81f5f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef81f5ac0 0x7fcef81f5f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 -- 172.21.15.81:0/2691351881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcef81532f0 con 0x7fcee0004800 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef7fff640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 0x7fcef8146610 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fcee8006610 tx=0x7fcee80039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef4ff9640 1 -- 172.21.15.81:0/2691351881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8015070 con 0x7fcee0004800 2024-09-17T05:23:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef4ff9640 1 -- 172.21.15.81:0/2691351881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcee8011900 con 0x7fcee0004800 2024-09-17T05:23:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcef8146b50 con 0x7fcee0004800 2024-09-17T05:23:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcef4ff9640 1 -- 172.21.15.81:0/2691351881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcee8011cf0 con 0x7fcee0004800 2024-09-17T05:23:06.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.218+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcef8152d30 con 0x7fcee0004800 2024-09-17T05:23:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.219+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcef80725a0 con 0x7fcee0004800 2024-09-17T05:23:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.220+0000 7fcef4ff9640 1 -- 172.21.15.81:0/2691351881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fcee8010420 con 0x7fcee0004800 2024-09-17T05:23:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.220+0000 7fcef4ff9640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcee4078ce0 0x7fcee407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.220+0000 7fcef77fe640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcee4078ce0 0x7fcee407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.220+0000 7fcef4ff9640 1 -- 172.21.15.81:0/2691351881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7fcee809bc00 con 0x7fcee0004800 2024-09-17T05:23:06.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.221+0000 7fcef77fe640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcee4078ce0 0x7fcee407b1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fceec036000 tx=0x7fceec03c040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.224+0000 7fcef4ff9640 1 -- 172.21.15.81:0/2691351881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcee80a2080 con 0x7fcee0004800 2024-09-17T05:23:06.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.425+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7fcef8150800 con 0x7fcee4078ce0 2024-09-17T05:23:06.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.427+0000 7fcef4ff9640 1 -- 172.21.15.81:0/2691351881 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7fceec03a660 con 0x7fcee4078ce0 2024-09-17T05:23:06.427 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:23:06.428 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:06.428 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:23:06.428 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:06.428 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcee4078ce0 msgr2=0x7fcee407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcee4078ce0 0x7fcee407b1a0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fceec036000 tx=0x7fceec03c040 comp rx=0 tx=0).stop 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 msgr2=0x7fcef8146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 0x7fcef8146610 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7fcee8006610 tx=0x7fcee80039c0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 shutdown_connections 2024-09-17T05:23:06.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcee4078ce0 0x7fcee407b1a0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcef81f5ac0 0x7fcef81f5f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcef81f6710 0x7fcef8152200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 --2- 172.21.15.81:0/2691351881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcee0004800 0x7fcef8146610 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 >> 172.21.15.81:0/2691351881 conn(0x7fcef80b1690 msgr2=0x7fcef80af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 shutdown_connections 2024-09-17T05:23:06.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.429+0000 7fcefe8bd640 1 -- 172.21.15.81:0/2691351881 wait complete. 2024-09-17T05:23:06.441 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.544+0000 7f211f76b640 1 -- 172.21.15.81:0/2320005203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f211806f1f0 msgr2=0x7f21180cca80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.544+0000 7f211f76b640 1 --2- 172.21.15.81:0/2320005203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f211806f1f0 0x7f21180cca80 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f21180cc510 tx=0x7f210802b150 comp rx=0 tx=0).stop 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.544+0000 7f211f76b640 1 -- 172.21.15.81:0/2320005203 shutdown_connections 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.544+0000 7f211f76b640 1 --2- 172.21.15.81:0/2320005203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f211806f1f0 0x7f21180cca80 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.544+0000 7f211f76b640 1 --2- 172.21.15.81:0/2320005203 >> v2:172.21.15.160:3300/0 conn(0x7f21180ca620 0x7f21180cc540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.544+0000 7f211f76b640 1 -- 172.21.15.81:0/2320005203 >> 172.21.15.81:0/2320005203 conn(0x7f21180b1700 msgr2=0x7f21180b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.545+0000 7f211f76b640 1 -- 172.21.15.81:0/2320005203 shutdown_connections 2024-09-17T05:23:06.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.545+0000 7f211f76b640 1 -- 172.21.15.81:0/2320005203 wait complete. 2024-09-17T05:23:06.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 Processor -- start 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 -- start start 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211806f1f0 0x7f21180c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21180ca620 0x7f21180c9060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211815a440 0x7f21181526c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2118163b70 con 0x7f21180ca620 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f21181639f0 con 0x7f211806f1f0 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.546+0000 7f211f76b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2118163cf0 con 0x7f211815a440 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21180ca620 0x7f21180c9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21180ca620 0x7f21180c9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49148/0 (socket says 172.21.15.81:49148) 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 -- 172.21.15.81:0/2852919063 learned_addr learned my addr 172.21.15.81:0/2852919063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:06.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211d507640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211806f1f0 0x7f21180c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211dd08640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211815a440 0x7f21181526c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 -- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211815a440 msgr2=0x7f21181526c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211815a440 0x7f21181526c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 -- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211806f1f0 msgr2=0x7f21180c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211806f1f0 0x7f21180c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 -- 172.21.15.81:0/2852919063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2118152c00 con 0x7f21180ca620 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211cd06640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21180ca620 0x7f21180c9060 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f21080075a0 tx=0x7f2108005d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f210dffb640 1 -- 172.21.15.81:0/2852919063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108003880 con 0x7f21180ca620 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f210dffb640 1 -- 172.21.15.81:0/2852919063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2108003b50 con 0x7f21180ca620 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21180c6ca0 con 0x7f21180ca620 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f210dffb640 1 -- 172.21.15.81:0/2852919063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2108003da0 con 0x7f21180ca620 2024-09-17T05:23:06.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.547+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21180c7260 con 0x7f21180ca620 2024-09-17T05:23:06.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.548+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f211815a8f0 con 0x7f21180ca620 2024-09-17T05:23:06.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.549+0000 7f210dffb640 1 -- 172.21.15.81:0/2852919063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f2108044030 con 0x7f21180ca620 2024-09-17T05:23:06.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.550+0000 7f210dffb640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f20fc078cb0 0x7f20fc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.550+0000 7f210dffb640 1 -- 172.21.15.81:0/2852919063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f21080ba700 con 0x7f21180ca620 2024-09-17T05:23:06.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.550+0000 7f211d507640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f20fc078cb0 0x7f20fc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.550+0000 7f211d507640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f20fc078cb0 0x7f20fc07b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2114005fd0 tx=0x7f211400b390 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.554+0000 7f210dffb640 1 -- 172.21.15.81:0/2852919063 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f21080823f0 con 0x7f21180ca620 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.728+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f21180b5850 con 0x7f21180ca620 2024-09-17T05:23:06.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.729+0000 7f210dffb640 1 -- 172.21.15.81:0/2852919063 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v36)=0 v36) ==== 122+0+0 (secure 0 0 0) 0x7f2108086e20 con 0x7f21180ca620 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f20fc078cb0 msgr2=0x7f20fc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f20fc078cb0 0x7f20fc07b170 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f2114005fd0 tx=0x7f211400b390 comp rx=0 tx=0).stop 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21180ca620 msgr2=0x7f21180c9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21180ca620 0x7f21180c9060 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f21080075a0 tx=0x7f2108005d50 comp rx=0 tx=0).stop 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 shutdown_connections 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f211815a440 0x7f21181526c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21180ca620 0x7f21180c9060 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f20fc078cb0 0x7f20fc07b170 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 --2- 172.21.15.81:0/2852919063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f211806f1f0 0x7f21180c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 >> 172.21.15.81:0/2852919063 conn(0x7f21180b1700 msgr2=0x7f21180b3160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 shutdown_connections 2024-09-17T05:23:06.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.731+0000 7f211f76b640 1 -- 172.21.15.81:0/2852919063 wait complete. 2024-09-17T05:23:06.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create 'abcd@#' 2024-09-17T05:23:06.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.846+0000 7f73d8516640 1 -- 172.21.15.81:0/2262711508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73bc004800 msgr2=0x7f73bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.846+0000 7f73d8516640 1 --2- 172.21.15.81:0/2262711508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73bc004800 0x7f73bc004c80 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f73c0009cf0 tx=0x7f73bc005830 comp rx=0 tx=0).stop 2024-09-17T05:23:06.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.846+0000 7f73d6ab3640 1 -- 172.21.15.81:0/2262711508 reap_dead start 2024-09-17T05:23:06.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.846+0000 7f73d8516640 1 -- 172.21.15.81:0/2262711508 shutdown_connections 2024-09-17T05:23:06.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.846+0000 7f73d8516640 1 -- 172.21.15.81:0/2262711508 >> 172.21.15.81:0/2262711508 conn(0x7f73d00b1700 msgr2=0x7f73d00b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:06.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.846+0000 7f73d8516640 1 -- 172.21.15.81:0/2262711508 shutdown_connections 2024-09-17T05:23:06.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.846+0000 7f73d8516640 1 -- 172.21.15.81:0/2262711508 wait complete. 2024-09-17T05:23:06.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.847+0000 7f73d8516640 1 Processor -- start 2024-09-17T05:23:06.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.847+0000 7f73d8516640 1 -- start start 2024-09-17T05:23:06.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d8516640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73bc004800 0x7f73d00aef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d8516640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d01f5b50 0x7f73d00b4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d8516640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73d014eb20 0x7f73d014efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d8516640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f73d00ce4c0 con 0x7f73d01f5b50 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d8516640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f73d00ce340 con 0x7f73bc004800 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d8516640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f73d006fc60 con 0x7f73d014eb20 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d5ab1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d01f5b50 0x7f73d00b4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d5ab1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d01f5b50 0x7f73d00b4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49168/0 (socket says 172.21.15.81:49168) 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d5ab1640 1 -- 172.21.15.81:0/1080436757 learned_addr learned my addr 172.21.15.81:0/1080436757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d62b2640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73bc004800 0x7f73d00aef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.848+0000 7f73d6ab3640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73d014eb20 0x7f73d014efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d5ab1640 1 -- 172.21.15.81:0/1080436757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73d014eb20 msgr2=0x7f73d014efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d5ab1640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f73d014eb20 0x7f73d014efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d5ab1640 1 -- 172.21.15.81:0/1080436757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73bc004800 msgr2=0x7f73d00aef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:06.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d5ab1640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f73bc004800 0x7f73d00aef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:06.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d5ab1640 1 -- 172.21.15.81:0/1080436757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73d01f6330 con 0x7f73d01f5b50 2024-09-17T05:23:06.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d5ab1640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f73d01f5b50 0x7f73d00b4670 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f73c002b5d0 tx=0x7f73c0005d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73c6ffd640 1 -- 172.21.15.81:0/1080436757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c0041020 con 0x7f73d01f5b50 2024-09-17T05:23:06.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73c6ffd640 1 -- 172.21.15.81:0/1080436757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f73c0009470 con 0x7f73d01f5b50 2024-09-17T05:23:06.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d8516640 1 -- 172.21.15.81:0/1080436757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73d01f6610 con 0x7f73d01f5b50 2024-09-17T05:23:06.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73c6ffd640 1 -- 172.21.15.81:0/1080436757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c00052a0 con 0x7f73d01f5b50 2024-09-17T05:23:06.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.849+0000 7f73d8516640 1 -- 172.21.15.81:0/1080436757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73d014e600 con 0x7f73d01f5b50 2024-09-17T05:23:06.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.850+0000 7f73d8516640 1 -- 172.21.15.81:0/1080436757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73d00cf200 con 0x7f73d01f5b50 2024-09-17T05:23:06.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.850+0000 7f73c6ffd640 1 -- 172.21.15.81:0/1080436757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f73c0044020 con 0x7f73d01f5b50 2024-09-17T05:23:06.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.851+0000 7f73c6ffd640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f73b4078ce0 0x7f73b407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:06.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.851+0000 7f73c6ffd640 1 -- 172.21.15.81:0/1080436757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f73c00bbd80 con 0x7f73d01f5b50 2024-09-17T05:23:06.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.851+0000 7f73d62b2640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f73b4078ce0 0x7f73b407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:06.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.851+0000 7f73d62b2640 1 --2- 172.21.15.81:0/1080436757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f73b4078ce0 0x7f73b407b1a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f73cc006fd0 tx=0x7f73cc006b10 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:06.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:06.855+0000 7f73c6ffd640 1 -- 172.21.15.81:0/1080436757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f73c004b030 con 0x7f73d01f5b50 2024-09-17T05:23:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-17T05:23:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:fs volume create [] : Create a CephFS volume 2024-09-17T05:23:07.054 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-17T05:23:07.057 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:23:07.058 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume create testvol 2024-09-17T05:23:07.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.162+0000 7f0a83ed4640 1 -- 172.21.15.81:0/2654545873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a68003fd0 msgr2=0x7f0a68004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.162+0000 7f0a83ed4640 1 --2- 172.21.15.81:0/2654545873 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a68003fd0 0x7f0a68004800 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f0a6c009b50 tx=0x7f0a68005830 comp rx=0 tx=0).stop 2024-09-17T05:23:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.162+0000 7f0a82471640 1 -- 172.21.15.81:0/2654545873 reap_dead start 2024-09-17T05:23:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.162+0000 7f0a83ed4640 1 -- 172.21.15.81:0/2654545873 shutdown_connections 2024-09-17T05:23:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.162+0000 7f0a83ed4640 1 -- 172.21.15.81:0/2654545873 >> 172.21.15.81:0/2654545873 conn(0x7f0a7c0b1700 msgr2=0x7f0a7c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.162+0000 7f0a83ed4640 1 -- 172.21.15.81:0/2654545873 shutdown_connections 2024-09-17T05:23:07.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.162+0000 7f0a83ed4640 1 -- 172.21.15.81:0/2654545873 wait complete. 2024-09-17T05:23:07.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.163+0000 7f0a83ed4640 1 Processor -- start 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.163+0000 7f0a83ed4640 1 -- start start 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a83ed4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68003fd0 0x7f0a7c0c61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a83ed4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c14c020 0x7f0a7c1f08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a83ed4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0b3170 0x7f0a7c0b35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a83ed4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0ccc00 con 0x7f0a7c0b3170 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a83ed4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a7c0cca80 con 0x7f0a68003fd0 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a83ed4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0a7c0ccd80 con 0x7f0a7c14c020 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a82471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0b3170 0x7f0a7c0b35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a82471640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0b3170 0x7f0a7c0b35d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49190/0 (socket says 172.21.15.81:49190) 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a82471640 1 -- 172.21.15.81:0/1202538455 learned_addr learned my addr 172.21.15.81:0/1202538455 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.164+0000 7f0a81c70640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68003fd0 0x7f0a7c0c61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a82471640 1 -- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c14c020 msgr2=0x7f0a7c1f08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a82471640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c14c020 0x7f0a7c1f08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a82471640 1 -- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68003fd0 msgr2=0x7f0a7c0c61c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a82471640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68003fd0 0x7f0a7c0c61c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a82471640 1 -- 172.21.15.81:0/1202538455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a7c1f0e00 con 0x7f0a7c0b3170 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a81c70640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68003fd0 0x7f0a7c0c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a82471640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0b3170 0x7f0a7c0b35d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001be0 tx=0x7f0a74006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a727fc640 1 -- 172.21.15.81:0/1202538455 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a7400fc10 con 0x7f0a7c0b3170 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a727fc640 1 -- 172.21.15.81:0/1202538455 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a74006970 con 0x7f0a7c0b3170 2024-09-17T05:23:07.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a7c1f10a0 con 0x7f0a7c0b3170 2024-09-17T05:23:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a727fc640 1 -- 172.21.15.81:0/1202538455 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a74011430 con 0x7f0a7c0b3170 2024-09-17T05:23:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.165+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a7c1f1660 con 0x7f0a7c0b3170 2024-09-17T05:23:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.166+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a7c0cc540 con 0x7f0a7c0b3170 2024-09-17T05:23:07.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.167+0000 7f0a727fc640 1 -- 172.21.15.81:0/1202538455 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f0a740115d0 con 0x7f0a7c0b3170 2024-09-17T05:23:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.167+0000 7f0a727fc640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a60078cb0 0x7f0a6007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.167+0000 7f0a81c70640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a60078cb0 0x7f0a6007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.167+0000 7f0a727fc640 1 -- 172.21.15.81:0/1202538455 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 5709+0+0 (secure 0 0 0) 0x7f0a7409b930 con 0x7f0a7c0b3170 2024-09-17T05:23:07.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.168+0000 7f0a81c70640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a60078cb0 0x7f0a6007b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0c4120 tx=0x7f0a78005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:07.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.172+0000 7f0a727fc640 1 -- 172.21.15.81:0/1202538455 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0a74063be0 con 0x7f0a7c0b3170 2024-09-17T05:23:07.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:07.369+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "testvol", "target": ["mon-mgr", ""]}) -- 0x7f0a7c0c3320 con 0x7f0a60078cb0 2024-09-17T05:23:10.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.125+0000 7f0a727fc640 1 -- 172.21.15.81:0/1202538455 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 Volume created successfully (no MDS daemons created)) ==== 60+0+0 (secure 0 0 0) 0x7f0a7c0c3320 con 0x7f0a60078cb0 2024-09-17T05:23:10.127 INFO:teuthology.orchestra.run.smithi081.stderr:Volume created successfully (no MDS daemons created) 2024-09-17T05:23:10.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.129+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a60078cb0 msgr2=0x7f0a6007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.129+0000 7f0a83ed4640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a60078cb0 0x7f0a6007b170 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0a7c0c4120 tx=0x7f0a78005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:10.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.129+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0b3170 msgr2=0x7f0a7c0b35d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.129+0000 7f0a83ed4640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0b3170 0x7f0a7c0b35d0 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f0a74001be0 tx=0x7f0a74006720 comp rx=0 tx=0).stop 2024-09-17T05:23:10.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 shutdown_connections 2024-09-17T05:23:10.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a7c0b3170 0x7f0a7c0b35d0 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a7c14c020 0x7f0a7c1f08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a60078cb0 0x7f0a6007b170 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 --2- 172.21.15.81:0/1202538455 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a68003fd0 0x7f0a7c0c61c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 >> 172.21.15.81:0/1202538455 conn(0x7f0a7c0b1700 msgr2=0x7f0a7c15d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:10.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 shutdown_connections 2024-09-17T05:23:10.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.130+0000 7f0a83ed4640 1 -- 172.21.15.81:0/1202538455 wait complete. 2024-09-17T05:23:10.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create testvol 'abcd@#' 2024-09-17T05:23:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 -- 172.21.15.81:0/1619097891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00cfe10 msgr2=0x7fcce0162650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 --2- 172.21.15.81:0/1619097891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00cfe10 0x7fcce0162650 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7fccd8005fd0 tx=0x7fccd802a780 comp rx=0 tx=0).stop 2024-09-17T05:23:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 -- 172.21.15.81:0/1619097891 shutdown_connections 2024-09-17T05:23:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 --2- 172.21.15.81:0/1619097891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00cfe10 0x7fcce0162650 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 --2- 172.21.15.81:0/1619097891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce00d05d0 0x7fcce00d09b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 -- 172.21.15.81:0/1619097891 >> 172.21.15.81:0/1619097891 conn(0x7fcce009d1c0 msgr2=0x7fcce00d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 -- 172.21.15.81:0/1619097891 shutdown_connections 2024-09-17T05:23:10.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.258+0000 7fcce57f8640 1 -- 172.21.15.81:0/1619097891 wait complete. 2024-09-17T05:23:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.259+0000 7fcce57f8640 1 Processor -- start 2024-09-17T05:23:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.259+0000 7fcce57f8640 1 -- start start 2024-09-17T05:23:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce006f040 0x7fcce01f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00cfe10 0x7fcce00ca000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce00d05d0 0x7fcce00b80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcce006d470 con 0x7fcce00cfe10 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcce006d2f0 con 0x7fcce006f040 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcce006d5f0 con 0x7fcce00d05d0 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00cfe10 0x7fcce00ca000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00cfe10 0x7fcce00ca000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49212/0 (socket says 172.21.15.81:49212) 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 -- 172.21.15.81:0/703382118 learned_addr learned my addr 172.21.15.81:0/703382118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccdeffd640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce006f040 0x7fcce01f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccdf7fe640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce00d05d0 0x7fcce00b80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 -- 172.21.15.81:0/703382118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce00d05d0 msgr2=0x7fcce00b80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcce00d05d0 0x7fcce00b80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 -- 172.21.15.81:0/703382118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce006f040 msgr2=0x7fcce01f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcce006f040 0x7fcce01f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 -- 172.21.15.81:0/703382118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcce01f5100 con 0x7fcce00cfe10 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd67fc640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcce00cfe10 0x7fcce00ca000 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7fccc800c760 tx=0x7fccc800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd7fff640 1 -- 172.21.15.81:0/703382118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc8017070 con 0x7fcce00cfe10 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd7fff640 1 -- 172.21.15.81:0/703382118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fccc8005180 con 0x7fcce00cfe10 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 -- 172.21.15.81:0/703382118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcce01f53e0 con 0x7fcce00cfe10 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fccd7fff640 1 -- 172.21.15.81:0/703382118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fccc800a640 con 0x7fcce00cfe10 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.260+0000 7fcce57f8640 1 -- 172.21.15.81:0/703382118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcce00b9730 con 0x7fcce00cfe10 2024-09-17T05:23:10.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.261+0000 7fcce57f8640 1 -- 172.21.15.81:0/703382118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcce00d09b0 con 0x7fcce00cfe10 2024-09-17T05:23:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.262+0000 7fccd7fff640 1 -- 172.21.15.81:0/703382118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fccc801a070 con 0x7fcce00cfe10 2024-09-17T05:23:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.263+0000 7fccd7fff640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccc0078cb0 0x7fccc007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.263+0000 7fccd7fff640 1 -- 172.21.15.81:0/703382118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6543+0+0 (secure 0 0 0) 0x7fccc809a640 con 0x7fcce00cfe10 2024-09-17T05:23:10.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.263+0000 7fccdeffd640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccc0078cb0 0x7fccc007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.263+0000 7fccdeffd640 1 --2- 172.21.15.81:0/703382118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccc0078cb0 0x7fccc007b170 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fccd00058c0 tx=0x7fccd0005d80 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:10.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.267+0000 7fccd7fff640 1 -- 172.21.15.81:0/703382118 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcce00d0ef0 con 0x7fcce00cfe10 2024-09-17T05:23:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:Invalid command: invalid chars @# in abcd@# 2024-09-17T05:23:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:fs subvolumegroup create [] [] [] [] [] : Create a CephFS subvolume group in a volume, and optionally, with a specific data pool layout, and a specific numeric mode 2024-09-17T05:23:10.469 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-17T05:23:10.473 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:23:10.473 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create testvol 'abcd@#' 2024-09-17T05:23:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.576+0000 7fc1fe394640 1 -- 172.21.15.81:0/3871744397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f80d01b0 msgr2=0x7fc1f80d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.576+0000 7fc1fe394640 1 --2- 172.21.15.81:0/3871744397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f80d01b0 0x7fc1f80d2440 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec009830 tx=0x7fc1ec02a480 comp rx=0 tx=0).stop 2024-09-17T05:23:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.576+0000 7fc1fe394640 1 -- 172.21.15.81:0/3871744397 shutdown_connections 2024-09-17T05:23:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.576+0000 7fc1fe394640 1 --2- 172.21.15.81:0/3871744397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f80d01b0 0x7fc1f80d2440 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.576+0000 7fc1fe394640 1 -- 172.21.15.81:0/3871744397 >> 172.21.15.81:0/3871744397 conn(0x7fc1f80d3e30 msgr2=0x7fc1f80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:10.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.576+0000 7fc1fe394640 1 -- 172.21.15.81:0/3871744397 shutdown_connections 2024-09-17T05:23:10.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.576+0000 7fc1fe394640 1 -- 172.21.15.81:0/3871744397 wait complete. 2024-09-17T05:23:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.577+0000 7fc1fe394640 1 Processor -- start 2024-09-17T05:23:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.578+0000 7fc1fe394640 1 -- start start 2024-09-17T05:23:10.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.578+0000 7fc1fe394640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f80b3de0 0x7fc1f809db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.578+0000 7fc1fe394640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1f80d01b0 0x7fc1f8154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.578+0000 7fc1fe394640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1f81617f0 0x7fc1f80b8e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.578+0000 7fc1fe394640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f80b4a80 con 0x7fc1f80b3de0 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.578+0000 7fc1fe394640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc1f80b4900 con 0x7fc1f80d01b0 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.578+0000 7fc1fe394640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc1f80b4c00 con 0x7fc1f81617f0 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f80b3de0 0x7fc1f809db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f80b3de0 0x7fc1f809db30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49222/0 (socket says 172.21.15.81:49222) 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 -- 172.21.15.81:0/3236595157 learned_addr learned my addr 172.21.15.81:0/3236595157 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f77fe640 1 --2- 172.21.15.81:0/3236595157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1f80d01b0 0x7fc1f8154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 -- 172.21.15.81:0/3236595157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1f81617f0 msgr2=0x7fc1f80b8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 --2- 172.21.15.81:0/3236595157 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc1f81617f0 0x7fc1f80b8e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 -- 172.21.15.81:0/3236595157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1f80d01b0 msgr2=0x7fc1f8154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 --2- 172.21.15.81:0/3236595157 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc1f80d01b0 0x7fc1f8154340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 -- 172.21.15.81:0/3236595157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc1f80ce0a0 con 0x7fc1f80b3de0 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f7fff640 1 --2- 172.21.15.81:0/3236595157 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc1f80b3de0 0x7fc1f809db30 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7fc1e800c370 tx=0x7fc1e800c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f4ff9640 1 -- 172.21.15.81:0/3236595157 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8006890 con 0x7fc1f80b3de0 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f4ff9640 1 -- 172.21.15.81:0/3236595157 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc1e8006b20 con 0x7fc1f80b3de0 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1f4ff9640 1 -- 172.21.15.81:0/3236595157 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc1e8007020 con 0x7fc1f80b3de0 2024-09-17T05:23:10.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1fe394640 1 -- 172.21.15.81:0/3236595157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc1f809f580 con 0x7fc1f80b3de0 2024-09-17T05:23:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.579+0000 7fc1fe394640 1 -- 172.21.15.81:0/3236595157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1f809fb40 con 0x7fc1f80b3de0 2024-09-17T05:23:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.580+0000 7fc1fe394640 1 -- 172.21.15.81:0/3236595157 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc1f80b41f0 con 0x7fc1f80b3de0 2024-09-17T05:23:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.581+0000 7fc1f4ff9640 1 -- 172.21.15.81:0/3236595157 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fc1e8019020 con 0x7fc1f80b3de0 2024-09-17T05:23:10.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.581+0000 7fc1f4ff9640 1 --2- 172.21.15.81:0/3236595157 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc1e4078cb0 0x7fc1e407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.581+0000 7fc1f77fe640 1 --2- 172.21.15.81:0/3236595157 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc1e4078cb0 0x7fc1e407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.581+0000 7fc1f4ff9640 1 -- 172.21.15.81:0/3236595157 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6543+0+0 (secure 0 0 0) 0x7fc1e809a910 con 0x7fc1f80b3de0 2024-09-17T05:23:10.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.582+0000 7fc1f77fe640 1 --2- 172.21.15.81:0/3236595157 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc1e4078cb0 0x7fc1e407b170 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc1ec034000 tx=0x7fc1ec004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:10.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.585+0000 7fc1f4ff9640 1 -- 172.21.15.81:0/3236595157 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc1e8062910 con 0x7fc1f80b3de0 2024-09-17T05:23:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:Invalid command: invalid chars #@ in abcd@# 2024-09-17T05:23:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:fs subvolume create [] [] [] [] [] [] [--namespace-isolated] [] : Create a CephFS subvolume in a volume, and optionally, with a specific size (in bytes), a specific data pool layout, a specific mode, in a specific subvolume group and in separate RADOS namespace 2024-09-17T05:23:10.786 INFO:teuthology.orchestra.run.smithi081.stderr:Error EINVAL: invalid command 2024-09-17T05:23:10.790 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-17T05:23:10.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume rm testvol --yes-i-really-mean-it 2024-09-17T05:23:10.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 -- 172.21.15.81:0/2290831131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40d01b0 msgr2=0x7faca40d2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 --2- 172.21.15.81:0/2290831131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40d01b0 0x7faca40d2440 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7faca406a240 tx=0x7fac9802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 -- 172.21.15.81:0/2290831131 shutdown_connections 2024-09-17T05:23:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 --2- 172.21.15.81:0/2290831131 >> v2:172.21.15.160:3300/0 conn(0x7faca40b3de0 0x7faca40b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 --2- 172.21.15.81:0/2290831131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40d01b0 0x7faca40d2440 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 -- 172.21.15.81:0/2290831131 >> 172.21.15.81:0/2290831131 conn(0x7faca40d3e30 msgr2=0x7faca40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 -- 172.21.15.81:0/2290831131 shutdown_connections 2024-09-17T05:23:10.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.893+0000 7facaa27f640 1 -- 172.21.15.81:0/2290831131 wait complete. 2024-09-17T05:23:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.894+0000 7facaa27f640 1 Processor -- start 2024-09-17T05:23:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7facaa27f640 1 -- start start 2024-09-17T05:23:10.898 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7facaa27f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40b3de0 0x7faca40caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7facaa27f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faca40d01b0 0x7faca41f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7facaa27f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faca41617f0 0x7faca415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7facaa27f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7faca40b48b0 con 0x7faca40b3de0 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7facaa27f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7faca40b4730 con 0x7faca41617f0 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7facaa27f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7faca40b4a30 con 0x7faca40d01b0 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7faca3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40b3de0 0x7faca40caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7faca3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40b3de0 0x7faca40caf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49240/0 (socket says 172.21.15.81:49240) 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.895+0000 7faca3fff640 1 -- 172.21.15.81:0/1121005433 learned_addr learned my addr 172.21.15.81:0/1121005433 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca881c640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faca41617f0 0x7faca415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca37fe640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faca40d01b0 0x7faca41f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca3fff640 1 -- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faca40d01b0 msgr2=0x7faca41f5720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca3fff640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faca40d01b0 0x7faca41f5720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca3fff640 1 -- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faca41617f0 msgr2=0x7faca415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca3fff640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faca41617f0 0x7faca415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca3fff640 1 -- 172.21.15.81:0/1121005433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faca40b6eb0 con 0x7faca40b3de0 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca881c640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faca41617f0 0x7faca415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca3fff640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40b3de0 0x7faca40caf00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fac9400c370 tx=0x7fac9400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca0ff9640 1 -- 172.21.15.81:0/1121005433 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94006890 con 0x7faca40b3de0 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca0ff9640 1 -- 172.21.15.81:0/1121005433 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac94006b20 con 0x7faca40b3de0 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faca40b7190 con 0x7faca40b3de0 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7faca0ff9640 1 -- 172.21.15.81:0/1121005433 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac94007020 con 0x7faca40b3de0 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.896+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faca40b7750 con 0x7faca40b3de0 2024-09-17T05:23:10.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.897+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faca40b4f50 con 0x7faca40b3de0 2024-09-17T05:23:10.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.898+0000 7faca0ff9640 1 -- 172.21.15.81:0/1121005433 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fac94019020 con 0x7faca40b3de0 2024-09-17T05:23:10.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.898+0000 7faca0ff9640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fac90078cb0 0x7fac9007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:10.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.898+0000 7faca37fe640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fac90078cb0 0x7fac9007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:10.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.898+0000 7faca0ff9640 1 -- 172.21.15.81:0/1121005433 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 6543+0+0 (secure 0 0 0) 0x7fac9409a9e0 con 0x7faca40b3de0 2024-09-17T05:23:10.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.899+0000 7faca37fe640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fac90078cb0 0x7fac9007b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac98034000 tx=0x7fac98004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:10.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:10.903+0000 7faca0ff9640 1 -- 172.21.15.81:0/1121005433 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fac940629e0 con 0x7faca40b3de0 2024-09-17T05:23:11.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:11.100+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume rm", "vol_name": "testvol", "yes-i-really-mean-it": "--yes-i-really-mean-it", "target": ["mon-mgr", ""]}) -- 0x7faca40b6c60 con 0x7fac90078cb0 2024-09-17T05:23:11.104 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:23:11.104+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:23:11.143 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:23:14.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.124+0000 7faca0ff9640 1 -- 172.21.15.81:0/1121005433 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+78 (secure 0 0 0) 0x7faca40b6c60 con 0x7fac90078cb0 2024-09-17T05:23:14.125 INFO:teuthology.orchestra.run.smithi081.stdout:metadata pool: cephfs.testvol.meta data pool: ['cephfs.testvol.data'] removed 2024-09-17T05:23:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fac90078cb0 msgr2=0x7fac9007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fac90078cb0 0x7fac9007b170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fac98034000 tx=0x7fac98004730 comp rx=0 tx=0).stop 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40b3de0 msgr2=0x7faca40caf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40b3de0 0x7faca40caf00 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fac9400c370 tx=0x7fac9400c830 comp rx=0 tx=0).stop 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 shutdown_connections 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fac90078cb0 0x7fac9007b170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7faca41617f0 0x7faca415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7faca40d01b0 0x7faca41f5720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 --2- 172.21.15.81:0/1121005433 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7faca40b3de0 0x7faca40caf00 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 >> 172.21.15.81:0/1121005433 conn(0x7faca40d3e30 msgr2=0x7faca40d1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 shutdown_connections 2024-09-17T05:23:14.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.127+0000 7facaa27f640 1 -- 172.21.15.81:0/1121005433 wait complete. 2024-09-17T05:23:14.145 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:23:14.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:23:14.195 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:23:14.242 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:23:14.242 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:23:14.242 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:14.242 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:14.260 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:14.260 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:14.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:23:14.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 -- 172.21.15.81:0/2732229556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 msgr2=0x7f6d84161f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 --2- 172.21.15.81:0/2732229556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d84161f10 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009830 tx=0x7f6d7802a560 comp rx=0 tx=0).stop 2024-09-17T05:23:14.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 -- 172.21.15.81:0/2732229556 shutdown_connections 2024-09-17T05:23:14.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 --2- 172.21.15.81:0/2732229556 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d84161f10 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 --2- 172.21.15.81:0/2732229556 >> v2:172.21.15.160:3300/0 conn(0x7f6d84161b30 0x7f6d840cf920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 -- 172.21.15.81:0/2732229556 >> 172.21.15.81:0/2732229556 conn(0x7f6d840d3e40 msgr2=0x7f6d840d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:14.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 -- 172.21.15.81:0/2732229556 shutdown_connections 2024-09-17T05:23:14.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.461+0000 7f6d89840640 1 -- 172.21.15.81:0/2732229556 wait complete. 2024-09-17T05:23:14.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.462+0000 7f6d89840640 1 Processor -- start 2024-09-17T05:23:14.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.462+0000 7f6d89840640 1 -- start start 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d89840640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d840cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d89840640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d84160ac0 0x7f6d840ca4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d89840640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d84161b30 0x7f6d841f7a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d89840640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6d840b39e0 con 0x7f6d840d1a10 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d89840640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84161900 con 0x7f6d84160ac0 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d89840640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6d840b3b60 con 0x7f6d84161b30 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d840cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d840cc450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35282/0 (socket says 172.21.15.81:35282) 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 -- 172.21.15.81:0/1992211967 learned_addr learned my addr 172.21.15.81:0/1992211967 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d837fe640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d84161b30 0x7f6d841f7a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d827fc640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d84160ac0 0x7f6d840ca4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 -- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d84161b30 msgr2=0x7f6d841f7a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d84161b30 0x7f6d841f7a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 -- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d84160ac0 msgr2=0x7f6d840ca4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d84160ac0 0x7f6d840ca4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 -- 172.21.15.81:0/1992211967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d840cc990 con 0x7f6d840d1a10 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d827fc640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d84160ac0 0x7f6d840ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d837fe640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d84161b30 0x7f6d841f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d82ffd640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d840cc450 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400ea20 tx=0x7f6d7400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:14.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d6bfff640 1 -- 172.21.15.81:0/1992211967 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7400cde0 con 0x7f6d840d1a10 2024-09-17T05:23:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.463+0000 7f6d6bfff640 1 -- 172.21.15.81:0/1992211967 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6d74011560 con 0x7f6d840d1a10 2024-09-17T05:23:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.464+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d84150a60 con 0x7f6d840d1a10 2024-09-17T05:23:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.464+0000 7f6d6bfff640 1 -- 172.21.15.81:0/1992211967 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d74011990 con 0x7f6d840d1a10 2024-09-17T05:23:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.464+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d840b8160 con 0x7f6d840d1a10 2024-09-17T05:23:14.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.465+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d840cf920 con 0x7f6d840d1a10 2024-09-17T05:23:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.465+0000 7f6d6bfff640 1 -- 172.21.15.81:0/1992211967 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f6d7401a400 con 0x7f6d840d1a10 2024-09-17T05:23:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.466+0000 7f6d6bfff640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6d70078cb0 0x7f6d7007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.466+0000 7f6d6bfff640 1 -- 172.21.15.81:0/1992211967 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f6d7409c2a0 con 0x7f6d840d1a10 2024-09-17T05:23:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.466+0000 7f6d827fc640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6d70078cb0 0x7f6d7007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.466+0000 7f6d827fc640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6d70078cb0 0x7f6d7007b170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d78034000 tx=0x7f6d78004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:14.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.470+0000 7f6d6bfff640 1 -- 172.21.15.81:0/1992211967 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6d74028020 con 0x7f6d840d1a10 2024-09-17T05:23:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.654+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6d840b3580 con 0x7f6d840d1a10 2024-09-17T05:23:14.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.654+0000 7f6d6bfff640 1 -- 172.21.15.81:0/1992211967 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) ==== 80+0+124 (secure 0 0 0) 0x7f6d74016030 con 0x7f6d840d1a10 2024-09-17T05:23:14.655 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.160:6801/3249546675 2024-09-18T05:23:11.104835+0000 2024-09-17T05:23:14.655 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.160:6800/3249546675 2024-09-18T05:23:11.104835+0000 2024-09-17T05:23:14.656 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2024-09-17T05:23:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6d70078cb0 msgr2=0x7f6d7007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6d70078cb0 0x7f6d7007b170 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6d78034000 tx=0x7f6d78004730 comp rx=0 tx=0).stop 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 msgr2=0x7f6d840cc450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d840cc450 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f6d7400ea20 tx=0x7f6d7400eee0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 shutdown_connections 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6d84161b30 0x7f6d841f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6d70078cb0 0x7f6d7007b170 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6d84160ac0 0x7f6d840ca4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 --2- 172.21.15.81:0/1992211967 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6d840d1a10 0x7f6d840cc450 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 >> 172.21.15.81:0/1992211967 conn(0x7f6d840d3e40 msgr2=0x7f6d84161f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 shutdown_connections 2024-09-17T05:23:14.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.656+0000 7f6d89840640 1 -- 172.21.15.81:0/1992211967 wait complete. 2024-09-17T05:23:14.669 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:23:14.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:14.669 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:14.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[61427]: fuse finished with error 0 and tester_r 0 2024-09-17T05:23:14.693 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:23:14.694 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:14.694 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:23:14.790 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:23:14.791 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:23:14.791 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:14.811 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:23:14.811 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:14.869 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:23:14.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.970+0000 7f52988bf640 1 -- 172.21.15.81:0/960511779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5280004d40 msgr2=0x7f52800051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.970+0000 7f52988bf640 1 --2- 172.21.15.81:0/960511779 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5280004d40 0x7f52800051c0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f528c00c610 tx=0x7f5280005830 comp rx=0 tx=0).stop 2024-09-17T05:23:14.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.970+0000 7f5292d9d640 1 -- 172.21.15.81:0/960511779 reap_dead start 2024-09-17T05:23:14.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.970+0000 7f52988bf640 1 -- 172.21.15.81:0/960511779 shutdown_connections 2024-09-17T05:23:14.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.970+0000 7f52988bf640 1 -- 172.21.15.81:0/960511779 >> 172.21.15.81:0/960511779 conn(0x7f52940b1690 msgr2=0x7f52940b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:14.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.970+0000 7f52988bf640 1 -- 172.21.15.81:0/960511779 shutdown_connections 2024-09-17T05:23:14.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.970+0000 7f52988bf640 1 -- 172.21.15.81:0/960511779 wait complete. 2024-09-17T05:23:14.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 Processor -- start 2024-09-17T05:23:14.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 -- start start 2024-09-17T05:23:14.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5280004d40 0x7f5294140310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52941435b0 0x7f529415cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.976 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415d470 0x7f5294151660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5294073d30 con 0x7f529415d470 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5294073bb0 con 0x7f52941435b0 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.972+0000 7f52988bf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f529415af60 con 0x7f5280004d40 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415d470 0x7f5294151660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415d470 0x7f5294151660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35290/0 (socket says 172.21.15.81:35290) 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 -- 172.21.15.81:0/3575442260 learned_addr learned my addr 172.21.15.81:0/3575442260 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f528bfff640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52941435b0 0x7f529415cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f529259c640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5280004d40 0x7f5294140310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 -- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5280004d40 msgr2=0x7f5294140310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5280004d40 0x7f5294140310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 -- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52941435b0 msgr2=0x7f529415cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52941435b0 0x7f529415cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 -- 172.21.15.81:0/3575442260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5294140850 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f5292d9d640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415d470 0x7f5294151660 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f528c002140 tx=0x7f528c004bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f528affd640 1 -- 172.21.15.81:0/3575442260 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c02bc10 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f528affd640 1 -- 172.21.15.81:0/3575442260 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f528c02bdb0 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52941f5a80 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f528affd640 1 -- 172.21.15.81:0/3575442260 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f528c0062d0 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.973+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52941f6040 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.974+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5294070790 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.975+0000 7f528affd640 1 -- 172.21.15.81:0/3575442260 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f528c006470 con 0x7f529415d470 2024-09-17T05:23:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.975+0000 7f528affd640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5274078ce0 0x7f527407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:14.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.975+0000 7f529259c640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5274078ce0 0x7f527407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:14.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.975+0000 7f528affd640 1 -- 172.21.15.81:0/3575442260 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f528c03b020 con 0x7f529415d470 2024-09-17T05:23:14.979 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.976+0000 7f529259c640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5274078ce0 0x7f527407b1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52941567d0 tx=0x7f5284005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:14.979+0000 7f528affd640 1 -- 172.21.15.81:0/3575442260 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f528c083170 con 0x7f529415d470 2024-09-17T05:23:15.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.168+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f5294072de0 con 0x7f529415d470 2024-09-17T05:23:15.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.168+0000 7f528affd640 1 -- 172.21.15.81:0/3575442260 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 2 entries v90) ==== 80+0+124 (secure 0 0 0) 0x7f528c082a70 con 0x7f529415d470 2024-09-17T05:23:15.170 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.160:6801/3249546675 2024-09-18T05:23:11.104835+0000 2024-09-17T05:23:15.170 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.15.160:6800/3249546675 2024-09-18T05:23:11.104835+0000 2024-09-17T05:23:15.170 INFO:teuthology.orchestra.run.smithi081.stderr:listed 2 entries 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.170+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5274078ce0 msgr2=0x7f527407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.170+0000 7f52988bf640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5274078ce0 0x7f527407b1a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f52941567d0 tx=0x7f5284005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415d470 msgr2=0x7f5294151660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415d470 0x7f5294151660 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f528c002140 tx=0x7f528c004bb0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 shutdown_connections 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f529415d470 0x7f5294151660 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5274078ce0 0x7f527407b1a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f52941435b0 0x7f529415cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 --2- 172.21.15.81:0/3575442260 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5280004d40 0x7f5294140310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 >> 172.21.15.81:0/3575442260 conn(0x7f52940b1690 msgr2=0x7f529415bfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:15.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 shutdown_connections 2024-09-17T05:23:15.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.171+0000 7f52988bf640 1 -- 172.21.15.81:0/3575442260 wait complete. 2024-09-17T05:23:15.182 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:23:15.182 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:15.182 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:15.211 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[46725]: fuse finished with error 0 and tester_r 0 2024-09-17T05:23:15.213 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:23:15.213 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:15.213 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:23:15.314 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:23:15.314 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:15.315 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:15.331 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:23:15.331 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:23:15.331 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:23:15.331 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:15.350 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:23:15.350 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:15.415 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:15.418 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.473+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/1627297352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2ac003aa0 msgr2=0x7fd2ac003ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.473+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/1627297352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2ac003aa0 0x7fd2ac003ee0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0009b50 tx=0x7fd2ac005830 comp rx=0 tx=0).stop 2024-09-17T05:23:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.473+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/1627297352 shutdown_connections 2024-09-17T05:23:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.473+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/1627297352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2ac003aa0 0x7fd2ac003ee0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.473+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/1627297352 >> 172.21.15.81:0/1627297352 conn(0x7fd2c00d3ea0 msgr2=0x7fd2c00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.473+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/1627297352 shutdown_connections 2024-09-17T05:23:15.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.473+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/1627297352 wait complete. 2024-09-17T05:23:15.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.474+0000 7fd2c5fb4640 1 Processor -- start 2024-09-17T05:23:15.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.474+0000 7fd2c5fb4640 1 -- start start 2024-09-17T05:23:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2c5fb4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2ac003aa0 0x7fd2c0160560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2c5fb4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c015e570 0x7fd2c015e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2c5fb4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd2c01f8420 0x7fd2c01f88a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2c5fb4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c00cf9b0 con 0x7fd2c015e570 2024-09-17T05:23:15.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2c5fb4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd2c01627a0 con 0x7fd2ac003aa0 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2c5fb4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd2c00cfb30 con 0x7fd2c01f8420 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c015e570 0x7fd2c015e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2b6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c015e570 0x7fd2c015e9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35308/0 (socket says 172.21.15.81:35308) 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2b6ffd640 1 -- 172.21.15.81:0/3892826709 learned_addr learned my addr 172.21.15.81:0/3892826709 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.475+0000 7fd2bf7fe640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2ac003aa0 0x7fd2c0160560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2bffff640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd2c01f8420 0x7fd2c01f88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2b6ffd640 1 -- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd2c01f8420 msgr2=0x7fd2c01f88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2b6ffd640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd2c01f8420 0x7fd2c01f88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2b6ffd640 1 -- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2ac003aa0 msgr2=0x7fd2c0160560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2b6ffd640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2ac003aa0 0x7fd2c0160560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2b6ffd640 1 -- 172.21.15.81:0/3892826709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2c0160c00 con 0x7fd2c015e570 2024-09-17T05:23:15.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2bf7fe640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2ac003aa0 0x7fd2c0160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:15.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2b6ffd640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c015e570 0x7fd2c015e9f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8004e20 tx=0x7fd2a8001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:15.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2bcff9640 1 -- 172.21.15.81:0/3892826709 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8015020 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2bcff9640 1 -- 172.21.15.81:0/3892826709 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd2a8011960 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2c0160ee0 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2bcff9640 1 -- 172.21.15.81:0/3892826709 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2a8011d90 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.476+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2c01614a0 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.477+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2c00d07a0 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.478+0000 7fd2bcff9640 1 -- 172.21.15.81:0/3892826709 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fd2a8018020 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.478+0000 7fd2bcff9640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd2a0078ce0 0x7fd2a007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.478+0000 7fd2bf7fe640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd2a0078ce0 0x7fd2a007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.478+0000 7fd2bcff9640 1 -- 172.21.15.81:0/3892826709 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7fd2a809b980 con 0x7fd2c015e570 2024-09-17T05:23:15.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.478+0000 7fd2bf7fe640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd2a0078ce0 0x7fd2a007b1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0035000 tx=0x7fd2b00046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:15.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.482+0000 7fd2bcff9640 1 -- 172.21.15.81:0/3892826709 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd2a801f020 con 0x7fd2c015e570 2024-09-17T05:23:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.694+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2c008d590 con 0x7fd2c015e570 2024-09-17T05:23:15.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.694+0000 7fd2bcff9640 1 -- 172.21.15.81:0/3892826709 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7fd2a8063bd0 con 0x7fd2c015e570 2024-09-17T05:23:15.696 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:15.696 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-17T05:23:12:106484+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3004752015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3004752015},{"type":"v1","addr":"172.21.15.81:6835","nonce":3004752015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4151219415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4151219415},{"type":"v1","addr":"172.21.15.160:6835","nonce":4151219415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/4277815965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":4277815965},{"type":"v1","addr":"172.21.15.160:6801","nonce":4277815965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:56.443180+0000","modified":"2024-09-17T05:22:59.178373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6834/3405352353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3405352353},{"type":"v1","addr":"172.21.15.81:6834","nonce":3405352353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6636,"qdb_cluster":[6636]},"id":6}]} 2024-09-17T05:23:15.696 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-17T05:23:15.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd2a0078ce0 msgr2=0x7fd2a007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd2a0078ce0 0x7fd2a007b1a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fd2b0035000 tx=0x7fd2b00046c0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c015e570 msgr2=0x7fd2c015e9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c015e570 0x7fd2c015e9f0 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7fd2a8004e20 tx=0x7fd2a8001630 comp rx=0 tx=0).stop 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 shutdown_connections 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd2c01f8420 0x7fd2c01f88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd2c015e570 0x7fd2c015e9f0 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd2a0078ce0 0x7fd2a007b1a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 --2- 172.21.15.81:0/3892826709 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd2ac003aa0 0x7fd2c0160560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 >> 172.21.15.81:0/3892826709 conn(0x7fd2c00d3ea0 msgr2=0x7fd2c00b51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:15.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 shutdown_connections 2024-09-17T05:23:15.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.697+0000 7fd2c5fb4640 1 -- 172.21.15.81:0/3892826709 wait complete. 2024-09-17T05:23:15.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.849+0000 7fa2abc47640 1 -- 172.21.15.81:0/2033834664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 msgr2=0x7fa28c0062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.849+0000 7fa2abc47640 1 --2- 172.21.15.81:0/2033834664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 0x7fa28c0062d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fa29400c290 tx=0x7fa28c006940 comp rx=0 tx=0).stop 2024-09-17T05:23:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.849+0000 7fa2aa1e4640 1 -- 172.21.15.81:0/2033834664 reap_dead start 2024-09-17T05:23:15.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.849+0000 7fa2abc47640 1 -- 172.21.15.81:0/2033834664 shutdown_connections 2024-09-17T05:23:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.849+0000 7fa2abc47640 1 -- 172.21.15.81:0/2033834664 >> 172.21.15.81:0/2033834664 conn(0x7fa2a40b1690 msgr2=0x7fa2a40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.849+0000 7fa2abc47640 1 -- 172.21.15.81:0/2033834664 shutdown_connections 2024-09-17T05:23:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.849+0000 7fa2abc47640 1 -- 172.21.15.81:0/2033834664 wait complete. 2024-09-17T05:23:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 Processor -- start 2024-09-17T05:23:15.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 -- start start 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 0x7fa2a41497d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a40af600 0x7fa2a40ac7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a40b04f0 0x7fa2a415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a406e760 con 0x7fa28c005e50 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa2a406e5e0 con 0x7fa2a40b04f0 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.851+0000 7fa2abc47640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa2a406e8e0 con 0x7fa2a40af600 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 0x7fa2a41497d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 0x7fa2a41497d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35318/0 (socket says 172.21.15.81:35318) 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 -- 172.21.15.81:0/927600853 learned_addr learned my addr 172.21.15.81:0/927600853 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a91e2640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a40af600 0x7fa2a40ac7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2aa1e4640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a40b04f0 0x7fa2a415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 -- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a40af600 msgr2=0x7fa2a40ac7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a40af600 0x7fa2a40ac7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 -- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a40b04f0 msgr2=0x7fa2a415a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a40b04f0 0x7fa2a415a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 -- 172.21.15.81:0/927600853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2a40a96e0 con 0x7fa28c005e50 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a91e2640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a40af600 0x7fa2a40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2aa1e4640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a40b04f0 0x7fa2a415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a99e3640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 0x7fa2a41497d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0043d0 tx=0x7fa29c004890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:15.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a27fc640 1 -- 172.21.15.81:0/927600853 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c00dc70 con 0x7fa28c005e50 2024-09-17T05:23:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a27fc640 1 -- 172.21.15.81:0/927600853 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa29c00de10 con 0x7fa28c005e50 2024-09-17T05:23:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2a40a99c0 con 0x7fa28c005e50 2024-09-17T05:23:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2a27fc640 1 -- 172.21.15.81:0/927600853 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa29c017680 con 0x7fa28c005e50 2024-09-17T05:23:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.852+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2a40b0970 con 0x7fa28c005e50 2024-09-17T05:23:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.853+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2a40cf380 con 0x7fa28c005e50 2024-09-17T05:23:15.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.854+0000 7fa2a27fc640 1 -- 172.21.15.81:0/927600853 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fa29c020400 con 0x7fa28c005e50 2024-09-17T05:23:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.854+0000 7fa2a27fc640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa290078ce0 0x7fa29007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.855+0000 7fa2a91e2640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa290078ce0 0x7fa29007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.855+0000 7fa2a27fc640 1 -- 172.21.15.81:0/927600853 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7fa29c09bb30 con 0x7fa28c005e50 2024-09-17T05:23:15.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.855+0000 7fa2a91e2640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa290078ce0 0x7fa29007b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40cda10 tx=0x7fa298005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:15.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:15.859+0000 7fa2a27fc640 1 -- 172.21.15.81:0/927600853 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa29c0637c0 con 0x7fa28c005e50 2024-09-17T05:23:16.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.076+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa2a40697e0 con 0x7fa28c005e50 2024-09-17T05:23:16.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.076+0000 7fa2a27fc640 1 -- 172.21.15.81:0/927600853 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7fa29c0681f0 con 0x7fa28c005e50 2024-09-17T05:23:16.077 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:16.077 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-17T05:23:12:106484+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3004752015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3004752015},{"type":"v1","addr":"172.21.15.81:6835","nonce":3004752015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4151219415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4151219415},{"type":"v1","addr":"172.21.15.160:6835","nonce":4151219415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/4277815965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":4277815965},{"type":"v1","addr":"172.21.15.160:6801","nonce":4277815965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:56.443180+0000","modified":"2024-09-17T05:22:59.178373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6834/3405352353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3405352353},{"type":"v1","addr":"172.21.15.81:6834","nonce":3405352353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6636,"qdb_cluster":[6636]},"id":6}]} 2024-09-17T05:23:16.078 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.078+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa290078ce0 msgr2=0x7fa29007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.078+0000 7fa2abc47640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa290078ce0 0x7fa29007b1a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fa2a40cda10 tx=0x7fa298005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.078+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 msgr2=0x7fa2a41497d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.078+0000 7fa2abc47640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 0x7fa2a41497d0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fa29c0043d0 tx=0x7fa29c004890 comp rx=0 tx=0).stop 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 shutdown_connections 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa290078ce0 0x7fa29007b1a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2a40b04f0 0x7fa2a415a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa2a40af600 0x7fa2a40ac7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 --2- 172.21.15.81:0/927600853 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa28c005e50 0x7fa2a41497d0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 >> 172.21.15.81:0/927600853 conn(0x7fa2a40b1690 msgr2=0x7fa2a40b4520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:16.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 shutdown_connections 2024-09-17T05:23:16.081 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.079+0000 7fa2abc47640 1 -- 172.21.15.81:0/927600853 wait complete. 2024-09-17T05:23:16.091 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 -- 172.21.15.81:0/761963503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c15df90 msgr2=0x7f057c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 --2- 172.21.15.81:0/761963503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c15df90 0x7f057c0cf9b0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7f056c005fd0 tx=0x7f056c02a530 comp rx=0 tx=0).stop 2024-09-17T05:23:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 -- 172.21.15.81:0/761963503 shutdown_connections 2024-09-17T05:23:16.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 --2- 172.21.15.81:0/761963503 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057c0d0d40 0x7f057c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 --2- 172.21.15.81:0/761963503 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c15df90 0x7f057c0cf9b0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 -- 172.21.15.81:0/761963503 >> 172.21.15.81:0/761963503 conn(0x7f057c0d3ea0 msgr2=0x7f057c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 -- 172.21.15.81:0/761963503 shutdown_connections 2024-09-17T05:23:16.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.192+0000 7f0581860640 1 -- 172.21.15.81:0/761963503 wait complete. 2024-09-17T05:23:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.193+0000 7f0581860640 1 Processor -- start 2024-09-17T05:23:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.193+0000 7f0581860640 1 -- start start 2024-09-17T05:23:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f0581860640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f057c0d0d40 0x7f057c157be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f0581860640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c0d49c0 0x7f057c1f8410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f0581860640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057c15df90 0x7f057c1f8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f0581860640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f057c162690 con 0x7f057c0d49c0 2024-09-17T05:23:16.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f0581860640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f057c0b3d40 con 0x7f057c0d0d40 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f0581860640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f057c1f92b0 con 0x7f057c15df90 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c0d49c0 0x7f057c1f8410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c0d49c0 0x7f057c1f8410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35338/0 (socket says 172.21.15.81:35338) 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 -- 172.21.15.81:0/937751662 learned_addr learned my addr 172.21.15.81:0/937751662 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057affd640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f057c0d0d40 0x7f057c157be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057b7fe640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057c15df90 0x7f057c1f8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 -- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057c15df90 msgr2=0x7f057c1f8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057c15df90 0x7f057c1f8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 -- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f057c0d0d40 msgr2=0x7f057c157be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f057c0d0d40 0x7f057c157be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057a7fc640 1 -- 172.21.15.81:0/937751662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f057c158d60 con 0x7f057c0d49c0 2024-09-17T05:23:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.194+0000 7f057b7fe640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057c15df90 0x7f057c1f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.195+0000 7f057a7fc640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c0d49c0 0x7f057c1f8410 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f057000c430 tx=0x7f057000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.195+0000 7f0563fff640 1 -- 172.21.15.81:0/937751662 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570011790 con 0x7f057c0d49c0 2024-09-17T05:23:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.195+0000 7f0563fff640 1 -- 172.21.15.81:0/937751662 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0570017070 con 0x7f057c0d49c0 2024-09-17T05:23:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.195+0000 7f0563fff640 1 -- 172.21.15.81:0/937751662 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0570011d00 con 0x7f057c0d49c0 2024-09-17T05:23:16.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.195+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f057c159040 con 0x7f057c0d49c0 2024-09-17T05:23:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.195+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f057c158120 con 0x7f057c0d49c0 2024-09-17T05:23:16.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.196+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057c08d590 con 0x7f057c0d49c0 2024-09-17T05:23:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.196+0000 7f0563fff640 1 -- 172.21.15.81:0/937751662 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f057001c460 con 0x7f057c0d49c0 2024-09-17T05:23:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.197+0000 7f0563fff640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0568078cb0 0x7f056807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.197+0000 7f057affd640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0568078cb0 0x7f056807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.197+0000 7f0563fff640 1 -- 172.21.15.81:0/937751662 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f057009adf0 con 0x7f057c0d49c0 2024-09-17T05:23:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.198+0000 7f057affd640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0568078cb0 0x7f056807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f056c033000 tx=0x7f056c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:16.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.201+0000 7f0563fff640 1 -- 172.21.15.81:0/937751662 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0570063040 con 0x7f057c0d49c0 2024-09-17T05:23:16.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.381+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f057c0d09f0 con 0x7f057c0d49c0 2024-09-17T05:23:16.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.382+0000 7f0563fff640 1 -- 172.21.15.81:0/937751662 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16851 (secure 0 0 0) 0x7f0570062940 con 0x7f057c0d49c0 2024-09-17T05:23:16.383 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:16.383 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:23:14.117186+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:55.051902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:55.400475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6801/3249546675":"2024-09-18T05:23:11.104835+0000","172.21.15.160:6800/3249546675":"2024-09-18T05:23:11.104835+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:16.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0568078cb0 msgr2=0x7f056807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0568078cb0 0x7f056807b170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f056c033000 tx=0x7f056c004730 comp rx=0 tx=0).stop 2024-09-17T05:23:16.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c0d49c0 msgr2=0x7f057c1f8410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c0d49c0 0x7f057c1f8410 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f057000c430 tx=0x7f057000c8f0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 shutdown_connections 2024-09-17T05:23:16.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057c15df90 0x7f057c1f8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057c0d49c0 0x7f057c1f8410 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0568078cb0 0x7f056807b170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 --2- 172.21.15.81:0/937751662 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f057c0d0d40 0x7f057c157be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 >> 172.21.15.81:0/937751662 conn(0x7f057c0d3ea0 msgr2=0x7f057c161750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:16.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 shutdown_connections 2024-09-17T05:23:16.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.384+0000 7f0581860640 1 -- 172.21.15.81:0/937751662 wait complete. 2024-09-17T05:23:16.396 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:23:16.397 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1372771803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c070690 msgr2=0x7f849c0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1372771803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c070690 0x7f849c0739a0 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f8494005fd0 tx=0x7f849402aa00 comp rx=0 tx=0).stop 2024-09-17T05:23:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1372771803 shutdown_connections 2024-09-17T05:23:16.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1372771803 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c070690 0x7f849c0739a0 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1372771803 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f849c15aa70 0x7f849c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1372771803 >> 172.21.15.81:0/1372771803 conn(0x7f849c0b1690 msgr2=0x7f849c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1372771803 shutdown_connections 2024-09-17T05:23:16.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.497+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1372771803 wait complete. 2024-09-17T05:23:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.498+0000 7f84a1ea3640 1 Processor -- start 2024-09-17T05:23:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.498+0000 7f84a1ea3640 1 -- start start 2024-09-17T05:23:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f849c070690 0x7f849c1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c0735a0 0x7f849c06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f849c15aa70 0x7f849c06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0cd270 con 0x7f849c0735a0 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f849c0cd0f0 con 0x7f849c15aa70 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f849c0cd3f0 con 0x7f849c070690 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c0735a0 0x7f849c06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c0735a0 0x7f849c06ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35356/0 (socket says 172.21.15.81:35356) 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 -- 172.21.15.81:0/1619117247 learned_addr learned my addr 172.21.15.81:0/1619117247 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:16.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849bfff640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f849c15aa70 0x7f849c06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849b7fe640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f849c070690 0x7f849c1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 -- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f849c070690 msgr2=0x7f849c1508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f849c070690 0x7f849c1508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 -- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f849c15aa70 msgr2=0x7f849c06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f849c15aa70 0x7f849c06f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 -- 172.21.15.81:0/1619117247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f849c1f3280 con 0x7f849c0735a0 2024-09-17T05:23:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f849affd640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c0735a0 0x7f849c06ee70 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f849000c400 tx=0x7f849000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f8483fff640 1 -- 172.21.15.81:0/1619117247 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490017070 con 0x7f849c0735a0 2024-09-17T05:23:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f8483fff640 1 -- 172.21.15.81:0/1619117247 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f84900035f0 con 0x7f849c0735a0 2024-09-17T05:23:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f849c1f24c0 con 0x7f849c0735a0 2024-09-17T05:23:16.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f8483fff640 1 -- 172.21.15.81:0/1619117247 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8490003a80 con 0x7f849c0735a0 2024-09-17T05:23:16.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.499+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f849c1f2a80 con 0x7f849c0735a0 2024-09-17T05:23:16.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.500+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f849c0cd950 con 0x7f849c0735a0 2024-09-17T05:23:16.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.501+0000 7f8483fff640 1 -- 172.21.15.81:0/1619117247 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f8490003c20 con 0x7f849c0735a0 2024-09-17T05:23:16.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.501+0000 7f8483fff640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8488078ce0 0x7f848807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.502+0000 7f8483fff640 1 -- 172.21.15.81:0/1619117247 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f849009a1e0 con 0x7f849c0735a0 2024-09-17T05:23:16.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.502+0000 7f849b7fe640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8488078ce0 0x7f848807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.502+0000 7f849b7fe640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8488078ce0 0x7f848807b1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f848c0058c0 tx=0x7f848c005f60 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:16.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.506+0000 7f8483fff640 1 -- 172.21.15.81:0/1619117247 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f84900010c0 con 0x7f849c0735a0 2024-09-17T05:23:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.715+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f849c0b2e90 con 0x7f849c0735a0 2024-09-17T05:23:16.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.716+0000 7f8483fff640 1 -- 172.21.15.81:0/1619117247 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7f8490061d60 con 0x7f849c0735a0 2024-09-17T05:23:16.717 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:16.717 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-17T05:23:12:106484+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3004752015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3004752015},{"type":"v1","addr":"172.21.15.81:6835","nonce":3004752015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4151219415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4151219415},{"type":"v1","addr":"172.21.15.160:6835","nonce":4151219415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/4277815965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":4277815965},{"type":"v1","addr":"172.21.15.160:6801","nonce":4277815965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:56.443180+0000","modified":"2024-09-17T05:22:59.178373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6834/3405352353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3405352353},{"type":"v1","addr":"172.21.15.81:6834","nonce":3405352353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6636,"qdb_cluster":[6636]},"id":6}]} 2024-09-17T05:23:16.718 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-17T05:23:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8488078ce0 msgr2=0x7f848807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8488078ce0 0x7f848807b1a0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f848c0058c0 tx=0x7f848c005f60 comp rx=0 tx=0).stop 2024-09-17T05:23:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c0735a0 msgr2=0x7f849c06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c0735a0 0x7f849c06ee70 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f849000c400 tx=0x7f849000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 shutdown_connections 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8488078ce0 0x7f848807b1a0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f849c15aa70 0x7f849c06f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f849c0735a0 0x7f849c06ee70 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 --2- 172.21.15.81:0/1619117247 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f849c070690 0x7f849c1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 >> 172.21.15.81:0/1619117247 conn(0x7f849c0b1690 msgr2=0x7f849c155010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 shutdown_connections 2024-09-17T05:23:16.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.718+0000 7f84a1ea3640 1 -- 172.21.15.81:0/1619117247 wait complete. 2024-09-17T05:23:16.731 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.831+0000 7f92686c6640 1 -- 172.21.15.81:0/656602921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d49c0 msgr2=0x7f92600b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.831+0000 7f92686c6640 1 --2- 172.21.15.81:0/656602921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d49c0 0x7f92600b3800 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f9258005fd0 tx=0x7f925802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.832+0000 7f92686c6640 1 -- 172.21.15.81:0/656602921 shutdown_connections 2024-09-17T05:23:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.832+0000 7f92686c6640 1 --2- 172.21.15.81:0/656602921 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d49c0 0x7f92600b3800 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.832+0000 7f92686c6640 1 --2- 172.21.15.81:0/656602921 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f92600d0d40 0x7f92600cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.832+0000 7f92686c6640 1 -- 172.21.15.81:0/656602921 >> 172.21.15.81:0/656602921 conn(0x7f92600d3ea0 msgr2=0x7f92600d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.832+0000 7f92686c6640 1 -- 172.21.15.81:0/656602921 shutdown_connections 2024-09-17T05:23:16.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.832+0000 7f92686c6640 1 -- 172.21.15.81:0/656602921 wait complete. 2024-09-17T05:23:16.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.833+0000 7f92686c6640 1 Processor -- start 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.833+0000 7f92686c6640 1 -- start start 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d0d40 0x7f92600cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d49c0 0x7f926015e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f926015df90 0x7f92600cbea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f92600b3d40 con 0x7f92600d49c0 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9260162710 con 0x7f92600d0d40 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f92600b3ec0 con 0x7f926015df90 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d49c0 0x7f926015e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d49c0 0x7f926015e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35368/0 (socket says 172.21.15.81:35368) 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 -- 172.21.15.81:0/2454086378 learned_addr learned my addr 172.21.15.81:0/2454086378 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9266462640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d0d40 0x7f92600cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9266c63640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f926015df90 0x7f92600cbea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 -- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f926015df90 msgr2=0x7f92600cbea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f926015df90 0x7f92600cbea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 -- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d0d40 msgr2=0x7f92600cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d0d40 0x7f92600cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 -- 172.21.15.81:0/2454086378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f926015ebc0 con 0x7f92600d49c0 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9266462640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d0d40 0x7f92600cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9266c63640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f926015df90 0x7f92600cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9265c61640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d49c0 0x7f926015e570 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f925400ea20 tx=0x7f925400eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:16.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9252ffd640 1 -- 172.21.15.81:0/2454086378 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f925400cd80 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9252ffd640 1 -- 172.21.15.81:0/2454086378 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9254010430 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f926015eea0 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f9252ffd640 1 -- 172.21.15.81:0/2454086378 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9254010840 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.834+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f926015f460 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.835+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92600b4310 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.836+0000 7f9252ffd640 1 -- 172.21.15.81:0/2454086378 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f92540109e0 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.837+0000 7f9252ffd640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9244078ce0 0x7f924407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.837+0000 7f9266462640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9244078ce0 0x7f924407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.837+0000 7f9252ffd640 1 -- 172.21.15.81:0/2454086378 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f925409ba70 con 0x7f92600d49c0 2024-09-17T05:23:16.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.837+0000 7f9266462640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9244078ce0 0x7f924407b1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f925c007fd0 tx=0x7f925c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:16.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:16.841+0000 7f9252ffd640 1 -- 172.21.15.81:0/2454086378 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9254063d50 con 0x7f92600d49c0 2024-09-17T05:23:17.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.055+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f926008d590 con 0x7f92600d49c0 2024-09-17T05:23:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.056+0000 7f9252ffd640 1 -- 172.21.15.81:0/2454086378 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 52 v52) ==== 94+0+5231 (secure 0 0 0) 0x7f9254063650 con 0x7f92600d49c0 2024-09-17T05:23:17.057 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:17.057 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":52,"btime":"2024-09-17T05:23:12:106484+0000","default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3004752015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3004752015},{"type":"v1","addr":"172.21.15.81:6835","nonce":3004752015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4151219415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4151219415},{"type":"v1","addr":"172.21.15.160:6835","nonce":4151219415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/4277815965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":4277815965},{"type":"v1","addr":"172.21.15.160:6801","nonce":4277815965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52}],"filesystems":[{"mdsmap":{"epoch":48,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:22:56.443180+0000","modified":"2024-09-17T05:22:59.178373+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":6636},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6636":{"gid":6636,"name":"a","rank":0,"incarnation":45,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6834/3405352353","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3405352353},{"type":"v1","addr":"172.21.15.81:6834","nonce":3405352353}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":6636,"qdb_cluster":[6636]},"id":6}]} 2024-09-17T05:23:17.057 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 52 2024-09-17T05:23:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9244078ce0 msgr2=0x7f924407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9244078ce0 0x7f924407b1a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f925c007fd0 tx=0x7f925c009040 comp rx=0 tx=0).stop 2024-09-17T05:23:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d49c0 msgr2=0x7f926015e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d49c0 0x7f926015e570 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f925400ea20 tx=0x7f925400eee0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 shutdown_connections 2024-09-17T05:23:17.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f926015df90 0x7f92600cbea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f92600d49c0 0x7f926015e570 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9244078ce0 0x7f924407b1a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 --2- 172.21.15.81:0/2454086378 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92600d0d40 0x7f92600cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 >> 172.21.15.81:0/2454086378 conn(0x7f92600d3ea0 msgr2=0x7f926006e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:17.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 shutdown_connections 2024-09-17T05:23:17.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.058+0000 7f92686c6640 1 -- 172.21.15.81:0/2454086378 wait complete. 2024-09-17T05:23:17.070 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.171+0000 7f531542a640 1 -- 172.21.15.81:0/2289631913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 msgr2=0x7f531015f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.171+0000 7f531542a640 1 --2- 172.21.15.81:0/2289631913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f531015f6d0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f5304009830 tx=0x7f530402a5a0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.171+0000 7f531542a640 1 -- 172.21.15.81:0/2289631913 shutdown_connections 2024-09-17T05:23:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.171+0000 7f531542a640 1 --2- 172.21.15.81:0/2289631913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f531015f6d0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.171+0000 7f531542a640 1 -- 172.21.15.81:0/2289631913 >> 172.21.15.81:0/2289631913 conn(0x7f531009aa30 msgr2=0x7f531009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:17.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.171+0000 7f531542a640 1 -- 172.21.15.81:0/2289631913 shutdown_connections 2024-09-17T05:23:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.171+0000 7f531542a640 1 -- 172.21.15.81:0/2289631913 wait complete. 2024-09-17T05:23:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.172+0000 7f531542a640 1 Processor -- start 2024-09-17T05:23:17.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.172+0000 7f531542a640 1 -- start start 2024-09-17T05:23:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f531542a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f53101f3820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f531542a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53100cfce0 0x7f53100c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f531542a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53100d2410 0x7f53101f5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f531542a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53100b15d0 con 0x7f53100b3090 2024-09-17T05:23:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f531542a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f53100b1450 con 0x7f53100cfce0 2024-09-17T05:23:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f531542a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f53100b1750 con 0x7f53100d2410 2024-09-17T05:23:17.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f53101f3820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f53101f3820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35380/0 (socket says 172.21.15.81:35380) 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 -- 172.21.15.81:0/537685935 learned_addr learned my addr 172.21.15.81:0/537685935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 -- 172.21.15.81:0/537685935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53100d2410 msgr2=0x7f53101f5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53100d2410 0x7f53101f5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 -- 172.21.15.81:0/537685935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53100cfce0 msgr2=0x7f53100c8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530e7fc640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53100cfce0 0x7f53100c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53100cfce0 0x7f53100c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 -- 172.21.15.81:0/537685935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53100cb520 con 0x7f53100b3090 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f530effd640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f53101f3820 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f530000ba50 tx=0x7f530000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f52f77fe640 1 -- 172.21.15.81:0/537685935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5300019070 con 0x7f53100b3090 2024-09-17T05:23:17.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f52f77fe640 1 -- 172.21.15.81:0/537685935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f530000cd10 con 0x7f53100b3090 2024-09-17T05:23:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f52f77fe640 1 -- 172.21.15.81:0/537685935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53000146a0 con 0x7f53100b3090 2024-09-17T05:23:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.173+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53100cb800 con 0x7f53100b3090 2024-09-17T05:23:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.174+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101573e0 con 0x7f53100b3090 2024-09-17T05:23:17.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.174+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53100b1b70 con 0x7f53100b3090 2024-09-17T05:23:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.175+0000 7f52f77fe640 1 -- 172.21.15.81:0/537685935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f530001c070 con 0x7f53100b3090 2024-09-17T05:23:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.176+0000 7f52f77fe640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f52fc078cb0 0x7f52fc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.176+0000 7f52f77fe640 1 -- 172.21.15.81:0/537685935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f530009ac60 con 0x7f53100b3090 2024-09-17T05:23:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.176+0000 7f530e7fc640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f52fc078cb0 0x7f52fc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.176+0000 7f530e7fc640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f52fc078cb0 0x7f52fc07b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5304034000 tx=0x7f5304004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:17.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.180+0000 7f52f77fe640 1 -- 172.21.15.81:0/537685935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5300062870 con 0x7f53100b3090 2024-09-17T05:23:17.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.356+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53100d29a0 con 0x7f53100b3090 2024-09-17T05:23:17.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.357+0000 7f52f77fe640 1 -- 172.21.15.81:0/537685935 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+16851 (secure 0 0 0) 0x7f53000672a0 con 0x7f53100b3090 2024-09-17T05:23:17.358 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:17.358 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":90,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:23:14.117186+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:22:55.051902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2024-09-17T05:22:55.400475+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"83","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6801/3249546675":"2024-09-18T05:23:11.104835+0000","172.21.15.160:6800/3249546675":"2024-09-18T05:23:11.104835+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f52fc078cb0 msgr2=0x7f52fc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f52fc078cb0 0x7f52fc07b170 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f5304034000 tx=0x7f5304004730 comp rx=0 tx=0).stop 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 msgr2=0x7f53101f3820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f53101f3820 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f530000ba50 tx=0x7f530000bf10 comp rx=0 tx=0).stop 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 shutdown_connections 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53100d2410 0x7f53101f5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f52fc078cb0 0x7f52fc07b170 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53100cfce0 0x7f53100c8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 --2- 172.21.15.81:0/537685935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53100b3090 0x7f53101f3820 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 >> 172.21.15.81:0/537685935 conn(0x7f531009aa30 msgr2=0x7f53100b36d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 shutdown_connections 2024-09-17T05:23:17.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.360+0000 7f531542a640 1 -- 172.21.15.81:0/537685935 wait complete. 2024-09-17T05:23:17.372 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:23:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 -- 172.21.15.81:0/3248169711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38151370 msgr2=0x7f0e380cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/3248169711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38151370 0x7f0e380cef30 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f0e28005fd0 tx=0x7f0e2802aae0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 -- 172.21.15.81:0/3248169711 shutdown_connections 2024-09-17T05:23:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/3248169711 >> v2:172.21.15.160:3300/0 conn(0x7f0e38072cb0 0x7f0e380cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/3248169711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38151370 0x7f0e380cef30 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 -- 172.21.15.81:0/3248169711 >> 172.21.15.81:0/3248169711 conn(0x7f0e380b1690 msgr2=0x7f0e380b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 -- 172.21.15.81:0/3248169711 shutdown_connections 2024-09-17T05:23:17.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.472+0000 7f0e3eddb640 1 -- 172.21.15.81:0/3248169711 wait complete. 2024-09-17T05:23:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.473+0000 7f0e3eddb640 1 Processor -- start 2024-09-17T05:23:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.473+0000 7f0e3eddb640 1 -- start start 2024-09-17T05:23:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3eddb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38072cb0 0x7f0e381435f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3eddb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e380b3140 0x7f0e381536f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3eddb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e38151370 0x7f0e380cdce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3eddb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3806eb90 con 0x7f0e38072cb0 2024-09-17T05:23:17.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3eddb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e3806ea10 con 0x7f0e38151370 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3eddb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0e3806f9f0 con 0x7f0e380b3140 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38072cb0 0x7f0e381435f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38072cb0 0x7f0e381435f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35390/0 (socket says 172.21.15.81:35390) 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 -- 172.21.15.81:0/1530392242 learned_addr learned my addr 172.21.15.81:0/1530392242 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3d378640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e38151370 0x7f0e380cdce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e37fff640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e380b3140 0x7f0e381536f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 -- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e380b3140 msgr2=0x7f0e381536f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e380b3140 0x7f0e381536f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 -- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e38151370 msgr2=0x7f0e380cdce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e38151370 0x7f0e380cdce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3cb77640 1 -- 172.21.15.81:0/1530392242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e38147340 con 0x7f0e38072cb0 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.474+0000 7f0e3d378640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e38151370 0x7f0e380cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.475+0000 7f0e3cb77640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38072cb0 0x7f0e381435f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006010 tx=0x7f0e28003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.475+0000 7f0e357fa640 1 -- 172.21.15.81:0/1530392242 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28044070 con 0x7f0e38072cb0 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.475+0000 7f0e357fa640 1 -- 172.21.15.81:0/1530392242 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e28004250 con 0x7f0e38072cb0 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.475+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e380cd200 con 0x7f0e38072cb0 2024-09-17T05:23:17.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.475+0000 7f0e357fa640 1 -- 172.21.15.81:0/1530392242 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e28004660 con 0x7f0e38072cb0 2024-09-17T05:23:17.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.475+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e3813f8f0 con 0x7f0e38072cb0 2024-09-17T05:23:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.476+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e380725a0 con 0x7f0e38072cb0 2024-09-17T05:23:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.476+0000 7f0e357fa640 1 -- 172.21.15.81:0/1530392242 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f0e28047070 con 0x7f0e38072cb0 2024-09-17T05:23:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.477+0000 7f0e357fa640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e18078cb0 0x7f0e1807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.477+0000 7f0e37fff640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e18078cb0 0x7f0e1807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.477+0000 7f0e357fa640 1 -- 172.21.15.81:0/1530392242 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 5795+0+0 (secure 0 0 0) 0x7f0e280bbde0 con 0x7f0e38072cb0 2024-09-17T05:23:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.477+0000 7f0e37fff640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e18078cb0 0x7f0e1807b170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e380b0b10 tx=0x7f0e20009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:17.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.481+0000 7f0e357fa640 1 -- 172.21.15.81:0/1530392242 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0e28032030 con 0x7f0e38072cb0 2024-09-17T05:23:17.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.692+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f0e380cd3d0 con 0x7f0e38072cb0 2024-09-17T05:23:17.693 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:23:17.692+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:23:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.694+0000 7f0e357fa640 1 -- 172.21.15.81:0/1530392242 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v53) ==== 161+0+0 (secure 0 0 0) 0x7f0e28084030 con 0x7f0e38072cb0 2024-09-17T05:23:17.695 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.696+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e18078cb0 msgr2=0x7f0e1807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e18078cb0 0x7f0e1807b170 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f0e380b0b10 tx=0x7f0e20009040 comp rx=0 tx=0).stop 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38072cb0 msgr2=0x7f0e381435f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38072cb0 0x7f0e381435f0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f0e28006010 tx=0x7f0e28003ce0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 shutdown_connections 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e18078cb0 0x7f0e1807b170 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e38151370 0x7f0e380cdce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e380b3140 0x7f0e381536f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 --2- 172.21.15.81:0/1530392242 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e38072cb0 0x7f0e381435f0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 >> 172.21.15.81:0/1530392242 conn(0x7f0e380b1690 msgr2=0x7f0e38141f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 shutdown_connections 2024-09-17T05:23:17.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.697+0000 7f0e3eddb640 1 -- 172.21.15.81:0/1530392242 wait complete. 2024-09-17T05:23:17.699 INFO:tasks.ceph.mds.a.smithi081.stderr: -1361> 2024-09-17T05:22:59.059+0000 7fd2a8962640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:23:17.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:23:17.725 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:23:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.812+0000 7f8a5d608640 1 -- 172.21.15.81:0/3867771526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004d40 msgr2=0x7f8a440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.812+0000 7f8a5d608640 1 --2- 172.21.15.81:0/3867771526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004d40 0x7f8a440051c0 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f8a5000baf0 tx=0x7f8a44005830 comp rx=0 tx=0).stop 2024-09-17T05:23:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.813+0000 7f8a577fe640 1 -- 172.21.15.81:0/3867771526 reap_dead start 2024-09-17T05:23:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.813+0000 7f8a5d608640 1 -- 172.21.15.81:0/3867771526 shutdown_connections 2024-09-17T05:23:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.813+0000 7f8a5d608640 1 -- 172.21.15.81:0/3867771526 >> 172.21.15.81:0/3867771526 conn(0x7f8a580b1700 msgr2=0x7f8a580b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.813+0000 7f8a5d608640 1 -- 172.21.15.81:0/3867771526 shutdown_connections 2024-09-17T05:23:17.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.813+0000 7f8a5d608640 1 -- 172.21.15.81:0/3867771526 wait complete. 2024-09-17T05:23:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.814+0000 7f8a5d608640 1 Processor -- start 2024-09-17T05:23:17.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.814+0000 7f8a5d608640 1 -- start start 2024-09-17T05:23:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a44004d40 0x7f8a580c8e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a580c93b0 0x7f8a581430d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a581f3060 0x7f8a58143610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580ce300 con 0x7f8a580c93b0 2024-09-17T05:23:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580ce180 con 0x7f8a581f3060 2024-09-17T05:23:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8a580ce480 con 0x7f8a44004d40 2024-09-17T05:23:17.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a580c93b0 0x7f8a581430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a580c93b0 0x7f8a581430d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35420/0 (socket says 172.21.15.81:35420) 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 -- 172.21.15.81:0/2126696394 learned_addr learned my addr 172.21.15.81:0/2126696394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a577fe640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a581f3060 0x7f8a58143610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a56ffd640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a44004d40 0x7f8a580c8e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 -- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a44004d40 msgr2=0x7f8a580c8e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a44004d40 0x7f8a580c8e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 -- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a581f3060 msgr2=0x7f8a58143610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a581f3060 0x7f8a58143610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 -- 172.21.15.81:0/2126696394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a580c7dd0 con 0x7f8a580c93b0 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a567fc640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a580c93b0 0x7f8a581430d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8a40004650 tx=0x7f8a4000ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/2126696394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40010850 con 0x7f8a580c93b0 2024-09-17T05:23:17.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/2126696394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a400109f0 con 0x7f8a580c93b0 2024-09-17T05:23:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a580c80b0 con 0x7f8a580c93b0 2024-09-17T05:23:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/2126696394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a40010e40 con 0x7f8a580c93b0 2024-09-17T05:23:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.815+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a580c8670 con 0x7f8a580c93b0 2024-09-17T05:23:17.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.817+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a580cf250 con 0x7f8a580c93b0 2024-09-17T05:23:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.817+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/2126696394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f8a40023440 con 0x7f8a580c93b0 2024-09-17T05:23:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.818+0000 7f8a4f7fe640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a38078cb0 0x7f8a3807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.818+0000 7f8a56ffd640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a38078cb0 0x7f8a3807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.818+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/2126696394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5881+0+0 (secure 0 0 0) 0x7f8a4009bd20 con 0x7f8a580c93b0 2024-09-17T05:23:17.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.818+0000 7f8a56ffd640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a38078cb0 0x7f8a3807b170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a48001370 tx=0x7f8a48001f30 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:17.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:17.822+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/2126696394 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8a40063f30 con 0x7f8a580c93b0 2024-09-17T05:23:18.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.034+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f8a58069700 con 0x7f8a580c93b0 2024-09-17T05:23:18.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.700+0000 7f8a4f7fe640 1 -- 172.21.15.81:0/2126696394 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v54) ==== 104+0+0 (secure 0 0 0) 0x7f8a40063830 con 0x7f8a580c93b0 2024-09-17T05:23:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a38078cb0 msgr2=0x7f8a3807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a38078cb0 0x7f8a3807b170 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f8a48001370 tx=0x7f8a48001f30 comp rx=0 tx=0).stop 2024-09-17T05:23:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a580c93b0 msgr2=0x7f8a581430d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:18.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a580c93b0 0x7f8a581430d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f8a40004650 tx=0x7f8a4000ba40 comp rx=0 tx=0).stop 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 shutdown_connections 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a38078cb0 0x7f8a3807b170 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a581f3060 0x7f8a58143610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a580c93b0 0x7f8a581430d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 --2- 172.21.15.81:0/2126696394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a44004d40 0x7f8a580c8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 >> 172.21.15.81:0/2126696394 conn(0x7f8a580b1700 msgr2=0x7f8a58156d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 shutdown_connections 2024-09-17T05:23:18.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.703+0000 7f8a5d608640 1 -- 172.21.15.81:0/2126696394 wait complete. 2024-09-17T05:23:18.718 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:23:18.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.868+0000 7fa913df8640 1 -- 172.21.15.81:0/1323542448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 msgr2=0x7fa8f4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:18.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.868+0000 7fa913df8640 1 --2- 172.21.15.81:0/1323542448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 0x7fa8f4004800 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7fa900009b80 tx=0x7fa8f4005830 comp rx=0 tx=0).stop 2024-09-17T05:23:18.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.868+0000 7fa912395640 1 -- 172.21.15.81:0/1323542448 reap_dead start 2024-09-17T05:23:18.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.868+0000 7fa913df8640 1 -- 172.21.15.81:0/1323542448 shutdown_connections 2024-09-17T05:23:18.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.868+0000 7fa913df8640 1 -- 172.21.15.81:0/1323542448 >> 172.21.15.81:0/1323542448 conn(0x7fa90c0b1620 msgr2=0x7fa90c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:18.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.869+0000 7fa913df8640 1 -- 172.21.15.81:0/1323542448 shutdown_connections 2024-09-17T05:23:18.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.869+0000 7fa913df8640 1 -- 172.21.15.81:0/1323542448 wait complete. 2024-09-17T05:23:18.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.870+0000 7fa913df8640 1 Processor -- start 2024-09-17T05:23:18.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.870+0000 7fa913df8640 1 -- start start 2024-09-17T05:23:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.870+0000 7fa913df8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 0x7fa90c0cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa913df8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa90c154760 0x7fa90c140b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa913df8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa90c1410c0 0x7fa90c1e4550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa913df8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c15bd00 con 0x7fa8f4003fd0 2024-09-17T05:23:18.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa913df8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa90c15bb80 con 0x7fa90c1410c0 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa913df8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa90c158400 con 0x7fa90c154760 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 0x7fa90c0cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 0x7fa90c0cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35430/0 (socket says 172.21.15.81:35430) 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 -- 172.21.15.81:0/1129067828 learned_addr learned my addr 172.21.15.81:0/1129067828 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa912395640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa90c1410c0 0x7fa90c1e4550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911393640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa90c154760 0x7fa90c140b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 -- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa90c154760 msgr2=0x7fa90c140b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa90c154760 0x7fa90c140b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 -- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa90c1410c0 msgr2=0x7fa90c1e4550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa90c1410c0 0x7fa90c1e4550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 -- 172.21.15.81:0/1129067828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa90c1445e0 con 0x7fa8f4003fd0 2024-09-17T05:23:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911393640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa90c154760 0x7fa90c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa911b94640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 0x7fa90c0cce70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc010c50 tx=0x7fa8fc00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa90a7fc640 1 -- 172.21.15.81:0/1129067828 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc003970 con 0x7fa8f4003fd0 2024-09-17T05:23:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa90a7fc640 1 -- 172.21.15.81:0/1129067828 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa8fc003b30 con 0x7fa8f4003fd0 2024-09-17T05:23:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa90c0cd3b0 con 0x7fa8f4003fd0 2024-09-17T05:23:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa90a7fc640 1 -- 172.21.15.81:0/1129067828 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8fc004050 con 0x7fa8f4003fd0 2024-09-17T05:23:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.871+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa90c143b00 con 0x7fa8f4003fd0 2024-09-17T05:23:18.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.872+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa90c157cf0 con 0x7fa8f4003fd0 2024-09-17T05:23:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.873+0000 7fa90a7fc640 1 -- 172.21.15.81:0/1129067828 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fa8fc0041f0 con 0x7fa8f4003fd0 2024-09-17T05:23:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.874+0000 7fa90a7fc640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8f8078cb0 0x7fa8f807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.874+0000 7fa90a7fc640 1 -- 172.21.15.81:0/1129067828 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(91..91 src has 1..91) ==== 5881+0+0 (secure 0 0 0) 0x7fa8fc09bba0 con 0x7fa8f4003fd0 2024-09-17T05:23:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.874+0000 7fa911393640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8f8078cb0 0x7fa8f807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:18.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.874+0000 7fa911393640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8f8078cb0 0x7fa8f807b170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa900035000 tx=0x7fa9000046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:18.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:18.878+0000 7fa90a7fc640 1 -- 172.21.15.81:0/1129067828 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa8fc063da0 con 0x7fa8f4003fd0 2024-09-17T05:23:19.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.052+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fa90c0b48e0 con 0x7fa8f4003fd0 2024-09-17T05:23:19.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.701+0000 7fa90a7fc640 1 -- 172.21.15.81:0/1129067828 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v92) ==== 181+0+0 (secure 0 0 0) 0x7fa8fc0636a0 con 0x7fa8f4003fd0 2024-09-17T05:23:19.703 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:23:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8f8078cb0 msgr2=0x7fa8f807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:19.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8f8078cb0 0x7fa8f807b170 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fa900035000 tx=0x7fa9000046c0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 msgr2=0x7fa90c0cce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 0x7fa90c0cce70 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7fa8fc010c50 tx=0x7fa8fc00e720 comp rx=0 tx=0).stop 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 shutdown_connections 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa8f8078cb0 0x7fa8f807b170 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa90c1410c0 0x7fa90c1e4550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa90c154760 0x7fa90c140b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 --2- 172.21.15.81:0/1129067828 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa8f4003fd0 0x7fa90c0cce70 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 >> 172.21.15.81:0/1129067828 conn(0x7fa90c0b1620 msgr2=0x7fa90c0b36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 shutdown_connections 2024-09-17T05:23:19.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.705+0000 7fa913df8640 1 -- 172.21.15.81:0/1129067828 wait complete. 2024-09-17T05:23:19.720 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:23:19.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 -- 172.21.15.81:0/2484886422 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600161300 msgr2=0x7f36000d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:19.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 --2- 172.21.15.81:0/2484886422 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600161300 0x7f36000d4940 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f35f0009830 tx=0x7f35f002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 -- 172.21.15.81:0/2484886422 shutdown_connections 2024-09-17T05:23:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 --2- 172.21.15.81:0/2484886422 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36000d25b0 0x7f36000b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 --2- 172.21.15.81:0/2484886422 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3600161300 0x7f36000d4940 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 -- 172.21.15.81:0/2484886422 >> 172.21.15.81:0/2484886422 conn(0x7f36000d3e20 msgr2=0x7f36000d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 -- 172.21.15.81:0/2484886422 shutdown_connections 2024-09-17T05:23:19.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.828+0000 7f36062dd640 1 -- 172.21.15.81:0/2484886422 wait complete. 2024-09-17T05:23:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.829+0000 7f36062dd640 1 Processor -- start 2024-09-17T05:23:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.829+0000 7f36062dd640 1 -- start start 2024-09-17T05:23:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f36062dd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36000d25b0 0x7f360014f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f36062dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3600161300 0x7f3600151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:19.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f36062dd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36001616e0 0x7f36000a0190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f36062dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f36000b7cb0 con 0x7f3600161300 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f36062dd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f36000b7b30 con 0x7f36001616e0 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f36062dd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f36000b7e30 con 0x7f36000d25b0 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f35ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3600161300 0x7f3600151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f35fffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36000d25b0 0x7f360014f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f35ff7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3600161300 0x7f3600151d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35440/0 (socket says 172.21.15.81:35440) 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f35fffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36000d25b0 0x7f360014f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.160:3301/0 says I am v2:172.21.15.81:43988/0 (socket says 172.21.15.81:43988) 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f35ff7fe640 1 -- 172.21.15.81:0/2532513454 learned_addr learned my addr 172.21.15.81:0/2532513454 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.830+0000 7f360487a640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36001616e0 0x7f36000a0190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35ff7fe640 1 -- 172.21.15.81:0/2532513454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36000d25b0 msgr2=0x7f360014f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35ff7fe640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36000d25b0 0x7f360014f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35ff7fe640 1 -- 172.21.15.81:0/2532513454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36001616e0 msgr2=0x7f36000a0190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35ff7fe640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36001616e0 0x7f36000a0190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35ff7fe640 1 -- 172.21.15.81:0/2532513454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360014f9b0 con 0x7f3600161300 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35ff7fe640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3600161300 0x7f3600151d50 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c3a0 tx=0x7f35f400c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35fcff9640 1 -- 172.21.15.81:0/2532513454 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011790 con 0x7f3600161300 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35fcff9640 1 -- 172.21.15.81:0/2532513454 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f35f4017070 con 0x7f3600161300 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36001527a0 con 0x7f3600161300 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f35fcff9640 1 -- 172.21.15.81:0/2532513454 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f4011cc0 con 0x7f3600161300 2024-09-17T05:23:19.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.831+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36000c8b20 con 0x7f3600161300 2024-09-17T05:23:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.832+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36000b9540 con 0x7f3600161300 2024-09-17T05:23:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.833+0000 7f35fcff9640 1 -- 172.21.15.81:0/2532513454 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f35f401c460 con 0x7f3600161300 2024-09-17T05:23:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.833+0000 7f35fcff9640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f35ec078cb0 0x7f35ec07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.833+0000 7f35fcff9640 1 -- 172.21.15.81:0/2532513454 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 5443+0+0 (secure 0 0 0) 0x7f35f409ab60 con 0x7f3600161300 2024-09-17T05:23:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.833+0000 7f35fffff640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f35ec078cb0 0x7f35ec07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:19.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.833+0000 7f35fffff640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f35ec078cb0 0x7f35ec07b170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f35f0034000 tx=0x7f35f0004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:19.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:19.837+0000 7f35fcff9640 1 -- 172.21.15.81:0/2532513454 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f35f4062e90 con 0x7f3600161300 2024-09-17T05:23:20.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.013+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f360015f590 con 0x7f3600161300 2024-09-17T05:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.707+0000 7f35fcff9640 1 -- 172.21.15.81:0/2532513454 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v93) ==== 169+0+0 (secure 0 0 0) 0x7f35f4062790 con 0x7f3600161300 2024-09-17T05:23:20.708 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:23:20.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f35ec078cb0 msgr2=0x7f35ec07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:20.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f35ec078cb0 0x7f35ec07b170 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f35f0034000 tx=0x7f35f0004730 comp rx=0 tx=0).stop 2024-09-17T05:23:20.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3600161300 msgr2=0x7f3600151d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:20.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3600161300 0x7f3600151d50 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c3a0 tx=0x7f35f400c7a0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 shutdown_connections 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f35ec078cb0 0x7f35ec07b170 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f36001616e0 0x7f36000a0190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3600161300 0x7f3600151d50 secure :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f35f400c3a0 tx=0x7f35f400c7a0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 --2- 172.21.15.81:0/2532513454 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f36000d25b0 0x7f360014f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 >> 172.21.15.81:0/2532513454 conn(0x7f36000d3e20 msgr2=0x7f36000cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 shutdown_connections 2024-09-17T05:23:20.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.713+0000 7f36062dd640 1 -- 172.21.15.81:0/2532513454 wait complete. 2024-09-17T05:23:20.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 -- 172.21.15.81:0/2726998654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac4070690 msgr2=0x7f3ac413f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 --2- 172.21.15.81:0/2726998654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac4070690 0x7f3ac413f290 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f3ac4074a30 tx=0x7f3ac002b910 comp rx=0 tx=0).stop 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 -- 172.21.15.81:0/2726998654 shutdown_connections 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 --2- 172.21.15.81:0/2726998654 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ac415d940 0x7f3ac415dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 --2- 172.21.15.81:0/2726998654 >> v2:172.21.15.160:3300/0 conn(0x7f3ac413ce00 0x7f3ac413f7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 --2- 172.21.15.81:0/2726998654 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac4070690 0x7f3ac413f290 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 -- 172.21.15.81:0/2726998654 >> 172.21.15.81:0/2726998654 conn(0x7f3ac40b1690 msgr2=0x7f3ac40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:20.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 -- 172.21.15.81:0/2726998654 shutdown_connections 2024-09-17T05:23:20.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.837+0000 7f3acbff3640 1 -- 172.21.15.81:0/2726998654 wait complete. 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.838+0000 7f3acbff3640 1 Processor -- start 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.838+0000 7f3acbff3640 1 -- start start 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ac4070690 0x7f3ac40cd0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac413ce00 0x7f3ac40b39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ac415d940 0x7f3ac40b3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac415e430 con 0x7f3ac413ce00 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ac415e2b0 con 0x7f3ac415d940 2024-09-17T05:23:20.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3ac415e5b0 con 0x7f3ac4070690 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac413ce00 0x7f3ac40b39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac413ce00 0x7f3ac40b39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35454/0 (socket says 172.21.15.81:35454) 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 -- 172.21.15.81:0/578603804 learned_addr learned my addr 172.21.15.81:0/578603804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac9d8f640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ac4070690 0x7f3ac40cd0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3aca590640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ac415d940 0x7f3ac40b3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 -- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ac4070690 msgr2=0x7f3ac40cd0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ac4070690 0x7f3ac40cd0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 -- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ac415d940 msgr2=0x7f3ac40b3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ac415d940 0x7f3ac40b3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 -- 172.21.15.81:0/578603804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ac40a98b0 con 0x7f3ac413ce00 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac9d8f640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ac4070690 0x7f3ac40cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:20.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3ac958e640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac413ce00 0x7f3ac40b39e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400d950 tx=0x7f3ab400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3aba7fc640 1 -- 172.21.15.81:0/578603804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab4017070 con 0x7f3ac413ce00 2024-09-17T05:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3aba7fc640 1 -- 172.21.15.81:0/578603804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3ab4009d20 con 0x7f3ac413ce00 2024-09-17T05:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ac40cc5c0 con 0x7f3ac413ce00 2024-09-17T05:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3aba7fc640 1 -- 172.21.15.81:0/578603804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ab40106c0 con 0x7f3ac413ce00 2024-09-17T05:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.839+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ac40af070 con 0x7f3ac413ce00 2024-09-17T05:23:20.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.840+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ac4074070 con 0x7f3ac413ce00 2024-09-17T05:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.841+0000 7f3aba7fc640 1 -- 172.21.15.81:0/578603804 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f3ab4010860 con 0x7f3ac413ce00 2024-09-17T05:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.841+0000 7f3aba7fc640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aa8078cb0 0x7f3aa807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.842+0000 7f3ac9d8f640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aa8078cb0 0x7f3aa807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.842+0000 7f3aba7fc640 1 -- 172.21.15.81:0/578603804 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f3ab409b000 con 0x7f3ac413ce00 2024-09-17T05:23:20.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.842+0000 7f3ac9d8f640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aa8078cb0 0x7f3aa807b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0036000 tx=0x7f3ac0004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:20.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:20.846+0000 7f3aba7fc640 1 -- 172.21.15.81:0/578603804 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3ac4074070 con 0x7f3ac413ce00 2024-09-17T05:23:21.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.022+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f3ac40b20a0 con 0x7f3ac413ce00 2024-09-17T05:23:21.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.026+0000 7f3aba7fc640 1 -- 172.21.15.81:0/578603804 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v37) ==== 71+0+0 (secure 0 0 0) 0x7f3ac40b20a0 con 0x7f3ac413ce00 2024-09-17T05:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aa8078cb0 msgr2=0x7f3aa807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aa8078cb0 0x7f3aa807b170 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3ac0036000 tx=0x7f3ac0004ab0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac413ce00 msgr2=0x7f3ac40b39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac413ce00 0x7f3ac40b39e0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f3ab400d950 tx=0x7f3ab400de10 comp rx=0 tx=0).stop 2024-09-17T05:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 shutdown_connections 2024-09-17T05:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aa8078cb0 0x7f3aa807b170 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ac415d940 0x7f3ac40b3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ac413ce00 0x7f3ac40b39e0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 --2- 172.21.15.81:0/578603804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ac4070690 0x7f3ac40cd0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 >> 172.21.15.81:0/578603804 conn(0x7f3ac40b1690 msgr2=0x7f3ac413e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 shutdown_connections 2024-09-17T05:23:21.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.028+0000 7f3acbff3640 1 -- 172.21.15.81:0/578603804 wait complete. 2024-09-17T05:23:21.039 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars' 2024-09-17T05:23:21.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 -- 172.21.15.81:0/3726606858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00940d49c0 msgr2=0x7f00940d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 --2- 172.21.15.81:0/3726606858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00940d49c0 0x7f00940d0630 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f0084009830 tx=0x7f008402a510 comp rx=0 tx=0).stop 2024-09-17T05:23:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 -- 172.21.15.81:0/3726606858 shutdown_connections 2024-09-17T05:23:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 --2- 172.21.15.81:0/3726606858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00940d49c0 0x7f00940d0630 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 --2- 172.21.15.81:0/3726606858 >> v2:172.21.15.81:3300/0 conn(0x7f009415df90 0x7f00940cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 -- 172.21.15.81:0/3726606858 >> 172.21.15.81:0/3726606858 conn(0x7f00940d3ea0 msgr2=0x7f00940d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 -- 172.21.15.81:0/3726606858 shutdown_connections 2024-09-17T05:23:21.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.142+0000 7f009c639640 1 -- 172.21.15.81:0/3726606858 wait complete. 2024-09-17T05:23:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.143+0000 7f009c639640 1 Processor -- start 2024-09-17T05:23:21.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009c639640 1 -- start start 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009c639640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00940d49c0 0x7f00941e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009c639640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009415df90 0x7f009414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009c639640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0094162480 0x7f00940ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009c639640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00940d0f00 con 0x7f009415df90 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009c639640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f00940d0d80 con 0x7f00940d49c0 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009c639640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f00940b3f10 con 0x7f0094162480 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f0099bd4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009415df90 0x7f009414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f0099bd4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009415df90 0x7f009414d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35476/0 (socket says 172.21.15.81:35476) 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f0099bd4640 1 -- 172.21.15.81:0/1311874469 learned_addr learned my addr 172.21.15.81:0/1311874469 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009a3d5640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00940d49c0 0x7f00941e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.144+0000 7f009abd6640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0094162480 0x7f00940ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f0099bd4640 1 -- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0094162480 msgr2=0x7f00940ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f0099bd4640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0094162480 0x7f00940ca330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f0099bd4640 1 -- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00940d49c0 msgr2=0x7f00941e7870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f0099bd4640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00940d49c0 0x7f00941e7870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f0099bd4640 1 -- 172.21.15.81:0/1311874469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f009414df00 con 0x7f009415df90 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f0099bd4640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009415df90 0x7f009414d230 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f0084000c00 tx=0x7f0084032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f008affd640 1 -- 172.21.15.81:0/1311874469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084040070 con 0x7f009415df90 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f008affd640 1 -- 172.21.15.81:0/1311874469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f00840038e0 con 0x7f009415df90 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00940cded0 con 0x7f009415df90 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f008affd640 1 -- 172.21.15.81:0/1311874469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0084005c90 con 0x7f009415df90 2024-09-17T05:23:21.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.145+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f009414b210 con 0x7f009415df90 2024-09-17T05:23:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.146+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00940b4430 con 0x7f009415df90 2024-09-17T05:23:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.147+0000 7f008affd640 1 -- 172.21.15.81:0/1311874469 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f0084039040 con 0x7f009415df90 2024-09-17T05:23:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.147+0000 7f008affd640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0078078cb0 0x7f007807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.148+0000 7f009a3d5640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0078078cb0 0x7f007807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.148+0000 7f008affd640 1 -- 172.21.15.81:0/1311874469 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f00840bbef0 con 0x7f009415df90 2024-09-17T05:23:21.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.148+0000 7f009a3d5640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0078078cb0 0x7f007807b170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0090009bd0 tx=0x7f0090005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:21.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.152+0000 7f008affd640 1 -- 172.21.15.81:0/1311874469 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0084083e80 con 0x7f009415df90 2024-09-17T05:23:21.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.401+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]} v 0) -- 0x7f009408d590 con 0x7f009415df90 2024-09-17T05:23:21.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.708+0000 7f008affd640 1 -- 172.21.15.81:0/1311874469 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_names_can_only_be_goodchars"]}]=0 v253) ==== 146+0+0 (secure 0 0 0) 0x7f00840888b0 con 0x7f009415df90 2024-09-17T05:23:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0078078cb0 msgr2=0x7f007807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0078078cb0 0x7f007807b170 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0090009bd0 tx=0x7f0090005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009415df90 msgr2=0x7f009414d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009415df90 0x7f009414d230 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f0084000c00 tx=0x7f0084032c10 comp rx=0 tx=0).stop 2024-09-17T05:23:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 shutdown_connections 2024-09-17T05:23:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0094162480 0x7f00940ca330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f009415df90 0x7f009414d230 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0078078cb0 0x7f007807b170 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 --2- 172.21.15.81:0/1311874469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f00940d49c0 0x7f00941e7870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 >> 172.21.15.81:0/1311874469 conn(0x7f00940d3ea0 msgr2=0x7f00940b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 shutdown_connections 2024-09-17T05:23:21.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.711+0000 7f009c639640 1 -- 172.21.15.81:0/1311874469 wait complete. 2024-09-17T05:23:21.723 INFO:tasks.cephfs_test_runner:Test the creating vols, subvols subvolgroups fails when their names uses ... ok 2024-09-17T05:23:21.723 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-17T05:23:21.723 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_sanity (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:23:21.724 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:21.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 -- 172.21.15.81:0/2871148178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c151370 msgr2=0x7f464c0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2871148178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c151370 0x7f464c0cef30 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f4640009830 tx=0x7f464002a510 comp rx=0 tx=0).stop 2024-09-17T05:23:21.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 -- 172.21.15.81:0/2871148178 shutdown_connections 2024-09-17T05:23:21.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2871148178 >> v2:172.21.15.160:3300/0 conn(0x7f464c0b3140 0x7f464c0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2871148178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c151370 0x7f464c0cef30 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 -- 172.21.15.81:0/2871148178 >> 172.21.15.81:0/2871148178 conn(0x7f464c0b1690 msgr2=0x7f464c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:21.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 -- 172.21.15.81:0/2871148178 shutdown_connections 2024-09-17T05:23:21.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.824+0000 7f4653ab8640 1 -- 172.21.15.81:0/2871148178 wait complete. 2024-09-17T05:23:21.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.825+0000 7f4653ab8640 1 Processor -- start 2024-09-17T05:23:21.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.825+0000 7f4653ab8640 1 -- start start 2024-09-17T05:23:21.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4653ab8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c0725a0 0x7f464c1f4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4653ab8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c0b3140 0x7f464c1467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4653ab8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f464c151370 0x7f464c144e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4653ab8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f464c06ec10 con 0x7f464c0725a0 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4653ab8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f464c06ea90 con 0x7f464c151370 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4653ab8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f464c06f9f0 con 0x7f464c0b3140 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c0725a0 0x7f464c1f4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c0725a0 0x7f464c1f4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35488/0 (socket says 172.21.15.81:35488) 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 -- 172.21.15.81:0/2329915237 learned_addr learned my addr 172.21.15.81:0/2329915237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4652055640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f464c151370 0x7f464c144e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651053640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c0b3140 0x7f464c1467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 -- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c0b3140 msgr2=0x7f464c1467f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c0b3140 0x7f464c1467f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 -- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f464c151370 msgr2=0x7f464c144e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f464c151370 0x7f464c144e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 -- 172.21.15.81:0/2329915237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f464c1f0950 con 0x7f464c0725a0 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.826+0000 7f4651854640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c0725a0 0x7f464c1f4450 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f464002ab00 tx=0x7f4640033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.827+0000 7f463e7fc640 1 -- 172.21.15.81:0/2329915237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640031d60 con 0x7f464c0725a0 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.827+0000 7f463e7fc640 1 -- 172.21.15.81:0/2329915237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4640033e10 con 0x7f464c0725a0 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.827+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f464c1f0c30 con 0x7f464c0725a0 2024-09-17T05:23:21.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.827+0000 7f463e7fc640 1 -- 172.21.15.81:0/2329915237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4640005260 con 0x7f464c0725a0 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.827+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f464c1f11f0 con 0x7f464c0725a0 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.827+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f464c072a30 con 0x7f464c0725a0 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.828+0000 7f463e7fc640 1 -- 172.21.15.81:0/2329915237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f4640005400 con 0x7f464c0725a0 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.829+0000 7f463e7fc640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4630078ce0 0x7f463007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.829+0000 7f463e7fc640 1 -- 172.21.15.81:0/2329915237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f46400bbc90 con 0x7f464c0725a0 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.829+0000 7f4651053640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4630078ce0 0x7f463007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.829+0000 7f4651053640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4630078ce0 0x7f463007b1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46480095f0 tx=0x7f4648005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:21.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:21.833+0000 7f463e7fc640 1 -- 172.21.15.81:0/2329915237 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f464003f030 con 0x7f464c0725a0 2024-09-17T05:23:22.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.009+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f464c152b80 con 0x7f464c0725a0 2024-09-17T05:23:22.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.009+0000 7f463e7fc640 1 -- 172.21.15.81:0/2329915237 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v93) ==== 74+0+13165 (secure 0 0 0) 0x7f46400841f0 con 0x7f464c0725a0 2024-09-17T05:23:22.010 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:22.011 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":93,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:23:20.703427+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":85,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6834/3405352353":"2024-09-18T05:23:17.693839+0000","172.21.15.81:6832/3405352353":"2024-09-18T05:23:17.693839+0000","172.21.15.160:6801/3249546675":"2024-09-18T05:23:11.104835+0000","172.21.15.160:6800/3249546675":"2024-09-18T05:23:11.104835+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:22.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4630078ce0 msgr2=0x7f463007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4630078ce0 0x7f463007b1a0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f46480095f0 tx=0x7f4648005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:22.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c0725a0 msgr2=0x7f464c1f4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c0725a0 0x7f464c1f4450 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f464002ab00 tx=0x7f4640033c20 comp rx=0 tx=0).stop 2024-09-17T05:23:22.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 shutdown_connections 2024-09-17T05:23:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4630078ce0 0x7f463007b1a0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f464c151370 0x7f464c144e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f464c0b3140 0x7f464c1467f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 --2- 172.21.15.81:0/2329915237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f464c0725a0 0x7f464c1f4450 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 >> 172.21.15.81:0/2329915237 conn(0x7f464c0b1690 msgr2=0x7f464c151dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 shutdown_connections 2024-09-17T05:23:22.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.012+0000 7f4653ab8640 1 -- 172.21.15.81:0/2329915237 wait complete. 2024-09-17T05:23:22.024 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:23:22.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 -- 172.21.15.81:0/935232769 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 msgr2=0x7f61500cdb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 --2- 172.21.15.81:0/935232769 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 0x7f61500cdb90 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f6138009830 tx=0x7f613802a510 comp rx=0 tx=0).stop 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 -- 172.21.15.81:0/935232769 shutdown_connections 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 --2- 172.21.15.81:0/935232769 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 0x7f61500cdb90 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 --2- 172.21.15.81:0/935232769 >> v2:172.21.15.160:3300/0 conn(0x7f615015bab0 0x7f61500b2a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 -- 172.21.15.81:0/935232769 >> 172.21.15.81:0/935232769 conn(0x7f61500b1700 msgr2=0x7f61500b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 -- 172.21.15.81:0/935232769 shutdown_connections 2024-09-17T05:23:22.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.128+0000 7f6154e16640 1 -- 172.21.15.81:0/935232769 wait complete. 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.129+0000 7f6154e16640 1 Processor -- start 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.129+0000 7f6154e16640 1 -- start start 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 0x7f61500c50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61500ce0d0 0x7f6150152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615015bab0 0x7f61501f4710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f615006fde0 con 0x7f615015bab0 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f615006fc60 con 0x7f61500ce0d0 2024-09-17T05:23:22.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f615006ff60 con 0x7f61500b2f40 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615015bab0 0x7f61501f4710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615015bab0 0x7f61501f4710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35496/0 (socket says 172.21.15.81:35496) 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 -- 172.21.15.81:0/411339467 learned_addr learned my addr 172.21.15.81:0/411339467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614e59c640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 0x7f61500c50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6147fff640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61500ce0d0 0x7f6150152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 -- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 msgr2=0x7f61500c50f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 0x7f61500c50f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 -- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61500ce0d0 msgr2=0x7f6150152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61500ce0d0 0x7f6150152f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 -- 172.21.15.81:0/411339467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61501541c0 con 0x7f615015bab0 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f614ed9d640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615015bab0 0x7f61501f4710 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f614800cbf0 tx=0x7f614800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6146ffd640 1 -- 172.21.15.81:0/411339467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148016020 con 0x7f615015bab0 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6146ffd640 1 -- 172.21.15.81:0/411339467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f614800acf0 con 0x7f615015bab0 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61501f5060 con 0x7f615015bab0 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6146ffd640 1 -- 172.21.15.81:0/411339467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6148012680 con 0x7f615015bab0 2024-09-17T05:23:22.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.130+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61500c48f0 con 0x7f615015bab0 2024-09-17T05:23:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.131+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6150070480 con 0x7f615015bab0 2024-09-17T05:23:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.132+0000 7f6146ffd640 1 -- 172.21.15.81:0/411339467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f6148019020 con 0x7f615015bab0 2024-09-17T05:23:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.133+0000 7f6146ffd640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6130078cb0 0x7f613007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.133+0000 7f6146ffd640 1 -- 172.21.15.81:0/411339467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f614809b040 con 0x7f615015bab0 2024-09-17T05:23:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.133+0000 7f614e59c640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6130078cb0 0x7f613007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.133+0000 7f614e59c640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6130078cb0 0x7f613007b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61400099e0 tx=0x7f6140005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:22.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.137+0000 7f6146ffd640 1 -- 172.21.15.81:0/411339467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6148020030 con 0x7f615015bab0 2024-09-17T05:23:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.310+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f6150156da0 con 0x7f615015bab0 2024-09-17T05:23:22.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.310+0000 7f6146ffd640 1 -- 172.21.15.81:0/411339467 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v93) ==== 93+0+10 (secure 0 0 0) 0x7f61501541c0 con 0x7f615015bab0 2024-09-17T05:23:22.311 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6130078cb0 msgr2=0x7f613007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6130078cb0 0x7f613007b170 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f61400099e0 tx=0x7f6140005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615015bab0 msgr2=0x7f61501f4710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615015bab0 0x7f61501f4710 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7f614800cbf0 tx=0x7f614800a430 comp rx=0 tx=0).stop 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 shutdown_connections 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f615015bab0 0x7f61501f4710 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6130078cb0 0x7f613007b170 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61500ce0d0 0x7f6150152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 --2- 172.21.15.81:0/411339467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61500b2f40 0x7f61500c50f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 >> 172.21.15.81:0/411339467 conn(0x7f61500b1700 msgr2=0x7f61500b4180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:22.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 shutdown_connections 2024-09-17T05:23:22.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.312+0000 7f6154e16640 1 -- 172.21.15.81:0/411339467 wait complete. 2024-09-17T05:23:22.324 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-17T05:23:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.424+0000 7ff88541f640 1 -- 172.21.15.81:0/2764936307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff868003a30 msgr2=0x7ff868003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.424+0000 7ff88541f640 1 --2- 172.21.15.81:0/2764936307 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff868003a30 0x7ff868003e70 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7ff870009b50 tx=0x7ff868005830 comp rx=0 tx=0).stop 2024-09-17T05:23:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.424+0000 7ff87f7fe640 1 -- 172.21.15.81:0/2764936307 reap_dead start 2024-09-17T05:23:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.424+0000 7ff88541f640 1 -- 172.21.15.81:0/2764936307 shutdown_connections 2024-09-17T05:23:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.424+0000 7ff88541f640 1 -- 172.21.15.81:0/2764936307 >> 172.21.15.81:0/2764936307 conn(0x7ff8800d3ea0 msgr2=0x7ff8800d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.424+0000 7ff88541f640 1 -- 172.21.15.81:0/2764936307 shutdown_connections 2024-09-17T05:23:22.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.425+0000 7ff88541f640 1 -- 172.21.15.81:0/2764936307 wait complete. 2024-09-17T05:23:22.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.426+0000 7ff88541f640 1 Processor -- start 2024-09-17T05:23:22.427 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.426+0000 7ff88541f640 1 -- start start 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff868003a30 0x7ff88014b060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8800ca350 0x7ff8800b92d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8800b9810 0x7ff8801e7870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8800cf9b0 con 0x7ff8800b9810 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff8801627d0 con 0x7ff8800ca350 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff8800cfb30 con 0x7ff868003a30 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8800b9810 0x7ff8801e7870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8800b9810 0x7ff8801e7870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35520/0 (socket says 172.21.15.81:35520) 2024-09-17T05:23:22.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 -- 172.21.15.81:0/1263299487 learned_addr learned my addr 172.21.15.81:0/1263299487 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87e7fc640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8800ca350 0x7ff8800b92d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87effd640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff868003a30 0x7ff88014b060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 -- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff868003a30 msgr2=0x7ff88014b060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff868003a30 0x7ff88014b060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 -- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8800ca350 msgr2=0x7ff8800b92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8800ca350 0x7ff8800b92d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 -- 172.21.15.81:0/1263299487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88014d440 con 0x7ff8800b9810 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87effd640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff868003a30 0x7ff88014b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff87f7fe640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8800b9810 0x7ff8801e7870 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff8780013d0 tx=0x7ff878004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff8677fe640 1 -- 172.21.15.81:0/1263299487 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878015070 con 0x7ff8800b9810 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff8677fe640 1 -- 172.21.15.81:0/1263299487 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff878011960 con 0x7ff8800b9810 2024-09-17T05:23:22.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff8677fe640 1 -- 172.21.15.81:0/1263299487 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff878011db0 con 0x7ff8800b9810 2024-09-17T05:23:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88014d720 con 0x7ff8800b9810 2024-09-17T05:23:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.427+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff88014dce0 con 0x7ff8800b9810 2024-09-17T05:23:22.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.428+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8800d0630 con 0x7ff8800b9810 2024-09-17T05:23:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.429+0000 7ff8677fe640 1 -- 172.21.15.81:0/1263299487 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7ff87800e4a0 con 0x7ff8800b9810 2024-09-17T05:23:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.430+0000 7ff8677fe640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff86c078cb0 0x7ff86c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.430+0000 7ff87effd640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff86c078cb0 0x7ff86c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.430+0000 7ff8677fe640 1 -- 172.21.15.81:0/1263299487 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7ff87809af70 con 0x7ff8800b9810 2024-09-17T05:23:22.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.430+0000 7ff87effd640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff86c078cb0 0x7ff86c07b170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff870035000 tx=0x7ff87002d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.434+0000 7ff8677fe640 1 -- 172.21.15.81:0/1263299487 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff8800ce970 con 0x7ff8800b9810 2024-09-17T05:23:22.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.677+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7ff88008d590 con 0x7ff8800b9810 2024-09-17T05:23:22.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.714+0000 7ff8677fe640 1 -- 172.21.15.81:0/1263299487 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v254) ==== 152+0+0 (secure 0 0 0) 0x7ff878062f00 con 0x7ff8800b9810 2024-09-17T05:23:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff86c078cb0 msgr2=0x7ff86c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff86c078cb0 0x7ff86c07b170 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7ff870035000 tx=0x7ff87002d040 comp rx=0 tx=0).stop 2024-09-17T05:23:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8800b9810 msgr2=0x7ff8801e7870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8800b9810 0x7ff8801e7870 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7ff8780013d0 tx=0x7ff878004f90 comp rx=0 tx=0).stop 2024-09-17T05:23:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 shutdown_connections 2024-09-17T05:23:22.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8800b9810 0x7ff8801e7870 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff86c078cb0 0x7ff86c07b170 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8800ca350 0x7ff8800b92d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 --2- 172.21.15.81:0/1263299487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff868003a30 0x7ff88014b060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 >> 172.21.15.81:0/1263299487 conn(0x7ff8800d3ea0 msgr2=0x7ff8800b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 shutdown_connections 2024-09-17T05:23:22.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.717+0000 7ff88541f640 1 -- 172.21.15.81:0/1263299487 wait complete. 2024-09-17T05:23:22.729 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:23:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.829+0000 7f16be7a1640 1 -- 172.21.15.81:0/2934476674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 msgr2=0x7f16a0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.829+0000 7f16be7a1640 1 --2- 172.21.15.81:0/2934476674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16a0004c80 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7f16ac00c310 tx=0x7f16a0005830 comp rx=0 tx=0).stop 2024-09-17T05:23:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.829+0000 7f16be7a1640 1 -- 172.21.15.81:0/2934476674 shutdown_connections 2024-09-17T05:23:22.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.829+0000 7f16be7a1640 1 --2- 172.21.15.81:0/2934476674 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16a0004c80 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.829+0000 7f16be7a1640 1 -- 172.21.15.81:0/2934476674 >> 172.21.15.81:0/2934476674 conn(0x7f16b80d1b30 msgr2=0x7f16b80d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:22.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.829+0000 7f16be7a1640 1 -- 172.21.15.81:0/2934476674 shutdown_connections 2024-09-17T05:23:22.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.829+0000 7f16be7a1640 1 -- 172.21.15.81:0/2934476674 wait complete. 2024-09-17T05:23:22.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.830+0000 7f16be7a1640 1 Processor -- start 2024-09-17T05:23:22.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.830+0000 7f16be7a1640 1 -- start start 2024-09-17T05:23:22.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16be7a1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16b81f6120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16be7a1640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b80b0da0 0x7f16b815bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16be7a1640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16b809f330 0x7f16b8070590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16be7a1640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16b80d29e0 con 0x7f16a0004800 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16be7a1640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f16b80d2860 con 0x7f16b80b0da0 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16be7a1640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f16b80d0ad0 con 0x7f16b809f330 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16b81f6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16b81f6120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35542/0 (socket says 172.21.15.81:35542) 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 -- 172.21.15.81:0/3425865213 learned_addr learned my addr 172.21.15.81:0/3425865213 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 -- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16b809f330 msgr2=0x7f16b8070590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bdfa0640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16b809f330 0x7f16b8070590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16b809f330 0x7f16b8070590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bcf9e640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b80b0da0 0x7f16b815bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 -- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b80b0da0 msgr2=0x7f16b815bfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b80b0da0 0x7f16b815bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 -- 172.21.15.81:0/3425865213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16b80ce9f0 con 0x7f16a0004800 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.831+0000 7f16bd79f640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16b81f6120 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f16b0004d60 tx=0x7f16b0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.832+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3425865213 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b00107d0 con 0x7f16a0004800 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.832+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3425865213 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16b0016070 con 0x7f16a0004800 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.832+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3425865213 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16b0010d00 con 0x7f16a0004800 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.832+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16b815c520 con 0x7f16a0004800 2024-09-17T05:23:22.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.832+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16b81f5920 con 0x7f16a0004800 2024-09-17T05:23:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.833+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16b80cfec0 con 0x7f16a0004800 2024-09-17T05:23:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.833+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3425865213 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f16b001b460 con 0x7f16a0004800 2024-09-17T05:23:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.834+0000 7f16b5ffb640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f16a4078ce0 0x7f16a407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.834+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3425865213 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f16b009b450 con 0x7f16a0004800 2024-09-17T05:23:22.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.834+0000 7f16bcf9e640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f16a4078ce0 0x7f16a407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:22.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.834+0000 7f16bcf9e640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f16a4078ce0 0x7f16a407b1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16ac033000 tx=0x7f16b806a0f0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:22.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:22.838+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3425865213 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f16b00639a0 con 0x7f16a0004800 2024-09-17T05:23:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.018+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f16b8072230 con 0x7f16a0004800 2024-09-17T05:23:23.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.018+0000 7f16b5ffb640 1 -- 172.21.15.81:0/3425865213 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v37) ==== 59+0+1998 (secure 0 0 0) 0x7f16b00632a0 con 0x7f16a0004800 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:23:23.020 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:23:23.021 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:23:23.022 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:23:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f16a4078ce0 msgr2=0x7f16a407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f16a4078ce0 0x7f16a407b1a0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f16ac033000 tx=0x7f16b806a0f0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 msgr2=0x7f16b81f6120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16b81f6120 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f16b0004d60 tx=0x7f16b0001630 comp rx=0 tx=0).stop 2024-09-17T05:23:23.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 shutdown_connections 2024-09-17T05:23:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f16b809f330 0x7f16b8070590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f16a4078ce0 0x7f16a407b1a0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f16b80b0da0 0x7f16b815bfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 --2- 172.21.15.81:0/3425865213 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16a0004800 0x7f16b81f6120 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 >> 172.21.15.81:0/3425865213 conn(0x7f16b80d1b30 msgr2=0x7f16b80b56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 shutdown_connections 2024-09-17T05:23:23.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.021+0000 7f16be7a1640 1 -- 172.21.15.81:0/3425865213 wait complete. 2024-09-17T05:23:23.033 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:23:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 -- 172.21.15.81:0/536777713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140b03a0 msgr2=0x7f18140cd440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 --2- 172.21.15.81:0/536777713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140b03a0 0x7f18140cd440 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f180c005fd0 tx=0x7f180c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 -- 172.21.15.81:0/536777713 shutdown_connections 2024-09-17T05:23:23.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 --2- 172.21.15.81:0/536777713 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140b03a0 0x7f18140cd440 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 --2- 172.21.15.81:0/536777713 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f181415e100 0x7f18140d0940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 -- 172.21.15.81:0/536777713 >> 172.21.15.81:0/536777713 conn(0x7f1814074160 msgr2=0x7f1814074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 -- 172.21.15.81:0/536777713 shutdown_connections 2024-09-17T05:23:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.136+0000 7f18191ca640 1 -- 172.21.15.81:0/536777713 wait complete. 2024-09-17T05:23:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.137+0000 7f18191ca640 1 Processor -- start 2024-09-17T05:23:23.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.137+0000 7f18191ca640 1 -- start start 2024-09-17T05:23:23.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f18191ca640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18140d0e80 0x7f181415f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f18191ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181415e100 0x7f18141f7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f18191ca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140c8c40 0x7f18141f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f18191ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18140ca980 con 0x7f181415e100 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f18191ca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f18140cdb90 con 0x7f18140c8c40 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f18191ca640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f18140cab00 con 0x7f18140d0e80 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f180a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181415e100 0x7f18141f7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f180a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181415e100 0x7f18141f7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35554/0 (socket says 172.21.15.81:35554) 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f180a59c640 1 -- 172.21.15.81:0/2625137394 learned_addr learned my addr 172.21.15.81:0/2625137394 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f181359e640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140c8c40 0x7f18141f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.138+0000 7f1812d9d640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18140d0e80 0x7f181415f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180a59c640 1 -- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18140d0e80 msgr2=0x7f181415f890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180a59c640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18140d0e80 0x7f181415f890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180a59c640 1 -- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140c8c40 msgr2=0x7f18141f4e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180a59c640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140c8c40 0x7f18141f4e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180a59c640 1 -- 172.21.15.81:0/2625137394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18141f8190 con 0x7f181415e100 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180a59c640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181415e100 0x7f18141f7c50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c460 tx=0x7f17fc00c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180bfff640 1 -- 172.21.15.81:0/2625137394 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc016020 con 0x7f181415e100 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180bfff640 1 -- 172.21.15.81:0/2625137394 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17fc012920 con 0x7f181415e100 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18141f4660 con 0x7f181415e100 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f180bfff640 1 -- 172.21.15.81:0/2625137394 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17fc012d50 con 0x7f181415e100 2024-09-17T05:23:23.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.139+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18141f8a00 con 0x7f181415e100 2024-09-17T05:23:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.140+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18140d0940 con 0x7f181415e100 2024-09-17T05:23:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.141+0000 7f180bfff640 1 -- 172.21.15.81:0/2625137394 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f17fc019020 con 0x7f181415e100 2024-09-17T05:23:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.141+0000 7f180bfff640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17f4078cb0 0x7f17f407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.141+0000 7f180bfff640 1 -- 172.21.15.81:0/2625137394 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f17fc09a5b0 con 0x7f181415e100 2024-09-17T05:23:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.141+0000 7f1812d9d640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17f4078cb0 0x7f17f407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.142+0000 7f1812d9d640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17f4078cb0 0x7f17f407b170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18040095f0 tx=0x7f1804005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:23.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.145+0000 7f180bfff640 1 -- 172.21.15.81:0/2625137394 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f17fc020070 con 0x7f181415e100 2024-09-17T05:23:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.319+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f18140b0c10 con 0x7f181415e100 2024-09-17T05:23:23.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.323+0000 7f180bfff640 1 -- 172.21.15.81:0/2625137394 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f17fc062570 con 0x7f181415e100 2024-09-17T05:23:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17f4078cb0 msgr2=0x7f17f407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17f4078cb0 0x7f17f407b170 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f18040095f0 tx=0x7f1804005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181415e100 msgr2=0x7f18141f7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181415e100 0x7f18141f7c50 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f17fc00c460 tx=0x7f17fc00c920 comp rx=0 tx=0).stop 2024-09-17T05:23:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 shutdown_connections 2024-09-17T05:23:23.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17f4078cb0 0x7f17f407b170 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18140c8c40 0x7f18141f4e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f181415e100 0x7f18141f7c50 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 --2- 172.21.15.81:0/2625137394 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18140d0e80 0x7f181415f890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 >> 172.21.15.81:0/2625137394 conn(0x7f1814074160 msgr2=0x7f1814075820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 shutdown_connections 2024-09-17T05:23:23.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.325+0000 7f18191ca640 1 -- 172.21.15.81:0/2625137394 wait complete. 2024-09-17T05:23:23.337 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:23:23.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:23:23.375 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:23:23.422 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:23:23.422 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:23.422 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:23.438 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:23:23.439 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:23:23.439 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:23.457 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:23:23.457 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:23.457 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:23.495 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:23:23.495 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:23:23.495 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:23.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:23:23.517 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:23:23.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:23.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 -- 172.21.15.81:0/3569990448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76900d49c0 msgr2=0x7f76900d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 --2- 172.21.15.81:0/3569990448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76900d49c0 0x7f76900d0630 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f7678005fd0 tx=0x7f767802a530 comp rx=0 tx=0).stop 2024-09-17T05:23:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 -- 172.21.15.81:0/3569990448 shutdown_connections 2024-09-17T05:23:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 --2- 172.21.15.81:0/3569990448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76900d49c0 0x7f76900d0630 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 --2- 172.21.15.81:0/3569990448 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f769015df90 0x7f76900cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 -- 172.21.15.81:0/3569990448 >> 172.21.15.81:0/3569990448 conn(0x7f76900d3ea0 msgr2=0x7f76900d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 -- 172.21.15.81:0/3569990448 shutdown_connections 2024-09-17T05:23:23.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.634+0000 7f7695abf640 1 -- 172.21.15.81:0/3569990448 wait complete. 2024-09-17T05:23:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.635+0000 7f7695abf640 1 Processor -- start 2024-09-17T05:23:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f7695abf640 1 -- start start 2024-09-17T05:23:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f7695abf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76900d49c0 0x7f76901f1f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f7695abf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f769015df90 0x7f769006dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f7695abf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7690162480 0x7f769006e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f7695abf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76900d0f00 con 0x7f7690162480 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f7695abf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f76900d0d80 con 0x7f76900d49c0 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f7695abf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f76900b3f10 con 0x7f769015df90 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f768ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7690162480 0x7f769006e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f768ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7690162480 0x7f769006e320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45478/0 (socket says 172.21.15.81:45478) 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f768ffff640 1 -- 172.21.15.81:0/3017201127 learned_addr learned my addr 172.21.15.81:0/3017201127 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.636+0000 7f768effd640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f769015df90 0x7f769006dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f768f7fe640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76900d49c0 0x7f76901f1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f768ffff640 1 -- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f769015df90 msgr2=0x7f769006dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f768ffff640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f769015df90 0x7f769006dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f768ffff640 1 -- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76900d49c0 msgr2=0x7f76901f1f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f768ffff640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76900d49c0 0x7f76901f1f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.639 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f768ffff640 1 -- 172.21.15.81:0/3017201127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76901f82e0 con 0x7f7690162480 2024-09-17T05:23:23.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f768ffff640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7690162480 0x7f769006e320 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f768800b970 tx=0x7f768800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:23.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f7687fff640 1 -- 172.21.15.81:0/3017201127 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7688019070 con 0x7f7690162480 2024-09-17T05:23:23.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f7687fff640 1 -- 172.21.15.81:0/3017201127 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f768800cc30 con 0x7f7690162480 2024-09-17T05:23:23.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76901f85c0 con 0x7f7690162480 2024-09-17T05:23:23.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f7687fff640 1 -- 172.21.15.81:0/3017201127 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76880146a0 con 0x7f7690162480 2024-09-17T05:23:23.640 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.637+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76901f8b80 con 0x7f7690162480 2024-09-17T05:23:23.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.638+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76900b4430 con 0x7f7690162480 2024-09-17T05:23:23.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.639+0000 7f7687fff640 1 -- 172.21.15.81:0/3017201127 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f768801c070 con 0x7f7690162480 2024-09-17T05:23:23.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.639+0000 7f7687fff640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7670078cb0 0x7f767007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:23.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.639+0000 7f768f7fe640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7670078cb0 0x7f767007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:23.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.639+0000 7f7687fff640 1 -- 172.21.15.81:0/3017201127 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f768809a9a0 con 0x7f7690162480 2024-09-17T05:23:23.641 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.640+0000 7f768f7fe640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7670078cb0 0x7f767007b170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76800058c0 tx=0x7f768000a250 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:23.644 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.644+0000 7f7687fff640 1 -- 172.21.15.81:0/3017201127 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7688062820 con 0x7f7690162480 2024-09-17T05:23:23.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.859+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f769008d590 con 0x7f7690162480 2024-09-17T05:23:23.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.860+0000 7f7687fff640 1 -- 172.21.15.81:0/3017201127 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 54 v54) ==== 94+0+3917 (secure 0 0 0) 0x7f7688067250 con 0x7f7690162480 2024-09-17T05:23:23.861 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:23.861 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":54,"btime":"2024-09-17T05:23:18:695902+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5771,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3004752015","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3004752015},{"type":"v1","addr":"172.21.15.81:6835","nonce":3004752015}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5780,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/4151219415","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":4151219415},{"type":"v1","addr":"172.21.15.160:6835","nonce":4151219415}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":44},{"gid":5891,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/4277815965","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":4277815965},{"type":"v1","addr":"172.21.15.160:6801","nonce":4277815965}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":52},{"gid":6930,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/1193270056","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":1193270056},{"type":"v1","addr":"172.21.15.81:6834","nonce":1193270056}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":54}],"filesystems":[]} 2024-09-17T05:23:23.862 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 54 2024-09-17T05:23:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7670078cb0 msgr2=0x7f767007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7670078cb0 0x7f767007b170 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f76800058c0 tx=0x7f768000a250 comp rx=0 tx=0).stop 2024-09-17T05:23:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7690162480 msgr2=0x7f769006e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7690162480 0x7f769006e320 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f768800b970 tx=0x7f768800be30 comp rx=0 tx=0).stop 2024-09-17T05:23:23.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 shutdown_connections 2024-09-17T05:23:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7690162480 0x7f769006e320 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f769015df90 0x7f769006dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7670078cb0 0x7f767007b170 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 --2- 172.21.15.81:0/3017201127 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76900d49c0 0x7f76901f1f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 >> 172.21.15.81:0/3017201127 conn(0x7f76900d3ea0 msgr2=0x7f76900d27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 shutdown_connections 2024-09-17T05:23:23.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:23.862+0000 7f7695abf640 1 -- 172.21.15.81:0/3017201127 wait complete. 2024-09-17T05:23:23.874 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:23:23.875 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:23:23.875 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:23:23.875 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:23.875 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:23:23.875 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:23:23.875 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:23:23.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:23.876 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:23:23.876 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:23:23.876 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:23:23.876 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:23.876 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:23:23.876 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:23:23.877 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:23:23.877 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:23:23.884 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:23:23.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:23:23.885 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:23:23.885 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:23:23.888 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:23:23.889 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:23:23.889 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:23:23.889 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:23:23.927 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:23:23.927 DEBUG:teuthology.parallel:result is None 2024-09-17T05:23:23.928 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:23:23.928 DEBUG:teuthology.parallel:result is None 2024-09-17T05:23:23.931 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:23:23.931 DEBUG:teuthology.parallel:result is None 2024-09-17T05:23:23.932 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:23:23.932 DEBUG:teuthology.parallel:result is None 2024-09-17T05:23:23.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:23:24.001 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:23:24.005 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:23:24.014 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:23:24.014 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:23:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.038+0000 7f72588c6640 1 -- 172.21.15.81:0/662067871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72540d49c0 msgr2=0x7f72540cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.038+0000 7f72588c6640 1 --2- 172.21.15.81:0/662067871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72540d49c0 0x7f72540cf9b0 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7f72540b9f50 tx=0x7f724c02a870 comp rx=0 tx=0).stop 2024-09-17T05:23:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.038+0000 7f72588c6640 1 -- 172.21.15.81:0/662067871 shutdown_connections 2024-09-17T05:23:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.038+0000 7f72588c6640 1 --2- 172.21.15.81:0/662067871 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72540d49c0 0x7f72540cf9b0 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.038+0000 7f72588c6640 1 -- 172.21.15.81:0/662067871 >> 172.21.15.81:0/662067871 conn(0x7f72540d3ea0 msgr2=0x7f72540d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.038+0000 7f72588c6640 1 -- 172.21.15.81:0/662067871 shutdown_connections 2024-09-17T05:23:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.038+0000 7f72588c6640 1 -- 172.21.15.81:0/662067871 wait complete. 2024-09-17T05:23:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.039+0000 7f72588c6640 1 Processor -- start 2024-09-17T05:23:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.039+0000 7f72588c6640 1 -- start start 2024-09-17T05:23:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f72588c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72540d0d40 0x7f725415cf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f72588c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72540d49c0 0x7f725415fb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f72588c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725415df90 0x7f72540cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f72588c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7254162690 con 0x7f725415df90 2024-09-17T05:23:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f72588c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f72540b3f10 con 0x7f72540d49c0 2024-09-17T05:23:24.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f72588c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f72540cbc80 con 0x7f72540d0d40 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725415df90 0x7f72540cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725415df90 0x7f72540cda90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45550/0 (socket says 172.21.15.81:45550) 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 -- 172.21.15.81:0/866424154 learned_addr learned my addr 172.21.15.81:0/866424154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f725259c640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72540d0d40 0x7f725415cf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f724bfff640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72540d49c0 0x7f725415fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 -- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72540d0d40 msgr2=0x7f725415cf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72540d0d40 0x7f725415cf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 -- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72540d49c0 msgr2=0x7f725415fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72540d49c0 0x7f725415fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.040+0000 7f7252d9d640 1 -- 172.21.15.81:0/866424154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72540cbed0 con 0x7f725415df90 2024-09-17T05:23:24.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.041+0000 7f7252d9d640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725415df90 0x7f72540cda90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f724c02ae60 tx=0x7f724c032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.041+0000 7f724affd640 1 -- 172.21.15.81:0/866424154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c040070 con 0x7f725415df90 2024-09-17T05:23:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.041+0000 7f724affd640 1 -- 172.21.15.81:0/866424154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f724c004350 con 0x7f725415df90 2024-09-17T05:23:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.041+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72540cc1b0 con 0x7f725415df90 2024-09-17T05:23:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.041+0000 7f724affd640 1 -- 172.21.15.81:0/866424154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f724c0047a0 con 0x7f725415df90 2024-09-17T05:23:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.041+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f725415d4c0 con 0x7f725415df90 2024-09-17T05:23:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.042+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72540b4450 con 0x7f725415df90 2024-09-17T05:23:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.042+0000 7f724affd640 1 -- 172.21.15.81:0/866424154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f724c039040 con 0x7f725415df90 2024-09-17T05:23:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.043+0000 7f724affd640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7234078ce0 0x7f723407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.043+0000 7f725259c640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7234078ce0 0x7f723407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.043+0000 7f724affd640 1 -- 172.21.15.81:0/866424154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 5029+0+0 (secure 0 0 0) 0x7f724c0bc380 con 0x7f725415df90 2024-09-17T05:23:24.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.043+0000 7f725259c640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7234078ce0 0x7f723407b1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7244006fd0 tx=0x7f7244008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:24.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.047+0000 7f724affd640 1 -- 172.21.15.81:0/866424154 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f724c084960 con 0x7f725415df90 2024-09-17T05:23:24.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.234+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f7254162260 con 0x7f725415df90 2024-09-17T05:23:24.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.726+0000 7f724affd640 1 -- 172.21.15.81:0/866424154 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v95) ==== 97+0+0 (secure 0 0 0) 0x7f724c084260 con 0x7f725415df90 2024-09-17T05:23:24.727 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:23:24.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7234078ce0 msgr2=0x7f723407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7234078ce0 0x7f723407b1a0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7244006fd0 tx=0x7f7244008040 comp rx=0 tx=0).stop 2024-09-17T05:23:24.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725415df90 msgr2=0x7f72540cda90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725415df90 0x7f72540cda90 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7f724c02ae60 tx=0x7f724c032c10 comp rx=0 tx=0).stop 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 shutdown_connections 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f725415df90 0x7f72540cda90 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7234078ce0 0x7f723407b1a0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72540d49c0 0x7f725415fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 --2- 172.21.15.81:0/866424154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72540d0d40 0x7f725415cf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 >> 172.21.15.81:0/866424154 conn(0x7f72540d3ea0 msgr2=0x7f72540b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 shutdown_connections 2024-09-17T05:23:24.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.729+0000 7f72588c6640 1 -- 172.21.15.81:0/866424154 wait complete. 2024-09-17T05:23:24.743 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:23:24.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.846+0000 7f4d8cb52640 1 -- 172.21.15.81:0/3532850561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 msgr2=0x7f4d74003e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.846+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/3532850561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d74003e90 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009ed0 tx=0x7f4d74005830 comp rx=0 tx=0).stop 2024-09-17T05:23:24.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.846+0000 7f4d8cb52640 1 -- 172.21.15.81:0/3532850561 shutdown_connections 2024-09-17T05:23:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.846+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/3532850561 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d74003e90 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.846+0000 7f4d8cb52640 1 -- 172.21.15.81:0/3532850561 >> 172.21.15.81:0/3532850561 conn(0x7f4d880d3ea0 msgr2=0x7f4d880d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.846+0000 7f4d8cb52640 1 -- 172.21.15.81:0/3532850561 shutdown_connections 2024-09-17T05:23:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.846+0000 7f4d8cb52640 1 -- 172.21.15.81:0/3532850561 wait complete. 2024-09-17T05:23:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.847+0000 7f4d8cb52640 1 Processor -- start 2024-09-17T05:23:24.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.847+0000 7f4d8cb52640 1 -- start start 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8cb52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d880b7b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8cb52640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d88156cf0 0x7f4d88158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8cb52640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d88158970 0x7f4d881f4fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8cb52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d880cf9b0 con 0x7f4d74003a50 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8cb52640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4d881627a0 con 0x7f4d88158970 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8cb52640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4d880cfb30 con 0x7f4d88156cf0 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d880b7b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d880b7b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45566/0 (socket says 172.21.15.81:45566) 2024-09-17T05:23:24.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 -- 172.21.15.81:0/2313331795 learned_addr learned my addr 172.21.15.81:0/2313331795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d86d9d640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d88158970 0x7f4d881f4fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d85d9b640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d88156cf0 0x7f4d88158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 -- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d88156cf0 msgr2=0x7f4d88158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d88156cf0 0x7f4d88158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 -- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d88158970 msgr2=0x7f4d881f4fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d88158970 0x7f4d881f4fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d8659c640 1 -- 172.21.15.81:0/2313331795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d88157150 con 0x7f4d74003a50 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.848+0000 7f4d85d9b640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d88156cf0 0x7f4d88158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.849+0000 7f4d8659c640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d880b7b30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009e20 tx=0x7f4d78033cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.849+0000 7f4d7effd640 1 -- 172.21.15.81:0/2313331795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d78038040 con 0x7f4d74003a50 2024-09-17T05:23:24.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.849+0000 7f4d7effd640 1 -- 172.21.15.81:0/2313331795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d78041070 con 0x7f4d74003a50 2024-09-17T05:23:24.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.849+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d881f5d20 con 0x7f4d74003a50 2024-09-17T05:23:24.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.849+0000 7f4d7effd640 1 -- 172.21.15.81:0/2313331795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d7803c670 con 0x7f4d74003a50 2024-09-17T05:23:24.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.849+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d8815fe80 con 0x7f4d74003a50 2024-09-17T05:23:24.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.850+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d88158d50 con 0x7f4d74003a50 2024-09-17T05:23:24.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.851+0000 7f4d7effd640 1 -- 172.21.15.81:0/2313331795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f4d7803c810 con 0x7f4d74003a50 2024-09-17T05:23:24.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.851+0000 7f4d7effd640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d68078ce0 0x7f4d6807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:24.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.851+0000 7f4d85d9b640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d68078ce0 0x7f4d6807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:24.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.851+0000 7f4d7effd640 1 -- 172.21.15.81:0/2313331795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7f4d780bb7c0 con 0x7f4d74003a50 2024-09-17T05:23:24.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.851+0000 7f4d85d9b640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d68078ce0 0x7f4d6807b1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d880cab10 tx=0x7f4d70001110 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:24.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:24.855+0000 7f4d7effd640 1 -- 172.21.15.81:0/2313331795 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4d78083800 con 0x7f4d74003a50 2024-09-17T05:23:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.098+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f4d881578e0 con 0x7f4d74003a50 2024-09-17T05:23:25.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.098+0000 7f4d7effd640 1 -- 172.21.15.81:0/2313331795 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) ==== 80+0+5304 (secure 0 0 0) 0x7f4d78088230 con 0x7f4d74003a50 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.100 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:23:25.101 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.102 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.103 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.104 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.105 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.106 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.107 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.108 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:23:25.109 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.110 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:23:25.111 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:23:25.112 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.113 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:23:25.114 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:23:25.115 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:23:25.115 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:23:25.115 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:23:25.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.115 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.115 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:23:25.115 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:25.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d68078ce0 msgr2=0x7f4d6807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d68078ce0 0x7f4d6807b1a0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f4d880cab10 tx=0x7f4d70001110 comp rx=0 tx=0).stop 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 msgr2=0x7f4d880b7b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d880b7b30 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7f4d78009e20 tx=0x7f4d78033cb0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 shutdown_connections 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d68078ce0 0x7f4d6807b1a0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d88158970 0x7f4d881f4fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d88156cf0 0x7f4d88158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 --2- 172.21.15.81:0/2313331795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d74003a50 0x7f4d880b7b30 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 >> 172.21.15.81:0/2313331795 conn(0x7f4d880d3ea0 msgr2=0x7f4d880b27e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 shutdown_connections 2024-09-17T05:23:25.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.101+0000 7f4d8cb52640 1 -- 172.21.15.81:0/2313331795 wait complete. 2024-09-17T05:23:25.118 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:23:25.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 -- 172.21.15.81:0/3643484904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 msgr2=0x7fb8f00b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 --2- 172.21.15.81:0/3643484904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b3800 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7fb8f00d1eb0 tx=0x7fb8e802aa30 comp rx=0 tx=0).stop 2024-09-17T05:23:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 -- 172.21.15.81:0/3643484904 shutdown_connections 2024-09-17T05:23:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 --2- 172.21.15.81:0/3643484904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b3800 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 --2- 172.21.15.81:0/3643484904 >> v2:172.21.15.160:3300/0 conn(0x7fb8f00d0d40 0x7fb8f00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 -- 172.21.15.81:0/3643484904 >> 172.21.15.81:0/3643484904 conn(0x7fb8f00d3ea0 msgr2=0x7fb8f00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 -- 172.21.15.81:0/3643484904 shutdown_connections 2024-09-17T05:23:25.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.218+0000 7fb8f5265640 1 -- 172.21.15.81:0/3643484904 wait complete. 2024-09-17T05:23:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.219+0000 7fb8f5265640 1 Processor -- start 2024-09-17T05:23:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.220+0000 7fb8f5265640 1 -- start start 2024-09-17T05:23:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.220+0000 7fb8f5265640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f00d0d40 0x7fb8f014e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.220+0000 7fb8f5265640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b8a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.220+0000 7fb8f5265640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8f015df90 0x7fb8f00b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.220+0000 7fb8f5265640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f0162690 con 0x7fb8f00d49c0 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.220+0000 7fb8f5265640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb8f00b3d40 con 0x7fb8f00d0d40 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.220+0000 7fb8f5265640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb8f014ddb0 con 0x7fb8f015df90 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b8a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45580/0 (socket says 172.21.15.81:45580) 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 -- 172.21.15.81:0/1620957444 learned_addr learned my addr 172.21.15.81:0/1620957444 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8eeffd640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f00d0d40 0x7fb8f014e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8ef7fe640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8f015df90 0x7fb8f00b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 -- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8f015df90 msgr2=0x7fb8f00b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8f015df90 0x7fb8f00b8f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 -- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f00d0d40 msgr2=0x7fb8f014e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f00d0d40 0x7fb8f014e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 -- 172.21.15.81:0/1620957444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8f014e580 con 0x7fb8f00d49c0 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8ef7fe640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8f015df90 0x7fb8f00b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e67fc640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b8a50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800d7a0 tx=0x7fb8d800dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e7fff640 1 -- 172.21.15.81:0/1620957444 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8017070 con 0x7fb8f00d49c0 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e7fff640 1 -- 172.21.15.81:0/1620957444 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb8d8009d20 con 0x7fb8f00d49c0 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8e7fff640 1 -- 172.21.15.81:0/1620957444 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8d8005280 con 0x7fb8f00d49c0 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8f015eeb0 con 0x7fb8f00d49c0 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.221+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8f00b8250 con 0x7fb8f00d49c0 2024-09-17T05:23:25.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.222+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8f008d590 con 0x7fb8f00d49c0 2024-09-17T05:23:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.223+0000 7fb8e7fff640 1 -- 172.21.15.81:0/1620957444 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fb8d8005420 con 0x7fb8f00d49c0 2024-09-17T05:23:25.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.223+0000 7fb8e7fff640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb8d0078ce0 0x7fb8d007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.224+0000 7fb8eeffd640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb8d0078ce0 0x7fb8d007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.224+0000 7fb8e7fff640 1 -- 172.21.15.81:0/1620957444 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7fb8d809ac00 con 0x7fb8f00d49c0 2024-09-17T05:23:25.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.224+0000 7fb8eeffd640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb8d0078ce0 0x7fb8d007b1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0006fd0 tx=0x7fb8e0009060 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:25.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.228+0000 7fb8e7fff640 1 -- 172.21.15.81:0/1620957444 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb8d80a1080 con 0x7fb8f00d49c0 2024-09-17T05:23:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.404+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb8f00cf990 con 0x7fb8f00d49c0 2024-09-17T05:23:25.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.404+0000 7fb8e7fff640 1 -- 172.21.15.81:0/1620957444 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) ==== 84+0+65 (secure 0 0 0) 0x7fb8d8062c40 con 0x7fb8f00d49c0 2024-09-17T05:23:25.406 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:25.406 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:23:25.406 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:25.406 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:23:25.406 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:23:25.406 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:25.407 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:23:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.406+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb8d0078ce0 msgr2=0x7fb8d007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.406+0000 7fb8f5265640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb8d0078ce0 0x7fb8d007b1a0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0006fd0 tx=0x7fb8e0009060 comp rx=0 tx=0).stop 2024-09-17T05:23:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.406+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 msgr2=0x7fb8f00b8a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.406+0000 7fb8f5265640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b8a50 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800d7a0 tx=0x7fb8d800dc60 comp rx=0 tx=0).stop 2024-09-17T05:23:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 shutdown_connections 2024-09-17T05:23:25.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb8f015df90 0x7fb8f00b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8f00d49c0 0x7fb8f00b8a50 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb8d0078ce0 0x7fb8d007b1a0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 --2- 172.21.15.81:0/1620957444 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8f00d0d40 0x7fb8f014e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 >> 172.21.15.81:0/1620957444 conn(0x7fb8f00d3ea0 msgr2=0x7fb8f00b0a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 shutdown_connections 2024-09-17T05:23:25.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.407+0000 7fb8f5265640 1 -- 172.21.15.81:0/1620957444 wait complete. 2024-09-17T05:23:25.418 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:23:25.419 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:23:25.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.521+0000 7fcac65e2640 1 -- 172.21.15.81:0/492113003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 msgr2=0x7fcac00d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.521+0000 7fcac65e2640 1 --2- 172.21.15.81:0/492113003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00d4940 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fcac00b6df0 tx=0x7fcab802a920 comp rx=0 tx=0).stop 2024-09-17T05:23:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.521+0000 7fcac65e2640 1 -- 172.21.15.81:0/492113003 shutdown_connections 2024-09-17T05:23:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.521+0000 7fcac65e2640 1 --2- 172.21.15.81:0/492113003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00d4940 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.521+0000 7fcac65e2640 1 -- 172.21.15.81:0/492113003 >> 172.21.15.81:0/492113003 conn(0x7fcac00d3e20 msgr2=0x7fcac00d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.521+0000 7fcac65e2640 1 -- 172.21.15.81:0/492113003 shutdown_connections 2024-09-17T05:23:25.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.521+0000 7fcac65e2640 1 -- 172.21.15.81:0/492113003 wait complete. 2024-09-17T05:23:25.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.522+0000 7fcac65e2640 1 Processor -- start 2024-09-17T05:23:25.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcac65e2640 1 -- start start 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcac65e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00c8320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcac65e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0161300 0x7fcac014a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcac65e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac01616e0 0x7fcac006dd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcac65e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcac01691a0 con 0x7fcac00b83f0 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcac65e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcac0169020 con 0x7fcac0161300 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcac65e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcac0169320 con 0x7fcac01616e0 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcabffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00c8320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcabffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00c8320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45586/0 (socket says 172.21.15.81:45586) 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.523+0000 7fcabffff640 1 -- 172.21.15.81:0/3553115686 learned_addr learned my addr 172.21.15.81:0/3553115686 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabf7fe640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0161300 0x7fcac014a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcac4b7f640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac01616e0 0x7fcac006dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabffff640 1 -- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac01616e0 msgr2=0x7fcac006dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabffff640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac01616e0 0x7fcac006dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabffff640 1 -- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0161300 msgr2=0x7fcac014a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabffff640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0161300 0x7fcac014a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabffff640 1 -- 172.21.15.81:0/3553115686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac01f4b90 con 0x7fcac00b83f0 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabffff640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00c8320 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c450 tx=0x7fcab000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabcff9640 1 -- 172.21.15.81:0/3553115686 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0016020 con 0x7fcac00b83f0 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabcff9640 1 -- 172.21.15.81:0/3553115686 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcab0012920 con 0x7fcac00b83f0 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcabcff9640 1 -- 172.21.15.81:0/3553115686 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab0012d70 con 0x7fcac00b83f0 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac00c7e80 con 0x7fcac00b83f0 2024-09-17T05:23:25.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.524+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac01f50f0 con 0x7fcac00b83f0 2024-09-17T05:23:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.525+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac00a1d30 con 0x7fcac00b83f0 2024-09-17T05:23:25.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.526+0000 7fcabcff9640 1 -- 172.21.15.81:0/3553115686 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fcab0019020 con 0x7fcac00b83f0 2024-09-17T05:23:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.526+0000 7fcabcff9640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaac078cb0 0x7fcaac07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.526+0000 7fcabcff9640 1 -- 172.21.15.81:0/3553115686 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(97..97 src has 1..97) ==== 4857+0+0 (secure 0 0 0) 0x7fcab009a940 con 0x7fcac00b83f0 2024-09-17T05:23:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.526+0000 7fcabf7fe640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaac078cb0 0x7fcaac07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.527+0000 7fcabf7fe640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaac078cb0 0x7fcaac07b170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcab4006fd0 tx=0x7fcab4008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:25.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.530+0000 7fcabcff9640 1 -- 172.21.15.81:0/3553115686 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcab0020030 con 0x7fcac00b83f0 2024-09-17T05:23:25.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.704+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcac014d830 con 0x7fcac00b83f0 2024-09-17T05:23:25.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.739+0000 7fcabcff9640 1 -- 172.21.15.81:0/3553115686 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) ==== 138+0+0 (secure 0 0 0) 0x7fcac01f4b90 con 0x7fcac00b83f0 2024-09-17T05:23:25.739 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaac078cb0 msgr2=0x7fcaac07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaac078cb0 0x7fcaac07b170 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fcab4006fd0 tx=0x7fcab4008040 comp rx=0 tx=0).stop 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 msgr2=0x7fcac00c8320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00c8320 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fcab000c450 tx=0x7fcab000c910 comp rx=0 tx=0).stop 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 shutdown_connections 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac01616e0 0x7fcac006dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaac078cb0 0x7fcaac07b170 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0161300 0x7fcac014a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 --2- 172.21.15.81:0/3553115686 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac00b83f0 0x7fcac00c8320 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 >> 172.21.15.81:0/3553115686 conn(0x7fcac00d3e20 msgr2=0x7fcac0151060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 shutdown_connections 2024-09-17T05:23:25.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.741+0000 7fcac65e2640 1 -- 172.21.15.81:0/3553115686 wait complete. 2024-09-17T05:23:25.756 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:23:25.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 -- 172.21.15.81:0/1830219511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 msgr2=0x7fb38c15b820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1830219511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 0x7fb38c15b820 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fb384005fd0 tx=0x7fb38402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 -- 172.21.15.81:0/1830219511 shutdown_connections 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1830219511 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 0x7fb38c15b820 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1830219511 >> v2:172.21.15.160:3300/0 conn(0x7fb38c0ccc50 0x7fb38c06fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 -- 172.21.15.81:0/1830219511 >> 172.21.15.81:0/1830219511 conn(0x7fb38c0b1700 msgr2=0x7fb38c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 -- 172.21.15.81:0/1830219511 shutdown_connections 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.864+0000 7fb392b5d640 1 -- 172.21.15.81:0/1830219511 wait complete. 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.865+0000 7fb392b5d640 1 Processor -- start 2024-09-17T05:23:25.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.865+0000 7fb392b5d640 1 -- start start 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb392b5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb38c0ccc50 0x7fb38c1544a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb392b5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38c151e30 0x7fb38c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb392b5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 0x7fb38c072d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb392b5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c0cb060 con 0x7fb38c151e30 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb392b5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb38c0caee0 con 0x7fb38c0ccc50 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb392b5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb38c0cb1e0 con 0x7fb38c15b3d0 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38c151e30 0x7fb38c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38c151e30 0x7fb38c0c7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45602/0 (socket says 172.21.15.81:45602) 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 -- 172.21.15.81:0/1687021320 learned_addr learned my addr 172.21.15.81:0/1687021320 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb3910fa640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 0x7fb38c072d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb3908f9640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb38c0ccc50 0x7fb38c1544a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 -- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 msgr2=0x7fb38c072d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 0x7fb38c072d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 -- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb38c0ccc50 msgr2=0x7fb38c1544a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb38c0ccc50 0x7fb38c1544a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.866+0000 7fb383fff640 1 -- 172.21.15.81:0/1687021320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb38c0c8870 con 0x7fb38c151e30 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.867+0000 7fb383fff640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38c151e30 0x7fb38c0c7f40 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00ea20 tx=0x7fb37c00eee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.867+0000 7fb3817fa640 1 -- 172.21.15.81:0/1687021320 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c00cd80 con 0x7fb38c151e30 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.867+0000 7fb3817fa640 1 -- 172.21.15.81:0/1687021320 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb37c010430 con 0x7fb38c151e30 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.867+0000 7fb3817fa640 1 -- 172.21.15.81:0/1687021320 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb37c010840 con 0x7fb38c151e30 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.867+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb38c0c8b50 con 0x7fb38c151e30 2024-09-17T05:23:25.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.867+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb38c0c9110 con 0x7fb38c151e30 2024-09-17T05:23:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.868+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb38c0cb690 con 0x7fb38c151e30 2024-09-17T05:23:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.869+0000 7fb3817fa640 1 -- 172.21.15.81:0/1687021320 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fb37c0109e0 con 0x7fb38c151e30 2024-09-17T05:23:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.869+0000 7fb3817fa640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb378078cb0 0x7fb37807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:25.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.869+0000 7fb3817fa640 1 -- 172.21.15.81:0/1687021320 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 5227+0+0 (secure 0 0 0) 0x7fb37c09b8e0 con 0x7fb38c151e30 2024-09-17T05:23:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.869+0000 7fb3908f9640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb378078cb0 0x7fb37807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:25.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.870+0000 7fb3908f9640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb378078cb0 0x7fb37807b170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0ca0b0 tx=0x7fb388007e90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:25.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:25.874+0000 7fb3817fa640 1 -- 172.21.15.81:0/1687021320 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb37c0636a0 con 0x7fb38c151e30 2024-09-17T05:23:26.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.052+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7fb38c0caa20 con 0x7fb38c151e30 2024-09-17T05:23:26.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.746+0000 7fb3817fa640 1 -- 172.21.15.81:0/1687021320 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) ==== 170+0+0 (secure 0 0 0) 0x7fb37c0680d0 con 0x7fb38c151e30 2024-09-17T05:23:26.747 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:23:26.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb378078cb0 msgr2=0x7fb37807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb378078cb0 0x7fb37807b170 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fb38c0ca0b0 tx=0x7fb388007e90 comp rx=0 tx=0).stop 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38c151e30 msgr2=0x7fb38c0c7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38c151e30 0x7fb38c0c7f40 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fb37c00ea20 tx=0x7fb37c00eee0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 shutdown_connections 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb38c15b3d0 0x7fb38c072d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb38c151e30 0x7fb38c0c7f40 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb378078cb0 0x7fb37807b170 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 --2- 172.21.15.81:0/1687021320 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb38c0ccc50 0x7fb38c1544a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.749+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 >> 172.21.15.81:0/1687021320 conn(0x7fb38c0b1700 msgr2=0x7fb38c0b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.750+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 shutdown_connections 2024-09-17T05:23:26.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.750+0000 7fb392b5d640 1 -- 172.21.15.81:0/1687021320 wait complete. 2024-09-17T05:23:26.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 -- 172.21.15.81:0/2245487611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b81617f0 msgr2=0x7f26b80d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 --2- 172.21.15.81:0/2245487611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b81617f0 0x7f26b80d1d30 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7f26b80b69d0 tx=0x7f26a802a950 comp rx=0 tx=0).stop 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 -- 172.21.15.81:0/2245487611 shutdown_connections 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 --2- 172.21.15.81:0/2245487611 >> v2:172.21.15.160:3300/0 conn(0x7f26b80b3de0 0x7f26b80b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 --2- 172.21.15.81:0/2245487611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b81617f0 0x7f26b80d1d30 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 -- 172.21.15.81:0/2245487611 >> 172.21.15.81:0/2245487611 conn(0x7f26b80d3e30 msgr2=0x7f26b80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 -- 172.21.15.81:0/2245487611 shutdown_connections 2024-09-17T05:23:26.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.881+0000 7f26bfa52640 1 -- 172.21.15.81:0/2245487611 wait complete. 2024-09-17T05:23:26.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 Processor -- start 2024-09-17T05:23:26.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 -- start start 2024-09-17T05:23:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26b80b3de0 0x7f26b8157370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b80d01b0 0x7f26b80b1e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:26.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26b81617f0 0x7f26b80b2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26b80b48b0 con 0x7f26b80d01b0 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f26b80b4730 con 0x7f26b81617f0 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bfa52640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f26b80b4a30 con 0x7f26b80b3de0 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bcfed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b80d01b0 0x7f26b80b1e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bcfed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b80d01b0 0x7f26b80b1e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45618/0 (socket says 172.21.15.81:45618) 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.883+0000 7f26bcfed640 1 -- 172.21.15.81:0/1085280655 learned_addr learned my addr 172.21.15.81:0/1085280655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bd7ee640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26b80b3de0 0x7f26b8157370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bdfef640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26b81617f0 0x7f26b80b2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bcfed640 1 -- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26b80b3de0 msgr2=0x7f26b8157370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:26.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bcfed640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26b80b3de0 0x7f26b8157370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bcfed640 1 -- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26b81617f0 msgr2=0x7f26b80b2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bcfed640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26b81617f0 0x7f26b80b2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bcfed640 1 -- 172.21.15.81:0/1085280655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26b81f8eb0 con 0x7f26b80d01b0 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bcfed640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b80d01b0 0x7f26b80b1e40 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c430 tx=0x7f26ac00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26b5ffb640 1 -- 172.21.15.81:0/1085280655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac011790 con 0x7f26b80d01b0 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26b5ffb640 1 -- 172.21.15.81:0/1085280655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26ac017070 con 0x7f26b80d01b0 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26b81f9190 con 0x7f26b80d01b0 2024-09-17T05:23:26.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26b5ffb640 1 -- 172.21.15.81:0/1085280655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26ac011d00 con 0x7f26b80d01b0 2024-09-17T05:23:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.884+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26b81f9750 con 0x7f26b80d01b0 2024-09-17T05:23:26.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.885+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26b80b4f70 con 0x7f26b80d01b0 2024-09-17T05:23:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.886+0000 7f26b5ffb640 1 -- 172.21.15.81:0/1085280655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f26ac01c460 con 0x7f26b80d01b0 2024-09-17T05:23:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.887+0000 7f26b5ffb640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26a4078cb0 0x7f26a407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.887+0000 7f26b5ffb640 1 -- 172.21.15.81:0/1085280655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(99..99 src has 1..99) ==== 5609+0+0 (secure 0 0 0) 0x7f26ac09ac70 con 0x7f26b80d01b0 2024-09-17T05:23:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.887+0000 7f26bd7ee640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26a4078cb0 0x7f26a407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.887+0000 7f26bd7ee640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26a4078cb0 0x7f26a407b170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26a8035000 tx=0x7f26a8004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:26.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:26.891+0000 7f26b5ffb640 1 -- 172.21.15.81:0/1085280655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f26ac062930 con 0x7f26b80d01b0 2024-09-17T05:23:27.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.103+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f26b806e4e0 con 0x7f26b80d01b0 2024-09-17T05:23:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.751+0000 7f26b5ffb640 1 -- 172.21.15.81:0/1085280655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v57) ==== 174+0+0 (secure 0 0 0) 0x7f26ac067360 con 0x7f26b80d01b0 2024-09-17T05:23:27.751 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 16 and data pool 17 2024-09-17T05:23:27.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26a4078cb0 msgr2=0x7f26a407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26a4078cb0 0x7f26a407b170 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f26a8035000 tx=0x7f26a8004ab0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b80d01b0 msgr2=0x7f26b80b1e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b80d01b0 0x7f26b80b1e40 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f26ac00c430 tx=0x7f26ac00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 shutdown_connections 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26a4078cb0 0x7f26a407b170 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26b81617f0 0x7f26b80b2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26b80d01b0 0x7f26b80b1e40 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 --2- 172.21.15.81:0/1085280655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26b80b3de0 0x7f26b8157370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 >> 172.21.15.81:0/1085280655 conn(0x7f26b80d3e30 msgr2=0x7f26b815ff80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:27.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.758+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 shutdown_connections 2024-09-17T05:23:27.760 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.759+0000 7f26bfa52640 1 -- 172.21.15.81:0/1085280655 wait complete. 2024-09-17T05:23:27.774 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:27.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 -- 172.21.15.81:0/3513651243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0ce780 msgr2=0x7f157c0cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:27.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 --2- 172.21.15.81:0/3513651243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0ce780 0x7f157c0cbb80 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f157c0cc980 tx=0x7f157402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 -- 172.21.15.81:0/3513651243 shutdown_connections 2024-09-17T05:23:27.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 --2- 172.21.15.81:0/3513651243 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0ce780 0x7f157c0cbb80 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 --2- 172.21.15.81:0/3513651243 >> v2:172.21.15.160:3300/0 conn(0x7f157c0cd3e0 0x7f157c0ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 -- 172.21.15.81:0/3513651243 >> 172.21.15.81:0/3513651243 conn(0x7f157c0741f0 msgr2=0x7f157c074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 -- 172.21.15.81:0/3513651243 shutdown_connections 2024-09-17T05:23:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.877+0000 7f1580924640 1 -- 172.21.15.81:0/3513651243 wait complete. 2024-09-17T05:23:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.878+0000 7f1580924640 1 Processor -- start 2024-09-17T05:23:27.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.878+0000 7f1580924640 1 -- start start 2024-09-17T05:23:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1580924640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f157c06f0b0 0x7f157c09db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:27.880 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1580924640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0cd3e0 0x7f157c0c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1580924640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f157c0ce780 0x7f157c0c6c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1580924640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f157c0cc0c0 con 0x7f157c0cd3e0 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1580924640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f157c15e670 con 0x7f157c06f0b0 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1580924640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f157c0cc240 con 0x7f157c0ce780 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0cd3e0 0x7f157c0c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0cd3e0 0x7f157c0c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45646/0 (socket says 172.21.15.81:45646) 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 -- 172.21.15.81:0/3179843728 learned_addr learned my addr 172.21.15.81:0/3179843728 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f157ad9d640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f157c0ce780 0x7f157c0c6c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f157a59c640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f157c06f0b0 0x7f157c09db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 -- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f157c0ce780 msgr2=0x7f157c0c6c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f157c0ce780 0x7f157c0c6c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.881 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 -- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f157c06f0b0 msgr2=0x7f157c09db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f157c06f0b0 0x7f157c09db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 -- 172.21.15.81:0/3179843728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157c0b1140 con 0x7f157c0cd3e0 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f157ad9d640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f157c0ce780 0x7f157c0c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f157a59c640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f157c06f0b0 0x7f157c09db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.879+0000 7f1579d9b640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0cd3e0 0x7f157c0c6740 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f157000b4d0 tx=0x7f157000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.880+0000 7f156affd640 1 -- 172.21.15.81:0/3179843728 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570014070 con 0x7f157c0cd3e0 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.880+0000 7f156affd640 1 -- 172.21.15.81:0/3179843728 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1570010960 con 0x7f157c0cd3e0 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.880+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157c0b1420 con 0x7f157c0cd3e0 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.880+0000 7f156affd640 1 -- 172.21.15.81:0/3179843728 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570010db0 con 0x7f157c0cd3e0 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.880+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f157c14e1b0 con 0x7f157c0cd3e0 2024-09-17T05:23:27.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.881+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f157c0cc6f0 con 0x7f157c0cd3e0 2024-09-17T05:23:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.881+0000 7f156affd640 1 -- 172.21.15.81:0/3179843728 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f1570017070 con 0x7f157c0cd3e0 2024-09-17T05:23:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.882+0000 7f156affd640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f155c078cb0 0x7f155c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.882+0000 7f157a59c640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f155c078cb0 0x7f155c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.882+0000 7f156affd640 1 -- 172.21.15.81:0/3179843728 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f157009ad60 con 0x7f157c0cd3e0 2024-09-17T05:23:27.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.882+0000 7f157a59c640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f155c078cb0 0x7f155c07b170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f156c001e40 tx=0x7f156c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:27.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:27.886+0000 7f156affd640 1 -- 172.21.15.81:0/3179843728 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1570063020 con 0x7f157c0cd3e0 2024-09-17T05:23:28.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.064+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f157c075070 con 0x7f157c0cd3e0 2024-09-17T05:23:28.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.065+0000 7f156affd640 1 -- 172.21.15.81:0/3179843728 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16692 (secure 0 0 0) 0x7f1570062920 con 0x7f157c0cd3e0 2024-09-17T05:23:28.066 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:28.066 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":100,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:23:27.104287+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:23:25.709556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:23:26.056368+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f155c078cb0 msgr2=0x7f155c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f155c078cb0 0x7f155c07b170 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f156c001e40 tx=0x7f156c009040 comp rx=0 tx=0).stop 2024-09-17T05:23:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0cd3e0 msgr2=0x7f157c0c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0cd3e0 0x7f157c0c6740 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f157000b4d0 tx=0x7f157000b990 comp rx=0 tx=0).stop 2024-09-17T05:23:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 shutdown_connections 2024-09-17T05:23:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f157c0ce780 0x7f157c0c6c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.068 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f157c0cd3e0 0x7f157c0c6740 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f155c078cb0 0x7f155c07b170 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 --2- 172.21.15.81:0/3179843728 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f157c06f0b0 0x7f157c09db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 >> 172.21.15.81:0/3179843728 conn(0x7f157c0741f0 msgr2=0x7f157c0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 shutdown_connections 2024-09-17T05:23:28.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.068+0000 7f1580924640 1 -- 172.21.15.81:0/3179843728 wait complete. 2024-09-17T05:23:28.079 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 -- 172.21.15.81:0/2349871597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c070690 msgr2=0x7f945c0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 --2- 172.21.15.81:0/2349871597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c070690 0x7f945c0739a0 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f9454005fd0 tx=0x7f945402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 -- 172.21.15.81:0/2349871597 shutdown_connections 2024-09-17T05:23:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 --2- 172.21.15.81:0/2349871597 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c070690 0x7f945c0739a0 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 --2- 172.21.15.81:0/2349871597 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f945c15aa70 0x7f945c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 -- 172.21.15.81:0/2349871597 >> 172.21.15.81:0/2349871597 conn(0x7f945c0b1690 msgr2=0x7f945c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 -- 172.21.15.81:0/2349871597 shutdown_connections 2024-09-17T05:23:28.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.180+0000 7f9461c2a640 1 -- 172.21.15.81:0/2349871597 wait complete. 2024-09-17T05:23:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.181+0000 7f9461c2a640 1 Processor -- start 2024-09-17T05:23:28.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f9461c2a640 1 -- start start 2024-09-17T05:23:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f9461c2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f945c070690 0x7f945c0c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f9461c2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f945c0735a0 0x7f945c0c9250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f9461c2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c15aa70 0x7f945c1f7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f9461c2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f945c0cd270 con 0x7f945c15aa70 2024-09-17T05:23:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f9461c2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f945c0cd0f0 con 0x7f945c0735a0 2024-09-17T05:23:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f9461c2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f945c0cd3f0 con 0x7f945c070690 2024-09-17T05:23:28.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f945bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c15aa70 0x7f945c1f7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f945bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c15aa70 0x7f945c1f7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45666/0 (socket says 172.21.15.81:45666) 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.182+0000 7f945bfff640 1 -- 172.21.15.81:0/1362600598 learned_addr learned my addr 172.21.15.81:0/1362600598 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945b7fe640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f945c070690 0x7f945c0c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f9452ffd640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f945c0735a0 0x7f945c0c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945bfff640 1 -- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f945c070690 msgr2=0x7f945c0c8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945bfff640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f945c070690 0x7f945c0c8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945bfff640 1 -- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f945c0735a0 msgr2=0x7f945c0c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945bfff640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f945c0735a0 0x7f945c0c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945bfff640 1 -- 172.21.15.81:0/1362600598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f945c14b0b0 con 0x7f945c15aa70 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945b7fe640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f945c070690 0x7f945c0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f945bfff640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c15aa70 0x7f945c1f7a70 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9454006010 tx=0x7f9454003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:28.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f9458ff9640 1 -- 172.21.15.81:0/1362600598 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454040070 con 0x7f945c15aa70 2024-09-17T05:23:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f9458ff9640 1 -- 172.21.15.81:0/1362600598 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9454004130 con 0x7f945c15aa70 2024-09-17T05:23:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f945c14b320 con 0x7f945c15aa70 2024-09-17T05:23:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f9458ff9640 1 -- 172.21.15.81:0/1362600598 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454004540 con 0x7f945c15aa70 2024-09-17T05:23:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.183+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f945c1f87a0 con 0x7f945c15aa70 2024-09-17T05:23:28.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.184+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f945c06a0c0 con 0x7f945c15aa70 2024-09-17T05:23:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.185+0000 7f9458ff9640 1 -- 172.21.15.81:0/1362600598 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f9454039040 con 0x7f945c15aa70 2024-09-17T05:23:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.185+0000 7f9458ff9640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f943c078cb0 0x7f943c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.185+0000 7f945b7fe640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f943c078cb0 0x7f943c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.185+0000 7f9458ff9640 1 -- 172.21.15.81:0/1362600598 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f94540bc900 con 0x7f945c15aa70 2024-09-17T05:23:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.186+0000 7f945b7fe640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f943c078cb0 0x7f943c07b170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f944c005fd0 tx=0x7f944c00f360 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:28.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.189+0000 7f9458ff9640 1 -- 172.21.15.81:0/1362600598 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f945c06a0c0 con 0x7f945c15aa70 2024-09-17T05:23:28.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.364+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f945c0697e0 con 0x7f945c15aa70 2024-09-17T05:23:28.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.365+0000 7f9458ff9640 1 -- 172.21.15.81:0/1362600598 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+16692 (secure 0 0 0) 0x7f9454084e40 con 0x7f945c15aa70 2024-09-17T05:23:28.365 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:28.365 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":100,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:23:27.104287+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:23:25.709556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:23:26.056368+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f943c078cb0 msgr2=0x7f943c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f943c078cb0 0x7f943c07b170 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f944c005fd0 tx=0x7f944c00f360 comp rx=0 tx=0).stop 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c15aa70 msgr2=0x7f945c1f7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c15aa70 0x7f945c1f7a70 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f9454006010 tx=0x7f9454003970 comp rx=0 tx=0).stop 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 shutdown_connections 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f945c15aa70 0x7f945c1f7a70 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f943c078cb0 0x7f943c07b170 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f945c0735a0 0x7f945c0c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 --2- 172.21.15.81:0/1362600598 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f945c070690 0x7f945c0c8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 >> 172.21.15.81:0/1362600598 conn(0x7f945c0b1690 msgr2=0x7f945c0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 shutdown_connections 2024-09-17T05:23:28.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.367+0000 7f9461c2a640 1 -- 172.21.15.81:0/1362600598 wait complete. 2024-09-17T05:23:28.379 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:23:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2459474342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea415b380 msgr2=0x7f5ea4072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2459474342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea415b380 0x7f5ea4072b50 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f5ea40b2770 tx=0x7f5e9402a530 comp rx=0 tx=0).stop 2024-09-17T05:23:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2459474342 shutdown_connections 2024-09-17T05:23:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2459474342 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea40ce120 0x7f5ea40cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2459474342 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea415b380 0x7f5ea4072b50 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2459474342 >> 172.21.15.81:0/2459474342 conn(0x7f5ea40b1700 msgr2=0x7f5ea40b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2459474342 shutdown_connections 2024-09-17T05:23:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.482+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2459474342 wait complete. 2024-09-17T05:23:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.484+0000 7f5ea89a3640 1 Processor -- start 2024-09-17T05:23:28.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.484+0000 7f5ea89a3640 1 -- start start 2024-09-17T05:23:28.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea89a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea4073090 0x7f5ea414bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea89a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea40ce120 0x7f5ea40afa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea89a3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea415b380 0x7f5ea40aff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea89a3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40cc8e0 con 0x7f5ea40ce120 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea89a3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5ea40cc760 con 0x7f5ea415b380 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea89a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5ea40cca60 con 0x7f5ea4073090 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea40ce120 0x7f5ea40afa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea40ce120 0x7f5ea40afa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45674/0 (socket says 172.21.15.81:45674) 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 -- 172.21.15.81:0/2803902406 learned_addr learned my addr 172.21.15.81:0/2803902406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea2d9d640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea415b380 0x7f5ea40aff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea259c640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea4073090 0x7f5ea414bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 -- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea4073090 msgr2=0x7f5ea414bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea4073090 0x7f5ea414bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 -- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea415b380 msgr2=0x7f5ea40aff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea415b380 0x7f5ea40aff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 -- 172.21.15.81:0/2803902406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ea4154960 con 0x7f5ea40ce120 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea259c640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea4073090 0x7f5ea414bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e99d9b640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea40ce120 0x7f5ea40afa30 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00c410 tx=0x7f5e8c00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e9b7fe640 1 -- 172.21.15.81:0/2803902406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c017070 con 0x7f5ea40ce120 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e9b7fe640 1 -- 172.21.15.81:0/2803902406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e8c0035f0 con 0x7f5ea40ce120 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ea41f6000 con 0x7f5ea40ce120 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.485+0000 7f5e9b7fe640 1 -- 172.21.15.81:0/2803902406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c003a80 con 0x7f5ea40ce120 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.486+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ea41f65c0 con 0x7f5ea40ce120 2024-09-17T05:23:28.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.487+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5ea41f67c0 con 0x7f5ea40ce120 2024-09-17T05:23:28.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.487+0000 7f5e9b7fe640 1 -- 172.21.15.81:0/2803902406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f5e8c01a070 con 0x7f5ea40ce120 2024-09-17T05:23:28.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.488+0000 7f5e9b7fe640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e84078cb0 0x7f5e8407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.488+0000 7f5e9b7fe640 1 -- 172.21.15.81:0/2803902406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 5709+0+0 (secure 0 0 0) 0x7f5e8c09a370 con 0x7f5ea40ce120 2024-09-17T05:23:28.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.488+0000 7f5ea259c640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e84078cb0 0x7f5e8407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.488+0000 7f5ea259c640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e84078cb0 0x7f5e8407b170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e94033000 tx=0x7f5e94004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:28.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.492+0000 7f5e9b7fe640 1 -- 172.21.15.81:0/2803902406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5ea41f67c0 con 0x7f5ea40ce120 2024-09-17T05:23:28.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.704+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f5ea40b1d80 con 0x7f5ea40ce120 2024-09-17T05:23:28.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.839+0000 7f5e9b7fe640 1 -- 172.21.15.81:0/2803902406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v59) ==== 118+0+0 (secure 0 0 0) 0x7f5e8c062620 con 0x7f5ea40ce120 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e84078cb0 msgr2=0x7f5e8407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e84078cb0 0x7f5e8407b170 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f5e94033000 tx=0x7f5e94004730 comp rx=0 tx=0).stop 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea40ce120 msgr2=0x7f5ea40afa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea40ce120 0x7f5ea40afa30 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00c410 tx=0x7f5e8c00c8d0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 shutdown_connections 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e84078cb0 0x7f5e8407b170 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5ea415b380 0x7f5ea40aff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5ea40ce120 0x7f5ea40afa30 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 --2- 172.21.15.81:0/2803902406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5ea4073090 0x7f5ea414bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 >> 172.21.15.81:0/2803902406 conn(0x7f5ea40b1700 msgr2=0x7f5ea40b08d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:28.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 shutdown_connections 2024-09-17T05:23:28.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.843+0000 7f5ea89a3640 1 -- 172.21.15.81:0/2803902406 wait complete. 2024-09-17T05:23:28.854 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:23:28.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:23:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 -- 172.21.15.81:0/322145585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 msgr2=0x7f90b80d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/322145585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b80d1ce0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7f90b80d0350 tx=0x7f90b002aa00 comp rx=0 tx=0).stop 2024-09-17T05:23:28.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 -- 172.21.15.81:0/322145585 shutdown_connections 2024-09-17T05:23:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/322145585 >> v2:172.21.15.160:3300/0 conn(0x7f90b80b0d80 0x7f90b80d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/322145585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b80d1ce0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 -- 172.21.15.81:0/322145585 >> 172.21.15.81:0/322145585 conn(0x7f90b809aa30 msgr2=0x7f90b809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 -- 172.21.15.81:0/322145585 shutdown_connections 2024-09-17T05:23:28.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.960+0000 7f90bd2fe640 1 -- 172.21.15.81:0/322145585 wait complete. 2024-09-17T05:23:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.961+0000 7f90bd2fe640 1 Processor -- start 2024-09-17T05:23:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.961+0000 7f90bd2fe640 1 -- start start 2024-09-17T05:23:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90bd2fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90b80b0d80 0x7f90b8156880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90bd2fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90b80d0490 0x7f90b80b6190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90bd2fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b814dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90bd2fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90b80b0a50 con 0x7f90b815bf10 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90bd2fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f90b80b2230 con 0x7f90b80d0490 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90bd2fe640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f90b80b5750 con 0x7f90b80b0d80 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b814dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b814dce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45690/0 (socket says 172.21.15.81:45690) 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 -- 172.21.15.81:0/78215265 learned_addr learned my addr 172.21.15.81:0/78215265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b6ffd640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90b80b0d80 0x7f90b8156880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b67fc640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90b80d0490 0x7f90b80b6190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 -- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90b80b0d80 msgr2=0x7f90b8156880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90b80b0d80 0x7f90b8156880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 -- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90b80d0490 msgr2=0x7f90b80b6190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90b80d0490 0x7f90b80b6190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b77fe640 1 -- 172.21.15.81:0/78215265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90b80c7f20 con 0x7f90b815bf10 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.962+0000 7f90b67fc640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90b80d0490 0x7f90b80b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.963+0000 7f90b77fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b814dce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f90a800c390 tx=0x7f90a800c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.963+0000 7f90af7fe640 1 -- 172.21.15.81:0/78215265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8017070 con 0x7f90b815bf10 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.963+0000 7f90af7fe640 1 -- 172.21.15.81:0/78215265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90a80035f0 con 0x7f90b815bf10 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.963+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90b80c8200 con 0x7f90b815bf10 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.963+0000 7f90af7fe640 1 -- 172.21.15.81:0/78215265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90a8003a40 con 0x7f90b815bf10 2024-09-17T05:23:28.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.963+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90b80b66d0 con 0x7f90b815bf10 2024-09-17T05:23:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.964+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90b80b2720 con 0x7f90b815bf10 2024-09-17T05:23:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.964+0000 7f90af7fe640 1 -- 172.21.15.81:0/78215265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f90a801a070 con 0x7f90b815bf10 2024-09-17T05:23:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.965+0000 7f90af7fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9098078ce0 0x7f909807b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.965+0000 7f90b6ffd640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9098078ce0 0x7f909807b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.965+0000 7f90af7fe640 1 -- 172.21.15.81:0/78215265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f90a809a230 con 0x7f90b815bf10 2024-09-17T05:23:28.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.965+0000 7f90b6ffd640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9098078ce0 0x7f909807b1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f90b0035000 tx=0x7f90b0004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:28.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:28.969+0000 7f90af7fe640 1 -- 172.21.15.81:0/78215265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f90a8061e90 con 0x7f90b815bf10 2024-09-17T05:23:29.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.183+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f90b815ac50 con 0x7f90b815bf10 2024-09-17T05:23:29.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.841+0000 7f90af7fe640 1 -- 172.21.15.81:0/78215265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v60) ==== 122+0+0 (secure 0 0 0) 0x7f90a80668c0 con 0x7f90b815bf10 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.843+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9098078ce0 msgr2=0x7f909807b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.843+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9098078ce0 0x7f909807b1a0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f90b0035000 tx=0x7f90b0004ab0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 msgr2=0x7f90b814dce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b814dce0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f90a800c390 tx=0x7f90a800c850 comp rx=0 tx=0).stop 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 shutdown_connections 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90b815bf10 0x7f90b814dce0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9098078ce0 0x7f909807b1a0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90b80d0490 0x7f90b80b6190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 --2- 172.21.15.81:0/78215265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90b80b0d80 0x7f90b8156880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 >> 172.21.15.81:0/78215265 conn(0x7f90b809aa30 msgr2=0x7f90b8070f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 shutdown_connections 2024-09-17T05:23:29.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.844+0000 7f90bd2fe640 1 -- 172.21.15.81:0/78215265 wait complete. 2024-09-17T05:23:29.856 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:23:29.856 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:29.961 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.961+0000 7f1e0a175640 1 -- 172.21.15.81:0/3279448954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e04072cb0 msgr2=0x7f1e0406f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.961+0000 7f1e0a175640 1 --2- 172.21.15.81:0/3279448954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e04072cb0 0x7f1e0406f9f0 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f1dfc005fd0 tx=0x7f1dfc02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.961+0000 7f1e0a175640 1 -- 172.21.15.81:0/3279448954 shutdown_connections 2024-09-17T05:23:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.961+0000 7f1e0a175640 1 --2- 172.21.15.81:0/3279448954 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e04072cb0 0x7f1e0406f9f0 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.961+0000 7f1e0a175640 1 -- 172.21.15.81:0/3279448954 >> 172.21.15.81:0/3279448954 conn(0x7f1e040b1690 msgr2=0x7f1e040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.961+0000 7f1e0a175640 1 -- 172.21.15.81:0/3279448954 shutdown_connections 2024-09-17T05:23:29.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.961+0000 7f1e0a175640 1 -- 172.21.15.81:0/3279448954 wait complete. 2024-09-17T05:23:29.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.963+0000 7f1e0a175640 1 Processor -- start 2024-09-17T05:23:29.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.963+0000 7f1e0a175640 1 -- start start 2024-09-17T05:23:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.963+0000 7f1e0a175640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e04072cb0 0x7f1e041394b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e0a175640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e040cf640 0x7f1e041462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e0a175640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e04151370 0x7f1e0414f690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e0a175640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e040702c0 con 0x7f1e040cf640 2024-09-17T05:23:29.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e0a175640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1e04070140 con 0x7f1e04072cb0 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e0a175640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1e04070440 con 0x7f1e04151370 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e040cf640 0x7f1e041462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e040cf640 0x7f1e041462f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45710/0 (socket says 172.21.15.81:45710) 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 -- 172.21.15.81:0/2668288665 learned_addr learned my addr 172.21.15.81:0/2668288665 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e03fff640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e04151370 0x7f1e0414f690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e037fe640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e04072cb0 0x7f1e041394b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 -- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e04151370 msgr2=0x7f1e0414f690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e04151370 0x7f1e0414f690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 -- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e04072cb0 msgr2=0x7f1e041394b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e04072cb0 0x7f1e041394b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 -- 172.21.15.81:0/2668288665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e04146830 con 0x7f1e040cf640 2024-09-17T05:23:29.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e03fff640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e04151370 0x7f1e0414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e02ffd640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e040cf640 0x7f1e041462f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1df400c430 tx=0x7f1df400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1dfbfff640 1 -- 172.21.15.81:0/2668288665 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4011790 con 0x7f1e040cf640 2024-09-17T05:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1dfbfff640 1 -- 172.21.15.81:0/2668288665 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1df4017070 con 0x7f1e040cf640 2024-09-17T05:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1dfbfff640 1 -- 172.21.15.81:0/2668288665 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1df4011d00 con 0x7f1e040cf640 2024-09-17T05:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e041443d0 con 0x7f1e040cf640 2024-09-17T05:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.964+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e04144990 con 0x7f1e040cf640 2024-09-17T05:23:29.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.965+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e0406f9f0 con 0x7f1e040cf640 2024-09-17T05:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.966+0000 7f1dfbfff640 1 -- 172.21.15.81:0/2668288665 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f1df401c460 con 0x7f1e040cf640 2024-09-17T05:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.966+0000 7f1dfbfff640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1de4078ce0 0x7f1de407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.967+0000 7f1e037fe640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1de4078ce0 0x7f1de407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.967+0000 7f1dfbfff640 1 -- 172.21.15.81:0/2668288665 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f1df409aed0 con 0x7f1e040cf640 2024-09-17T05:23:29.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.967+0000 7f1e037fe640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1de4078ce0 0x7f1de407b1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1dec007fd0 tx=0x7f1dec009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:29.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:29.971+0000 7f1dfbfff640 1 -- 172.21.15.81:0/2668288665 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1df4063100 con 0x7f1e040cf640 2024-09-17T05:23:30.184 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.184+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1e041e73b0 con 0x7f1e040cf640 2024-09-17T05:23:30.185 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.185+0000 7f1dfbfff640 1 -- 172.21.15.81:0/2668288665 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5231 (secure 0 0 0) 0x7f1df4062a00 con 0x7f1e040cf640 2024-09-17T05:23:30.185 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:30.185 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"btime":"2024-09-17T05:23:29:840034+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1016859110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1016859110},{"type":"v1","addr":"172.21.15.160:6834","nonce":1016859110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2510717284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2510717284},{"type":"v1","addr":"172.21.15.81:6833","nonce":2510717284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3071988430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3071988430},{"type":"v1","addr":"172.21.15.81:6835","nonce":3071988430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:23:27.104253+0000","modified":"2024-09-17T05:23:29.183539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7011},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7011":{"gid":7011,"name":"d","rank":0,"incarnation":57,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/1304519501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":1304519501},{"type":"v1","addr":"172.21.15.160:6835","nonce":1304519501}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7011,"qdb_cluster":[7011]},"id":8}]} 2024-09-17T05:23:30.186 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2024-09-17T05:23:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1de4078ce0 msgr2=0x7f1de407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1de4078ce0 0x7f1de407b1a0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f1dec007fd0 tx=0x7f1dec009040 comp rx=0 tx=0).stop 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e040cf640 msgr2=0x7f1e041462f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e040cf640 0x7f1e041462f0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f1df400c430 tx=0x7f1df400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 shutdown_connections 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e04151370 0x7f1e0414f690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e040cf640 0x7f1e041462f0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1de4078ce0 0x7f1de407b1a0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 --2- 172.21.15.81:0/2668288665 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e04072cb0 0x7f1e041394b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 >> 172.21.15.81:0/2668288665 conn(0x7f1e040b1690 msgr2=0x7f1e04147430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 shutdown_connections 2024-09-17T05:23:30.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.187+0000 7f1e0a175640 1 -- 172.21.15.81:0/2668288665 wait complete. 2024-09-17T05:23:30.198 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:23:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.298+0000 7f3121110640 1 -- 172.21.15.81:0/146685870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c0b3140 msgr2=0x7f311c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.298+0000 7f3121110640 1 --2- 172.21.15.81:0/146685870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c0b3140 0x7f311c072ae0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f3114005fd0 tx=0x7f311402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.299+0000 7f3121110640 1 -- 172.21.15.81:0/146685870 shutdown_connections 2024-09-17T05:23:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.299+0000 7f3121110640 1 --2- 172.21.15.81:0/146685870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c0b3140 0x7f311c072ae0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.299+0000 7f3121110640 1 --2- 172.21.15.81:0/146685870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311c0cf640 0x7f311c0725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.299+0000 7f3121110640 1 -- 172.21.15.81:0/146685870 >> 172.21.15.81:0/146685870 conn(0x7f311c0b1690 msgr2=0x7f311c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.299+0000 7f3121110640 1 -- 172.21.15.81:0/146685870 shutdown_connections 2024-09-17T05:23:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.299+0000 7f3121110640 1 -- 172.21.15.81:0/146685870 wait complete. 2024-09-17T05:23:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.300+0000 7f3121110640 1 Processor -- start 2024-09-17T05:23:30.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.300+0000 7f3121110640 1 -- start start 2024-09-17T05:23:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f3121110640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311c0b3140 0x7f311c13e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f3121110640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311c0cf640 0x7f311c1517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f3121110640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c151370 0x7f311c151d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f3121110640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f311c06ec10 con 0x7f311c151370 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f3121110640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f311c06ea90 con 0x7f311c0b3140 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f3121110640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f311c06f9f0 con 0x7f311c0cf640 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c151370 0x7f311c151d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c151370 0x7f311c151d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45724/0 (socket says 172.21.15.81:45724) 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 -- 172.21.15.81:0/1136398588 learned_addr learned my addr 172.21.15.81:0/1136398588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311259c640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311c0cf640 0x7f311c1517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311ad9d640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311c0b3140 0x7f311c13e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 -- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311c0cf640 msgr2=0x7f311c1517f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311c0cf640 0x7f311c1517f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 -- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311c0b3140 msgr2=0x7f311c13e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311c0b3140 0x7f311c13e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 -- 172.21.15.81:0/1136398588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f311c153b10 con 0x7f311c151370 2024-09-17T05:23:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311259c640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311c0cf640 0x7f311c1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311ad9d640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311c0b3140 0x7f311c13e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.301+0000 7f311b59e640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c151370 0x7f311c151d30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3114006010 tx=0x7f3114003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:30.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.302+0000 7f3113fff640 1 -- 172.21.15.81:0/1136398588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114040070 con 0x7f311c151370 2024-09-17T05:23:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.302+0000 7f3113fff640 1 -- 172.21.15.81:0/1136398588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3114004130 con 0x7f311c151370 2024-09-17T05:23:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.302+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f311c153df0 con 0x7f311c151370 2024-09-17T05:23:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.302+0000 7f3113fff640 1 -- 172.21.15.81:0/1136398588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3114004540 con 0x7f311c151370 2024-09-17T05:23:30.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.302+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f311c1543b0 con 0x7f311c151370 2024-09-17T05:23:30.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.303+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f311c0cef30 con 0x7f311c151370 2024-09-17T05:23:30.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.303+0000 7f3113fff640 1 -- 172.21.15.81:0/1136398588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f3114039040 con 0x7f311c151370 2024-09-17T05:23:30.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.304+0000 7f3113fff640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f30fc078cb0 0x7f30fc07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.304+0000 7f3113fff640 1 -- 172.21.15.81:0/1136398588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f31140bc610 con 0x7f311c151370 2024-09-17T05:23:30.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.304+0000 7f311ad9d640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f30fc078cb0 0x7f30fc07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.304+0000 7f311ad9d640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f30fc078cb0 0x7f30fc07b170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f310c000f60 tx=0x7f310c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:30.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.308+0000 7f3113fff640 1 -- 172.21.15.81:0/1136398588 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f31140848c0 con 0x7f311c151370 2024-09-17T05:23:30.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.484+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f311c14d280 con 0x7f311c151370 2024-09-17T05:23:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.485+0000 7f3113fff640 1 -- 172.21.15.81:0/1136398588 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) ==== 74+0+16679 (secure 0 0 0) 0x7f31140841c0 con 0x7f311c151370 2024-09-17T05:23:30.485 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:30.485 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:23:28.732784+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:23:25.709556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:23:26.056368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:23:30.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f30fc078cb0 msgr2=0x7f30fc07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f30fc078cb0 0x7f30fc07b170 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f310c000f60 tx=0x7f310c009040 comp rx=0 tx=0).stop 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c151370 msgr2=0x7f311c151d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c151370 0x7f311c151d30 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f3114006010 tx=0x7f3114003970 comp rx=0 tx=0).stop 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 shutdown_connections 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f311c151370 0x7f311c151d30 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f311c0cf640 0x7f311c1517f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f30fc078cb0 0x7f30fc07b170 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 --2- 172.21.15.81:0/1136398588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f311c0b3140 0x7f311c13e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 >> 172.21.15.81:0/1136398588 conn(0x7f311c0b1690 msgr2=0x7f311c144b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 shutdown_connections 2024-09-17T05:23:30.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.487+0000 7f3121110640 1 -- 172.21.15.81:0/1136398588 wait complete. 2024-09-17T05:23:30.499 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:23:30.499 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 -- 172.21.15.81:0/879827630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b0159680 msgr2=0x7f68b015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 --2- 172.21.15.81:0/879827630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b0159680 0x7f68b015d270 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f68a0005fd0 tx=0x7f68a002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 -- 172.21.15.81:0/879827630 shutdown_connections 2024-09-17T05:23:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 --2- 172.21.15.81:0/879827630 >> v2:172.21.15.160:3300/0 conn(0x7f68b00cc490 0x7f68b015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 --2- 172.21.15.81:0/879827630 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b0159680 0x7f68b015d270 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 -- 172.21.15.81:0/879827630 >> 172.21.15.81:0/879827630 conn(0x7f68b00b1690 msgr2=0x7f68b00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 -- 172.21.15.81:0/879827630 shutdown_connections 2024-09-17T05:23:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.601+0000 7f68b4a79640 1 -- 172.21.15.81:0/879827630 wait complete. 2024-09-17T05:23:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.602+0000 7f68b4a79640 1 Processor -- start 2024-09-17T05:23:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.602+0000 7f68b4a79640 1 -- start start 2024-09-17T05:23:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68b4a79640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b00cc490 0x7f68b01f2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68b4a79640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68b00cc8d0 0x7f68b00b08c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68b4a79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0159680 0x7f68b01f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68b4a79640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68b00cf350 con 0x7f68b0159680 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68b4a79640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f68b00cf1d0 con 0x7f68b00cc8d0 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68b4a79640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f68b00cf4d0 con 0x7f68b00cc490 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0159680 0x7f68b01f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0159680 0x7f68b01f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45736/0 (socket says 172.21.15.81:45736) 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 -- 172.21.15.81:0/186051898 learned_addr learned my addr 172.21.15.81:0/186051898 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68add9b640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68b00cc8d0 0x7f68b00b08c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68ae59c640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b00cc490 0x7f68b01f2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 -- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b00cc490 msgr2=0x7f68b01f2dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b00cc490 0x7f68b01f2dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 -- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68b00cc8d0 msgr2=0x7f68b00b08c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68b00cc8d0 0x7f68b00b08c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.603+0000 7f68aed9d640 1 -- 172.21.15.81:0/186051898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68b01f6380 con 0x7f68b0159680 2024-09-17T05:23:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.604+0000 7f68aed9d640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0159680 0x7f68b01f5a10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c7a0 tx=0x7f68a800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.604+0000 7f68a6ffd640 1 -- 172.21.15.81:0/186051898 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a8003b70 con 0x7f68b0159680 2024-09-17T05:23:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.604+0000 7f68a6ffd640 1 -- 172.21.15.81:0/186051898 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68a8003d10 con 0x7f68b0159680 2024-09-17T05:23:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.604+0000 7f68a6ffd640 1 -- 172.21.15.81:0/186051898 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68a800aab0 con 0x7f68b0159680 2024-09-17T05:23:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.604+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68b01f6660 con 0x7f68b0159680 2024-09-17T05:23:30.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.604+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68b01f28a0 con 0x7f68b0159680 2024-09-17T05:23:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.605+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68b01f2aa0 con 0x7f68b0159680 2024-09-17T05:23:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.605+0000 7f68a6ffd640 1 -- 172.21.15.81:0/186051898 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f68a800ac50 con 0x7f68b0159680 2024-09-17T05:23:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.606+0000 7f68a6ffd640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6890078ce0 0x7f689007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.606+0000 7f68a6ffd640 1 -- 172.21.15.81:0/186051898 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f68a809ad60 con 0x7f68b0159680 2024-09-17T05:23:30.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.606+0000 7f68ae59c640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6890078ce0 0x7f689007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.606+0000 7f68ae59c640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6890078ce0 0x7f689007b1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f68a0033000 tx=0x7f68a0004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:30.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.610+0000 7f68a6ffd640 1 -- 172.21.15.81:0/186051898 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f68b01f2aa0 con 0x7f68b0159680 2024-09-17T05:23:30.735 INFO:tasks.ceph.mds.d.smithi160.stderr:2024-09-17T05:23:30.735+0000 7f59e48c4640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:23:30.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.781+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f68b015fe00 con 0x7f6890078ce0 2024-09-17T05:23:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.785+0000 7f68a6ffd640 1 -- 172.21.15.81:0/186051898 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252253 (secure 0 0 0) 0x7f68b015fe00 con 0x7f6890078ce0 2024-09-17T05:23:30.788 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:30.790 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:23:30.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6890078ce0 msgr2=0x7f689007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6890078ce0 0x7f689007b1a0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f68a0033000 tx=0x7f68a0004730 comp rx=0 tx=0).stop 2024-09-17T05:23:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0159680 msgr2=0x7f68b01f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0159680 0x7f68b01f5a10 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f68a800c7a0 tx=0x7f68a800cc60 comp rx=0 tx=0).stop 2024-09-17T05:23:30.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 shutdown_connections 2024-09-17T05:23:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68b0159680 0x7f68b01f5a10 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6890078ce0 0x7f689007b1a0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68b00cc8d0 0x7f68b00b08c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 --2- 172.21.15.81:0/186051898 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68b00cc490 0x7f68b01f2dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 >> 172.21.15.81:0/186051898 conn(0x7f68b00b1690 msgr2=0x7f68b015bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 shutdown_connections 2024-09-17T05:23:30.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.788+0000 7f68b4a79640 1 -- 172.21.15.81:0/186051898 wait complete. 2024-09-17T05:23:30.799 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T05:23:30.031704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260532,"kb_used_data":10984,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714188,"statfs":{"total":773094113280,"available":772827328512,"internally_reserved":0,"allocated":11247616,"data_stored":5537196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.289205"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871068+0000","last_change":"2024-09-17T05:23:27.747540+0000","last_active":"2024-09-17T05:23:28.871068+0000","last_peered":"2024-09-17T05:23:28.871068+0000","last_clean":"2024-09-17T05:23:28.871068+0000","last_became_active":"2024-09-17T05:23:27.746980+0000","last_became_peered":"2024-09-17T05:23:27.746980+0000","last_unstale":"2024-09-17T05:23:28.871068+0000","last_undegraded":"2024-09-17T05:23:28.871068+0000","last_fullsized":"2024-09-17T05:23:28.871068+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.732247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740107+0000","last_change":"2024-09-17T05:23:27.755023+0000","last_active":"2024-09-17T05:23:28.740107+0000","last_peered":"2024-09-17T05:23:28.740107+0000","last_clean":"2024-09-17T05:23:28.740107+0000","last_became_active":"2024-09-17T05:23:27.754740+0000","last_became_peered":"2024-09-17T05:23:27.754740+0000","last_unstale":"2024-09-17T05:23:28.740107+0000","last_undegraded":"2024-09-17T05:23:28.740107+0000","last_fullsized":"2024-09-17T05:23:28.740107+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:14.676019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740570+0000","last_change":"2024-09-17T05:23:27.758739+0000","last_active":"2024-09-17T05:23:28.740570+0000","last_peered":"2024-09-17T05:23:28.740570+0000","last_clean":"2024-09-17T05:23:28.740570+0000","last_became_active":"2024-09-17T05:23:27.758428+0000","last_became_peered":"2024-09-17T05:23:27.758428+0000","last_unstale":"2024-09-17T05:23:28.740570+0000","last_undegraded":"2024-09-17T05:23:28.740570+0000","last_fullsized":"2024-09-17T05:23:28.740570+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:50.576871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871025+0000","last_change":"2024-09-17T05:23:27.756384+0000","last_active":"2024-09-17T05:23:28.871025+0000","last_peered":"2024-09-17T05:23:28.871025+0000","last_clean":"2024-09-17T05:23:28.871025+0000","last_became_active":"2024-09-17T05:23:27.756108+0000","last_became_peered":"2024-09-17T05:23:27.756108+0000","last_unstale":"2024-09-17T05:23:28.871025+0000","last_undegraded":"2024-09-17T05:23:28.871025+0000","last_fullsized":"2024-09-17T05:23:28.871025+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:28.739063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870150+0000","last_change":"2024-09-17T05:23:27.742637+0000","last_active":"2024-09-17T05:23:28.870150+0000","last_peered":"2024-09-17T05:23:28.870150+0000","last_clean":"2024-09-17T05:23:28.870150+0000","last_became_active":"2024-09-17T05:23:27.742336+0000","last_became_peered":"2024-09-17T05:23:27.742336+0000","last_unstale":"2024-09-17T05:23:28.870150+0000","last_undegraded":"2024-09-17T05:23:28.870150+0000","last_fullsized":"2024-09-17T05:23:28.870150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:34.391135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869555+0000","last_change":"2024-09-17T05:23:27.754872+0000","last_active":"2024-09-17T05:23:28.869555+0000","last_peered":"2024-09-17T05:23:28.869555+0000","last_clean":"2024-09-17T05:23:28.869555+0000","last_became_active":"2024-09-17T05:23:27.754622+0000","last_became_peered":"2024-09-17T05:23:27.754622+0000","last_unstale":"2024-09-17T05:23:28.869555+0000","last_undegraded":"2024-09-17T05:23:28.869555+0000","last_fullsized":"2024-09-17T05:23:28.869555+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:50.042732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762714+0000","last_change":"2024-09-17T05:23:27.749490+0000","last_active":"2024-09-17T05:23:28.762714+0000","last_peered":"2024-09-17T05:23:28.762714+0000","last_clean":"2024-09-17T05:23:28.762714+0000","last_became_active":"2024-09-17T05:23:27.748350+0000","last_became_peered":"2024-09-17T05:23:27.748350+0000","last_unstale":"2024-09-17T05:23:28.762714+0000","last_undegraded":"2024-09-17T05:23:28.762714+0000","last_fullsized":"2024-09-17T05:23:28.762714+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:59.662874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739316+0000","last_change":"2024-09-17T05:23:27.753923+0000","last_active":"2024-09-17T05:23:28.739316+0000","last_peered":"2024-09-17T05:23:28.739316+0000","last_clean":"2024-09-17T05:23:28.739316+0000","last_became_active":"2024-09-17T05:23:27.753178+0000","last_became_peered":"2024-09-17T05:23:27.753178+0000","last_unstale":"2024-09-17T05:23:28.739316+0000","last_undegraded":"2024-09-17T05:23:28.739316+0000","last_fullsized":"2024-09-17T05:23:28.739316+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:13.083163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871209+0000","last_change":"2024-09-17T05:23:27.744004+0000","last_active":"2024-09-17T05:23:28.871209+0000","last_peered":"2024-09-17T05:23:28.871209+0000","last_clean":"2024-09-17T05:23:28.871209+0000","last_became_active":"2024-09-17T05:23:27.743621+0000","last_became_peered":"2024-09-17T05:23:27.743621+0000","last_unstale":"2024-09-17T05:23:28.871209+0000","last_undegraded":"2024-09-17T05:23:28.871209+0000","last_fullsized":"2024-09-17T05:23:28.871209+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:16.079026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870897+0000","last_change":"2024-09-17T05:23:27.742154+0000","last_active":"2024-09-17T05:23:28.870897+0000","last_peered":"2024-09-17T05:23:28.870897+0000","last_clean":"2024-09-17T05:23:28.870897+0000","last_became_active":"2024-09-17T05:23:27.741884+0000","last_became_peered":"2024-09-17T05:23:27.741884+0000","last_unstale":"2024-09-17T05:23:28.870897+0000","last_undegraded":"2024-09-17T05:23:28.870897+0000","last_fullsized":"2024-09-17T05:23:28.870897+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:16.874294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739697+0000","last_change":"2024-09-17T05:23:27.741223+0000","last_active":"2024-09-17T05:23:28.739697+0000","last_peered":"2024-09-17T05:23:28.739697+0000","last_clean":"2024-09-17T05:23:28.739697+0000","last_became_active":"2024-09-17T05:23:27.740916+0000","last_became_peered":"2024-09-17T05:23:27.740916+0000","last_unstale":"2024-09-17T05:23:28.739697+0000","last_undegraded":"2024-09-17T05:23:28.739697+0000","last_fullsized":"2024-09-17T05:23:28.739697+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:35.199176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871088+0000","last_change":"2024-09-17T05:23:27.746003+0000","last_active":"2024-09-17T05:23:28.871088+0000","last_peered":"2024-09-17T05:23:28.871088+0000","last_clean":"2024-09-17T05:23:28.871088+0000","last_became_active":"2024-09-17T05:23:27.745525+0000","last_became_peered":"2024-09-17T05:23:27.745525+0000","last_unstale":"2024-09-17T05:23:28.871088+0000","last_undegraded":"2024-09-17T05:23:28.871088+0000","last_fullsized":"2024-09-17T05:23:28.871088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:57.756820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740276+0000","last_change":"2024-09-17T05:23:27.753629+0000","last_active":"2024-09-17T05:23:28.740276+0000","last_peered":"2024-09-17T05:23:28.740276+0000","last_clean":"2024-09-17T05:23:28.740276+0000","last_became_active":"2024-09-17T05:23:27.753264+0000","last_became_peered":"2024-09-17T05:23:27.753264+0000","last_unstale":"2024-09-17T05:23:28.740276+0000","last_undegraded":"2024-09-17T05:23:28.740276+0000","last_fullsized":"2024-09-17T05:23:28.740276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:47.665821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740488+0000","last_change":"2024-09-17T05:23:27.748577+0000","last_active":"2024-09-17T05:23:28.740488+0000","last_peered":"2024-09-17T05:23:28.740488+0000","last_clean":"2024-09-17T05:23:28.740488+0000","last_became_active":"2024-09-17T05:23:27.748296+0000","last_became_peered":"2024-09-17T05:23:27.748296+0000","last_unstale":"2024-09-17T05:23:28.740488+0000","last_undegraded":"2024-09-17T05:23:28.740488+0000","last_fullsized":"2024-09-17T05:23:28.740488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:14.608917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869932+0000","last_change":"2024-09-17T05:23:27.751951+0000","last_active":"2024-09-17T05:23:28.869932+0000","last_peered":"2024-09-17T05:23:28.869932+0000","last_clean":"2024-09-17T05:23:28.869932+0000","last_became_active":"2024-09-17T05:23:27.751670+0000","last_became_peered":"2024-09-17T05:23:27.751670+0000","last_unstale":"2024-09-17T05:23:28.869932+0000","last_undegraded":"2024-09-17T05:23:28.869932+0000","last_fullsized":"2024-09-17T05:23:28.869932+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:33.132181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870318+0000","last_change":"2024-09-17T05:23:27.750236+0000","last_active":"2024-09-17T05:23:28.870318+0000","last_peered":"2024-09-17T05:23:28.870318+0000","last_clean":"2024-09-17T05:23:28.870318+0000","last_became_active":"2024-09-17T05:23:27.749592+0000","last_became_peered":"2024-09-17T05:23:27.749592+0000","last_unstale":"2024-09-17T05:23:28.870318+0000","last_undegraded":"2024-09-17T05:23:28.870318+0000","last_fullsized":"2024-09-17T05:23:28.870318+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:21.953132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739686+0000","last_change":"2024-09-17T05:23:27.747130+0000","last_active":"2024-09-17T05:23:28.739686+0000","last_peered":"2024-09-17T05:23:28.739686+0000","last_clean":"2024-09-17T05:23:28.739686+0000","last_became_active":"2024-09-17T05:23:27.746853+0000","last_became_peered":"2024-09-17T05:23:27.746853+0000","last_unstale":"2024-09-17T05:23:28.739686+0000","last_undegraded":"2024-09-17T05:23:28.739686+0000","last_fullsized":"2024-09-17T05:23:28.739686+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:53.430131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760325+0000","last_change":"2024-09-17T05:23:27.745590+0000","last_active":"2024-09-17T05:23:28.760325+0000","last_peered":"2024-09-17T05:23:28.760325+0000","last_clean":"2024-09-17T05:23:28.760325+0000","last_became_active":"2024-09-17T05:23:27.745336+0000","last_became_peered":"2024-09-17T05:23:27.745336+0000","last_unstale":"2024-09-17T05:23:28.760325+0000","last_undegraded":"2024-09-17T05:23:28.760325+0000","last_fullsized":"2024-09-17T05:23:28.760325+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:56.814526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740914+0000","last_change":"2024-09-17T05:23:27.756274+0000","last_active":"2024-09-17T05:23:28.740914+0000","last_peered":"2024-09-17T05:23:28.740914+0000","last_clean":"2024-09-17T05:23:28.740914+0000","last_became_active":"2024-09-17T05:23:27.755802+0000","last_became_peered":"2024-09-17T05:23:27.755802+0000","last_unstale":"2024-09-17T05:23:28.740914+0000","last_undegraded":"2024-09-17T05:23:28.740914+0000","last_fullsized":"2024-09-17T05:23:28.740914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:03.716356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740229+0000","last_change":"2024-09-17T05:23:27.749562+0000","last_active":"2024-09-17T05:23:28.740229+0000","last_peered":"2024-09-17T05:23:28.740229+0000","last_clean":"2024-09-17T05:23:28.740229+0000","last_became_active":"2024-09-17T05:23:27.749297+0000","last_became_peered":"2024-09-17T05:23:27.749297+0000","last_unstale":"2024-09-17T05:23:28.740229+0000","last_undegraded":"2024-09-17T05:23:28.740229+0000","last_fullsized":"2024-09-17T05:23:28.740229+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:42.272314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740928+0000","last_change":"2024-09-17T05:23:27.744707+0000","last_active":"2024-09-17T05:23:28.740928+0000","last_peered":"2024-09-17T05:23:28.740928+0000","last_clean":"2024-09-17T05:23:28.740928+0000","last_became_active":"2024-09-17T05:23:27.743720+0000","last_became_peered":"2024-09-17T05:23:27.743720+0000","last_unstale":"2024-09-17T05:23:28.740928+0000","last_undegraded":"2024-09-17T05:23:28.740928+0000","last_fullsized":"2024-09-17T05:23:28.740928+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:45.342370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736337+0000","last_change":"2024-09-17T05:23:27.741562+0000","last_active":"2024-09-17T05:23:28.736337+0000","last_peered":"2024-09-17T05:23:28.736337+0000","last_clean":"2024-09-17T05:23:28.736337+0000","last_became_active":"2024-09-17T05:23:27.741297+0000","last_became_peered":"2024-09-17T05:23:27.741297+0000","last_unstale":"2024-09-17T05:23:28.736337+0000","last_undegraded":"2024-09-17T05:23:28.736337+0000","last_fullsized":"2024-09-17T05:23:28.736337+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:17.574504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739300+0000","last_change":"2024-09-17T05:23:27.750328+0000","last_active":"2024-09-17T05:23:28.739300+0000","last_peered":"2024-09-17T05:23:28.739300+0000","last_clean":"2024-09-17T05:23:28.739300+0000","last_became_active":"2024-09-17T05:23:27.750057+0000","last_became_peered":"2024-09-17T05:23:27.750057+0000","last_unstale":"2024-09-17T05:23:28.739300+0000","last_undegraded":"2024-09-17T05:23:28.739300+0000","last_fullsized":"2024-09-17T05:23:28.739300+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:59.752948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736041+0000","last_change":"2024-09-17T05:23:27.754282+0000","last_active":"2024-09-17T05:23:28.736041+0000","last_peered":"2024-09-17T05:23:28.736041+0000","last_clean":"2024-09-17T05:23:28.736041+0000","last_became_active":"2024-09-17T05:23:27.754023+0000","last_became_peered":"2024-09-17T05:23:27.754023+0000","last_unstale":"2024-09-17T05:23:28.736041+0000","last_undegraded":"2024-09-17T05:23:28.736041+0000","last_fullsized":"2024-09-17T05:23:28.736041+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:03.716356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739870+0000","last_change":"2024-09-17T05:23:27.746375+0000","last_active":"2024-09-17T05:23:28.739870+0000","last_peered":"2024-09-17T05:23:28.739870+0000","last_clean":"2024-09-17T05:23:28.739870+0000","last_became_active":"2024-09-17T05:23:27.746110+0000","last_became_peered":"2024-09-17T05:23:27.746110+0000","last_unstale":"2024-09-17T05:23:28.739870+0000","last_undegraded":"2024-09-17T05:23:28.739870+0000","last_fullsized":"2024-09-17T05:23:28.739870+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.300404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870962+0000","last_change":"2024-09-17T05:23:27.747828+0000","last_active":"2024-09-17T05:23:28.870962+0000","last_peered":"2024-09-17T05:23:28.870962+0000","last_clean":"2024-09-17T05:23:28.870962+0000","last_became_active":"2024-09-17T05:23:27.747569+0000","last_became_peered":"2024-09-17T05:23:27.747569+0000","last_unstale":"2024-09-17T05:23:28.870962+0000","last_undegraded":"2024-09-17T05:23:28.870962+0000","last_fullsized":"2024-09-17T05:23:28.870962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:28.121975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869862+0000","last_change":"2024-09-17T05:23:27.752148+0000","last_active":"2024-09-17T05:23:28.869862+0000","last_peered":"2024-09-17T05:23:28.869862+0000","last_clean":"2024-09-17T05:23:28.869862+0000","last_became_active":"2024-09-17T05:23:27.751869+0000","last_became_peered":"2024-09-17T05:23:27.751869+0000","last_unstale":"2024-09-17T05:23:28.869862+0000","last_undegraded":"2024-09-17T05:23:28.869862+0000","last_fullsized":"2024-09-17T05:23:28.869862+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:41.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736412+0000","last_change":"2024-09-17T05:23:27.748943+0000","last_active":"2024-09-17T05:23:28.736412+0000","last_peered":"2024-09-17T05:23:28.736412+0000","last_clean":"2024-09-17T05:23:28.736412+0000","last_became_active":"2024-09-17T05:23:27.748517+0000","last_became_peered":"2024-09-17T05:23:27.748517+0000","last_unstale":"2024-09-17T05:23:28.736412+0000","last_undegraded":"2024-09-17T05:23:28.736412+0000","last_fullsized":"2024-09-17T05:23:28.736412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:30.150234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740207+0000","last_change":"2024-09-17T05:23:27.751158+0000","last_active":"2024-09-17T05:23:28.740207+0000","last_peered":"2024-09-17T05:23:28.740207+0000","last_clean":"2024-09-17T05:23:28.740207+0000","last_became_active":"2024-09-17T05:23:27.750841+0000","last_became_peered":"2024-09-17T05:23:27.750841+0000","last_unstale":"2024-09-17T05:23:28.740207+0000","last_undegraded":"2024-09-17T05:23:28.740207+0000","last_fullsized":"2024-09-17T05:23:28.740207+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:55.409815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762787+0000","last_change":"2024-09-17T05:23:27.750673+0000","last_active":"2024-09-17T05:23:28.762787+0000","last_peered":"2024-09-17T05:23:28.762787+0000","last_clean":"2024-09-17T05:23:28.762787+0000","last_became_active":"2024-09-17T05:23:27.750400+0000","last_became_peered":"2024-09-17T05:23:27.750400+0000","last_unstale":"2024-09-17T05:23:28.762787+0000","last_undegraded":"2024-09-17T05:23:28.762787+0000","last_fullsized":"2024-09-17T05:23:28.762787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:08.365999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870547+0000","last_change":"2024-09-17T05:23:27.748579+0000","last_active":"2024-09-17T05:23:28.870547+0000","last_peered":"2024-09-17T05:23:28.870547+0000","last_clean":"2024-09-17T05:23:28.870547+0000","last_became_active":"2024-09-17T05:23:27.748308+0000","last_became_peered":"2024-09-17T05:23:27.748308+0000","last_unstale":"2024-09-17T05:23:28.870547+0000","last_undegraded":"2024-09-17T05:23:28.870547+0000","last_fullsized":"2024-09-17T05:23:28.870547+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:29.426710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869608+0000","last_change":"2024-09-17T05:23:27.752215+0000","last_active":"2024-09-17T05:23:28.869608+0000","last_peered":"2024-09-17T05:23:28.869608+0000","last_clean":"2024-09-17T05:23:28.869608+0000","last_became_active":"2024-09-17T05:23:27.751831+0000","last_became_peered":"2024-09-17T05:23:27.751831+0000","last_unstale":"2024-09-17T05:23:28.869608+0000","last_undegraded":"2024-09-17T05:23:28.869608+0000","last_fullsized":"2024-09-17T05:23:28.869608+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:15.783172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869793+0000","last_change":"2024-09-17T05:23:27.755513+0000","last_active":"2024-09-17T05:23:28.869793+0000","last_peered":"2024-09-17T05:23:28.869793+0000","last_clean":"2024-09-17T05:23:28.869793+0000","last_became_active":"2024-09-17T05:23:27.755263+0000","last_became_peered":"2024-09-17T05:23:27.755263+0000","last_unstale":"2024-09-17T05:23:28.869793+0000","last_undegraded":"2024-09-17T05:23:28.869793+0000","last_fullsized":"2024-09-17T05:23:28.869793+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:45.468227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"100'4","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762883+0000","last_change":"2024-09-17T05:23:26.758172+0000","last_active":"2024-09-17T05:23:28.762883+0000","last_peered":"2024-09-17T05:23:28.762883+0000","last_clean":"2024-09-17T05:23:28.762883+0000","last_became_active":"2024-09-17T05:23:26.757900+0000","last_became_peered":"2024-09-17T05:23:26.757900+0000","last_unstale":"2024-09-17T05:23:28.762883+0000","last_undegraded":"2024-09-17T05:23:28.762883+0000","last_fullsized":"2024-09-17T05:23:28.762883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:35.317950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760488+0000","last_change":"2024-09-17T05:23:27.750582+0000","last_active":"2024-09-17T05:23:28.760488+0000","last_peered":"2024-09-17T05:23:28.760488+0000","last_clean":"2024-09-17T05:23:28.760488+0000","last_became_active":"2024-09-17T05:23:27.749877+0000","last_became_peered":"2024-09-17T05:23:27.749877+0000","last_unstale":"2024-09-17T05:23:28.760488+0000","last_undegraded":"2024-09-17T05:23:28.760488+0000","last_fullsized":"2024-09-17T05:23:28.760488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:14.608917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739729+0000","last_change":"2024-09-17T05:23:26.763700+0000","last_active":"2024-09-17T05:23:28.739729+0000","last_peered":"2024-09-17T05:23:28.739729+0000","last_clean":"2024-09-17T05:23:28.739729+0000","last_became_active":"2024-09-17T05:23:26.763436+0000","last_became_peered":"2024-09-17T05:23:26.763436+0000","last_unstale":"2024-09-17T05:23:28.739729+0000","last_undegraded":"2024-09-17T05:23:28.739729+0000","last_fullsized":"2024-09-17T05:23:28.739729+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:15.609283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869913+0000","last_change":"2024-09-17T05:23:27.755750+0000","last_active":"2024-09-17T05:23:28.869913+0000","last_peered":"2024-09-17T05:23:28.869913+0000","last_clean":"2024-09-17T05:23:28.869913+0000","last_became_active":"2024-09-17T05:23:27.754286+0000","last_became_peered":"2024-09-17T05:23:27.754286+0000","last_unstale":"2024-09-17T05:23:28.869913+0000","last_undegraded":"2024-09-17T05:23:28.869913+0000","last_fullsized":"2024-09-17T05:23:28.869913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:09.856676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870010+0000","last_change":"2024-09-17T05:23:26.769220+0000","last_active":"2024-09-17T05:23:28.870010+0000","last_peered":"2024-09-17T05:23:28.870010+0000","last_clean":"2024-09-17T05:23:28.870010+0000","last_became_active":"2024-09-17T05:23:26.768972+0000","last_became_peered":"2024-09-17T05:23:26.768972+0000","last_unstale":"2024-09-17T05:23:28.870010+0000","last_undegraded":"2024-09-17T05:23:28.870010+0000","last_fullsized":"2024-09-17T05:23:28.870010+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:18.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.741049+0000","last_change":"2024-09-17T05:23:27.756436+0000","last_active":"2024-09-17T05:23:28.741049+0000","last_peered":"2024-09-17T05:23:28.741049+0000","last_clean":"2024-09-17T05:23:28.741049+0000","last_became_active":"2024-09-17T05:23:27.755837+0000","last_became_peered":"2024-09-17T05:23:27.755837+0000","last_unstale":"2024-09-17T05:23:28.741049+0000","last_undegraded":"2024-09-17T05:23:28.741049+0000","last_fullsized":"2024-09-17T05:23:28.741049+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:53.339086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869940+0000","last_change":"2024-09-17T05:23:26.767942+0000","last_active":"2024-09-17T05:23:28.869940+0000","last_peered":"2024-09-17T05:23:28.869940+0000","last_clean":"2024-09-17T05:23:28.869940+0000","last_became_active":"2024-09-17T05:23:26.767665+0000","last_became_peered":"2024-09-17T05:23:26.767665+0000","last_unstale":"2024-09-17T05:23:28.869940+0000","last_undegraded":"2024-09-17T05:23:28.869940+0000","last_fullsized":"2024-09-17T05:23:28.869940+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:48.380609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870610+0000","last_change":"2024-09-17T05:23:27.743939+0000","last_active":"2024-09-17T05:23:28.870610+0000","last_peered":"2024-09-17T05:23:28.870610+0000","last_clean":"2024-09-17T05:23:28.870610+0000","last_became_active":"2024-09-17T05:23:27.743671+0000","last_became_peered":"2024-09-17T05:23:27.743671+0000","last_unstale":"2024-09-17T05:23:28.870610+0000","last_undegraded":"2024-09-17T05:23:28.870610+0000","last_fullsized":"2024-09-17T05:23:28.870610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:47.453002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762688+0000","last_change":"2024-09-17T05:23:26.766390+0000","last_active":"2024-09-17T05:23:28.762688+0000","last_peered":"2024-09-17T05:23:28.762688+0000","last_clean":"2024-09-17T05:23:28.762688+0000","last_became_active":"2024-09-17T05:23:26.766102+0000","last_became_peered":"2024-09-17T05:23:26.766102+0000","last_unstale":"2024-09-17T05:23:28.762688+0000","last_undegraded":"2024-09-17T05:23:28.762688+0000","last_fullsized":"2024-09-17T05:23:28.762688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:36.872927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740468+0000","last_change":"2024-09-17T05:23:27.752179+0000","last_active":"2024-09-17T05:23:28.740468+0000","last_peered":"2024-09-17T05:23:28.740468+0000","last_clean":"2024-09-17T05:23:28.740468+0000","last_became_active":"2024-09-17T05:23:27.751850+0000","last_became_peered":"2024-09-17T05:23:27.751850+0000","last_unstale":"2024-09-17T05:23:28.740468+0000","last_undegraded":"2024-09-17T05:23:28.740468+0000","last_fullsized":"2024-09-17T05:23:28.740468+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:47.455757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736438+0000","last_change":"2024-09-17T05:23:26.763691+0000","last_active":"2024-09-17T05:23:28.736438+0000","last_peered":"2024-09-17T05:23:28.736438+0000","last_clean":"2024-09-17T05:23:28.736438+0000","last_became_active":"2024-09-17T05:23:26.760828+0000","last_became_peered":"2024-09-17T05:23:26.760828+0000","last_unstale":"2024-09-17T05:23:28.736438+0000","last_undegraded":"2024-09-17T05:23:28.736438+0000","last_fullsized":"2024-09-17T05:23:28.736438+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:44.395183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870325+0000","last_change":"2024-09-17T05:23:27.753337+0000","last_active":"2024-09-17T05:23:28.870325+0000","last_peered":"2024-09-17T05:23:28.870325+0000","last_clean":"2024-09-17T05:23:28.870325+0000","last_became_active":"2024-09-17T05:23:27.751215+0000","last_became_peered":"2024-09-17T05:23:27.751215+0000","last_unstale":"2024-09-17T05:23:28.870325+0000","last_undegraded":"2024-09-17T05:23:28.870325+0000","last_fullsized":"2024-09-17T05:23:28.870325+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.053588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739199+0000","last_change":"2024-09-17T05:23:26.765987+0000","last_active":"2024-09-17T05:23:28.739199+0000","last_peered":"2024-09-17T05:23:28.739199+0000","last_clean":"2024-09-17T05:23:28.739199+0000","last_became_active":"2024-09-17T05:23:26.765664+0000","last_became_peered":"2024-09-17T05:23:26.765664+0000","last_unstale":"2024-09-17T05:23:28.739199+0000","last_undegraded":"2024-09-17T05:23:28.739199+0000","last_fullsized":"2024-09-17T05:23:28.739199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:55.192021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762695+0000","last_change":"2024-09-17T05:23:27.751437+0000","last_active":"2024-09-17T05:23:28.762695+0000","last_peered":"2024-09-17T05:23:28.762695+0000","last_clean":"2024-09-17T05:23:28.762695+0000","last_became_active":"2024-09-17T05:23:27.751181+0000","last_became_peered":"2024-09-17T05:23:27.751181+0000","last_unstale":"2024-09-17T05:23:28.762695+0000","last_undegraded":"2024-09-17T05:23:28.762695+0000","last_fullsized":"2024-09-17T05:23:28.762695+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:23.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870437+0000","last_change":"2024-09-17T05:23:26.757573+0000","last_active":"2024-09-17T05:23:28.870437+0000","last_peered":"2024-09-17T05:23:28.870437+0000","last_clean":"2024-09-17T05:23:28.870437+0000","last_became_active":"2024-09-17T05:23:26.757306+0000","last_became_peered":"2024-09-17T05:23:26.757306+0000","last_unstale":"2024-09-17T05:23:28.870437+0000","last_undegraded":"2024-09-17T05:23:28.870437+0000","last_fullsized":"2024-09-17T05:23:28.870437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:31.385119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762952+0000","last_change":"2024-09-17T05:23:27.750888+0000","last_active":"2024-09-17T05:23:28.762952+0000","last_peered":"2024-09-17T05:23:28.762952+0000","last_clean":"2024-09-17T05:23:28.762952+0000","last_became_active":"2024-09-17T05:23:27.750113+0000","last_became_peered":"2024-09-17T05:23:27.750113+0000","last_unstale":"2024-09-17T05:23:28.762952+0000","last_undegraded":"2024-09-17T05:23:28.762952+0000","last_fullsized":"2024-09-17T05:23:28.762952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:27.206292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869959+0000","last_change":"2024-09-17T05:23:26.767760+0000","last_active":"2024-09-17T05:23:28.869959+0000","last_peered":"2024-09-17T05:23:28.869959+0000","last_clean":"2024-09-17T05:23:28.869959+0000","last_became_active":"2024-09-17T05:23:26.767477+0000","last_became_peered":"2024-09-17T05:23:26.767477+0000","last_unstale":"2024-09-17T05:23:28.869959+0000","last_undegraded":"2024-09-17T05:23:28.869959+0000","last_fullsized":"2024-09-17T05:23:28.869959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:10.643587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760465+0000","last_change":"2024-09-17T05:23:27.743278+0000","last_active":"2024-09-17T05:23:28.760465+0000","last_peered":"2024-09-17T05:23:28.760465+0000","last_clean":"2024-09-17T05:23:28.760465+0000","last_became_active":"2024-09-17T05:23:27.743032+0000","last_became_peered":"2024-09-17T05:23:27.743032+0000","last_unstale":"2024-09-17T05:23:28.760465+0000","last_undegraded":"2024-09-17T05:23:28.760465+0000","last_fullsized":"2024-09-17T05:23:28.760465+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:47.665821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736287+0000","last_change":"2024-09-17T05:23:26.762615+0000","last_active":"2024-09-17T05:23:28.736287+0000","last_peered":"2024-09-17T05:23:28.736287+0000","last_clean":"2024-09-17T05:23:28.736287+0000","last_became_active":"2024-09-17T05:23:26.762361+0000","last_became_peered":"2024-09-17T05:23:26.762361+0000","last_unstale":"2024-09-17T05:23:28.736287+0000","last_undegraded":"2024-09-17T05:23:28.736287+0000","last_fullsized":"2024-09-17T05:23:28.736287+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:49.505507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736485+0000","last_change":"2024-09-17T05:23:27.754964+0000","last_active":"2024-09-17T05:23:28.736485+0000","last_peered":"2024-09-17T05:23:28.736485+0000","last_clean":"2024-09-17T05:23:28.736485+0000","last_became_active":"2024-09-17T05:23:27.754376+0000","last_became_peered":"2024-09-17T05:23:27.754376+0000","last_unstale":"2024-09-17T05:23:28.736485+0000","last_undegraded":"2024-09-17T05:23:28.736485+0000","last_fullsized":"2024-09-17T05:23:28.736485+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:18.265019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"100'3","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870995+0000","last_change":"2024-09-17T05:23:26.766161+0000","last_active":"2024-09-17T05:23:28.870995+0000","last_peered":"2024-09-17T05:23:28.870995+0000","last_clean":"2024-09-17T05:23:28.870995+0000","last_became_active":"2024-09-17T05:23:26.765888+0000","last_became_peered":"2024-09-17T05:23:26.765888+0000","last_unstale":"2024-09-17T05:23:28.870995+0000","last_undegraded":"2024-09-17T05:23:28.870995+0000","last_fullsized":"2024-09-17T05:23:28.870995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:47.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762977+0000","last_change":"2024-09-17T05:23:27.757436+0000","last_active":"2024-09-17T05:23:28.762977+0000","last_peered":"2024-09-17T05:23:28.762977+0000","last_clean":"2024-09-17T05:23:28.762977+0000","last_became_active":"2024-09-17T05:23:27.757169+0000","last_became_peered":"2024-09-17T05:23:27.757169+0000","last_unstale":"2024-09-17T05:23:28.762977+0000","last_undegraded":"2024-09-17T05:23:28.762977+0000","last_fullsized":"2024-09-17T05:23:28.762977+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:44.659150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"100'6","reported_seq":21,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871193+0000","last_change":"2024-09-17T05:23:26.765277+0000","last_active":"2024-09-17T05:23:28.871193+0000","last_peered":"2024-09-17T05:23:28.871193+0000","last_clean":"2024-09-17T05:23:28.871193+0000","last_became_active":"2024-09-17T05:23:26.765007+0000","last_became_peered":"2024-09-17T05:23:26.765007+0000","last_unstale":"2024-09-17T05:23:28.871193+0000","last_undegraded":"2024-09-17T05:23:28.871193+0000","last_fullsized":"2024-09-17T05:23:28.871193+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:36.086349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736447+0000","last_change":"2024-09-17T05:23:27.747487+0000","last_active":"2024-09-17T05:23:28.736447+0000","last_peered":"2024-09-17T05:23:28.736447+0000","last_clean":"2024-09-17T05:23:28.736447+0000","last_became_active":"2024-09-17T05:23:27.747209+0000","last_became_peered":"2024-09-17T05:23:27.747209+0000","last_unstale":"2024-09-17T05:23:28.736447+0000","last_undegraded":"2024-09-17T05:23:28.736447+0000","last_fullsized":"2024-09-17T05:23:28.736447+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:46.694118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869728+0000","last_change":"2024-09-17T05:23:26.766494+0000","last_active":"2024-09-17T05:23:28.869728+0000","last_peered":"2024-09-17T05:23:28.869728+0000","last_clean":"2024-09-17T05:23:28.869728+0000","last_became_active":"2024-09-17T05:23:26.766186+0000","last_became_peered":"2024-09-17T05:23:26.766186+0000","last_unstale":"2024-09-17T05:23:28.869728+0000","last_undegraded":"2024-09-17T05:23:28.869728+0000","last_fullsized":"2024-09-17T05:23:28.869728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:53.826110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736437+0000","last_change":"2024-09-17T05:23:27.753620+0000","last_active":"2024-09-17T05:23:28.736437+0000","last_peered":"2024-09-17T05:23:28.736437+0000","last_clean":"2024-09-17T05:23:28.736437+0000","last_became_active":"2024-09-17T05:23:27.753360+0000","last_became_peered":"2024-09-17T05:23:27.753360+0000","last_unstale":"2024-09-17T05:23:28.736437+0000","last_undegraded":"2024-09-17T05:23:28.736437+0000","last_fullsized":"2024-09-17T05:23:28.736437+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:09.983870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760188+0000","last_change":"2024-09-17T05:23:26.758107+0000","last_active":"2024-09-17T05:23:28.760188+0000","last_peered":"2024-09-17T05:23:28.760188+0000","last_clean":"2024-09-17T05:23:28.760188+0000","last_became_active":"2024-09-17T05:23:26.757839+0000","last_became_peered":"2024-09-17T05:23:26.757839+0000","last_unstale":"2024-09-17T05:23:28.760188+0000","last_undegraded":"2024-09-17T05:23:28.760188+0000","last_fullsized":"2024-09-17T05:23:28.760188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:47.180458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736288+0000","last_change":"2024-09-17T05:23:27.748078+0000","last_active":"2024-09-17T05:23:28.736288+0000","last_peered":"2024-09-17T05:23:28.736288+0000","last_clean":"2024-09-17T05:23:28.736288+0000","last_became_active":"2024-09-17T05:23:27.747776+0000","last_became_peered":"2024-09-17T05:23:27.747776+0000","last_unstale":"2024-09-17T05:23:28.736288+0000","last_undegraded":"2024-09-17T05:23:28.736288+0000","last_fullsized":"2024-09-17T05:23:28.736288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:53.339086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"100'8","reported_seq":23,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869437+0000","last_change":"2024-09-17T05:23:26.768157+0000","last_active":"2024-09-17T05:23:28.869437+0000","last_peered":"2024-09-17T05:23:28.869437+0000","last_clean":"2024-09-17T05:23:28.869437+0000","last_became_active":"2024-09-17T05:23:26.767890+0000","last_became_peered":"2024-09-17T05:23:26.767890+0000","last_unstale":"2024-09-17T05:23:28.869437+0000","last_undegraded":"2024-09-17T05:23:28.869437+0000","last_fullsized":"2024-09-17T05:23:28.869437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:26.736145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870390+0000","last_change":"2024-09-17T05:23:27.742471+0000","last_active":"2024-09-17T05:23:28.870390+0000","last_peered":"2024-09-17T05:23:28.870390+0000","last_clean":"2024-09-17T05:23:28.870390+0000","last_became_active":"2024-09-17T05:23:27.742172+0000","last_became_peered":"2024-09-17T05:23:27.742172+0000","last_unstale":"2024-09-17T05:23:28.870390+0000","last_undegraded":"2024-09-17T05:23:28.870390+0000","last_fullsized":"2024-09-17T05:23:28.870390+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:53.141311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871306+0000","last_change":"2024-09-17T05:23:26.758601+0000","last_active":"2024-09-17T05:23:28.871306+0000","last_peered":"2024-09-17T05:23:28.871306+0000","last_clean":"2024-09-17T05:23:28.871306+0000","last_became_active":"2024-09-17T05:23:26.758352+0000","last_became_peered":"2024-09-17T05:23:26.758352+0000","last_unstale":"2024-09-17T05:23:28.871306+0000","last_undegraded":"2024-09-17T05:23:28.871306+0000","last_fullsized":"2024-09-17T05:23:28.871306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:40.374304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869913+0000","last_change":"2024-09-17T05:23:27.756606+0000","last_active":"2024-09-17T05:23:28.869913+0000","last_peered":"2024-09-17T05:23:28.869913+0000","last_clean":"2024-09-17T05:23:28.869913+0000","last_became_active":"2024-09-17T05:23:27.756328+0000","last_became_peered":"2024-09-17T05:23:27.756328+0000","last_unstale":"2024-09-17T05:23:28.869913+0000","last_undegraded":"2024-09-17T05:23:28.869913+0000","last_fullsized":"2024-09-17T05:23:28.869913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:07.086933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870220+0000","last_change":"2024-09-17T05:23:26.769826+0000","last_active":"2024-09-17T05:23:28.870220+0000","last_peered":"2024-09-17T05:23:28.870220+0000","last_clean":"2024-09-17T05:23:28.870220+0000","last_became_active":"2024-09-17T05:23:26.769582+0000","last_became_peered":"2024-09-17T05:23:26.769582+0000","last_unstale":"2024-09-17T05:23:28.870220+0000","last_undegraded":"2024-09-17T05:23:28.870220+0000","last_fullsized":"2024-09-17T05:23:28.870220+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:12.415903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739600+0000","last_change":"2024-09-17T05:23:27.754032+0000","last_active":"2024-09-17T05:23:28.739600+0000","last_peered":"2024-09-17T05:23:28.739600+0000","last_clean":"2024-09-17T05:23:28.739600+0000","last_became_active":"2024-09-17T05:23:27.753739+0000","last_became_peered":"2024-09-17T05:23:27.753739+0000","last_unstale":"2024-09-17T05:23:28.739600+0000","last_undegraded":"2024-09-17T05:23:28.739600+0000","last_fullsized":"2024-09-17T05:23:28.739600+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:41.427556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760251+0000","last_change":"2024-09-17T05:23:26.757286+0000","last_active":"2024-09-17T05:23:28.760251+0000","last_peered":"2024-09-17T05:23:28.760251+0000","last_clean":"2024-09-17T05:23:28.760251+0000","last_became_active":"2024-09-17T05:23:26.757000+0000","last_became_peered":"2024-09-17T05:23:26.757000+0000","last_unstale":"2024-09-17T05:23:28.760251+0000","last_undegraded":"2024-09-17T05:23:28.760251+0000","last_fullsized":"2024-09-17T05:23:28.760251+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:31.619765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.741122+0000","last_change":"2024-09-17T05:23:27.756488+0000","last_active":"2024-09-17T05:23:28.741122+0000","last_peered":"2024-09-17T05:23:28.741122+0000","last_clean":"2024-09-17T05:23:28.741122+0000","last_became_active":"2024-09-17T05:23:27.756152+0000","last_became_peered":"2024-09-17T05:23:27.756152+0000","last_unstale":"2024-09-17T05:23:28.741122+0000","last_undegraded":"2024-09-17T05:23:28.741122+0000","last_fullsized":"2024-09-17T05:23:28.741122+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.268681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762740+0000","last_change":"2024-09-17T05:23:26.758654+0000","last_active":"2024-09-17T05:23:28.762740+0000","last_peered":"2024-09-17T05:23:28.762740+0000","last_clean":"2024-09-17T05:23:28.762740+0000","last_became_active":"2024-09-17T05:23:26.758374+0000","last_became_peered":"2024-09-17T05:23:26.758374+0000","last_unstale":"2024-09-17T05:23:28.762740+0000","last_undegraded":"2024-09-17T05:23:28.762740+0000","last_fullsized":"2024-09-17T05:23:28.762740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:16.252064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740715+0000","last_change":"2024-09-17T05:23:27.757821+0000","last_active":"2024-09-17T05:23:28.740715+0000","last_peered":"2024-09-17T05:23:28.740715+0000","last_clean":"2024-09-17T05:23:28.740715+0000","last_became_active":"2024-09-17T05:23:27.757205+0000","last_became_peered":"2024-09-17T05:23:27.757205+0000","last_unstale":"2024-09-17T05:23:28.740715+0000","last_undegraded":"2024-09-17T05:23:28.740715+0000","last_fullsized":"2024-09-17T05:23:28.740715+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:41.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869756+0000","last_change":"2024-09-17T05:23:26.770147+0000","last_active":"2024-09-17T05:23:28.869756+0000","last_peered":"2024-09-17T05:23:28.869756+0000","last_clean":"2024-09-17T05:23:28.869756+0000","last_became_active":"2024-09-17T05:23:26.769850+0000","last_became_peered":"2024-09-17T05:23:26.769850+0000","last_unstale":"2024-09-17T05:23:28.869756+0000","last_undegraded":"2024-09-17T05:23:28.869756+0000","last_fullsized":"2024-09-17T05:23:28.869756+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:59.818409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870822+0000","last_change":"2024-09-17T05:23:27.750556+0000","last_active":"2024-09-17T05:23:28.870822+0000","last_peered":"2024-09-17T05:23:28.870822+0000","last_clean":"2024-09-17T05:23:28.870822+0000","last_became_active":"2024-09-17T05:23:27.749568+0000","last_became_peered":"2024-09-17T05:23:27.749568+0000","last_unstale":"2024-09-17T05:23:28.870822+0000","last_undegraded":"2024-09-17T05:23:28.870822+0000","last_fullsized":"2024-09-17T05:23:28.870822+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:31.329521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869564+0000","last_change":"2024-09-17T05:23:26.770589+0000","last_active":"2024-09-17T05:23:28.869564+0000","last_peered":"2024-09-17T05:23:28.869564+0000","last_clean":"2024-09-17T05:23:28.869564+0000","last_became_active":"2024-09-17T05:23:26.770158+0000","last_became_peered":"2024-09-17T05:23:26.770158+0000","last_unstale":"2024-09-17T05:23:28.869564+0000","last_undegraded":"2024-09-17T05:23:28.869564+0000","last_fullsized":"2024-09-17T05:23:28.869564+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:24.722662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739533+0000","last_change":"2024-09-17T05:23:27.754882+0000","last_active":"2024-09-17T05:23:28.739533+0000","last_peered":"2024-09-17T05:23:28.739533+0000","last_clean":"2024-09-17T05:23:28.739533+0000","last_became_active":"2024-09-17T05:23:27.754629+0000","last_became_peered":"2024-09-17T05:23:27.754629+0000","last_unstale":"2024-09-17T05:23:28.739533+0000","last_undegraded":"2024-09-17T05:23:28.739533+0000","last_fullsized":"2024-09-17T05:23:28.739533+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:56.814526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870028+0000","last_change":"2024-09-17T05:23:26.767306+0000","last_active":"2024-09-17T05:23:28.870028+0000","last_peered":"2024-09-17T05:23:28.870028+0000","last_clean":"2024-09-17T05:23:28.870028+0000","last_became_active":"2024-09-17T05:23:26.766883+0000","last_became_peered":"2024-09-17T05:23:26.766883+0000","last_unstale":"2024-09-17T05:23:28.870028+0000","last_undegraded":"2024-09-17T05:23:28.870028+0000","last_fullsized":"2024-09-17T05:23:28.870028+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:14.845054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736256+0000","last_change":"2024-09-17T05:23:27.744087+0000","last_active":"2024-09-17T05:23:28.736256+0000","last_peered":"2024-09-17T05:23:28.736256+0000","last_clean":"2024-09-17T05:23:28.736256+0000","last_became_active":"2024-09-17T05:23:27.743818+0000","last_became_peered":"2024-09-17T05:23:27.743818+0000","last_unstale":"2024-09-17T05:23:28.736256+0000","last_undegraded":"2024-09-17T05:23:28.736256+0000","last_fullsized":"2024-09-17T05:23:28.736256+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:04.001117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870441+0000","last_change":"2024-09-17T05:23:26.763029+0000","last_active":"2024-09-17T05:23:28.870441+0000","last_peered":"2024-09-17T05:23:28.870441+0000","last_clean":"2024-09-17T05:23:28.870441+0000","last_became_active":"2024-09-17T05:23:26.762417+0000","last_became_peered":"2024-09-17T05:23:26.762417+0000","last_unstale":"2024-09-17T05:23:28.870441+0000","last_undegraded":"2024-09-17T05:23:28.870441+0000","last_fullsized":"2024-09-17T05:23:28.870441+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:56.411904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760336+0000","last_change":"2024-09-17T05:23:27.744578+0000","last_active":"2024-09-17T05:23:28.760336+0000","last_peered":"2024-09-17T05:23:28.760336+0000","last_clean":"2024-09-17T05:23:28.760336+0000","last_became_active":"2024-09-17T05:23:27.744293+0000","last_became_peered":"2024-09-17T05:23:27.744293+0000","last_unstale":"2024-09-17T05:23:28.760336+0000","last_undegraded":"2024-09-17T05:23:28.760336+0000","last_fullsized":"2024-09-17T05:23:28.760336+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:41.427556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736397+0000","last_change":"2024-09-17T05:23:26.758654+0000","last_active":"2024-09-17T05:23:28.736397+0000","last_peered":"2024-09-17T05:23:28.736397+0000","last_clean":"2024-09-17T05:23:28.736397+0000","last_became_active":"2024-09-17T05:23:26.758402+0000","last_became_peered":"2024-09-17T05:23:26.758402+0000","last_unstale":"2024-09-17T05:23:28.736397+0000","last_undegraded":"2024-09-17T05:23:28.736397+0000","last_fullsized":"2024-09-17T05:23:28.736397+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:01.923889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871282+0000","last_change":"2024-09-17T05:23:27.744731+0000","last_active":"2024-09-17T05:23:28.871282+0000","last_peered":"2024-09-17T05:23:28.871282+0000","last_clean":"2024-09-17T05:23:28.871282+0000","last_became_active":"2024-09-17T05:23:27.744547+0000","last_became_peered":"2024-09-17T05:23:27.744547+0000","last_unstale":"2024-09-17T05:23:28.871282+0000","last_undegraded":"2024-09-17T05:23:28.871282+0000","last_fullsized":"2024-09-17T05:23:28.871282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:47.944944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"101'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762023+0000","last_change":"2024-09-17T05:23:26.758626+0000","last_active":"2024-09-17T05:23:28.762023+0000","last_peered":"2024-09-17T05:23:28.762023+0000","last_clean":"2024-09-17T05:23:28.762023+0000","last_became_active":"2024-09-17T05:23:26.758354+0000","last_became_peered":"2024-09-17T05:23:26.758354+0000","last_unstale":"2024-09-17T05:23:28.762023+0000","last_undegraded":"2024-09-17T05:23:28.762023+0000","last_fullsized":"2024-09-17T05:23:28.762023+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:16.164496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871231+0000","last_change":"2024-09-17T05:23:27.752475+0000","last_active":"2024-09-17T05:23:28.871231+0000","last_peered":"2024-09-17T05:23:28.871231+0000","last_clean":"2024-09-17T05:23:28.871231+0000","last_became_active":"2024-09-17T05:23:27.751067+0000","last_became_peered":"2024-09-17T05:23:27.751067+0000","last_unstale":"2024-09-17T05:23:28.871231+0000","last_undegraded":"2024-09-17T05:23:28.871231+0000","last_fullsized":"2024-09-17T05:23:28.871231+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:33.882556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870896+0000","last_change":"2024-09-17T05:23:26.762893+0000","last_active":"2024-09-17T05:23:28.870896+0000","last_peered":"2024-09-17T05:23:28.870896+0000","last_clean":"2024-09-17T05:23:28.870896+0000","last_became_active":"2024-09-17T05:23:26.762636+0000","last_became_peered":"2024-09-17T05:23:26.762636+0000","last_unstale":"2024-09-17T05:23:28.870896+0000","last_undegraded":"2024-09-17T05:23:28.870896+0000","last_fullsized":"2024-09-17T05:23:28.870896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:44.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760359+0000","last_change":"2024-09-17T05:23:27.744951+0000","last_active":"2024-09-17T05:23:28.760359+0000","last_peered":"2024-09-17T05:23:28.760359+0000","last_clean":"2024-09-17T05:23:28.760359+0000","last_became_active":"2024-09-17T05:23:27.743953+0000","last_became_peered":"2024-09-17T05:23:27.743953+0000","last_unstale":"2024-09-17T05:23:28.760359+0000","last_undegraded":"2024-09-17T05:23:28.760359+0000","last_fullsized":"2024-09-17T05:23:28.760359+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:22.885736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736552+0000","last_change":"2024-09-17T05:23:26.765100+0000","last_active":"2024-09-17T05:23:28.736552+0000","last_peered":"2024-09-17T05:23:28.736552+0000","last_clean":"2024-09-17T05:23:28.736552+0000","last_became_active":"2024-09-17T05:23:26.764829+0000","last_became_peered":"2024-09-17T05:23:26.764829+0000","last_unstale":"2024-09-17T05:23:28.736552+0000","last_undegraded":"2024-09-17T05:23:28.736552+0000","last_fullsized":"2024-09-17T05:23:28.736552+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:16.164496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739322+0000","last_change":"2024-09-17T05:23:27.751147+0000","last_active":"2024-09-17T05:23:28.739322+0000","last_peered":"2024-09-17T05:23:28.739322+0000","last_clean":"2024-09-17T05:23:28.739322+0000","last_became_active":"2024-09-17T05:23:27.750867+0000","last_became_peered":"2024-09-17T05:23:27.750867+0000","last_unstale":"2024-09-17T05:23:28.739322+0000","last_undegraded":"2024-09-17T05:23:28.739322+0000","last_fullsized":"2024-09-17T05:23:28.739322+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:58.310866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762675+0000","last_change":"2024-09-17T05:23:26.761582+0000","last_active":"2024-09-17T05:23:28.762675+0000","last_peered":"2024-09-17T05:23:28.762675+0000","last_clean":"2024-09-17T05:23:28.762675+0000","last_became_active":"2024-09-17T05:23:26.761267+0000","last_became_peered":"2024-09-17T05:23:26.761267+0000","last_unstale":"2024-09-17T05:23:28.762675+0000","last_undegraded":"2024-09-17T05:23:28.762675+0000","last_fullsized":"2024-09-17T05:23:28.762675+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:22.797993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740688+0000","last_change":"2024-09-17T05:23:27.745184+0000","last_active":"2024-09-17T05:23:28.740688+0000","last_peered":"2024-09-17T05:23:28.740688+0000","last_clean":"2024-09-17T05:23:28.740688+0000","last_became_active":"2024-09-17T05:23:27.744863+0000","last_became_peered":"2024-09-17T05:23:27.744863+0000","last_unstale":"2024-09-17T05:23:28.740688+0000","last_undegraded":"2024-09-17T05:23:28.740688+0000","last_fullsized":"2024-09-17T05:23:28.740688+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:14.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739419+0000","last_change":"2024-09-17T05:23:26.766715+0000","last_active":"2024-09-17T05:23:28.739419+0000","last_peered":"2024-09-17T05:23:28.739419+0000","last_clean":"2024-09-17T05:23:28.739419+0000","last_became_active":"2024-09-17T05:23:26.766464+0000","last_became_peered":"2024-09-17T05:23:26.766464+0000","last_unstale":"2024-09-17T05:23:28.739419+0000","last_undegraded":"2024-09-17T05:23:28.739419+0000","last_fullsized":"2024-09-17T05:23:28.739419+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:08.853126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739741+0000","last_change":"2024-09-17T05:23:27.754210+0000","last_active":"2024-09-17T05:23:28.739741+0000","last_peered":"2024-09-17T05:23:28.739741+0000","last_clean":"2024-09-17T05:23:28.739741+0000","last_became_active":"2024-09-17T05:23:27.753512+0000","last_became_peered":"2024-09-17T05:23:27.753512+0000","last_unstale":"2024-09-17T05:23:28.739741+0000","last_undegraded":"2024-09-17T05:23:28.739741+0000","last_fullsized":"2024-09-17T05:23:28.739741+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:22.885736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869457+0000","last_change":"2024-09-17T05:23:26.768574+0000","last_active":"2024-09-17T05:23:28.869457+0000","last_peered":"2024-09-17T05:23:28.869457+0000","last_clean":"2024-09-17T05:23:28.869457+0000","last_became_active":"2024-09-17T05:23:26.768206+0000","last_became_peered":"2024-09-17T05:23:26.768206+0000","last_unstale":"2024-09-17T05:23:28.869457+0000","last_undegraded":"2024-09-17T05:23:28.869457+0000","last_fullsized":"2024-09-17T05:23:28.869457+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:44.653791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870736+0000","last_change":"2024-09-17T05:23:27.751908+0000","last_active":"2024-09-17T05:23:28.870736+0000","last_peered":"2024-09-17T05:23:28.870736+0000","last_clean":"2024-09-17T05:23:28.870736+0000","last_became_active":"2024-09-17T05:23:27.751618+0000","last_became_peered":"2024-09-17T05:23:27.751618+0000","last_unstale":"2024-09-17T05:23:28.870736+0000","last_undegraded":"2024-09-17T05:23:28.870736+0000","last_fullsized":"2024-09-17T05:23:28.870736+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:29.137103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870531+0000","last_change":"2024-09-17T05:23:26.763308+0000","last_active":"2024-09-17T05:23:28.870531+0000","last_peered":"2024-09-17T05:23:28.870531+0000","last_clean":"2024-09-17T05:23:28.870531+0000","last_became_active":"2024-09-17T05:23:26.762756+0000","last_became_peered":"2024-09-17T05:23:26.762756+0000","last_unstale":"2024-09-17T05:23:28.870531+0000","last_undegraded":"2024-09-17T05:23:28.870531+0000","last_fullsized":"2024-09-17T05:23:28.870531+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736103+0000","last_change":"2024-09-17T05:23:27.750458+0000","last_active":"2024-09-17T05:23:28.736103+0000","last_peered":"2024-09-17T05:23:28.736103+0000","last_clean":"2024-09-17T05:23:28.736103+0000","last_became_active":"2024-09-17T05:23:27.750180+0000","last_became_peered":"2024-09-17T05:23:27.750180+0000","last_unstale":"2024-09-17T05:23:28.736103+0000","last_undegraded":"2024-09-17T05:23:28.736103+0000","last_fullsized":"2024-09-17T05:23:28.736103+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:45.342370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762841+0000","last_change":"2024-09-17T05:23:26.759054+0000","last_active":"2024-09-17T05:23:28.762841+0000","last_peered":"2024-09-17T05:23:28.762841+0000","last_clean":"2024-09-17T05:23:28.762841+0000","last_became_active":"2024-09-17T05:23:26.758709+0000","last_became_peered":"2024-09-17T05:23:26.758709+0000","last_unstale":"2024-09-17T05:23:28.762841+0000","last_undegraded":"2024-09-17T05:23:28.762841+0000","last_fullsized":"2024-09-17T05:23:28.762841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:35.892119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":277,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739890+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:23:28.739890+0000","last_peered":"2024-09-17T05:23:28.739890+0000","last_clean":"2024-09-17T05:23:28.739890+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:23:28.739890+0000","last_undegraded":"2024-09-17T05:23:28.739890+0000","last_fullsized":"2024-09-17T05:23:28.739890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1851392,"data_stored":1134939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1253376,"data_stored":544025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509502,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1257472,"data_stored":544559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1249280,"data_stored":543955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1265664,"data_stored":545637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1249280,"data_stored":543955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":544079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1863680,"data_stored":1136047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:30.804 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:23:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.941+0000 7f1e643d3640 1 -- 172.21.15.81:0/645064102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e48004040 msgr2=0x7f1e48004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.941+0000 7f1e643d3640 1 --2- 172.21.15.81:0/645064102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e48004040 0x7f1e48004800 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c2e0 tx=0x7f1e48005830 comp rx=0 tx=0).stop 2024-09-17T05:23:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.941+0000 7f1e62970640 1 -- 172.21.15.81:0/645064102 reap_dead start 2024-09-17T05:23:30.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.941+0000 7f1e643d3640 1 -- 172.21.15.81:0/645064102 shutdown_connections 2024-09-17T05:23:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.941+0000 7f1e643d3640 1 -- 172.21.15.81:0/645064102 >> 172.21.15.81:0/645064102 conn(0x7f1e5c0b1690 msgr2=0x7f1e5c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.941+0000 7f1e643d3640 1 -- 172.21.15.81:0/645064102 shutdown_connections 2024-09-17T05:23:30.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.941+0000 7f1e643d3640 1 -- 172.21.15.81:0/645064102 wait complete. 2024-09-17T05:23:30.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 Processor -- start 2024-09-17T05:23:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 -- start start 2024-09-17T05:23:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e48004040 0x7f1e5c15c880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e5c1535a0 0x7f1e5c1f34e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e5c1f3a20 0x7f1e5c150fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c0ccee0 con 0x7f1e5c1535a0 2024-09-17T05:23:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1e5c073c30 con 0x7f1e5c1f3a20 2024-09-17T05:23:30.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e643d3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1e5c0cd060 con 0x7f1e48004040 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e6196e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e5c1535a0 0x7f1e5c1f34e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e6196e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e5c1535a0 0x7f1e5c1f34e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45754/0 (socket says 172.21.15.81:45754) 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.943+0000 7f1e6196e640 1 -- 172.21.15.81:0/202997006 learned_addr learned my addr 172.21.15.81:0/202997006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e62970640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e5c1f3a20 0x7f1e5c150fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e6216f640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e48004040 0x7f1e5c15c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e6196e640 1 -- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e48004040 msgr2=0x7f1e5c15c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e6196e640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e48004040 0x7f1e5c15c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e6196e640 1 -- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e5c1f3a20 msgr2=0x7f1e5c150fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e6196e640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e5c1f3a20 0x7f1e5c150fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e6196e640 1 -- 172.21.15.81:0/202997006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e5c151d40 con 0x7f1e5c1535a0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e6196e640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e5c1535a0 0x7f1e5c1f34e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c400 tx=0x7f1e4c006c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e52ffd640 1 -- 172.21.15.81:0/202997006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c031040 con 0x7f1e5c1535a0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e52ffd640 1 -- 172.21.15.81:0/202997006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e4c003610 con 0x7f1e5c1535a0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e5c1527e0 con 0x7f1e5c1535a0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e52ffd640 1 -- 172.21.15.81:0/202997006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e4c003a80 con 0x7f1e5c1535a0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.944+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e5c152da0 con 0x7f1e5c1535a0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.945+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e5c1f3e30 con 0x7f1e5c1535a0 2024-09-17T05:23:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.946+0000 7f1e52ffd640 1 -- 172.21.15.81:0/202997006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f1e4c034070 con 0x7f1e5c1535a0 2024-09-17T05:23:30.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.946+0000 7f1e52ffd640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e40078ce0 0x7f1e4007b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:30.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.946+0000 7f1e6216f640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e40078ce0 0x7f1e4007b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:30.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.946+0000 7f1e52ffd640 1 -- 172.21.15.81:0/202997006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f1e4c0bb280 con 0x7f1e5c1535a0 2024-09-17T05:23:30.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.947+0000 7f1e6216f640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e40078ce0 0x7f1e4007b1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1e58003940 tx=0x7f1e58006b70 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:30.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:30.950+0000 7f1e52ffd640 1 -- 172.21.15.81:0/202997006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1e5c1f3e30 con 0x7f1e5c1535a0 2024-09-17T05:23:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.124+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1e5c06fef0 con 0x7f1e40078ce0 2024-09-17T05:23:31.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.128+0000 7f1e52ffd640 1 -- 172.21.15.81:0/202997006 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252253 (secure 0 0 0) 0x7f1e5c06fef0 con 0x7f1e40078ce0 2024-09-17T05:23:31.130 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:31.132 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:23:31.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e40078ce0 msgr2=0x7f1e4007b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e40078ce0 0x7f1e4007b1a0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f1e58003940 tx=0x7f1e58006b70 comp rx=0 tx=0).stop 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e5c1535a0 msgr2=0x7f1e5c1f34e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e5c1535a0 0x7f1e5c1f34e0 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f1e4c00c400 tx=0x7f1e4c006c90 comp rx=0 tx=0).stop 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 shutdown_connections 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e40078ce0 0x7f1e4007b1a0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e5c1f3a20 0x7f1e5c150fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e5c1535a0 0x7f1e5c1f34e0 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 --2- 172.21.15.81:0/202997006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e48004040 0x7f1e5c15c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 >> 172.21.15.81:0/202997006 conn(0x7f1e5c0b1690 msgr2=0x7f1e5c15a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 shutdown_connections 2024-09-17T05:23:31.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.131+0000 7f1e643d3640 1 -- 172.21.15.81:0/202997006 wait complete. 2024-09-17T05:23:31.142 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":56,"stamp":"2024-09-17T05:23:30.031704+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":184,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":260532,"kb_used_data":10984,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754714188,"statfs":{"total":773094113280,"available":772827328512,"internally_reserved":0,"allocated":11247616,"data_stored":5537196,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.289205"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871068+0000","last_change":"2024-09-17T05:23:27.747540+0000","last_active":"2024-09-17T05:23:28.871068+0000","last_peered":"2024-09-17T05:23:28.871068+0000","last_clean":"2024-09-17T05:23:28.871068+0000","last_became_active":"2024-09-17T05:23:27.746980+0000","last_became_peered":"2024-09-17T05:23:27.746980+0000","last_unstale":"2024-09-17T05:23:28.871068+0000","last_undegraded":"2024-09-17T05:23:28.871068+0000","last_fullsized":"2024-09-17T05:23:28.871068+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:03:56.732247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740107+0000","last_change":"2024-09-17T05:23:27.755023+0000","last_active":"2024-09-17T05:23:28.740107+0000","last_peered":"2024-09-17T05:23:28.740107+0000","last_clean":"2024-09-17T05:23:28.740107+0000","last_became_active":"2024-09-17T05:23:27.754740+0000","last_became_peered":"2024-09-17T05:23:27.754740+0000","last_unstale":"2024-09-17T05:23:28.740107+0000","last_undegraded":"2024-09-17T05:23:28.740107+0000","last_fullsized":"2024-09-17T05:23:28.740107+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:14.676019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740570+0000","last_change":"2024-09-17T05:23:27.758739+0000","last_active":"2024-09-17T05:23:28.740570+0000","last_peered":"2024-09-17T05:23:28.740570+0000","last_clean":"2024-09-17T05:23:28.740570+0000","last_became_active":"2024-09-17T05:23:27.758428+0000","last_became_peered":"2024-09-17T05:23:27.758428+0000","last_unstale":"2024-09-17T05:23:28.740570+0000","last_undegraded":"2024-09-17T05:23:28.740570+0000","last_fullsized":"2024-09-17T05:23:28.740570+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:53:50.576871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871025+0000","last_change":"2024-09-17T05:23:27.756384+0000","last_active":"2024-09-17T05:23:28.871025+0000","last_peered":"2024-09-17T05:23:28.871025+0000","last_clean":"2024-09-17T05:23:28.871025+0000","last_became_active":"2024-09-17T05:23:27.756108+0000","last_became_peered":"2024-09-17T05:23:27.756108+0000","last_unstale":"2024-09-17T05:23:28.871025+0000","last_undegraded":"2024-09-17T05:23:28.871025+0000","last_fullsized":"2024-09-17T05:23:28.871025+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:28.739063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870150+0000","last_change":"2024-09-17T05:23:27.742637+0000","last_active":"2024-09-17T05:23:28.870150+0000","last_peered":"2024-09-17T05:23:28.870150+0000","last_clean":"2024-09-17T05:23:28.870150+0000","last_became_active":"2024-09-17T05:23:27.742336+0000","last_became_peered":"2024-09-17T05:23:27.742336+0000","last_unstale":"2024-09-17T05:23:28.870150+0000","last_undegraded":"2024-09-17T05:23:28.870150+0000","last_fullsized":"2024-09-17T05:23:28.870150+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:28:34.391135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869555+0000","last_change":"2024-09-17T05:23:27.754872+0000","last_active":"2024-09-17T05:23:28.869555+0000","last_peered":"2024-09-17T05:23:28.869555+0000","last_clean":"2024-09-17T05:23:28.869555+0000","last_became_active":"2024-09-17T05:23:27.754622+0000","last_became_peered":"2024-09-17T05:23:27.754622+0000","last_unstale":"2024-09-17T05:23:28.869555+0000","last_undegraded":"2024-09-17T05:23:28.869555+0000","last_fullsized":"2024-09-17T05:23:28.869555+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:50.042732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762714+0000","last_change":"2024-09-17T05:23:27.749490+0000","last_active":"2024-09-17T05:23:28.762714+0000","last_peered":"2024-09-17T05:23:28.762714+0000","last_clean":"2024-09-17T05:23:28.762714+0000","last_became_active":"2024-09-17T05:23:27.748350+0000","last_became_peered":"2024-09-17T05:23:27.748350+0000","last_unstale":"2024-09-17T05:23:28.762714+0000","last_undegraded":"2024-09-17T05:23:28.762714+0000","last_fullsized":"2024-09-17T05:23:28.762714+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:42:59.662874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739316+0000","last_change":"2024-09-17T05:23:27.753923+0000","last_active":"2024-09-17T05:23:28.739316+0000","last_peered":"2024-09-17T05:23:28.739316+0000","last_clean":"2024-09-17T05:23:28.739316+0000","last_became_active":"2024-09-17T05:23:27.753178+0000","last_became_peered":"2024-09-17T05:23:27.753178+0000","last_unstale":"2024-09-17T05:23:28.739316+0000","last_undegraded":"2024-09-17T05:23:28.739316+0000","last_fullsized":"2024-09-17T05:23:28.739316+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:13.083163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871209+0000","last_change":"2024-09-17T05:23:27.744004+0000","last_active":"2024-09-17T05:23:28.871209+0000","last_peered":"2024-09-17T05:23:28.871209+0000","last_clean":"2024-09-17T05:23:28.871209+0000","last_became_active":"2024-09-17T05:23:27.743621+0000","last_became_peered":"2024-09-17T05:23:27.743621+0000","last_unstale":"2024-09-17T05:23:28.871209+0000","last_undegraded":"2024-09-17T05:23:28.871209+0000","last_fullsized":"2024-09-17T05:23:28.871209+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:16.079026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870897+0000","last_change":"2024-09-17T05:23:27.742154+0000","last_active":"2024-09-17T05:23:28.870897+0000","last_peered":"2024-09-17T05:23:28.870897+0000","last_clean":"2024-09-17T05:23:28.870897+0000","last_became_active":"2024-09-17T05:23:27.741884+0000","last_became_peered":"2024-09-17T05:23:27.741884+0000","last_unstale":"2024-09-17T05:23:28.870897+0000","last_undegraded":"2024-09-17T05:23:28.870897+0000","last_fullsized":"2024-09-17T05:23:28.870897+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:02:16.874294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739697+0000","last_change":"2024-09-17T05:23:27.741223+0000","last_active":"2024-09-17T05:23:28.739697+0000","last_peered":"2024-09-17T05:23:28.739697+0000","last_clean":"2024-09-17T05:23:28.739697+0000","last_became_active":"2024-09-17T05:23:27.740916+0000","last_became_peered":"2024-09-17T05:23:27.740916+0000","last_unstale":"2024-09-17T05:23:28.739697+0000","last_undegraded":"2024-09-17T05:23:28.739697+0000","last_fullsized":"2024-09-17T05:23:28.739697+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:35.199176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871088+0000","last_change":"2024-09-17T05:23:27.746003+0000","last_active":"2024-09-17T05:23:28.871088+0000","last_peered":"2024-09-17T05:23:28.871088+0000","last_clean":"2024-09-17T05:23:28.871088+0000","last_became_active":"2024-09-17T05:23:27.745525+0000","last_became_peered":"2024-09-17T05:23:27.745525+0000","last_unstale":"2024-09-17T05:23:28.871088+0000","last_undegraded":"2024-09-17T05:23:28.871088+0000","last_fullsized":"2024-09-17T05:23:28.871088+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:57.756820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740276+0000","last_change":"2024-09-17T05:23:27.753629+0000","last_active":"2024-09-17T05:23:28.740276+0000","last_peered":"2024-09-17T05:23:28.740276+0000","last_clean":"2024-09-17T05:23:28.740276+0000","last_became_active":"2024-09-17T05:23:27.753264+0000","last_became_peered":"2024-09-17T05:23:27.753264+0000","last_unstale":"2024-09-17T05:23:28.740276+0000","last_undegraded":"2024-09-17T05:23:28.740276+0000","last_fullsized":"2024-09-17T05:23:28.740276+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:47.665821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740488+0000","last_change":"2024-09-17T05:23:27.748577+0000","last_active":"2024-09-17T05:23:28.740488+0000","last_peered":"2024-09-17T05:23:28.740488+0000","last_clean":"2024-09-17T05:23:28.740488+0000","last_became_active":"2024-09-17T05:23:27.748296+0000","last_became_peered":"2024-09-17T05:23:27.748296+0000","last_unstale":"2024-09-17T05:23:28.740488+0000","last_undegraded":"2024-09-17T05:23:28.740488+0000","last_fullsized":"2024-09-17T05:23:28.740488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:14.608917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869932+0000","last_change":"2024-09-17T05:23:27.751951+0000","last_active":"2024-09-17T05:23:28.869932+0000","last_peered":"2024-09-17T05:23:28.869932+0000","last_clean":"2024-09-17T05:23:28.869932+0000","last_became_active":"2024-09-17T05:23:27.751670+0000","last_became_peered":"2024-09-17T05:23:27.751670+0000","last_unstale":"2024-09-17T05:23:28.869932+0000","last_undegraded":"2024-09-17T05:23:28.869932+0000","last_fullsized":"2024-09-17T05:23:28.869932+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:51:33.132181+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870318+0000","last_change":"2024-09-17T05:23:27.750236+0000","last_active":"2024-09-17T05:23:28.870318+0000","last_peered":"2024-09-17T05:23:28.870318+0000","last_clean":"2024-09-17T05:23:28.870318+0000","last_became_active":"2024-09-17T05:23:27.749592+0000","last_became_peered":"2024-09-17T05:23:27.749592+0000","last_unstale":"2024-09-17T05:23:28.870318+0000","last_undegraded":"2024-09-17T05:23:28.870318+0000","last_fullsized":"2024-09-17T05:23:28.870318+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:21.953132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739686+0000","last_change":"2024-09-17T05:23:27.747130+0000","last_active":"2024-09-17T05:23:28.739686+0000","last_peered":"2024-09-17T05:23:28.739686+0000","last_clean":"2024-09-17T05:23:28.739686+0000","last_became_active":"2024-09-17T05:23:27.746853+0000","last_became_peered":"2024-09-17T05:23:27.746853+0000","last_unstale":"2024-09-17T05:23:28.739686+0000","last_undegraded":"2024-09-17T05:23:28.739686+0000","last_fullsized":"2024-09-17T05:23:28.739686+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:54:53.430131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760325+0000","last_change":"2024-09-17T05:23:27.745590+0000","last_active":"2024-09-17T05:23:28.760325+0000","last_peered":"2024-09-17T05:23:28.760325+0000","last_clean":"2024-09-17T05:23:28.760325+0000","last_became_active":"2024-09-17T05:23:27.745336+0000","last_became_peered":"2024-09-17T05:23:27.745336+0000","last_unstale":"2024-09-17T05:23:28.760325+0000","last_undegraded":"2024-09-17T05:23:28.760325+0000","last_fullsized":"2024-09-17T05:23:28.760325+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:56.814526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740914+0000","last_change":"2024-09-17T05:23:27.756274+0000","last_active":"2024-09-17T05:23:28.740914+0000","last_peered":"2024-09-17T05:23:28.740914+0000","last_clean":"2024-09-17T05:23:28.740914+0000","last_became_active":"2024-09-17T05:23:27.755802+0000","last_became_peered":"2024-09-17T05:23:27.755802+0000","last_unstale":"2024-09-17T05:23:28.740914+0000","last_undegraded":"2024-09-17T05:23:28.740914+0000","last_fullsized":"2024-09-17T05:23:28.740914+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:03.716356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740229+0000","last_change":"2024-09-17T05:23:27.749562+0000","last_active":"2024-09-17T05:23:28.740229+0000","last_peered":"2024-09-17T05:23:28.740229+0000","last_clean":"2024-09-17T05:23:28.740229+0000","last_became_active":"2024-09-17T05:23:27.749297+0000","last_became_peered":"2024-09-17T05:23:27.749297+0000","last_unstale":"2024-09-17T05:23:28.740229+0000","last_undegraded":"2024-09-17T05:23:28.740229+0000","last_fullsized":"2024-09-17T05:23:28.740229+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:42.272314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740928+0000","last_change":"2024-09-17T05:23:27.744707+0000","last_active":"2024-09-17T05:23:28.740928+0000","last_peered":"2024-09-17T05:23:28.740928+0000","last_clean":"2024-09-17T05:23:28.740928+0000","last_became_active":"2024-09-17T05:23:27.743720+0000","last_became_peered":"2024-09-17T05:23:27.743720+0000","last_unstale":"2024-09-17T05:23:28.740928+0000","last_undegraded":"2024-09-17T05:23:28.740928+0000","last_fullsized":"2024-09-17T05:23:28.740928+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:45.342370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736337+0000","last_change":"2024-09-17T05:23:27.741562+0000","last_active":"2024-09-17T05:23:28.736337+0000","last_peered":"2024-09-17T05:23:28.736337+0000","last_clean":"2024-09-17T05:23:28.736337+0000","last_became_active":"2024-09-17T05:23:27.741297+0000","last_became_peered":"2024-09-17T05:23:27.741297+0000","last_unstale":"2024-09-17T05:23:28.736337+0000","last_undegraded":"2024-09-17T05:23:28.736337+0000","last_fullsized":"2024-09-17T05:23:28.736337+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:39:17.574504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739300+0000","last_change":"2024-09-17T05:23:27.750328+0000","last_active":"2024-09-17T05:23:28.739300+0000","last_peered":"2024-09-17T05:23:28.739300+0000","last_clean":"2024-09-17T05:23:28.739300+0000","last_became_active":"2024-09-17T05:23:27.750057+0000","last_became_peered":"2024-09-17T05:23:27.750057+0000","last_unstale":"2024-09-17T05:23:28.739300+0000","last_undegraded":"2024-09-17T05:23:28.739300+0000","last_fullsized":"2024-09-17T05:23:28.739300+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:59.752948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736041+0000","last_change":"2024-09-17T05:23:27.754282+0000","last_active":"2024-09-17T05:23:28.736041+0000","last_peered":"2024-09-17T05:23:28.736041+0000","last_clean":"2024-09-17T05:23:28.736041+0000","last_became_active":"2024-09-17T05:23:27.754023+0000","last_became_peered":"2024-09-17T05:23:27.754023+0000","last_unstale":"2024-09-17T05:23:28.736041+0000","last_undegraded":"2024-09-17T05:23:28.736041+0000","last_fullsized":"2024-09-17T05:23:28.736041+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:49:03.716356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739870+0000","last_change":"2024-09-17T05:23:27.746375+0000","last_active":"2024-09-17T05:23:28.739870+0000","last_peered":"2024-09-17T05:23:28.739870+0000","last_clean":"2024-09-17T05:23:28.739870+0000","last_became_active":"2024-09-17T05:23:27.746110+0000","last_became_peered":"2024-09-17T05:23:27.746110+0000","last_unstale":"2024-09-17T05:23:28.739870+0000","last_undegraded":"2024-09-17T05:23:28.739870+0000","last_fullsized":"2024-09-17T05:23:28.739870+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:31.300404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870962+0000","last_change":"2024-09-17T05:23:27.747828+0000","last_active":"2024-09-17T05:23:28.870962+0000","last_peered":"2024-09-17T05:23:28.870962+0000","last_clean":"2024-09-17T05:23:28.870962+0000","last_became_active":"2024-09-17T05:23:27.747569+0000","last_became_peered":"2024-09-17T05:23:27.747569+0000","last_unstale":"2024-09-17T05:23:28.870962+0000","last_undegraded":"2024-09-17T05:23:28.870962+0000","last_fullsized":"2024-09-17T05:23:28.870962+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:28.121975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869862+0000","last_change":"2024-09-17T05:23:27.752148+0000","last_active":"2024-09-17T05:23:28.869862+0000","last_peered":"2024-09-17T05:23:28.869862+0000","last_clean":"2024-09-17T05:23:28.869862+0000","last_became_active":"2024-09-17T05:23:27.751869+0000","last_became_peered":"2024-09-17T05:23:27.751869+0000","last_unstale":"2024-09-17T05:23:28.869862+0000","last_undegraded":"2024-09-17T05:23:28.869862+0000","last_fullsized":"2024-09-17T05:23:28.869862+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:41.766982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736412+0000","last_change":"2024-09-17T05:23:27.748943+0000","last_active":"2024-09-17T05:23:28.736412+0000","last_peered":"2024-09-17T05:23:28.736412+0000","last_clean":"2024-09-17T05:23:28.736412+0000","last_became_active":"2024-09-17T05:23:27.748517+0000","last_became_peered":"2024-09-17T05:23:27.748517+0000","last_unstale":"2024-09-17T05:23:28.736412+0000","last_undegraded":"2024-09-17T05:23:28.736412+0000","last_fullsized":"2024-09-17T05:23:28.736412+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:22:30.150234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740207+0000","last_change":"2024-09-17T05:23:27.751158+0000","last_active":"2024-09-17T05:23:28.740207+0000","last_peered":"2024-09-17T05:23:28.740207+0000","last_clean":"2024-09-17T05:23:28.740207+0000","last_became_active":"2024-09-17T05:23:27.750841+0000","last_became_peered":"2024-09-17T05:23:27.750841+0000","last_unstale":"2024-09-17T05:23:28.740207+0000","last_undegraded":"2024-09-17T05:23:28.740207+0000","last_fullsized":"2024-09-17T05:23:28.740207+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:57:55.409815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762787+0000","last_change":"2024-09-17T05:23:27.750673+0000","last_active":"2024-09-17T05:23:28.762787+0000","last_peered":"2024-09-17T05:23:28.762787+0000","last_clean":"2024-09-17T05:23:28.762787+0000","last_became_active":"2024-09-17T05:23:27.750400+0000","last_became_peered":"2024-09-17T05:23:27.750400+0000","last_unstale":"2024-09-17T05:23:28.762787+0000","last_undegraded":"2024-09-17T05:23:28.762787+0000","last_fullsized":"2024-09-17T05:23:28.762787+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:08.365999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870547+0000","last_change":"2024-09-17T05:23:27.748579+0000","last_active":"2024-09-17T05:23:28.870547+0000","last_peered":"2024-09-17T05:23:28.870547+0000","last_clean":"2024-09-17T05:23:28.870547+0000","last_became_active":"2024-09-17T05:23:27.748308+0000","last_became_peered":"2024-09-17T05:23:27.748308+0000","last_unstale":"2024-09-17T05:23:28.870547+0000","last_undegraded":"2024-09-17T05:23:28.870547+0000","last_fullsized":"2024-09-17T05:23:28.870547+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:12:29.426710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869608+0000","last_change":"2024-09-17T05:23:27.752215+0000","last_active":"2024-09-17T05:23:28.869608+0000","last_peered":"2024-09-17T05:23:28.869608+0000","last_clean":"2024-09-17T05:23:28.869608+0000","last_became_active":"2024-09-17T05:23:27.751831+0000","last_became_peered":"2024-09-17T05:23:27.751831+0000","last_unstale":"2024-09-17T05:23:28.869608+0000","last_undegraded":"2024-09-17T05:23:28.869608+0000","last_fullsized":"2024-09-17T05:23:28.869608+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:15.783172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869793+0000","last_change":"2024-09-17T05:23:27.755513+0000","last_active":"2024-09-17T05:23:28.869793+0000","last_peered":"2024-09-17T05:23:28.869793+0000","last_clean":"2024-09-17T05:23:28.869793+0000","last_became_active":"2024-09-17T05:23:27.755263+0000","last_became_peered":"2024-09-17T05:23:27.755263+0000","last_unstale":"2024-09-17T05:23:28.869793+0000","last_undegraded":"2024-09-17T05:23:28.869793+0000","last_fullsized":"2024-09-17T05:23:28.869793+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:40:45.468227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"100'4","reported_seq":19,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762883+0000","last_change":"2024-09-17T05:23:26.758172+0000","last_active":"2024-09-17T05:23:28.762883+0000","last_peered":"2024-09-17T05:23:28.762883+0000","last_clean":"2024-09-17T05:23:28.762883+0000","last_became_active":"2024-09-17T05:23:26.757900+0000","last_became_peered":"2024-09-17T05:23:26.757900+0000","last_unstale":"2024-09-17T05:23:28.762883+0000","last_undegraded":"2024-09-17T05:23:28.762883+0000","last_fullsized":"2024-09-17T05:23:28.762883+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:46:35.317950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760488+0000","last_change":"2024-09-17T05:23:27.750582+0000","last_active":"2024-09-17T05:23:28.760488+0000","last_peered":"2024-09-17T05:23:28.760488+0000","last_clean":"2024-09-17T05:23:28.760488+0000","last_became_active":"2024-09-17T05:23:27.749877+0000","last_became_peered":"2024-09-17T05:23:27.749877+0000","last_unstale":"2024-09-17T05:23:28.760488+0000","last_undegraded":"2024-09-17T05:23:28.760488+0000","last_fullsized":"2024-09-17T05:23:28.760488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:30:14.608917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739729+0000","last_change":"2024-09-17T05:23:26.763700+0000","last_active":"2024-09-17T05:23:28.739729+0000","last_peered":"2024-09-17T05:23:28.739729+0000","last_clean":"2024-09-17T05:23:28.739729+0000","last_became_active":"2024-09-17T05:23:26.763436+0000","last_became_peered":"2024-09-17T05:23:26.763436+0000","last_unstale":"2024-09-17T05:23:28.739729+0000","last_undegraded":"2024-09-17T05:23:28.739729+0000","last_fullsized":"2024-09-17T05:23:28.739729+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:15.609283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869913+0000","last_change":"2024-09-17T05:23:27.755750+0000","last_active":"2024-09-17T05:23:28.869913+0000","last_peered":"2024-09-17T05:23:28.869913+0000","last_clean":"2024-09-17T05:23:28.869913+0000","last_became_active":"2024-09-17T05:23:27.754286+0000","last_became_peered":"2024-09-17T05:23:27.754286+0000","last_unstale":"2024-09-17T05:23:28.869913+0000","last_undegraded":"2024-09-17T05:23:28.869913+0000","last_fullsized":"2024-09-17T05:23:28.869913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:09.856676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870010+0000","last_change":"2024-09-17T05:23:26.769220+0000","last_active":"2024-09-17T05:23:28.870010+0000","last_peered":"2024-09-17T05:23:28.870010+0000","last_clean":"2024-09-17T05:23:28.870010+0000","last_became_active":"2024-09-17T05:23:26.768972+0000","last_became_peered":"2024-09-17T05:23:26.768972+0000","last_unstale":"2024-09-17T05:23:28.870010+0000","last_undegraded":"2024-09-17T05:23:28.870010+0000","last_fullsized":"2024-09-17T05:23:28.870010+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:21:18.495337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.741049+0000","last_change":"2024-09-17T05:23:27.756436+0000","last_active":"2024-09-17T05:23:28.741049+0000","last_peered":"2024-09-17T05:23:28.741049+0000","last_clean":"2024-09-17T05:23:28.741049+0000","last_became_active":"2024-09-17T05:23:27.755837+0000","last_became_peered":"2024-09-17T05:23:27.755837+0000","last_unstale":"2024-09-17T05:23:28.741049+0000","last_undegraded":"2024-09-17T05:23:28.741049+0000","last_fullsized":"2024-09-17T05:23:28.741049+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:53.339086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869940+0000","last_change":"2024-09-17T05:23:26.767942+0000","last_active":"2024-09-17T05:23:28.869940+0000","last_peered":"2024-09-17T05:23:28.869940+0000","last_clean":"2024-09-17T05:23:28.869940+0000","last_became_active":"2024-09-17T05:23:26.767665+0000","last_became_peered":"2024-09-17T05:23:26.767665+0000","last_unstale":"2024-09-17T05:23:28.869940+0000","last_undegraded":"2024-09-17T05:23:28.869940+0000","last_fullsized":"2024-09-17T05:23:28.869940+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:48.380609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870610+0000","last_change":"2024-09-17T05:23:27.743939+0000","last_active":"2024-09-17T05:23:28.870610+0000","last_peered":"2024-09-17T05:23:28.870610+0000","last_clean":"2024-09-17T05:23:28.870610+0000","last_became_active":"2024-09-17T05:23:27.743671+0000","last_became_peered":"2024-09-17T05:23:27.743671+0000","last_unstale":"2024-09-17T05:23:28.870610+0000","last_undegraded":"2024-09-17T05:23:28.870610+0000","last_fullsized":"2024-09-17T05:23:28.870610+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:47.453002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762688+0000","last_change":"2024-09-17T05:23:26.766390+0000","last_active":"2024-09-17T05:23:28.762688+0000","last_peered":"2024-09-17T05:23:28.762688+0000","last_clean":"2024-09-17T05:23:28.762688+0000","last_became_active":"2024-09-17T05:23:26.766102+0000","last_became_peered":"2024-09-17T05:23:26.766102+0000","last_unstale":"2024-09-17T05:23:28.762688+0000","last_undegraded":"2024-09-17T05:23:28.762688+0000","last_fullsized":"2024-09-17T05:23:28.762688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:36.872927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740468+0000","last_change":"2024-09-17T05:23:27.752179+0000","last_active":"2024-09-17T05:23:28.740468+0000","last_peered":"2024-09-17T05:23:28.740468+0000","last_clean":"2024-09-17T05:23:28.740468+0000","last_became_active":"2024-09-17T05:23:27.751850+0000","last_became_peered":"2024-09-17T05:23:27.751850+0000","last_unstale":"2024-09-17T05:23:28.740468+0000","last_undegraded":"2024-09-17T05:23:28.740468+0000","last_fullsized":"2024-09-17T05:23:28.740468+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:59:47.455757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736438+0000","last_change":"2024-09-17T05:23:26.763691+0000","last_active":"2024-09-17T05:23:28.736438+0000","last_peered":"2024-09-17T05:23:28.736438+0000","last_clean":"2024-09-17T05:23:28.736438+0000","last_became_active":"2024-09-17T05:23:26.760828+0000","last_became_peered":"2024-09-17T05:23:26.760828+0000","last_unstale":"2024-09-17T05:23:28.736438+0000","last_undegraded":"2024-09-17T05:23:28.736438+0000","last_fullsized":"2024-09-17T05:23:28.736438+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:19:44.395183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870325+0000","last_change":"2024-09-17T05:23:27.753337+0000","last_active":"2024-09-17T05:23:28.870325+0000","last_peered":"2024-09-17T05:23:28.870325+0000","last_clean":"2024-09-17T05:23:28.870325+0000","last_became_active":"2024-09-17T05:23:27.751215+0000","last_became_peered":"2024-09-17T05:23:27.751215+0000","last_unstale":"2024-09-17T05:23:28.870325+0000","last_undegraded":"2024-09-17T05:23:28.870325+0000","last_fullsized":"2024-09-17T05:23:28.870325+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:41:01.053588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739199+0000","last_change":"2024-09-17T05:23:26.765987+0000","last_active":"2024-09-17T05:23:28.739199+0000","last_peered":"2024-09-17T05:23:28.739199+0000","last_clean":"2024-09-17T05:23:28.739199+0000","last_became_active":"2024-09-17T05:23:26.765664+0000","last_became_peered":"2024-09-17T05:23:26.765664+0000","last_unstale":"2024-09-17T05:23:28.739199+0000","last_undegraded":"2024-09-17T05:23:28.739199+0000","last_fullsized":"2024-09-17T05:23:28.739199+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:55.192021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762695+0000","last_change":"2024-09-17T05:23:27.751437+0000","last_active":"2024-09-17T05:23:28.762695+0000","last_peered":"2024-09-17T05:23:28.762695+0000","last_clean":"2024-09-17T05:23:28.762695+0000","last_became_active":"2024-09-17T05:23:27.751181+0000","last_became_peered":"2024-09-17T05:23:27.751181+0000","last_unstale":"2024-09-17T05:23:28.762695+0000","last_undegraded":"2024-09-17T05:23:28.762695+0000","last_fullsized":"2024-09-17T05:23:28.762695+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:29:23.618852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870437+0000","last_change":"2024-09-17T05:23:26.757573+0000","last_active":"2024-09-17T05:23:28.870437+0000","last_peered":"2024-09-17T05:23:28.870437+0000","last_clean":"2024-09-17T05:23:28.870437+0000","last_became_active":"2024-09-17T05:23:26.757306+0000","last_became_peered":"2024-09-17T05:23:26.757306+0000","last_unstale":"2024-09-17T05:23:28.870437+0000","last_undegraded":"2024-09-17T05:23:28.870437+0000","last_fullsized":"2024-09-17T05:23:28.870437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:31.385119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762952+0000","last_change":"2024-09-17T05:23:27.750888+0000","last_active":"2024-09-17T05:23:28.762952+0000","last_peered":"2024-09-17T05:23:28.762952+0000","last_clean":"2024-09-17T05:23:28.762952+0000","last_became_active":"2024-09-17T05:23:27.750113+0000","last_became_peered":"2024-09-17T05:23:27.750113+0000","last_unstale":"2024-09-17T05:23:28.762952+0000","last_undegraded":"2024-09-17T05:23:28.762952+0000","last_fullsized":"2024-09-17T05:23:28.762952+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:27.206292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869959+0000","last_change":"2024-09-17T05:23:26.767760+0000","last_active":"2024-09-17T05:23:28.869959+0000","last_peered":"2024-09-17T05:23:28.869959+0000","last_clean":"2024-09-17T05:23:28.869959+0000","last_became_active":"2024-09-17T05:23:26.767477+0000","last_became_peered":"2024-09-17T05:23:26.767477+0000","last_unstale":"2024-09-17T05:23:28.869959+0000","last_undegraded":"2024-09-17T05:23:28.869959+0000","last_fullsized":"2024-09-17T05:23:28.869959+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:22:10.643587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760465+0000","last_change":"2024-09-17T05:23:27.743278+0000","last_active":"2024-09-17T05:23:28.760465+0000","last_peered":"2024-09-17T05:23:28.760465+0000","last_clean":"2024-09-17T05:23:28.760465+0000","last_became_active":"2024-09-17T05:23:27.743032+0000","last_became_peered":"2024-09-17T05:23:27.743032+0000","last_unstale":"2024-09-17T05:23:28.760465+0000","last_undegraded":"2024-09-17T05:23:28.760465+0000","last_fullsized":"2024-09-17T05:23:28.760465+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:18:47.665821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736287+0000","last_change":"2024-09-17T05:23:26.762615+0000","last_active":"2024-09-17T05:23:28.736287+0000","last_peered":"2024-09-17T05:23:28.736287+0000","last_clean":"2024-09-17T05:23:28.736287+0000","last_became_active":"2024-09-17T05:23:26.762361+0000","last_became_peered":"2024-09-17T05:23:26.762361+0000","last_unstale":"2024-09-17T05:23:28.736287+0000","last_undegraded":"2024-09-17T05:23:28.736287+0000","last_fullsized":"2024-09-17T05:23:28.736287+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:51:49.505507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736485+0000","last_change":"2024-09-17T05:23:27.754964+0000","last_active":"2024-09-17T05:23:28.736485+0000","last_peered":"2024-09-17T05:23:28.736485+0000","last_clean":"2024-09-17T05:23:28.736485+0000","last_became_active":"2024-09-17T05:23:27.754376+0000","last_became_peered":"2024-09-17T05:23:27.754376+0000","last_unstale":"2024-09-17T05:23:28.736485+0000","last_undegraded":"2024-09-17T05:23:28.736485+0000","last_fullsized":"2024-09-17T05:23:28.736485+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:49:18.265019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"100'3","reported_seq":18,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870995+0000","last_change":"2024-09-17T05:23:26.766161+0000","last_active":"2024-09-17T05:23:28.870995+0000","last_peered":"2024-09-17T05:23:28.870995+0000","last_clean":"2024-09-17T05:23:28.870995+0000","last_became_active":"2024-09-17T05:23:26.765888+0000","last_became_peered":"2024-09-17T05:23:26.765888+0000","last_unstale":"2024-09-17T05:23:28.870995+0000","last_undegraded":"2024-09-17T05:23:28.870995+0000","last_fullsized":"2024-09-17T05:23:28.870995+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:14:47.740331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762977+0000","last_change":"2024-09-17T05:23:27.757436+0000","last_active":"2024-09-17T05:23:28.762977+0000","last_peered":"2024-09-17T05:23:28.762977+0000","last_clean":"2024-09-17T05:23:28.762977+0000","last_became_active":"2024-09-17T05:23:27.757169+0000","last_became_peered":"2024-09-17T05:23:27.757169+0000","last_unstale":"2024-09-17T05:23:28.762977+0000","last_undegraded":"2024-09-17T05:23:28.762977+0000","last_fullsized":"2024-09-17T05:23:28.762977+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:36:44.659150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"100'6","reported_seq":21,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871193+0000","last_change":"2024-09-17T05:23:26.765277+0000","last_active":"2024-09-17T05:23:28.871193+0000","last_peered":"2024-09-17T05:23:28.871193+0000","last_clean":"2024-09-17T05:23:28.871193+0000","last_became_active":"2024-09-17T05:23:26.765007+0000","last_became_peered":"2024-09-17T05:23:26.765007+0000","last_unstale":"2024-09-17T05:23:28.871193+0000","last_undegraded":"2024-09-17T05:23:28.871193+0000","last_fullsized":"2024-09-17T05:23:28.871193+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:09:36.086349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736447+0000","last_change":"2024-09-17T05:23:27.747487+0000","last_active":"2024-09-17T05:23:28.736447+0000","last_peered":"2024-09-17T05:23:28.736447+0000","last_clean":"2024-09-17T05:23:28.736447+0000","last_became_active":"2024-09-17T05:23:27.747209+0000","last_became_peered":"2024-09-17T05:23:27.747209+0000","last_unstale":"2024-09-17T05:23:28.736447+0000","last_undegraded":"2024-09-17T05:23:28.736447+0000","last_fullsized":"2024-09-17T05:23:28.736447+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:46.694118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869728+0000","last_change":"2024-09-17T05:23:26.766494+0000","last_active":"2024-09-17T05:23:28.869728+0000","last_peered":"2024-09-17T05:23:28.869728+0000","last_clean":"2024-09-17T05:23:28.869728+0000","last_became_active":"2024-09-17T05:23:26.766186+0000","last_became_peered":"2024-09-17T05:23:26.766186+0000","last_unstale":"2024-09-17T05:23:28.869728+0000","last_undegraded":"2024-09-17T05:23:28.869728+0000","last_fullsized":"2024-09-17T05:23:28.869728+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:20:53.826110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736437+0000","last_change":"2024-09-17T05:23:27.753620+0000","last_active":"2024-09-17T05:23:28.736437+0000","last_peered":"2024-09-17T05:23:28.736437+0000","last_clean":"2024-09-17T05:23:28.736437+0000","last_became_active":"2024-09-17T05:23:27.753360+0000","last_became_peered":"2024-09-17T05:23:27.753360+0000","last_unstale":"2024-09-17T05:23:28.736437+0000","last_undegraded":"2024-09-17T05:23:28.736437+0000","last_fullsized":"2024-09-17T05:23:28.736437+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:45:09.983870+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760188+0000","last_change":"2024-09-17T05:23:26.758107+0000","last_active":"2024-09-17T05:23:28.760188+0000","last_peered":"2024-09-17T05:23:28.760188+0000","last_clean":"2024-09-17T05:23:28.760188+0000","last_became_active":"2024-09-17T05:23:26.757839+0000","last_became_peered":"2024-09-17T05:23:26.757839+0000","last_unstale":"2024-09-17T05:23:28.760188+0000","last_undegraded":"2024-09-17T05:23:28.760188+0000","last_fullsized":"2024-09-17T05:23:28.760188+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:47.180458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736288+0000","last_change":"2024-09-17T05:23:27.748078+0000","last_active":"2024-09-17T05:23:28.736288+0000","last_peered":"2024-09-17T05:23:28.736288+0000","last_clean":"2024-09-17T05:23:28.736288+0000","last_became_active":"2024-09-17T05:23:27.747776+0000","last_became_peered":"2024-09-17T05:23:27.747776+0000","last_unstale":"2024-09-17T05:23:28.736288+0000","last_undegraded":"2024-09-17T05:23:28.736288+0000","last_fullsized":"2024-09-17T05:23:28.736288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:20:53.339086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"100'8","reported_seq":23,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869437+0000","last_change":"2024-09-17T05:23:26.768157+0000","last_active":"2024-09-17T05:23:28.869437+0000","last_peered":"2024-09-17T05:23:28.869437+0000","last_clean":"2024-09-17T05:23:28.869437+0000","last_became_active":"2024-09-17T05:23:26.767890+0000","last_became_peered":"2024-09-17T05:23:26.767890+0000","last_unstale":"2024-09-17T05:23:28.869437+0000","last_undegraded":"2024-09-17T05:23:28.869437+0000","last_fullsized":"2024-09-17T05:23:28.869437+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:05:26.736145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870390+0000","last_change":"2024-09-17T05:23:27.742471+0000","last_active":"2024-09-17T05:23:28.870390+0000","last_peered":"2024-09-17T05:23:28.870390+0000","last_clean":"2024-09-17T05:23:28.870390+0000","last_became_active":"2024-09-17T05:23:27.742172+0000","last_became_peered":"2024-09-17T05:23:27.742172+0000","last_unstale":"2024-09-17T05:23:28.870390+0000","last_undegraded":"2024-09-17T05:23:28.870390+0000","last_fullsized":"2024-09-17T05:23:28.870390+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:31:53.141311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871306+0000","last_change":"2024-09-17T05:23:26.758601+0000","last_active":"2024-09-17T05:23:28.871306+0000","last_peered":"2024-09-17T05:23:28.871306+0000","last_clean":"2024-09-17T05:23:28.871306+0000","last_became_active":"2024-09-17T05:23:26.758352+0000","last_became_peered":"2024-09-17T05:23:26.758352+0000","last_unstale":"2024-09-17T05:23:28.871306+0000","last_undegraded":"2024-09-17T05:23:28.871306+0000","last_fullsized":"2024-09-17T05:23:28.871306+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:35:40.374304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869913+0000","last_change":"2024-09-17T05:23:27.756606+0000","last_active":"2024-09-17T05:23:28.869913+0000","last_peered":"2024-09-17T05:23:28.869913+0000","last_clean":"2024-09-17T05:23:28.869913+0000","last_became_active":"2024-09-17T05:23:27.756328+0000","last_became_peered":"2024-09-17T05:23:27.756328+0000","last_unstale":"2024-09-17T05:23:28.869913+0000","last_undegraded":"2024-09-17T05:23:28.869913+0000","last_fullsized":"2024-09-17T05:23:28.869913+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:04:07.086933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870220+0000","last_change":"2024-09-17T05:23:26.769826+0000","last_active":"2024-09-17T05:23:28.870220+0000","last_peered":"2024-09-17T05:23:28.870220+0000","last_clean":"2024-09-17T05:23:28.870220+0000","last_became_active":"2024-09-17T05:23:26.769582+0000","last_became_peered":"2024-09-17T05:23:26.769582+0000","last_unstale":"2024-09-17T05:23:28.870220+0000","last_undegraded":"2024-09-17T05:23:28.870220+0000","last_fullsized":"2024-09-17T05:23:28.870220+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:39:12.415903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739600+0000","last_change":"2024-09-17T05:23:27.754032+0000","last_active":"2024-09-17T05:23:28.739600+0000","last_peered":"2024-09-17T05:23:28.739600+0000","last_clean":"2024-09-17T05:23:28.739600+0000","last_became_active":"2024-09-17T05:23:27.753739+0000","last_became_peered":"2024-09-17T05:23:27.753739+0000","last_unstale":"2024-09-17T05:23:28.739600+0000","last_undegraded":"2024-09-17T05:23:28.739600+0000","last_fullsized":"2024-09-17T05:23:28.739600+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:41.427556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"100'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760251+0000","last_change":"2024-09-17T05:23:26.757286+0000","last_active":"2024-09-17T05:23:28.760251+0000","last_peered":"2024-09-17T05:23:28.760251+0000","last_clean":"2024-09-17T05:23:28.760251+0000","last_became_active":"2024-09-17T05:23:26.757000+0000","last_became_peered":"2024-09-17T05:23:26.757000+0000","last_unstale":"2024-09-17T05:23:28.760251+0000","last_undegraded":"2024-09-17T05:23:28.760251+0000","last_fullsized":"2024-09-17T05:23:28.760251+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:44:31.619765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.741122+0000","last_change":"2024-09-17T05:23:27.756488+0000","last_active":"2024-09-17T05:23:28.741122+0000","last_peered":"2024-09-17T05:23:28.741122+0000","last_clean":"2024-09-17T05:23:28.741122+0000","last_became_active":"2024-09-17T05:23:27.756152+0000","last_became_peered":"2024-09-17T05:23:27.756152+0000","last_unstale":"2024-09-17T05:23:28.741122+0000","last_undegraded":"2024-09-17T05:23:28.741122+0000","last_fullsized":"2024-09-17T05:23:28.741122+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:05.268681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762740+0000","last_change":"2024-09-17T05:23:26.758654+0000","last_active":"2024-09-17T05:23:28.762740+0000","last_peered":"2024-09-17T05:23:28.762740+0000","last_clean":"2024-09-17T05:23:28.762740+0000","last_became_active":"2024-09-17T05:23:26.758374+0000","last_became_peered":"2024-09-17T05:23:26.758374+0000","last_unstale":"2024-09-17T05:23:28.762740+0000","last_undegraded":"2024-09-17T05:23:28.762740+0000","last_fullsized":"2024-09-17T05:23:28.762740+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:16.252064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740715+0000","last_change":"2024-09-17T05:23:27.757821+0000","last_active":"2024-09-17T05:23:28.740715+0000","last_peered":"2024-09-17T05:23:28.740715+0000","last_clean":"2024-09-17T05:23:28.740715+0000","last_became_active":"2024-09-17T05:23:27.757205+0000","last_became_peered":"2024-09-17T05:23:27.757205+0000","last_unstale":"2024-09-17T05:23:28.740715+0000","last_undegraded":"2024-09-17T05:23:28.740715+0000","last_fullsized":"2024-09-17T05:23:28.740715+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:41.917691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869756+0000","last_change":"2024-09-17T05:23:26.770147+0000","last_active":"2024-09-17T05:23:28.869756+0000","last_peered":"2024-09-17T05:23:28.869756+0000","last_clean":"2024-09-17T05:23:28.869756+0000","last_became_active":"2024-09-17T05:23:26.769850+0000","last_became_peered":"2024-09-17T05:23:26.769850+0000","last_unstale":"2024-09-17T05:23:28.869756+0000","last_undegraded":"2024-09-17T05:23:28.869756+0000","last_fullsized":"2024-09-17T05:23:28.869756+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:56:59.818409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870822+0000","last_change":"2024-09-17T05:23:27.750556+0000","last_active":"2024-09-17T05:23:28.870822+0000","last_peered":"2024-09-17T05:23:28.870822+0000","last_clean":"2024-09-17T05:23:28.870822+0000","last_became_active":"2024-09-17T05:23:27.749568+0000","last_became_peered":"2024-09-17T05:23:27.749568+0000","last_unstale":"2024-09-17T05:23:28.870822+0000","last_undegraded":"2024-09-17T05:23:28.870822+0000","last_fullsized":"2024-09-17T05:23:28.870822+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:02:31.329521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869564+0000","last_change":"2024-09-17T05:23:26.770589+0000","last_active":"2024-09-17T05:23:28.869564+0000","last_peered":"2024-09-17T05:23:28.869564+0000","last_clean":"2024-09-17T05:23:28.869564+0000","last_became_active":"2024-09-17T05:23:26.770158+0000","last_became_peered":"2024-09-17T05:23:26.770158+0000","last_unstale":"2024-09-17T05:23:28.869564+0000","last_undegraded":"2024-09-17T05:23:28.869564+0000","last_fullsized":"2024-09-17T05:23:28.869564+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:19:24.722662+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739533+0000","last_change":"2024-09-17T05:23:27.754882+0000","last_active":"2024-09-17T05:23:28.739533+0000","last_peered":"2024-09-17T05:23:28.739533+0000","last_clean":"2024-09-17T05:23:28.739533+0000","last_became_active":"2024-09-17T05:23:27.754629+0000","last_became_peered":"2024-09-17T05:23:27.754629+0000","last_unstale":"2024-09-17T05:23:28.739533+0000","last_undegraded":"2024-09-17T05:23:28.739533+0000","last_fullsized":"2024-09-17T05:23:28.739533+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:56.814526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870028+0000","last_change":"2024-09-17T05:23:26.767306+0000","last_active":"2024-09-17T05:23:28.870028+0000","last_peered":"2024-09-17T05:23:28.870028+0000","last_clean":"2024-09-17T05:23:28.870028+0000","last_became_active":"2024-09-17T05:23:26.766883+0000","last_became_peered":"2024-09-17T05:23:26.766883+0000","last_unstale":"2024-09-17T05:23:28.870028+0000","last_undegraded":"2024-09-17T05:23:28.870028+0000","last_fullsized":"2024-09-17T05:23:28.870028+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:14.845054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736256+0000","last_change":"2024-09-17T05:23:27.744087+0000","last_active":"2024-09-17T05:23:28.736256+0000","last_peered":"2024-09-17T05:23:28.736256+0000","last_clean":"2024-09-17T05:23:28.736256+0000","last_became_active":"2024-09-17T05:23:27.743818+0000","last_became_peered":"2024-09-17T05:23:27.743818+0000","last_unstale":"2024-09-17T05:23:28.736256+0000","last_undegraded":"2024-09-17T05:23:28.736256+0000","last_fullsized":"2024-09-17T05:23:28.736256+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:36:04.001117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870441+0000","last_change":"2024-09-17T05:23:26.763029+0000","last_active":"2024-09-17T05:23:28.870441+0000","last_peered":"2024-09-17T05:23:28.870441+0000","last_clean":"2024-09-17T05:23:28.870441+0000","last_became_active":"2024-09-17T05:23:26.762417+0000","last_became_peered":"2024-09-17T05:23:26.762417+0000","last_unstale":"2024-09-17T05:23:28.870441+0000","last_undegraded":"2024-09-17T05:23:28.870441+0000","last_fullsized":"2024-09-17T05:23:28.870441+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:32:56.411904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760336+0000","last_change":"2024-09-17T05:23:27.744578+0000","last_active":"2024-09-17T05:23:28.760336+0000","last_peered":"2024-09-17T05:23:28.760336+0000","last_clean":"2024-09-17T05:23:28.760336+0000","last_became_active":"2024-09-17T05:23:27.744293+0000","last_became_peered":"2024-09-17T05:23:27.744293+0000","last_unstale":"2024-09-17T05:23:28.760336+0000","last_undegraded":"2024-09-17T05:23:28.760336+0000","last_fullsized":"2024-09-17T05:23:28.760336+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:41.427556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"100'2","reported_seq":17,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736397+0000","last_change":"2024-09-17T05:23:26.758654+0000","last_active":"2024-09-17T05:23:28.736397+0000","last_peered":"2024-09-17T05:23:28.736397+0000","last_clean":"2024-09-17T05:23:28.736397+0000","last_became_active":"2024-09-17T05:23:26.758402+0000","last_became_peered":"2024-09-17T05:23:26.758402+0000","last_unstale":"2024-09-17T05:23:28.736397+0000","last_undegraded":"2024-09-17T05:23:28.736397+0000","last_fullsized":"2024-09-17T05:23:28.736397+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:01.923889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871282+0000","last_change":"2024-09-17T05:23:27.744731+0000","last_active":"2024-09-17T05:23:28.871282+0000","last_peered":"2024-09-17T05:23:28.871282+0000","last_clean":"2024-09-17T05:23:28.871282+0000","last_became_active":"2024-09-17T05:23:27.744547+0000","last_became_peered":"2024-09-17T05:23:27.744547+0000","last_unstale":"2024-09-17T05:23:28.871282+0000","last_undegraded":"2024-09-17T05:23:28.871282+0000","last_fullsized":"2024-09-17T05:23:28.871282+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:24:47.944944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"101'1","reported_seq":16,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762023+0000","last_change":"2024-09-17T05:23:26.758626+0000","last_active":"2024-09-17T05:23:28.762023+0000","last_peered":"2024-09-17T05:23:28.762023+0000","last_clean":"2024-09-17T05:23:28.762023+0000","last_became_active":"2024-09-17T05:23:26.758354+0000","last_became_peered":"2024-09-17T05:23:26.758354+0000","last_unstale":"2024-09-17T05:23:28.762023+0000","last_undegraded":"2024-09-17T05:23:28.762023+0000","last_fullsized":"2024-09-17T05:23:28.762023+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:16.164496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.871231+0000","last_change":"2024-09-17T05:23:27.752475+0000","last_active":"2024-09-17T05:23:28.871231+0000","last_peered":"2024-09-17T05:23:28.871231+0000","last_clean":"2024-09-17T05:23:28.871231+0000","last_became_active":"2024-09-17T05:23:27.751067+0000","last_became_peered":"2024-09-17T05:23:27.751067+0000","last_unstale":"2024-09-17T05:23:28.871231+0000","last_undegraded":"2024-09-17T05:23:28.871231+0000","last_fullsized":"2024-09-17T05:23:28.871231+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:33.882556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870896+0000","last_change":"2024-09-17T05:23:26.762893+0000","last_active":"2024-09-17T05:23:28.870896+0000","last_peered":"2024-09-17T05:23:28.870896+0000","last_clean":"2024-09-17T05:23:28.870896+0000","last_became_active":"2024-09-17T05:23:26.762636+0000","last_became_peered":"2024-09-17T05:23:26.762636+0000","last_unstale":"2024-09-17T05:23:28.870896+0000","last_undegraded":"2024-09-17T05:23:28.870896+0000","last_fullsized":"2024-09-17T05:23:28.870896+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:44.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.760359+0000","last_change":"2024-09-17T05:23:27.744951+0000","last_active":"2024-09-17T05:23:28.760359+0000","last_peered":"2024-09-17T05:23:28.760359+0000","last_clean":"2024-09-17T05:23:28.760359+0000","last_became_active":"2024-09-17T05:23:27.743953+0000","last_became_peered":"2024-09-17T05:23:27.743953+0000","last_unstale":"2024-09-17T05:23:28.760359+0000","last_undegraded":"2024-09-17T05:23:28.760359+0000","last_fullsized":"2024-09-17T05:23:28.760359+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:22.885736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736552+0000","last_change":"2024-09-17T05:23:26.765100+0000","last_active":"2024-09-17T05:23:28.736552+0000","last_peered":"2024-09-17T05:23:28.736552+0000","last_clean":"2024-09-17T05:23:28.736552+0000","last_became_active":"2024-09-17T05:23:26.764829+0000","last_became_peered":"2024-09-17T05:23:26.764829+0000","last_unstale":"2024-09-17T05:23:28.736552+0000","last_undegraded":"2024-09-17T05:23:28.736552+0000","last_fullsized":"2024-09-17T05:23:28.736552+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:06:16.164496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739322+0000","last_change":"2024-09-17T05:23:27.751147+0000","last_active":"2024-09-17T05:23:28.739322+0000","last_peered":"2024-09-17T05:23:28.739322+0000","last_clean":"2024-09-17T05:23:28.739322+0000","last_became_active":"2024-09-17T05:23:27.750867+0000","last_became_peered":"2024-09-17T05:23:27.750867+0000","last_unstale":"2024-09-17T05:23:28.739322+0000","last_undegraded":"2024-09-17T05:23:28.739322+0000","last_fullsized":"2024-09-17T05:23:28.739322+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:58.310866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762675+0000","last_change":"2024-09-17T05:23:26.761582+0000","last_active":"2024-09-17T05:23:28.762675+0000","last_peered":"2024-09-17T05:23:28.762675+0000","last_clean":"2024-09-17T05:23:28.762675+0000","last_became_active":"2024-09-17T05:23:26.761267+0000","last_became_peered":"2024-09-17T05:23:26.761267+0000","last_unstale":"2024-09-17T05:23:28.762675+0000","last_undegraded":"2024-09-17T05:23:28.762675+0000","last_fullsized":"2024-09-17T05:23:28.762675+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:49:22.797993+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.740688+0000","last_change":"2024-09-17T05:23:27.745184+0000","last_active":"2024-09-17T05:23:28.740688+0000","last_peered":"2024-09-17T05:23:28.740688+0000","last_clean":"2024-09-17T05:23:28.740688+0000","last_became_active":"2024-09-17T05:23:27.744863+0000","last_became_peered":"2024-09-17T05:23:27.744863+0000","last_unstale":"2024-09-17T05:23:28.740688+0000","last_undegraded":"2024-09-17T05:23:28.740688+0000","last_fullsized":"2024-09-17T05:23:28.740688+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:44:14.840600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739419+0000","last_change":"2024-09-17T05:23:26.766715+0000","last_active":"2024-09-17T05:23:28.739419+0000","last_peered":"2024-09-17T05:23:28.739419+0000","last_clean":"2024-09-17T05:23:28.739419+0000","last_became_active":"2024-09-17T05:23:26.766464+0000","last_became_peered":"2024-09-17T05:23:26.766464+0000","last_unstale":"2024-09-17T05:23:28.739419+0000","last_undegraded":"2024-09-17T05:23:28.739419+0000","last_fullsized":"2024-09-17T05:23:28.739419+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:37:08.853126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739741+0000","last_change":"2024-09-17T05:23:27.754210+0000","last_active":"2024-09-17T05:23:28.739741+0000","last_peered":"2024-09-17T05:23:28.739741+0000","last_clean":"2024-09-17T05:23:28.739741+0000","last_became_active":"2024-09-17T05:23:27.753512+0000","last_became_peered":"2024-09-17T05:23:27.753512+0000","last_unstale":"2024-09-17T05:23:28.739741+0000","last_undegraded":"2024-09-17T05:23:28.739741+0000","last_fullsized":"2024-09-17T05:23:28.739741+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:22.885736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.869457+0000","last_change":"2024-09-17T05:23:26.768574+0000","last_active":"2024-09-17T05:23:28.869457+0000","last_peered":"2024-09-17T05:23:28.869457+0000","last_clean":"2024-09-17T05:23:28.869457+0000","last_became_active":"2024-09-17T05:23:26.768206+0000","last_became_peered":"2024-09-17T05:23:26.768206+0000","last_unstale":"2024-09-17T05:23:28.869457+0000","last_undegraded":"2024-09-17T05:23:28.869457+0000","last_fullsized":"2024-09-17T05:23:28.869457+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:24:44.653791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870736+0000","last_change":"2024-09-17T05:23:27.751908+0000","last_active":"2024-09-17T05:23:28.870736+0000","last_peered":"2024-09-17T05:23:28.870736+0000","last_clean":"2024-09-17T05:23:28.870736+0000","last_became_active":"2024-09-17T05:23:27.751618+0000","last_became_peered":"2024-09-17T05:23:27.751618+0000","last_unstale":"2024-09-17T05:23:28.870736+0000","last_undegraded":"2024-09-17T05:23:28.870736+0000","last_fullsized":"2024-09-17T05:23:28.870736+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:29.137103+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.870531+0000","last_change":"2024-09-17T05:23:26.763308+0000","last_active":"2024-09-17T05:23:28.870531+0000","last_peered":"2024-09-17T05:23:28.870531+0000","last_clean":"2024-09-17T05:23:28.870531+0000","last_became_active":"2024-09-17T05:23:26.762756+0000","last_became_peered":"2024-09-17T05:23:26.762756+0000","last_unstale":"2024-09-17T05:23:28.870531+0000","last_undegraded":"2024-09-17T05:23:28.870531+0000","last_fullsized":"2024-09-17T05:23:28.870531+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:43.321238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":13,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.736103+0000","last_change":"2024-09-17T05:23:27.750458+0000","last_active":"2024-09-17T05:23:28.736103+0000","last_peered":"2024-09-17T05:23:28.736103+0000","last_clean":"2024-09-17T05:23:28.736103+0000","last_became_active":"2024-09-17T05:23:27.750180+0000","last_became_peered":"2024-09-17T05:23:27.750180+0000","last_unstale":"2024-09-17T05:23:28.736103+0000","last_undegraded":"2024-09-17T05:23:28.736103+0000","last_fullsized":"2024-09-17T05:23:28.736103+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:26.739966+0000","last_clean_scrub_stamp":"2024-09-17T05:23:26.739966+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:39:45.342370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":15,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.762841+0000","last_change":"2024-09-17T05:23:26.759054+0000","last_active":"2024-09-17T05:23:28.762841+0000","last_peered":"2024-09-17T05:23:28.762841+0000","last_clean":"2024-09-17T05:23:28.762841+0000","last_became_active":"2024-09-17T05:23:26.758709+0000","last_became_peered":"2024-09-17T05:23:26.758709+0000","last_unstale":"2024-09-17T05:23:28.762841+0000","last_undegraded":"2024-09-17T05:23:28.762841+0000","last_fullsized":"2024-09-17T05:23:28.762841+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:23:25.736415+0000","last_clean_scrub_stamp":"2024-09-17T05:23:25.736415+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:55:35.892119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":277,"reported_epoch":101,"state":"active+clean","last_fresh":"2024-09-17T05:23:28.739890+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:23:28.739890+0000","last_peered":"2024-09-17T05:23:28.739890+0000","last_clean":"2024-09-17T05:23:28.739890+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:23:28.739890+0000","last_undegraded":"2024-09-17T05:23:28.739890+0000","last_fullsized":"2024-09-17T05:23:28.739890+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509503,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33000,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338840,"statfs":{"total":96636764160,"available":96602972160,"internally_reserved":0,"allocated":1851392,"data_stored":1134939,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509503,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32420,"kb_used_data":1224,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339420,"statfs":{"total":96636764160,"available":96603566080,"internally_reserved":0,"allocated":1253376,"data_stored":544025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509502,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32424,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339416,"statfs":{"total":96636764160,"available":96603561984,"internally_reserved":0,"allocated":1257472,"data_stored":544559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509502,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1249280,"data_stored":543955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509502,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32432,"kb_used_data":1236,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339408,"statfs":{"total":96636764160,"available":96603553792,"internally_reserved":0,"allocated":1265664,"data_stored":545637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509503,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32408,"kb_used_data":1220,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339432,"statfs":{"total":96636764160,"available":96603578368,"internally_reserved":0,"allocated":1249280,"data_stored":543955,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509502,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32416,"kb_used_data":1228,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339424,"statfs":{"total":96636764160,"available":96603570176,"internally_reserved":0,"allocated":1257472,"data_stored":544079,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574911,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33016,"kb_used_data":1820,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338824,"statfs":{"total":96636764160,"available":96602955776,"internally_reserved":0,"allocated":1863680,"data_stored":1136047,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1724,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":16,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":17,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:23:31.146 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:23:31.146 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:23:31.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.289+0000 7f7479156640 1 -- 172.21.15.81:0/758517685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 msgr2=0x7f74740cabf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.289+0000 7f7479156640 1 --2- 172.21.15.81:0/758517685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740cabf0 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f74740af620 tx=0x7f746402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.289+0000 7f7479156640 1 -- 172.21.15.81:0/758517685 shutdown_connections 2024-09-17T05:23:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.289+0000 7f7479156640 1 --2- 172.21.15.81:0/758517685 >> v2:172.21.15.160:3300/0 conn(0x7f747415f270 0x7f7474072cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.289+0000 7f7479156640 1 --2- 172.21.15.81:0/758517685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740cabf0 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.289+0000 7f7479156640 1 -- 172.21.15.81:0/758517685 >> 172.21.15.81:0/758517685 conn(0x7f74740b1700 msgr2=0x7f74740b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.289+0000 7f7479156640 1 -- 172.21.15.81:0/758517685 shutdown_connections 2024-09-17T05:23:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.290+0000 7f7479156640 1 -- 172.21.15.81:0/758517685 wait complete. 2024-09-17T05:23:31.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.291+0000 7f7479156640 1 Processor -- start 2024-09-17T05:23:31.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.291+0000 7f7479156640 1 -- start start 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f7479156640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74740cc3f0 0x7f74741f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f7479156640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f7479156640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f747415f270 0x7f7474147660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f7479156640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f747406f590 con 0x7f747415aa00 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f7479156640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f747406f410 con 0x7f747415f270 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f7479156640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f747406f710 con 0x7f74740cc3f0 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740c7c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45778/0 (socket says 172.21.15.81:45778) 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 -- 172.21.15.81:0/2644462463 learned_addr learned my addr 172.21.15.81:0/2644462463 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f7472d9d640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74740cc3f0 0x7f74741f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747359e640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f747415f270 0x7f7474147660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 -- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74740cc3f0 msgr2=0x7f74741f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74740cc3f0 0x7f74741f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 -- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f747415f270 msgr2=0x7f7474147660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f747415f270 0x7f7474147660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 -- 172.21.15.81:0/2644462463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74740b2c10 con 0x7f747415aa00 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747359e640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f747415f270 0x7f7474147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.292+0000 7f747259c640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740c7c50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f745c00b440 tx=0x7f745c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:31.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.293+0000 7f746b7fe640 1 -- 172.21.15.81:0/2644462463 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c015020 con 0x7f747415aa00 2024-09-17T05:23:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.293+0000 7f746b7fe640 1 -- 172.21.15.81:0/2644462463 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f745c011980 con 0x7f747415aa00 2024-09-17T05:23:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.293+0000 7f746b7fe640 1 -- 172.21.15.81:0/2644462463 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f745c011dd0 con 0x7f747415aa00 2024-09-17T05:23:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.293+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74740b2ef0 con 0x7f747415aa00 2024-09-17T05:23:31.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.293+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74740b31d0 con 0x7f747415aa00 2024-09-17T05:23:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.294+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74740b46c0 con 0x7f747415aa00 2024-09-17T05:23:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.294+0000 7f746b7fe640 1 -- 172.21.15.81:0/2644462463 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f745c018020 con 0x7f747415aa00 2024-09-17T05:23:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.295+0000 7f746b7fe640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7454078cb0 0x7f745407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.295+0000 7f746b7fe640 1 -- 172.21.15.81:0/2644462463 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f745c09b060 con 0x7f747415aa00 2024-09-17T05:23:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.295+0000 7f7472d9d640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7454078cb0 0x7f745407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.295+0000 7f7472d9d640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7454078cb0 0x7f745407b170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7464033000 tx=0x7f7464004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:31.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.299+0000 7f746b7fe640 1 -- 172.21.15.81:0/2644462463 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f745c01f020 con 0x7f747415aa00 2024-09-17T05:23:31.543 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.543+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f74740cfe00 con 0x7f747415aa00 2024-09-17T05:23:31.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.546+0000 7f746b7fe640 1 -- 172.21.15.81:0/2644462463 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) ==== 190+0+147 (secure 0 0 0) 0x7f745c00d040 con 0x7f747415aa00 2024-09-17T05:23:31.546 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:23:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:23:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:23:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:23:31.546 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:23:31.546 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:23:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7454078cb0 msgr2=0x7f745407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7454078cb0 0x7f745407b170 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7464033000 tx=0x7f7464004730 comp rx=0 tx=0).stop 2024-09-17T05:23:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 msgr2=0x7f74740c7c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740c7c50 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f745c00b440 tx=0x7f745c00b900 comp rx=0 tx=0).stop 2024-09-17T05:23:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 shutdown_connections 2024-09-17T05:23:31.548 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7454078cb0 0x7f745407b170 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f747415f270 0x7f7474147660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f747415aa00 0x7f74740c7c50 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 --2- 172.21.15.81:0/2644462463 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f74740cc3f0 0x7f74741f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 >> 172.21.15.81:0/2644462463 conn(0x7f74740b1700 msgr2=0x7f74740ad8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 shutdown_connections 2024-09-17T05:23:31.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.548+0000 7f7479156640 1 -- 172.21.15.81:0/2644462463 wait complete. 2024-09-17T05:23:31.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:23:31.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.661+0000 7fa327710640 1 -- 172.21.15.81:0/2404726874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c004040 msgr2=0x7fa30c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.661+0000 7fa327710640 1 --2- 172.21.15.81:0/2404726874 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa30c004040 0x7fa30c004800 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c710 tx=0x7fa30c005830 comp rx=0 tx=0).stop 2024-09-17T05:23:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.661+0000 7fa325cad640 1 -- 172.21.15.81:0/2404726874 reap_dead start 2024-09-17T05:23:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.661+0000 7fa327710640 1 -- 172.21.15.81:0/2404726874 shutdown_connections 2024-09-17T05:23:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.661+0000 7fa327710640 1 -- 172.21.15.81:0/2404726874 >> 172.21.15.81:0/2404726874 conn(0x7fa3200b1690 msgr2=0x7fa3200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.661+0000 7fa327710640 1 -- 172.21.15.81:0/2404726874 shutdown_connections 2024-09-17T05:23:31.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.661+0000 7fa327710640 1 -- 172.21.15.81:0/2404726874 wait complete. 2024-09-17T05:23:31.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.662+0000 7fa327710640 1 Processor -- start 2024-09-17T05:23:31.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.662+0000 7fa327710640 1 -- start start 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa327710640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa30c004040 0x7fa32014f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa327710640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa32013b400 0x7fa3201f6200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa327710640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3200b3370 0x7fa3200b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa327710640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa32013f620 con 0x7fa32013b400 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa327710640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa32013f4a0 con 0x7fa3200b3370 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa327710640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa32006fc50 con 0x7fa30c004040 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa32013b400 0x7fa3201f6200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa32013b400 0x7fa3201f6200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45796/0 (socket says 172.21.15.81:45796) 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 -- 172.21.15.81:0/1951234624 learned_addr learned my addr 172.21.15.81:0/1951234624 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa3254ac640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa30c004040 0x7fa32014f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa325cad640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3200b3370 0x7fa3200b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 -- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa30c004040 msgr2=0x7fa32014f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa30c004040 0x7fa32014f8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 -- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3200b3370 msgr2=0x7fa3200b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3200b3370 0x7fa3200b37f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.663+0000 7fa324cab640 1 -- 172.21.15.81:0/1951234624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3201e56d0 con 0x7fa32013b400 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.664+0000 7fa324cab640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa32013b400 0x7fa3201f6200 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c630 tx=0x7fa310006380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.664+0000 7fa315ffb640 1 -- 172.21.15.81:0/1951234624 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004830 con 0x7fa32013b400 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.664+0000 7fa315ffb640 1 -- 172.21.15.81:0/1951234624 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa310039070 con 0x7fa32013b400 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.664+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3200cc490 con 0x7fa32013b400 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.664+0000 7fa315ffb640 1 -- 172.21.15.81:0/1951234624 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa310004d80 con 0x7fa32013b400 2024-09-17T05:23:31.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.664+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3200cca50 con 0x7fa32013b400 2024-09-17T05:23:31.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.665+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa32006f540 con 0x7fa32013b400 2024-09-17T05:23:31.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.666+0000 7fa315ffb640 1 -- 172.21.15.81:0/1951234624 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fa310043030 con 0x7fa32013b400 2024-09-17T05:23:31.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.666+0000 7fa315ffb640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa304078cb0 0x7fa30407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:31.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.666+0000 7fa3254ac640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa304078cb0 0x7fa30407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:31.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.666+0000 7fa315ffb640 1 -- 172.21.15.81:0/1951234624 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fa3100ba9b0 con 0x7fa32013b400 2024-09-17T05:23:31.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.667+0000 7fa3254ac640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa304078cb0 0x7fa30407b170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0045b0 tx=0x7fa31c00b260 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:31.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.671+0000 7fa315ffb640 1 -- 172.21.15.81:0/1951234624 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa31004a020 con 0x7fa32013b400 2024-09-17T05:23:31.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.884+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa32013c7a0 con 0x7fa32013b400 2024-09-17T05:23:31.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.884+0000 7fa315ffb640 1 -- 172.21.15.81:0/1951234624 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 60 v60) ==== 94+0+5231 (secure 0 0 0) 0x7fa310082cf0 con 0x7fa32013b400 2024-09-17T05:23:31.885 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:31.885 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":60,"btime":"2024-09-17T05:23:29:840034+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1016859110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1016859110},{"type":"v1","addr":"172.21.15.160:6834","nonce":1016859110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2510717284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2510717284},{"type":"v1","addr":"172.21.15.81:6833","nonce":2510717284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3071988430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3071988430},{"type":"v1","addr":"172.21.15.81:6835","nonce":3071988430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:23:27.104253+0000","modified":"2024-09-17T05:23:29.183539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7011},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7011":{"gid":7011,"name":"d","rank":0,"incarnation":57,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/1304519501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":1304519501},{"type":"v1","addr":"172.21.15.160:6835","nonce":1304519501}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7011,"qdb_cluster":[7011]},"id":8}]} 2024-09-17T05:23:31.885 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 60 2024-09-17T05:23:31.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa304078cb0 msgr2=0x7fa30407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa304078cb0 0x7fa30407b170 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa31c0045b0 tx=0x7fa31c00b260 comp rx=0 tx=0).stop 2024-09-17T05:23:31.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa32013b400 msgr2=0x7fa3201f6200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:31.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa32013b400 0x7fa3201f6200 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7fa31000c630 tx=0x7fa310006380 comp rx=0 tx=0).stop 2024-09-17T05:23:31.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 shutdown_connections 2024-09-17T05:23:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa304078cb0 0x7fa30407b170 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3200b3370 0x7fa3200b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa32013b400 0x7fa3201f6200 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 --2- 172.21.15.81:0/1951234624 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa30c004040 0x7fa32014f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 >> 172.21.15.81:0/1951234624 conn(0x7fa3200b1690 msgr2=0x7fa3200b0dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 shutdown_connections 2024-09-17T05:23:31.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:31.886+0000 7fa327710640 1 -- 172.21.15.81:0/1951234624 wait complete. 2024-09-17T05:23:32.300 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 60, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:23:27.104253+0000', 'modified': '2024-09-17T05:23:29.183539+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7011}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7011': {'gid': 7011, 'name': 'd', 'rank': 0, 'incarnation': 57, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.160:6835/1304519501', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6801', 'nonce': 1304519501}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 1304519501}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7011, 'qdb_cluster': [7011]} 2024-09-17T05:23:32.300 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:23:32.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-09-17T05:23:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.403+0000 7f3c63693640 1 -- 172.21.15.81:0/3334587822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 msgr2=0x7f3c5c15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.403+0000 7f3c63693640 1 --2- 172.21.15.81:0/3334587822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c15f750 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c009830 tx=0x7f3c4c02a5c0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.403+0000 7f3c63693640 1 -- 172.21.15.81:0/3334587822 shutdown_connections 2024-09-17T05:23:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.403+0000 7f3c63693640 1 --2- 172.21.15.81:0/3334587822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c15f750 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.403+0000 7f3c63693640 1 -- 172.21.15.81:0/3334587822 >> 172.21.15.81:0/3334587822 conn(0x7f3c5c0b1690 msgr2=0x7f3c5c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.403+0000 7f3c63693640 1 -- 172.21.15.81:0/3334587822 shutdown_connections 2024-09-17T05:23:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.403+0000 7f3c63693640 1 -- 172.21.15.81:0/3334587822 wait complete. 2024-09-17T05:23:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.404+0000 7f3c63693640 1 Processor -- start 2024-09-17T05:23:32.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.404+0000 7f3c63693640 1 -- start start 2024-09-17T05:23:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c63693640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c0aaf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c63693640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c5c0cc900 0x7f3c5c1f2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c63693640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c5c159680 0x7f3c5c1493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c63693640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c0cf560 con 0x7f3c5c0cc490 2024-09-17T05:23:32.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c63693640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c0cf3e0 con 0x7f3c5c159680 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c63693640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c06f130 con 0x7f3c5c0cc900 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c0aaf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c0aaf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45824/0 (socket says 172.21.15.81:45824) 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 -- 172.21.15.81:0/2927295396 learned_addr learned my addr 172.21.15.81:0/2927295396 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c5c0cc900 0x7f3c5c1f2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c61c30640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c5c159680 0x7f3c5c1493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 -- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c5c0cc900 msgr2=0x7f3c5c1f2f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c5c0cc900 0x7f3c5c1f2f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 -- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c5c159680 msgr2=0x7f3c5c1493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c5c159680 0x7f3c5c1493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.405+0000 7f3c6142f640 1 -- 172.21.15.81:0/2927295396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c5c0a9490 con 0x7f3c5c0cc490 2024-09-17T05:23:32.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.406+0000 7f3c61c30640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c5c159680 0x7f3c5c1493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.406+0000 7f3c6142f640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c0aaf00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c3a0 tx=0x7f3c5800c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.406+0000 7f3c51ffb640 1 -- 172.21.15.81:0/2927295396 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58017070 con 0x7f3c5c0cc490 2024-09-17T05:23:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.406+0000 7f3c51ffb640 1 -- 172.21.15.81:0/2927295396 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c580053c0 con 0x7f3c5c0cc490 2024-09-17T05:23:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.406+0000 7f3c51ffb640 1 -- 172.21.15.81:0/2927295396 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58003850 con 0x7f3c5c0cc490 2024-09-17T05:23:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.406+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c5c1f3780 con 0x7f3c5c0cc490 2024-09-17T05:23:32.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.406+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c5c0a9730 con 0x7f3c5c0cc490 2024-09-17T05:23:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.408+0000 7f3c51ffb640 1 -- 172.21.15.81:0/2927295396 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f3c5801a070 con 0x7f3c5c0cc490 2024-09-17T05:23:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.408+0000 7f3c51ffb640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c40078cb0 0x7f3c4007b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.408+0000 7f3c51ffb640 1 -- 172.21.15.81:0/2927295396 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f3c5809a1c0 con 0x7f3c5c0cc490 2024-09-17T05:23:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.408+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c40078cb0 0x7f3c4007b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.408+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c40078cb0 0x7f3c4007b170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c034000 tx=0x7f3c4c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 Processor -- start 2024-09-17T05:23:32.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 -- start start 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89aab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89a85f0 0x5650d89a8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5650d891f820 con 0x5650d89d31b0 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5650d890ec50 con 0x5650d89f2df0 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.409+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5650d8912a60 con 0x5650d89a85f0 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89aab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89aab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45834/0 (socket says 172.21.15.81:45834) 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 -- 172.21.15.81:0/1926005244 learned_addr learned my addr 172.21.15.81:0/1926005244 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c61c30640 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89a85f0 0x5650d89a8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 -- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89a85f0 msgr2=0x5650d89a8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89a85f0 0x5650d89a8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 -- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 msgr2=0x5650d89f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 -- 172.21.15.81:0/1926005244 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d8670850 con 0x5650d89d31b0 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c6142f640 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89aab20 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c5805f120 tx=0x7f3c580619c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c16ccf7c97e5ef server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c3effd640 1 -- 172.21.15.81:0/1926005244 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c580668e0 con 0x5650d89d31b0 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c3effd640 1 -- 172.21.15.81:0/1926005244 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c5806b790 con 0x5650d89d31b0 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.410+0000 7f3c3effd640 1 -- 172.21.15.81:0/1926005244 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58069bd0 con 0x5650d89d31b0 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 -- 172.21.15.81:0/1926005244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 msgr2=0x5650d89aab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89aab20 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f3c5805f120 tx=0x7f3c580619c0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 -- 172.21.15.81:0/1926005244 shutdown_connections 2024-09-17T05:23:32.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89a85f0 0x5650d89a8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 --2- 172.21.15.81:0/1926005244 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89aab20 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 -- 172.21.15.81:0/1926005244 >> 172.21.15.81:0/1926005244 conn(0x5650d89a96a0 msgr2=0x5650d89ad0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 -- 172.21.15.81:0/1926005244 shutdown_connections 2024-09-17T05:23:32.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 -- 172.21.15.81:0/1926005244 wait complete. 2024-09-17T05:23:32.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 -- start start 2024-09-17T05:23:32.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.411+0000 7f3c66465740 1 Processor -- start 2024-09-17T05:23:32.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c66465740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89d7300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89cb250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89cbbf0 0x5650d8a01a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c66465740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5650d867f620 con 0x5650d89d31b0 2024-09-17T05:23:32.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5650d88b45f0 con 0x5650d89f2df0 2024-09-17T05:23:32.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5650d89a7b30 con 0x5650d89cbbf0 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c66465740 10 client.0 _ll_register_callbacks cb 0x5650d88b80a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.412+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89d7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89d7300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45842/0 (socket says 172.21.15.81:45842) 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 -- 172.21.15.81:0/3597309178 learned_addr learned my addr 172.21.15.81:0/3597309178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89cb250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c61c30640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89cbbf0 0x5650d8a01a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 -- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89cbbf0 msgr2=0x5650d8a01a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89cbbf0 0x5650d8a01a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 -- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 msgr2=0x5650d89cb250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89cb250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 -- 172.21.15.81:0/3597309178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650d86e76b0 con 0x5650d89d31b0 2024-09-17T05:23:32.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c61c30640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89cbbf0 0x5650d8a01a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c6142f640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89d7300 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c58061e40 tx=0x7f3c5805e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fe5fab3e7c6c20 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c37fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c37fff640 1 -- 172.21.15.81:0/3597309178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c580881c0 con 0x5650d89d31b0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c37fff640 1 -- 172.21.15.81:0/3597309178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f3c58069bd0 con 0x5650d89d31b0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c5806b790 con 0x5650d89d31b0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c37fff640 1 -- 172.21.15.81:0/3597309178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3c58069dd0 con 0x5650d89d31b0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 10 client.7137 fetch_fsmap learned FSMap version 60 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5650d8a024a0 con 0x5650d89d31b0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c37fff640 1 -- 172.21.15.81:0/3597309178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c5806b790 con 0x5650d89d31b0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c37fff640 1 -- 172.21.15.81:0/3597309178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f3c58098b10 con 0x5650d89d31b0 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 10 client.7137 fetch_fsmap finished waiting for FSMap version 60 2024-09-17T05:23:32.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 10 client.7137 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 20 client.7137 populate_metadata read hostname 'smithi081' 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a05090 0x5650d8a05470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 4 client.7137 mds_command: new command op to 7011 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.413+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 --> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5650d8921770 con 0x5650d8a05090 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.414+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a05090 0x5650d8a05470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.414+0000 7f3c37fff640 10 client.7137 ms_handle_connect on v2:172.21.15.160:6801/1304519501 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.414+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a05090 0x5650d8a05470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dd8ef3ff3231ba1c server_cookie=7274be94d34713b8 in_seq=0 out_seq=0 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c37fff640 1 -- 172.21.15.81:0/3597309178 <== mds.0 v2:172.21.15.160:6801/1304519501 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5650d8921770 con 0x5650d8a05090 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c37fff640 10 client.7137 handle_command_reply: tid=0 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 client.7137 shutdown 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 msgr2=0x5650d89d7300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89d7300 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f3c58061e40 tx=0x7f3c5805e350 comp rx=0 tx=0).stop 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 shutdown_connections 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89cbbf0 0x5650d8a01a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89cb250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a05090 0x5650d8a05470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 --2- 172.21.15.81:0/3597309178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89d7300 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c37fff640 0 client.7137 ms_handle_reset on v2:172.21.15.160:6801/1304519501 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 >> 172.21.15.81:0/3597309178 conn(0x5650d89a85f0 msgr2=0x5650d89a65d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 shutdown_connections 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 1 -- 172.21.15.81:0/3597309178 wait complete. 2024-09-17T05:23:32.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.415+0000 7f3c66465740 20 client.7137 trim_cache size 0 max 16384 2024-09-17T05:23:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.433+0000 7f3c66465740 1 Processor -- start 2024-09-17T05:23:32.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.433+0000 7f3c66465740 1 -- start start 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89cbbf0 0x5650d89a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c66465740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89f2df0 0x5650d89f0c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c66465740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c1f6b90 con 0x5650d89d31b0 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3c5c0ab900 con 0x5650d89cbbf0 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3c5c1f6540 con 0x5650d89f2df0 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89a8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45850/0 (socket says 172.21.15.81:45850) 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 -- 172.21.15.81:0/3077338822 learned_addr learned my addr 172.21.15.81:0/3077338822 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 -- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89f2df0 msgr2=0x5650d89f0c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89f2df0 0x5650d89f0c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 -- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89cbbf0 msgr2=0x5650d89a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c6142f640 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89cbbf0 0x5650d89a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89cbbf0 0x5650d89a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 -- 172.21.15.81:0/3077338822 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5650d89f2820 con 0x5650d89d31b0 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c6142f640 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89cbbf0 0x5650d89a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.434+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89a8f10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c000c00 tx=0x7f3c4c03f070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a189b46e293fd02 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c3e7fc640 1 -- 172.21.15.81:0/3077338822 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c031660 con 0x5650d89d31b0 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c3e7fc640 1 -- 172.21.15.81:0/3077338822 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c4c058030 con 0x5650d89d31b0 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c3e7fc640 1 -- 172.21.15.81:0/3077338822 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c4c031b10 con 0x5650d89d31b0 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 -- 172.21.15.81:0/3077338822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 msgr2=0x5650d89a8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89a8f10 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c000c00 tx=0x7f3c4c03f070 comp rx=0 tx=0).stop 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 -- 172.21.15.81:0/3077338822 shutdown_connections 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89f2df0 0x5650d89f0c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89d31b0 0x5650d89a8f10 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 --2- 172.21.15.81:0/3077338822 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89cbbf0 0x5650d89a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 -- 172.21.15.81:0/3077338822 >> 172.21.15.81:0/3077338822 conn(0x5650d89a85f0 msgr2=0x5650d89f32b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 -- 172.21.15.81:0/3077338822 shutdown_connections 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.435+0000 7f3c66465740 1 -- 172.21.15.81:0/3077338822 wait complete. 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.436+0000 7f3c66465740 1 -- start start 2024-09-17T05:23:32.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.436+0000 7f3c66465740 1 Processor -- start 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89cbbf0 0x5650d8a69450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89d31b0 0x5650d89a89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89a8f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5650d867f620 con 0x5650d89cbbf0 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5650d88b45f0 con 0x5650d89f2df0 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5650d89ccb60 con 0x5650d89d31b0 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 10 client.0 _ll_register_callbacks cb 0x7f3c58061d30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89cbbf0 0x5650d8a69450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89cbbf0 0x5650d8a69450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45858/0 (socket says 172.21.15.81:45858) 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 -- 172.21.15.81:0/1790524719 learned_addr learned my addr 172.21.15.81:0/1790524719 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89d31b0 0x5650d89a89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c61c30640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89a8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 -- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89d31b0 msgr2=0x5650d89a89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89d31b0 0x5650d89a89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 -- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 msgr2=0x5650d89a8f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89a8f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 -- 172.21.15.81:0/1790524719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5650d89ebfe0 con 0x5650d89cbbf0 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c61c30640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c6142f640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89cbbf0 0x5650d8a69450 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3c58062070 tx=0x7f3c5805e3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de83ed285481bbf1 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c37fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c37fff640 1 -- 172.21.15.81:0/1790524719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c580881c0 con 0x5650d89cbbf0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c37fff640 1 -- 172.21.15.81:0/1790524719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f3c58069bd0 con 0x5650d89cbbf0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3c4c058030 con 0x5650d89cbbf0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c37fff640 1 -- 172.21.15.81:0/1790524719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=60) ==== 24+0+0 (secure 0 0 0) 0x7f3c5806b790 con 0x5650d89cbbf0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 10 client.7143 fetch_fsmap learned FSMap version 60 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.437+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=60,monmap=2+}) -- 0x5650d89ebfe0 con 0x5650d89cbbf0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c37fff640 1 -- 172.21.15.81:0/1790524719 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c4c058030 con 0x5650d89cbbf0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c37fff640 1 -- 172.21.15.81:0/1790524719 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 60) ==== 3502+0+0 (secure 0 0 0) 0x7f3c58060b80 con 0x5650d89cbbf0 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c66465740 10 client.7143 fetch_fsmap finished waiting for FSMap version 60 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c66465740 10 client.7143 resolve_mds: resolved name 'd' to daemon mds.d 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c66465740 20 client.7143 populate_metadata read hostname 'smithi081' 2024-09-17T05:23:32.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c66465740 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a72eb0 0x5650d8a73290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c66465740 4 client.7143 mds_command: new command op to 7011 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 --> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] -- command(tid 0: {"prefix": "status"}) -- 0x5650d891d220 con 0x5650d8a72eb0 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a72eb0 0x5650d8a73290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c37fff640 10 client.7143 ms_handle_connect on v2:172.21.15.160:6801/1304519501 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c60c2e640 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a72eb0 0x5650d8a73290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee822a498d479c88 server_cookie=19cba4d42a36bf0a in_seq=0 out_seq=0 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c37fff640 1 -- 172.21.15.81:0/1790524719 <== mds.0 v2:172.21.15.160:6801/1304519501 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x5650d891d220 con 0x5650d8a72eb0 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c37fff640 10 client.7143 handle_command_reply: tid=0 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.438+0000 7f3c66465740 1 client.7143 shutdown 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89cbbf0 msgr2=0x5650d8a69450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89cbbf0 0x5650d8a69450 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7f3c58062070 tx=0x7f3c5805e3c0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 shutdown_connections 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5650d89f2df0 0x5650d89a8f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5650d89d31b0 0x5650d89a89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.160:6801/1304519501,v1:172.21.15.160:6835/1304519501] conn(0x5650d8a72eb0 0x5650d8a73290 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 --2- 172.21.15.81:0/1790524719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5650d89cbbf0 0x5650d8a69450 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 >> 172.21.15.81:0/1790524719 conn(0x5650d89a85f0 msgr2=0x5650d89eb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c37fff640 0 client.7143 ms_handle_reset on v2:172.21.15.160:6801/1304519501 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 shutdown_connections 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 1 -- 172.21.15.81:0/1790524719 wait complete. 2024-09-17T05:23:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c66465740 20 client.7143 trim_cache size 0 max 16384 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7011, 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.6881564280000001, 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 60, 2024-09-17T05:23:32.448 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 101, 2024-09-17T05:23:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 101, 2024-09-17T05:23:32.449 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.4246172710000007 2024-09-17T05:23:32.449 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:32.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c40078cb0 msgr2=0x7f3c4007b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c40078cb0 0x7f3c4007b170 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c034000 tx=0x7f3c4c004730 comp rx=0 tx=0).stop 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 msgr2=0x7f3c5c0aaf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c0aaf00 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c3a0 tx=0x7f3c5800c860 comp rx=0 tx=0).stop 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 shutdown_connections 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c40078cb0 0x7f3c4007b170 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c5c159680 0x7f3c5c1493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c5c0cc900 0x7f3c5c1f2f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 --2- 172.21.15.81:0/2927295396 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c5c0cc490 0x7f3c5c0aaf00 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 >> 172.21.15.81:0/2927295396 conn(0x7f3c5c0b1690 msgr2=0x7f3c5c15b030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 shutdown_connections 2024-09-17T05:23:32.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.439+0000 7f3c63693640 1 -- 172.21.15.81:0/2927295396 wait complete. 2024-09-17T05:23:32.451 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.551+0000 7f96e7ff8640 1 -- 172.21.15.81:0/4141104125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e0151370 msgr2=0x7f96e00cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.551+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/4141104125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e0151370 0x7f96e00cef30 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f96d8005fd0 tx=0x7f96d802a620 comp rx=0 tx=0).stop 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.551+0000 7f96e7ff8640 1 -- 172.21.15.81:0/4141104125 shutdown_connections 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.551+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/4141104125 >> v2:172.21.15.160:3300/0 conn(0x7f96e00b3140 0x7f96e00cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.551+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/4141104125 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e0151370 0x7f96e00cef30 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.551+0000 7f96e7ff8640 1 -- 172.21.15.81:0/4141104125 >> 172.21.15.81:0/4141104125 conn(0x7f96e00b1690 msgr2=0x7f96e00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.552+0000 7f96e7ff8640 1 -- 172.21.15.81:0/4141104125 shutdown_connections 2024-09-17T05:23:32.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.552+0000 7f96e7ff8640 1 -- 172.21.15.81:0/4141104125 wait complete. 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 Processor -- start 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 -- start start 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96e00725a0 0x7f96e00cdff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e00b3140 0x7f96e0141590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96e0151370 0x7f96e0146950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f96e006ebe0 con 0x7f96e00b3140 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f96e006ea60 con 0x7f96e0151370 2024-09-17T05:23:32.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e7ff8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f96e006f9f0 con 0x7f96e00725a0 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.553+0000 7f96e5593640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e00b3140 0x7f96e0141590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e00b3140 0x7f96e0141590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45862/0 (socket says 172.21.15.81:45862) 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 -- 172.21.15.81:0/2844490059 learned_addr learned my addr 172.21.15.81:0/2844490059 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5d94640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96e00725a0 0x7f96e00cdff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e6595640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96e0151370 0x7f96e0146950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 -- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96e00725a0 msgr2=0x7f96e00cdff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96e00725a0 0x7f96e00cdff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 -- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96e0151370 msgr2=0x7f96e0146950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96e0151370 0x7f96e0146950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 -- 172.21.15.81:0/2844490059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e00ce890 con 0x7f96e00b3140 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e6595640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96e0151370 0x7f96e0146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:32.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e5593640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e00b3140 0x7f96e0141590 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f96d000b4a0 tx=0x7f96d000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96d67fc640 1 -- 172.21.15.81:0/2844490059 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0014070 con 0x7f96e00b3140 2024-09-17T05:23:32.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96d67fc640 1 -- 172.21.15.81:0/2844490059 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f96d0010700 con 0x7f96e00b3140 2024-09-17T05:23:32.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96d67fc640 1 -- 172.21.15.81:0/2844490059 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96d0010b50 con 0x7f96e00b3140 2024-09-17T05:23:32.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e00cebd0 con 0x7f96e00b3140 2024-09-17T05:23:32.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.554+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e00ce530 con 0x7f96e00b3140 2024-09-17T05:23:32.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.555+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e0072a10 con 0x7f96e00b3140 2024-09-17T05:23:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.556+0000 7f96d67fc640 1 -- 172.21.15.81:0/2844490059 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f96d0017070 con 0x7f96e00b3140 2024-09-17T05:23:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.556+0000 7f96d67fc640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96c4078cb0 0x7f96c407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.557+0000 7f96e5d94640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96c4078cb0 0x7f96c407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.557+0000 7f96d67fc640 1 -- 172.21.15.81:0/2844490059 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f96d009a990 con 0x7f96e00b3140 2024-09-17T05:23:32.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.557+0000 7f96e5d94640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96c4078cb0 0x7f96c407b170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96d8033000 tx=0x7f96d8004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:32.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.561+0000 7f96d67fc640 1 -- 172.21.15.81:0/2844490059 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f96e00cebd0 con 0x7f96e00b3140 2024-09-17T05:23:32.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.771+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f96e00cedb0 con 0x7f96e00b3140 2024-09-17T05:23:32.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.772+0000 7f96d67fc640 1 -- 172.21.15.81:0/2844490059 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) ==== 53+0+73 (secure 0 0 0) 0x7f96d0069020 con 0x7f96e00b3140 2024-09-17T05:23:32.773 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:23:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96c4078cb0 msgr2=0x7f96c407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96c4078cb0 0x7f96c407b170 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f96d8033000 tx=0x7f96d8004730 comp rx=0 tx=0).stop 2024-09-17T05:23:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e00b3140 msgr2=0x7f96e0141590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e00b3140 0x7f96e0141590 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f96d000b4a0 tx=0x7f96d000b960 comp rx=0 tx=0).stop 2024-09-17T05:23:32.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 shutdown_connections 2024-09-17T05:23:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96c4078cb0 0x7f96c407b170 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f96e0151370 0x7f96e0146950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96e00b3140 0x7f96e0141590 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 --2- 172.21.15.81:0/2844490059 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96e00725a0 0x7f96e00cdff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 >> 172.21.15.81:0/2844490059 conn(0x7f96e00b1690 msgr2=0x7f96e00cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 shutdown_connections 2024-09-17T05:23:32.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:32.774+0000 7f96e7ff8640 1 -- 172.21.15.81:0/2844490059 wait complete. 2024-09-17T05:23:32.785 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:23:32.786 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:23:32.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:32.786 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:23:32.802 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:32.803 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:23:32.804 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42505sec preferred_lft 42505sec 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:32.805 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:32.806 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:23:32.806 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:32.806 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:32.806 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:32.806 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:23:32.806 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:32.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:32.806 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:23:32.865 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:23:32.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:32.867 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:23:32.923 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:23:32.923 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:23:32.923 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:23:32.923 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:23:32.923 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:23:32.924 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:23:32.924 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:23:32.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:23:32.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:23:32.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:23:32.924 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:23:33.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:33 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:23:33.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:33.049 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:33.049 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:23:33.064 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:23:33.065 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:23:33.065 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:23:33.065 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:33.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:23:33.129 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:23:33.130 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:33.130 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:33.185 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:23:33.185 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:33.185 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:33.240 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:23:33.305 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:33.362 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:23:33.362 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:23:33.362 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:23:33.362 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:23:33.362 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:33.363 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:23:33.364 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:33.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:33.366 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:23:33.418 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:23:33.418 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:23:33.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:23:33.484 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:33.541 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:23:33.541 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:33.542 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:23:33.543 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:23:33.544 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:33.545 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:23:33.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:23:33.540+0000 7f05d0ce4480 -1 init, newargv = 0x55b5ab9855c0 newargc=15 2024-09-17T05:23:33.545 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[64075]: starting ceph client 2024-09-17T05:23:33.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[64075]: starting fuse 2024-09-17T05:23:33.560 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:23:33.560 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:23:33.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:23:33.561 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:23:33.562 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:23:33.563 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:23:33.678 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.64075.asok 2024-09-17T05:23:33.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:33 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:33.689 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.64075.asok 2024-09-17T05:23:33.690 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:33.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.64075.asok status 2024-09-17T05:23:33.837 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "64075", 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:23:33.838 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7155, 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7155 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 601970373 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:33.839 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 601970373 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.7155 192.168.0.1:0/601970373", 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/601970373", 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 60, 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 101, 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:23:33.840 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:23:33.841 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:33.847 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:33.848 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:23:33.848 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:33.864 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:23:33.864 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:33.864 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:33.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:23:33.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:23:34.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 -- 172.21.15.81:0/2832367042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c740ceb70 msgr2=0x7f8c740cd1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:34.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 --2- 172.21.15.81:0/2832367042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c740ceb70 0x7f8c740cd1f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c005fd0 tx=0x7f8c6c02a540 comp rx=0 tx=0).stop 2024-09-17T05:23:34.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 -- 172.21.15.81:0/2832367042 shutdown_connections 2024-09-17T05:23:34.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 --2- 172.21.15.81:0/2832367042 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c740ceb70 0x7f8c740cd1f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 --2- 172.21.15.81:0/2832367042 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c740d2760 0x7f8c740ce630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 -- 172.21.15.81:0/2832367042 >> 172.21.15.81:0/2832367042 conn(0x7f8c740d1c40 msgr2=0x7f8c740d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:34.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 -- 172.21.15.81:0/2832367042 shutdown_connections 2024-09-17T05:23:34.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.072+0000 7f8c79272640 1 -- 172.21.15.81:0/2832367042 wait complete. 2024-09-17T05:23:34.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.073+0000 7f8c79272640 1 Processor -- start 2024-09-17T05:23:34.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.073+0000 7f8c79272640 1 -- start start 2024-09-17T05:23:34.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c79272640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c740ceb70 0x7f8c740c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:34.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c79272640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c740d2760 0x7f8c74153a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c79272640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c7415bd30 0x7f8c740c8070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c79272640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8c740cf590 con 0x7f8c7415bd30 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c79272640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8c740cf410 con 0x7f8c740ceb70 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c79272640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8c740cd730 con 0x7f8c740d2760 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c7415bd30 0x7f8c740c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c7415bd30 0x7f8c740c8070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40792/0 (socket says 172.21.15.81:40792) 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 -- 172.21.15.81:0/2219090772 learned_addr learned my addr 172.21.15.81:0/2219090772 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c727fc640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c740d2760 0x7f8c74153a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c72ffd640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c740ceb70 0x7f8c740c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 -- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c740d2760 msgr2=0x7f8c74153a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c740d2760 0x7f8c74153a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.077 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 -- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c740ceb70 msgr2=0x7f8c740c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c740ceb70 0x7f8c740c6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c737fe640 1 -- 172.21.15.81:0/2219090772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c7415c440 con 0x7f8c7415bd30 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.074+0000 7f8c72ffd640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c740ceb70 0x7f8c740c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.075+0000 7f8c737fe640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c7415bd30 0x7f8c740c8070 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c006010 tx=0x7f8c6c003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.075+0000 7f8c6b7fe640 1 -- 172.21.15.81:0/2219090772 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c03f070 con 0x7f8c7415bd30 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.075+0000 7f8c6b7fe640 1 -- 172.21.15.81:0/2219090772 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8c6c0047a0 con 0x7f8c7415bd30 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.075+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c7415c6e0 con 0x7f8c7415bd30 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.075+0000 7f8c6b7fe640 1 -- 172.21.15.81:0/2219090772 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c6c035030 con 0x7f8c7415bd30 2024-09-17T05:23:34.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.075+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c7415cca0 con 0x7f8c7415bd30 2024-09-17T05:23:34.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.076+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c740cf1f0 con 0x7f8c7415bd30 2024-09-17T05:23:34.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.076+0000 7f8c6b7fe640 1 -- 172.21.15.81:0/2219090772 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f8c6c042070 con 0x7f8c7415bd30 2024-09-17T05:23:34.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.077+0000 7f8c6b7fe640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8c54078cb0 0x7f8c5407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.077+0000 7f8c6b7fe640 1 -- 172.21.15.81:0/2219090772 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f8c6c0bbc00 con 0x7f8c7415bd30 2024-09-17T05:23:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.077+0000 7f8c72ffd640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8c54078cb0 0x7f8c5407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:34.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.077+0000 7f8c72ffd640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8c54078cb0 0x7f8c5407b170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001da0 tx=0x7f8c64009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:34.082 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.081+0000 7f8c6b7fe640 1 -- 172.21.15.81:0/2219090772 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8c6c0c2080 con 0x7f8c7415bd30 2024-09-17T05:23:34.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.299+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f8c740cd1d0 con 0x7f8c7415bd30 2024-09-17T05:23:34.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.299+0000 7f8c6b7fe640 1 -- 172.21.15.81:0/2219090772 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v60) ==== 53+0+73 (secure 0 0 0) 0x7f8c6c0838f0 con 0x7f8c7415bd30 2024-09-17T05:23:34.300 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:23:34.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8c54078cb0 msgr2=0x7f8c5407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8c54078cb0 0x7f8c5407b170 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f8c64001da0 tx=0x7f8c64009040 comp rx=0 tx=0).stop 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c7415bd30 msgr2=0x7f8c740c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c7415bd30 0x7f8c740c8070 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f8c6c006010 tx=0x7f8c6c003820 comp rx=0 tx=0).stop 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 shutdown_connections 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8c7415bd30 0x7f8c740c8070 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8c740d2760 0x7f8c74153a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8c54078cb0 0x7f8c5407b170 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 --2- 172.21.15.81:0/2219090772 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8c740ceb70 0x7f8c740c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 >> 172.21.15.81:0/2219090772 conn(0x7f8c740d1c40 msgr2=0x7f8c740d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 shutdown_connections 2024-09-17T05:23:34.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:34.301+0000 7f8c79272640 1 -- 172.21.15.81:0/2219090772 wait complete. 2024-09-17T05:23:34.313 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:23:34.313 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:23:34.314 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:23:34.314 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:23:34.314 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:34.314 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:23:34.314 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:23:34.314 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:23:34.314 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:23:34.314 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:34.314 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:23:34.335 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:23:34.335 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:23:34.335 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:23:34.335 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:34.335 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:23:34.336 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42501sec preferred_lft 42501sec 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:34.337 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:23:34.338 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:23:34.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:34.339 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:23:34.404 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:23:34.405 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:34.406 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:23:34.464 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:23:34.465 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:23:34.465 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:23:34.465 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:23:34.465 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:23:34.465 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:23:34.465 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:23:34.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:23:34.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:23:34.466 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:23:34.466 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:23:34.558 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:23:34 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:23:34.592 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:23:34 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:34.598 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:34.598 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:23:34.614 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:23:34.614 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:23:34.615 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:23:34.615 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:34.615 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:23:34.680 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:23:34.680 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:34.680 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:34.736 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:23:34.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:23:34.736 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:34.792 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:23:34.857 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:34.913 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:23:34.913 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:23:34.913 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:23:34.913 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:23:34.914 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:23:34.915 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:23:34.916 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:23:34.916 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:23:34.916 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:34.916 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:34.916 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:34.916 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:34.917 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:34.917 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:23:34.973 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:23:34.973 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:23:35.016 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:23:35.041 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:23:35.099 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:23:35.098+0000 7fee6cd82480 -1 init, newargv = 0x55a6fe3204a0 newargc=15 2024-09-17T05:23:35.100 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[47395]: starting ceph client 2024-09-17T05:23:35.100 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:23:35.101 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:23:35.102 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:35.103 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:23:35.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:35.104 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:23:35.105 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[47395]: starting fuse 2024-09-17T05:23:35.119 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:23:35.119 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:23:35.119 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:23:35.120 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:23:35.121 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:23:35.122 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:23:35.237 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.47395.asok 2024-09-17T05:23:35.240 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:23:35 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:23:35.247 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.47395.asok 2024-09-17T05:23:35.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:35.248 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.47395.asok status 2024-09-17T05:23:35.381 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:23:35.381 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:23:35.381 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:23:35.381 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:23:35.381 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:23:35.381 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:23:35.381 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "47395", 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 6427, 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 6427 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:23:35.382 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1985160207 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1985160207 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.6427 192.168.0.1:0/1985160207", 2024-09-17T05:23:35.383 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/1985160207", 2024-09-17T05:23:35.384 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:23:35.384 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 60, 2024-09-17T05:23:35.384 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 101, 2024-09-17T05:23:35.384 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:23:35.384 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:23:35.384 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:23:35.384 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:23:35.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:35.389 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:23:35.389 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:35.405 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:23:35.406 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:35.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:35.406 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:23:35.470 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:23:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 -- 172.21.15.81:0/501328999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c8070550 msgr2=0x7ff9c8070c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/501328999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c8070550 0x7ff9c8070c30 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0005fd0 tx=0x7ff9c002aa10 comp rx=0 tx=0).stop 2024-09-17T05:23:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 -- 172.21.15.81:0/501328999 shutdown_connections 2024-09-17T05:23:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/501328999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c8070550 0x7ff9c8070c30 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/501328999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9c815ad30 0x7ff9c80b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 -- 172.21.15.81:0/501328999 >> 172.21.15.81:0/501328999 conn(0x7ff9c80d0b90 msgr2=0x7ff9c80d0fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:35.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 -- 172.21.15.81:0/501328999 shutdown_connections 2024-09-17T05:23:35.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.583+0000 7ff9d05f8640 1 -- 172.21.15.81:0/501328999 wait complete. 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.584+0000 7ff9d05f8640 1 Processor -- start 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.584+0000 7ff9d05f8640 1 -- start start 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9d05f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9c8070550 0x7ff9c8144730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9d05f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9c815a950 0x7ff9c8143f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9d05f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c815ad30 0x7ff9c806cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9d05f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c80b5220 con 0x7ff9c815ad30 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9d05f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c8071680 con 0x7ff9c8070550 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9d05f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff9c80b53a0 con 0x7ff9c815a950 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9ceb95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c815ad30 0x7ff9c806cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:35.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9ceb95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c815ad30 0x7ff9c806cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40814/0 (socket says 172.21.15.81:40814) 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9ceb95640 1 -- 172.21.15.81:0/360781466 learned_addr learned my addr 172.21.15.81:0/360781466 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9cdb93640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9c815a950 0x7ff9c8143f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.585+0000 7ff9ce394640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9c8070550 0x7ff9c8144730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9ceb95640 1 -- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9c815a950 msgr2=0x7ff9c8143f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9ceb95640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9c815a950 0x7ff9c8143f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9ceb95640 1 -- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9c8070550 msgr2=0x7ff9c8144730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9ceb95640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9c8070550 0x7ff9c8144730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9ceb95640 1 -- 172.21.15.81:0/360781466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c80c69c0 con 0x7ff9c815ad30 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9ceb95640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c815ad30 0x7ff9c806cb40 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009d90 tx=0x7ff9c0003e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9beffd640 1 -- 172.21.15.81:0/360781466 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0047070 con 0x7ff9c815ad30 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9beffd640 1 -- 172.21.15.81:0/360781466 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff9c002f670 con 0x7ff9c815ad30 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c80c66e0 con 0x7ff9c815ad30 2024-09-17T05:23:35.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9beffd640 1 -- 172.21.15.81:0/360781466 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9c0033050 con 0x7ff9c815ad30 2024-09-17T05:23:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.586+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c80cbad0 con 0x7ff9c815ad30 2024-09-17T05:23:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.587+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c80b5b20 con 0x7ff9c815ad30 2024-09-17T05:23:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.588+0000 7ff9beffd640 1 -- 172.21.15.81:0/360781466 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7ff9c004a070 con 0x7ff9c815ad30 2024-09-17T05:23:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.588+0000 7ff9beffd640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff9ac078cb0 0x7ff9ac07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:35.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.588+0000 7ff9beffd640 1 -- 172.21.15.81:0/360781466 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7ff9c00bc0b0 con 0x7ff9c815ad30 2024-09-17T05:23:35.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.588+0000 7ff9ce394640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff9ac078cb0 0x7ff9ac07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:35.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.588+0000 7ff9ce394640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff9ac078cb0 0x7ff9ac07b170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40016b0 tx=0x7ff9c4009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:35.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.592+0000 7ff9beffd640 1 -- 172.21.15.81:0/360781466 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff9c0084370 con 0x7ff9c815ad30 2024-09-17T05:23:35.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:35.806+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7ff9c80b5840 con 0x7ff9c815ad30 2024-09-17T05:23:36.140 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.139+0000 7ff9beffd640 1 -- 172.21.15.81:0/360781466 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v61) ==== 136+0+0 (secure 0 0 0) 0x7ff9c0083c70 con 0x7ff9c815ad30 2024-09-17T05:23:36.142 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff9ac078cb0 msgr2=0x7ff9ac07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff9ac078cb0 0x7ff9ac07b170 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff9c40016b0 tx=0x7ff9c4009040 comp rx=0 tx=0).stop 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c815ad30 msgr2=0x7ff9c806cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c815ad30 0x7ff9c806cb40 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7ff9c0009d90 tx=0x7ff9c0003e80 comp rx=0 tx=0).stop 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 shutdown_connections 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff9c815ad30 0x7ff9c806cb40 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff9c815a950 0x7ff9c8143f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff9ac078cb0 0x7ff9ac07b170 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.141+0000 7ff9d05f8640 1 --2- 172.21.15.81:0/360781466 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff9c8070550 0x7ff9c8144730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.142+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 >> 172.21.15.81:0/360781466 conn(0x7ff9c80d0b90 msgr2=0x7ff9c8157f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:36.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.142+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 shutdown_connections 2024-09-17T05:23:36.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.142+0000 7ff9d05f8640 1 -- 172.21.15.81:0/360781466 wait complete. 2024-09-17T05:23:36.154 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:23:36.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 -- 172.21.15.81:0/2437457154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d80d49c0 msgr2=0x7f95d80d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 --2- 172.21.15.81:0/2437457154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d80d49c0 0x7f95d80d0630 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f95c0005fd0 tx=0x7f95c002a530 comp rx=0 tx=0).stop 2024-09-17T05:23:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 -- 172.21.15.81:0/2437457154 shutdown_connections 2024-09-17T05:23:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 --2- 172.21.15.81:0/2437457154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d80d49c0 0x7f95d80d0630 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 --2- 172.21.15.81:0/2437457154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d815df90 0x7f95d80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 -- 172.21.15.81:0/2437457154 >> 172.21.15.81:0/2437457154 conn(0x7f95d80d3ea0 msgr2=0x7f95d80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 -- 172.21.15.81:0/2437457154 shutdown_connections 2024-09-17T05:23:36.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.255+0000 7f95dc833640 1 -- 172.21.15.81:0/2437457154 wait complete. 2024-09-17T05:23:36.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 Processor -- start 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 -- start start 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d80d49c0 0x7f95d80cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d815df90 0x7f95d809db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d8162480 0x7f95d8160850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f95d80d0f00 con 0x7f95d815df90 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f95d80d0d80 con 0x7f95d8162480 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95dc833640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f95d80b3f10 con 0x7f95d80d49c0 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d815df90 0x7f95d809db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95cffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d815df90 0x7f95d809db80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40830/0 (socket says 172.21.15.81:40830) 2024-09-17T05:23:36.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.257+0000 7f95cffff640 1 -- 172.21.15.81:0/1826819007 learned_addr learned my addr 172.21.15.81:0/1826819007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95d659c640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d80d49c0 0x7f95d80cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95d6d9d640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d8162480 0x7f95d8160850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95cffff640 1 -- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d80d49c0 msgr2=0x7f95d80cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95cffff640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d80d49c0 0x7f95d80cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95cffff640 1 -- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d8162480 msgr2=0x7f95d8160850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95cffff640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d8162480 0x7f95d8160850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95cffff640 1 -- 172.21.15.81:0/1826819007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95d80cacf0 con 0x7f95d815df90 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95cffff640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d815df90 0x7f95d809db80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f95c0000c00 tx=0x7f95c0003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95ceffd640 1 -- 172.21.15.81:0/1826819007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c003f070 con 0x7f95d815df90 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95ceffd640 1 -- 172.21.15.81:0/1826819007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f95c00047a0 con 0x7f95d815df90 2024-09-17T05:23:36.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95d80cbeb0 con 0x7f95d815df90 2024-09-17T05:23:36.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95ceffd640 1 -- 172.21.15.81:0/1826819007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0035030 con 0x7f95d815df90 2024-09-17T05:23:36.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.258+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95d80cc470 con 0x7f95d815df90 2024-09-17T05:23:36.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.259+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95d80b4430 con 0x7f95d815df90 2024-09-17T05:23:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.260+0000 7f95ceffd640 1 -- 172.21.15.81:0/1826819007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f95c0042070 con 0x7f95d815df90 2024-09-17T05:23:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.260+0000 7f95ceffd640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95b8078cb0 0x7f95b807b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.260+0000 7f95ceffd640 1 -- 172.21.15.81:0/1826819007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f95c00bc070 con 0x7f95d815df90 2024-09-17T05:23:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.260+0000 7f95d659c640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95b8078cb0 0x7f95b807b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.261+0000 7f95d659c640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95b8078cb0 0x7f95b807b170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f95c8005fd0 tx=0x7f95c800b390 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:36.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.264+0000 7f95ceffd640 1 -- 172.21.15.81:0/1826819007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f95d80cacf0 con 0x7f95d815df90 2024-09-17T05:23:36.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.462+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f95d808d590 con 0x7f95b8078cb0 2024-09-17T05:23:36.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.464+0000 7f95ceffd640 1 -- 172.21.15.81:0/1826819007 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f95d808d590 con 0x7f95b8078cb0 2024-09-17T05:23:36.465 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:23:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:23:36.465 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:36.465 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:23:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95b8078cb0 msgr2=0x7f95b807b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95b8078cb0 0x7f95b807b170 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f95c8005fd0 tx=0x7f95c800b390 comp rx=0 tx=0).stop 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d815df90 msgr2=0x7f95d809db80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d815df90 0x7f95d809db80 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f95c0000c00 tx=0x7f95c0003910 comp rx=0 tx=0).stop 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 shutdown_connections 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95b8078cb0 0x7f95b807b170 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f95d8162480 0x7f95d8160850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f95d815df90 0x7f95d809db80 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 --2- 172.21.15.81:0/1826819007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f95d80d49c0 0x7f95d80cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 >> 172.21.15.81:0/1826819007 conn(0x7f95d80d3ea0 msgr2=0x7f95d80d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:36.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 shutdown_connections 2024-09-17T05:23:36.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.466+0000 7f95dc833640 1 -- 172.21.15.81:0/1826819007 wait complete. 2024-09-17T05:23:36.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:23:36.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.581+0000 7f0be013d640 1 -- 172.21.15.81:0/3865218338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bc0004d40 msgr2=0x7f0bc00051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.581+0000 7f0be013d640 1 --2- 172.21.15.81:0/3865218338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bc0004d40 0x7f0bc00051c0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f0bc800c630 tx=0x7f0bc0005830 comp rx=0 tx=0).stop 2024-09-17T05:23:36.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.581+0000 7f0bde6da640 1 -- 172.21.15.81:0/3865218338 reap_dead start 2024-09-17T05:23:36.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.581+0000 7f0be013d640 1 -- 172.21.15.81:0/3865218338 shutdown_connections 2024-09-17T05:23:36.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.581+0000 7f0be013d640 1 -- 172.21.15.81:0/3865218338 >> 172.21.15.81:0/3865218338 conn(0x7f0bd80b1700 msgr2=0x7f0bd80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:36.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.581+0000 7f0be013d640 1 -- 172.21.15.81:0/3865218338 shutdown_connections 2024-09-17T05:23:36.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.581+0000 7f0be013d640 1 -- 172.21.15.81:0/3865218338 wait complete. 2024-09-17T05:23:36.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.582+0000 7f0be013d640 1 Processor -- start 2024-09-17T05:23:36.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.582+0000 7f0be013d640 1 -- start start 2024-09-17T05:23:36.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0be013d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bc0004d40 0x7f0bd815b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0be013d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd81f96f0 0x7f0bd8157f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0be013d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bd815dc90 0x7f0bd8158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0be013d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd806fa00 con 0x7f0bd81f96f0 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0be013d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0bd815e990 con 0x7f0bc0004d40 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0be013d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0bd806fb80 con 0x7f0bd815dc90 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd81f96f0 0x7f0bd8157f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd81f96f0 0x7f0bd8157f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40846/0 (socket says 172.21.15.81:40846) 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 -- 172.21.15.81:0/232412399 learned_addr learned my addr 172.21.15.81:0/232412399 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdded9640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bc0004d40 0x7f0bd815b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bde6da640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bd815dc90 0x7f0bd8158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 -- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bd815dc90 msgr2=0x7f0bd8158470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bd815dc90 0x7f0bd8158470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 -- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bc0004d40 msgr2=0x7f0bd815b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bc0004d40 0x7f0bd815b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 -- 172.21.15.81:0/232412399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bd815baa0 con 0x7f0bd81f96f0 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdded9640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bc0004d40 0x7f0bd815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.583+0000 7f0bdd6d8640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd81f96f0 0x7f0bd8157f30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc004f00 tx=0x7f0bcc001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.584+0000 7f0bd67fc640 1 -- 172.21.15.81:0/232412399 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc015020 con 0x7f0bd81f96f0 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.584+0000 7f0bd67fc640 1 -- 172.21.15.81:0/232412399 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0bcc011960 con 0x7f0bd81f96f0 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.584+0000 7f0bd67fc640 1 -- 172.21.15.81:0/232412399 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0bcc011db0 con 0x7f0bd81f96f0 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.584+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bd81f8c10 con 0x7f0bd81f96f0 2024-09-17T05:23:36.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.584+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bd81f91d0 con 0x7f0bd81f96f0 2024-09-17T05:23:36.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.585+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bd806a100 con 0x7f0bd81f96f0 2024-09-17T05:23:36.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.585+0000 7f0bd67fc640 1 -- 172.21.15.81:0/232412399 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f0bcc018020 con 0x7f0bd81f96f0 2024-09-17T05:23:36.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.586+0000 7f0bd67fc640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0bc4078cb0 0x7f0bc407b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:36.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.586+0000 7f0bdded9640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0bc4078cb0 0x7f0bc407b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:36.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.586+0000 7f0bd67fc640 1 -- 172.21.15.81:0/232412399 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f0bcc09ba80 con 0x7f0bd81f96f0 2024-09-17T05:23:36.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.586+0000 7f0bdded9640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0bc4078cb0 0x7f0bc407b170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009b60 tx=0x7f0bd0005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:36.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.590+0000 7f0bd67fc640 1 -- 172.21.15.81:0/232412399 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0bd806a100 con 0x7f0bd81f96f0 2024-09-17T05:23:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.767+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f0bd80cc7e0 con 0x7f0bd81f96f0 2024-09-17T05:23:36.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.768+0000 7f0bd67fc640 1 -- 172.21.15.81:0/232412399 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v38)=0 v38) ==== 122+0+0 (secure 0 0 0) 0x7f0bcc01f020 con 0x7f0bd81f96f0 2024-09-17T05:23:36.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0bc4078cb0 msgr2=0x7f0bc407b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0bc4078cb0 0x7f0bc407b170 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f0bd0009b60 tx=0x7f0bd0005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:36.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd81f96f0 msgr2=0x7f0bd8157f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:36.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd81f96f0 0x7f0bd8157f30 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7f0bcc004f00 tx=0x7f0bcc001630 comp rx=0 tx=0).stop 2024-09-17T05:23:36.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 shutdown_connections 2024-09-17T05:23:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0bd815dc90 0x7f0bd8158470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0bd81f96f0 0x7f0bd8157f30 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0bc4078cb0 0x7f0bc407b170 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 --2- 172.21.15.81:0/232412399 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0bc0004d40 0x7f0bd815b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 >> 172.21.15.81:0/232412399 conn(0x7f0bd80b1700 msgr2=0x7f0bd80cdfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 shutdown_connections 2024-09-17T05:23:36.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:36.770+0000 7f0be013d640 1 -- 172.21.15.81:0/232412399 wait complete. 2024-09-17T05:23:36.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:36.782 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4) 2024-09-17T05:23:36.817 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:36.818 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/fake) 2024-09-17T05:23:36.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:36.892 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:23:36.950 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:23:36.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:36.951 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4) 2024-09-17T05:23:37.020 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:37.020 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol21940/.meta 2024-09-17T05:23:37.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol21940 2024-09-17T05:23:37.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.233+0000 7feaedbe2640 1 -- 172.21.15.81:0/426607128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fead0004800 msgr2=0x7fead0004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.233+0000 7feaedbe2640 1 --2- 172.21.15.81:0/426607128 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fead0004800 0x7fead0004c80 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7feadc006fd0 tx=0x7fead0005830 comp rx=0 tx=0).stop 2024-09-17T05:23:37.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.233+0000 7feae7fff640 1 -- 172.21.15.81:0/426607128 reap_dead start 2024-09-17T05:23:37.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.233+0000 7feaedbe2640 1 -- 172.21.15.81:0/426607128 shutdown_connections 2024-09-17T05:23:37.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.233+0000 7feaedbe2640 1 -- 172.21.15.81:0/426607128 >> 172.21.15.81:0/426607128 conn(0x7feae80b1700 msgr2=0x7feae80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:37.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.233+0000 7feaedbe2640 1 -- 172.21.15.81:0/426607128 shutdown_connections 2024-09-17T05:23:37.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.233+0000 7feaedbe2640 1 -- 172.21.15.81:0/426607128 wait complete. 2024-09-17T05:23:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.234+0000 7feaedbe2640 1 Processor -- start 2024-09-17T05:23:37.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feaedbe2640 1 -- start start 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feaedbe2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fead0004800 0x7feae80c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feaedbe2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8151170 0x7feae81f0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feaedbe2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae81f14e0 0x7feae815cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feaedbe2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feae80cadc0 con 0x7feae8151170 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feaedbe2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feae80cac40 con 0x7fead0004800 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feaedbe2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7feae80caf40 con 0x7feae81f14e0 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feae6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8151170 0x7feae81f0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feae6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8151170 0x7feae81f0fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40866/0 (socket says 172.21.15.81:40866) 2024-09-17T05:23:37.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.235+0000 7feae6ffd640 1 -- 172.21.15.81:0/3918434545 learned_addr learned my addr 172.21.15.81:0/3918434545 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae77fe640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fead0004800 0x7feae80c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae7fff640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae81f14e0 0x7feae815cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae6ffd640 1 -- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae81f14e0 msgr2=0x7feae815cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae6ffd640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae81f14e0 0x7feae815cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae6ffd640 1 -- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fead0004800 msgr2=0x7feae80c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae6ffd640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fead0004800 0x7feae80c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae6ffd640 1 -- 172.21.15.81:0/3918434545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feae8073240 con 0x7feae8151170 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feae6ffd640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8151170 0x7feae81f0fa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c350 tx=0x7feadc006c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feacffff640 1 -- 172.21.15.81:0/3918434545 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc031040 con 0x7feae8151170 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feacffff640 1 -- 172.21.15.81:0/3918434545 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feadc0035f0 con 0x7feae8151170 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feacffff640 1 -- 172.21.15.81:0/3918434545 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feadc003a00 con 0x7feae8151170 2024-09-17T05:23:37.239 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feae80b53d0 con 0x7feae8151170 2024-09-17T05:23:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.236+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feae80c8560 con 0x7feae8151170 2024-09-17T05:23:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.237+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feae80cb4a0 con 0x7feae8151170 2024-09-17T05:23:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.238+0000 7feacffff640 1 -- 172.21.15.81:0/3918434545 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7feadc034070 con 0x7feae8151170 2024-09-17T05:23:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.238+0000 7feacffff640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fead4078ce0 0x7fead407b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.238+0000 7feacffff640 1 -- 172.21.15.81:0/3918434545 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7feadc0bae50 con 0x7feae8151170 2024-09-17T05:23:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.238+0000 7feae77fe640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fead4078ce0 0x7fead407b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.239+0000 7feae77fe640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fead4078ce0 0x7fead407b1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fead8000f80 tx=0x7fead8004a00 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:37.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.243+0000 7feacffff640 1 -- 172.21.15.81:0/3918434545 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7feadc082c20 con 0x7feae8151170 2024-09-17T05:23:37.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.446+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol21940", "target": ["mon-mgr", ""]}) -- 0x7feae80c3440 con 0x7fead4078ce0 2024-09-17T05:23:37.451 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:37.450+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:37.451 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:37.450+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:37.451 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:37.450+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:37.451 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:37.450+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:37.451 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:37.450+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:37.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.475+0000 7feacffff640 1 -- 172.21.15.81:0/3918434545 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7feae80c3440 con 0x7fead4078ce0 2024-09-17T05:23:37.476 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4 2024-09-17T05:23:37.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fead4078ce0 msgr2=0x7fead407b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fead4078ce0 0x7fead407b1a0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fead8000f80 tx=0x7fead8004a00 comp rx=0 tx=0).stop 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8151170 msgr2=0x7feae81f0fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8151170 0x7feae81f0fa0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7feadc00c350 tx=0x7feadc006c80 comp rx=0 tx=0).stop 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 shutdown_connections 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feae81f14e0 0x7feae815cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feae8151170 0x7feae81f0fa0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fead4078ce0 0x7fead407b1a0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 --2- 172.21.15.81:0/3918434545 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fead0004800 0x7feae80c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 >> 172.21.15.81:0/3918434545 conn(0x7feae80b1700 msgr2=0x7feae80cc540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 shutdown_connections 2024-09-17T05:23:37.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.477+0000 7feaedbe2640 1 -- 172.21.15.81:0/3918434545 wait complete. 2024-09-17T05:23:37.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-17T05:23:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.592+0000 7fc02fc7c640 1 -- 172.21.15.81:0/3575291566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 msgr2=0x7fc0280cc540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.592+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/3575291566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280cc540 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc02400a940 tx=0x7fc02402b7b0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.592+0000 7fc02fc7c640 1 -- 172.21.15.81:0/3575291566 shutdown_connections 2024-09-17T05:23:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.592+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/3575291566 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280cc540 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.592+0000 7fc02fc7c640 1 -- 172.21.15.81:0/3575291566 >> 172.21.15.81:0/3575291566 conn(0x7fc0280b1700 msgr2=0x7fc0280b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:37.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.592+0000 7fc02fc7c640 1 -- 172.21.15.81:0/3575291566 shutdown_connections 2024-09-17T05:23:37.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.592+0000 7fc02fc7c640 1 -- 172.21.15.81:0/3575291566 wait complete. 2024-09-17T05:23:37.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.593+0000 7fc02fc7c640 1 Processor -- start 2024-09-17T05:23:37.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.593+0000 7fc02fc7c640 1 -- start start 2024-09-17T05:23:37.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02fc7c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc02806f1f0 0x7fc0281f5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02fc7c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02fc7c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02815ab50 0x7fc0280b41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02fc7c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0280cce10 con 0x7fc0280ca620 2024-09-17T05:23:37.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02fc7c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc0280ccc90 con 0x7fc02815ab50 2024-09-17T05:23:37.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02fc7c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc0280707a0 con 0x7fc02806f1f0 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280c6070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40904/0 (socket says 172.21.15.81:40904) 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 -- 172.21.15.81:0/2865892248 learned_addr learned my addr 172.21.15.81:0/2865892248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02e219640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02815ab50 0x7fc0280b41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 -- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc02806f1f0 msgr2=0x7fc0281f5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02da18640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc02806f1f0 0x7fc0281f5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc02806f1f0 0x7fc0281f5b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 -- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02815ab50 msgr2=0x7fc0280b41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02815ab50 0x7fc0280b41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 -- 172.21.15.81:0/2865892248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0280c4900 con 0x7fc0280ca620 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02e219640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02815ab50 0x7fc0280b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc02d217640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280c6070 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c450 tx=0x7fc01800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:37.597 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc01e7fc640 1 -- 172.21.15.81:0/2865892248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018016020 con 0x7fc0280ca620 2024-09-17T05:23:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.594+0000 7fc01e7fc640 1 -- 172.21.15.81:0/2865892248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc018012920 con 0x7fc0280ca620 2024-09-17T05:23:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.595+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0280c4be0 con 0x7fc0280ca620 2024-09-17T05:23:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.595+0000 7fc01e7fc640 1 -- 172.21.15.81:0/2865892248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc018012d70 con 0x7fc0280ca620 2024-09-17T05:23:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.595+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0280c51a0 con 0x7fc0280ca620 2024-09-17T05:23:37.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.595+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0280cc540 con 0x7fc0280ca620 2024-09-17T05:23:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.596+0000 7fc01e7fc640 1 -- 172.21.15.81:0/2865892248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7fc018019020 con 0x7fc0280ca620 2024-09-17T05:23:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.597+0000 7fc01e7fc640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc00c078cb0 0x7fc00c07b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.597+0000 7fc02da18640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc00c078cb0 0x7fc00c07b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.597+0000 7fc01e7fc640 1 -- 172.21.15.81:0/2865892248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fc01809af50 con 0x7fc0280ca620 2024-09-17T05:23:37.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.597+0000 7fc02da18640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc00c078cb0 0x7fc00c07b170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc02815a280 tx=0x7fc024004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:37.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.601+0000 7fc01e7fc640 1 -- 172.21.15.81:0/2865892248 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc018020020 con 0x7fc0280ca620 2024-09-17T05:23:37.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.801+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7fc0280c5370 con 0x7fc00c078cb0 2024-09-17T05:23:37.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.806+0000 7fc01e7fc640 1 -- 172.21.15.81:0/2865892248 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7fc0280c5370 con 0x7fc00c078cb0 2024-09-17T05:23:37.807 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:23:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subvol21940" 2024-09-17T05:23:37.807 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:37.807 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:23:37.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc00c078cb0 msgr2=0x7fc00c07b170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc00c078cb0 0x7fc00c07b170 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fc02815a280 tx=0x7fc024004730 comp rx=0 tx=0).stop 2024-09-17T05:23:37.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 msgr2=0x7fc0280c6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280c6070 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc01800c450 tx=0x7fc01800c910 comp rx=0 tx=0).stop 2024-09-17T05:23:37.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 shutdown_connections 2024-09-17T05:23:37.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc00c078cb0 0x7fc00c07b170 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc02815ab50 0x7fc0280b41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0280ca620 0x7fc0280c6070 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 --2- 172.21.15.81:0/2865892248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc02806f1f0 0x7fc0281f5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 >> 172.21.15.81:0/2865892248 conn(0x7fc0280b1700 msgr2=0x7fc02814feb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 shutdown_connections 2024-09-17T05:23:37.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.808+0000 7fc02fc7c640 1 -- 172.21.15.81:0/2865892248 wait complete. 2024-09-17T05:23:37.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol21940 2024-09-17T05:23:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.922+0000 7f123f633640 1 -- 172.21.15.81:0/4218064029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1224004d40 msgr2=0x7f12240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.922+0000 7f123f633640 1 --2- 172.21.15.81:0/4218064029 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1224004d40 0x7f12240051c0 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ed0 tx=0x7f1224005830 comp rx=0 tx=0).stop 2024-09-17T05:23:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.923+0000 7f123dbd0640 1 -- 172.21.15.81:0/4218064029 reap_dead start 2024-09-17T05:23:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.923+0000 7f123f633640 1 -- 172.21.15.81:0/4218064029 shutdown_connections 2024-09-17T05:23:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.923+0000 7f123f633640 1 -- 172.21.15.81:0/4218064029 >> 172.21.15.81:0/4218064029 conn(0x7f12380b1700 msgr2=0x7f12380b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.923+0000 7f123f633640 1 -- 172.21.15.81:0/4218064029 shutdown_connections 2024-09-17T05:23:37.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.923+0000 7f123f633640 1 -- 172.21.15.81:0/4218064029 wait complete. 2024-09-17T05:23:37.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.924+0000 7f123f633640 1 Processor -- start 2024-09-17T05:23:37.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.924+0000 7f123f633640 1 -- start start 2024-09-17T05:23:37.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123f633640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1238145ae0 0x7f12381f6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123f633640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1238145ec0 0x7f12381484a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123f633640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12381489e0 0x7f12380c8e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123f633640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1238073050 con 0x7f12381489e0 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123f633640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1238072ed0 con 0x7f1238145ec0 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123f633640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f12380731d0 con 0x7f1238145ae0 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12381489e0 0x7f12380c8e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12381489e0 0x7f12380c8e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40920/0 (socket says 172.21.15.81:40920) 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 -- 172.21.15.81:0/3923248804 learned_addr learned my addr 172.21.15.81:0/3923248804 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123d3cf640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1238145ae0 0x7f12381f6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123cbce640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1238145ec0 0x7f12381484a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 -- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1238145ae0 msgr2=0x7f12381f6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1238145ae0 0x7f12381f6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 -- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1238145ec0 msgr2=0x7f12381484a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1238145ec0 0x7f12381484a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 -- 172.21.15.81:0/3923248804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12381f7000 con 0x7f12381489e0 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123cbce640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1238145ec0 0x7f12381484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123dbd0640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12381489e0 0x7f12380c8e10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ed0 tx=0x7f1230033da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230043070 con 0x7f12381489e0 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1230003b70 con 0x7f12381489e0 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1230038040 con 0x7f12381489e0 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.925+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1238148ef0 con 0x7f12381489e0 2024-09-17T05:23:37.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.926+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12381f62c0 con 0x7f12381489e0 2024-09-17T05:23:37.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.927+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12380cc860 con 0x7f12381489e0 2024-09-17T05:23:37.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.927+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 16) ==== 101543+0+0 (secure 0 0 0) 0x7f1230004030 con 0x7f12381489e0 2024-09-17T05:23:37.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.928+0000 7f122dffb640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f121c078ce0 0x7f121c07b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.928+0000 7f123d3cf640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f121c078ce0 0x7f121c07b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.928+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f12300bb0b0 con 0x7f12381489e0 2024-09-17T05:23:37.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.928+0000 7f123d3cf640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f121c078ce0 0x7f121c07b1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1234001860 tx=0x7f1234001170 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:37.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:37.932+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1230082c80 con 0x7f12381489e0 2024-09-17T05:23:38.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.136+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol21940", "target": ["mon-mgr", ""]}) -- 0x7f1238149410 con 0x7f121c078ce0 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "atime": "2024-09-17 05:23:36", 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_pcent": "undefined", 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_quota": "infinite", 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 0, 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "created_at": "2024-09-17 05:23:36", 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "ctime": "2024-09-17 05:23:37", 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "cephfs_data", 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "earmark": "", 2024-09-17T05:23:38.151 INFO:teuthology.orchestra.run.smithi081.stdout: "features": [ 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot-clone", 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot-autoprotect" 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "flavor": 1, 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 0, 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": 16877, 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_addrs": [ 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.81:6789", 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.160:6789", 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.160:6790" 2024-09-17T05:23:38.152 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:23:38.153 INFO:teuthology.orchestra.run.smithi081.stdout: "mtime": "2024-09-17 05:23:36", 2024-09-17T05:23:38.153 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4", 2024-09-17T05:23:38.153 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_namespace": "", 2024-09-17T05:23:38.153 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "complete", 2024-09-17T05:23:38.153 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "subvolume", 2024-09-17T05:23:38.153 INFO:teuthology.orchestra.run.smithi081.stdout: "uid": 0 2024-09-17T05:23:38.153 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:38.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.149+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+705 (secure 0 0 0) 0x7f12340109d0 con 0x7f121c078ce0 2024-09-17T05:23:38.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.152+0000 7f122dffb640 1 -- 172.21.15.81:0/3923248804 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7f12300b95d0 con 0x7f12381489e0 2024-09-17T05:23:38.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f121c078ce0 msgr2=0x7f121c07b1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f121c078ce0 0x7f121c07b1a0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f1234001860 tx=0x7f1234001170 comp rx=0 tx=0).stop 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12381489e0 msgr2=0x7f12380c8e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12381489e0 0x7f12380c8e10 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f1230009ed0 tx=0x7f1230033da0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 shutdown_connections 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12381489e0 0x7f12380c8e10 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f121c078ce0 0x7f121c07b1a0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1238145ec0 0x7f12381484a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 --2- 172.21.15.81:0/3923248804 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1238145ae0 0x7f12381f6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 >> 172.21.15.81:0/3923248804 conn(0x7f12380b1700 msgr2=0x7f12380b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 shutdown_connections 2024-09-17T05:23:38.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.153+0000 7f123f633640 1 -- 172.21.15.81:0/3923248804 wait complete. 2024-09-17T05:23:38.165 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize cephfs subvol21940 10485760 2024-09-17T05:23:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 -- 172.21.15.81:0/2616808945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0cbc00 msgr2=0x7f3dbc0cbfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 --2- 172.21.15.81:0/2616808945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0cbc00 0x7f3dbc0cbfe0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f3dbc0b2a10 tx=0x7f3db802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 -- 172.21.15.81:0/2616808945 shutdown_connections 2024-09-17T05:23:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 --2- 172.21.15.81:0/2616808945 >> v2:172.21.15.81:3300/0 conn(0x7f3dbc162390 0x7f3dbc06e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 --2- 172.21.15.81:0/2616808945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0cbc00 0x7f3dbc0cbfe0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 -- 172.21.15.81:0/2616808945 >> 172.21.15.81:0/2616808945 conn(0x7f3dbc0cfdf0 msgr2=0x7f3dbc0d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 -- 172.21.15.81:0/2616808945 shutdown_connections 2024-09-17T05:23:38.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.273+0000 7f3dc3594640 1 -- 172.21.15.81:0/2616808945 wait complete. 2024-09-17T05:23:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.274+0000 7f3dc3594640 1 Processor -- start 2024-09-17T05:23:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc3594640 1 -- start start 2024-09-17T05:23:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc3594640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0743a0 0x7f3dbc0b3000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc3594640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dbc0cbc00 0x7f3dbc1fc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc3594640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dbc162390 0x7f3dbc1f8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc3594640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0cdb40 con 0x7f3dbc162390 2024-09-17T05:23:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc3594640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3dbc0cd9c0 con 0x7f3dbc0743a0 2024-09-17T05:23:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc3594640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3dbc0af4b0 con 0x7f3dbc0cbc00 2024-09-17T05:23:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc1b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dbc162390 0x7f3dbc1f8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc1b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dbc162390 0x7f3dbc1f8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40944/0 (socket says 172.21.15.81:40944) 2024-09-17T05:23:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc1b31640 1 -- 172.21.15.81:0/1498753413 learned_addr learned my addr 172.21.15.81:0/1498753413 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc1330640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0743a0 0x7f3dbc0b3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.275+0000 7f3dc0b2f640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dbc0cbc00 0x7f3dbc1fc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc1b31640 1 -- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dbc0cbc00 msgr2=0x7f3dbc1fc5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc1b31640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dbc0cbc00 0x7f3dbc1fc5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc1b31640 1 -- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0743a0 msgr2=0x7f3dbc0b3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc1b31640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0743a0 0x7f3dbc0b3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc1b31640 1 -- 172.21.15.81:0/1498753413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dbc15e2e0 con 0x7f3dbc162390 2024-09-17T05:23:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc1330640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0743a0 0x7f3dbc0b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc1b31640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dbc162390 0x7f3dbc1f8250 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00e740 tx=0x7f3dac00ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3db1ffb640 1 -- 172.21.15.81:0/1498753413 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00ccc0 con 0x7f3dbc162390 2024-09-17T05:23:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dbc15bed0 con 0x7f3dbc162390 2024-09-17T05:23:38.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3db1ffb640 1 -- 172.21.15.81:0/1498753413 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dac00ce80 con 0x7f3dbc162390 2024-09-17T05:23:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3db1ffb640 1 -- 172.21.15.81:0/1498753413 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dac005280 con 0x7f3dbc162390 2024-09-17T05:23:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.276+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dbc15e580 con 0x7f3dbc162390 2024-09-17T05:23:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.277+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dbc0cbfe0 con 0x7f3dbc162390 2024-09-17T05:23:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.278+0000 7f3db1ffb640 1 -- 172.21.15.81:0/1498753413 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7f3dac005420 con 0x7f3dbc162390 2024-09-17T05:23:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.278+0000 7f3db1ffb640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3da0078d40 0x7f3da007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.278+0000 7f3dc1330640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3da0078d40 0x7f3da007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.278+0000 7f3db1ffb640 1 -- 172.21.15.81:0/1498753413 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f3dac09ba00 con 0x7f3dbc162390 2024-09-17T05:23:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.279+0000 7f3dc1330640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3da0078d40 0x7f3da007b200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3db8034000 tx=0x7f3db8004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:38.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.283+0000 7f3db1ffb640 1 -- 172.21.15.81:0/1498753413 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3dac063b50 con 0x7f3dbc162390 2024-09-17T05:23:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.492+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "cephfs", "sub_name": "subvol21940", "new_size": "10485760", "target": ["mon-mgr", ""]}) -- 0x7f3dbc09e0d0 con 0x7f3da0078d40 2024-09-17T05:23:38.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.507+0000 7f3db1ffb640 1 -- 172.21.15.81:0/1498753413 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+128 (secure 0 0 0) 0x7f3dbc09e0d0 con 0x7f3da0078d40 2024-09-17T05:23:38.508 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:23:38.508 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:38.508 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 0 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_quota": 10485760 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_pcent": "0.00" 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:38.509 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:23:38.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3da0078d40 msgr2=0x7f3da007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3da0078d40 0x7f3da007b200 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f3db8034000 tx=0x7f3db8004730 comp rx=0 tx=0).stop 2024-09-17T05:23:38.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dbc162390 msgr2=0x7f3dbc1f8250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dbc162390 0x7f3dbc1f8250 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00e740 tx=0x7f3dac00ec00 comp rx=0 tx=0).stop 2024-09-17T05:23:38.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 shutdown_connections 2024-09-17T05:23:38.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dbc162390 0x7f3dbc1f8250 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dbc0cbc00 0x7f3dbc1fc5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3da0078d40 0x7f3da007b200 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 --2- 172.21.15.81:0/1498753413 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dbc0743a0 0x7f3dbc0b3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 >> 172.21.15.81:0/1498753413 conn(0x7f3dbc0cfdf0 msgr2=0x7f3dbc073050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:38.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 shutdown_connections 2024-09-17T05:23:38.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.509+0000 7f3dc3594640 1 -- 172.21.15.81:0/1498753413 wait complete. 2024-09-17T05:23:38.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol21940 2024-09-17T05:23:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2370936350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 msgr2=0x7f6bc00d1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2370936350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00d1ce0 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0005fd0 tx=0x7f6bb002aa00 comp rx=0 tx=0).stop 2024-09-17T05:23:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2370936350 shutdown_connections 2024-09-17T05:23:38.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2370936350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bc00b0d80 0x7f6bc00d2220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2370936350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00d1ce0 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2370936350 >> 172.21.15.81:0/2370936350 conn(0x7f6bc009aa30 msgr2=0x7f6bc009ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2370936350 shutdown_connections 2024-09-17T05:23:38.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.625+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2370936350 wait complete. 2024-09-17T05:23:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.626+0000 7f6bc6bda640 1 Processor -- start 2024-09-17T05:23:38.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.626+0000 7f6bc6bda640 1 -- start start 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc6bda640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc00b0d80 0x7f6bc0157410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc6bda640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bc00d0490 0x7f6bc01f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc6bda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00c8f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc6bda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc00b2230 con 0x7f6bc015bf10 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc6bda640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc00b0ad0 con 0x7f6bc00b0d80 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc6bda640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6bc00b23b0 con 0x7f6bc00d0490 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc5177640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00c8f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc5177640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00c8f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40956/0 (socket says 172.21.15.81:40956) 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.627+0000 7f6bc5177640 1 -- 172.21.15.81:0/2864759356 learned_addr learned my addr 172.21.15.81:0/2864759356 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc4976640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc00b0d80 0x7f6bc0157410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bbffff640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bc00d0490 0x7f6bc01f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc5177640 1 -- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bc00d0490 msgr2=0x7f6bc01f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc5177640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bc00d0490 0x7f6bc01f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc5177640 1 -- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc00b0d80 msgr2=0x7f6bc0157410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc5177640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc00b0d80 0x7f6bc0157410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc5177640 1 -- 172.21.15.81:0/2864759356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc00c9a30 con 0x7f6bc015bf10 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc5177640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00c8f80 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c390 tx=0x7f6bb800c790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bbd7fa640 1 -- 172.21.15.81:0/2864759356 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8017070 con 0x7f6bc015bf10 2024-09-17T05:23:38.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bbd7fa640 1 -- 172.21.15.81:0/2864759356 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bb80035f0 con 0x7f6bc015bf10 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc00c9d10 con 0x7f6bc015bf10 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bbd7fa640 1 -- 172.21.15.81:0/2864759356 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb8003a40 con 0x7f6bc015bf10 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.628+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc01f6880 con 0x7f6bc015bf10 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.629+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc00c9f50 con 0x7f6bc015bf10 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.630+0000 7f6bbd7fa640 1 -- 172.21.15.81:0/2864759356 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7f6bb801a070 con 0x7f6bc015bf10 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.630+0000 7f6bbd7fa640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba0078d70 0x7f6ba007b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.630+0000 7f6bbd7fa640 1 -- 172.21.15.81:0/2864759356 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f6bb809a260 con 0x7f6bc015bf10 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.630+0000 7f6bc4976640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba0078d70 0x7f6ba007b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.631+0000 7f6bc4976640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba0078d70 0x7f6ba007b230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0035000 tx=0x7f6bb003b040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:38.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.634+0000 7f6bbd7fa640 1 -- 172.21.15.81:0/2864759356 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6bc00c9f50 con 0x7f6bc015bf10 2024-09-17T05:23:38.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.837+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol21940", "target": ["mon-mgr", ""]}) -- 0x7f6bc00d2830 con 0x7f6ba0078d70 2024-09-17T05:23:38.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.850+0000 7f6bbd7fa640 1 -- 172.21.15.81:0/2864759356 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+698 (secure 0 0 0) 0x7f6bc00d2830 con 0x7f6ba0078d70 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "atime": "2024-09-17 05:23:36", 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_pcent": "0.00", 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_quota": 10485760, 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 0, 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "created_at": "2024-09-17 05:23:36", 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "ctime": "2024-09-17 05:23:38", 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "cephfs_data", 2024-09-17T05:23:38.852 INFO:teuthology.orchestra.run.smithi081.stdout: "earmark": "", 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "features": [ 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot-clone", 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot-autoprotect" 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "flavor": 1, 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 0, 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": 16877, 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_addrs": [ 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.81:6789", 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.160:6789", 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.160:6790" 2024-09-17T05:23:38.853 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:23:38.854 INFO:teuthology.orchestra.run.smithi081.stdout: "mtime": "2024-09-17 05:23:36", 2024-09-17T05:23:38.854 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4", 2024-09-17T05:23:38.854 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_namespace": "", 2024-09-17T05:23:38.854 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "complete", 2024-09-17T05:23:38.854 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "subvolume", 2024-09-17T05:23:38.854 INFO:teuthology.orchestra.run.smithi081.stdout: "uid": 0 2024-09-17T05:23:38.854 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:38.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba0078d70 msgr2=0x7f6ba007b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba0078d70 0x7f6ba007b230 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6bb0035000 tx=0x7f6bb003b040 comp rx=0 tx=0).stop 2024-09-17T05:23:38.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 msgr2=0x7f6bc00c8f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00c8f80 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800c390 tx=0x7f6bb800c790 comp rx=0 tx=0).stop 2024-09-17T05:23:38.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 shutdown_connections 2024-09-17T05:23:38.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bc015bf10 0x7f6bc00c8f80 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bc00d0490 0x7f6bc01f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.852+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba0078d70 0x7f6ba007b230 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.853+0000 7f6bc6bda640 1 --2- 172.21.15.81:0/2864759356 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bc00b0d80 0x7f6bc0157410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.853+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 >> 172.21.15.81:0/2864759356 conn(0x7f6bc009aa30 msgr2=0x7f6bc0071ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.853+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 shutdown_connections 2024-09-17T05:23:38.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.853+0000 7f6bc6bda640 1 -- 172.21.15.81:0/2864759356 wait complete. 2024-09-17T05:23:38.864 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create cephfs subvol21940 --mode 777 --uid 1000 --gid 1000 2024-09-17T05:23:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 -- 172.21.15.81:0/64992948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f80ca0f0 msgr2=0x7f03f80704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 --2- 172.21.15.81:0/64992948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f80ca0f0 0x7f03f80704f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f03f80767f0 tx=0x7f03ec02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 -- 172.21.15.81:0/64992948 shutdown_connections 2024-09-17T05:23:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 --2- 172.21.15.81:0/64992948 >> v2:172.21.15.160:3300/0 conn(0x7f03f815e600 0x7f03f80ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 --2- 172.21.15.81:0/64992948 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f80ca0f0 0x7f03f80704f0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 --2- 172.21.15.81:0/64992948 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f815a970 0x7f03f806ffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 -- 172.21.15.81:0/64992948 >> 172.21.15.81:0/64992948 conn(0x7f03f80cfaa0 msgr2=0x7f03f80cfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 -- 172.21.15.81:0/64992948 shutdown_connections 2024-09-17T05:23:38.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.980+0000 7f03fec72640 1 -- 172.21.15.81:0/64992948 wait complete. 2024-09-17T05:23:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 Processor -- start 2024-09-17T05:23:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 -- start start 2024-09-17T05:23:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f80ca0f0 0x7f03f8155320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f815a970 0x7f03f815cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f815e600 0x7f03f8150af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f03f80cb080 con 0x7f03f815a970 2024-09-17T05:23:38.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f03f80caf00 con 0x7f03f815e600 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.982+0000 7f03fec72640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f03f80cb200 con 0x7f03f80ca0f0 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f815a970 0x7f03f815cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f815a970 0x7f03f815cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40978/0 (socket says 172.21.15.81:40978) 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 -- 172.21.15.81:0/4086091008 learned_addr learned my addr 172.21.15.81:0/4086091008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03fca0e640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f80ca0f0 0x7f03f8155320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03fd20f640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f815e600 0x7f03f8150af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 -- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f80ca0f0 msgr2=0x7f03f8155320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f80ca0f0 0x7f03f8155320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 -- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f815e600 msgr2=0x7f03f8150af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f815e600 0x7f03f8150af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 -- 172.21.15.81:0/4086091008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03f8154280 con 0x7f03f815a970 2024-09-17T05:23:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f7fff640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f815a970 0x7f03f815cb80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009850 tx=0x7f03ec003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f57fa640 1 -- 172.21.15.81:0/4086091008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec03f070 con 0x7f03f815a970 2024-09-17T05:23:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f57fa640 1 -- 172.21.15.81:0/4086091008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f03ec0047a0 con 0x7f03f815a970 2024-09-17T05:23:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03f8154560 con 0x7f03f815a970 2024-09-17T05:23:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03f57fa640 1 -- 172.21.15.81:0/4086091008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f03ec035030 con 0x7f03f815a970 2024-09-17T05:23:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.983+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03f8154b20 con 0x7f03f815a970 2024-09-17T05:23:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.984+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f03f80726b0 con 0x7f03f815a970 2024-09-17T05:23:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.985+0000 7f03f57fa640 1 -- 172.21.15.81:0/4086091008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7f03ec042070 con 0x7f03f815a970 2024-09-17T05:23:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.985+0000 7f03f57fa640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f03e4078d40 0x7f03e407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.985+0000 7f03f57fa640 1 -- 172.21.15.81:0/4086091008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f03ec0bbd80 con 0x7f03f815a970 2024-09-17T05:23:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.985+0000 7f03fca0e640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f03e4078d40 0x7f03e407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.986+0000 7f03fca0e640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f03e4078d40 0x7f03e407b200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009b50 tx=0x7f03e8005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:38.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:38.989+0000 7f03f57fa640 1 -- 172.21.15.81:0/4086091008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f03f80726b0 con 0x7f03f815a970 2024-09-17T05:23:39.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.192+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "subvol21940", "mode": "777", "uid": 1000, "gid": 1000, "target": ["mon-mgr", ""]}) -- 0x7f03f8076200 con 0x7f03e4078d40 2024-09-17T05:23:39.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.207+0000 7f03f57fa640 1 -- 172.21.15.81:0/4086091008 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f03e8004020 con 0x7f03e4078d40 2024-09-17T05:23:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f03e4078d40 msgr2=0x7f03e407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f03e4078d40 0x7f03e407b200 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f03e8009b50 tx=0x7f03e8005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f815a970 msgr2=0x7f03f815cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f815a970 0x7f03f815cb80 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f03ec009850 tx=0x7f03ec003820 comp rx=0 tx=0).stop 2024-09-17T05:23:39.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 shutdown_connections 2024-09-17T05:23:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f03e4078d40 0x7f03e407b200 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f03f815e600 0x7f03f8150af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f03f815a970 0x7f03f815cb80 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 --2- 172.21.15.81:0/4086091008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f03f80ca0f0 0x7f03f8155320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 >> 172.21.15.81:0/4086091008 conn(0x7f03f80cfaa0 msgr2=0x7f03f80c6430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 shutdown_connections 2024-09-17T05:23:39.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.210+0000 7f03fec72640 1 -- 172.21.15.81:0/4086091008 wait complete. 2024-09-17T05:23:39.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol21940 2024-09-17T05:23:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.326+0000 7f6005603640 1 -- 172.21.15.81:0/3575470879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 msgr2=0x7f5fec003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.326+0000 7f6005603640 1 --2- 172.21.15.81:0/3575470879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 0x7f5fec003e50 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f5ff00016c0 tx=0x7f5fec005830 comp rx=0 tx=0).stop 2024-09-17T05:23:39.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.326+0000 7f5fff7fe640 1 -- 172.21.15.81:0/3575470879 reap_dead start 2024-09-17T05:23:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.326+0000 7f6005603640 1 -- 172.21.15.81:0/3575470879 shutdown_connections 2024-09-17T05:23:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.326+0000 7f6005603640 1 -- 172.21.15.81:0/3575470879 >> 172.21.15.81:0/3575470879 conn(0x7f60000d3c70 msgr2=0x7f60000d4080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.326+0000 7f6005603640 1 -- 172.21.15.81:0/3575470879 shutdown_connections 2024-09-17T05:23:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.326+0000 7f6005603640 1 -- 172.21.15.81:0/3575470879 wait complete. 2024-09-17T05:23:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.327+0000 7f6005603640 1 Processor -- start 2024-09-17T05:23:39.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.327+0000 7f6005603640 1 -- start start 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f6005603640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 0x7f60000cbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f6005603640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60000b8110 0x7f60000cad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f6005603640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60000cb280 0x7f6000151c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f6005603640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f600006e570 con 0x7f5fec003a30 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f6005603640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f600006e3f0 con 0x7f60000b8110 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f6005603640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f60000b2190 con 0x7f60000cb280 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 0x7f60000cbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 0x7f60000cbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41000/0 (socket says 172.21.15.81:41000) 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 -- 172.21.15.81:0/4181750145 learned_addr learned my addr 172.21.15.81:0/4181750145 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5fff7fe640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60000cb280 0x7f6000151c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:39.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ff7fff640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60000b8110 0x7f60000cad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 -- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60000cb280 msgr2=0x7f6000151c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60000cb280 0x7f6000151c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 -- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60000b8110 msgr2=0x7f60000cad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60000b8110 0x7f60000cad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5ffeffd640 1 -- 172.21.15.81:0/4181750145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60001f4610 con 0x7f5fec003a30 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.328+0000 7f5fff7fe640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60000cb280 0x7f6000151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.329+0000 7f5ffeffd640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 0x7f60000cbdd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5ff002a930 tx=0x7f5ff0006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.329+0000 7f5ff77fe640 1 -- 172.21.15.81:0/4181750145 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0041070 con 0x7f5fec003a30 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.329+0000 7f5ff77fe640 1 -- 172.21.15.81:0/4181750145 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5ff0003af0 con 0x7f5fec003a30 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.329+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60001f48f0 con 0x7f5fec003a30 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.329+0000 7f5ff77fe640 1 -- 172.21.15.81:0/4181750145 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ff0038070 con 0x7f5fec003a30 2024-09-17T05:23:39.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.329+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60001f4eb0 con 0x7f5fec003a30 2024-09-17T05:23:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.330+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f60000b1a80 con 0x7f5fec003a30 2024-09-17T05:23:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.330+0000 7f5ff77fe640 1 -- 172.21.15.81:0/4181750145 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7f5ff0044070 con 0x7f5fec003a30 2024-09-17T05:23:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.331+0000 7f5ff77fe640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5fe0078d40 0x7f5fe007b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.331+0000 7f5ff77fe640 1 -- 172.21.15.81:0/4181750145 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f5ff00ba790 con 0x7f5fec003a30 2024-09-17T05:23:39.333 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.331+0000 7f5ff7fff640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5fe0078d40 0x7f5fe007b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:39.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.331+0000 7f5ff7fff640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5fe0078d40 0x7f5fe007b200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60001f8ab0 tx=0x7f5fe8005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:39.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.335+0000 7f5ff77fe640 1 -- 172.21.15.81:0/4181750145 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5ff0006500 con 0x7f5fec003a30 2024-09-17T05:23:39.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.539+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol21940", "target": ["mon-mgr", ""]}) -- 0x7f6000160640 con 0x7f5fe0078d40 2024-09-17T05:23:39.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.548+0000 7f5ff77fe640 1 -- 172.21.15.81:0/4181750145 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f6000160640 con 0x7f5fe0078d40 2024-09-17T05:23:39.549 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5fe0078d40 msgr2=0x7f5fe007b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5fe0078d40 0x7f5fe007b200 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f60001f8ab0 tx=0x7f5fe8005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 msgr2=0x7f60000cbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 0x7f60000cbdd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f5ff002a930 tx=0x7f5ff0006310 comp rx=0 tx=0).stop 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 shutdown_connections 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f60000cb280 0x7f6000151c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5fe0078d40 0x7f5fe007b200 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f60000b8110 0x7f60000cad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 --2- 172.21.15.81:0/4181750145 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5fec003a30 0x7f60000cbdd0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:39.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 >> 172.21.15.81:0/4181750145 conn(0x7f60000d3c70 msgr2=0x7f600015eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:39.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.550+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 shutdown_connections 2024-09-17T05:23:39.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:39.551+0000 7f6005603640 1 -- 172.21.15.81:0/4181750145 wait complete. 2024-09-17T05:23:39.562 DEBUG:tasks.cephfs.test_volumes:filling subvolume subvol21940 with 8 files each 1MB size under directory volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4 2024-09-17T05:23:39.563 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:39.563 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:39.580 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:39.580 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.0 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:39.648 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:39.649 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:39.649 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00949504 s, 110 MB/s 2024-09-17T05:23:39.649 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:39.649 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:39.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:39.705 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.1 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:39.775 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00957648 s, 109 MB/s 2024-09-17T05:23:39.776 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:39.776 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:39.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:39.832 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.2 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:39.904 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:39.904 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:39.905 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0104027 s, 101 MB/s 2024-09-17T05:23:39.905 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:39.905 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:39.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:39.961 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.3 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:40.034 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:40.034 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:40.035 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121065 s, 86.6 MB/s 2024-09-17T05:23:40.035 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:40.035 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:40.091 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:40.091 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.4 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:40.162 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00921481 s, 114 MB/s 2024-09-17T05:23:40.162 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:40.162 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:40.219 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:40.219 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.5 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:40.291 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:40.291 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:40.291 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00879465 s, 119 MB/s 2024-09-17T05:23:40.292 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:40.292 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:40.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:40.348 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.6 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:40.421 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0121297 s, 86.4 MB/s 2024-09-17T05:23:40.422 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:23:40.423 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:23:40.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:40.479 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/subvolume_file.7 bs=1M conv=fdatasync count=1 seek=0) 2024-09-17T05:23:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records in 2024-09-17T05:23:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:1+0 records out 2024-09-17T05:23:40.551 INFO:teuthology.orchestra.run.smithi081.stderr:1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0110648 s, 94.8 MB/s 2024-09-17T05:23:40.552 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create cephfs subvol21940 subvol_snap72950 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 -- 172.21.15.81:0/3601821796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 msgr2=0x7f41b40cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/3601821796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40cefe0 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f41ac005fd0 tx=0x7f41ac02a870 comp rx=0 tx=0).stop 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 -- 172.21.15.81:0/3601821796 shutdown_connections 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/3601821796 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40cefe0 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/3601821796 >> v2:172.21.15.160:3300/0 conn(0x7f41b4072530 0x7f41b4070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 -- 172.21.15.81:0/3601821796 >> 172.21.15.81:0/3601821796 conn(0x7f41b40b1620 msgr2=0x7f41b40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 -- 172.21.15.81:0/3601821796 shutdown_connections 2024-09-17T05:23:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.697+0000 7f41b8c7f640 1 -- 172.21.15.81:0/3601821796 wait complete. 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 Processor -- start 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 -- start start 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41b4072530 0x7f41b4152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40b3310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41b415f600 0x7f41b40b3850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f41b4156320 con 0x7f41b40ceb70 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f41b406f060 con 0x7f41b415f600 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.699+0000 7f41b8c7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f41b41564a0 con 0x7f41b4072530 2024-09-17T05:23:40.702 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40b3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40b3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41026/0 (socket says 172.21.15.81:41026) 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 -- 172.21.15.81:0/1241643616 learned_addr learned my addr 172.21.15.81:0/1241643616 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41b2d9d640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41b415f600 0x7f41b40b3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41b259c640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41b4072530 0x7f41b4152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 -- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41b4072530 msgr2=0x7f41b4152830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41b4072530 0x7f41b4152830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 -- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41b415f600 msgr2=0x7f41b40b3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41b415f600 0x7f41b40b3850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 -- 172.21.15.81:0/1241643616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41b41f5970 con 0x7f41b40ceb70 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41b2d9d640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41b415f600 0x7f41b40b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:40.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41abfff640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40b3310 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f419c00b4a0 tx=0x7f419c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41aaffd640 1 -- 172.21.15.81:0/1241643616 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c014070 con 0x7f41b40ceb70 2024-09-17T05:23:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41aaffd640 1 -- 172.21.15.81:0/1241643616 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f419c010700 con 0x7f41b40ceb70 2024-09-17T05:23:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41b41f48d0 con 0x7f41b40ceb70 2024-09-17T05:23:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41aaffd640 1 -- 172.21.15.81:0/1241643616 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f419c010b50 con 0x7f41b40ceb70 2024-09-17T05:23:40.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.700+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41b41f4e90 con 0x7f41b40ceb70 2024-09-17T05:23:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.701+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41b40cf750 con 0x7f41b40ceb70 2024-09-17T05:23:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.702+0000 7f41aaffd640 1 -- 172.21.15.81:0/1241643616 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7f419c017070 con 0x7f41b40ceb70 2024-09-17T05:23:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.703+0000 7f41aaffd640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4194078d40 0x7f419407b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.703+0000 7f41b259c640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4194078d40 0x7f419407b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.703+0000 7f41aaffd640 1 -- 172.21.15.81:0/1241643616 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f419c09ab40 con 0x7f41b40ceb70 2024-09-17T05:23:40.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.703+0000 7f41b259c640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4194078d40 0x7f419407b200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41a40015e0 tx=0x7f41a4009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:40.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.707+0000 7f41aaffd640 1 -- 172.21.15.81:0/1241643616 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f41b41f5970 con 0x7f41b40ceb70 2024-09-17T05:23:40.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.913+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "cephfs", "sub_name": "subvol21940", "snap_name": "subvol_snap72950", "target": ["mon-mgr", ""]}) -- 0x7f41b4074100 con 0x7f4194078d40 2024-09-17T05:23:40.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.932+0000 7f41aaffd640 1 -- 172.21.15.81:0/1241643616 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f41b4074100 con 0x7f4194078d40 2024-09-17T05:23:40.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4194078d40 msgr2=0x7f419407b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4194078d40 0x7f419407b200 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f41a40015e0 tx=0x7f41a4009040 comp rx=0 tx=0).stop 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 msgr2=0x7f41b40b3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40b3310 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f419c00b4a0 tx=0x7f419c00b960 comp rx=0 tx=0).stop 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 shutdown_connections 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4194078d40 0x7f419407b200 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f41b415f600 0x7f41b40b3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f41b40ceb70 0x7f41b40b3310 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 --2- 172.21.15.81:0/1241643616 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f41b4072530 0x7f41b4152830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 >> 172.21.15.81:0/1241643616 conn(0x7f41b40b1620 msgr2=0x7f41b4072b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:40.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 shutdown_connections 2024-09-17T05:23:40.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:40.934+0000 7f41b8c7f640 1 -- 172.21.15.81:0/1241643616 wait complete. 2024-09-17T05:23:40.946 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol21940 subvol_snap72950 subvol_clone63710 2024-09-17T05:23:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.053+0000 7efc19e72640 1 -- 172.21.15.81:0/2008111572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc00003a80 msgr2=0x7efc00003ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.053+0000 7efc19e72640 1 --2- 172.21.15.81:0/2008111572 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc00003a80 0x7efc00003ec0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7efc0400c310 tx=0x7efc00005830 comp rx=0 tx=0).stop 2024-09-17T05:23:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.053+0000 7efc13fff640 1 -- 172.21.15.81:0/2008111572 reap_dead start 2024-09-17T05:23:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.053+0000 7efc19e72640 1 -- 172.21.15.81:0/2008111572 shutdown_connections 2024-09-17T05:23:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.053+0000 7efc19e72640 1 -- 172.21.15.81:0/2008111572 >> 172.21.15.81:0/2008111572 conn(0x7efc140d3e30 msgr2=0x7efc140d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.053+0000 7efc19e72640 1 -- 172.21.15.81:0/2008111572 shutdown_connections 2024-09-17T05:23:41.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.053+0000 7efc19e72640 1 -- 172.21.15.81:0/2008111572 wait complete. 2024-09-17T05:23:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.054+0000 7efc19e72640 1 Processor -- start 2024-09-17T05:23:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.054+0000 7efc19e72640 1 -- start start 2024-09-17T05:23:41.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc19e72640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc00003a80 0x7efc141f5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc19e72640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc14158300 0x7efc14150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc19e72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140caf00 0x7efc140cd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc19e72640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7efc140d2910 con 0x7efc140caf00 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc19e72640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7efc140d2790 con 0x7efc14158300 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc19e72640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7efc140d2a90 con 0x7efc00003a80 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140caf00 0x7efc140cd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140caf00 0x7efc140cd110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41050/0 (socket says 172.21.15.81:41050) 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 -- 172.21.15.81:0/3980197785 learned_addr learned my addr 172.21.15.81:0/3980197785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc137fe640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc00003a80 0x7efc141f5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc0bfff640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc14158300 0x7efc14150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 -- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc00003a80 msgr2=0x7efc141f5a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc00003a80 0x7efc141f5a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 -- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc14158300 msgr2=0x7efc14150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc14158300 0x7efc14150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 -- 172.21.15.81:0/3980197785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc140b6e00 con 0x7efc140caf00 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc137fe640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc00003a80 0x7efc141f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc0bfff640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc14158300 0x7efc14150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.055+0000 7efc13fff640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140caf00 0x7efc140cd110 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efc1406a240 tx=0x7efc0c001950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.056+0000 7efc10ff9640 1 -- 172.21.15.81:0/3980197785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011870 con 0x7efc140caf00 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.056+0000 7efc10ff9640 1 -- 172.21.15.81:0/3980197785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7efc0c017070 con 0x7efc140caf00 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.056+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc140b70e0 con 0x7efc140caf00 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.056+0000 7efc10ff9640 1 -- 172.21.15.81:0/3980197785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc0c011dc0 con 0x7efc140caf00 2024-09-17T05:23:41.059 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.056+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc140b9b60 con 0x7efc140caf00 2024-09-17T05:23:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.057+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc140b4c70 con 0x7efc140caf00 2024-09-17T05:23:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.057+0000 7efc10ff9640 1 -- 172.21.15.81:0/3980197785 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7efc0c01c460 con 0x7efc140caf00 2024-09-17T05:23:41.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.058+0000 7efc10ff9640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efbf4078d70 0x7efbf407b230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.058+0000 7efc137fe640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efbf4078d70 0x7efbf407b230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.058+0000 7efc10ff9640 1 -- 172.21.15.81:0/3980197785 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7efc0c09b7e0 con 0x7efc140caf00 2024-09-17T05:23:41.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.058+0000 7efc137fe640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efbf4078d70 0x7efbf407b230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efc04033000 tx=0x7efc140d3960 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:41.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.062+0000 7efc10ff9640 1 -- 172.21.15.81:0/3980197785 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7efc0c063920 con 0x7efc140caf00 2024-09-17T05:23:41.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.276+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol21940", "snap_name": "subvol_snap72950", "target_sub_name": "subvol_clone63710", "target": ["mon-mgr", ""]}) -- 0x7efc140b3570 con 0x7efbf4078d70 2024-09-17T05:23:41.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.346+0000 7efc10ff9640 1 -- 172.21.15.81:0/3980197785 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7efc140b3570 con 0x7efbf4078d70 2024-09-17T05:23:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efbf4078d70 msgr2=0x7efbf407b230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efbf4078d70 0x7efbf407b230 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7efc04033000 tx=0x7efc140d3960 comp rx=0 tx=0).stop 2024-09-17T05:23:41.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140caf00 msgr2=0x7efc140cd110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140caf00 0x7efc140cd110 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7efc1406a240 tx=0x7efc0c001950 comp rx=0 tx=0).stop 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 shutdown_connections 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7efc140caf00 0x7efc140cd110 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7efbf4078d70 0x7efbf407b230 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7efc14158300 0x7efc14150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 --2- 172.21.15.81:0/3980197785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7efc00003a80 0x7efc141f5a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 >> 172.21.15.81:0/3980197785 conn(0x7efc140d3e30 msgr2=0x7efc140b4e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 shutdown_connections 2024-09-17T05:23:41.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.348+0000 7efc19e72640 1 -- 172.21.15.81:0/3980197785 wait complete. 2024-09-17T05:23:41.351 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.349+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.351 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.349+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.351 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.349+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.351 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.349+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.351 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.349+0000 7fe39977b640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone63710 2024-09-17T05:23:41.363 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.362+0000 7fe398779640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.363 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.362+0000 7fe398779640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.364 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.362+0000 7fe398779640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.364 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.362+0000 7fe398779640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.364 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:41.362+0000 7fe398779640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.478+0000 7f8822040640 1 -- 172.21.15.81:0/691964114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c0d2740 msgr2=0x7f881c0ce5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.478+0000 7f8822040640 1 --2- 172.21.15.81:0/691964114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c0d2740 0x7f881c0ce5c0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f8804009860 tx=0x7f880402a560 comp rx=0 tx=0).stop 2024-09-17T05:23:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.478+0000 7f8822040640 1 -- 172.21.15.81:0/691964114 shutdown_connections 2024-09-17T05:23:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.478+0000 7f8822040640 1 --2- 172.21.15.81:0/691964114 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c0d2740 0x7f881c0ce5c0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.478+0000 7f8822040640 1 -- 172.21.15.81:0/691964114 >> 172.21.15.81:0/691964114 conn(0x7f881c0d1bb0 msgr2=0x7f881c0d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:41.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.478+0000 7f8822040640 1 -- 172.21.15.81:0/691964114 shutdown_connections 2024-09-17T05:23:41.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.478+0000 7f8822040640 1 -- 172.21.15.81:0/691964114 wait complete. 2024-09-17T05:23:41.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.479+0000 7f8822040640 1 Processor -- start 2024-09-17T05:23:41.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.479+0000 7f8822040640 1 -- start start 2024-09-17T05:23:41.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f8822040640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c0ceb00 0x7f881c0c4810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f8822040640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f881c0d2740 0x7f881c1483f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f8822040640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c15bda0 0x7f881c147b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f8822040640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b3040 con 0x7f881c0ceb00 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f8822040640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f881c0b2ec0 con 0x7f881c15bda0 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f8822040640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f881c0b31c0 con 0x7f881c0d2740 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f881b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c0ceb00 0x7f881c0c4810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f881b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c0ceb00 0x7f881c0c4810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41098/0 (socket says 172.21.15.81:41098) 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f881b7fe640 1 -- 172.21.15.81:0/3758778178 learned_addr learned my addr 172.21.15.81:0/3758778178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f881bfff640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c15bda0 0x7f881c147b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.480+0000 7f8813fff640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f881c0d2740 0x7f881c1483f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f881b7fe640 1 -- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f881c0d2740 msgr2=0x7f881c1483f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f881b7fe640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f881c0d2740 0x7f881c1483f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f881b7fe640 1 -- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c15bda0 msgr2=0x7f881c147b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:41.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f881b7fe640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c15bda0 0x7f881c147b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f881b7fe640 1 -- 172.21.15.81:0/3758778178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881c0c4e60 con 0x7f881c0ceb00 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f881bfff640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c15bda0 0x7f881c147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f881b7fe640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c0ceb00 0x7f881c0c4810 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c430 tx=0x7f880c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c017070 con 0x7f881c0ceb00 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f880c0053c0 con 0x7f881c0ceb00 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880c003850 con 0x7f881c0ceb00 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881c151cb0 con 0x7f881c0ceb00 2024-09-17T05:23:41.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.481+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f881c1480a0 con 0x7f881c0ceb00 2024-09-17T05:23:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.482+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f881c0cf0f0 con 0x7f881c0ceb00 2024-09-17T05:23:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.483+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 17) ==== 101594+0+0 (secure 0 0 0) 0x7f880c01a070 con 0x7f881c0ceb00 2024-09-17T05:23:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.483+0000 7f8818ff9640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f87fc078d40 0x7f87fc07b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.483+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f880c09a340 con 0x7f881c0ceb00 2024-09-17T05:23:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.483+0000 7f8813fff640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f87fc078d40 0x7f87fc07b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:41.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.484+0000 7f8813fff640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f87fc078d40 0x7f87fc07b200 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8804034000 tx=0x7f8804004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:41.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.488+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f881c0cf0f0 con 0x7f881c0ceb00 2024-09-17T05:23:41.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:41.718+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone63710", "target": ["mon-mgr", ""]}) -- 0x7f881c0b41b0 con 0x7f87fc078d40 2024-09-17T05:23:42.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.166+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 18) ==== 101696+0+0 (secure 0 0 0) 0x7f880c05e1e0 con 0x7f881c0ceb00 2024-09-17T05:23:42.350 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:42.349+0000 7fe3806c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:42.350 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:42.349+0000 7fe3806c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:42.350 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:42.349+0000 7fe3806c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:42.350 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:42.349+0000 7fe3806c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:42.350 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:42.349+0000 7fe3806c9640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:42.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.359+0000 7f8818ff9640 1 -- 172.21.15.81:0/3758778178 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f881c0b41b0 con 0x7f87fc078d40 2024-09-17T05:23:42.360 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:42.360 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2024-09-17T05:23:42.360 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "complete" 2024-09-17T05:23:42.360 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:42.360 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:42.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f87fc078d40 msgr2=0x7f87fc07b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f87fc078d40 0x7f87fc07b200 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f8804034000 tx=0x7f8804004730 comp rx=0 tx=0).stop 2024-09-17T05:23:42.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c0ceb00 msgr2=0x7f881c0c4810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c0ceb00 0x7f881c0c4810 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f880c00c430 tx=0x7f880c00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 shutdown_connections 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f87fc078d40 0x7f87fc07b200 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f881c15bda0 0x7f881c147b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f881c0d2740 0x7f881c1483f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 --2- 172.21.15.81:0/3758778178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f881c0ceb00 0x7f881c0c4810 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 >> 172.21.15.81:0/3758778178 conn(0x7f881c0d1bb0 msgr2=0x7f881c071bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 shutdown_connections 2024-09-17T05:23:42.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.361+0000 7f8822040640 1 -- 172.21.15.81:0/3758778178 wait complete. 2024-09-17T05:23:42.374 DEBUG:tasks.cephfs.test_volumes:current clone state = complete 2024-09-17T05:23:42.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:42.374 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone63710/.meta) 2024-09-17T05:23:42.403 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:23:42.403 INFO:teuthology.orchestra.run.smithi081.stdout:version = 2 2024-09-17T05:23:42.403 INFO:teuthology.orchestra.run.smithi081.stdout:type = clone 2024-09-17T05:23:42.403 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5 2024-09-17T05:23:42.404 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:23:42.404 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:42.406 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol21940 2024-09-17T05:23:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.551+0000 7fc829d17640 1 -- 172.21.15.81:0/572687497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8100039e0 msgr2=0x7fc810003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.551+0000 7fc829d17640 1 --2- 172.21.15.81:0/572687497 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8100039e0 0x7fc810003dc0 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc814001700 tx=0x7fc810005830 comp rx=0 tx=0).stop 2024-09-17T05:23:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.551+0000 7fc823fff640 1 -- 172.21.15.81:0/572687497 reap_dead start 2024-09-17T05:23:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.551+0000 7fc829d17640 1 -- 172.21.15.81:0/572687497 shutdown_connections 2024-09-17T05:23:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.551+0000 7fc829d17640 1 -- 172.21.15.81:0/572687497 >> 172.21.15.81:0/572687497 conn(0x7fc8240b1700 msgr2=0x7fc8240b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.551+0000 7fc829d17640 1 -- 172.21.15.81:0/572687497 shutdown_connections 2024-09-17T05:23:42.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.551+0000 7fc829d17640 1 -- 172.21.15.81:0/572687497 wait complete. 2024-09-17T05:23:42.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.552+0000 7fc829d17640 1 Processor -- start 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.552+0000 7fc829d17640 1 -- start start 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc829d17640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8100039e0 0x7fc8241f5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc829d17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc824150e60 0x7fc8241507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc829d17640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8241f2390 0x7fc824072bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc829d17640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8240cadc0 con 0x7fc824150e60 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc829d17640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc8240cac40 con 0x7fc8100039e0 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc829d17640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc8240caf40 con 0x7fc8241f2390 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc824150e60 0x7fc8241507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc824150e60 0x7fc8241507d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41130/0 (socket says 172.21.15.81:41130) 2024-09-17T05:23:42.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 -- 172.21.15.81:0/234671902 learned_addr learned my addr 172.21.15.81:0/234671902 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc8237fe640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8100039e0 0x7fc8241f5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 -- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8241f2390 msgr2=0x7fc824072bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8241f2390 0x7fc824072bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 -- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8100039e0 msgr2=0x7fc8241f5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8100039e0 0x7fc8241f5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc81bfff640 1 -- 172.21.15.81:0/234671902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8241f1bd0 con 0x7fc824150e60 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.553+0000 7fc8237fe640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8100039e0 0x7fc8241f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.554+0000 7fc81bfff640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc824150e60 0x7fc8241507d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00e5b0 tx=0x7fc80c00ea70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.554+0000 7fc820ff9640 1 -- 172.21.15.81:0/234671902 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c015070 con 0x7fc824150e60 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.554+0000 7fc820ff9640 1 -- 172.21.15.81:0/234671902 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc80c011960 con 0x7fc824150e60 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.554+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8241542b0 con 0x7fc824150e60 2024-09-17T05:23:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.554+0000 7fc820ff9640 1 -- 172.21.15.81:0/234671902 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc80c011d90 con 0x7fc824150e60 2024-09-17T05:23:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.554+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8241f1e70 con 0x7fc824150e60 2024-09-17T05:23:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.555+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc82415b3d0 con 0x7fc824150e60 2024-09-17T05:23:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.555+0000 7fc820ff9640 1 -- 172.21.15.81:0/234671902 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 101696+0+0 (secure 0 0 0) 0x7fc80c018070 con 0x7fc824150e60 2024-09-17T05:23:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.556+0000 7fc820ff9640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc804078e90 0x7fc80407b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.556+0000 7fc820ff9640 1 -- 172.21.15.81:0/234671902 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7fc80c09b6d0 con 0x7fc824150e60 2024-09-17T05:23:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.556+0000 7fc8237fe640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc804078e90 0x7fc80407b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:42.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.556+0000 7fc8237fe640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc804078e90 0x7fc80407b350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc814032000 tx=0x7fc814037040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.560+0000 7fc820ff9640 1 -- 172.21.15.81:0/234671902 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc80c063660 con 0x7fc824150e60 2024-09-17T05:23:42.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.763+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol21940", "target": ["mon-mgr", ""]}) -- 0x7fc8240caa20 con 0x7fc804078e90 2024-09-17T05:23:42.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.775+0000 7fc820ff9640 1 -- 172.21.15.81:0/234671902 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fc8240caa20 con 0x7fc804078e90 2024-09-17T05:23:42.777 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4 2024-09-17T05:23:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc804078e90 msgr2=0x7fc80407b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc804078e90 0x7fc80407b350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fc814032000 tx=0x7fc814037040 comp rx=0 tx=0).stop 2024-09-17T05:23:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc824150e60 msgr2=0x7fc8241507d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc824150e60 0x7fc8241507d0 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc80c00e5b0 tx=0x7fc80c00ea70 comp rx=0 tx=0).stop 2024-09-17T05:23:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 shutdown_connections 2024-09-17T05:23:42.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8241f2390 0x7fc824072bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc824150e60 0x7fc8241507d0 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc804078e90 0x7fc80407b350 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 --2- 172.21.15.81:0/234671902 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8100039e0 0x7fc8241f5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 >> 172.21.15.81:0/234671902 conn(0x7fc8240b1700 msgr2=0x7fc824072440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 shutdown_connections 2024-09-17T05:23:42.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.778+0000 7fc829d17640 1 -- 172.21.15.81:0/234671902 wait complete. 2024-09-17T05:23:42.790 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol_clone63710 2024-09-17T05:23:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.894+0000 7f65938d4640 1 -- 172.21.15.81:0/3137314225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 msgr2=0x7f6578003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.894+0000 7f65938d4640 1 --2- 172.21.15.81:0/3137314225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f6578003e70 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f6588001d90 tx=0x7f6578005830 comp rx=0 tx=0).stop 2024-09-17T05:23:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.894+0000 7f65938d4640 1 -- 172.21.15.81:0/3137314225 shutdown_connections 2024-09-17T05:23:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.894+0000 7f65938d4640 1 --2- 172.21.15.81:0/3137314225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f6578003e70 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.894+0000 7f65938d4640 1 -- 172.21.15.81:0/3137314225 >> 172.21.15.81:0/3137314225 conn(0x7f658c09aa30 msgr2=0x7f658c09ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.894+0000 7f65938d4640 1 -- 172.21.15.81:0/3137314225 shutdown_connections 2024-09-17T05:23:42.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.894+0000 7f65938d4640 1 -- 172.21.15.81:0/3137314225 wait complete. 2024-09-17T05:23:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.895+0000 7f65938d4640 1 Processor -- start 2024-09-17T05:23:42.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.895+0000 7f65938d4640 1 -- start start 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f65938d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f658c1f5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f65938d4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f658c15c390 0x7f658c15e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f65938d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f658c15e540 0x7f658c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f65938d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f658c0d1ce0 con 0x7f6578003a50 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f65938d4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f658c0d0810 con 0x7f658c15c390 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f65938d4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f658c0d1e60 con 0x7f658c15e540 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f658c1f5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f658c1f5f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:41152/0 (socket says 172.21.15.81:41152) 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 -- 172.21.15.81:0/1034262939 learned_addr learned my addr 172.21.15.81:0/1034262939 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:42.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6590e6f640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f658c15c390 0x7f658c15e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591e71640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f658c15e540 0x7f658c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 -- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f658c15e540 msgr2=0x7f658c0c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f658c15e540 0x7f658c0c9ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 -- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f658c15c390 msgr2=0x7f658c15e000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f658c15c390 0x7f658c15e000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 -- 172.21.15.81:0/1034262939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f658c0cc020 con 0x7f6578003a50 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6590e6f640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f658c15c390 0x7f658c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6591670640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f658c1f5f60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f658802ac70 tx=0x7f6588003aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6581ffb640 1 -- 172.21.15.81:0/1034262939 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6588006460 con 0x7f6578003a50 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6581ffb640 1 -- 172.21.15.81:0/1034262939 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65880066f0 con 0x7f6578003a50 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f6581ffb640 1 -- 172.21.15.81:0/1034262939 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65880336e0 con 0x7f6578003a50 2024-09-17T05:23:42.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.896+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f658c15e9c0 con 0x7f6578003a50 2024-09-17T05:23:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.897+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f658c0b7440 con 0x7f6578003a50 2024-09-17T05:23:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.898+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f658c0b2ca0 con 0x7f6578003a50 2024-09-17T05:23:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.898+0000 7f6581ffb640 1 -- 172.21.15.81:0/1034262939 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 101696+0+0 (secure 0 0 0) 0x7f6588033880 con 0x7f6578003a50 2024-09-17T05:23:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.899+0000 7f6581ffb640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6570078e60 0x7f657007b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:42.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.899+0000 7f6581ffb640 1 -- 172.21.15.81:0/1034262939 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7f65880bb830 con 0x7f6578003a50 2024-09-17T05:23:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.899+0000 7f6590e6f640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6570078e60 0x7f657007b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:42.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.899+0000 7f6590e6f640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6570078e60 0x7f657007b320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f658c0a0010 tx=0x7f657c005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:42.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:42.903+0000 7f6581ffb640 1 -- 172.21.15.81:0/1034262939 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f658c0cc020 con 0x7f6578003a50 2024-09-17T05:23:43.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.106+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol_clone63710", "target": ["mon-mgr", ""]}) -- 0x7f658c1f64a0 con 0x7f6570078e60 2024-09-17T05:23:43.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.112+0000 7f6581ffb640 1 -- 172.21.15.81:0/1034262939 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+73 (secure 0 0 0) 0x7f658c1f64a0 con 0x7f6570078e60 2024-09-17T05:23:43.113 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5 2024-09-17T05:23:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6570078e60 msgr2=0x7f657007b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6570078e60 0x7f657007b320 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f658c0a0010 tx=0x7f657c005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:43.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 msgr2=0x7f658c1f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f658c1f5f60 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f658802ac70 tx=0x7f6588003aa0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 shutdown_connections 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f658c15e540 0x7f658c0c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6570078e60 0x7f657007b320 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f658c15c390 0x7f658c15e000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 --2- 172.21.15.81:0/1034262939 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6578003a50 0x7f658c1f5f60 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 >> 172.21.15.81:0/1034262939 conn(0x7f658c09aa30 msgr2=0x7f658c0cecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 shutdown_connections 2024-09-17T05:23:43.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.114+0000 7f65938d4640 1 -- 172.21.15.81:0/1034262939 wait complete. 2024-09-17T05:23:43.126 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.127 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:43.150 INFO:teuthology.orchestra.run.smithi081.stdout:9 2024-09-17T05:23:43.150 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.150 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.rentries volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5) 2024-09-17T05:23:43.211 INFO:teuthology.orchestra.run.smithi081.stdout:9 2024-09-17T05:23:43.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info cephfs subvol_clone63710 2024-09-17T05:23:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.353+0000 7ff78759e640 1 -- 172.21.15.81:0/3650907609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff774003f70 msgr2=0x7ff774004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.353+0000 7ff78759e640 1 --2- 172.21.15.81:0/3650907609 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff774003f70 0x7ff774004800 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7ff78806e070 tx=0x7ff774005830 comp rx=0 tx=0).stop 2024-09-17T05:23:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.353+0000 7ff786d9d640 1 -- 172.21.15.81:0/3650907609 reap_dead start 2024-09-17T05:23:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.354+0000 7ff78759e640 1 -- 172.21.15.81:0/3650907609 shutdown_connections 2024-09-17T05:23:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.354+0000 7ff78759e640 1 -- 172.21.15.81:0/3650907609 >> 172.21.15.81:0/3650907609 conn(0x7ff7880cf860 msgr2=0x7ff7880cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.354+0000 7ff78759e640 1 -- 172.21.15.81:0/3650907609 shutdown_connections 2024-09-17T05:23:43.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.354+0000 7ff78759e640 1 -- 172.21.15.81:0/3650907609 wait complete. 2024-09-17T05:23:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.355+0000 7ff78759e640 1 Processor -- start 2024-09-17T05:23:43.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.355+0000 7ff78759e640 1 -- start start 2024-09-17T05:23:43.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff78759e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff774003f70 0x7ff788158c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:43.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff78759e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff78814b3d0 0x7ff78814ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:43.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff78759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7880b0630 0x7ff7880ad8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff78759e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff7880cc460 con 0x7ff7880b0630 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff78759e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff7880cc2e0 con 0x7ff774003f70 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff78759e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff7880cc5e0 con 0x7ff78814b3d0 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7880b0630 0x7ff7880ad8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7880b0630 0x7ff7880ad8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42694/0 (socket says 172.21.15.81:42694) 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 -- 172.21.15.81:0/242790718 learned_addr learned my addr 172.21.15.81:0/242790718 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff78659c640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff774003f70 0x7ff788158c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff785d9b640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff78814b3d0 0x7ff78814ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:43.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 -- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff78814b3d0 msgr2=0x7ff78814ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff78814b3d0 0x7ff78814ad60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 -- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff774003f70 msgr2=0x7ff788158c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff774003f70 0x7ff788158c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 -- 172.21.15.81:0/242790718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7880afca0 con 0x7ff7880b0630 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.356+0000 7ff786d9d640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7880b0630 0x7ff7880ad8a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff788072d30 tx=0x7ff780011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.357+0000 7ff77effd640 1 -- 172.21.15.81:0/242790718 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff780004230 con 0x7ff7880b0630 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.357+0000 7ff77effd640 1 -- 172.21.15.81:0/242790718 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff780016070 con 0x7ff7880b0630 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.357+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff788158480 con 0x7ff7880b0630 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.357+0000 7ff77effd640 1 -- 172.21.15.81:0/242790718 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff78000fa40 con 0x7ff7880b0630 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.357+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7880b0220 con 0x7ff7880b0630 2024-09-17T05:23:43.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.358+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7880b0460 con 0x7ff7880b0630 2024-09-17T05:23:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.358+0000 7ff77effd640 1 -- 172.21.15.81:0/242790718 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 18) ==== 101696+0+0 (secure 0 0 0) 0x7ff78000fbe0 con 0x7ff7880b0630 2024-09-17T05:23:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.359+0000 7ff77effd640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff768078e90 0x7ff76807b350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.359+0000 7ff77effd640 1 -- 172.21.15.81:0/242790718 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 5709+0+0 (secure 0 0 0) 0x7ff78009b900 con 0x7ff7880b0630 2024-09-17T05:23:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.359+0000 7ff78659c640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff768078e90 0x7ff76807b350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:43.361 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.359+0000 7ff78659c640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff768078e90 0x7ff76807b350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7780012e0 tx=0x7ff778004980 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:43.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.363+0000 7ff77effd640 1 -- 172.21.15.81:0/242790718 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff780063320 con 0x7ff7880b0630 2024-09-17T05:23:43.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.564+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "cephfs", "sub_name": "subvol_clone63710", "target": ["mon-mgr", ""]}) -- 0x7ff7880733c0 con 0x7ff768078e90 2024-09-17T05:23:43.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.572+0000 7ff77effd640 1 -- 172.21.15.81:0/242790718 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+743 (secure 0 0 0) 0x7ff7880733c0 con 0x7ff768078e90 2024-09-17T05:23:43.573 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "atime": "2024-09-17 05:23:36", 2024-09-17T05:23:43.573 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_pcent": "80.00", 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_quota": 10485760, 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "bytes_used": 8388608, 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "created_at": "2024-09-17 05:23:41", 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "ctime": "2024-09-17 05:23:41", 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "cephfs_data", 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "earmark": "", 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "features": [ 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot-clone", 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot-autoprotect", 2024-09-17T05:23:43.574 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot-retention" 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "flavor": 2, 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "gid": 1000, 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "mode": 16895, 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "mon_addrs": [ 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.81:6789", 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.160:6789", 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "172.21.15.160:6790" 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: ], 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "mtime": "2024-09-17 05:23:40", 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "path": "/volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5", 2024-09-17T05:23:43.575 INFO:teuthology.orchestra.run.smithi081.stdout: "pool_namespace": "", 2024-09-17T05:23:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "complete", 2024-09-17T05:23:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "clone", 2024-09-17T05:23:43.576 INFO:teuthology.orchestra.run.smithi081.stdout: "uid": 1000 2024-09-17T05:23:43.576 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff768078e90 msgr2=0x7ff76807b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff768078e90 0x7ff76807b350 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff7780012e0 tx=0x7ff778004980 comp rx=0 tx=0).stop 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7880b0630 msgr2=0x7ff7880ad8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7880b0630 0x7ff7880ad8a0 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff788072d30 tx=0x7ff780011b10 comp rx=0 tx=0).stop 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 shutdown_connections 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff7880b0630 0x7ff7880ad8a0 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff78814b3d0 0x7ff78814ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff768078e90 0x7ff76807b350 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 --2- 172.21.15.81:0/242790718 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff774003f70 0x7ff788158c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.574+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 >> 172.21.15.81:0/242790718 conn(0x7ff7880cf860 msgr2=0x7ff7880cbb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.575+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 shutdown_connections 2024-09-17T05:23:43.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:43.575+0000 7ff78759e640 1 -- 172.21.15.81:0/242790718 wait complete. 2024-09-17T05:23:43.586 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.586 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.quota.max_bytes volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:43.609 INFO:teuthology.orchestra.run.smithi081.stdout:10485760 2024-09-17T05:23:43.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.610 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:43.671 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:23:43.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.672 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool_namespace volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:43.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.733 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec find volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.2 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.5 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.4 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.7 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.6 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.0 2024-09-17T05:23:43.795 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.3 2024-09-17T05:23:43.796 INFO:teuthology.orchestra.run.smithi081.stdout:volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.1 2024-09-17T05:23:43.796 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.796 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:43.852 INFO:teuthology.orchestra.run.smithi081.stdout:41ff 2024-09-17T05:23:43.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.852 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/) 2024-09-17T05:23:43.912 INFO:teuthology.orchestra.run.smithi081.stdout:41ff 2024-09-17T05:23:43.912 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.912 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:43.969 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:43.969 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:43.969 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/) 2024-09-17T05:23:44.026 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:44.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.027 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:44.084 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:44.084 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.084 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/) 2024-09-17T05:23:44.140 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:44.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.140 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950) 2024-09-17T05:23:44.197 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:44.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.198 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/) 2024-09-17T05:23:44.254 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:44.254 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.254 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.2) 2024-09-17T05:23:44.313 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:44.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.314 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.2) 2024-09-17T05:23:44.377 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:44.377 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.378 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.2) 2024-09-17T05:23:44.436 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:44.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.436 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.2) 2024-09-17T05:23:44.492 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:44.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.492 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.2) 2024-09-17T05:23:44.550 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:44.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.551 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.2) 2024-09-17T05:23:44.607 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:44.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.607 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.2) 2024-09-17T05:23:44.664 INFO:teuthology.orchestra.run.smithi081.stdout:1726550619 2024-09-17T05:23:44.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.665 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.2) 2024-09-17T05:23:44.721 INFO:teuthology.orchestra.run.smithi081.stdout:1726550619 2024-09-17T05:23:44.721 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.721 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.5) 2024-09-17T05:23:44.778 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:44.778 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.778 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.5) 2024-09-17T05:23:44.841 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:44.841 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.841 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.5) 2024-09-17T05:23:44.900 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:44.900 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.900 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.5) 2024-09-17T05:23:44.956 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:44.956 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:44.956 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.5) 2024-09-17T05:23:45.014 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:45.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.014 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.5) 2024-09-17T05:23:45.070 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:45.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.070 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.5) 2024-09-17T05:23:45.127 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:45.127 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.128 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.5) 2024-09-17T05:23:45.185 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:45.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.186 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.4) 2024-09-17T05:23:45.244 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:45.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.244 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.4) 2024-09-17T05:23:45.306 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:45.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.307 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.4) 2024-09-17T05:23:45.365 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:45.365 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.365 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.4) 2024-09-17T05:23:45.421 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:45.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.421 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.4) 2024-09-17T05:23:45.479 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:45.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.480 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.4) 2024-09-17T05:23:45.482 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:45.523 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:23:45.536 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:45.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.536 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.4) 2024-09-17T05:23:45.630 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:45.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.630 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.4) 2024-09-17T05:23:45.686 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:45.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.686 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.7) 2024-09-17T05:23:45.743 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:45.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.743 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.7) 2024-09-17T05:23:45.807 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:45.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.808 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.7) 2024-09-17T05:23:45.866 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:45.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.866 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.7) 2024-09-17T05:23:45.922 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:45.922 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.922 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.7) 2024-09-17T05:23:45.980 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:45.980 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:45.980 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.7) 2024-09-17T05:23:46.037 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:46.037 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.038 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.7) 2024-09-17T05:23:46.096 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:46.096 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.096 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.7) 2024-09-17T05:23:46.152 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:46.152 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.153 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.6) 2024-09-17T05:23:46.211 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:46.212 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.212 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.6) 2024-09-17T05:23:46.274 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:46.275 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.275 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.6) 2024-09-17T05:23:46.332 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:46.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.333 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.6) 2024-09-17T05:23:46.389 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:46.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.389 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.6) 2024-09-17T05:23:46.447 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:46.447 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.448 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.6) 2024-09-17T05:23:46.504 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:46.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.504 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.6) 2024-09-17T05:23:46.561 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:46.561 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.562 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.6) 2024-09-17T05:23:46.618 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:46.618 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.618 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.0) 2024-09-17T05:23:46.675 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:46.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.676 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.0) 2024-09-17T05:23:46.737 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:46.738 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.738 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.0) 2024-09-17T05:23:46.795 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:46.795 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.796 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.0) 2024-09-17T05:23:46.851 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:46.851 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.852 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.0) 2024-09-17T05:23:46.910 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:46.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.910 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.0) 2024-09-17T05:23:46.966 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:46.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:46.966 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.0) 2024-09-17T05:23:47.024 INFO:teuthology.orchestra.run.smithi081.stdout:1726550619 2024-09-17T05:23:47.025 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.025 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.0) 2024-09-17T05:23:47.081 INFO:teuthology.orchestra.run.smithi081.stdout:1726550619 2024-09-17T05:23:47.081 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.081 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.3) 2024-09-17T05:23:47.139 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:47.140 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.140 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.3) 2024-09-17T05:23:47.203 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:47.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.204 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.3) 2024-09-17T05:23:47.262 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:47.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.262 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.3) 2024-09-17T05:23:47.318 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:47.318 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.318 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.3) 2024-09-17T05:23:47.379 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:47.379 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.379 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.3) 2024-09-17T05:23:47.435 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:47.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.436 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.3) 2024-09-17T05:23:47.493 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:47.493 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.493 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.3) 2024-09-17T05:23:47.548 INFO:teuthology.orchestra.run.smithi081.stdout:1726550620 2024-09-17T05:23:47.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.549 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.1) 2024-09-17T05:23:47.606 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:47.607 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.607 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%f volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.1) 2024-09-17T05:23:47.665 INFO:teuthology.orchestra.run.smithi081.stdout:81a4 2024-09-17T05:23:47.666 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.666 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.1) 2024-09-17T05:23:47.723 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:47.724 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.724 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%u volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.1) 2024-09-17T05:23:47.780 INFO:teuthology.orchestra.run.smithi081.stdout:1000 2024-09-17T05:23:47.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.780 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.1) 2024-09-17T05:23:47.838 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:47.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.838 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%g volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.1) 2024-09-17T05:23:47.894 INFO:teuthology.orchestra.run.smithi081.stdout:1333 2024-09-17T05:23:47.894 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.894 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4/.snap/subvol_snap72950/subvolume_file.1) 2024-09-17T05:23:47.951 INFO:teuthology.orchestra.run.smithi081.stdout:1726550619 2024-09-17T05:23:47.951 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:47.951 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stat -c%Y volumes/_nogroup/subvol_clone63710/0c610ef2-a3a9-479c-9fc9-02ede4ac10c5/subvolume_file.1) 2024-09-17T05:23:48.008 INFO:teuthology.orchestra.run.smithi081.stdout:1726550619 2024-09-17T05:23:48.008 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone cephfs subvol21940 fake subvol_clone52881 2024-09-17T05:23:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.155+0000 7f161d5cd640 1 -- 172.21.15.81:0/1991321432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1604003a30 msgr2=0x7f1604003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.155+0000 7f161d5cd640 1 --2- 172.21.15.81:0/1991321432 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1604003a30 0x7f1604003e50 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f1608001dc0 tx=0x7f1604005830 comp rx=0 tx=0).stop 2024-09-17T05:23:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.155+0000 7f16177fe640 1 -- 172.21.15.81:0/1991321432 reap_dead start 2024-09-17T05:23:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.155+0000 7f161d5cd640 1 -- 172.21.15.81:0/1991321432 shutdown_connections 2024-09-17T05:23:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.155+0000 7f161d5cd640 1 -- 172.21.15.81:0/1991321432 >> 172.21.15.81:0/1991321432 conn(0x7f161809aa30 msgr2=0x7f161809ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.155+0000 7f161d5cd640 1 -- 172.21.15.81:0/1991321432 shutdown_connections 2024-09-17T05:23:48.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.155+0000 7f161d5cd640 1 -- 172.21.15.81:0/1991321432 wait complete. 2024-09-17T05:23:48.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 Processor -- start 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 -- start start 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1604003a30 0x7f16180cc850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16181576d0 0x7f161814e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f161806f440 0x7f16180b4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f16180af9b0 con 0x7f16181576d0 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f16180af830 con 0x7f1604003a30 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.157+0000 7f161d5cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f16180afb30 con 0x7f161806f440 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16181576d0 0x7f161814e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16181576d0 0x7f161814e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42712/0 (socket says 172.21.15.81:42712) 2024-09-17T05:23:48.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 -- 172.21.15.81:0/527965814 learned_addr learned my addr 172.21.15.81:0/527965814 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16177fe640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f161806f440 0x7f16180b4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f1616ffd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1604003a30 0x7f16180cc850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 -- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f161806f440 msgr2=0x7f16180b4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f161806f440 0x7f16180b4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 -- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1604003a30 msgr2=0x7f16180cc850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1604003a30 0x7f16180cc850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 -- 172.21.15.81:0/527965814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f161806e3a0 con 0x7f16181576d0 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f1616ffd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1604003a30 0x7f16180cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16177fe640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f161806f440 0x7f16180b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f16167fc640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16181576d0 0x7f161814e3a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1600010a70 tx=0x7f1600010f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:48.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f160f7fe640 1 -- 172.21.15.81:0/527965814 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160000eda0 con 0x7f16181576d0 2024-09-17T05:23:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f160f7fe640 1 -- 172.21.15.81:0/527965814 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f160001c480 con 0x7f16181576d0 2024-09-17T05:23:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f160f7fe640 1 -- 172.21.15.81:0/527965814 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f160001c8d0 con 0x7f16181576d0 2024-09-17T05:23:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f161806e680 con 0x7f16181576d0 2024-09-17T05:23:48.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.158+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f161806ec40 con 0x7f16181576d0 2024-09-17T05:23:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.159+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16180cc430 con 0x7f16181576d0 2024-09-17T05:23:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.160+0000 7f160f7fe640 1 -- 172.21.15.81:0/527965814 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7f160001ca70 con 0x7f16181576d0 2024-09-17T05:23:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.160+0000 7f160f7fe640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f15f8078f20 0x7f15f807b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.160+0000 7f160f7fe640 1 -- 172.21.15.81:0/527965814 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f160009c2b0 con 0x7f16181576d0 2024-09-17T05:23:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.160+0000 7f1616ffd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f15f8078f20 0x7f15f807b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.161+0000 7f1616ffd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f15f8078f20 0x7f15f807b3e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1608032000 tx=0x7f1608001510 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:48.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.164+0000 7f160f7fe640 1 -- 172.21.15.81:0/527965814 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f16180cc430 con 0x7f16181576d0 2024-09-17T05:23:48.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.377+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "cephfs", "sub_name": "subvol21940", "snap_name": "fake", "target_sub_name": "subvol_clone52881", "target": ["mon-mgr", ""]}) -- 0x7f161806e150 con 0x7f15f8078f20 2024-09-17T05:23:48.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.446+0000 7f160f7fe640 1 -- 172.21.15.81:0/527965814 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f161806e150 con 0x7f15f8078f20 2024-09-17T05:23:48.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f15f8078f20 msgr2=0x7f15f807b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f15f8078f20 0x7f15f807b3e0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f1608032000 tx=0x7f1608001510 comp rx=0 tx=0).stop 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16181576d0 msgr2=0x7f161814e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16181576d0 0x7f161814e3a0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f1600010a70 tx=0x7f1600010f30 comp rx=0 tx=0).stop 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 shutdown_connections 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f161806f440 0x7f16180b4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f16181576d0 0x7f161814e3a0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f15f8078f20 0x7f15f807b3e0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 --2- 172.21.15.81:0/527965814 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1604003a30 0x7f16180cc850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 >> 172.21.15.81:0/527965814 conn(0x7f161809aa30 msgr2=0x7f16180b30b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:48.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 shutdown_connections 2024-09-17T05:23:48.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.448+0000 7f161d5cd640 1 -- 172.21.15.81:0/527965814 wait complete. 2024-09-17T05:23:48.460 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone52881 2024-09-17T05:23:48.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 -- 172.21.15.81:0/1442742714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 msgr2=0x7fde1c0d1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 --2- 172.21.15.81:0/1442742714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0d1c20 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7fde1c0d1860 tx=0x7fde0402a560 comp rx=0 tx=0).stop 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 -- 172.21.15.81:0/1442742714 shutdown_connections 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 --2- 172.21.15.81:0/1442742714 >> v2:172.21.15.160:3300/0 conn(0x7fde1c0d2160 0x7fde1c0ce6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 --2- 172.21.15.81:0/1442742714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0d1c20 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 --2- 172.21.15.81:0/1442742714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1c15bdc0 0x7fde1c0d02b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 -- 172.21.15.81:0/1442742714 >> 172.21.15.81:0/1442742714 conn(0x7fde1c09aa30 msgr2=0x7fde1c09ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 -- 172.21.15.81:0/1442742714 shutdown_connections 2024-09-17T05:23:48.567 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.565+0000 7fde223f3640 1 -- 172.21.15.81:0/1442742714 wait complete. 2024-09-17T05:23:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.566+0000 7fde223f3640 1 Processor -- start 2024-09-17T05:23:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.566+0000 7fde223f3640 1 -- start start 2024-09-17T05:23:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde223f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde223f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1c0d2160 0x7fde1c1f2f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde223f3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1c15bdc0 0x7fde1c1ef8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde223f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c0cefb0 con 0x7fde1c0b1360 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde223f3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fde1c0cee30 con 0x7fde1c0d2160 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde223f3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fde1c0cf130 con 0x7fde1c15bdc0 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0ca3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42732/0 (socket says 172.21.15.81:42732) 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 -- 172.21.15.81:0/4176529568 learned_addr learned my addr 172.21.15.81:0/4176529568 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde13fff640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1c0d2160 0x7fde1c1f2f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde20990640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1c15bdc0 0x7fde1c1ef8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 -- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1c15bdc0 msgr2=0x7fde1c1ef8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1c15bdc0 0x7fde1c1ef8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 -- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1c0d2160 msgr2=0x7fde1c1f2f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1c0d2160 0x7fde1c1f2f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.567+0000 7fde1bfff640 1 -- 172.21.15.81:0/4176529568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde1c0ca930 con 0x7fde1c0b1360 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.568+0000 7fde20990640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1c15bdc0 0x7fde1c1ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.568+0000 7fde1bfff640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0ca3f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00b440 tx=0x7fde0c00b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.568+0000 7fde197fa640 1 -- 172.21.15.81:0/4176529568 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c015020 con 0x7fde1c0b1360 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.568+0000 7fde197fa640 1 -- 172.21.15.81:0/4176529568 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fde0c011980 con 0x7fde1c0b1360 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.568+0000 7fde197fa640 1 -- 172.21.15.81:0/4176529568 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde0c011dd0 con 0x7fde1c0b1360 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.568+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde1c1f3470 con 0x7fde1c0b1360 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.568+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde1c0b59a0 con 0x7fde1c0b1360 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.569+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde1c0b2170 con 0x7fde1c0b1360 2024-09-17T05:23:48.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.569+0000 7fde197fa640 1 -- 172.21.15.81:0/4176529568 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7fde0c018020 con 0x7fde1c0b1360 2024-09-17T05:23:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.570+0000 7fde197fa640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fddfc078ef0 0x7fddfc07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:48.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.570+0000 7fde197fa640 1 -- 172.21.15.81:0/4176529568 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fde0c09b540 con 0x7fde1c0b1360 2024-09-17T05:23:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.570+0000 7fde13fff640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fddfc078ef0 0x7fddfc07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.570+0000 7fde13fff640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fddfc078ef0 0x7fddfc07b3b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde04033000 tx=0x7fde04004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:48.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.574+0000 7fde197fa640 1 -- 172.21.15.81:0/4176529568 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fde0c01f020 con 0x7fde1c0b1360 2024-09-17T05:23:48.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:48.782+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone52881", "target": ["mon-mgr", ""]}) -- 0x7fde1c0ce660 con 0x7fddfc078ef0 2024-09-17T05:23:49.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.035+0000 7fde197fa640 1 -- 172.21.15.81:0/4176529568 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+153 (secure 0 0 0) 0x7fde1c0ce660 con 0x7fddfc078ef0 2024-09-17T05:23:49.036 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2024-09-17T05:23:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "pending", 2024-09-17T05:23:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "source": { 2024-09-17T05:23:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "volume": "cephfs", 2024-09-17T05:23:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "subvolume": "subvol21940", 2024-09-17T05:23:49.036 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot": "fake" 2024-09-17T05:23:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:49.037 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:49.037 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:49.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fddfc078ef0 msgr2=0x7fddfc07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:49.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fddfc078ef0 0x7fddfc07b3b0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fde04033000 tx=0x7fde04004730 comp rx=0 tx=0).stop 2024-09-17T05:23:49.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 msgr2=0x7fde1c0ca3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:49.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0ca3f0 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7fde0c00b440 tx=0x7fde0c00b900 comp rx=0 tx=0).stop 2024-09-17T05:23:49.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 shutdown_connections 2024-09-17T05:23:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fde1c15bdc0 0x7fde1c1ef8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fddfc078ef0 0x7fddfc07b3b0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fde1c0d2160 0x7fde1c1f2f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 --2- 172.21.15.81:0/4176529568 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fde1c0b1360 0x7fde1c0ca3f0 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 >> 172.21.15.81:0/4176529568 conn(0x7fde1c09aa30 msgr2=0x7fde1c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 shutdown_connections 2024-09-17T05:23:49.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:49.037+0000 7fde223f3640 1 -- 172.21.15.81:0/4176529568 wait complete. 2024-09-17T05:23:49.049 DEBUG:tasks.cephfs.test_volumes:current clone state = pending 2024-09-17T05:23:50.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol_clone52881 2024-09-17T05:23:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 -- 172.21.15.81:0/2031850675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3070072f20 msgr2=0x7f3070152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 --2- 172.21.15.81:0/2031850675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3070072f20 0x7f3070152af0 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f30700cf1f0 tx=0x7f306402a560 comp rx=0 tx=0).stop 2024-09-17T05:23:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 -- 172.21.15.81:0/2031850675 shutdown_connections 2024-09-17T05:23:50.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 --2- 172.21.15.81:0/2031850675 >> v2:172.21.15.160:3300/0 conn(0x7f30700cc500 0x7f30700cc930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 --2- 172.21.15.81:0/2031850675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3070072f20 0x7f3070152af0 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 -- 172.21.15.81:0/2031850675 >> 172.21.15.81:0/2031850675 conn(0x7f30700b1700 msgr2=0x7f30700b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 -- 172.21.15.81:0/2031850675 shutdown_connections 2024-09-17T05:23:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.164+0000 7f3076117640 1 -- 172.21.15.81:0/2031850675 wait complete. 2024-09-17T05:23:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.165+0000 7f3076117640 1 Processor -- start 2024-09-17T05:23:50.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.165+0000 7f3076117640 1 -- start start 2024-09-17T05:23:50.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f3076117640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3070072f20 0x7f3070151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:50.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f3076117640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30700cc500 0x7f3070155360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:50.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f3076117640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3070152710 0x7f30701558a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:50.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f3076117640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f307006fd70 con 0x7f30700cc500 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f3076117640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f307006fbf0 con 0x7f3070072f20 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f3076117640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f307006fef0 con 0x7f3070152710 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30700cc500 0x7f3070155360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30700cc500 0x7f3070155360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:42742/0 (socket says 172.21.15.81:42742) 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 -- 172.21.15.81:0/1993405748 learned_addr learned my addr 172.21.15.81:0/1993405748 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306f7fe640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3070072f20 0x7f3070151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306ffff640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3070152710 0x7f30701558a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 -- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3070152710 msgr2=0x7f30701558a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3070152710 0x7f30701558a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 -- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3070072f20 msgr2=0x7f3070151f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:50.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3070072f20 0x7f3070151f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.166+0000 7f306effd640 1 -- 172.21.15.81:0/1993405748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30701524a0 con 0x7f30700cc500 2024-09-17T05:23:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.167+0000 7f306effd640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30700cc500 0x7f3070155360 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3064000c00 tx=0x7f30640039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.167+0000 7f3057fff640 1 -- 172.21.15.81:0/1993405748 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f306403e030 con 0x7f30700cc500 2024-09-17T05:23:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.167+0000 7f3057fff640 1 -- 172.21.15.81:0/1993405748 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f30640047a0 con 0x7f30700cc500 2024-09-17T05:23:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.167+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30701f5dc0 con 0x7f30700cc500 2024-09-17T05:23:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.167+0000 7f3057fff640 1 -- 172.21.15.81:0/1993405748 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3064035040 con 0x7f30700cc500 2024-09-17T05:23:50.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.167+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30701f6380 con 0x7f30700cc500 2024-09-17T05:23:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.168+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3070152af0 con 0x7f30700cc500 2024-09-17T05:23:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.168+0000 7f3057fff640 1 -- 172.21.15.81:0/1993405748 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7f3064041030 con 0x7f30700cc500 2024-09-17T05:23:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.169+0000 7f3057fff640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f305c078ef0 0x7f305c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.169+0000 7f3057fff640 1 -- 172.21.15.81:0/1993405748 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f30640bba70 con 0x7f30700cc500 2024-09-17T05:23:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.169+0000 7f306f7fe640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f305c078ef0 0x7f305c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:50.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.169+0000 7f306f7fe640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f305c078ef0 0x7f305c07b3b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3070159ea0 tx=0x7f3060009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:50.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.173+0000 7f3057fff640 1 -- 172.21.15.81:0/1993405748 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3064083a70 con 0x7f30700cc500 2024-09-17T05:23:50.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:50.385+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol_clone52881", "target": ["mon-mgr", ""]}) -- 0x7f3070074240 con 0x7f305c078ef0 2024-09-17T05:23:54.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.026+0000 7f3057fff640 1 -- 172.21.15.81:0/1993405748 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+46 (secure 0 0 0) 0x7f3070074240 con 0x7f305c078ef0 2024-09-17T05:23:54.027 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2024-09-17T05:23:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "complete" 2024-09-17T05:23:54.027 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:54.027 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f305c078ef0 msgr2=0x7f305c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f305c078ef0 0x7f305c07b3b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3070159ea0 tx=0x7f3060009040 comp rx=0 tx=0).stop 2024-09-17T05:23:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30700cc500 msgr2=0x7f3070155360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30700cc500 0x7f3070155360 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f3064000c00 tx=0x7f30640039e0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 shutdown_connections 2024-09-17T05:23:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3070152710 0x7f30701558a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30700cc500 0x7f3070155360 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f305c078ef0 0x7f305c07b3b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 --2- 172.21.15.81:0/1993405748 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3070072f20 0x7f3070151f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 >> 172.21.15.81:0/1993405748 conn(0x7f30700b1700 msgr2=0x7f30700b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 shutdown_connections 2024-09-17T05:23:54.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.029+0000 7f3076117640 1 -- 172.21.15.81:0/1993405748 wait complete. 2024-09-17T05:23:54.043 DEBUG:tasks.cephfs.test_volumes:current clone state = complete 2024-09-17T05:23:54.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:54.044 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol_clone52881/.meta) 2024-09-17T05:23:54.074 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:23:54.074 INFO:teuthology.orchestra.run.smithi081.stdout:version = 2 2024-09-17T05:23:54.074 INFO:teuthology.orchestra.run.smithi081.stdout:type = clone 2024-09-17T05:23:54.074 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol_clone52881/c64f3864-791b-4b02-94d7-022820404ce5 2024-09-17T05:23:54.074 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:23:54.074 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:54.076 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info cephfs subvol21940 subvol_snap72950 2024-09-17T05:23:54.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.225+0000 7f0957e40640 1 -- 172.21.15.81:0/754418981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 msgr2=0x7f09500d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.225+0000 7f0957e40640 1 --2- 172.21.15.81:0/754418981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f09500d4940 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f0948009830 tx=0x7f094802a5a0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.225+0000 7f0957e40640 1 -- 172.21.15.81:0/754418981 shutdown_connections 2024-09-17T05:23:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.225+0000 7f0957e40640 1 --2- 172.21.15.81:0/754418981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f09500d4940 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.225+0000 7f0957e40640 1 -- 172.21.15.81:0/754418981 >> 172.21.15.81:0/754418981 conn(0x7f09500d3e20 msgr2=0x7f09500d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.225+0000 7f0957e40640 1 -- 172.21.15.81:0/754418981 shutdown_connections 2024-09-17T05:23:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.225+0000 7f0957e40640 1 -- 172.21.15.81:0/754418981 wait complete. 2024-09-17T05:23:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.226+0000 7f0957e40640 1 Processor -- start 2024-09-17T05:23:54.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f0957e40640 1 -- start start 2024-09-17T05:23:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f0957e40640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09500d25b0 0x7f0950157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f0957e40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f095015c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f0957e40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09501616e0 0x7f095015d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f0957e40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f09500b7ec0 con 0x7f0950161300 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f0957e40640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f09500b7d40 con 0x7f09500d25b0 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f0957e40640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f09500b8040 con 0x7f09501616e0 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f09553db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f095015c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f09553db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f095015c8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48216/0 (socket says 172.21.15.81:48216) 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.227+0000 7f09553db640 1 -- 172.21.15.81:0/1401234003 learned_addr learned my addr 172.21.15.81:0/1401234003 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f0955bdc640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09500d25b0 0x7f0950157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09563dd640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09501616e0 0x7f095015d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09553db640 1 -- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09501616e0 msgr2=0x7f095015d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09553db640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09501616e0 0x7f095015d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09553db640 1 -- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09500d25b0 msgr2=0x7f0950157150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09553db640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09500d25b0 0x7f0950157150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09553db640 1 -- 172.21.15.81:0/1401234003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f095015b830 con 0x7f0950161300 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09563dd640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09501616e0 0x7f095015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f09553db640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f095015c8d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f094400c3a0 tx=0x7f094400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f094e7fc640 1 -- 172.21.15.81:0/1401234003 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944011790 con 0x7f0950161300 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f094e7fc640 1 -- 172.21.15.81:0/1401234003 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0944017070 con 0x7f0950161300 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f094e7fc640 1 -- 172.21.15.81:0/1401234003 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944011cc0 con 0x7f0950161300 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f095015bb10 con 0x7f0950161300 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.228+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f095015c0d0 con 0x7f0950161300 2024-09-17T05:23:54.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.229+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09500b84f0 con 0x7f0950161300 2024-09-17T05:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.230+0000 7f094e7fc640 1 -- 172.21.15.81:0/1401234003 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7f094401c460 con 0x7f0950161300 2024-09-17T05:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.230+0000 7f094e7fc640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f093c078ef0 0x7f093c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.230+0000 7f0955bdc640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f093c078ef0 0x7f093c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.230+0000 7f094e7fc640 1 -- 172.21.15.81:0/1401234003 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f094409b080 con 0x7f0950161300 2024-09-17T05:23:54.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.231+0000 7f0955bdc640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f093c078ef0 0x7f093c07b3b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0948034000 tx=0x7f0948004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:54.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.234+0000 7f094e7fc640 1 -- 172.21.15.81:0/1401234003 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0944062ff0 con 0x7f0950161300 2024-09-17T05:23:54.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.440+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "cephfs", "sub_name": "subvol21940", "snap_name": "subvol_snap72950", "target": ["mon-mgr", ""]}) -- 0x7f095006e6d0 con 0x7f093c078ef0 2024-09-17T05:23:54.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.458+0000 7f094e7fc640 1 -- 172.21.15.81:0/1401234003 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+115 (secure 0 0 0) 0x7f095006e6d0 con 0x7f093c078ef0 2024-09-17T05:23:54.459 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:23:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "created_at": "2024-09-17 05:23:40.928609", 2024-09-17T05:23:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "data_pool": "cephfs_data", 2024-09-17T05:23:54.459 INFO:teuthology.orchestra.run.smithi081.stdout: "has_pending_clones": "no" 2024-09-17T05:23:54.459 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:23:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f093c078ef0 msgr2=0x7f093c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f093c078ef0 0x7f093c07b3b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0948034000 tx=0x7f0948004730 comp rx=0 tx=0).stop 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 msgr2=0x7f095015c8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f095015c8d0 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f094400c3a0 tx=0x7f094400c860 comp rx=0 tx=0).stop 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 shutdown_connections 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f09501616e0 0x7f095015d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0950161300 0x7f095015c8d0 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f093c078ef0 0x7f093c07b3b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 --2- 172.21.15.81:0/1401234003 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f09500d25b0 0x7f0950157150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 >> 172.21.15.81:0/1401234003 conn(0x7f09500d3e20 msgr2=0x7f0950075820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 shutdown_connections 2024-09-17T05:23:54.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.460+0000 7f0957e40640 1 -- 172.21.15.81:0/1401234003 wait complete. 2024-09-17T05:23:54.472 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls cephfs subvol21940 2024-09-17T05:23:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 -- 172.21.15.81:0/2257863168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b006e940 msgr2=0x7f64b006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2257863168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b006e940 0x7f64b006fe80 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f64b0074dd0 tx=0x7f64a402a560 comp rx=0 tx=0).stop 2024-09-17T05:23:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 -- 172.21.15.81:0/2257863168 shutdown_connections 2024-09-17T05:23:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2257863168 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64b00703c0 0x7f64b0157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2257863168 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b006e940 0x7f64b006fe80 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2257863168 >> v2:172.21.15.160:3300/0 conn(0x7f64b00aee40 0x7f64b015b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 -- 172.21.15.81:0/2257863168 >> 172.21.15.81:0/2257863168 conn(0x7f64b00b1620 msgr2=0x7f64b00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 -- 172.21.15.81:0/2257863168 shutdown_connections 2024-09-17T05:23:54.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.575+0000 7f64b69ad640 1 -- 172.21.15.81:0/2257863168 wait complete. 2024-09-17T05:23:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.576+0000 7f64b69ad640 1 Processor -- start 2024-09-17T05:23:54.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b69ad640 1 -- start start 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b69ad640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64b006e940 0x7f64b0159700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b69ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b00703c0 0x7f64b014cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b69ad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b00aee40 0x7f64b0154650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b69ad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f64b01585c0 con 0x7f64b00703c0 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b69ad640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f64b0158440 con 0x7f64b00aee40 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b69ad640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f64b0158740 con 0x7f64b006e940 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b00703c0 0x7f64b014cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64af7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b00703c0 0x7f64b014cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48232/0 (socket says 172.21.15.81:48232) 2024-09-17T05:23:54.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64af7fe640 1 -- 172.21.15.81:0/2710387366 learned_addr learned my addr 172.21.15.81:0/2710387366 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64b4f4a640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b00aee40 0x7f64b0154650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.577+0000 7f64affff640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64b006e940 0x7f64b0159700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64af7fe640 1 -- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64b006e940 msgr2=0x7f64b0159700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64af7fe640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64b006e940 0x7f64b0159700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64af7fe640 1 -- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b00aee40 msgr2=0x7f64b0154650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64af7fe640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b00aee40 0x7f64b0154650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64af7fe640 1 -- 172.21.15.81:0/2710387366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64b014d730 con 0x7f64b00703c0 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64af7fe640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b00703c0 0x7f64b014cc40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000c00 tx=0x7f64a4003820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64acff9640 1 -- 172.21.15.81:0/2710387366 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a403f070 con 0x7f64b00703c0 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64acff9640 1 -- 172.21.15.81:0/2710387366 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f64a40047a0 con 0x7f64b00703c0 2024-09-17T05:23:54.581 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64b01551c0 con 0x7f64b00703c0 2024-09-17T05:23:54.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64acff9640 1 -- 172.21.15.81:0/2710387366 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64a4035030 con 0x7f64b00703c0 2024-09-17T05:23:54.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.578+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64b0158f00 con 0x7f64b00703c0 2024-09-17T05:23:54.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.579+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64b0157cf0 con 0x7f64b00703c0 2024-09-17T05:23:54.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.580+0000 7f64acff9640 1 -- 172.21.15.81:0/2710387366 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7f64a4042070 con 0x7f64b00703c0 2024-09-17T05:23:54.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.580+0000 7f64acff9640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f649c078ef0 0x7f649c07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.580+0000 7f64acff9640 1 -- 172.21.15.81:0/2710387366 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f64a40bc060 con 0x7f64b00703c0 2024-09-17T05:23:54.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.580+0000 7f64affff640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f649c078ef0 0x7f649c07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.581+0000 7f64affff640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f649c078ef0 0x7f649c07b3b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009ab0 tx=0x7f64a0005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:54.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.584+0000 7f64acff9640 1 -- 172.21.15.81:0/2710387366 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f64a4083980 con 0x7f64b00703c0 2024-09-17T05:23:54.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.790+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "cephfs", "sub_name": "subvol21940", "target": ["mon-mgr", ""]}) -- 0x7f64b00cf7a0 con 0x7f649c078ef0 2024-09-17T05:23:54.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.803+0000 7f64acff9640 1 -- 172.21.15.81:0/2710387366 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+87 (secure 0 0 0) 0x7f64b00cf7a0 con 0x7f649c078ef0 2024-09-17T05:23:54.804 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:23:54.804 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:54.804 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "fake" 2024-09-17T05:23:54.804 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:23:54.805 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:23:54.805 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "subvol_snap72950" 2024-09-17T05:23:54.805 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:23:54.805 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:23:54.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f649c078ef0 msgr2=0x7f649c07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f649c078ef0 0x7f649c07b3b0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f64a0009ab0 tx=0x7f64a0005f90 comp rx=0 tx=0).stop 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b00703c0 msgr2=0x7f64b014cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b00703c0 0x7f64b014cc40 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f64a4000c00 tx=0x7f64a4003820 comp rx=0 tx=0).stop 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 shutdown_connections 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f649c078ef0 0x7f649c07b3b0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f64b00aee40 0x7f64b0154650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f64b00703c0 0x7f64b014cc40 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 --2- 172.21.15.81:0/2710387366 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f64b006e940 0x7f64b0159700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 >> 172.21.15.81:0/2710387366 conn(0x7f64b00b1620 msgr2=0x7f64b015d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:54.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 shutdown_connections 2024-09-17T05:23:54.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.805+0000 7f64b69ad640 1 -- 172.21.15.81:0/2710387366 wait complete. 2024-09-17T05:23:54.818 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol21940 subvol_snap72950 2024-09-17T05:23:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 -- 172.21.15.81:0/244491205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408070590 msgr2=0x7fd40815ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/244491205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408070590 0x7fd40815ba50 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fd4080af560 tx=0x7fd3f802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 -- 172.21.15.81:0/244491205 shutdown_connections 2024-09-17T05:23:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/244491205 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd408073190 0x7fd4081595d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/244491205 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408070590 0x7fd40815ba50 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 -- 172.21.15.81:0/244491205 >> 172.21.15.81:0/244491205 conn(0x7fd4080b1620 msgr2=0x7fd4080b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 -- 172.21.15.81:0/244491205 shutdown_connections 2024-09-17T05:23:54.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.923+0000 7fd40fd2b640 1 -- 172.21.15.81:0/244491205 wait complete. 2024-09-17T05:23:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.924+0000 7fd40fd2b640 1 Processor -- start 2024-09-17T05:23:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.924+0000 7fd40fd2b640 1 -- start start 2024-09-17T05:23:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40fd2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd408070590 0x7fd408151c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40fd2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408073190 0x7fd40814f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40fd2b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40814f8f0 0x7fd4080b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40fd2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd40815a140 con 0x7fd408073190 2024-09-17T05:23:54.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40fd2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd408159fc0 con 0x7fd408070590 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40fd2b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd40815a2c0 con 0x7fd40814f8f0 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408073190 0x7fd40814f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408073190 0x7fd40814f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48262/0 (socket says 172.21.15.81:48262) 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 -- 172.21.15.81:0/417137935 learned_addr learned my addr 172.21.15.81:0/417137935 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 -- 172.21.15.81:0/417137935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40814f8f0 msgr2=0x7fd4080b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40814f8f0 0x7fd4080b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40dac7640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd408070590 0x7fd408151c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 -- 172.21.15.81:0/417137935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd408070590 msgr2=0x7fd408151c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd408070590 0x7fd408151c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 -- 172.21.15.81:0/417137935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd408150f50 con 0x7fd408073190 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.925+0000 7fd40d2c6640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408073190 0x7fd40814f3b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009850 tx=0x7fd3f80039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:54.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.926+0000 7fd3fe7fc640 1 -- 172.21.15.81:0/417137935 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f803f070 con 0x7fd408073190 2024-09-17T05:23:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.926+0000 7fd3fe7fc640 1 -- 172.21.15.81:0/417137935 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd3f8004890 con 0x7fd408073190 2024-09-17T05:23:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.926+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4081511d0 con 0x7fd408073190 2024-09-17T05:23:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.926+0000 7fd3fe7fc640 1 -- 172.21.15.81:0/417137935 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3f8035030 con 0x7fd408073190 2024-09-17T05:23:54.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.926+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd408151770 con 0x7fd408073190 2024-09-17T05:23:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.927+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd40815a7f0 con 0x7fd408073190 2024-09-17T05:23:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.927+0000 7fd3fe7fc640 1 -- 172.21.15.81:0/417137935 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7fd3f8042070 con 0x7fd408073190 2024-09-17T05:23:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.928+0000 7fd3fe7fc640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd3ec078ef0 0x7fd3ec07b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.928+0000 7fd3fe7fc640 1 -- 172.21.15.81:0/417137935 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7fd3f80bc2e0 con 0x7fd408073190 2024-09-17T05:23:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.928+0000 7fd40dac7640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd3ec078ef0 0x7fd3ec07b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:54.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.928+0000 7fd40dac7640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd3ec078ef0 0x7fd3ec07b3b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd40400a730 tx=0x7fd404008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:54.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:54.932+0000 7fd3fe7fc640 1 -- 172.21.15.81:0/417137935 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd408150f50 con 0x7fd408073190 2024-09-17T05:23:55.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.144+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol21940", "snap_name": "subvol_snap72950", "target": ["mon-mgr", ""]}) -- 0x7fd4080cc390 con 0x7fd3ec078ef0 2024-09-17T05:23:55.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.174+0000 7fd3fe7fc640 1 -- 172.21.15.81:0/417137935 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fd4080cc390 con 0x7fd3ec078ef0 2024-09-17T05:23:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.176+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd3ec078ef0 msgr2=0x7fd3ec07b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd3ec078ef0 0x7fd3ec07b3b0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fd40400a730 tx=0x7fd404008040 comp rx=0 tx=0).stop 2024-09-17T05:23:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408073190 msgr2=0x7fd40814f3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408073190 0x7fd40814f3b0 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7fd3f8009850 tx=0x7fd3f80039e0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 shutdown_connections 2024-09-17T05:23:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd40814f8f0 0x7fd4080b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd408073190 0x7fd40814f3b0 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd3ec078ef0 0x7fd3ec07b3b0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 --2- 172.21.15.81:0/417137935 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd408070590 0x7fd408151c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 >> 172.21.15.81:0/417137935 conn(0x7fd4080b1620 msgr2=0x7fd40815cf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 shutdown_connections 2024-09-17T05:23:55.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.177+0000 7fd40fd2b640 1 -- 172.21.15.81:0/417137935 wait complete. 2024-09-17T05:23:55.188 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol21940 fake 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.292+0000 7f253aebd640 1 -- 172.21.15.81:0/333917479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340aeba0 msgr2=0x7f2534072a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.292+0000 7f253aebd640 1 --2- 172.21.15.81:0/333917479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340aeba0 0x7f2534072a70 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f252c005fd0 tx=0x7f252c02a9c0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.292+0000 7f253aebd640 1 -- 172.21.15.81:0/333917479 shutdown_connections 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.292+0000 7f253aebd640 1 --2- 172.21.15.81:0/333917479 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25340aeba0 0x7f2534072a70 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.292+0000 7f253aebd640 1 --2- 172.21.15.81:0/333917479 >> v2:172.21.15.160:3300/0 conn(0x7f25340af0f0 0x7f2534072530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.292+0000 7f253aebd640 1 --2- 172.21.15.81:0/333917479 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f253415ef20 0x7f25340cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.292+0000 7f253aebd640 1 -- 172.21.15.81:0/333917479 >> 172.21.15.81:0/333917479 conn(0x7f25340b1620 msgr2=0x7f25340b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.293+0000 7f253aebd640 1 -- 172.21.15.81:0/333917479 shutdown_connections 2024-09-17T05:23:55.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.293+0000 7f253aebd640 1 -- 172.21.15.81:0/333917479 wait complete. 2024-09-17T05:23:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.294+0000 7f253aebd640 1 Processor -- start 2024-09-17T05:23:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.294+0000 7f253aebd640 1 -- start start 2024-09-17T05:23:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.294+0000 7f253aebd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25340aeba0 0x7f253413fff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:55.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253aebd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25340af0f0 0x7f25341f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253aebd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253415ef20 0x7f2534072c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253aebd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f253415f830 con 0x7f253415ef20 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253aebd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f253415f6b0 con 0x7f25340af0f0 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253aebd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f253415f9b0 con 0x7f25340aeba0 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253415ef20 0x7f2534072c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253415ef20 0x7f2534072c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48288/0 (socket says 172.21.15.81:48288) 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 -- 172.21.15.81:0/1086412725 learned_addr learned my addr 172.21.15.81:0/1086412725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f2533fff640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25340af0f0 0x7f25341f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 -- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25340aeba0 msgr2=0x7f253413fff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f2538c59640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25340aeba0 0x7f253413fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:55.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25340aeba0 0x7f253413fff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 -- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25340af0f0 msgr2=0x7f25341f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25340af0f0 0x7f25341f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 -- 172.21.15.81:0/1086412725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25341427a0 con 0x7f253415ef20 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f2533fff640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25340af0f0 0x7f25341f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253945a640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253415ef20 0x7f2534072c20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f252c006010 tx=0x7f252c003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f25317fa640 1 -- 172.21.15.81:0/1086412725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c047070 con 0x7f253415ef20 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f25317fa640 1 -- 172.21.15.81:0/1086412725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f252c0045c0 con 0x7f253415ef20 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2534142a60 con 0x7f253415ef20 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f25317fa640 1 -- 172.21.15.81:0/1086412725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f252c034070 con 0x7f253415ef20 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.295+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2534143020 con 0x7f253415ef20 2024-09-17T05:23:55.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.296+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25340d0800 con 0x7f253415ef20 2024-09-17T05:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.297+0000 7f25317fa640 1 -- 172.21.15.81:0/1086412725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7f252c04a070 con 0x7f253415ef20 2024-09-17T05:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.297+0000 7f25317fa640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2518078ef0 0x7f251807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.298+0000 7f2538c59640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2518078ef0 0x7f251807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.298+0000 7f25317fa640 1 -- 172.21.15.81:0/1086412725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 5767+0+0 (secure 0 0 0) 0x7f252c0bc670 con 0x7f253415ef20 2024-09-17T05:23:55.300 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.298+0000 7f2538c59640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2518078ef0 0x7f251807b3b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25341f09d0 tx=0x7f2528008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:55.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.302+0000 7f25317fa640 1 -- 172.21.15.81:0/1086412725 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f25340d0800 con 0x7f253415ef20 2024-09-17T05:23:55.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.509+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol21940", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f253415ffa0 con 0x7f2518078ef0 2024-09-17T05:23:55.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.538+0000 7f25317fa640 1 -- 172.21.15.81:0/1086412725 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f253415ffa0 con 0x7f2518078ef0 2024-09-17T05:23:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2518078ef0 msgr2=0x7f251807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2518078ef0 0x7f251807b3b0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25341f09d0 tx=0x7f2528008040 comp rx=0 tx=0).stop 2024-09-17T05:23:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253415ef20 msgr2=0x7f2534072c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253415ef20 0x7f2534072c20 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f252c006010 tx=0x7f252c003ef0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 shutdown_connections 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f253415ef20 0x7f2534072c20 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2518078ef0 0x7f251807b3b0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25340af0f0 0x7f25341f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 --2- 172.21.15.81:0/1086412725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25340aeba0 0x7f253413fff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 >> 172.21.15.81:0/1086412725 conn(0x7f25340b1620 msgr2=0x7f25340d00f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 shutdown_connections 2024-09-17T05:23:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:55.540+0000 7f253aebd640 1 -- 172.21.15.81:0/1086412725 wait complete. 2024-09-17T05:23:55.551 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:23:55.552 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol21940/.meta) 2024-09-17T05:23:59.023 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:23:59.023 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:23:59.024 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:23:59.024 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol21940/b776f0b8-3a33-4d03-9d99-1ea32a3017e4 2024-09-17T05:23:59.024 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:23:59.024 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:23:59.025 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol21940 2024-09-17T05:23:59.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 -- 172.21.15.81:0/1062519373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d01b0 msgr2=0x7ff8200d2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 --2- 172.21.15.81:0/1062519373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d01b0 0x7ff8200d2270 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7ff808005fd0 tx=0x7ff80802a540 comp rx=0 tx=0).stop 2024-09-17T05:23:59.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 -- 172.21.15.81:0/1062519373 shutdown_connections 2024-09-17T05:23:59.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 --2- 172.21.15.81:0/1062519373 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d01b0 0x7ff8200d2270 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 --2- 172.21.15.81:0/1062519373 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8201617f0 0x7ff8200d1d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 -- 172.21.15.81:0/1062519373 >> 172.21.15.81:0/1062519373 conn(0x7ff8200d3e30 msgr2=0x7ff8200d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:59.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 -- 172.21.15.81:0/1062519373 shutdown_connections 2024-09-17T05:23:59.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.143+0000 7ff82622a640 1 -- 172.21.15.81:0/1062519373 wait complete. 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.144+0000 7ff82622a640 1 Processor -- start 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.144+0000 7ff82622a640 1 -- start start 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff82622a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8200d01b0 0x7ff8200caf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff82622a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d27b0 0x7ff8200ccfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff82622a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8201617f0 0x7ff820159d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff82622a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8200d0f50 con 0x7ff8200d27b0 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff82622a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff8200b5000 con 0x7ff8200d01b0 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff82622a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff8200d10d0 con 0x7ff8201617f0 2024-09-17T05:23:59.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d27b0 0x7ff8200ccfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d27b0 0x7ff8200ccfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48312/0 (socket says 172.21.15.81:48312) 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 -- 172.21.15.81:0/3426643410 learned_addr learned my addr 172.21.15.81:0/3426643410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff81f7fe640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8200d01b0 0x7ff8200caf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff81ffff640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8201617f0 0x7ff820159d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 -- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8201617f0 msgr2=0x7ff820159d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8201617f0 0x7ff820159d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 -- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8200d01b0 msgr2=0x7ff8200caf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8200d01b0 0x7ff8200caf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 -- 172.21.15.81:0/3426643410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8201f4fc0 con 0x7ff8200d27b0 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff817fff640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d27b0 0x7ff8200ccfd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ff808000c00 tx=0x7ff808004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff81cff9640 1 -- 172.21.15.81:0/3426643410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff80803f070 con 0x7ff8200d27b0 2024-09-17T05:23:59.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.145+0000 7ff81cff9640 1 -- 172.21.15.81:0/3426643410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff8080038e0 con 0x7ff8200d27b0 2024-09-17T05:23:59.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.146+0000 7ff81cff9640 1 -- 172.21.15.81:0/3426643410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff808035030 con 0x7ff8200d27b0 2024-09-17T05:23:59.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.146+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8201f52a0 con 0x7ff8200d27b0 2024-09-17T05:23:59.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.146+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8201f5860 con 0x7ff8200d27b0 2024-09-17T05:23:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.147+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8200d15f0 con 0x7ff8200d27b0 2024-09-17T05:23:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.147+0000 7ff81cff9640 1 -- 172.21.15.81:0/3426643410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7ff808042070 con 0x7ff8200d27b0 2024-09-17T05:23:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.148+0000 7ff81cff9640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff804078ef0 0x7ff80407b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.148+0000 7ff81cff9640 1 -- 172.21.15.81:0/3426643410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7ff8080bc0b0 con 0x7ff8200d27b0 2024-09-17T05:23:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.148+0000 7ff81f7fe640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff804078ef0 0x7ff80407b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.148+0000 7ff81f7fe640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff804078ef0 0x7ff80407b3b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8200cae50 tx=0x7ff81000b2e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:59.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.152+0000 7ff81cff9640 1 -- 172.21.15.81:0/3426643410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff808083a30 con 0x7ff8200d27b0 2024-09-17T05:23:59.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.361+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol21940", "target": ["mon-mgr", ""]}) -- 0x7ff8200b5700 con 0x7ff804078ef0 2024-09-17T05:23:59.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.397+0000 7ff81cff9640 1 -- 172.21.15.81:0/3426643410 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff8200b5700 con 0x7ff804078ef0 2024-09-17T05:23:59.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff804078ef0 msgr2=0x7ff80407b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff804078ef0 0x7ff80407b3b0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7ff8200cae50 tx=0x7ff81000b2e0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d27b0 msgr2=0x7ff8200ccfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d27b0 0x7ff8200ccfd0 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7ff808000c00 tx=0x7ff808004c80 comp rx=0 tx=0).stop 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 shutdown_connections 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8201617f0 0x7ff820159d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8200d27b0 0x7ff8200ccfd0 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff804078ef0 0x7ff80407b3b0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 --2- 172.21.15.81:0/3426643410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8200d01b0 0x7ff8200caf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 >> 172.21.15.81:0/3426643410 conn(0x7ff8200d3e30 msgr2=0x7ff8200b5920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 shutdown_connections 2024-09-17T05:23:59.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.399+0000 7ff82622a640 1 -- 172.21.15.81:0/3426643410 wait complete. 2024-09-17T05:23:59.402 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.401+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.402 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.401+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.402 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.401+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.402 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.401+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.402 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.401+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.412 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone63710 2024-09-17T05:23:59.414 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.413+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.415 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.413+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.415 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.413+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.415 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.413+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.415 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:23:59.413+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:23:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.518+0000 7fc29d023640 1 -- 172.21.15.81:0/86945209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc280003a00 msgr2=0x7fc280003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.518+0000 7fc29d023640 1 --2- 172.21.15.81:0/86945209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc280003a00 0x7fc280003e20 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc28800c260 tx=0x7fc280005830 comp rx=0 tx=0).stop 2024-09-17T05:23:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.518+0000 7fc29759e640 1 -- 172.21.15.81:0/86945209 reap_dead start 2024-09-17T05:23:59.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.518+0000 7fc29d023640 1 -- 172.21.15.81:0/86945209 shutdown_connections 2024-09-17T05:23:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.518+0000 7fc29d023640 1 -- 172.21.15.81:0/86945209 >> 172.21.15.81:0/86945209 conn(0x7fc2980b1700 msgr2=0x7fc2980b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.518+0000 7fc29d023640 1 -- 172.21.15.81:0/86945209 shutdown_connections 2024-09-17T05:23:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.518+0000 7fc29d023640 1 -- 172.21.15.81:0/86945209 wait complete. 2024-09-17T05:23:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.519+0000 7fc29d023640 1 Processor -- start 2024-09-17T05:23:59.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29d023640 1 -- start start 2024-09-17T05:23:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29d023640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc280003a00 0x7fc2981522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29d023640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298150b90 0x7fc2981f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29d023640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2980b2a00 0x7fc2980c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29d023640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2980cac40 con 0x7fc2980b2a00 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29d023640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc29806feb0 con 0x7fc298150b90 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29d023640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc2980cadc0 con 0x7fc280003a00 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2980b2a00 0x7fc2980c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29759e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2980b2a00 0x7fc2980c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48360/0 (socket says 172.21.15.81:48360) 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29759e640 1 -- 172.21.15.81:0/4040990628 learned_addr learned my addr 172.21.15.81:0/4040990628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc296d9d640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc280003a00 0x7fc2981522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.520+0000 7fc29659c640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298150b90 0x7fc2981f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29759e640 1 -- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc280003a00 msgr2=0x7fc2981522b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29759e640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc280003a00 0x7fc2981522b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29759e640 1 -- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298150b90 msgr2=0x7fc2981f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29759e640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298150b90 0x7fc2981f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29759e640 1 -- 172.21.15.81:0/4040990628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2981528d0 con 0x7fc2980b2a00 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29759e640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2980b2a00 0x7fc2980c5830 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc280004780 tx=0x7fc290004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc27f7fe640 1 -- 172.21.15.81:0/4040990628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290004b20 con 0x7fc2980b2a00 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc27f7fe640 1 -- 172.21.15.81:0/4040990628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc290004cc0 con 0x7fc2980b2a00 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc27f7fe640 1 -- 172.21.15.81:0/4040990628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc290010d10 con 0x7fc2980b2a00 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc298152bb0 con 0x7fc2980b2a00 2024-09-17T05:23:59.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.521+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc298153170 con 0x7fc2980b2a00 2024-09-17T05:23:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.522+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc298155600 con 0x7fc2980b2a00 2024-09-17T05:23:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.523+0000 7fc27f7fe640 1 -- 172.21.15.81:0/4040990628 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7fc29001c020 con 0x7fc2980b2a00 2024-09-17T05:23:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.523+0000 7fc27f7fe640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc284078f20 0x7fc28407b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.523+0000 7fc27f7fe640 1 -- 172.21.15.81:0/4040990628 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7fc29009b850 con 0x7fc2980b2a00 2024-09-17T05:23:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.523+0000 7fc296d9d640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc284078f20 0x7fc28407b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.524+0000 7fc296d9d640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc284078f20 0x7fc28407b3e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc288033000 tx=0x7fc288038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:59.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.527+0000 7fc27f7fe640 1 -- 172.21.15.81:0/4040990628 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc298155600 con 0x7fc2980b2a00 2024-09-17T05:23:59.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.730+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone63710", "target": ["mon-mgr", ""]}) -- 0x7fc2980caa20 con 0x7fc284078f20 2024-09-17T05:23:59.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.744+0000 7fc27f7fe640 1 -- 172.21.15.81:0/4040990628 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc2980caa20 con 0x7fc284078f20 2024-09-17T05:23:59.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc284078f20 msgr2=0x7fc28407b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc284078f20 0x7fc28407b3e0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fc288033000 tx=0x7fc288038040 comp rx=0 tx=0).stop 2024-09-17T05:23:59.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2980b2a00 msgr2=0x7fc2980c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2980b2a00 0x7fc2980c5830 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc280004780 tx=0x7fc290004700 comp rx=0 tx=0).stop 2024-09-17T05:23:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 shutdown_connections 2024-09-17T05:23:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc2980b2a00 0x7fc2980c5830 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc284078f20 0x7fc28407b3e0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc298150b90 0x7fc2981f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 --2- 172.21.15.81:0/4040990628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc280003a00 0x7fc2981522b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 >> 172.21.15.81:0/4040990628 conn(0x7fc2980b1700 msgr2=0x7fc2980cb9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:59.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 shutdown_connections 2024-09-17T05:23:59.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.747+0000 7fc29d023640 1 -- 172.21.15.81:0/4040990628 wait complete. 2024-09-17T05:23:59.760 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol_clone52881 2024-09-17T05:23:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 -- 172.21.15.81:0/905825095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815f270 msgr2=0x7ff8a8072cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/905825095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815f270 0x7ff8a8072cc0 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7ff890009830 tx=0x7ff89002a480 comp rx=0 tx=0).stop 2024-09-17T05:23:59.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 -- 172.21.15.81:0/905825095 shutdown_connections 2024-09-17T05:23:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/905825095 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a80cc3f0 0x7ff8a80cc800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/905825095 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815f270 0x7ff8a8072cc0 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 -- 172.21.15.81:0/905825095 >> 172.21.15.81:0/905825095 conn(0x7ff8a80b1700 msgr2=0x7ff8a80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:23:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 -- 172.21.15.81:0/905825095 shutdown_connections 2024-09-17T05:23:59.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.865+0000 7ff8aceb6640 1 -- 172.21.15.81:0/905825095 wait complete. 2024-09-17T05:23:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.866+0000 7ff8aceb6640 1 Processor -- start 2024-09-17T05:23:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.866+0000 7ff8aceb6640 1 -- start start 2024-09-17T05:23:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8aceb6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a80cc3f0 0x7ff8a815dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8aceb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815aa00 0x7ff8a8147c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8aceb6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a815f270 0x7ff8a815ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8aceb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a806f590 con 0x7ff8a815aa00 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8aceb6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff8a806f410 con 0x7ff8a80cc3f0 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8aceb6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff8a806f710 con 0x7ff8a815f270 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815aa00 0x7ff8a8147c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815aa00 0x7ff8a8147c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48378/0 (socket says 172.21.15.81:48378) 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 -- 172.21.15.81:0/3206205153 learned_addr learned my addr 172.21.15.81:0/3206205153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a6d9d640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a815f270 0x7ff8a815ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a659c640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a80cc3f0 0x7ff8a815dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 -- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a815f270 msgr2=0x7ff8a815ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a815f270 0x7ff8a815ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 -- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a80cc3f0 msgr2=0x7ff8a815dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a80cc3f0 0x7ff8a815dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:23:59.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.867+0000 7ff8a5d9b640 1 -- 172.21.15.81:0/3206205153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8a815c1f0 con 0x7ff8a815aa00 2024-09-17T05:23:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.868+0000 7ff8a5d9b640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815aa00 0x7ff8a8147c90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff890000c00 tx=0x7ff890033c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.868+0000 7ff89effd640 1 -- 172.21.15.81:0/3206205153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff890005c90 con 0x7ff8a815aa00 2024-09-17T05:23:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.868+0000 7ff89effd640 1 -- 172.21.15.81:0/3206205153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff890031e50 con 0x7ff8a815aa00 2024-09-17T05:23:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.868+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8a815c4d0 con 0x7ff8a815aa00 2024-09-17T05:23:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.868+0000 7ff89effd640 1 -- 172.21.15.81:0/3206205153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8900332f0 con 0x7ff8a815aa00 2024-09-17T05:23:59.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.868+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8a80c8c50 con 0x7ff8a815aa00 2024-09-17T05:23:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.869+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff8a815c9f0 con 0x7ff8a815aa00 2024-09-17T05:23:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.869+0000 7ff89effd640 1 -- 172.21.15.81:0/3206205153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 19) ==== 101747+0+0 (secure 0 0 0) 0x7ff890033490 con 0x7ff8a815aa00 2024-09-17T05:23:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.870+0000 7ff89effd640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff888078ef0 0x7ff88807b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:23:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.870+0000 7ff89effd640 1 -- 172.21.15.81:0/3206205153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(104..104 src has 1..104) ==== 5823+0+0 (secure 0 0 0) 0x7ff8900bc770 con 0x7ff8a815aa00 2024-09-17T05:23:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.870+0000 7ff8a659c640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff888078ef0 0x7ff88807b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:23:59.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.870+0000 7ff8a659c640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff888078ef0 0x7ff88807b3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff898002150 tx=0x7ff898009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:23:59.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:23:59.874+0000 7ff89effd640 1 -- 172.21.15.81:0/3206205153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff8a815c9f0 con 0x7ff8a815aa00 2024-09-17T05:24:00.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.076+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol_clone52881", "target": ["mon-mgr", ""]}) -- 0x7ff8a80c6be0 con 0x7ff888078ef0 2024-09-17T05:24:00.091 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.090+0000 7ff89effd640 1 -- 172.21.15.81:0/3206205153 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff898001d90 con 0x7ff888078ef0 2024-09-17T05:24:00.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff888078ef0 msgr2=0x7ff88807b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff888078ef0 0x7ff88807b3b0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7ff898002150 tx=0x7ff898009040 comp rx=0 tx=0).stop 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815aa00 msgr2=0x7ff8a8147c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815aa00 0x7ff8a8147c90 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7ff890000c00 tx=0x7ff890033c90 comp rx=0 tx=0).stop 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 shutdown_connections 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff8a815f270 0x7ff8a815ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff8a815aa00 0x7ff8a8147c90 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff888078ef0 0x7ff88807b3b0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 --2- 172.21.15.81:0/3206205153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff8a80cc3f0 0x7ff8a815dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 >> 172.21.15.81:0/3206205153 conn(0x7ff8a80b1700 msgr2=0x7ff8a806fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 shutdown_connections 2024-09-17T05:24:00.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.092+0000 7ff8aceb6640 1 -- 172.21.15.81:0/3206205153 wait complete. 2024-09-17T05:24:00.105 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:24:00.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:24:00.167 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-17T05:24:00.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:00.175 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:24:00.175 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:00.224 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:00.264 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:24:00.264 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:00.264 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:00.264 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:00.280 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:00.280 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:00.339 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:24:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 -- 172.21.15.81:0/3438388669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 msgr2=0x7fbc94072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3438388669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc94072ae0 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c009830 tx=0x7fbc8c02a510 comp rx=0 tx=0).stop 2024-09-17T05:24:00.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 -- 172.21.15.81:0/3438388669 shutdown_connections 2024-09-17T05:24:00.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3438388669 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc94072ae0 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3438388669 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc940cf640 0x7fbc940725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 -- 172.21.15.81:0/3438388669 >> 172.21.15.81:0/3438388669 conn(0x7fbc940b1690 msgr2=0x7fbc940b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:00.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 -- 172.21.15.81:0/3438388669 shutdown_connections 2024-09-17T05:24:00.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.480+0000 7fbc99fda640 1 -- 172.21.15.81:0/3438388669 wait complete. 2024-09-17T05:24:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.481+0000 7fbc99fda640 1 Processor -- start 2024-09-17T05:24:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.481+0000 7fbc99fda640 1 -- start start 2024-09-17T05:24:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc99fda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc941f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc99fda640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc940cf640 0x7fbc941eaec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc99fda640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc94151370 0x7fbc940ced80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc99fda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc94070020 con 0x7fbc940b3140 2024-09-17T05:24:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc99fda640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9406fea0 con 0x7fbc940cf640 2024-09-17T05:24:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc99fda640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbc940701a0 con 0x7fbc94151370 2024-09-17T05:24:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc941f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc941f8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48388/0 (socket says 172.21.15.81:48388) 2024-09-17T05:24:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 -- 172.21.15.81:0/3875521852 learned_addr learned my addr 172.21.15.81:0/3875521852 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:00.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc93fff640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc94151370 0x7fbc940ced80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc92ffd640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc940cf640 0x7fbc941eaec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 -- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc94151370 msgr2=0x7fbc940ced80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc94151370 0x7fbc940ced80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 -- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc940cf640 msgr2=0x7fbc941eaec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc940cf640 0x7fbc941eaec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc937fe640 1 -- 172.21.15.81:0/3875521852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc941eb400 con 0x7fbc940b3140 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.482+0000 7fbc92ffd640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc940cf640 0x7fbc941eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.483+0000 7fbc937fe640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc941f8500 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400c7a0 tx=0x7fbc8400cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:00.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.483+0000 7fbc7bfff640 1 -- 172.21.15.81:0/3875521852 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84017070 con 0x7fbc940b3140 2024-09-17T05:24:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.483+0000 7fbc7bfff640 1 -- 172.21.15.81:0/3875521852 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc84005070 con 0x7fbc940b3140 2024-09-17T05:24:00.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.483+0000 7fbc7bfff640 1 -- 172.21.15.81:0/3875521852 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc840054a0 con 0x7fbc940b3140 2024-09-17T05:24:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.483+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc941f4570 con 0x7fbc940b3140 2024-09-17T05:24:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.483+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc941f4830 con 0x7fbc940b3140 2024-09-17T05:24:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.484+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc940706c0 con 0x7fbc940b3140 2024-09-17T05:24:00.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.484+0000 7fbc7bfff640 1 -- 172.21.15.81:0/3875521852 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fbc8401a070 con 0x7fbc940b3140 2024-09-17T05:24:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.485+0000 7fbc7bfff640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc80079010 0x7fbc8007b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.485+0000 7fbc92ffd640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc80079010 0x7fbc8007b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.485+0000 7fbc7bfff640 1 -- 172.21.15.81:0/3875521852 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5839+0+0 (secure 0 0 0) 0x7fbc8409ace0 con 0x7fbc940b3140 2024-09-17T05:24:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.485+0000 7fbc92ffd640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc80079010 0x7fbc8007b4d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc9414b100 tx=0x7fbc88005ec0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:00.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.489+0000 7fbc7bfff640 1 -- 172.21.15.81:0/3875521852 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbc84062310 con 0x7fbc940b3140 2024-09-17T05:24:00.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.676+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fbc940729b0 con 0x7fbc940b3140 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.677+0000 7fbc7bfff640 1 -- 172.21.15.81:0/3875521852 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v105) ==== 80+0+0 (secure 0 0 0) 0x7fbc84066d40 con 0x7fbc940b3140 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc80079010 msgr2=0x7fbc8007b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc80079010 0x7fbc8007b4d0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fbc9414b100 tx=0x7fbc88005ec0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 msgr2=0x7fbc941f8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc941f8500 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7fbc8400c7a0 tx=0x7fbc8400cc60 comp rx=0 tx=0).stop 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 shutdown_connections 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc94151370 0x7fbc940ced80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc80079010 0x7fbc8007b4d0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc940cf640 0x7fbc941eaec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 --2- 172.21.15.81:0/3875521852 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc940b3140 0x7fbc941f8500 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 >> 172.21.15.81:0/3875521852 conn(0x7fbc940b1690 msgr2=0x7fbc94147280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 shutdown_connections 2024-09-17T05:24:00.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.679+0000 7fbc99fda640 1 -- 172.21.15.81:0/3875521852 wait complete. 2024-09-17T05:24:00.692 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:24:00.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:00.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:00.715 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[64075]: fuse finished with error 0 and tester_r 0 2024-09-17T05:24:00.717 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:24:00.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:00.717 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:24:00.774 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:00.774 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:00.774 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:00.790 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:00.790 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:00.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 -- 172.21.15.81:0/1233390524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f243006ff80 msgr2=0x7f24300703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 --2- 172.21.15.81:0/1233390524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f243006ff80 0x7f24300703f0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f243006ee40 tx=0x7f242802aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 -- 172.21.15.81:0/1233390524 shutdown_connections 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 --2- 172.21.15.81:0/1233390524 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f243006ff80 0x7f24300703f0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 --2- 172.21.15.81:0/1233390524 >> v2:172.21.15.160:3300/0 conn(0x7f24300735a0 0x7f24300739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 -- 172.21.15.81:0/1233390524 >> 172.21.15.81:0/1233390524 conn(0x7f24300b1690 msgr2=0x7f24300b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 -- 172.21.15.81:0/1233390524 shutdown_connections 2024-09-17T05:24:00.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.947+0000 7f2434b94640 1 -- 172.21.15.81:0/1233390524 wait complete. 2024-09-17T05:24:00.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.949+0000 7f2434b94640 1 Processor -- start 2024-09-17T05:24:00.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.949+0000 7f2434b94640 1 -- start start 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.949+0000 7f2434b94640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f243006ff80 0x7f2430149a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.949+0000 7f2434b94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24300735a0 0x7f2430155e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.949+0000 7f2434b94640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f243015aa70 0x7f24301f2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.949+0000 7f2434b94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f24300cd270 con 0x7f24300735a0 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f2434b94640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f24300cd0f0 con 0x7f243006ff80 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f2434b94640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f24300cd3f0 con 0x7f243015aa70 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24300735a0 0x7f2430155e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24300735a0 0x7f2430155e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48408/0 (socket says 172.21.15.81:48408) 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 -- 172.21.15.81:0/3127706166 learned_addr learned my addr 172.21.15.81:0/3127706166 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242e59c640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f243006ff80 0x7f2430149a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242ed9d640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f243015aa70 0x7f24301f2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 -- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f243015aa70 msgr2=0x7f24301f2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f243015aa70 0x7f24301f2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 -- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f243006ff80 msgr2=0x7f2430149a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f243006ff80 0x7f2430149a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 -- 172.21.15.81:0/3127706166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2430151640 con 0x7f24300735a0 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f242dd9b640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24300735a0 0x7f2430155e10 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f241800d980 tx=0x7f241800de40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f2426ffd640 1 -- 172.21.15.81:0/3127706166 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2418017070 con 0x7f24300735a0 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f2426ffd640 1 -- 172.21.15.81:0/3127706166 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2418009d20 con 0x7f24300735a0 2024-09-17T05:24:00.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2430156350 con 0x7f24300735a0 2024-09-17T05:24:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f2426ffd640 1 -- 172.21.15.81:0/3127706166 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f24180106c0 con 0x7f24300735a0 2024-09-17T05:24:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.950+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24301533c0 con 0x7f24300735a0 2024-09-17T05:24:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.951+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24300cd8a0 con 0x7f24300735a0 2024-09-17T05:24:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.952+0000 7f2426ffd640 1 -- 172.21.15.81:0/3127706166 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f2418010860 con 0x7f24300735a0 2024-09-17T05:24:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.952+0000 7f2426ffd640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2410079010 0x7f241007b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.952+0000 7f2426ffd640 1 -- 172.21.15.81:0/3127706166 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5839+0+0 (secure 0 0 0) 0x7f241809ba80 con 0x7f24300735a0 2024-09-17T05:24:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.952+0000 7f242e59c640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2410079010 0x7f241007b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.953+0000 7f242e59c640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2410079010 0x7f241007b4d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2420001720 tx=0x7f2420009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:00.956+0000 7f2426ffd640 1 -- 172.21.15.81:0/3127706166 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2430151640 con 0x7f24300735a0 2024-09-17T05:24:01.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.145+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f243014e5e0 con 0x7f24300735a0 2024-09-17T05:24:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.146+0000 7f2426ffd640 1 -- 172.21.15.81:0/3127706166 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v105) ==== 80+0+0 (secure 0 0 0) 0x7f24180630b0 con 0x7f24300735a0 2024-09-17T05:24:01.147 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:24:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2410079010 msgr2=0x7f241007b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2410079010 0x7f241007b4d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f2420001720 tx=0x7f2420009040 comp rx=0 tx=0).stop 2024-09-17T05:24:01.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24300735a0 msgr2=0x7f2430155e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24300735a0 0x7f2430155e10 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f241800d980 tx=0x7f241800de40 comp rx=0 tx=0).stop 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 shutdown_connections 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f243015aa70 0x7f24301f2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f24300735a0 0x7f2430155e10 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2410079010 0x7f241007b4d0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 --2- 172.21.15.81:0/3127706166 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f243006ff80 0x7f2430149a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 >> 172.21.15.81:0/3127706166 conn(0x7f24300b1690 msgr2=0x7f2430156770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 shutdown_connections 2024-09-17T05:24:01.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.148+0000 7f2434b94640 1 -- 172.21.15.81:0/3127706166 wait complete. 2024-09-17T05:24:01.160 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:24:01.160 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:01.161 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:01.185 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[47395]: fuse finished with error 0 and tester_r 0 2024-09-17T05:24:01.186 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:24:01.187 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:01.187 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:24:01.323 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:01.323 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:01.323 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:01.339 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:24:01.339 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:01.339 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:01.339 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:01.355 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:24:01.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 -- 172.21.15.81:0/596226487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 msgr2=0x7fc42c0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 --2- 172.21.15.81:0/596226487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 0x7fc42c0739a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7fc420009830 tx=0x7fc42002a510 comp rx=0 tx=0).stop 2024-09-17T05:24:01.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 -- 172.21.15.81:0/596226487 shutdown_connections 2024-09-17T05:24:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 --2- 172.21.15.81:0/596226487 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 0x7fc42c0739a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 --2- 172.21.15.81:0/596226487 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc42c15aa70 0x7fc42c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 -- 172.21.15.81:0/596226487 >> 172.21.15.81:0/596226487 conn(0x7fc42c0b1690 msgr2=0x7fc42c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 -- 172.21.15.81:0/596226487 shutdown_connections 2024-09-17T05:24:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.479+0000 7fc431c23640 1 -- 172.21.15.81:0/596226487 wait complete. 2024-09-17T05:24:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.480+0000 7fc431c23640 1 Processor -- start 2024-09-17T05:24:01.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.480+0000 7fc431c23640 1 -- start start 2024-09-17T05:24:01.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc431c23640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc42c06ff80 0x7fc42c1f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc431c23640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 0x7fc42c0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc431c23640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc42c15aa70 0x7fc42c0cbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc431c23640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c0707c0 con 0x7fc42c06ff80 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc431c23640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc42c070640 con 0x7fc42c0735a0 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc431c23640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc42c0cd5f0 con 0x7fc42c15aa70 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc42b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc42c06ff80 0x7fc42c1f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc42b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc42c06ff80 0x7fc42c1f5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48424/0 (socket says 172.21.15.81:48424) 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc42b7fe640 1 -- 172.21.15.81:0/547167182 learned_addr learned my addr 172.21.15.81:0/547167182 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc42bfff640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc42c15aa70 0x7fc42c0cbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.481+0000 7fc42affd640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 0x7fc42c0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc42b7fe640 1 -- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc42c15aa70 msgr2=0x7fc42c0cbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc42b7fe640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc42c15aa70 0x7fc42c0cbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc42b7fe640 1 -- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 msgr2=0x7fc42c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc42b7fe640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 0x7fc42c0c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc42b7fe640 1 -- 172.21.15.81:0/547167182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc42c147100 con 0x7fc42c06ff80 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc42b7fe640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc42c06ff80 0x7fc42c1f5730 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00ecb0 tx=0x7fc41c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc413fff640 1 -- 172.21.15.81:0/547167182 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c003b70 con 0x7fc42c06ff80 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc413fff640 1 -- 172.21.15.81:0/547167182 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc41c003d10 con 0x7fc42c06ff80 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc413fff640 1 -- 172.21.15.81:0/547167182 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc41c004280 con 0x7fc42c06ff80 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc42c1f5d10 con 0x7fc42c06ff80 2024-09-17T05:24:01.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.482+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc42c1f62d0 con 0x7fc42c06ff80 2024-09-17T05:24:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.483+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc42c0739a0 con 0x7fc42c06ff80 2024-09-17T05:24:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.483+0000 7fc413fff640 1 -- 172.21.15.81:0/547167182 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fc41c004420 con 0x7fc42c06ff80 2024-09-17T05:24:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.484+0000 7fc413fff640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc418079010 0x7fc41807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.484+0000 7fc42affd640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc418079010 0x7fc41807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.484+0000 7fc413fff640 1 -- 172.21.15.81:0/547167182 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5839+0+0 (secure 0 0 0) 0x7fc41c09c360 con 0x7fc42c06ff80 2024-09-17T05:24:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.484+0000 7fc42affd640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc418079010 0x7fc41807b4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc420034000 tx=0x7fc420004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:01.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.488+0000 7fc413fff640 1 -- 172.21.15.81:0/547167182 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc41c064070 con 0x7fc42c06ff80 2024-09-17T05:24:01.700 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.700+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc42c0b46a0 con 0x7fc42c06ff80 2024-09-17T05:24:01.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.700+0000 7fc413fff640 1 -- 172.21.15.81:0/547167182 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7fc41c063970 con 0x7fc42c06ff80 2024-09-17T05:24:01.701 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:01.701 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":61,"btime":"2024-09-17T05:23:36:135635+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1016859110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1016859110},{"type":"v1","addr":"172.21.15.160:6834","nonce":1016859110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2510717284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2510717284},{"type":"v1","addr":"172.21.15.81:6833","nonce":2510717284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3071988430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3071988430},{"type":"v1","addr":"172.21.15.81:6835","nonce":3071988430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:23:27.104253+0000","modified":"2024-09-17T05:23:29.183539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7011},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7011":{"gid":7011,"name":"d","rank":0,"incarnation":57,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/1304519501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":1304519501},{"type":"v1","addr":"172.21.15.160:6835","nonce":1304519501}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7011,"qdb_cluster":[7011]},"id":8}]} 2024-09-17T05:24:01.702 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 61 2024-09-17T05:24:01.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc418079010 msgr2=0x7fc41807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc418079010 0x7fc41807b4d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fc420034000 tx=0x7fc420004730 comp rx=0 tx=0).stop 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc42c06ff80 msgr2=0x7fc42c1f5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc42c06ff80 0x7fc42c1f5730 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fc41c00ecb0 tx=0x7fc41c00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 shutdown_connections 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc42c15aa70 0x7fc42c0cbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc418079010 0x7fc41807b4d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc42c0735a0 0x7fc42c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 --2- 172.21.15.81:0/547167182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc42c06ff80 0x7fc42c1f5730 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 >> 172.21.15.81:0/547167182 conn(0x7fc42c0b1690 msgr2=0x7fc42c0cdda0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 shutdown_connections 2024-09-17T05:24:01.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.702+0000 7fc431c23640 1 -- 172.21.15.81:0/547167182 wait complete. 2024-09-17T05:24:01.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 -- 172.21.15.81:0/23702965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d980d0d40 msgr2=0x7f4d980cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 --2- 172.21.15.81:0/23702965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d980d0d40 0x7f4d980cf9b0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f4d94005fd0 tx=0x7f4d9402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 -- 172.21.15.81:0/23702965 shutdown_connections 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 --2- 172.21.15.81:0/23702965 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d980d49c0 0x7f4d980b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 --2- 172.21.15.81:0/23702965 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d980d0d40 0x7f4d980cf9b0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 -- 172.21.15.81:0/23702965 >> 172.21.15.81:0/23702965 conn(0x7f4d980d3ea0 msgr2=0x7f4d980d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 -- 172.21.15.81:0/23702965 shutdown_connections 2024-09-17T05:24:01.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.817+0000 7f4da059b640 1 -- 172.21.15.81:0/23702965 wait complete. 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 Processor -- start 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 -- start start 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d980d0d40 0x7f4d98157a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d980d49c0 0x7f4d980c83b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d9815df90 0x7f4d980b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4d980b3d40 con 0x7f4d9815df90 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4d98162710 con 0x7f4d980d49c0 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4da059b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4d980b3ec0 con 0x7f4d980d0d40 2024-09-17T05:24:01.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.819+0000 7f4d9eb38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d9815df90 0x7f4d980b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d9815df90 0x7f4d980b1a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48444/0 (socket says 172.21.15.81:48444) 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 -- 172.21.15.81:0/1611036387 learned_addr learned my addr 172.21.15.81:0/1611036387 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9e337640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d980d0d40 0x7f4d98157a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9db36640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d980d49c0 0x7f4d980c83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 -- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d980d0d40 msgr2=0x7f4d98157a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d980d0d40 0x7f4d98157a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 -- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d980d49c0 msgr2=0x7f4d980c83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d980d49c0 0x7f4d980c83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:01.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 -- 172.21.15.81:0/1611036387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d98157fd0 con 0x7f4d9815df90 2024-09-17T05:24:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d9eb38640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d9815df90 0x7f4d980b1a70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000cad0 tx=0x7f4d9000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d8affd640 1 -- 172.21.15.81:0/1611036387 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d9000ae20 con 0x7f4d9815df90 2024-09-17T05:24:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d8affd640 1 -- 172.21.15.81:0/1611036387 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4d90004b20 con 0x7f4d9815df90 2024-09-17T05:24:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d980c9600 con 0x7f4d9815df90 2024-09-17T05:24:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4d8affd640 1 -- 172.21.15.81:0/1611036387 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d90005020 con 0x7f4d9815df90 2024-09-17T05:24:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.820+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d980c9bc0 con 0x7f4d9815df90 2024-09-17T05:24:01.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.821+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4d980d3310 con 0x7f4d9815df90 2024-09-17T05:24:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.822+0000 7f4d8affd640 1 -- 172.21.15.81:0/1611036387 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f4d900051c0 con 0x7f4d9815df90 2024-09-17T05:24:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.822+0000 7f4d8affd640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d7c079010 0x7f4d7c07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.822+0000 7f4d9e337640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d7c079010 0x7f4d7c07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.822+0000 7f4d8affd640 1 -- 172.21.15.81:0/1611036387 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5839+0+0 (secure 0 0 0) 0x7f4d9009be50 con 0x7f4d9815df90 2024-09-17T05:24:01.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.823+0000 7f4d9e337640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d7c079010 0x7f4d7c07b4d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c006fd0 tx=0x7f4d8c009060 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:01.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:01.826+0000 7f4d8affd640 1 -- 172.21.15.81:0/1611036387 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4d980d3310 con 0x7f4d9815df90 2024-09-17T05:24:02.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.038+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4d980b43d0 con 0x7f4d9815df90 2024-09-17T05:24:02.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.039+0000 7f4d8affd640 1 -- 172.21.15.81:0/1611036387 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7f4d90014030 con 0x7f4d9815df90 2024-09-17T05:24:02.040 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:02.040 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":61,"btime":"2024-09-17T05:23:36:135635+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1016859110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1016859110},{"type":"v1","addr":"172.21.15.160:6834","nonce":1016859110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2510717284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2510717284},{"type":"v1","addr":"172.21.15.81:6833","nonce":2510717284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3071988430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3071988430},{"type":"v1","addr":"172.21.15.81:6835","nonce":3071988430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:23:27.104253+0000","modified":"2024-09-17T05:23:29.183539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7011},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7011":{"gid":7011,"name":"d","rank":0,"incarnation":57,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/1304519501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":1304519501},{"type":"v1","addr":"172.21.15.160:6835","nonce":1304519501}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7011,"qdb_cluster":[7011]},"id":8}]} 2024-09-17T05:24:02.040 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 61 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d7c079010 msgr2=0x7f4d7c07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d7c079010 0x7f4d7c07b4d0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c006fd0 tx=0x7f4d8c009060 comp rx=0 tx=0).stop 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d9815df90 msgr2=0x7f4d980b1a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d9815df90 0x7f4d980b1a70 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f4d9000cad0 tx=0x7f4d9000cf90 comp rx=0 tx=0).stop 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 shutdown_connections 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4d9815df90 0x7f4d980b1a70 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4d7c079010 0x7f4d7c07b4d0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4d980d49c0 0x7f4d980c83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 --2- 172.21.15.81:0/1611036387 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4d980d0d40 0x7f4d98157a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 >> 172.21.15.81:0/1611036387 conn(0x7f4d980d3ea0 msgr2=0x7f4d980d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 shutdown_connections 2024-09-17T05:24:02.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.041+0000 7f4da059b640 1 -- 172.21.15.81:0/1611036387 wait complete. 2024-09-17T05:24:02.053 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 -- 172.21.15.81:0/2694279738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c0b1e30 msgr2=0x7fb22c0b22c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2694279738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c0b1e30 0x7fb22c0b22c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb224005fd0 tx=0x7fb22402a820 comp rx=0 tx=0).stop 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 -- 172.21.15.81:0/2694279738 shutdown_connections 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2694279738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c0b1e30 0x7fb22c0b22c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2694279738 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22c0d1d10 0x7fb22c0d2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 -- 172.21.15.81:0/2694279738 >> 172.21.15.81:0/2694279738 conn(0x7fb22c074cb0 msgr2=0x7fb22c09b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 -- 172.21.15.81:0/2694279738 shutdown_connections 2024-09-17T05:24:02.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.154+0000 7fb231c0c640 1 -- 172.21.15.81:0/2694279738 wait complete. 2024-09-17T05:24:02.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 Processor -- start 2024-09-17T05:24:02.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 -- start start 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22c0b1e30 0x7fb22c06dc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22c0d1d10 0x7fb22c0ce620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c15bdc0 0x7fb22c06ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c0ccaa0 con 0x7fb22c0d1d10 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb22c0cc920 con 0x7fb22c15bdc0 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.156+0000 7fb231c0c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb22c0cdac0 con 0x7fb22c0b1e30 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22c0d1d10 0x7fb22c0ce620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22c0d1d10 0x7fb22c0ce620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48456/0 (socket says 172.21.15.81:48456) 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 -- 172.21.15.81:0/2632390725 learned_addr learned my addr 172.21.15.81:0/2632390725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:02.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22b7fe640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22c0b1e30 0x7fb22c06dc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22bfff640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c15bdc0 0x7fb22c06ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 -- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22c0b1e30 msgr2=0x7fb22c06dc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22c0b1e30 0x7fb22c06dc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 -- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c15bdc0 msgr2=0x7fb22c06ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c15bdc0 0x7fb22c06ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 -- 172.21.15.81:0/2632390725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb22c1f8040 con 0x7fb22c0d1d10 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb22affd640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22c0d1d10 0x7fb22c0ce620 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00ea60 tx=0x7fb21c00ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb223fff640 1 -- 172.21.15.81:0/2632390725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c00cde0 con 0x7fb22c0d1d10 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb223fff640 1 -- 172.21.15.81:0/2632390725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb21c004020 con 0x7fb22c0d1d10 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb22c1f8320 con 0x7fb22c0d1d10 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb223fff640 1 -- 172.21.15.81:0/2632390725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb21c004450 con 0x7fb22c0d1d10 2024-09-17T05:24:02.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.157+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb22c1f88e0 con 0x7fb22c0d1d10 2024-09-17T05:24:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.158+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb22c0d2170 con 0x7fb22c0d1d10 2024-09-17T05:24:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.159+0000 7fb223fff640 1 -- 172.21.15.81:0/2632390725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fb21c0035f0 con 0x7fb22c0d1d10 2024-09-17T05:24:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.159+0000 7fb223fff640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb20c079010 0x7fb20c07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.159+0000 7fb22b7fe640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb20c079010 0x7fb20c07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.160+0000 7fb223fff640 1 -- 172.21.15.81:0/2632390725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5839+0+0 (secure 0 0 0) 0x7fb21c09bf80 con 0x7fb22c0d1d10 2024-09-17T05:24:02.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.160+0000 7fb22b7fe640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb20c079010 0x7fb20c07b4d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb214007fd0 tx=0x7fb214001430 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:02.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.164+0000 7fb223fff640 1 -- 172.21.15.81:0/2632390725 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb21c0635c0 con 0x7fb22c0d1d10 2024-09-17T05:24:02.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.339+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb22c0cc520 con 0x7fb22c0d1d10 2024-09-17T05:24:02.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.340+0000 7fb223fff640 1 -- 172.21.15.81:0/2632390725 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v105) ==== 74+0+16909 (secure 0 0 0) 0x7fb21c067ff0 con 0x7fb22c0d1d10 2024-09-17T05:24:02.341 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:02.341 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":105,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:00.135470+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:23:25.709556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:23:26.056368+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.34","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:02.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb20c079010 msgr2=0x7fb20c07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb20c079010 0x7fb20c07b4d0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7fb214007fd0 tx=0x7fb214001430 comp rx=0 tx=0).stop 2024-09-17T05:24:02.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22c0d1d10 msgr2=0x7fb22c0ce620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22c0d1d10 0x7fb22c0ce620 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7fb21c00ea60 tx=0x7fb21c00ef20 comp rx=0 tx=0).stop 2024-09-17T05:24:02.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 shutdown_connections 2024-09-17T05:24:02.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb20c079010 0x7fb20c07b4d0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb22c15bdc0 0x7fb22c06ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb22c0d1d10 0x7fb22c0ce620 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 --2- 172.21.15.81:0/2632390725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb22c0b1e30 0x7fb22c06dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 >> 172.21.15.81:0/2632390725 conn(0x7fb22c074cb0 msgr2=0x7fb22c0b2ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:02.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 shutdown_connections 2024-09-17T05:24:02.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.342+0000 7fb231c0c640 1 -- 172.21.15.81:0/2632390725 wait complete. 2024-09-17T05:24:02.354 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:24:02.355 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:02.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.455+0000 7fecf586e640 1 -- 172.21.15.81:0/3534772523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecd8003a50 msgr2=0x7fecd8003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.455+0000 7fecf586e640 1 --2- 172.21.15.81:0/3534772523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecd8003a50 0x7fecd8003e70 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7fece0006fd0 tx=0x7fecd8005830 comp rx=0 tx=0).stop 2024-09-17T05:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.455+0000 7fecf586e640 1 -- 172.21.15.81:0/3534772523 shutdown_connections 2024-09-17T05:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.455+0000 7fecf586e640 1 --2- 172.21.15.81:0/3534772523 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecd8003a50 0x7fecd8003e70 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.455+0000 7fecf586e640 1 -- 172.21.15.81:0/3534772523 >> 172.21.15.81:0/3534772523 conn(0x7fecf00d3e70 msgr2=0x7fecf00d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.455+0000 7fecf586e640 1 -- 172.21.15.81:0/3534772523 shutdown_connections 2024-09-17T05:24:02.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.455+0000 7fecf586e640 1 -- 172.21.15.81:0/3534772523 wait complete. 2024-09-17T05:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.456+0000 7fecf586e640 1 Processor -- start 2024-09-17T05:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.456+0000 7fecf586e640 1 -- start start 2024-09-17T05:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecf586e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fecd8003a50 0x7fecf00ca1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecf586e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecf00cd010 0x7fecf01f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecf586e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf01f8210 0x7fecf01f8690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecf586e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0162870 con 0x7fecf01f8210 2024-09-17T05:24:02.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecf586e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fecf0162210 con 0x7fecf00cd010 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecf586e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fecf01629f0 con 0x7fecd8003a50 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf01f8210 0x7fecf01f8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf01f8210 0x7fecf01f8690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48468/0 (socket says 172.21.15.81:48468) 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecef7fe640 1 -- 172.21.15.81:0/3947779851 learned_addr learned my addr 172.21.15.81:0/3947779851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7feceeffd640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fecd8003a50 0x7fecf00ca1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.457+0000 7fecee7fc640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecf00cd010 0x7fecf01f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecef7fe640 1 -- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fecd8003a50 msgr2=0x7fecf00ca1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecef7fe640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fecd8003a50 0x7fecf00ca1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecef7fe640 1 -- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecf00cd010 msgr2=0x7fecf01f7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecef7fe640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecf00cd010 0x7fecf01f7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecef7fe640 1 -- 172.21.15.81:0/3947779851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fecf00cd7f0 con 0x7fecf01f8210 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecef7fe640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf01f8210 0x7fecf01f8690 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fece80020c0 tx=0x7fece8006430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecd7fff640 1 -- 172.21.15.81:0/3947779851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8011840 con 0x7fecf01f8210 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecd7fff640 1 -- 172.21.15.81:0/3947779851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fece8017070 con 0x7fecf01f8210 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fecf00cdad0 con 0x7fecf01f8210 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecd7fff640 1 -- 172.21.15.81:0/3947779851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fece8011c60 con 0x7fecf01f8210 2024-09-17T05:24:02.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.458+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fecf015ee20 con 0x7fecf01f8210 2024-09-17T05:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.459+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fecf00cdd10 con 0x7fecf01f8210 2024-09-17T05:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.460+0000 7fecd7fff640 1 -- 172.21.15.81:0/3947779851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fece801c460 con 0x7fecf01f8210 2024-09-17T05:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.460+0000 7fecd7fff640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fecdc079040 0x7fecdc07b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.460+0000 7feceeffd640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fecdc079040 0x7fecdc07b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.460+0000 7fecd7fff640 1 -- 172.21.15.81:0/3947779851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5839+0+0 (secure 0 0 0) 0x7fece809bc40 con 0x7fecf01f8210 2024-09-17T05:24:02.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.460+0000 7feceeffd640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fecdc079040 0x7fecdc07b500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fece0033000 tx=0x7fece0038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.464+0000 7fecd7fff640 1 -- 172.21.15.81:0/3947779851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fecf00cdd10 con 0x7fecf01f8210 2024-09-17T05:24:02.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.676+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fecf00d22f0 con 0x7fecf01f8210 2024-09-17T05:24:02.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.676+0000 7fecd7fff640 1 -- 172.21.15.81:0/3947779851 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7fece8063a80 con 0x7fecf01f8210 2024-09-17T05:24:02.677 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:02.678 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":61,"btime":"2024-09-17T05:23:36:135635+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1016859110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1016859110},{"type":"v1","addr":"172.21.15.160:6834","nonce":1016859110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2510717284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2510717284},{"type":"v1","addr":"172.21.15.81:6833","nonce":2510717284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3071988430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3071988430},{"type":"v1","addr":"172.21.15.81:6835","nonce":3071988430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:23:27.104253+0000","modified":"2024-09-17T05:23:29.183539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7011},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7011":{"gid":7011,"name":"d","rank":0,"incarnation":57,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/1304519501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":1304519501},{"type":"v1","addr":"172.21.15.160:6835","nonce":1304519501}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7011,"qdb_cluster":[7011]},"id":8}]} 2024-09-17T05:24:02.678 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 61 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fecdc079040 msgr2=0x7fecdc07b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fecdc079040 0x7fecdc07b500 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fece0033000 tx=0x7fece0038040 comp rx=0 tx=0).stop 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf01f8210 msgr2=0x7fecf01f8690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf01f8210 0x7fecf01f8690 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fece80020c0 tx=0x7fece8006430 comp rx=0 tx=0).stop 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 shutdown_connections 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fecf01f8210 0x7fecf01f8690 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fecdc079040 0x7fecdc07b500 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fecf00cd010 0x7fecf01f7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 --2- 172.21.15.81:0/3947779851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fecd8003a50 0x7fecf00ca1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 >> 172.21.15.81:0/3947779851 conn(0x7fecf00d3e70 msgr2=0x7fecf015df60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 shutdown_connections 2024-09-17T05:24:02.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.678+0000 7fecf586e640 1 -- 172.21.15.81:0/3947779851 wait complete. 2024-09-17T05:24:02.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:02.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1777495978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 msgr2=0x7fec680cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1777495978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec680cef30 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fec5c005fd0 tx=0x7fec5c02a580 comp rx=0 tx=0).stop 2024-09-17T05:24:02.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1777495978 shutdown_connections 2024-09-17T05:24:02.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1777495978 >> v2:172.21.15.160:3300/0 conn(0x7fec680b3140 0x7fec680cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1777495978 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec680cef30 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1777495978 >> 172.21.15.81:0/1777495978 conn(0x7fec680b1690 msgr2=0x7fec680b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:02.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1777495978 shutdown_connections 2024-09-17T05:24:02.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.790+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1777495978 wait complete. 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.791+0000 7fec6f1f8640 1 Processor -- start 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.791+0000 7fec6f1f8640 1 -- start start 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec680725a0 0x7fec681e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3140 0x7fec681e7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec681e3b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fec6806fff0 con 0x7fec68151370 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fec6806fe70 con 0x7fec680b3140 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fec68070170 con 0x7fec680725a0 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec681e3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec681e3b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48484/0 (socket says 172.21.15.81:48484) 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 -- 172.21.15.81:0/1338813809 learned_addr learned my addr 172.21.15.81:0/1338813809 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6cf94640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec680725a0 0x7fec681e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec67fff640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3140 0x7fec681e7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 -- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec680725a0 msgr2=0x7fec681e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec680725a0 0x7fec681e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 -- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3140 msgr2=0x7fec681e7930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3140 0x7fec681e7930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 -- 172.21.15.81:0/1338813809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec681e6890 con 0x7fec68151370 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec67fff640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3140 0x7fec681e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6cf94640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec680725a0 0x7fec681e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6d795640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec681e3b70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fec6000c780 tx=0x7fec6000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec657fa640 1 -- 172.21.15.81:0/1338813809 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60017070 con 0x7fec68151370 2024-09-17T05:24:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec657fa640 1 -- 172.21.15.81:0/1338813809 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fec6000ce30 con 0x7fec68151370 2024-09-17T05:24:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec681e6b70 con 0x7fec68151370 2024-09-17T05:24:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec657fa640 1 -- 172.21.15.81:0/1338813809 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec60005290 con 0x7fec68151370 2024-09-17T05:24:02.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.792+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec681e7130 con 0x7fec68151370 2024-09-17T05:24:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.794+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec680706d0 con 0x7fec68151370 2024-09-17T05:24:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.794+0000 7fec657fa640 1 -- 172.21.15.81:0/1338813809 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fec6001a070 con 0x7fec68151370 2024-09-17T05:24:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.795+0000 7fec657fa640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fec4c079010 0x7fec4c07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.795+0000 7fec6cf94640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fec4c079010 0x7fec4c07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.795+0000 7fec657fa640 1 -- 172.21.15.81:0/1338813809 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(105..105 src has 1..105) ==== 5839+0+0 (secure 0 0 0) 0x7fec6009acb0 con 0x7fec68151370 2024-09-17T05:24:02.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.795+0000 7fec6cf94640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fec4c079010 0x7fec4c07b4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec5c033000 tx=0x7fec5c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:02.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:02.799+0000 7fec657fa640 1 -- 172.21.15.81:0/1338813809 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fec600629c0 con 0x7fec68151370 2024-09-17T05:24:03.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.013+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec680cf310 con 0x7fec68151370 2024-09-17T05:24:03.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.014+0000 7fec657fa640 1 -- 172.21.15.81:0/1338813809 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 61 v61) ==== 94+0+5231 (secure 0 0 0) 0x7fec600622c0 con 0x7fec68151370 2024-09-17T05:24:03.015 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:03.015 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":61,"btime":"2024-09-17T05:23:36:135635+0000","default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1016859110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1016859110},{"type":"v1","addr":"172.21.15.160:6834","nonce":1016859110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2510717284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2510717284},{"type":"v1","addr":"172.21.15.81:6833","nonce":2510717284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3071988430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3071988430},{"type":"v1","addr":"172.21.15.81:6835","nonce":3071988430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[{"mdsmap":{"epoch":60,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:23:27.104253+0000","modified":"2024-09-17T05:23:29.183539+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7011},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7011":{"gid":7011,"name":"d","rank":0,"incarnation":57,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/1304519501","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":1304519501},{"type":"v1","addr":"172.21.15.160:6835","nonce":1304519501}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7011,"qdb_cluster":[7011]},"id":8}]} 2024-09-17T05:24:03.015 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 61 2024-09-17T05:24:03.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fec4c079010 msgr2=0x7fec4c07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fec4c079010 0x7fec4c07b4d0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fec5c033000 tx=0x7fec5c004730 comp rx=0 tx=0).stop 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 msgr2=0x7fec681e3b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec681e3b70 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7fec6000c780 tx=0x7fec6000cc40 comp rx=0 tx=0).stop 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 shutdown_connections 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fec68151370 0x7fec681e3b70 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fec4c079010 0x7fec4c07b4d0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fec680b3140 0x7fec681e7930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 --2- 172.21.15.81:0/1338813809 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fec680725a0 0x7fec681e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 >> 172.21.15.81:0/1338813809 conn(0x7fec680b1690 msgr2=0x7fec681e4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 shutdown_connections 2024-09-17T05:24:03.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.016+0000 7fec6f1f8640 1 -- 172.21.15.81:0/1338813809 wait complete. 2024-09-17T05:24:03.028 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:03.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.128+0000 7fb70e305640 1 -- 172.21.15.81:0/1291375528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb708151370 msgr2=0x7fb7080cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.128+0000 7fb70e305640 1 --2- 172.21.15.81:0/1291375528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb708151370 0x7fb7080cef30 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8005fd0 tx=0x7fb6f802a580 comp rx=0 tx=0).stop 2024-09-17T05:24:03.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.129+0000 7fb70e305640 1 -- 172.21.15.81:0/1291375528 shutdown_connections 2024-09-17T05:24:03.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.129+0000 7fb70e305640 1 --2- 172.21.15.81:0/1291375528 >> v2:172.21.15.160:3300/0 conn(0x7fb708072cb0 0x7fb7080cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.129+0000 7fb70e305640 1 --2- 172.21.15.81:0/1291375528 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb708151370 0x7fb7080cef30 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.129+0000 7fb70e305640 1 -- 172.21.15.81:0/1291375528 >> 172.21.15.81:0/1291375528 conn(0x7fb7080b1690 msgr2=0x7fb7080b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:03.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.129+0000 7fb70e305640 1 -- 172.21.15.81:0/1291375528 shutdown_connections 2024-09-17T05:24:03.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.129+0000 7fb70e305640 1 -- 172.21.15.81:0/1291375528 wait complete. 2024-09-17T05:24:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.130+0000 7fb70e305640 1 Processor -- start 2024-09-17T05:24:03.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.130+0000 7fb70e305640 1 -- start start 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb708072cb0 0x7fb708146c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7080b3140 0x7fb7081f5530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb708151370 0x7fb7080af8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb70806ebe0 con 0x7fb7080b3140 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb70806ea60 con 0x7fb708072cb0 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb70806f9f0 con 0x7fb708151370 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7080b3140 0x7fb7081f5530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7080b3140 0x7fb7081f5530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48504/0 (socket says 172.21.15.81:48504) 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 -- 172.21.15.81:0/710273006 learned_addr learned my addr 172.21.15.81:0/710273006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb707fff640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb708072cb0 0x7fb708146c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70c8a2640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb708151370 0x7fb7080af8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 -- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb708151370 msgr2=0x7fb7080af8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb708151370 0x7fb7080af8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 -- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb708072cb0 msgr2=0x7fb708146c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb708072cb0 0x7fb708146c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 -- 172.21.15.81:0/710273006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7081f5a70 con 0x7fb7080b3140 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb707fff640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb708072cb0 0x7fb708146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb7077fe640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7080b3140 0x7fb7081f5530 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c430 tx=0x7fb6fc00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:03.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb704ff9640 1 -- 172.21.15.81:0/710273006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc011790 con 0x7fb7080b3140 2024-09-17T05:24:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb704ff9640 1 -- 172.21.15.81:0/710273006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb6fc017070 con 0x7fb7080b3140 2024-09-17T05:24:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb704ff9640 1 -- 172.21.15.81:0/710273006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6fc011cc0 con 0x7fb7080b3140 2024-09-17T05:24:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7080cc680 con 0x7fb7080b3140 2024-09-17T05:24:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.131+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7080ccc40 con 0x7fb7080b3140 2024-09-17T05:24:03.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.132+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7080725a0 con 0x7fb7080b3140 2024-09-17T05:24:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.133+0000 7fb704ff9640 1 -- 172.21.15.81:0/710273006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fb6fc01c460 con 0x7fb7080b3140 2024-09-17T05:24:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.134+0000 7fb704ff9640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb6f4079010 0x7fb6f407b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.134+0000 7fb707fff640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb6f4079010 0x7fb6f407b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.134+0000 7fb704ff9640 1 -- 172.21.15.81:0/710273006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5839+0+0 (secure 0 0 0) 0x7fb6fc09b450 con 0x7fb7080b3140 2024-09-17T05:24:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.134+0000 7fb707fff640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb6f4079010 0x7fb6f407b4d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8033000 tx=0x7fb6f8004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:03.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.138+0000 7fb704ff9640 1 -- 172.21.15.81:0/710273006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb7081f5a70 con 0x7fb7080b3140 2024-09-17T05:24:03.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.316+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb70814d5a0 con 0x7fb7080b3140 2024-09-17T05:24:03.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.317+0000 7fb704ff9640 1 -- 172.21.15.81:0/710273006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v106) ==== 74+0+16909 (secure 0 0 0) 0x7fb6fc063200 con 0x7fb7080b3140 2024-09-17T05:24:03.318 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:03.318 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":106,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:02.837961+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:23:25.709556+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2024-09-17T05:23:26.056368+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"105","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":105,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"17.34","mappings":[{"from":0,"to":5}]},{"pgid":"17.37","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[{"pool":17,"snaps":[{"begin":3,"length":2}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb6f4079010 msgr2=0x7fb6f407b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb6f4079010 0x7fb6f407b4d0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fb6f8033000 tx=0x7fb6f8004730 comp rx=0 tx=0).stop 2024-09-17T05:24:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7080b3140 msgr2=0x7fb7081f5530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7080b3140 0x7fb7081f5530 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7fb6fc00c430 tx=0x7fb6fc00c8f0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 shutdown_connections 2024-09-17T05:24:03.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb708151370 0x7fb7080af8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7080b3140 0x7fb7081f5530 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb6f4079010 0x7fb6f407b4d0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 --2- 172.21.15.81:0/710273006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb708072cb0 0x7fb708146c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 >> 172.21.15.81:0/710273006 conn(0x7fb7080b1690 msgr2=0x7fb708142f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 shutdown_connections 2024-09-17T05:24:03.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.319+0000 7fb70e305640 1 -- 172.21.15.81:0/710273006 wait complete. 2024-09-17T05:24:03.332 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:24:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 -- 172.21.15.81:0/2375730872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c8072ae0 msgr2=0x7f49c813f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 --2- 172.21.15.81:0/2375730872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c8072ae0 0x7f49c813f290 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f49bc005fd0 tx=0x7f49bc02b1a0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 -- 172.21.15.81:0/2375730872 shutdown_connections 2024-09-17T05:24:03.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 --2- 172.21.15.81:0/2375730872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c8072ae0 0x7f49c813f290 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 --2- 172.21.15.81:0/2375730872 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c813ce00 0x7f49c80725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 -- 172.21.15.81:0/2375730872 >> 172.21.15.81:0/2375730872 conn(0x7f49c80b1690 msgr2=0x7f49c80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:03.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 -- 172.21.15.81:0/2375730872 shutdown_connections 2024-09-17T05:24:03.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.433+0000 7f49cf952640 1 -- 172.21.15.81:0/2375730872 wait complete. 2024-09-17T05:24:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.434+0000 7f49cf952640 1 Processor -- start 2024-09-17T05:24:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.434+0000 7f49cf952640 1 -- start start 2024-09-17T05:24:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cf952640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c8072ae0 0x7f49c80d0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cf952640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c813ce00 0x7f49c81f25d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cf952640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c813f7d0 0x7f49c8157200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cf952640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f49c813d520 con 0x7f49c813f7d0 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cf952640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f49c813d3a0 con 0x7f49c8072ae0 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cf952640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f49c8070690 con 0x7f49c813ce00 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c813f7d0 0x7f49c8157200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c813f7d0 0x7f49c8157200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48098/0 (socket says 172.21.15.81:48098) 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 -- 172.21.15.81:0/1448668202 learned_addr learned my addr 172.21.15.81:0/1448668202 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cd6ee640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c8072ae0 0x7f49c80d0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cceed640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c813ce00 0x7f49c81f25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 -- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c813ce00 msgr2=0x7f49c81f25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c813ce00 0x7f49c81f25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 -- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c8072ae0 msgr2=0x7f49c80d0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c8072ae0 0x7f49c80d0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cdeef640 1 -- 172.21.15.81:0/1448668202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49c8154ab0 con 0x7f49c813f7d0 2024-09-17T05:24:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cceed640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c813ce00 0x7f49c81f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:03.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.435+0000 7f49cd6ee640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c8072ae0 0x7f49c80d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.436+0000 7f49cdeef640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c813f7d0 0x7f49c8157200 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f49c000b4c0 tx=0x7f49c000b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.436+0000 7f49c5ffb640 1 -- 172.21.15.81:0/1448668202 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0015020 con 0x7f49c813f7d0 2024-09-17T05:24:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.436+0000 7f49c5ffb640 1 -- 172.21.15.81:0/1448668202 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f49c0011940 con 0x7f49c813f7d0 2024-09-17T05:24:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.436+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49c8154d90 con 0x7f49c813f7d0 2024-09-17T05:24:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.436+0000 7f49c5ffb640 1 -- 172.21.15.81:0/1448668202 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49c0011d90 con 0x7f49c813f7d0 2024-09-17T05:24:03.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.436+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49c8155350 con 0x7f49c813f7d0 2024-09-17T05:24:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.437+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f49c81f2bd0 con 0x7f49c813f7d0 2024-09-17T05:24:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.437+0000 7f49c5ffb640 1 -- 172.21.15.81:0/1448668202 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f49c0018020 con 0x7f49c813f7d0 2024-09-17T05:24:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.438+0000 7f49c5ffb640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f49b4079010 0x7f49b407b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.438+0000 7f49c5ffb640 1 -- 172.21.15.81:0/1448668202 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(106..106 src has 1..106) ==== 5839+0+0 (secure 0 0 0) 0x7f49c009b560 con 0x7f49c813f7d0 2024-09-17T05:24:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.438+0000 7f49cd6ee640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f49b4079010 0x7f49b407b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.439+0000 7f49cd6ee640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f49b4079010 0x7f49b407b4d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009fa0 tx=0x7f49b8009570 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:03.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.442+0000 7f49c5ffb640 1 -- 172.21.15.81:0/1448668202 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f49c001f020 con 0x7f49c813f7d0 2024-09-17T05:24:03.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.656+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f49c813f290 con 0x7f49c813f7d0 2024-09-17T05:24:03.657 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:24:03.656+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:24:03.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.657+0000 7f49c5ffb640 1 -- 172.21.15.81:0/1448668202 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v62) ==== 161+0+0 (secure 0 0 0) 0x7f49c0063270 con 0x7f49c813f7d0 2024-09-17T05:24:03.658 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:24:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f49b4079010 msgr2=0x7f49b407b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f49b4079010 0x7f49b407b4d0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f49b8009fa0 tx=0x7f49b8009570 comp rx=0 tx=0).stop 2024-09-17T05:24:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c813f7d0 msgr2=0x7f49c8157200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c813f7d0 0x7f49c8157200 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f49c000b4c0 tx=0x7f49c000b980 comp rx=0 tx=0).stop 2024-09-17T05:24:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 shutdown_connections 2024-09-17T05:24:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f49c813f7d0 0x7f49c8157200 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f49c813ce00 0x7f49c81f25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f49b4079010 0x7f49b407b4d0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 --2- 172.21.15.81:0/1448668202 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f49c8072ae0 0x7f49c80d0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 >> 172.21.15.81:0/1448668202 conn(0x7f49c80b1690 msgr2=0x7f49c815c330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 shutdown_connections 2024-09-17T05:24:03.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.661+0000 7f49cf952640 1 -- 172.21.15.81:0/1448668202 wait complete. 2024-09-17T05:24:03.673 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:24:03.701 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:24:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.775+0000 7f79e2ed6640 1 -- 172.21.15.81:0/3802506917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8004b60 msgr2=0x7f79c8004f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.775+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/3802506917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8004b60 0x7f79c8004f80 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f79d4009b50 tx=0x7f79c8006940 comp rx=0 tx=0).stop 2024-09-17T05:24:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.775+0000 7f79e2ed6640 1 -- 172.21.15.81:0/3802506917 shutdown_connections 2024-09-17T05:24:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.775+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/3802506917 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79c8004b60 0x7f79c8004f80 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.775+0000 7f79e2ed6640 1 -- 172.21.15.81:0/3802506917 >> 172.21.15.81:0/3802506917 conn(0x7f79dc0b1700 msgr2=0x7f79dc0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.775+0000 7f79e2ed6640 1 -- 172.21.15.81:0/3802506917 shutdown_connections 2024-09-17T05:24:03.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.775+0000 7f79e2ed6640 1 -- 172.21.15.81:0/3802506917 wait complete. 2024-09-17T05:24:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.776+0000 7f79e2ed6640 1 Processor -- start 2024-09-17T05:24:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.776+0000 7f79e2ed6640 1 -- start start 2024-09-17T05:24:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e2ed6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c8004b60 0x7f79dc0c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e2ed6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79dc1f1510 0x7f79dc144ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e2ed6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc1f4080 0x7f79dc1f4500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e2ed6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc0cc730 con 0x7f79dc1f4080 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e2ed6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f79dc0cc5b0 con 0x7f79c8004b60 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e2ed6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f79dc0cc8b0 con 0x7f79dc1f1510 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc1f4080 0x7f79dc1f4500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc1f4080 0x7f79dc1f4500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48126/0 (socket says 172.21.15.81:48126) 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 -- 172.21.15.81:0/217676682 learned_addr learned my addr 172.21.15.81:0/217676682 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e0c72640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c8004b60 0x7f79dc0c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79dbfff640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79dc1f1510 0x7f79dc144ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 -- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79dc1f1510 msgr2=0x7f79dc144ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79dc1f1510 0x7f79dc144ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 -- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c8004b60 msgr2=0x7f79dc0c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:03.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c8004b60 0x7f79dc0c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e1473640 1 -- 172.21.15.81:0/217676682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79dc0c7050 con 0x7f79dc1f4080 2024-09-17T05:24:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.777+0000 7f79e0c72640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c8004b60 0x7f79dc0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.778+0000 7f79e1473640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc1f4080 0x7f79dc1f4500 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f79c4001d00 tx=0x7f79c400e900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.778+0000 7f79d97fa640 1 -- 172.21.15.81:0/217676682 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400a4b0 con 0x7f79dc1f4080 2024-09-17T05:24:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.778+0000 7f79d97fa640 1 -- 172.21.15.81:0/217676682 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f79c400a650 con 0x7f79dc1f4080 2024-09-17T05:24:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.778+0000 7f79d97fa640 1 -- 172.21.15.81:0/217676682 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79c400aa80 con 0x7f79dc1f4080 2024-09-17T05:24:03.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.778+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79dc0c7330 con 0x7f79dc1f4080 2024-09-17T05:24:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.778+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79dc0c78f0 con 0x7f79dc1f4080 2024-09-17T05:24:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.779+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f79dc0cd070 con 0x7f79dc1f4080 2024-09-17T05:24:03.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.779+0000 7f79d97fa640 1 -- 172.21.15.81:0/217676682 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f79c400ac20 con 0x7f79dc1f4080 2024-09-17T05:24:03.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.780+0000 7f79d97fa640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f79bc079010 0x7f79bc07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:03.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.780+0000 7f79d97fa640 1 -- 172.21.15.81:0/217676682 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5897+0+0 (secure 0 0 0) 0x7f79c409cda0 con 0x7f79dc1f4080 2024-09-17T05:24:03.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.780+0000 7f79e0c72640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f79bc079010 0x7f79bc07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:03.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.780+0000 7f79e0c72640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f79bc079010 0x7f79bc07b4d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f79d4035000 tx=0x7f79d40046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:03.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.784+0000 7f79d97fa640 1 -- 172.21.15.81:0/217676682 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f79c40649e0 con 0x7f79dc1f4080 2024-09-17T05:24:03.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:03.998+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f79dc0c6900 con 0x7f79dc1f4080 2024-09-17T05:24:04.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.667+0000 7f79d97fa640 1 -- 172.21.15.81:0/217676682 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v63) ==== 104+0+0 (secure 0 0 0) 0x7f79c40642e0 con 0x7f79dc1f4080 2024-09-17T05:24:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f79bc079010 msgr2=0x7f79bc07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f79bc079010 0x7f79bc07b4d0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f79d4035000 tx=0x7f79d40046c0 comp rx=0 tx=0).stop 2024-09-17T05:24:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc1f4080 msgr2=0x7f79dc1f4500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc1f4080 0x7f79dc1f4500 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7f79c4001d00 tx=0x7f79c400e900 comp rx=0 tx=0).stop 2024-09-17T05:24:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 shutdown_connections 2024-09-17T05:24:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f79dc1f4080 0x7f79dc1f4500 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:04.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f79dc1f1510 0x7f79dc144ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:04.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f79bc079010 0x7f79bc07b4d0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:04.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 --2- 172.21.15.81:0/217676682 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f79c8004b60 0x7f79dc0c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:04.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 >> 172.21.15.81:0/217676682 conn(0x7f79dc0b1700 msgr2=0x7f79dc06ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:04.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 shutdown_connections 2024-09-17T05:24:04.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.669+0000 7f79e2ed6640 1 -- 172.21.15.81:0/217676682 wait complete. 2024-09-17T05:24:04.682 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:24:04.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.786+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/581640149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9dc0039e0 msgr2=0x7fd9dc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.786+0000 7fd9f7aa9640 1 --2- 172.21.15.81:0/581640149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9dc0039e0 0x7fd9dc003dc0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c290 tx=0x7fd9dc005830 comp rx=0 tx=0).stop 2024-09-17T05:24:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.786+0000 7fd9f6046640 1 -- 172.21.15.81:0/581640149 reap_dead start 2024-09-17T05:24:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.786+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/581640149 shutdown_connections 2024-09-17T05:24:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.786+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/581640149 >> 172.21.15.81:0/581640149 conn(0x7fd9f00b1620 msgr2=0x7fd9f00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.786+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/581640149 shutdown_connections 2024-09-17T05:24:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.786+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/581640149 wait complete. 2024-09-17T05:24:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.787+0000 7fd9f7aa9640 1 Processor -- start 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.787+0000 7fd9f7aa9640 1 -- start start 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f7aa9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9dc0039e0 0x7fd9f01f5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f7aa9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f00aeda0 0x7fd9f01f8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f7aa9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f01f8ec0 0x7fd9f006ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f7aa9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f0159e60 con 0x7fd9f00aeda0 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f7aa9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f0159ce0 con 0x7fd9dc0039e0 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f7aa9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f0159fe0 con 0x7fd9f01f8ec0 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f00aeda0 0x7fd9f01f8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f00aeda0 0x7fd9f01f8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48146/0 (socket says 172.21.15.81:48146) 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 -- 172.21.15.81:0/1450628411 learned_addr learned my addr 172.21.15.81:0/1450628411 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:04.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5845640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9dc0039e0 0x7fd9f01f5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:04.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f6046640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f01f8ec0 0x7fd9f006ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:04.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 -- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f01f8ec0 msgr2=0x7fd9f006ed70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:04.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f01f8ec0 0x7fd9f006ed70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:04.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 -- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9dc0039e0 msgr2=0x7fd9f01f5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:04.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9dc0039e0 0x7fd9f01f5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:04.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f5044640 1 -- 172.21.15.81:0/1450628411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f01f5390 con 0x7fd9f00aeda0 2024-09-17T05:24:04.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.788+0000 7fd9f6046640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f01f8ec0 0x7fd9f006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:04.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.789+0000 7fd9f5044640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f00aeda0 0x7fd9f01f8980 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0011a80 tx=0x7fd9e0011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:04.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.789+0000 7fd9e67fc640 1 -- 172.21.15.81:0/1450628411 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e001f070 con 0x7fd9f00aeda0 2024-09-17T05:24:04.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.789+0000 7fd9e67fc640 1 -- 172.21.15.81:0/1450628411 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9e000fe40 con 0x7fd9f00aeda0 2024-09-17T05:24:04.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.789+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f01f9440 con 0x7fd9f00aeda0 2024-09-17T05:24:04.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.789+0000 7fd9e67fc640 1 -- 172.21.15.81:0/1450628411 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e00126b0 con 0x7fd9f00aeda0 2024-09-17T05:24:04.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.789+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f01f5630 con 0x7fd9f00aeda0 2024-09-17T05:24:04.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.790+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f015a510 con 0x7fd9f00aeda0 2024-09-17T05:24:04.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.790+0000 7fd9e67fc640 1 -- 172.21.15.81:0/1450628411 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fd9e0022070 con 0x7fd9f00aeda0 2024-09-17T05:24:04.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.791+0000 7fd9e67fc640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d4079040 0x7fd9d407b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:04.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.791+0000 7fd9f5845640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d4079040 0x7fd9d407b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:04.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.791+0000 7fd9e67fc640 1 -- 172.21.15.81:0/1450628411 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(107..107 src has 1..107) ==== 5897+0+0 (secure 0 0 0) 0x7fd9e009c050 con 0x7fd9f00aeda0 2024-09-17T05:24:04.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.791+0000 7fd9f5845640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d4079040 0x7fd9d407b500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c290 tx=0x7fd9ec02d000 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:04.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.795+0000 7fd9e67fc640 1 -- 172.21.15.81:0/1450628411 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd9e0063640 con 0x7fd9f00aeda0 2024-09-17T05:24:04.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:04.970+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd9f00cc390 con 0x7fd9f00aeda0 2024-09-17T05:24:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.668+0000 7fd9e67fc640 1 -- 172.21.15.81:0/1450628411 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v108) ==== 181+0+0 (secure 0 0 0) 0x7fd9e0068070 con 0x7fd9f00aeda0 2024-09-17T05:24:05.669 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d4079040 msgr2=0x7fd9d407b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d4079040 0x7fd9d407b500 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec00c290 tx=0x7fd9ec02d000 comp rx=0 tx=0).stop 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f00aeda0 msgr2=0x7fd9f01f8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f00aeda0 0x7fd9f01f8980 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7fd9e0011a80 tx=0x7fd9e0011f40 comp rx=0 tx=0).stop 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 shutdown_connections 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f01f8ec0 0x7fd9f006ed70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f00aeda0 0x7fd9f01f8980 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d4079040 0x7fd9d407b500 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 --2- 172.21.15.81:0/1450628411 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9dc0039e0 0x7fd9f01f5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.670+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 >> 172.21.15.81:0/1450628411 conn(0x7fd9f00b1620 msgr2=0x7fd9f0157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.671+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 shutdown_connections 2024-09-17T05:24:05.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.671+0000 7fd9f7aa9640 1 -- 172.21.15.81:0/1450628411 wait complete. 2024-09-17T05:24:05.685 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:24:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 -- 172.21.15.81:0/2884922682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b640b0590 msgr2=0x7f4b640cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2884922682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b640b0590 0x7f4b640cd1d0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7f4b640cdde0 tx=0x7f4b4c02a420 comp rx=0 tx=0).stop 2024-09-17T05:24:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 -- 172.21.15.81:0/2884922682 shutdown_connections 2024-09-17T05:24:05.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2884922682 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b640cd710 0x7f4b640b0ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2884922682 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b640b0590 0x7f4b640cd1d0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2884922682 >> v2:172.21.15.160:3300/0 conn(0x7f4b6415be70 0x7f4b640ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 -- 172.21.15.81:0/2884922682 >> 172.21.15.81:0/2884922682 conn(0x7f4b64074160 msgr2=0x7f4b64074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 -- 172.21.15.81:0/2884922682 shutdown_connections 2024-09-17T05:24:05.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.790+0000 7f4b69a95640 1 -- 172.21.15.81:0/2884922682 wait complete. 2024-09-17T05:24:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.792+0000 7f4b69a95640 1 Processor -- start 2024-09-17T05:24:05.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.792+0000 7f4b69a95640 1 -- start start 2024-09-17T05:24:05.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b640b0590 0x7f4b641f4ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:05.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b640cd710 0x7f4b640ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:05.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415be70 0x7f4b640cae50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b640b1020 con 0x7f4b6415be70 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b64074e80 con 0x7f4b640cd710 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4b640b11a0 con 0x7f4b640b0590 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415be70 0x7f4b640cae50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415be70 0x7f4b640cae50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48154/0 (socket says 172.21.15.81:48154) 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 -- 172.21.15.81:0/2280401888 learned_addr learned my addr 172.21.15.81:0/2280401888 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b637fe640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b640b0590 0x7f4b641f4ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b62ffd640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b640cd710 0x7f4b640ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 -- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b640b0590 msgr2=0x7f4b641f4ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b640b0590 0x7f4b641f4ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 -- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b640cd710 msgr2=0x7f4b640ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b640cd710 0x7f4b640ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 -- 172.21.15.81:0/2280401888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b640b4680 con 0x7f4b6415be70 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b63fff640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415be70 0x7f4b640cae50 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00cd10 tx=0x7f4b5c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b5bfff640 1 -- 172.21.15.81:0/2280401888 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00f450 con 0x7f4b6415be70 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b5bfff640 1 -- 172.21.15.81:0/2280401888 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b5c00f700 con 0x7f4b6415be70 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b640b4960 con 0x7f4b6415be70 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b5bfff640 1 -- 172.21.15.81:0/2280401888 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c00fb50 con 0x7f4b6415be70 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.793+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b640b4f20 con 0x7f4b6415be70 2024-09-17T05:24:05.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.794+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b64069f80 con 0x7f4b6415be70 2024-09-17T05:24:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.795+0000 7f4b5bfff640 1 -- 172.21.15.81:0/2280401888 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f4b5c00fcf0 con 0x7f4b6415be70 2024-09-17T05:24:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.795+0000 7f4b5bfff640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b44079040 0x7f4b4407b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.795+0000 7f4b5bfff640 1 -- 172.21.15.81:0/2280401888 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(108..108 src has 1..108) ==== 5459+0+0 (secure 0 0 0) 0x7f4b5c09bf60 con 0x7f4b6415be70 2024-09-17T05:24:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.795+0000 7f4b637fe640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b44079040 0x7f4b4407b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.796+0000 7f4b637fe640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b44079040 0x7f4b4407b500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b540058c0 tx=0x7f4b54005f60 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:05.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.799+0000 7f4b5bfff640 1 -- 172.21.15.81:0/2280401888 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4b64069f80 con 0x7f4b6415be70 2024-09-17T05:24:05.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:05.977+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4b640b6240 con 0x7f4b6415be70 2024-09-17T05:24:06.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.675+0000 7f4b5bfff640 1 -- 172.21.15.81:0/2280401888 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v109) ==== 169+0+0 (secure 0 0 0) 0x7f4b5c014030 con 0x7f4b6415be70 2024-09-17T05:24:06.676 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b44079040 msgr2=0x7f4b4407b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b44079040 0x7f4b4407b500 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f4b540058c0 tx=0x7f4b54005f60 comp rx=0 tx=0).stop 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415be70 msgr2=0x7f4b640cae50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415be70 0x7f4b640cae50 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00cd10 tx=0x7f4b5c00a620 comp rx=0 tx=0).stop 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 shutdown_connections 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b6415be70 0x7f4b640cae50 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b44079040 0x7f4b4407b500 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.677+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b640cd710 0x7f4b640ca910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.678+0000 7f4b69a95640 1 --2- 172.21.15.81:0/2280401888 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b640b0590 0x7f4b641f4ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.678+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 >> 172.21.15.81:0/2280401888 conn(0x7f4b64074160 msgr2=0x7f4b640af1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.678+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 shutdown_connections 2024-09-17T05:24:06.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.678+0000 7f4b69a95640 1 -- 172.21.15.81:0/2280401888 wait complete. 2024-09-17T05:24:06.694 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 -- 172.21.15.81:0/1298323349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0d40 msgr2=0x7f76a80b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/1298323349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0d40 0x7f76a80b3800 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f76a808cf10 tx=0x7f76a002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 -- 172.21.15.81:0/1298323349 shutdown_connections 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/1298323349 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a80d0d40 0x7f76a80b3800 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/1298323349 >> v2:172.21.15.160:3300/0 conn(0x7f76a815df90 0x7f76a80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 -- 172.21.15.81:0/1298323349 >> 172.21.15.81:0/1298323349 conn(0x7f76a80d3ea0 msgr2=0x7f76a80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 -- 172.21.15.81:0/1298323349 shutdown_connections 2024-09-17T05:24:06.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.806+0000 7f76ad8b6640 1 -- 172.21.15.81:0/1298323349 wait complete. 2024-09-17T05:24:06.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.808+0000 7f76ad8b6640 1 Processor -- start 2024-09-17T05:24:06.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.808+0000 7f76ad8b6640 1 -- start start 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.808+0000 7f76ad8b6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76a80d0d40 0x7f76a815b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.808+0000 7f76ad8b6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76a80d49c0 0x7f76a81f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76ad8b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a815df90 0x7f76a81f7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76ad8b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f76a8162690 con 0x7f76a815df90 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76ad8b6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f76a80b3d40 con 0x7f76a80d49c0 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76ad8b6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f76a81f4ed0 con 0x7f76a80d0d40 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a815df90 0x7f76a81f7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a815df90 0x7f76a81f7f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48172/0 (socket says 172.21.15.81:48172) 2024-09-17T05:24:06.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 -- 172.21.15.81:0/4130188576 learned_addr learned my addr 172.21.15.81:0/4130188576 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a6ffd640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76a80d0d40 0x7f76a815b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f769e7fc640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76a80d49c0 0x7f76a81f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 -- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76a80d0d40 msgr2=0x7f76a815b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76a80d0d40 0x7f76a815b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 -- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76a80d49c0 msgr2=0x7f76a81f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76a80d49c0 0x7f76a81f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 -- 172.21.15.81:0/4130188576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76a81f8920 con 0x7f76a815df90 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a77fe640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a815df90 0x7f76a81f7f40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009ca0 tx=0x7f76a0031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a4ff9640 1 -- 172.21.15.81:0/4130188576 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0040070 con 0x7f76a815df90 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a4ff9640 1 -- 172.21.15.81:0/4130188576 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f76a0004040 con 0x7f76a815df90 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76a81f8c00 con 0x7f76a815df90 2024-09-17T05:24:06.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76a4ff9640 1 -- 172.21.15.81:0/4130188576 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76a0004470 con 0x7f76a815df90 2024-09-17T05:24:06.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.809+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76a81f58a0 con 0x7f76a815df90 2024-09-17T05:24:06.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.810+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76a81f4950 con 0x7f76a815df90 2024-09-17T05:24:06.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.811+0000 7f76a4ff9640 1 -- 172.21.15.81:0/4130188576 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f76a0039040 con 0x7f76a815df90 2024-09-17T05:24:06.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.811+0000 7f76a4ff9640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7688079010 0x7f768807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:06.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.812+0000 7f76a6ffd640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7688079010 0x7f768807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:06.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.812+0000 7f76a4ff9640 1 -- 172.21.15.81:0/4130188576 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f76a00bc720 con 0x7f76a815df90 2024-09-17T05:24:06.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.812+0000 7f76a6ffd640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7688079010 0x7f768807b4d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f769800a490 tx=0x7f769800a420 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:06.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.816+0000 7f76a4ff9640 1 -- 172.21.15.81:0/4130188576 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f76a0084130 con 0x7f76a815df90 2024-09-17T05:24:06.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.989+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f76a80b4260 con 0x7f76a815df90 2024-09-17T05:24:06.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.992+0000 7f76a4ff9640 1 -- 172.21.15.81:0/4130188576 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v39) ==== 71+0+0 (secure 0 0 0) 0x7f76a0088b60 con 0x7f76a815df90 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7688079010 msgr2=0x7f768807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7688079010 0x7f768807b4d0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f769800a490 tx=0x7f769800a420 comp rx=0 tx=0).stop 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a815df90 msgr2=0x7f76a81f7f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a815df90 0x7f76a81f7f40 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f76a0009ca0 tx=0x7f76a0031720 comp rx=0 tx=0).stop 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 shutdown_connections 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f76a815df90 0x7f76a81f7f40 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7688079010 0x7f768807b4d0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f76a80d49c0 0x7f76a81f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 --2- 172.21.15.81:0/4130188576 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f76a80d0d40 0x7f76a815b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 >> 172.21.15.81:0/4130188576 conn(0x7f76a80d3ea0 msgr2=0x7f76a80b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 shutdown_connections 2024-09-17T05:24:06.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:06.995+0000 7f76ad8b6640 1 -- 172.21.15.81:0/4130188576 wait complete. 2024-09-17T05:24:07.007 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity' 2024-09-17T05:24:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.108+0000 7f6ef4662640 1 -- 172.21.15.81:0/2436167770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 msgr2=0x7f6ed8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.108+0000 7f6ef4662640 1 --2- 172.21.15.81:0/2436167770 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 0x7f6ed8004c80 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x7f6edc001690 tx=0x7f6ed8005830 comp rx=0 tx=0).stop 2024-09-17T05:24:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.108+0000 7f6ef2bff640 1 -- 172.21.15.81:0/2436167770 reap_dead start 2024-09-17T05:24:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.108+0000 7f6ef4662640 1 -- 172.21.15.81:0/2436167770 shutdown_connections 2024-09-17T05:24:07.109 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.108+0000 7f6ef4662640 1 -- 172.21.15.81:0/2436167770 >> 172.21.15.81:0/2436167770 conn(0x7f6eec0b1690 msgr2=0x7f6eec0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.108+0000 7f6ef4662640 1 -- 172.21.15.81:0/2436167770 shutdown_connections 2024-09-17T05:24:07.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.108+0000 7f6ef4662640 1 -- 172.21.15.81:0/2436167770 wait complete. 2024-09-17T05:24:07.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.109+0000 7f6ef4662640 1 Processor -- start 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.109+0000 7f6ef4662640 1 -- start start 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef4662640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 0x7f6eec1e0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef4662640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eec0b07e0 0x7f6eec149040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef4662640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eec1e5ed0 0x7f6eec1e6350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef4662640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec070100 con 0x7f6ed8004800 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef4662640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6eec06eba0 con 0x7f6eec1e5ed0 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef4662640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6eec070280 con 0x7f6eec0b07e0 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 0x7f6eec1e0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 0x7f6eec1e0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48188/0 (socket says 172.21.15.81:48188) 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 -- 172.21.15.81:0/940438429 learned_addr learned my addr 172.21.15.81:0/940438429 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:07.112 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 -- 172.21.15.81:0/940438429 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eec0b07e0 msgr2=0x7f6eec149040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eec0b07e0 0x7f6eec149040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 -- 172.21.15.81:0/940438429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eec1e5ed0 msgr2=0x7f6eec1e6350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eec1e5ed0 0x7f6eec1e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 -- 172.21.15.81:0/940438429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eec149580 con 0x7f6ed8004800 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ef23fe640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 0x7f6eec1e0980 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800b5b0 tx=0x7f6ee800ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.110+0000 7f6ee2ffd640 1 -- 172.21.15.81:0/940438429 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8010a00 con 0x7f6ed8004800 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.111+0000 7f6ee2ffd640 1 -- 172.21.15.81:0/940438429 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6ee8015070 con 0x7f6ed8004800 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.111+0000 7f6ee2ffd640 1 -- 172.21.15.81:0/940438429 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8010e20 con 0x7f6ed8004800 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.111+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eec0cca30 con 0x7f6ed8004800 2024-09-17T05:24:07.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.111+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eec0ccff0 con 0x7f6ed8004800 2024-09-17T05:24:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.111+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eec06f9f0 con 0x7f6ed8004800 2024-09-17T05:24:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.112+0000 7f6ee2ffd640 1 -- 172.21.15.81:0/940438429 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f6ee801a470 con 0x7f6ed8004800 2024-09-17T05:24:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.113+0000 7f6ee2ffd640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ed0079010 0x7f6ed007b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.113+0000 7f6ef1bfd640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ed0079010 0x7f6ed007b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:07.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.113+0000 7f6ee2ffd640 1 -- 172.21.15.81:0/940438429 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f6ee809be30 con 0x7f6ed8004800 2024-09-17T05:24:07.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.113+0000 7f6ef1bfd640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ed0079010 0x7f6ed007b4d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6edc032000 tx=0x7f6edc001120 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:07.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.117+0000 7f6ee2ffd640 1 -- 172.21.15.81:0/940438429 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6eec149580 con 0x7f6ed8004800 2024-09-17T05:24:07.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.362+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]} v 0) -- 0x7f6eec1523c0 con 0x7f6ed8004800 2024-09-17T05:24:07.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.676+0000 7f6ee2ffd640 1 -- 172.21.15.81:0/940438429 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_sanity"]}]=0 v294) ==== 149+0+0 (secure 0 0 0) 0x7f6ee8063e90 con 0x7f6ed8004800 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ed0079010 msgr2=0x7f6ed007b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ed0079010 0x7f6ed007b4d0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6edc032000 tx=0x7f6edc001120 comp rx=0 tx=0).stop 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 msgr2=0x7f6eec1e0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 0x7f6eec1e0980 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800b5b0 tx=0x7f6ee800ba70 comp rx=0 tx=0).stop 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 shutdown_connections 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ed0079010 0x7f6ed007b4d0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6eec1e5ed0 0x7f6eec1e6350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6eec0b07e0 0x7f6eec149040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 --2- 172.21.15.81:0/940438429 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ed8004800 0x7f6eec1e0980 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 >> 172.21.15.81:0/940438429 conn(0x7f6eec0b1690 msgr2=0x7f6eec14f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:07.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 shutdown_connections 2024-09-17T05:24:07.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.679+0000 7f6ef4662640 1 -- 172.21.15.81:0/940438429 wait complete. 2024-09-17T05:24:07.692 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-17T05:24:07.692 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-17T05:24:07.692 INFO:tasks.cephfs_test_runner:test_subvolume_no_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:24:07.692 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 -- 172.21.15.81:0/3593680343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c070690 msgr2=0x7f4f7c0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/3593680343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c070690 0x7f4f7c0739d0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f4f7c0b26e0 tx=0x7f4f7402aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:07.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 -- 172.21.15.81:0/3593680343 shutdown_connections 2024-09-17T05:24:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/3593680343 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c070690 0x7f4f7c0739d0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/3593680343 >> v2:172.21.15.160:3300/0 conn(0x7f4f7c15aa70 0x7f4f7c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 -- 172.21.15.81:0/3593680343 >> 172.21.15.81:0/3593680343 conn(0x7f4f7c0b1690 msgr2=0x7f4f7c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 -- 172.21.15.81:0/3593680343 shutdown_connections 2024-09-17T05:24:07.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.795+0000 7f4f82c7f640 1 -- 172.21.15.81:0/3593680343 wait complete. 2024-09-17T05:24:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.796+0000 7f4f82c7f640 1 Processor -- start 2024-09-17T05:24:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.796+0000 7f4f82c7f640 1 -- start start 2024-09-17T05:24:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f82c7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f7c070690 0x7f4f7c1f8280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f82c7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0735a0 0x7f4f7c15c3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f82c7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f7c15aa70 0x7f4f7c149030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f82c7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0cd270 con 0x7f4f7c0735a0 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f82c7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4f7c0cd0f0 con 0x7f4f7c15aa70 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f82c7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4f7c0cd3f0 con 0x7f4f7c070690 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0735a0 0x7f4f7c15c3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0735a0 0x7f4f7c15c3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48218/0 (socket says 172.21.15.81:48218) 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 -- 172.21.15.81:0/2944648172 learned_addr learned my addr 172.21.15.81:0/2944648172 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 -- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f7c070690 msgr2=0x7f4f7c1f8280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f7c070690 0x7f4f7c1f8280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f8121c640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f7c15aa70 0x7f4f7c149030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 -- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f7c15aa70 msgr2=0x7f4f7c149030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f7c15aa70 0x7f4f7c149030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f7bfff640 1 -- 172.21.15.81:0/2944648172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f7c0cbdc0 con 0x7f4f7c0735a0 2024-09-17T05:24:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.797+0000 7f4f8121c640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f7c15aa70 0x7f4f7c149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.798+0000 7f4f7bfff640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0735a0 0x7f4f7c15c3e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000c410 tx=0x7f4f7000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.798+0000 7f4f797fa640 1 -- 172.21.15.81:0/2944648172 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70017070 con 0x7f4f7c0735a0 2024-09-17T05:24:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.798+0000 7f4f797fa640 1 -- 172.21.15.81:0/2944648172 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4f700035f0 con 0x7f4f7c0735a0 2024-09-17T05:24:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.798+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f7c0cc0a0 con 0x7f4f7c0735a0 2024-09-17T05:24:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.798+0000 7f4f797fa640 1 -- 172.21.15.81:0/2944648172 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f70003a80 con 0x7f4f7c0735a0 2024-09-17T05:24:07.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.798+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f7c1f87c0 con 0x7f4f7c0735a0 2024-09-17T05:24:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.799+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f7c1f7b90 con 0x7f4f7c0735a0 2024-09-17T05:24:07.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.799+0000 7f4f797fa640 1 -- 172.21.15.81:0/2944648172 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f4f7001a070 con 0x7f4f7c0735a0 2024-09-17T05:24:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.800+0000 7f4f797fa640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f68079010 0x7f4f6807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.800+0000 7f4f797fa640 1 -- 172.21.15.81:0/2944648172 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f4f7009a740 con 0x7f4f7c0735a0 2024-09-17T05:24:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.800+0000 7f4f80a1b640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f68079010 0x7f4f6807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:07.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.800+0000 7f4f80a1b640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f68079010 0x7f4f6807b4d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009670 tx=0x7f4f6c006bf0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:07.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.804+0000 7f4f797fa640 1 -- 172.21.15.81:0/2944648172 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4f70062710 con 0x7f4f7c0735a0 2024-09-17T05:24:07.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.981+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4f7c0cd920 con 0x7f4f7c0735a0 2024-09-17T05:24:07.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.981+0000 7f4f797fa640 1 -- 172.21.15.81:0/2944648172 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v109) ==== 74+0+13105 (secure 0 0 0) 0x7f4f700010c0 con 0x7f4f7c0735a0 2024-09-17T05:24:07.983 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:07.983 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":109,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:06.669769+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":102,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6835/1304519501":"2024-09-18T05:24:03.657502+0000","172.21.15.160:6801/1304519501":"2024-09-18T05:24:03.657502+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.983+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f68079010 msgr2=0x7f4f6807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.983+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f68079010 0x7f4f6807b4d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4f6c009670 tx=0x7f4f6c006bf0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.983+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0735a0 msgr2=0x7f4f7c15c3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.983+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0735a0 0x7f4f7c15c3e0 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f4f7000c410 tx=0x7f4f7000c8d0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 shutdown_connections 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4f68079010 0x7f4f6807b4d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4f7c15aa70 0x7f4f7c149030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4f7c0735a0 0x7f4f7c15c3e0 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 --2- 172.21.15.81:0/2944648172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4f7c070690 0x7f4f7c1f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 >> 172.21.15.81:0/2944648172 conn(0x7f4f7c0b1690 msgr2=0x7f4f7c158eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:07.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 shutdown_connections 2024-09-17T05:24:07.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:07.984+0000 7f4f82c7f640 1 -- 172.21.15.81:0/2944648172 wait complete. 2024-09-17T05:24:07.996 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:24:07.997 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:24:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 -- 172.21.15.81:0/4007206666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72781617f0 msgr2=0x7f72780d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 --2- 172.21.15.81:0/4007206666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72781617f0 0x7f72780d1d30 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f7268009830 tx=0x7f726802a470 comp rx=0 tx=0).stop 2024-09-17T05:24:08.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 -- 172.21.15.81:0/4007206666 shutdown_connections 2024-09-17T05:24:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 --2- 172.21.15.81:0/4007206666 >> v2:172.21.15.160:3300/0 conn(0x7f72780d01b0 0x7f72780d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 --2- 172.21.15.81:0/4007206666 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72781617f0 0x7f72780d1d30 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 -- 172.21.15.81:0/4007206666 >> 172.21.15.81:0/4007206666 conn(0x7f72780d3e30 msgr2=0x7f72780d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 -- 172.21.15.81:0/4007206666 shutdown_connections 2024-09-17T05:24:08.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.100+0000 7f727d616640 1 -- 172.21.15.81:0/4007206666 wait complete. 2024-09-17T05:24:08.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.101+0000 7f727d616640 1 Processor -- start 2024-09-17T05:24:08.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.101+0000 7f727d616640 1 -- start start 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f727d616640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72780d01b0 0x7f727815b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f727d616640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72780d27b0 0x7f72780c7920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f727d616640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72781617f0 0x7f72781f4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f727d616640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f72780d0f50 con 0x7f72781617f0 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f727d616640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f72780b5000 con 0x7f72780d01b0 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f727d616640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f72780d10d0 con 0x7f72780d27b0 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72781617f0 0x7f72781f4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72781617f0 0x7f72781f4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48228/0 (socket says 172.21.15.81:48228) 2024-09-17T05:24:08.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 -- 172.21.15.81:0/1403072100 learned_addr learned my addr 172.21.15.81:0/1403072100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f7276ffd640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72780d01b0 0x7f727815b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f726ffff640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72780d27b0 0x7f72780c7920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 -- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72780d27b0 msgr2=0x7f72780c7920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72780d27b0 0x7f72780c7920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 -- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72780d01b0 msgr2=0x7f727815b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72780d01b0 0x7f727815b2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 -- 172.21.15.81:0/1403072100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f727815bec0 con 0x7f72781617f0 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.102+0000 7f72777fe640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72781617f0 0x7f72781f4bc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f727000c7a0 tx=0x7f727000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.103+0000 7f726f7fe640 1 -- 172.21.15.81:0/1403072100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7270003b70 con 0x7f72781617f0 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.103+0000 7f726f7fe640 1 -- 172.21.15.81:0/1403072100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7270003d30 con 0x7f72781617f0 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.103+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72781f5740 con 0x7f72781617f0 2024-09-17T05:24:08.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.103+0000 7f726f7fe640 1 -- 172.21.15.81:0/1403072100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f727000aab0 con 0x7f72781617f0 2024-09-17T05:24:08.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.103+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f727815c180 con 0x7f72781617f0 2024-09-17T05:24:08.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.104+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72780d0840 con 0x7f72781617f0 2024-09-17T05:24:08.107 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.104+0000 7f726f7fe640 1 -- 172.21.15.81:0/1403072100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f727000ac50 con 0x7f72781617f0 2024-09-17T05:24:08.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.105+0000 7f726f7fe640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7258079010 0x7f725807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.105+0000 7f7276ffd640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7258079010 0x7f725807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.105+0000 7f726f7fe640 1 -- 172.21.15.81:0/1403072100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f727009aed0 con 0x7f72781617f0 2024-09-17T05:24:08.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.105+0000 7f7276ffd640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7258079010 0x7f725807b4d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7268034000 tx=0x7f7268004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:08.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.109+0000 7f726f7fe640 1 -- 172.21.15.81:0/1403072100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7270062a10 con 0x7f72781617f0 2024-09-17T05:24:08.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.282+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f72780b3570 con 0x7f72781617f0 2024-09-17T05:24:08.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.283+0000 7f726f7fe640 1 -- 172.21.15.81:0/1403072100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v109) ==== 93+0+10 (secure 0 0 0) 0x7f7270067440 con 0x7f72781617f0 2024-09-17T05:24:08.284 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7258079010 msgr2=0x7f725807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7258079010 0x7f725807b4d0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f7268034000 tx=0x7f7268004730 comp rx=0 tx=0).stop 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72781617f0 msgr2=0x7f72781f4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72781617f0 0x7f72781f4bc0 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f727000c7a0 tx=0x7f727000cc60 comp rx=0 tx=0).stop 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 shutdown_connections 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f72781617f0 0x7f72781f4bc0 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f72780d27b0 0x7f72780c7920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7258079010 0x7f725807b4d0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 --2- 172.21.15.81:0/1403072100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f72780d01b0 0x7f727815b2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 >> 172.21.15.81:0/1403072100 conn(0x7f72780d3e30 msgr2=0x7f72780b12c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:08.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 shutdown_connections 2024-09-17T05:24:08.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.285+0000 7f727d616640 1 -- 172.21.15.81:0/1403072100 wait complete. 2024-09-17T05:24:08.297 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-17T05:24:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 -- 172.21.15.81:0/2583554108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc070690 msgr2=0x7f91fc0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 --2- 172.21.15.81:0/2583554108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc070690 0x7f91fc0739a0 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f91f4005fd0 tx=0x7f91f402aa00 comp rx=0 tx=0).stop 2024-09-17T05:24:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 -- 172.21.15.81:0/2583554108 shutdown_connections 2024-09-17T05:24:08.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 --2- 172.21.15.81:0/2583554108 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc070690 0x7f91fc0739a0 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 --2- 172.21.15.81:0/2583554108 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91fc15aa70 0x7f91fc0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 -- 172.21.15.81:0/2583554108 >> 172.21.15.81:0/2583554108 conn(0x7f91fc0b1690 msgr2=0x7f91fc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:08.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 -- 172.21.15.81:0/2583554108 shutdown_connections 2024-09-17T05:24:08.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.398+0000 7f9202a33640 1 -- 172.21.15.81:0/2583554108 wait complete. 2024-09-17T05:24:08.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.399+0000 7f9202a33640 1 Processor -- start 2024-09-17T05:24:08.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.399+0000 7f9202a33640 1 -- start start 2024-09-17T05:24:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f9202a33640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc070690 0x7f91fc1508d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f9202a33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc0735a0 0x7f91fc06ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f9202a33640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91fc15aa70 0x7f91fc06f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f9202a33640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc0cd270 con 0x7f91fc0735a0 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f9202a33640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc0cd0f0 con 0x7f91fc070690 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f9202a33640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f91fc0cd3f0 con 0x7f91fc15aa70 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc0735a0 0x7f91fc06ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc0735a0 0x7f91fc06ee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48242/0 (socket says 172.21.15.81:48242) 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 -- 172.21.15.81:0/4116351870 learned_addr learned my addr 172.21.15.81:0/4116351870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fbfff640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc070690 0x7f91fc1508d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f9200fd0640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91fc15aa70 0x7f91fc06f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 -- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91fc15aa70 msgr2=0x7f91fc06f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91fc15aa70 0x7f91fc06f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 -- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc070690 msgr2=0x7f91fc1508d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc070690 0x7f91fc1508d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.400+0000 7f91fb7fe640 1 -- 172.21.15.81:0/4116351870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc1f3280 con 0x7f91fc0735a0 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.401+0000 7f91fb7fe640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc0735a0 0x7f91fc06ee70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f91f000c400 tx=0x7f91f000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.401+0000 7f91f8ff9640 1 -- 172.21.15.81:0/4116351870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011790 con 0x7f91fc0735a0 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.401+0000 7f91f8ff9640 1 -- 172.21.15.81:0/4116351870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f91f0017070 con 0x7f91fc0735a0 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.401+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc1f24c0 con 0x7f91fc0735a0 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.401+0000 7f91f8ff9640 1 -- 172.21.15.81:0/4116351870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91f0011d00 con 0x7f91fc0735a0 2024-09-17T05:24:08.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.401+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc1f2a80 con 0x7f91fc0735a0 2024-09-17T05:24:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.402+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc0cd950 con 0x7f91fc0735a0 2024-09-17T05:24:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.403+0000 7f91f8ff9640 1 -- 172.21.15.81:0/4116351870 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f91f001c460 con 0x7f91fc0735a0 2024-09-17T05:24:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.403+0000 7f91f8ff9640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91e8079040 0x7f91e807b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.403+0000 7f91fbfff640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91e8079040 0x7f91e807b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.403+0000 7f91f8ff9640 1 -- 172.21.15.81:0/4116351870 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f91f009b000 con 0x7f91fc0735a0 2024-09-17T05:24:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.403+0000 7f91fbfff640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91e8079040 0x7f91e807b500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004630 tx=0x7f91ec00b2e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.407+0000 7f91f8ff9640 1 -- 172.21.15.81:0/4116351870 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f91f0063100 con 0x7f91fc0735a0 2024-09-17T05:24:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.650+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7f91fc0b2e90 con 0x7f91fc0735a0 2024-09-17T05:24:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.680+0000 7f91f8ff9640 1 -- 172.21.15.81:0/4116351870 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v295) ==== 151+0+0 (secure 0 0 0) 0x7f91f0062a00 con 0x7f91fc0735a0 2024-09-17T05:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91e8079040 msgr2=0x7f91e807b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91e8079040 0x7f91e807b500 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f91ec004630 tx=0x7f91ec00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc0735a0 msgr2=0x7f91fc06ee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc0735a0 0x7f91fc06ee70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f91f000c400 tx=0x7f91f000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 shutdown_connections 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91fc15aa70 0x7f91fc06f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91fc0735a0 0x7f91fc06ee70 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91e8079040 0x7f91e807b500 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 --2- 172.21.15.81:0/4116351870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91fc070690 0x7f91fc1508d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 >> 172.21.15.81:0/4116351870 conn(0x7f91fc0b1690 msgr2=0x7f91fc155010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 shutdown_connections 2024-09-17T05:24:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.683+0000 7f9202a33640 1 -- 172.21.15.81:0/4116351870 wait complete. 2024-09-17T05:24:08.695 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:24:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.795+0000 7f66c635d640 1 -- 172.21.15.81:0/3514680007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 msgr2=0x7f66a8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.795+0000 7f66c635d640 1 --2- 172.21.15.81:0/3514680007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66a8004c80 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7f66b40016c0 tx=0x7f66a8005830 comp rx=0 tx=0).stop 2024-09-17T05:24:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.795+0000 7f66c635d640 1 -- 172.21.15.81:0/3514680007 shutdown_connections 2024-09-17T05:24:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.795+0000 7f66c635d640 1 --2- 172.21.15.81:0/3514680007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66a8004c80 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.795+0000 7f66c635d640 1 -- 172.21.15.81:0/3514680007 >> 172.21.15.81:0/3514680007 conn(0x7f66c00b1690 msgr2=0x7f66c00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.795+0000 7f66c635d640 1 -- 172.21.15.81:0/3514680007 shutdown_connections 2024-09-17T05:24:08.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.795+0000 7f66c635d640 1 -- 172.21.15.81:0/3514680007 wait complete. 2024-09-17T05:24:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.796+0000 7f66c635d640 1 Processor -- start 2024-09-17T05:24:08.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.797+0000 7f66c635d640 1 -- start start 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.797+0000 7f66c635d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66c01593f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.797+0000 7f66c635d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66c014a020 0x7f66c014a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.797+0000 7f66c635d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66c01f80b0 0x7f66c01f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.797+0000 7f66c635d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66c006e5e0 con 0x7f66a8004800 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.797+0000 7f66c635d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f66c00cf4c0 con 0x7f66c014a020 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.797+0000 7f66c635d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f66c006e760 con 0x7f66c01f80b0 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66c01593f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66c01593f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48258/0 (socket says 172.21.15.81:48258) 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 -- 172.21.15.81:0/4268774268 learned_addr learned my addr 172.21.15.81:0/4268774268 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66c48fa640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66c01f80b0 0x7f66c01f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bf7fe640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66c014a020 0x7f66c014a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 -- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66c01f80b0 msgr2=0x7f66c01f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66c01f80b0 0x7f66c01f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 -- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66c014a020 msgr2=0x7f66c014a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66c014a020 0x7f66c014a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 -- 172.21.15.81:0/4268774268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66c01f4820 con 0x7f66a8004800 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bffff640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66c01593f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f66b0011780 tx=0x7f66b0011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bcff9640 1 -- 172.21.15.81:0/4268774268 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b000fd50 con 0x7f66a8004800 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bcff9640 1 -- 172.21.15.81:0/4268774268 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66b0011e90 con 0x7f66a8004800 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66c01f4aa0 con 0x7f66a8004800 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66bcff9640 1 -- 172.21.15.81:0/4268774268 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66b0004290 con 0x7f66a8004800 2024-09-17T05:24:08.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.798+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66c01f5340 con 0x7f66a8004800 2024-09-17T05:24:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.799+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66c0154a40 con 0x7f66a8004800 2024-09-17T05:24:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.800+0000 7f66bcff9640 1 -- 172.21.15.81:0/4268774268 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f66b00035f0 con 0x7f66a8004800 2024-09-17T05:24:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.800+0000 7f66bcff9640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f66ac079010 0x7f66ac07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.800+0000 7f66bcff9640 1 -- 172.21.15.81:0/4268774268 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f66b009c010 con 0x7f66a8004800 2024-09-17T05:24:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.800+0000 7f66bf7fe640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f66ac079010 0x7f66ac07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:08.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.801+0000 7f66bf7fe640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f66ac079010 0x7f66ac07b4d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66b4032000 tx=0x7f66b4001190 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:08.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.805+0000 7f66bcff9640 1 -- 172.21.15.81:0/4268774268 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f66c0154a40 con 0x7f66a8004800 2024-09-17T05:24:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.980+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f66c01f4c70 con 0x7f66a8004800 2024-09-17T05:24:08.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.980+0000 7f66bcff9640 1 -- 172.21.15.81:0/4268774268 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v39) ==== 59+0+1998 (secure 0 0 0) 0x7f66c01f4820 con 0x7f66a8004800 2024-09-17T05:24:08.982 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:24:08.982 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:24:08.982 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:24:08.982 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:24:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:24:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:24:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:24:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:24:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:24:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:24:08.983 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:24:08.984 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:24:08.985 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:24:08.985 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:24:08.985 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:24:08.985 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:24:08.985 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:24:08.985 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:24:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.982+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f66ac079010 msgr2=0x7f66ac07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.982+0000 7f66c635d640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f66ac079010 0x7f66ac07b4d0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f66b4032000 tx=0x7f66b4001190 comp rx=0 tx=0).stop 2024-09-17T05:24:08.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.982+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 msgr2=0x7f66c01593f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.982+0000 7f66c635d640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66c01593f0 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7f66b0011780 tx=0x7f66b0011c40 comp rx=0 tx=0).stop 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 shutdown_connections 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66c01f80b0 0x7f66c01f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f66ac079010 0x7f66ac07b4d0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66c014a020 0x7f66c014a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 --2- 172.21.15.81:0/4268774268 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66a8004800 0x7f66c01593f0 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 >> 172.21.15.81:0/4268774268 conn(0x7f66c00b1690 msgr2=0x7f66c0153800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 shutdown_connections 2024-09-17T05:24:08.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:08.983+0000 7f66c635d640 1 -- 172.21.15.81:0/4268774268 wait complete. 2024-09-17T05:24:08.994 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:24:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 -- 172.21.15.81:0/1200941471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18240cbed0 msgr2=0x7f18240b0380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 --2- 172.21.15.81:0/1200941471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18240cbed0 0x7f18240b0380 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7f18240b1df0 tx=0x7f181c02a530 comp rx=0 tx=0).stop 2024-09-17T05:24:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 -- 172.21.15.81:0/1200941471 shutdown_connections 2024-09-17T05:24:09.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 --2- 172.21.15.81:0/1200941471 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f18240cbed0 0x7f18240b0380 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 --2- 172.21.15.81:0/1200941471 >> v2:172.21.15.160:3300/0 conn(0x7f182415adb0 0x7f18240ccd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 -- 172.21.15.81:0/1200941471 >> 172.21.15.81:0/1200941471 conn(0x7f1824074160 msgr2=0x7f1824074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 -- 172.21.15.81:0/1200941471 shutdown_connections 2024-09-17T05:24:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.098+0000 7f182b9ec640 1 -- 172.21.15.81:0/1200941471 wait complete. 2024-09-17T05:24:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.099+0000 7f182b9ec640 1 Processor -- start 2024-09-17T05:24:09.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.099+0000 7f182b9ec640 1 -- start start 2024-09-17T05:24:09.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f182b9ec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18240cbed0 0x7f18240c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f182b9ec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18240cd260 0x7f18240b5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f182b9ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182415adb0 0x7f18240b5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f182b9ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f18240b0c50 con 0x7f182415adb0 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f182b9ec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f18240b0ad0 con 0x7f18240cd260 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f182b9ec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f18240b0dd0 con 0x7f18240cbed0 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182415adb0 0x7f18240b5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182415adb0 0x7f18240b5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48280/0 (socket says 172.21.15.81:48280) 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 -- 172.21.15.81:0/3433182585 learned_addr learned my addr 172.21.15.81:0/3433182585 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829788640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18240cbed0 0x7f18240c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1828f87640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18240cd260 0x7f18240b5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 -- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18240cbed0 msgr2=0x7f18240c9dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18240cbed0 0x7f18240c9dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 -- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18240cd260 msgr2=0x7f18240b5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18240cd260 0x7f18240b5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1829f89640 1 -- 172.21.15.81:0/3433182585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1824159ac0 con 0x7f182415adb0 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.100+0000 7f1828f87640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18240cd260 0x7f18240b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.101+0000 7f1829f89640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182415adb0 0x7f18240b5890 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f181c009230 tx=0x7f181c003960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.101+0000 7f1819ffb640 1 -- 172.21.15.81:0/3433182585 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c03f070 con 0x7f182415adb0 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.101+0000 7f1819ffb640 1 -- 172.21.15.81:0/3433182585 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f181c0047a0 con 0x7f182415adb0 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.101+0000 7f1819ffb640 1 -- 172.21.15.81:0/3433182585 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f181c035030 con 0x7f182415adb0 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.101+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18241e4340 con 0x7f182415adb0 2024-09-17T05:24:09.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.101+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18241e3580 con 0x7f182415adb0 2024-09-17T05:24:09.105 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.102+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18240b0380 con 0x7f182415adb0 2024-09-17T05:24:09.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.103+0000 7f1819ffb640 1 -- 172.21.15.81:0/3433182585 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f181c042070 con 0x7f182415adb0 2024-09-17T05:24:09.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.103+0000 7f1819ffb640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1808079010 0x7f180807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.103+0000 7f1829788640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1808079010 0x7f180807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.103+0000 7f1819ffb640 1 -- 172.21.15.81:0/3433182585 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f181c0bc120 con 0x7f182415adb0 2024-09-17T05:24:09.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.104+0000 7f1829788640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1808079010 0x7f180807b4d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1820005fd0 tx=0x7f18200095e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:09.108 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.108+0000 7f1819ffb640 1 -- 172.21.15.81:0/3433182585 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1824159ac0 con 0x7f182415adb0 2024-09-17T05:24:09.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.283+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f18240cb410 con 0x7f182415adb0 2024-09-17T05:24:09.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.287+0000 7f1819ffb640 1 -- 172.21.15.81:0/3433182585 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7f181c083aa0 con 0x7f182415adb0 2024-09-17T05:24:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1808079010 msgr2=0x7f180807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1808079010 0x7f180807b4d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f1820005fd0 tx=0x7f18200095e0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182415adb0 msgr2=0x7f18240b5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182415adb0 0x7f18240b5890 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f181c009230 tx=0x7f181c003960 comp rx=0 tx=0).stop 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 shutdown_connections 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f182415adb0 0x7f18240b5890 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1808079010 0x7f180807b4d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f18240cd260 0x7f18240b5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 --2- 172.21.15.81:0/3433182585 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f18240cbed0 0x7f18240c9dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 >> 172.21.15.81:0/3433182585 conn(0x7f1824074160 msgr2=0x7f182406f400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 shutdown_connections 2024-09-17T05:24:09.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.289+0000 7f182b9ec640 1 -- 172.21.15.81:0/3433182585 wait complete. 2024-09-17T05:24:09.301 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:24:09.301 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:09.341 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:09.386 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:24:09.386 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:09.386 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:09.402 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:24:09.402 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:09.402 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:09.420 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:24:09.421 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:09.421 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:09.458 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:24:09.458 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:09.458 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:09.480 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:24:09.480 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:24:09.481 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.597+0000 7f6201a32640 1 -- 172.21.15.81:0/1655649860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 msgr2=0x7f61fc0739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.597+0000 7f6201a32640 1 --2- 172.21.15.81:0/1655649860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0739d0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7f61e4005fd0 tx=0x7f61e402a540 comp rx=0 tx=0).stop 2024-09-17T05:24:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.597+0000 7f6201a32640 1 -- 172.21.15.81:0/1655649860 shutdown_connections 2024-09-17T05:24:09.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.597+0000 7f6201a32640 1 --2- 172.21.15.81:0/1655649860 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0739d0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.597+0000 7f6201a32640 1 -- 172.21.15.81:0/1655649860 >> 172.21.15.81:0/1655649860 conn(0x7f61fc0b1690 msgr2=0x7f61fc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.597+0000 7f6201a32640 1 -- 172.21.15.81:0/1655649860 shutdown_connections 2024-09-17T05:24:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.597+0000 7f6201a32640 1 -- 172.21.15.81:0/1655649860 wait complete. 2024-09-17T05:24:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.598+0000 7f6201a32640 1 Processor -- start 2024-09-17T05:24:09.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.598+0000 7f6201a32640 1 -- start start 2024-09-17T05:24:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f6201a32640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61fc06ff80 0x7f61fc1450b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f6201a32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0cbad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f6201a32640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61fc15aa70 0x7f61fc0c9a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f6201a32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc070780 con 0x7f61fc0735a0 2024-09-17T05:24:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f6201a32640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f61fc070600 con 0x7f61fc06ff80 2024-09-17T05:24:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f6201a32640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f61fc070900 con 0x7f61fc15aa70 2024-09-17T05:24:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0cbad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0cbad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48304/0 (socket says 172.21.15.81:48304) 2024-09-17T05:24:09.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 -- 172.21.15.81:0/229810299 learned_addr learned my addr 172.21.15.81:0/229810299 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:09.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fb7fe640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61fc15aa70 0x7f61fc0c9a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 -- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61fc15aa70 msgr2=0x7f61fc0c9a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61fc15aa70 0x7f61fc0c9a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 -- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61fc06ff80 msgr2=0x7f61fc1450b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61faffd640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61fc06ff80 0x7f61fc1450b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61fc06ff80 0x7f61fc1450b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 -- 172.21.15.81:0/229810299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61fc1f2aa0 con 0x7f61fc0735a0 2024-09-17T05:24:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61fa7fc640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0cbad0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009850 tx=0x7f61e40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61f3fff640 1 -- 172.21.15.81:0/229810299 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e403f070 con 0x7f61fc0735a0 2024-09-17T05:24:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61f3fff640 1 -- 172.21.15.81:0/229810299 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61e4004890 con 0x7f61fc0735a0 2024-09-17T05:24:09.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.599+0000 7f61f3fff640 1 -- 172.21.15.81:0/229810299 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61e4035030 con 0x7f61fc0735a0 2024-09-17T05:24:09.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.600+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61fc1f2d80 con 0x7f61fc0735a0 2024-09-17T05:24:09.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.600+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61fc1f3340 con 0x7f61fc0735a0 2024-09-17T05:24:09.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.600+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61fc0cd8c0 con 0x7f61fc0735a0 2024-09-17T05:24:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.601+0000 7f61f3fff640 1 -- 172.21.15.81:0/229810299 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f61e4042070 con 0x7f61fc0735a0 2024-09-17T05:24:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.602+0000 7f61f3fff640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61dc079010 0x7f61dc07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.602+0000 7f61faffd640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61dc079010 0x7f61dc07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.602+0000 7f61f3fff640 1 -- 172.21.15.81:0/229810299 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f61e40bc2c0 con 0x7f61fc0735a0 2024-09-17T05:24:09.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.602+0000 7f61faffd640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61dc079010 0x7f61dc07b4d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61ec007bf0 tx=0x7f61ec007240 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:09.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.606+0000 7f61f3fff640 1 -- 172.21.15.81:0/229810299 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f61e4084290 con 0x7f61fc0735a0 2024-09-17T05:24:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.819+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f61fc15b160 con 0x7f61fc0735a0 2024-09-17T05:24:09.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.820+0000 7f61f3fff640 1 -- 172.21.15.81:0/229810299 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) ==== 94+0+3917 (secure 0 0 0) 0x7f61e4083b90 con 0x7f61fc0735a0 2024-09-17T05:24:09.821 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:09.821 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":63,"btime":"2024-09-17T05:24:04:659251+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5987,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/1016859110","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":1016859110},{"type":"v1","addr":"172.21.15.160:6834","nonce":1016859110}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56},{"gid":6610,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3819036010","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3819036010},{"type":"v1","addr":"172.21.15.160:6835","nonce":3819036010}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":63},{"gid":6996,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/2510717284","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":2510717284},{"type":"v1","addr":"172.21.15.81:6833","nonce":2510717284}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":55},{"gid":6999,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3071988430","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3071988430},{"type":"v1","addr":"172.21.15.81:6835","nonce":3071988430}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":56}],"filesystems":[]} 2024-09-17T05:24:09.821 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 63 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61dc079010 msgr2=0x7f61dc07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61dc079010 0x7f61dc07b4d0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f61ec007bf0 tx=0x7f61ec007240 comp rx=0 tx=0).stop 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 msgr2=0x7f61fc0cbad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0cbad0 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f61e4009850 tx=0x7f61e40039e0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 shutdown_connections 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61fc15aa70 0x7f61fc0c9a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61fc0735a0 0x7f61fc0cbad0 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61dc079010 0x7f61dc07b4d0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 --2- 172.21.15.81:0/229810299 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61fc06ff80 0x7f61fc1450b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 >> 172.21.15.81:0/229810299 conn(0x7f61fc0b1690 msgr2=0x7f61fc0b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 shutdown_connections 2024-09-17T05:24:09.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:09.822+0000 7f6201a32640 1 -- 172.21.15.81:0/229810299 wait complete. 2024-09-17T05:24:09.834 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:24:09.834 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:24:09.835 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:24:09.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:09.835 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:24:09.835 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:24:09.835 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:24:09.835 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:09.836 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:24:09.836 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:24:09.836 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:24:09.836 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:09.836 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:24:09.836 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:24:09.836 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:24:09.837 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:09.844 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:24:09.844 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:24:09.845 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:24:09.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:24:09.848 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:24:09.848 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:24:09.848 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:24:09.849 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:24:09.889 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:24:09.890 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:09.891 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:24:09.891 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:09.892 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:24:09.892 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:09.893 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:24:09.893 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:09.893 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:24:09.960 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:24:09.964 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:24:09.976 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:24:09.976 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:24:09.977 INFO:tasks.ceph.mds.d.smithi160.stderr:2024-09-17T05:24:09.975+0000 7f5412d38640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6800/0: (98) Address already in use 2024-09-17T05:24:10.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.000+0000 7f68a5b17640 1 -- 172.21.15.81:0/2158936998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688c004d40 msgr2=0x7f688c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.000+0000 7f68a5b17640 1 --2- 172.21.15.81:0/2158936998 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f688c004d40 0x7f688c0051c0 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7f689800c780 tx=0x7f688c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:10.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.000+0000 7f689ffff640 1 -- 172.21.15.81:0/2158936998 reap_dead start 2024-09-17T05:24:10.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.000+0000 7f68a5b17640 1 -- 172.21.15.81:0/2158936998 shutdown_connections 2024-09-17T05:24:10.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.000+0000 7f68a5b17640 1 -- 172.21.15.81:0/2158936998 >> 172.21.15.81:0/2158936998 conn(0x7f68a00d3ea0 msgr2=0x7f68a00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:10.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.000+0000 7f68a5b17640 1 -- 172.21.15.81:0/2158936998 shutdown_connections 2024-09-17T05:24:10.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.000+0000 7f68a5b17640 1 -- 172.21.15.81:0/2158936998 wait complete. 2024-09-17T05:24:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.001+0000 7f68a5b17640 1 Processor -- start 2024-09-17T05:24:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.001+0000 7f68a5b17640 1 -- start start 2024-09-17T05:24:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f68a5b17640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c004d40 0x7f68a01f3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f68a5b17640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68a01535d0 0x7f68a015f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f68a5b17640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a015fae0 0x7f68a015ff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f68a5b17640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00b42a0 con 0x7f68a015fae0 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f68a5b17640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f68a00b4120 con 0x7f688c004d40 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f68a5b17640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f68a00b4420 con 0x7f68a01535d0 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a015fae0 0x7f68a015ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a015fae0 0x7f68a015ff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48370/0 (socket says 172.21.15.81:48370) 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 -- 172.21.15.81:0/3138240617 learned_addr learned my addr 172.21.15.81:0/3138240617 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689f7fe640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c004d40 0x7f68a01f3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f6897fff640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68a01535d0 0x7f68a015f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 -- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68a01535d0 msgr2=0x7f68a015f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68a01535d0 0x7f68a015f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 -- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c004d40 msgr2=0x7f68a01f3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c004d40 0x7f68a01f3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 -- 172.21.15.81:0/3138240617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68a0151010 con 0x7f68a015fae0 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689ffff640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a015fae0 0x7f68a015ff60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f689800c870 tx=0x7f689800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689cff9640 1 -- 172.21.15.81:0/3138240617 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6898004d40 con 0x7f68a015fae0 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689cff9640 1 -- 172.21.15.81:0/3138240617 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f689802b9a0 con 0x7f68a015fae0 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f689cff9640 1 -- 172.21.15.81:0/3138240617 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f689802bdb0 con 0x7f68a015fae0 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.002+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68a01512f0 con 0x7f68a015fae0 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.003+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68a01518b0 con 0x7f68a015fae0 2024-09-17T05:24:10.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.003+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68a00cf9b0 con 0x7f68a015fae0 2024-09-17T05:24:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.004+0000 7f689cff9640 1 -- 172.21.15.81:0/3138240617 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f6898035430 con 0x7f68a015fae0 2024-09-17T05:24:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.005+0000 7f689cff9640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6880079010 0x7f688007b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.005+0000 7f689f7fe640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6880079010 0x7f688007b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.005+0000 7f689cff9640 1 -- 172.21.15.81:0/3138240617 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(109..109 src has 1..109) ==== 4987+0+0 (secure 0 0 0) 0x7f689803b020 con 0x7f68a015fae0 2024-09-17T05:24:10.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.005+0000 7f689f7fe640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6880079010 0x7f688007b4d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6890009cd0 tx=0x7f6890005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:10.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.009+0000 7f689cff9640 1 -- 172.21.15.81:0/3138240617 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f68a00ce970 con 0x7f68a015fae0 2024-09-17T05:24:10.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.197+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f68a00b3a50 con 0x7f68a015fae0 2024-09-17T05:24:10.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.691+0000 7f689cff9640 1 -- 172.21.15.81:0/3138240617 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v111) ==== 97+0+0 (secure 0 0 0) 0x7f6898083000 con 0x7f68a015fae0 2024-09-17T05:24:10.692 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:24:10.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6880079010 msgr2=0x7f688007b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6880079010 0x7f688007b4d0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f6890009cd0 tx=0x7f6890005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a015fae0 msgr2=0x7f68a015ff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a015fae0 0x7f68a015ff60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7f689800c870 tx=0x7f689800c430 comp rx=0 tx=0).stop 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 shutdown_connections 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68a015fae0 0x7f68a015ff60 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68a01535d0 0x7f68a015f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6880079010 0x7f688007b4d0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 --2- 172.21.15.81:0/3138240617 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f688c004d40 0x7f68a01f3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 >> 172.21.15.81:0/3138240617 conn(0x7f68a00d3ea0 msgr2=0x7f68a00d0750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 shutdown_connections 2024-09-17T05:24:10.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.694+0000 7f68a5b17640 1 -- 172.21.15.81:0/3138240617 wait complete. 2024-09-17T05:24:10.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:24:10.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 -- 172.21.15.81:0/1879943801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a80735a0 msgr2=0x7f20a80739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 --2- 172.21.15.81:0/1879943801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a80735a0 0x7f20a80739d0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7f20a80b26e0 tx=0x7f209c02a560 comp rx=0 tx=0).stop 2024-09-17T05:24:10.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 -- 172.21.15.81:0/1879943801 shutdown_connections 2024-09-17T05:24:10.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 --2- 172.21.15.81:0/1879943801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a80735a0 0x7f20a80739d0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 --2- 172.21.15.81:0/1879943801 >> v2:172.21.15.160:3300/0 conn(0x7f20a815aa70 0x7f20a80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 -- 172.21.15.81:0/1879943801 >> 172.21.15.81:0/1879943801 conn(0x7f20a80b1690 msgr2=0x7f20a80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:10.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 -- 172.21.15.81:0/1879943801 shutdown_connections 2024-09-17T05:24:10.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.810+0000 7f20ae62a640 1 -- 172.21.15.81:0/1879943801 wait complete. 2024-09-17T05:24:10.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.811+0000 7f20ae62a640 1 Processor -- start 2024-09-17T05:24:10.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.811+0000 7f20ae62a640 1 -- start start 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20ae62a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a806ff80 0x7f20a8152d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20ae62a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20a80735a0 0x7f20a815c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20ae62a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a815aa70 0x7f20a81f5a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20ae62a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8070780 con 0x7f20a806ff80 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20ae62a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f20a8070600 con 0x7f20a80735a0 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20ae62a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f20a8070900 con 0x7f20a815aa70 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a806ff80 0x7f20a8152d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a806ff80 0x7f20a8152d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48398/0 (socket says 172.21.15.81:48398) 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 -- 172.21.15.81:0/4047332192 learned_addr learned my addr 172.21.15.81:0/4047332192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a77fe640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20a80735a0 0x7f20a815c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20acbc7640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a815aa70 0x7f20a81f5a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 -- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a815aa70 msgr2=0x7f20a81f5a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a815aa70 0x7f20a81f5a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 -- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20a80735a0 msgr2=0x7f20a815c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20a80735a0 0x7f20a815c140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20a7fff640 1 -- 172.21.15.81:0/4047332192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20a81532d0 con 0x7f20a806ff80 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.812+0000 7f20acbc7640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a815aa70 0x7f20a81f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.813+0000 7f20a7fff640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a806ff80 0x7f20a8152d90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f209800b410 tx=0x7f209800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.813+0000 7f20a4ff9640 1 -- 172.21.15.81:0/4047332192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098015020 con 0x7f20a806ff80 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.813+0000 7f20a4ff9640 1 -- 172.21.15.81:0/4047332192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2098011940 con 0x7f20a806ff80 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.813+0000 7f20a4ff9640 1 -- 172.21.15.81:0/4047332192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2098011d90 con 0x7f20a806ff80 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.813+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20a815cb00 con 0x7f20a806ff80 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.813+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20a815d0c0 con 0x7f20a806ff80 2024-09-17T05:24:10.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.814+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f20a80739d0 con 0x7f20a806ff80 2024-09-17T05:24:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.814+0000 7f20a4ff9640 1 -- 172.21.15.81:0/4047332192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f2098018020 con 0x7f20a806ff80 2024-09-17T05:24:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.815+0000 7f20a4ff9640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2094079010 0x7f209407b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.815+0000 7f20a77fe640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2094079010 0x7f209407b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:10.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.815+0000 7f20a4ff9640 1 -- 172.21.15.81:0/4047332192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4901+0+0 (secure 0 0 0) 0x7f209809b230 con 0x7f20a806ff80 2024-09-17T05:24:10.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.815+0000 7f20a77fe640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2094079010 0x7f209407b4d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f209c033000 tx=0x7f209c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:10.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:10.819+0000 7f20a4ff9640 1 -- 172.21.15.81:0/4047332192 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f209801f020 con 0x7f20a806ff80 2024-09-17T05:24:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.063+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f20a8072f10 con 0x7f20a806ff80 2024-09-17T05:24:11.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.063+0000 7f20a4ff9640 1 -- 172.21.15.81:0/4047332192 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) ==== 80+0+5304 (secure 0 0 0) 0x7f20a81532d0 con 0x7f20a806ff80 2024-09-17T05:24:11.064 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:11.064 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.065 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:24:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:24:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:11.066 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.067 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.068 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.069 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.070 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:24:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:24:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.071 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.072 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.073 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.074 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:24:11.075 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:24:11.076 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.077 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:24:11.078 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.079 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:24:11.080 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.081 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:24:11.082 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:24:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:24:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.083 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:24:11.083 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:24:11.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2094079010 msgr2=0x7f209407b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2094079010 0x7f209407b4d0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f209c033000 tx=0x7f209c004730 comp rx=0 tx=0).stop 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a806ff80 msgr2=0x7f20a8152d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a806ff80 0x7f20a8152d90 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f209800b410 tx=0x7f209800b8d0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 shutdown_connections 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f20a815aa70 0x7f20a81f5a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2094079010 0x7f209407b4d0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f20a80735a0 0x7f20a815c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 --2- 172.21.15.81:0/4047332192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f20a806ff80 0x7f20a8152d90 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.065+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 >> 172.21.15.81:0/4047332192 conn(0x7f20a80b1690 msgr2=0x7f20a80ce260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.066+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 shutdown_connections 2024-09-17T05:24:11.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.066+0000 7f20ae62a640 1 -- 172.21.15.81:0/4047332192 wait complete. 2024-09-17T05:24:11.086 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:24:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 -- 172.21.15.81:0/2716358915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 msgr2=0x7f6ba00b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/2716358915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba00b3800 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7f6b98005fd0 tx=0x7f6b9802aa00 comp rx=0 tx=0).stop 2024-09-17T05:24:11.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 -- 172.21.15.81:0/2716358915 shutdown_connections 2024-09-17T05:24:11.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/2716358915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba00b3800 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/2716358915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ba00d0d40 0x7f6ba00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 -- 172.21.15.81:0/2716358915 >> 172.21.15.81:0/2716358915 conn(0x7f6ba00d3ea0 msgr2=0x7f6ba00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:11.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 -- 172.21.15.81:0/2716358915 shutdown_connections 2024-09-17T05:24:11.189 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.187+0000 7f6ba66c6640 1 -- 172.21.15.81:0/2716358915 wait complete. 2024-09-17T05:24:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.188+0000 7f6ba66c6640 1 Processor -- start 2024-09-17T05:24:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.188+0000 7f6ba66c6640 1 -- start start 2024-09-17T05:24:11.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6ba66c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ba00d0d40 0x7f6ba00cdcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6ba66c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba014fe00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6ba66c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ba015df90 0x7f6ba006dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6ba66c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba0162690 con 0x7f6ba00d49c0 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6ba66c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6ba00b3d40 con 0x7f6ba015df90 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6ba66c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6ba014e0e0 con 0x7f6ba00d0d40 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6b9f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba014fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6b9f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba014fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48414/0 (socket says 172.21.15.81:48414) 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6b9f7fe640 1 -- 172.21.15.81:0/308173763 learned_addr learned my addr 172.21.15.81:0/308173763 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6b9ffff640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ba00d0d40 0x7f6ba00cdcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.189+0000 7f6ba4c63640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ba015df90 0x7f6ba006dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9f7fe640 1 -- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ba00d0d40 msgr2=0x7f6ba00cdcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9f7fe640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ba00d0d40 0x7f6ba00cdcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9f7fe640 1 -- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ba015df90 msgr2=0x7f6ba006dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9f7fe640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ba015df90 0x7f6ba006dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9f7fe640 1 -- 172.21.15.81:0/308173763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ba014ddb0 con 0x7f6ba00d49c0 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6ba4c63640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ba015df90 0x7f6ba006dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9f7fe640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba014fe00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400d950 tx=0x7f6b9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9cff9640 1 -- 172.21.15.81:0/308173763 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b94017070 con 0x7f6ba00d49c0 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9cff9640 1 -- 172.21.15.81:0/308173763 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b94009d20 con 0x7f6ba00d49c0 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ba0150690 con 0x7f6ba00d49c0 2024-09-17T05:24:11.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6b9cff9640 1 -- 172.21.15.81:0/308173763 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b940106c0 con 0x7f6ba00d49c0 2024-09-17T05:24:11.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.190+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ba0150c50 con 0x7f6ba00d49c0 2024-09-17T05:24:11.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.191+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ba008d590 con 0x7f6ba00d49c0 2024-09-17T05:24:11.194 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.192+0000 7f6b9cff9640 1 -- 172.21.15.81:0/308173763 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f6b94010860 con 0x7f6ba00d49c0 2024-09-17T05:24:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.192+0000 7f6b9cff9640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b8c079010 0x7f6b8c07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.192+0000 7f6b9cff9640 1 -- 172.21.15.81:0/308173763 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4901+0+0 (secure 0 0 0) 0x7f6b9409b690 con 0x7f6ba00d49c0 2024-09-17T05:24:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.192+0000 7f6b9ffff640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b8c079010 0x7f6b8c07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.192+0000 7f6b9ffff640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b8c079010 0x7f6b8c07b4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0161520 tx=0x7f6b90009060 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:11.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.196+0000 7f6b9cff9640 1 -- 172.21.15.81:0/308173763 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6b94063060 con 0x7f6ba00d49c0 2024-09-17T05:24:11.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.374+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6ba00cf990 con 0x7f6ba00d49c0 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.375+0000 7f6b9cff9640 1 -- 172.21.15.81:0/308173763 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v113) ==== 84+0+65 (secure 0 0 0) 0x7f6b94067a90 con 0x7f6ba00d49c0 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:11.376 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b8c079010 msgr2=0x7f6b8c07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b8c079010 0x7f6b8c07b4d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f6ba0161520 tx=0x7f6b90009060 comp rx=0 tx=0).stop 2024-09-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 msgr2=0x7f6ba014fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba014fe00 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f6b9400d950 tx=0x7f6b9400de10 comp rx=0 tx=0).stop 2024-09-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 shutdown_connections 2024-09-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b8c079010 0x7f6b8c07b4d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6ba015df90 0x7f6ba006dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6ba00d49c0 0x7f6ba014fe00 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 --2- 172.21.15.81:0/308173763 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6ba00d0d40 0x7f6ba00cdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 >> 172.21.15.81:0/308173763 conn(0x7f6ba00d3ea0 msgr2=0x7f6ba00b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 shutdown_connections 2024-09-17T05:24:11.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.377+0000 7f6ba66c6640 1 -- 172.21.15.81:0/308173763 wait complete. 2024-09-17T05:24:11.389 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:24:11.389 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.492+0000 7fae03bc9640 1 -- 172.21.15.81:0/1173640132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 msgr2=0x7fadfc070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.492+0000 7fae03bc9640 1 --2- 172.21.15.81:0/1173640132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc070180 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fadfc0b4da0 tx=0x7fadec02aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.493+0000 7fae03bc9640 1 -- 172.21.15.81:0/1173640132 shutdown_connections 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.493+0000 7fae03bc9640 1 --2- 172.21.15.81:0/1173640132 >> v2:172.21.15.160:3300/0 conn(0x7fadfc0aec50 0x7fadfc072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.493+0000 7fae03bc9640 1 --2- 172.21.15.81:0/1173640132 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc070180 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.493+0000 7fae03bc9640 1 -- 172.21.15.81:0/1173640132 >> 172.21.15.81:0/1173640132 conn(0x7fadfc0b1620 msgr2=0x7fadfc0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.493+0000 7fae03bc9640 1 -- 172.21.15.81:0/1173640132 shutdown_connections 2024-09-17T05:24:11.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.493+0000 7fae03bc9640 1 -- 172.21.15.81:0/1173640132 wait complete. 2024-09-17T05:24:11.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.494+0000 7fae03bc9640 1 Processor -- start 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.494+0000 7fae03bc9640 1 -- start start 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.494+0000 7fae03bc9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadfc0ae690 0x7fadfc1f28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae03bc9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadfc0aec50 0x7fadfc15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae03bc9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc1f55e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae03bc9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc0b35f0 con 0x7fadfc15d610 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae03bc9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fadfc072f50 con 0x7fadfc0aec50 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae03bc9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fadfc1f2e00 con 0x7fadfc0ae690 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc1f55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc1f55e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48440/0 (socket says 172.21.15.81:48440) 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 -- 172.21.15.81:0/698524913 learned_addr learned my addr 172.21.15.81:0/698524913 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae01965640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadfc0ae690 0x7fadfc1f28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae01164640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadfc0aec50 0x7fadfc15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 -- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadfc0ae690 msgr2=0x7fadfc1f28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadfc0ae690 0x7fadfc1f28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 -- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadfc0aec50 msgr2=0x7fadfc15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadfc0aec50 0x7fadfc15a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 -- 172.21.15.81:0/698524913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadfc15aee0 con 0x7fadfc15d610 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae02166640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc1f55e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c410 tx=0x7fadf400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fadfa7fc640 1 -- 172.21.15.81:0/698524913 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4011790 con 0x7fadfc15d610 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fadfa7fc640 1 -- 172.21.15.81:0/698524913 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fadf4017070 con 0x7fadfc15d610 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fadfa7fc640 1 -- 172.21.15.81:0/698524913 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadf4011d00 con 0x7fadfc15d610 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadfc14ee10 con 0x7fadfc15d610 2024-09-17T05:24:11.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.495+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadfc14f3d0 con 0x7fadfc15d610 2024-09-17T05:24:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.496+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadfc072a10 con 0x7fadfc15d610 2024-09-17T05:24:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.497+0000 7fadfa7fc640 1 -- 172.21.15.81:0/698524913 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fadf401c460 con 0x7fadfc15d610 2024-09-17T05:24:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.497+0000 7fadfa7fc640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fade8079010 0x7fade807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.498+0000 7fadfa7fc640 1 -- 172.21.15.81:0/698524913 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(113..113 src has 1..113) ==== 4901+0+0 (secure 0 0 0) 0x7fadf409af10 con 0x7fadfc15d610 2024-09-17T05:24:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.498+0000 7fae01965640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fade8079010 0x7fade807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.498+0000 7fae01965640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fade8079010 0x7fade807b4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fadec035000 tx=0x7fadec004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:11.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.502+0000 7fadfa7fc640 1 -- 172.21.15.81:0/698524913 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fadf4021020 con 0x7fadfc15d610 2024-09-17T05:24:11.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.677+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fadfc0b2ab0 con 0x7fadfc15d610 2024-09-17T05:24:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.700+0000 7fadfa7fc640 1 -- 172.21.15.81:0/698524913 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v114) ==== 138+0+0 (secure 0 0 0) 0x7fadf4062f30 con 0x7fadfc15d610 2024-09-17T05:24:11.701 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.702+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fade8079010 msgr2=0x7fade807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.702+0000 7fae03bc9640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fade8079010 0x7fade807b4d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fadec035000 tx=0x7fadec004ab0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.702+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 msgr2=0x7fadfc1f55e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.702+0000 7fae03bc9640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc1f55e0 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fadf400c410 tx=0x7fadf400c8d0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 shutdown_connections 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fadfc15d610 0x7fadfc1f55e0 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fade8079010 0x7fade807b4d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fadfc0aec50 0x7fadfc15a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 --2- 172.21.15.81:0/698524913 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fadfc0ae690 0x7fadfc1f28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 >> 172.21.15.81:0/698524913 conn(0x7fadfc0b1620 msgr2=0x7fadfc0b3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:11.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 shutdown_connections 2024-09-17T05:24:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.703+0000 7fae03bc9640 1 -- 172.21.15.81:0/698524913 wait complete. 2024-09-17T05:24:11.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:24:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 -- 172.21.15.81:0/1284172228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 msgr2=0x7f83ac0cc990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/1284172228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac0cc990 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7f83a4005fd0 tx=0x7f83a402a530 comp rx=0 tx=0).stop 2024-09-17T05:24:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 -- 172.21.15.81:0/1284172228 shutdown_connections 2024-09-17T05:24:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/1284172228 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac0cc990 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/1284172228 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83ac072f20 0x7f83ac152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 -- 172.21.15.81:0/1284172228 >> 172.21.15.81:0/1284172228 conn(0x7f83ac0b1700 msgr2=0x7f83ac0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:11.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 -- 172.21.15.81:0/1284172228 shutdown_connections 2024-09-17T05:24:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.825+0000 7f83b1fc6640 1 -- 172.21.15.81:0/1284172228 wait complete. 2024-09-17T05:24:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.826+0000 7f83b1fc6640 1 Processor -- start 2024-09-17T05:24:11.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.826+0000 7f83b1fc6640 1 -- start start 2024-09-17T05:24:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83b1fc6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83ac072f20 0x7f83ac151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83b1fc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac158470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83b1fc6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83ac152710 0x7f83ac0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83b1fc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac06fd70 con 0x7f83ac0cc500 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83b1fc6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f83ac06fbf0 con 0x7f83ac152710 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83b1fc6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f83ac06fef0 con 0x7f83ac072f20 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac158470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac158470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48458/0 (socket says 172.21.15.81:48458) 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 -- 172.21.15.81:0/2030054799 learned_addr learned my addr 172.21.15.81:0/2030054799 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83abfff640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83ac152710 0x7f83ac0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83ab7fe640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83ac072f20 0x7f83ac151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.830 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 -- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83ac072f20 msgr2=0x7f83ac151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83ac072f20 0x7f83ac151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 -- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83ac152710 msgr2=0x7f83ac0c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83ac152710 0x7f83ac0c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 -- 172.21.15.81:0/2030054799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83ac0c4200 con 0x7f83ac0cc500 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f83aaffd640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac158470 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c9a0 tx=0x7f83a000ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.827+0000 7f8393fff640 1 -- 172.21.15.81:0/2030054799 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0007bb0 con 0x7f83ac0cc500 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.828+0000 7f8393fff640 1 -- 172.21.15.81:0/2030054799 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a0005020 con 0x7f83ac0cc500 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.828+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83ac0c44e0 con 0x7f83ac0cc500 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.828+0000 7f8393fff640 1 -- 172.21.15.81:0/2030054799 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a0007e60 con 0x7f83ac0cc500 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.828+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83ac0c4aa0 con 0x7f83ac0cc500 2024-09-17T05:24:11.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.828+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83ac06a100 con 0x7f83ac0cc500 2024-09-17T05:24:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.829+0000 7f8393fff640 1 -- 172.21.15.81:0/2030054799 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f83a0005470 con 0x7f83ac0cc500 2024-09-17T05:24:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.830+0000 7f8393fff640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8398079040 0x7f839807b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.830+0000 7f8393fff640 1 -- 172.21.15.81:0/2030054799 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(114..114 src has 1..114) ==== 5271+0+0 (secure 0 0 0) 0x7f83a009b820 con 0x7f83ac0cc500 2024-09-17T05:24:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.830+0000 7f83ab7fe640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8398079040 0x7f839807b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:11.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.830+0000 7f83ab7fe640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8398079040 0x7f839807b500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f839c005660 tx=0x7f839c003d90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:11.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:11.834+0000 7f8393fff640 1 -- 172.21.15.81:0/2030054799 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f83ac06a100 con 0x7f83ac0cc500 2024-09-17T05:24:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.009+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f83ac152af0 con 0x7f83ac0cc500 2024-09-17T05:24:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.704+0000 7f8393fff640 1 -- 172.21.15.81:0/2030054799 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v115) ==== 170+0+0 (secure 0 0 0) 0x7f83a0014030 con 0x7f83ac0cc500 2024-09-17T05:24:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:24:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8398079040 msgr2=0x7f839807b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8398079040 0x7f839807b500 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f839c005660 tx=0x7f839c003d90 comp rx=0 tx=0).stop 2024-09-17T05:24:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 msgr2=0x7f83ac158470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac158470 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7f83a000c9a0 tx=0x7f83a000ce60 comp rx=0 tx=0).stop 2024-09-17T05:24:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 shutdown_connections 2024-09-17T05:24:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8398079040 0x7f839807b500 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83ac152710 0x7f83ac0c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83ac0cc500 0x7f83ac158470 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 --2- 172.21.15.81:0/2030054799 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83ac072f20 0x7f83ac151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.708+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 >> 172.21.15.81:0/2030054799 conn(0x7f83ac0b1700 msgr2=0x7f83ac0ce000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.709+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 shutdown_connections 2024-09-17T05:24:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.709+0000 7f83b1fc6640 1 -- 172.21.15.81:0/2030054799 wait complete. 2024-09-17T05:24:12.733 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:24:12.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.841+0000 7f9cb873d640 1 -- 172.21.15.81:0/1964209842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb0159d00 msgr2=0x7f9cb015a1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.841+0000 7f9cb873d640 1 --2- 172.21.15.81:0/1964209842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb0159d00 0x7f9cb015a1b0 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f9ca0005fd0 tx=0x7f9ca002bbc0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.841+0000 7f9cb873d640 1 -- 172.21.15.81:0/1964209842 shutdown_connections 2024-09-17T05:24:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.841+0000 7f9cb873d640 1 --2- 172.21.15.81:0/1964209842 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb0159d00 0x7f9cb015a1b0 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.841+0000 7f9cb873d640 1 -- 172.21.15.81:0/1964209842 >> 172.21.15.81:0/1964209842 conn(0x7f9cb00b1700 msgr2=0x7f9cb00b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.841+0000 7f9cb873d640 1 -- 172.21.15.81:0/1964209842 shutdown_connections 2024-09-17T05:24:12.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.842+0000 7f9cb873d640 1 -- 172.21.15.81:0/1964209842 wait complete. 2024-09-17T05:24:12.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 Processor -- start 2024-09-17T05:24:12.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 -- start start 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cb0159d00 0x7f9cb00b3db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9cb015e0d0 0x7f9cb01f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb015e4b0 0x7f9cb01f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00cc940 con 0x7f9cb015e4b0 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9cb00cc7c0 con 0x7f9cb0159d00 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb873d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9cb00ccac0 con 0x7f9cb015e0d0 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.843+0000 7f9cb6cda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb015e4b0 0x7f9cb01f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:12.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb015e4b0 0x7f9cb01f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48476/0 (socket says 172.21.15.81:48476) 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 -- 172.21.15.81:0/2649625582 learned_addr learned my addr 172.21.15.81:0/2649625582 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb64d9640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cb0159d00 0x7f9cb00b3db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb5cd8640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9cb015e0d0 0x7f9cb01f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 -- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9cb015e0d0 msgr2=0x7f9cb01f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9cb015e0d0 0x7f9cb01f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 -- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cb0159d00 msgr2=0x7f9cb00b3db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cb0159d00 0x7f9cb00b3db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 -- 172.21.15.81:0/2649625582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9cb00c8980 con 0x7f9cb015e4b0 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb64d9640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cb0159d00 0x7f9cb00b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb5cd8640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9cb015e0d0 0x7f9cb01f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb6cda640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb015e4b0 0x7f9cb01f44a0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000ade0 tx=0x7f9ca002d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9caeffd640 1 -- 172.21.15.81:0/2649625582 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0042020 con 0x7f9cb015e4b0 2024-09-17T05:24:12.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9caeffd640 1 -- 172.21.15.81:0/2649625582 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ca0004250 con 0x7f9cb015e4b0 2024-09-17T05:24:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9cb00c6f80 con 0x7f9cb015e4b0 2024-09-17T05:24:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9caeffd640 1 -- 172.21.15.81:0/2649625582 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ca0004680 con 0x7f9cb015e4b0 2024-09-17T05:24:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.844+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9cb01f4d40 con 0x7f9cb015e4b0 2024-09-17T05:24:12.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.845+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9cb006fcd0 con 0x7f9cb015e4b0 2024-09-17T05:24:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.846+0000 7f9caeffd640 1 -- 172.21.15.81:0/2649625582 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f9ca0045020 con 0x7f9cb015e4b0 2024-09-17T05:24:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.847+0000 7f9caeffd640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c9c079010 0x7f9c9c07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:12.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.847+0000 7f9caeffd640 1 -- 172.21.15.81:0/2649625582 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(115..115 src has 1..115) ==== 5653+0+0 (secure 0 0 0) 0x7f9ca00be4f0 con 0x7f9cb015e4b0 2024-09-17T05:24:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.847+0000 7f9cb64d9640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c9c079010 0x7f9c9c07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:12.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.847+0000 7f9cb64d9640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c9c079010 0x7f9c9c07b4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8007fd0 tx=0x7f9ca8009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:12.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:12.850+0000 7f9caeffd640 1 -- 172.21.15.81:0/2649625582 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9cb006fcd0 con 0x7f9cb015e4b0 2024-09-17T05:24:13.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.062+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f9cb015a1b0 con 0x7f9cb015e4b0 2024-09-17T05:24:13.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.715+0000 7f9caeffd640 1 -- 172.21.15.81:0/2649625582 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v66) ==== 174+0+0 (secure 0 0 0) 0x7f9ca004c070 con 0x7f9cb015e4b0 2024-09-17T05:24:13.716 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 18 and data pool 19 2024-09-17T05:24:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.719+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c9c079010 msgr2=0x7f9c9c07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.719+0000 7f9cb873d640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c9c079010 0x7f9c9c07b4d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f9ca8007fd0 tx=0x7f9ca8009040 comp rx=0 tx=0).stop 2024-09-17T05:24:13.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.719+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb015e4b0 msgr2=0x7f9cb01f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:13.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.719+0000 7f9cb873d640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb015e4b0 0x7f9cb01f44a0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f9ca000ade0 tx=0x7f9ca002d9d0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 shutdown_connections 2024-09-17T05:24:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9cb015e4b0 0x7f9cb01f44a0 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9cb015e0d0 0x7f9cb01f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c9c079010 0x7f9c9c07b4d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 --2- 172.21.15.81:0/2649625582 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9cb0159d00 0x7f9cb00b3db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 >> 172.21.15.81:0/2649625582 conn(0x7f9cb00b1700 msgr2=0x7f9cb0075820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 shutdown_connections 2024-09-17T05:24:13.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.722+0000 7f9cb873d640 1 -- 172.21.15.81:0/2649625582 wait complete. 2024-09-17T05:24:13.738 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:13.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/1618795341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40cf640 msgr2=0x7fe2c40725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/1618795341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40cf640 0x7fe2c40725a0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40b22c0 tx=0x7fe2ac02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/1618795341 shutdown_connections 2024-09-17T05:24:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/1618795341 >> v2:172.21.15.160:3300/0 conn(0x7fe2c40b3140 0x7fe2c4072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/1618795341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40cf640 0x7fe2c40725a0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/1618795341 >> 172.21.15.81:0/1618795341 conn(0x7fe2c40b1690 msgr2=0x7fe2c40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/1618795341 shutdown_connections 2024-09-17T05:24:13.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.839+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/1618795341 wait complete. 2024-09-17T05:24:13.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.840+0000 7fe2c8ee2640 1 Processor -- start 2024-09-17T05:24:13.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c8ee2640 1 -- start start 2024-09-17T05:24:13.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c8ee2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40b3140 0x7fe2c414fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:13.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c8ee2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40cf640 0x7fe2c4150390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c8ee2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c4151370 0x7fe2c4159180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c8ee2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c406ffd0 con 0x7fe2c40b3140 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c8ee2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c406fe50 con 0x7fe2c40cf640 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c8ee2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c4070150 con 0x7fe2c4151370 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40b3140 0x7fe2c414fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40b3140 0x7fe2c414fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49516/0 (socket says 172.21.15.81:49516) 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c259c640 1 -- 172.21.15.81:0/3587353719 learned_addr learned my addr 172.21.15.81:0/3587353719 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c2d9d640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c4151370 0x7fe2c4159180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.841+0000 7fe2c1d9b640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40cf640 0x7fe2c4150390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c259c640 1 -- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c4151370 msgr2=0x7fe2c4159180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c259c640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c4151370 0x7fe2c4159180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c259c640 1 -- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40cf640 msgr2=0x7fe2c4150390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c259c640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40cf640 0x7fe2c4150390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c259c640 1 -- 172.21.15.81:0/3587353719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c414e960 con 0x7fe2c40b3140 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c2d9d640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c4151370 0x7fe2c4159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c1d9b640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40cf640 0x7fe2c4150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c259c640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40b3140 0x7fe2c414fe50 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c760 tx=0x7fe2b400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2baffd640 1 -- 172.21.15.81:0/3587353719 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4003b70 con 0x7fe2c40b3140 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2baffd640 1 -- 172.21.15.81:0/3587353719 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2b4003d30 con 0x7fe2c40b3140 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2baffd640 1 -- 172.21.15.81:0/3587353719 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b400aab0 con 0x7fe2c40b3140 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c414ec40 con 0x7fe2c40b3140 2024-09-17T05:24:13.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.842+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c414f200 con 0x7fe2c40b3140 2024-09-17T05:24:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.843+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c4070670 con 0x7fe2c40b3140 2024-09-17T05:24:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.843+0000 7fe2baffd640 1 -- 172.21.15.81:0/3587353719 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fe2b400ac50 con 0x7fe2c40b3140 2024-09-17T05:24:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.844+0000 7fe2baffd640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079010 0x7fe2a407b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:13.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.844+0000 7fe2c1d9b640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079010 0x7fe2a407b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.844+0000 7fe2baffd640 1 -- 172.21.15.81:0/3587353719 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5753+0+0 (secure 0 0 0) 0x7fe2b409b2d0 con 0x7fe2c40b3140 2024-09-17T05:24:13.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.845+0000 7fe2c1d9b640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079010 0x7fe2a407b4d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac033000 tx=0x7fe2ac004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:13.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:13.849+0000 7fe2baffd640 1 -- 172.21.15.81:0/3587353719 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe2b4063160 con 0x7fe2c40b3140 2024-09-17T05:24:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.025+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2c40b0bf0 con 0x7fe2c40b3140 2024-09-17T05:24:14.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.026+0000 7fe2baffd640 1 -- 172.21.15.81:0/3587353719 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16819 (secure 0 0 0) 0x7fe2b4062a60 con 0x7fe2c40b3140 2024-09-17T05:24:14.029 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:14.029 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":116,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:13.064364+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:11.682378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:12.014580+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079010 msgr2=0x7fe2a407b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079010 0x7fe2a407b4d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fe2ac033000 tx=0x7fe2ac004730 comp rx=0 tx=0).stop 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40b3140 msgr2=0x7fe2c414fe50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40b3140 0x7fe2c414fe50 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400c760 tx=0x7fe2b400cc20 comp rx=0 tx=0).stop 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 shutdown_connections 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c4151370 0x7fe2c4159180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079010 0x7fe2a407b4d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40cf640 0x7fe2c4150390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 --2- 172.21.15.81:0/3587353719 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2c40b3140 0x7fe2c414fe50 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 >> 172.21.15.81:0/3587353719 conn(0x7fe2c40b1690 msgr2=0x7fe2c4142510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:14.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 shutdown_connections 2024-09-17T05:24:14.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.028+0000 7fe2c8ee2640 1 -- 172.21.15.81:0/3587353719 wait complete. 2024-09-17T05:24:14.041 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.142+0000 7fbe852b8640 1 -- 172.21.15.81:0/2676420324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c004800 msgr2=0x7fbe6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.142+0000 7fbe852b8640 1 --2- 172.21.15.81:0/2676420324 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe6c004800 0x7fbe6c004c80 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7fbe6800c2e0 tx=0x7fbe6c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.142+0000 7fbe7f7fe640 1 -- 172.21.15.81:0/2676420324 reap_dead start 2024-09-17T05:24:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.142+0000 7fbe852b8640 1 -- 172.21.15.81:0/2676420324 shutdown_connections 2024-09-17T05:24:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.142+0000 7fbe852b8640 1 -- 172.21.15.81:0/2676420324 >> 172.21.15.81:0/2676420324 conn(0x7fbe80074cb0 msgr2=0x7fbe8009b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:14.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.142+0000 7fbe852b8640 1 -- 172.21.15.81:0/2676420324 shutdown_connections 2024-09-17T05:24:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.142+0000 7fbe852b8640 1 -- 172.21.15.81:0/2676420324 wait complete. 2024-09-17T05:24:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.143+0000 7fbe852b8640 1 Processor -- start 2024-09-17T05:24:14.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.143+0000 7fbe852b8640 1 -- start start 2024-09-17T05:24:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe852b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe6c004800 0x7fbe800ca430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe852b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe801f2c10 0x7fbe8014e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe852b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800cae80 0x7fbe800cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe852b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800ccaa0 con 0x7fbe801f2c10 2024-09-17T05:24:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe852b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe800cc920 con 0x7fbe800cae80 2024-09-17T05:24:14.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe852b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbe800cdac0 con 0x7fbe6c004800 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe801f2c10 0x7fbe8014e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe801f2c10 0x7fbe8014e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49534/0 (socket says 172.21.15.81:49534) 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/4099814651 learned_addr learned my addr 172.21.15.81:0/4099814651 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7effd640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe6c004800 0x7fbe800ca430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7f7fe640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800cae80 0x7fbe800cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe6c004800 msgr2=0x7fbe800ca430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe6c004800 0x7fbe800ca430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800cae80 msgr2=0x7fbe800cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800cae80 0x7fbe800cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/4099814651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe8014e8e0 con 0x7fbe801f2c10 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7f7fe640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800cae80 0x7fbe800cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.144+0000 7fbe7e7fc640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe801f2c10 0x7fbe8014e3a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fbe68000f60 tx=0x7fbe68006ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.145+0000 7fbe777fe640 1 -- 172.21.15.81:0/4099814651 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68031070 con 0x7fbe801f2c10 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.145+0000 7fbe777fe640 1 -- 172.21.15.81:0/4099814651 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe680065e0 con 0x7fbe801f2c10 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.145+0000 7fbe777fe640 1 -- 172.21.15.81:0/4099814651 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe68003a40 con 0x7fbe801f2c10 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.145+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe800c9390 con 0x7fbe801f2c10 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.145+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe800c9950 con 0x7fbe801f2c10 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.146+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe800d2170 con 0x7fbe801f2c10 2024-09-17T05:24:14.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.146+0000 7fbe777fe640 1 -- 172.21.15.81:0/4099814651 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fbe68034070 con 0x7fbe801f2c10 2024-09-17T05:24:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.147+0000 7fbe777fe640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe60079040 0x7fbe6007b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.147+0000 7fbe7effd640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe60079040 0x7fbe6007b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.147+0000 7fbe777fe640 1 -- 172.21.15.81:0/4099814651 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5753+0+0 (secure 0 0 0) 0x7fbe680bb610 con 0x7fbe801f2c10 2024-09-17T05:24:14.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.147+0000 7fbe7effd640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe60079040 0x7fbe6007b500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe70006fd0 tx=0x7fbe70003d60 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:14.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.151+0000 7fbe777fe640 1 -- 172.21.15.81:0/4099814651 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbe8014e8e0 con 0x7fbe801f2c10 2024-09-17T05:24:14.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.329+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fbe800cf130 con 0x7fbe801f2c10 2024-09-17T05:24:14.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.330+0000 7fbe777fe640 1 -- 172.21.15.81:0/4099814651 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v116) ==== 74+0+16819 (secure 0 0 0) 0x7fbe680833e0 con 0x7fbe801f2c10 2024-09-17T05:24:14.332 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:14.332 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":116,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:13.064364+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:11.682378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:12.014580+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe60079040 msgr2=0x7fbe6007b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe60079040 0x7fbe6007b500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fbe70006fd0 tx=0x7fbe70003d60 comp rx=0 tx=0).stop 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe801f2c10 msgr2=0x7fbe8014e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe801f2c10 0x7fbe8014e3a0 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7fbe68000f60 tx=0x7fbe68006ce0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 shutdown_connections 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe60079040 0x7fbe6007b500 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe800cae80 0x7fbe800cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe801f2c10 0x7fbe8014e3a0 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 --2- 172.21.15.81:0/4099814651 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe6c004800 0x7fbe800ca430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 >> 172.21.15.81:0/4099814651 conn(0x7fbe80074cb0 msgr2=0x7fbe800aeb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.332+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 shutdown_connections 2024-09-17T05:24:14.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.333+0000 7fbe852b8640 1 -- 172.21.15.81:0/4099814651 wait complete. 2024-09-17T05:24:14.345 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:24:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.448+0000 7f0daf647640 1 -- 172.21.15.81:0/1768897048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d94004b40 msgr2=0x7f0d94004f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.448+0000 7f0daf647640 1 --2- 172.21.15.81:0/1768897048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d94004b40 0x7f0d94004f60 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7f0da4001630 tx=0x7f0d94006940 comp rx=0 tx=0).stop 2024-09-17T05:24:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.448+0000 7f0dadbe4640 1 -- 172.21.15.81:0/1768897048 reap_dead start 2024-09-17T05:24:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.448+0000 7f0daf647640 1 -- 172.21.15.81:0/1768897048 shutdown_connections 2024-09-17T05:24:14.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.448+0000 7f0daf647640 1 -- 172.21.15.81:0/1768897048 >> 172.21.15.81:0/1768897048 conn(0x7f0da80b1700 msgr2=0x7f0da80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.448+0000 7f0daf647640 1 -- 172.21.15.81:0/1768897048 shutdown_connections 2024-09-17T05:24:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.448+0000 7f0daf647640 1 -- 172.21.15.81:0/1768897048 wait complete. 2024-09-17T05:24:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.449+0000 7f0daf647640 1 Processor -- start 2024-09-17T05:24:14.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.449+0000 7f0daf647640 1 -- start start 2024-09-17T05:24:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0daf647640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d94004b40 0x7f0da80c29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0daf647640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0da80c6160 0x7f0da80b4c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0daf647640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da80c65e0 0x7f0da80b5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0daf647640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0da80cdda0 con 0x7f0da80c65e0 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0daf647640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0da80cdc20 con 0x7f0d94004b40 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0daf647640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0da80cc5b0 con 0x7f0da80c6160 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da80c65e0 0x7f0da80b5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da80c65e0 0x7f0da80b5150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49554/0 (socket says 172.21.15.81:49554) 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 -- 172.21.15.81:0/752158778 learned_addr learned my addr 172.21.15.81:0/752158778 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dacbe2640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0da80c6160 0x7f0da80b4c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dad3e3640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d94004b40 0x7f0da80c29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 -- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0da80c6160 msgr2=0x7f0da80b4c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0da80c6160 0x7f0da80b4c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 -- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d94004b40 msgr2=0x7f0da80c29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d94004b40 0x7f0da80c29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 -- 172.21.15.81:0/752158778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0da81f2ca0 con 0x7f0da80c65e0 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dad3e3640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d94004b40 0x7f0da80c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dacbe2640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0da80c6160 0x7f0da80b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0dadbe4640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da80c65e0 0x7f0da80b5150 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0da00020c0 tx=0x7f0da000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.450+0000 7f0d9dffb640 1 -- 172.21.15.81:0/752158778 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da0015070 con 0x7f0da80c65e0 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.451+0000 7f0d9dffb640 1 -- 172.21.15.81:0/752158778 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0da000ccb0 con 0x7f0da80c65e0 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.451+0000 7f0d9dffb640 1 -- 172.21.15.81:0/752158778 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0da000cea0 con 0x7f0da80c65e0 2024-09-17T05:24:14.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.451+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0da81f2f80 con 0x7f0da80c65e0 2024-09-17T05:24:14.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.451+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0da81f3540 con 0x7f0da80c65e0 2024-09-17T05:24:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.452+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0da80ccb10 con 0x7f0da80c65e0 2024-09-17T05:24:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.452+0000 7f0d9dffb640 1 -- 172.21.15.81:0/752158778 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f0da0018070 con 0x7f0da80c65e0 2024-09-17T05:24:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.453+0000 7f0d9dffb640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d8c079040 0x7f0d8c07b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.453+0000 7f0d9dffb640 1 -- 172.21.15.81:0/752158778 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(116..116 src has 1..116) ==== 5753+0+0 (secure 0 0 0) 0x7f0da009bb70 con 0x7f0da80c65e0 2024-09-17T05:24:14.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.453+0000 7f0dad3e3640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d8c079040 0x7f0d8c07b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.453+0000 7f0dad3e3640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d8c079040 0x7f0d8c07b500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0da4032000 tx=0x7f0da4001190 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:14.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.457+0000 7f0d9dffb640 1 -- 172.21.15.81:0/752158778 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0da00638d0 con 0x7f0da80c65e0 2024-09-17T05:24:14.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.670+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f0da80b14e0 con 0x7f0da80c65e0 2024-09-17T05:24:14.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.716+0000 7f0d9dffb640 1 -- 172.21.15.81:0/752158778 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v67) ==== 118+0+0 (secure 0 0 0) 0x7f0da00631d0 con 0x7f0da80c65e0 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d8c079040 msgr2=0x7f0d8c07b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d8c079040 0x7f0d8c07b500 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0da4032000 tx=0x7f0da4001190 comp rx=0 tx=0).stop 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da80c65e0 msgr2=0x7f0da80b5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da80c65e0 0x7f0da80b5150 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f0da00020c0 tx=0x7f0da000edb0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 shutdown_connections 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0da80c65e0 0x7f0da80b5150 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0da80c6160 0x7f0da80b4c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d8c079040 0x7f0d8c07b500 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 --2- 172.21.15.81:0/752158778 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d94004b40 0x7f0da80c29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.718+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 >> 172.21.15.81:0/752158778 conn(0x7f0da80b1700 msgr2=0x7f0da80afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.719+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 shutdown_connections 2024-09-17T05:24:14.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.719+0000 7f0daf647640 1 -- 172.21.15.81:0/752158778 wait complete. 2024-09-17T05:24:14.730 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:24:14.730 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:24:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.835+0000 7fd274085640 1 -- 172.21.15.81:0/1001907772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd254004d90 msgr2=0x7fd2540051f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.835+0000 7fd274085640 1 --2- 172.21.15.81:0/1001907772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd254004d90 0x7fd2540051f0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fd25c00c640 tx=0x7fd254005830 comp rx=0 tx=0).stop 2024-09-17T05:24:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.835+0000 7fd272622640 1 -- 172.21.15.81:0/1001907772 reap_dead start 2024-09-17T05:24:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.835+0000 7fd274085640 1 -- 172.21.15.81:0/1001907772 shutdown_connections 2024-09-17T05:24:14.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.835+0000 7fd274085640 1 -- 172.21.15.81:0/1001907772 >> 172.21.15.81:0/1001907772 conn(0x7fd26c0d3e30 msgr2=0x7fd26c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.835+0000 7fd274085640 1 -- 172.21.15.81:0/1001907772 shutdown_connections 2024-09-17T05:24:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.835+0000 7fd274085640 1 -- 172.21.15.81:0/1001907772 wait complete. 2024-09-17T05:24:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.836+0000 7fd274085640 1 Processor -- start 2024-09-17T05:24:14.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.836+0000 7fd274085640 1 -- start start 2024-09-17T05:24:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd274085640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c0cd810 0x7fd26c0c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd274085640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd26c0caf00 0x7fd26c14cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd274085640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd26c0c9200 0x7fd26c14d300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd274085640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c0d2930 con 0x7fd26c0cd810 2024-09-17T05:24:14.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd274085640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd26c0d27b0 con 0x7fd26c0caf00 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd274085640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd26c0d2ab0 con 0x7fd26c0c9200 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c0cd810 0x7fd26c0c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c0cd810 0x7fd26c0c8cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49564/0 (socket says 172.21.15.81:49564) 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 -- 172.21.15.81:0/2777326398 learned_addr learned my addr 172.21.15.81:0/2777326398 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd272622640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd26c0c9200 0x7fd26c14d300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271620640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd26c0caf00 0x7fd26c14cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 -- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd26c0c9200 msgr2=0x7fd26c14d300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd26c0c9200 0x7fd26c14d300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 -- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd26c0caf00 msgr2=0x7fd26c14cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd26c0caf00 0x7fd26c14cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:14.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 -- 172.21.15.81:0/2777326398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd26c0c9740 con 0x7fd26c0cd810 2024-09-17T05:24:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd271e21640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c0cd810 0x7fd26c0c8cc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd264004ce0 tx=0x7fd2640017f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd26a7fc640 1 -- 172.21.15.81:0/2777326398 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264015020 con 0x7fd26c0cd810 2024-09-17T05:24:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd26a7fc640 1 -- 172.21.15.81:0/2777326398 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd264011960 con 0x7fd26c0cd810 2024-09-17T05:24:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd26a7fc640 1 -- 172.21.15.81:0/2777326398 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd264011db0 con 0x7fd26c0cd810 2024-09-17T05:24:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.837+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd26c159da0 con 0x7fd26c0cd810 2024-09-17T05:24:14.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.838+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd26c15a360 con 0x7fd26c0cd810 2024-09-17T05:24:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.839+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd26c0cff60 con 0x7fd26c0cd810 2024-09-17T05:24:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.839+0000 7fd26a7fc640 1 -- 172.21.15.81:0/2777326398 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fd264018020 con 0x7fd26c0cd810 2024-09-17T05:24:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.840+0000 7fd26a7fc640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd258079010 0x7fd25807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.840+0000 7fd271620640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd258079010 0x7fd25807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.840+0000 7fd26a7fc640 1 -- 172.21.15.81:0/2777326398 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fd26409c140 con 0x7fd26c0cd810 2024-09-17T05:24:14.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.840+0000 7fd271620640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd258079010 0x7fd25807b4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd26c1f9a90 tx=0x7fd260005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:14.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:14.844+0000 7fd26a7fc640 1 -- 172.21.15.81:0/2777326398 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd26c0cff60 con 0x7fd26c0cd810 2024-09-17T05:24:15.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.059+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fd26c0b4c70 con 0x7fd26c0cd810 2024-09-17T05:24:15.610 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:24:15.613 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:24:15.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.717+0000 7fd26a7fc640 1 -- 172.21.15.81:0/2777326398 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v68) ==== 122+0+0 (secure 0 0 0) 0x7fd26401f020 con 0x7fd26c0cd810 2024-09-17T05:24:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd258079010 msgr2=0x7fd25807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:15.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd258079010 0x7fd25807b4d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd26c1f9a90 tx=0x7fd260005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c0cd810 msgr2=0x7fd26c0c8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c0cd810 0x7fd26c0c8cc0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fd264004ce0 tx=0x7fd2640017f0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 shutdown_connections 2024-09-17T05:24:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd26c0c9200 0x7fd26c14d300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd258079010 0x7fd25807b4d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd26c0caf00 0x7fd26c14cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 --2- 172.21.15.81:0/2777326398 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd26c0cd810 0x7fd26c0c8cc0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 >> 172.21.15.81:0/2777326398 conn(0x7fd26c0d3e30 msgr2=0x7fd26c0b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.720+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 shutdown_connections 2024-09-17T05:24:15.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.721+0000 7fd274085640 1 -- 172.21.15.81:0/2777326398 wait complete. 2024-09-17T05:24:15.732 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:24:15.732 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:15.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/282735595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 msgr2=0x7f6c980cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/282735595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cf9b0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f6c980b9f50 tx=0x7f6c8002a5f0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/282735595 shutdown_connections 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/282735595 >> v2:172.21.15.160:3300/0 conn(0x7f6c980d49c0 0x7f6c980b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/282735595 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cf9b0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/282735595 >> 172.21.15.81:0/282735595 conn(0x7f6c980d3ea0 msgr2=0x7f6c980d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/282735595 shutdown_connections 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.832+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/282735595 wait complete. 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 Processor -- start 2024-09-17T05:24:15.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 -- start start 2024-09-17T05:24:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cda50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:15.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c980d49c0 0x7f6c981f5220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c9815df90 0x7f6c9815d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6c98162690 con 0x7f6c980d0d40 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6c980b3d40 con 0x7f6c9815df90 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c9e7bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6c98161760 con 0x7f6c980d49c0 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cda50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c97fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cda50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49570/0 (socket says 172.21.15.81:49570) 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.834+0000 7f6c97fff640 1 -- 172.21.15.81:0/3388627880 learned_addr learned my addr 172.21.15.81:0/3388627880 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c9cd59640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c9815df90 0x7f6c9815d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c8ffff640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c980d49c0 0x7f6c981f5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c97fff640 1 -- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c980d49c0 msgr2=0x7f6c981f5220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c97fff640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c980d49c0 0x7f6c981f5220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c97fff640 1 -- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c9815df90 msgr2=0x7f6c9815d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c97fff640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c9815df90 0x7f6c9815d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c97fff640 1 -- 172.21.15.81:0/3388627880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c980ccc90 con 0x7f6c980d0d40 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c97fff640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cda50 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c3d0 tx=0x7f6c8800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c957fa640 1 -- 172.21.15.81:0/3388627880 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88017070 con 0x7f6c980d0d40 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c957fa640 1 -- 172.21.15.81:0/3388627880 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6c880053c0 con 0x7f6c980d0d40 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c980ccf70 con 0x7f6c980d0d40 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c957fa640 1 -- 172.21.15.81:0/3388627880 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c88003850 con 0x7f6c980d0d40 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.835+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c980cd530 con 0x7f6c980d0d40 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.836+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c980cf9b0 con 0x7f6c980d0d40 2024-09-17T05:24:15.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.837+0000 7f6c957fa640 1 -- 172.21.15.81:0/3388627880 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f6c8801a070 con 0x7f6c980d0d40 2024-09-17T05:24:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.837+0000 7f6c957fa640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6c78079010 0x7f6c7807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.837+0000 7f6c8ffff640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6c78079010 0x7f6c7807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.837+0000 7f6c957fa640 1 -- 172.21.15.81:0/3388627880 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f6c8809a9e0 con 0x7f6c980d0d40 2024-09-17T05:24:15.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.838+0000 7f6c8ffff640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6c78079010 0x7f6c7807b4d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c80033000 tx=0x7f6c80004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:15.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:15.841+0000 7f6c957fa640 1 -- 172.21.15.81:0/3388627880 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6c980ce970 con 0x7f6c980d0d40 2024-09-17T05:24:16.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.052+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6c9808d590 con 0x7f6c980d0d40 2024-09-17T05:24:16.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.052+0000 7f6c957fa640 1 -- 172.21.15.81:0/3388627880 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5231 (secure 0 0 0) 0x7f6c880626b0 con 0x7f6c980d0d40 2024-09-17T05:24:16.054 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:16.054 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"btime":"2024-09-17T05:24:15:717521+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3436145099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3436145099},{"type":"v1","addr":"172.21.15.160:6834","nonce":3436145099}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3146864973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3146864973},{"type":"v1","addr":"172.21.15.160:6835","nonce":3146864973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7515,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/3025598693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3025598693},{"type":"v1","addr":"172.21.15.81:6833","nonce":3025598693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:13.064331+0000","modified":"2024-09-17T05:24:15.061074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7518":{"gid":7518,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1143442034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1143442034},{"type":"v1","addr":"172.21.15.81:6835","nonce":1143442034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7518,"qdb_cluster":[7518]},"id":9}]} 2024-09-17T05:24:16.054 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2024-09-17T05:24:16.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.054+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6c78079010 msgr2=0x7f6c7807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.054+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6c78079010 0x7f6c7807b4d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c80033000 tx=0x7f6c80004730 comp rx=0 tx=0).stop 2024-09-17T05:24:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.054+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 msgr2=0x7f6c980cda50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.054+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cda50 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f6c8800c3d0 tx=0x7f6c8800c890 comp rx=0 tx=0).stop 2024-09-17T05:24:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 shutdown_connections 2024-09-17T05:24:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6c78079010 0x7f6c7807b4d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6c9815df90 0x7f6c9815d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6c980d49c0 0x7f6c981f5220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 --2- 172.21.15.81:0/3388627880 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6c980d0d40 0x7f6c980cda50 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 >> 172.21.15.81:0/3388627880 conn(0x7f6c980d3ea0 msgr2=0x7f6c980b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 shutdown_connections 2024-09-17T05:24:16.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.055+0000 7f6c9e7bc640 1 -- 172.21.15.81:0/3388627880 wait complete. 2024-09-17T05:24:16.066 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.167+0000 7f664acdd640 1 -- 172.21.15.81:0/873781260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6634003a50 msgr2=0x7f6634003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.167+0000 7f664acdd640 1 --2- 172.21.15.81:0/873781260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6634003a50 0x7f6634003e70 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f663800c310 tx=0x7f6634005830 comp rx=0 tx=0).stop 2024-09-17T05:24:16.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.167+0000 7f664acdd640 1 -- 172.21.15.81:0/873781260 shutdown_connections 2024-09-17T05:24:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.167+0000 7f664acdd640 1 --2- 172.21.15.81:0/873781260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6634003a50 0x7f6634003e70 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.167+0000 7f664acdd640 1 -- 172.21.15.81:0/873781260 >> 172.21.15.81:0/873781260 conn(0x7f66440d0c20 msgr2=0x7f66440d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.167+0000 7f664acdd640 1 -- 172.21.15.81:0/873781260 shutdown_connections 2024-09-17T05:24:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.167+0000 7f664acdd640 1 -- 172.21.15.81:0/873781260 wait complete. 2024-09-17T05:24:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.168+0000 7f664acdd640 1 Processor -- start 2024-09-17T05:24:16.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.168+0000 7f664acdd640 1 -- start start 2024-09-17T05:24:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664acdd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6634003a50 0x7f66440ca570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664acdd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66441f5900 0x7f66441f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664acdd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66441f62c0 0x7f66440b4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664acdd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66440cca60 con 0x7f66441f62c0 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664acdd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f66440cc8e0 con 0x7f6634003a50 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664acdd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f66440ccbe0 con 0x7f66441f5900 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664927a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66441f62c0 0x7f66440b4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664927a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66441f62c0 0x7f66440b4bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49590/0 (socket says 172.21.15.81:49590) 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f664927a640 1 -- 172.21.15.81:0/4250023600 learned_addr learned my addr 172.21.15.81:0/4250023600 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f6643fff640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66441f5900 0x7f66441f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.169+0000 7f6648a79640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6634003a50 0x7f66440ca570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664927a640 1 -- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66441f5900 msgr2=0x7f66441f5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664927a640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66441f5900 0x7f66441f5d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664927a640 1 -- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6634003a50 msgr2=0x7f66440ca570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664927a640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6634003a50 0x7f66440ca570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664927a640 1 -- 172.21.15.81:0/4250023600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66441f6740 con 0x7f66441f62c0 2024-09-17T05:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664927a640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66441f62c0 0x7f66440b4bc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f66440cb220 tx=0x7f663c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f66417fa640 1 -- 172.21.15.81:0/4250023600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c003970 con 0x7f66441f62c0 2024-09-17T05:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f66417fa640 1 -- 172.21.15.81:0/4250023600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f663c015070 con 0x7f66441f62c0 2024-09-17T05:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66440c6ab0 con 0x7f66441f62c0 2024-09-17T05:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f66417fa640 1 -- 172.21.15.81:0/4250023600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f663c004050 con 0x7f66441f62c0 2024-09-17T05:24:16.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.170+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66440c7070 con 0x7f66441f62c0 2024-09-17T05:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.171+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66440cb430 con 0x7f66441f62c0 2024-09-17T05:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.172+0000 7f66417fa640 1 -- 172.21.15.81:0/4250023600 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f663c0041f0 con 0x7f66441f62c0 2024-09-17T05:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.172+0000 7f66417fa640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6628079010 0x7f662807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.173+0000 7f6648a79640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6628079010 0x7f662807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.173+0000 7f66417fa640 1 -- 172.21.15.81:0/4250023600 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f663c09bff0 con 0x7f66441f62c0 2024-09-17T05:24:16.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.173+0000 7f6648a79640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6628079010 0x7f662807b4d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6638033000 tx=0x7f6638038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:16.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.177+0000 7f66417fa640 1 -- 172.21.15.81:0/4250023600 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f663c063670 con 0x7f66441f62c0 2024-09-17T05:24:16.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.353+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f66440b6ba0 con 0x7f66441f62c0 2024-09-17T05:24:16.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.354+0000 7f66417fa640 1 -- 172.21.15.81:0/4250023600 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16806 (secure 0 0 0) 0x7f663c0680a0 con 0x7f66441f62c0 2024-09-17T05:24:16.355 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:16.355 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":117,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:14.697841+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:11.682378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:12.014580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6628079010 msgr2=0x7f662807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6628079010 0x7f662807b4d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6638033000 tx=0x7f6638038040 comp rx=0 tx=0).stop 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66441f62c0 msgr2=0x7f66440b4bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66441f62c0 0x7f66440b4bc0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f66440cb220 tx=0x7f663c010f40 comp rx=0 tx=0).stop 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 shutdown_connections 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66441f62c0 0x7f66440b4bc0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66441f5900 0x7f66441f5d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6628079010 0x7f662807b4d0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 --2- 172.21.15.81:0/4250023600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6634003a50 0x7f66440ca570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 >> 172.21.15.81:0/4250023600 conn(0x7f66440d0c20 msgr2=0x7f66440b0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 shutdown_connections 2024-09-17T05:24:16.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.356+0000 7f664acdd640 1 -- 172.21.15.81:0/4250023600 wait complete. 2024-09-17T05:24:16.369 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:24:16.369 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/491490724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b8074060 msgr2=0x7fb4b815f8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/491490724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b8074060 0x7fb4b815f8f0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fb4b80adb10 tx=0x7fb4b002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/491490724 shutdown_connections 2024-09-17T05:24:16.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/491490724 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b8074060 0x7fb4b815f8f0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/491490724 >> v2:172.21.15.160:3300/0 conn(0x7fb4b80cdaa0 0x7fb4b8073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/491490724 >> 172.21.15.81:0/491490724 conn(0x7fb4b80b19c0 msgr2=0x7fb4b80b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/491490724 shutdown_connections 2024-09-17T05:24:16.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.469+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/491490724 wait complete. 2024-09-17T05:24:16.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 Processor -- start 2024-09-17T05:24:16.478 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 -- start start 2024-09-17T05:24:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4b8074060 0x7fb4b81f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80cdaa0 0x7fb4b80b4d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4b8156110 0x7fb4b8154960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b8074c10 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb4b8074a90 con 0x7fb4b8074060 2024-09-17T05:24:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.471+0000 7fb4bc8b6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb4b815fe30 con 0x7fb4b8156110 2024-09-17T05:24:16.479 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80cdaa0 0x7fb4b80b4d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80cdaa0 0x7fb4b80b4d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49606/0 (socket says 172.21.15.81:49606) 2024-09-17T05:24:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 -- 172.21.15.81:0/2331874203 learned_addr learned my addr 172.21.15.81:0/2331874203 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4b6d9d640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4b8156110 0x7fb4b8154960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4b659c640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4b8074060 0x7fb4b81f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 -- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4b8156110 msgr2=0x7fb4b8154960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4b8156110 0x7fb4b8154960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.480 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 -- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4b8074060 msgr2=0x7fb4b81f3200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4b8074060 0x7fb4b81f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 -- 172.21.15.81:0/2331874203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4b80b56d0 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4affff640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80cdaa0 0x7fb4b80b4d80 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000e9f0 tx=0x7fb4a000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:16.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4aeffd640 1 -- 172.21.15.81:0/2331874203 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a000cd80 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4aeffd640 1 -- 172.21.15.81:0/2331874203 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4a0005020 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4b80b59b0 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4aeffd640 1 -- 172.21.15.81:0/2331874203 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4a0005450 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.472+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4b81f2ce0 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.473+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4b81f2ee0 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.474+0000 7fb4aeffd640 1 -- 172.21.15.81:0/2331874203 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fb4a00047a0 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.474+0000 7fb4aeffd640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb498079010 0x7fb49807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.474+0000 7fb4b659c640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb498079010 0x7fb49807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.475+0000 7fb4aeffd640 1 -- 172.21.15.81:0/2331874203 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fb4a009c110 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.475+0000 7fb4b659c640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb498079010 0x7fb49807b4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8000f60 tx=0x7fb4a8009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:16.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.479+0000 7fb4aeffd640 1 -- 172.21.15.81:0/2331874203 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb4b81f2ee0 con 0x7fb4b80cdaa0 2024-09-17T05:24:16.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.653+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4b81f3800 con 0x7fb498079010 2024-09-17T05:24:16.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.657+0000 7fb4aeffd640 1 -- 172.21.15.81:0/2331874203 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7fb4b81f3800 con 0x7fb498079010 2024-09-17T05:24:16.661 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:16.663 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:24:16.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.660+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb498079010 msgr2=0x7fb49807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.660+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb498079010 0x7fb49807b4d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fb4a8000f60 tx=0x7fb4a8009040 comp rx=0 tx=0).stop 2024-09-17T05:24:16.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80cdaa0 msgr2=0x7fb4b80b4d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80cdaa0 0x7fb4b80b4d80 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fb4a000e9f0 tx=0x7fb4a000edf0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 shutdown_connections 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4b8156110 0x7fb4b8154960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4b80cdaa0 0x7fb4b80b4d80 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb498079010 0x7fb49807b4d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 --2- 172.21.15.81:0/2331874203 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4b8074060 0x7fb4b81f3200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 >> 172.21.15.81:0/2331874203 conn(0x7fb4b80b19c0 msgr2=0x7fb4b80cf180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 shutdown_connections 2024-09-17T05:24:16.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.661+0000 7fb4bc8b6640 1 -- 172.21.15.81:0/2331874203 wait complete. 2024-09-17T05:24:16.673 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-17T05:24:16.040846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262056,"kb_used_data":12512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712664,"statfs":{"total":773094113280,"available":772825767936,"internally_reserved":0,"allocated":12812288,"data_stored":6257732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.338927"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701497+0000","last_change":"2024-09-17T05:24:13.719963+0000","last_active":"2024-09-17T05:24:14.701497+0000","last_peered":"2024-09-17T05:24:14.701497+0000","last_clean":"2024-09-17T05:24:14.701497+0000","last_became_active":"2024-09-17T05:24:13.719678+0000","last_became_peered":"2024-09-17T05:24:13.719678+0000","last_unstale":"2024-09-17T05:24:14.701497+0000","last_undegraded":"2024-09-17T05:24:14.701497+0000","last_fullsized":"2024-09-17T05:24:14.701497+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:44.272695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704025+0000","last_change":"2024-09-17T05:24:13.724676+0000","last_active":"2024-09-17T05:24:14.704025+0000","last_peered":"2024-09-17T05:24:14.704025+0000","last_clean":"2024-09-17T05:24:14.704025+0000","last_became_active":"2024-09-17T05:24:13.724423+0000","last_became_peered":"2024-09-17T05:24:13.724423+0000","last_unstale":"2024-09-17T05:24:14.704025+0000","last_undegraded":"2024-09-17T05:24:14.704025+0000","last_fullsized":"2024-09-17T05:24:14.704025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:52.858863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752431+0000","last_change":"2024-09-17T05:24:13.710229+0000","last_active":"2024-09-17T05:24:14.752431+0000","last_peered":"2024-09-17T05:24:14.752431+0000","last_clean":"2024-09-17T05:24:14.752431+0000","last_became_active":"2024-09-17T05:24:13.709731+0000","last_became_peered":"2024-09-17T05:24:13.709731+0000","last_unstale":"2024-09-17T05:24:14.752431+0000","last_undegraded":"2024-09-17T05:24:14.752431+0000","last_fullsized":"2024-09-17T05:24:14.752431+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:17.655496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701347+0000","last_change":"2024-09-17T05:24:13.719670+0000","last_active":"2024-09-17T05:24:14.701347+0000","last_peered":"2024-09-17T05:24:14.701347+0000","last_clean":"2024-09-17T05:24:14.701347+0000","last_became_active":"2024-09-17T05:24:13.719282+0000","last_became_peered":"2024-09-17T05:24:13.719282+0000","last_unstale":"2024-09-17T05:24:14.701347+0000","last_undegraded":"2024-09-17T05:24:14.701347+0000","last_fullsized":"2024-09-17T05:24:14.701347+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.470887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752247+0000","last_change":"2024-09-17T05:24:13.719383+0000","last_active":"2024-09-17T05:24:14.752247+0000","last_peered":"2024-09-17T05:24:14.752247+0000","last_clean":"2024-09-17T05:24:14.752247+0000","last_became_active":"2024-09-17T05:24:13.719086+0000","last_became_peered":"2024-09-17T05:24:13.719086+0000","last_unstale":"2024-09-17T05:24:14.752247+0000","last_undegraded":"2024-09-17T05:24:14.752247+0000","last_fullsized":"2024-09-17T05:24:14.752247+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:47.871465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704745+0000","last_change":"2024-09-17T05:24:13.715685+0000","last_active":"2024-09-17T05:24:14.704745+0000","last_peered":"2024-09-17T05:24:14.704745+0000","last_clean":"2024-09-17T05:24:14.704745+0000","last_became_active":"2024-09-17T05:24:13.715429+0000","last_became_peered":"2024-09-17T05:24:13.715429+0000","last_unstale":"2024-09-17T05:24:14.704745+0000","last_undegraded":"2024-09-17T05:24:14.704745+0000","last_fullsized":"2024-09-17T05:24:14.704745+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704522+0000","last_change":"2024-09-17T05:24:13.713628+0000","last_active":"2024-09-17T05:24:14.704522+0000","last_peered":"2024-09-17T05:24:14.704522+0000","last_clean":"2024-09-17T05:24:14.704522+0000","last_became_active":"2024-09-17T05:24:13.713391+0000","last_became_peered":"2024-09-17T05:24:13.713391+0000","last_unstale":"2024-09-17T05:24:14.704522+0000","last_undegraded":"2024-09-17T05:24:14.704522+0000","last_fullsized":"2024-09-17T05:24:14.704522+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:28.083420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752544+0000","last_change":"2024-09-17T05:24:13.707915+0000","last_active":"2024-09-17T05:24:14.752544+0000","last_peered":"2024-09-17T05:24:14.752544+0000","last_clean":"2024-09-17T05:24:14.752544+0000","last_became_active":"2024-09-17T05:24:13.707570+0000","last_became_peered":"2024-09-17T05:24:13.707570+0000","last_unstale":"2024-09-17T05:24:14.752544+0000","last_undegraded":"2024-09-17T05:24:14.752544+0000","last_fullsized":"2024-09-17T05:24:14.752544+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:23.899014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752154+0000","last_change":"2024-09-17T05:24:13.712370+0000","last_active":"2024-09-17T05:24:14.752154+0000","last_peered":"2024-09-17T05:24:14.752154+0000","last_clean":"2024-09-17T05:24:14.752154+0000","last_became_active":"2024-09-17T05:24:13.712027+0000","last_became_peered":"2024-09-17T05:24:13.712027+0000","last_unstale":"2024-09-17T05:24:14.752154+0000","last_undegraded":"2024-09-17T05:24:14.752154+0000","last_fullsized":"2024-09-17T05:24:14.752154+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:27.857847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704127+0000","last_change":"2024-09-17T05:24:13.725258+0000","last_active":"2024-09-17T05:24:14.704127+0000","last_peered":"2024-09-17T05:24:14.704127+0000","last_clean":"2024-09-17T05:24:14.704127+0000","last_became_active":"2024-09-17T05:24:13.724952+0000","last_became_peered":"2024-09-17T05:24:13.724952+0000","last_unstale":"2024-09-17T05:24:14.704127+0000","last_undegraded":"2024-09-17T05:24:14.704127+0000","last_fullsized":"2024-09-17T05:24:14.704127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:09.281535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751095+0000","last_change":"2024-09-17T05:24:13.724685+0000","last_active":"2024-09-17T05:24:14.751095+0000","last_peered":"2024-09-17T05:24:14.751095+0000","last_clean":"2024-09-17T05:24:14.751095+0000","last_became_active":"2024-09-17T05:24:13.724375+0000","last_became_peered":"2024-09-17T05:24:13.724375+0000","last_unstale":"2024-09-17T05:24:14.751095+0000","last_undegraded":"2024-09-17T05:24:14.751095+0000","last_fullsized":"2024-09-17T05:24:14.751095+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:11.291533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751640+0000","last_change":"2024-09-17T05:24:13.708867+0000","last_active":"2024-09-17T05:24:14.751640+0000","last_peered":"2024-09-17T05:24:14.751640+0000","last_clean":"2024-09-17T05:24:14.751640+0000","last_became_active":"2024-09-17T05:24:13.708310+0000","last_became_peered":"2024-09-17T05:24:13.708310+0000","last_unstale":"2024-09-17T05:24:14.751640+0000","last_undegraded":"2024-09-17T05:24:14.751640+0000","last_fullsized":"2024-09-17T05:24:14.751640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:14.090582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701461+0000","last_change":"2024-09-17T05:24:13.715912+0000","last_active":"2024-09-17T05:24:14.701461+0000","last_peered":"2024-09-17T05:24:14.701461+0000","last_clean":"2024-09-17T05:24:14.701461+0000","last_became_active":"2024-09-17T05:24:13.715660+0000","last_became_peered":"2024-09-17T05:24:13.715660+0000","last_unstale":"2024-09-17T05:24:14.701461+0000","last_undegraded":"2024-09-17T05:24:14.701461+0000","last_fullsized":"2024-09-17T05:24:14.701461+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:48.889269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703847+0000","last_change":"2024-09-17T05:24:13.715993+0000","last_active":"2024-09-17T05:24:14.703847+0000","last_peered":"2024-09-17T05:24:14.703847+0000","last_clean":"2024-09-17T05:24:14.703847+0000","last_became_active":"2024-09-17T05:24:13.713708+0000","last_became_peered":"2024-09-17T05:24:13.713708+0000","last_unstale":"2024-09-17T05:24:14.703847+0000","last_undegraded":"2024-09-17T05:24:14.703847+0000","last_fullsized":"2024-09-17T05:24:14.703847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:29.093680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701068+0000","last_change":"2024-09-17T05:24:13.712229+0000","last_active":"2024-09-17T05:24:14.701068+0000","last_peered":"2024-09-17T05:24:14.701068+0000","last_clean":"2024-09-17T05:24:14.701068+0000","last_became_active":"2024-09-17T05:24:13.711963+0000","last_became_peered":"2024-09-17T05:24:13.711963+0000","last_unstale":"2024-09-17T05:24:14.701068+0000","last_undegraded":"2024-09-17T05:24:14.701068+0000","last_fullsized":"2024-09-17T05:24:14.701068+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:34.145838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750774+0000","last_change":"2024-09-17T05:24:13.711697+0000","last_active":"2024-09-17T05:24:14.750774+0000","last_peered":"2024-09-17T05:24:14.750774+0000","last_clean":"2024-09-17T05:24:14.750774+0000","last_became_active":"2024-09-17T05:24:13.711472+0000","last_became_peered":"2024-09-17T05:24:13.711472+0000","last_unstale":"2024-09-17T05:24:14.750774+0000","last_undegraded":"2024-09-17T05:24:14.750774+0000","last_fullsized":"2024-09-17T05:24:14.750774+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:37.917371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.705152+0000","last_change":"2024-09-17T05:24:13.715016+0000","last_active":"2024-09-17T05:24:14.705152+0000","last_peered":"2024-09-17T05:24:14.705152+0000","last_clean":"2024-09-17T05:24:14.705152+0000","last_became_active":"2024-09-17T05:24:13.714758+0000","last_became_peered":"2024-09-17T05:24:13.714758+0000","last_unstale":"2024-09-17T05:24:14.705152+0000","last_undegraded":"2024-09-17T05:24:14.705152+0000","last_fullsized":"2024-09-17T05:24:14.705152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:37.917371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751345+0000","last_change":"2024-09-17T05:24:13.717555+0000","last_active":"2024-09-17T05:24:14.751345+0000","last_peered":"2024-09-17T05:24:14.751345+0000","last_clean":"2024-09-17T05:24:14.751345+0000","last_became_active":"2024-09-17T05:24:13.717254+0000","last_became_peered":"2024-09-17T05:24:13.717254+0000","last_unstale":"2024-09-17T05:24:14.751345+0000","last_undegraded":"2024-09-17T05:24:14.751345+0000","last_fullsized":"2024-09-17T05:24:14.751345+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:21.842848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751327+0000","last_change":"2024-09-17T05:24:13.716009+0000","last_active":"2024-09-17T05:24:14.751327+0000","last_peered":"2024-09-17T05:24:14.751327+0000","last_clean":"2024-09-17T05:24:14.751327+0000","last_became_active":"2024-09-17T05:24:13.715733+0000","last_became_peered":"2024-09-17T05:24:13.715733+0000","last_unstale":"2024-09-17T05:24:14.751327+0000","last_undegraded":"2024-09-17T05:24:14.751327+0000","last_fullsized":"2024-09-17T05:24:14.751327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:48.720794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751391+0000","last_change":"2024-09-17T05:24:13.714993+0000","last_active":"2024-09-17T05:24:14.751391+0000","last_peered":"2024-09-17T05:24:14.751391+0000","last_clean":"2024-09-17T05:24:14.751391+0000","last_became_active":"2024-09-17T05:24:13.714745+0000","last_became_peered":"2024-09-17T05:24:13.714745+0000","last_unstale":"2024-09-17T05:24:14.751391+0000","last_undegraded":"2024-09-17T05:24:14.751391+0000","last_fullsized":"2024-09-17T05:24:14.751391+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:47.871465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752020+0000","last_change":"2024-09-17T05:24:13.716858+0000","last_active":"2024-09-17T05:24:14.752020+0000","last_peered":"2024-09-17T05:24:14.752020+0000","last_clean":"2024-09-17T05:24:14.752020+0000","last_became_active":"2024-09-17T05:24:13.716583+0000","last_became_peered":"2024-09-17T05:24:13.716583+0000","last_unstale":"2024-09-17T05:24:14.752020+0000","last_undegraded":"2024-09-17T05:24:14.752020+0000","last_fullsized":"2024-09-17T05:24:14.752020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:21.842848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750805+0000","last_change":"2024-09-17T05:24:13.714349+0000","last_active":"2024-09-17T05:24:14.750805+0000","last_peered":"2024-09-17T05:24:14.750805+0000","last_clean":"2024-09-17T05:24:14.750805+0000","last_became_active":"2024-09-17T05:24:13.714090+0000","last_became_peered":"2024-09-17T05:24:13.714090+0000","last_unstale":"2024-09-17T05:24:14.750805+0000","last_undegraded":"2024-09-17T05:24:14.750805+0000","last_fullsized":"2024-09-17T05:24:14.750805+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:41.509068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752051+0000","last_change":"2024-09-17T05:24:13.708466+0000","last_active":"2024-09-17T05:24:14.752051+0000","last_peered":"2024-09-17T05:24:14.752051+0000","last_clean":"2024-09-17T05:24:14.752051+0000","last_became_active":"2024-09-17T05:24:13.708157+0000","last_became_peered":"2024-09-17T05:24:13.708157+0000","last_unstale":"2024-09-17T05:24:14.752051+0000","last_undegraded":"2024-09-17T05:24:14.752051+0000","last_fullsized":"2024-09-17T05:24:14.752051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:42.813994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750665+0000","last_change":"2024-09-17T05:24:13.711518+0000","last_active":"2024-09-17T05:24:14.750665+0000","last_peered":"2024-09-17T05:24:14.750665+0000","last_clean":"2024-09-17T05:24:14.750665+0000","last_became_active":"2024-09-17T05:24:13.711087+0000","last_became_peered":"2024-09-17T05:24:13.711087+0000","last_unstale":"2024-09-17T05:24:14.750665+0000","last_undegraded":"2024-09-17T05:24:14.750665+0000","last_fullsized":"2024-09-17T05:24:14.750665+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:13.838726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704009+0000","last_change":"2024-09-17T05:24:13.717026+0000","last_active":"2024-09-17T05:24:14.704009+0000","last_peered":"2024-09-17T05:24:14.704009+0000","last_clean":"2024-09-17T05:24:14.704009+0000","last_became_active":"2024-09-17T05:24:13.716752+0000","last_became_peered":"2024-09-17T05:24:13.716752+0000","last_unstale":"2024-09-17T05:24:14.704009+0000","last_undegraded":"2024-09-17T05:24:14.704009+0000","last_fullsized":"2024-09-17T05:24:14.704009+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:14.090582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751437+0000","last_change":"2024-09-17T05:24:13.712621+0000","last_active":"2024-09-17T05:24:14.751437+0000","last_peered":"2024-09-17T05:24:14.751437+0000","last_clean":"2024-09-17T05:24:14.751437+0000","last_became_active":"2024-09-17T05:24:13.712358+0000","last_became_peered":"2024-09-17T05:24:13.712358+0000","last_unstale":"2024-09-17T05:24:14.751437+0000","last_undegraded":"2024-09-17T05:24:14.751437+0000","last_fullsized":"2024-09-17T05:24:14.751437+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:14.630085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701280+0000","last_change":"2024-09-17T05:24:13.719995+0000","last_active":"2024-09-17T05:24:14.701280+0000","last_peered":"2024-09-17T05:24:14.701280+0000","last_clean":"2024-09-17T05:24:14.701280+0000","last_became_active":"2024-09-17T05:24:13.719551+0000","last_became_peered":"2024-09-17T05:24:13.719551+0000","last_unstale":"2024-09-17T05:24:14.701280+0000","last_undegraded":"2024-09-17T05:24:14.701280+0000","last_fullsized":"2024-09-17T05:24:14.701280+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:31.360563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751717+0000","last_change":"2024-09-17T05:24:13.711079+0000","last_active":"2024-09-17T05:24:14.751717+0000","last_peered":"2024-09-17T05:24:14.751717+0000","last_clean":"2024-09-17T05:24:14.751717+0000","last_became_active":"2024-09-17T05:24:13.710807+0000","last_became_peered":"2024-09-17T05:24:13.710807+0000","last_unstale":"2024-09-17T05:24:14.751717+0000","last_undegraded":"2024-09-17T05:24:14.751717+0000","last_fullsized":"2024-09-17T05:24:14.751717+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:30.237020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701489+0000","last_change":"2024-09-17T05:24:13.711676+0000","last_active":"2024-09-17T05:24:14.701489+0000","last_peered":"2024-09-17T05:24:14.701489+0000","last_clean":"2024-09-17T05:24:14.701489+0000","last_became_active":"2024-09-17T05:24:13.711063+0000","last_became_peered":"2024-09-17T05:24:13.711063+0000","last_unstale":"2024-09-17T05:24:14.701489+0000","last_undegraded":"2024-09-17T05:24:14.701489+0000","last_fullsized":"2024-09-17T05:24:14.701489+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:45.714777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701258+0000","last_change":"2024-09-17T05:24:13.712876+0000","last_active":"2024-09-17T05:24:14.701258+0000","last_peered":"2024-09-17T05:24:14.701258+0000","last_clean":"2024-09-17T05:24:14.701258+0000","last_became_active":"2024-09-17T05:24:13.712603+0000","last_became_peered":"2024-09-17T05:24:13.712603+0000","last_unstale":"2024-09-17T05:24:14.701258+0000","last_undegraded":"2024-09-17T05:24:14.701258+0000","last_fullsized":"2024-09-17T05:24:14.701258+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:03.129876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752421+0000","last_change":"2024-09-17T05:24:13.725294+0000","last_active":"2024-09-17T05:24:14.752421+0000","last_peered":"2024-09-17T05:24:14.752421+0000","last_clean":"2024-09-17T05:24:14.752421+0000","last_became_active":"2024-09-17T05:24:13.725027+0000","last_became_peered":"2024-09-17T05:24:13.725027+0000","last_unstale":"2024-09-17T05:24:14.752421+0000","last_undegraded":"2024-09-17T05:24:14.752421+0000","last_fullsized":"2024-09-17T05:24:14.752421+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:14.630085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704450+0000","last_change":"2024-09-17T05:24:13.714712+0000","last_active":"2024-09-17T05:24:14.704450+0000","last_peered":"2024-09-17T05:24:14.704450+0000","last_clean":"2024-09-17T05:24:14.704450+0000","last_became_active":"2024-09-17T05:24:13.714447+0000","last_became_peered":"2024-09-17T05:24:13.714447+0000","last_unstale":"2024-09-17T05:24:14.704450+0000","last_undegraded":"2024-09-17T05:24:14.704450+0000","last_fullsized":"2024-09-17T05:24:14.704450+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:19.122444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751530+0000","last_change":"2024-09-17T05:24:13.711299+0000","last_active":"2024-09-17T05:24:14.751530+0000","last_peered":"2024-09-17T05:24:14.751530+0000","last_clean":"2024-09-17T05:24:14.751530+0000","last_became_active":"2024-09-17T05:24:13.711013+0000","last_became_peered":"2024-09-17T05:24:13.711013+0000","last_unstale":"2024-09-17T05:24:14.751530+0000","last_undegraded":"2024-09-17T05:24:14.751530+0000","last_fullsized":"2024-09-17T05:24:14.751530+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:23.326418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"116'4","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752360+0000","last_change":"2024-09-17T05:24:12.725911+0000","last_active":"2024-09-17T05:24:14.752360+0000","last_peered":"2024-09-17T05:24:14.752360+0000","last_clean":"2024-09-17T05:24:14.752360+0000","last_became_active":"2024-09-17T05:24:12.725513+0000","last_became_peered":"2024-09-17T05:24:12.725513+0000","last_unstale":"2024-09-17T05:24:14.752360+0000","last_undegraded":"2024-09-17T05:24:14.752360+0000","last_fullsized":"2024-09-17T05:24:14.752360+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:11.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752026+0000","last_change":"2024-09-17T05:24:13.714550+0000","last_active":"2024-09-17T05:24:14.752026+0000","last_peered":"2024-09-17T05:24:14.752026+0000","last_clean":"2024-09-17T05:24:14.752026+0000","last_became_active":"2024-09-17T05:24:13.714299+0000","last_became_peered":"2024-09-17T05:24:13.714299+0000","last_unstale":"2024-09-17T05:24:14.752026+0000","last_undegraded":"2024-09-17T05:24:14.752026+0000","last_fullsized":"2024-09-17T05:24:14.752026+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:45.070058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752136+0000","last_change":"2024-09-17T05:24:12.724408+0000","last_active":"2024-09-17T05:24:14.752136+0000","last_peered":"2024-09-17T05:24:14.752136+0000","last_clean":"2024-09-17T05:24:14.752136+0000","last_became_active":"2024-09-17T05:24:12.724051+0000","last_became_peered":"2024-09-17T05:24:12.724051+0000","last_unstale":"2024-09-17T05:24:14.752136+0000","last_undegraded":"2024-09-17T05:24:14.752136+0000","last_fullsized":"2024-09-17T05:24:14.752136+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:02.850979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752775+0000","last_change":"2024-09-17T05:24:13.719502+0000","last_active":"2024-09-17T05:24:14.752775+0000","last_peered":"2024-09-17T05:24:14.752775+0000","last_clean":"2024-09-17T05:24:14.752775+0000","last_became_active":"2024-09-17T05:24:13.719261+0000","last_became_peered":"2024-09-17T05:24:13.719261+0000","last_unstale":"2024-09-17T05:24:14.752775+0000","last_undegraded":"2024-09-17T05:24:14.752775+0000","last_fullsized":"2024-09-17T05:24:14.752775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:55.098580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751394+0000","last_change":"2024-09-17T05:24:12.724220+0000","last_active":"2024-09-17T05:24:14.751394+0000","last_peered":"2024-09-17T05:24:14.751394+0000","last_clean":"2024-09-17T05:24:14.751394+0000","last_became_active":"2024-09-17T05:24:12.723925+0000","last_became_peered":"2024-09-17T05:24:12.723925+0000","last_unstale":"2024-09-17T05:24:14.751394+0000","last_undegraded":"2024-09-17T05:24:14.751394+0000","last_fullsized":"2024-09-17T05:24:14.751394+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:23.549917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752306+0000","last_change":"2024-09-17T05:24:13.726701+0000","last_active":"2024-09-17T05:24:14.752306+0000","last_peered":"2024-09-17T05:24:14.752306+0000","last_clean":"2024-09-17T05:24:14.752306+0000","last_became_active":"2024-09-17T05:24:13.726454+0000","last_became_peered":"2024-09-17T05:24:13.726454+0000","last_unstale":"2024-09-17T05:24:14.752306+0000","last_undegraded":"2024-09-17T05:24:14.752306+0000","last_fullsized":"2024-09-17T05:24:14.752306+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:19.565402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703974+0000","last_change":"2024-09-17T05:24:12.726353+0000","last_active":"2024-09-17T05:24:14.703974+0000","last_peered":"2024-09-17T05:24:14.703974+0000","last_clean":"2024-09-17T05:24:14.703974+0000","last_became_active":"2024-09-17T05:24:12.725883+0000","last_became_peered":"2024-09-17T05:24:12.725883+0000","last_unstale":"2024-09-17T05:24:14.703974+0000","last_undegraded":"2024-09-17T05:24:14.703974+0000","last_fullsized":"2024-09-17T05:24:14.703974+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:49.292076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751021+0000","last_change":"2024-09-17T05:24:13.718350+0000","last_active":"2024-09-17T05:24:14.751021+0000","last_peered":"2024-09-17T05:24:14.751021+0000","last_clean":"2024-09-17T05:24:14.751021+0000","last_became_active":"2024-09-17T05:24:13.718085+0000","last_became_peered":"2024-09-17T05:24:13.718085+0000","last_unstale":"2024-09-17T05:24:14.751021+0000","last_undegraded":"2024-09-17T05:24:14.751021+0000","last_fullsized":"2024-09-17T05:24:14.751021+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:13.611003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703711+0000","last_change":"2024-09-17T05:24:12.727711+0000","last_active":"2024-09-17T05:24:14.703711+0000","last_peered":"2024-09-17T05:24:14.703711+0000","last_clean":"2024-09-17T05:24:14.703711+0000","last_became_active":"2024-09-17T05:24:12.727406+0000","last_became_peered":"2024-09-17T05:24:12.727406+0000","last_unstale":"2024-09-17T05:24:14.703711+0000","last_undegraded":"2024-09-17T05:24:14.703711+0000","last_fullsized":"2024-09-17T05:24:14.703711+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:41.287331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704744+0000","last_change":"2024-09-17T05:24:13.714223+0000","last_active":"2024-09-17T05:24:14.704744+0000","last_peered":"2024-09-17T05:24:14.704744+0000","last_clean":"2024-09-17T05:24:14.704744+0000","last_became_active":"2024-09-17T05:24:13.713592+0000","last_became_peered":"2024-09-17T05:24:13.713592+0000","last_unstale":"2024-09-17T05:24:14.704744+0000","last_undegraded":"2024-09-17T05:24:14.704744+0000","last_fullsized":"2024-09-17T05:24:14.704744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:54.578026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751149+0000","last_change":"2024-09-17T05:24:12.724067+0000","last_active":"2024-09-17T05:24:14.751149+0000","last_peered":"2024-09-17T05:24:14.751149+0000","last_clean":"2024-09-17T05:24:14.751149+0000","last_became_active":"2024-09-17T05:24:12.723795+0000","last_became_peered":"2024-09-17T05:24:12.723795+0000","last_unstale":"2024-09-17T05:24:14.751149+0000","last_undegraded":"2024-09-17T05:24:14.751149+0000","last_fullsized":"2024-09-17T05:24:14.751149+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:10.292836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752764+0000","last_change":"2024-09-17T05:24:13.704947+0000","last_active":"2024-09-17T05:24:14.752764+0000","last_peered":"2024-09-17T05:24:14.752764+0000","last_clean":"2024-09-17T05:24:14.752764+0000","last_became_active":"2024-09-17T05:24:13.704527+0000","last_became_peered":"2024-09-17T05:24:13.704527+0000","last_unstale":"2024-09-17T05:24:14.752764+0000","last_undegraded":"2024-09-17T05:24:14.752764+0000","last_fullsized":"2024-09-17T05:24:14.752764+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:51.798907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704389+0000","last_change":"2024-09-17T05:24:12.717905+0000","last_active":"2024-09-17T05:24:14.704389+0000","last_peered":"2024-09-17T05:24:14.704389+0000","last_clean":"2024-09-17T05:24:14.704389+0000","last_became_active":"2024-09-17T05:24:12.717634+0000","last_became_peered":"2024-09-17T05:24:12.717634+0000","last_unstale":"2024-09-17T05:24:14.704389+0000","last_undegraded":"2024-09-17T05:24:14.704389+0000","last_fullsized":"2024-09-17T05:24:14.704389+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:16.653931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703694+0000","last_change":"2024-09-17T05:24:13.715128+0000","last_active":"2024-09-17T05:24:14.703694+0000","last_peered":"2024-09-17T05:24:14.703694+0000","last_clean":"2024-09-17T05:24:14.703694+0000","last_became_active":"2024-09-17T05:24:13.714818+0000","last_became_peered":"2024-09-17T05:24:13.714818+0000","last_unstale":"2024-09-17T05:24:14.703694+0000","last_undegraded":"2024-09-17T05:24:14.703694+0000","last_fullsized":"2024-09-17T05:24:14.703694+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:12.107916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703811+0000","last_change":"2024-09-17T05:24:12.721910+0000","last_active":"2024-09-17T05:24:14.703811+0000","last_peered":"2024-09-17T05:24:14.703811+0000","last_clean":"2024-09-17T05:24:14.703811+0000","last_became_active":"2024-09-17T05:24:12.721652+0000","last_became_peered":"2024-09-17T05:24:12.721652+0000","last_unstale":"2024-09-17T05:24:14.703811+0000","last_undegraded":"2024-09-17T05:24:14.703811+0000","last_fullsized":"2024-09-17T05:24:14.703811+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.123266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701451+0000","last_change":"2024-09-17T05:24:13.711925+0000","last_active":"2024-09-17T05:24:14.701451+0000","last_peered":"2024-09-17T05:24:14.701451+0000","last_clean":"2024-09-17T05:24:14.701451+0000","last_became_active":"2024-09-17T05:24:13.711513+0000","last_became_peered":"2024-09-17T05:24:13.711513+0000","last_unstale":"2024-09-17T05:24:14.701451+0000","last_undegraded":"2024-09-17T05:24:14.701451+0000","last_fullsized":"2024-09-17T05:24:14.701451+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:19.664164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752807+0000","last_change":"2024-09-17T05:24:12.722894+0000","last_active":"2024-09-17T05:24:14.752807+0000","last_peered":"2024-09-17T05:24:14.752807+0000","last_clean":"2024-09-17T05:24:14.752807+0000","last_became_active":"2024-09-17T05:24:12.722566+0000","last_became_peered":"2024-09-17T05:24:12.722566+0000","last_unstale":"2024-09-17T05:24:14.752807+0000","last_undegraded":"2024-09-17T05:24:14.752807+0000","last_fullsized":"2024-09-17T05:24:14.752807+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:59.768999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752429+0000","last_change":"2024-09-17T05:24:13.710276+0000","last_active":"2024-09-17T05:24:14.752429+0000","last_peered":"2024-09-17T05:24:14.752429+0000","last_clean":"2024-09-17T05:24:14.752429+0000","last_became_active":"2024-09-17T05:24:13.709971+0000","last_became_peered":"2024-09-17T05:24:13.709971+0000","last_unstale":"2024-09-17T05:24:14.752429+0000","last_undegraded":"2024-09-17T05:24:14.752429+0000","last_fullsized":"2024-09-17T05:24:14.752429+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:48.662889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751492+0000","last_change":"2024-09-17T05:24:12.719470+0000","last_active":"2024-09-17T05:24:14.751492+0000","last_peered":"2024-09-17T05:24:14.751492+0000","last_clean":"2024-09-17T05:24:14.751492+0000","last_became_active":"2024-09-17T05:24:12.719143+0000","last_became_peered":"2024-09-17T05:24:12.719143+0000","last_unstale":"2024-09-17T05:24:14.751492+0000","last_undegraded":"2024-09-17T05:24:14.751492+0000","last_fullsized":"2024-09-17T05:24:14.751492+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:01.864170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752750+0000","last_change":"2024-09-17T05:24:13.715466+0000","last_active":"2024-09-17T05:24:14.752750+0000","last_peered":"2024-09-17T05:24:14.752750+0000","last_clean":"2024-09-17T05:24:14.752750+0000","last_became_active":"2024-09-17T05:24:13.715114+0000","last_became_peered":"2024-09-17T05:24:13.715114+0000","last_unstale":"2024-09-17T05:24:14.752750+0000","last_undegraded":"2024-09-17T05:24:14.752750+0000","last_fullsized":"2024-09-17T05:24:14.752750+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:18.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"116'3","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752047+0000","last_change":"2024-09-17T05:24:12.725893+0000","last_active":"2024-09-17T05:24:14.752047+0000","last_peered":"2024-09-17T05:24:14.752047+0000","last_clean":"2024-09-17T05:24:14.752047+0000","last_became_active":"2024-09-17T05:24:12.725577+0000","last_became_peered":"2024-09-17T05:24:12.725577+0000","last_unstale":"2024-09-17T05:24:14.752047+0000","last_undegraded":"2024-09-17T05:24:14.752047+0000","last_fullsized":"2024-09-17T05:24:14.752047+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.111120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752487+0000","last_change":"2024-09-17T05:24:13.718530+0000","last_active":"2024-09-17T05:24:14.752487+0000","last_peered":"2024-09-17T05:24:14.752487+0000","last_clean":"2024-09-17T05:24:14.752487+0000","last_became_active":"2024-09-17T05:24:13.718184+0000","last_became_peered":"2024-09-17T05:24:13.718184+0000","last_unstale":"2024-09-17T05:24:14.752487+0000","last_undegraded":"2024-09-17T05:24:14.752487+0000","last_fullsized":"2024-09-17T05:24:14.752487+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:23.326418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"116'6","reported_seq":21,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751773+0000","last_change":"2024-09-17T05:24:12.717488+0000","last_active":"2024-09-17T05:24:14.751773+0000","last_peered":"2024-09-17T05:24:14.751773+0000","last_clean":"2024-09-17T05:24:14.751773+0000","last_became_active":"2024-09-17T05:24:12.717170+0000","last_became_peered":"2024-09-17T05:24:12.717170+0000","last_unstale":"2024-09-17T05:24:14.751773+0000","last_undegraded":"2024-09-17T05:24:14.751773+0000","last_fullsized":"2024-09-17T05:24:14.751773+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:59.768999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701633+0000","last_change":"2024-09-17T05:24:13.711398+0000","last_active":"2024-09-17T05:24:14.701633+0000","last_peered":"2024-09-17T05:24:14.701633+0000","last_clean":"2024-09-17T05:24:14.701633+0000","last_became_active":"2024-09-17T05:24:13.710794+0000","last_became_peered":"2024-09-17T05:24:13.710794+0000","last_unstale":"2024-09-17T05:24:14.701633+0000","last_undegraded":"2024-09-17T05:24:14.701633+0000","last_fullsized":"2024-09-17T05:24:14.701633+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:21.161006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701295+0000","last_change":"2024-09-17T05:24:12.711267+0000","last_active":"2024-09-17T05:24:14.701295+0000","last_peered":"2024-09-17T05:24:14.701295+0000","last_clean":"2024-09-17T05:24:14.701295+0000","last_became_active":"2024-09-17T05:24:12.710967+0000","last_became_peered":"2024-09-17T05:24:12.710967+0000","last_unstale":"2024-09-17T05:24:14.701295+0000","last_undegraded":"2024-09-17T05:24:14.701295+0000","last_fullsized":"2024-09-17T05:24:14.701295+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:06.283226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703706+0000","last_change":"2024-09-17T05:24:13.718987+0000","last_active":"2024-09-17T05:24:14.703706+0000","last_peered":"2024-09-17T05:24:14.703706+0000","last_clean":"2024-09-17T05:24:14.703706+0000","last_became_active":"2024-09-17T05:24:13.718700+0000","last_became_peered":"2024-09-17T05:24:13.718700+0000","last_unstale":"2024-09-17T05:24:14.703706+0000","last_undegraded":"2024-09-17T05:24:14.703706+0000","last_fullsized":"2024-09-17T05:24:14.703706+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:15.880802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703829+0000","last_change":"2024-09-17T05:24:12.723321+0000","last_active":"2024-09-17T05:24:14.703829+0000","last_peered":"2024-09-17T05:24:14.703829+0000","last_clean":"2024-09-17T05:24:14.703829+0000","last_became_active":"2024-09-17T05:24:12.723029+0000","last_became_peered":"2024-09-17T05:24:12.723029+0000","last_unstale":"2024-09-17T05:24:14.703829+0000","last_undegraded":"2024-09-17T05:24:14.703829+0000","last_fullsized":"2024-09-17T05:24:14.703829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:17.912893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751739+0000","last_change":"2024-09-17T05:24:13.709701+0000","last_active":"2024-09-17T05:24:14.751739+0000","last_peered":"2024-09-17T05:24:14.751739+0000","last_clean":"2024-09-17T05:24:14.751739+0000","last_became_active":"2024-09-17T05:24:13.708314+0000","last_became_peered":"2024-09-17T05:24:13.708314+0000","last_unstale":"2024-09-17T05:24:14.751739+0000","last_undegraded":"2024-09-17T05:24:14.751739+0000","last_fullsized":"2024-09-17T05:24:14.751739+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:17.770629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"116'8","reported_seq":23,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752889+0000","last_change":"2024-09-17T05:24:12.722884+0000","last_active":"2024-09-17T05:24:14.752889+0000","last_peered":"2024-09-17T05:24:14.752889+0000","last_clean":"2024-09-17T05:24:14.752889+0000","last_became_active":"2024-09-17T05:24:12.722563+0000","last_became_peered":"2024-09-17T05:24:12.722563+0000","last_unstale":"2024-09-17T05:24:14.752889+0000","last_undegraded":"2024-09-17T05:24:14.752889+0000","last_fullsized":"2024-09-17T05:24:14.752889+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:58.714535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751675+0000","last_change":"2024-09-17T05:24:13.713597+0000","last_active":"2024-09-17T05:24:14.751675+0000","last_peered":"2024-09-17T05:24:14.751675+0000","last_clean":"2024-09-17T05:24:14.751675+0000","last_became_active":"2024-09-17T05:24:13.713341+0000","last_became_peered":"2024-09-17T05:24:13.713341+0000","last_unstale":"2024-09-17T05:24:14.751675+0000","last_undegraded":"2024-09-17T05:24:14.751675+0000","last_fullsized":"2024-09-17T05:24:14.751675+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:41.910091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752919+0000","last_change":"2024-09-17T05:24:12.721853+0000","last_active":"2024-09-17T05:24:14.752919+0000","last_peered":"2024-09-17T05:24:14.752919+0000","last_clean":"2024-09-17T05:24:14.752919+0000","last_became_active":"2024-09-17T05:24:12.721574+0000","last_became_peered":"2024-09-17T05:24:12.721574+0000","last_unstale":"2024-09-17T05:24:14.752919+0000","last_undegraded":"2024-09-17T05:24:14.752919+0000","last_fullsized":"2024-09-17T05:24:14.752919+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:58.714535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752626+0000","last_change":"2024-09-17T05:24:13.710270+0000","last_active":"2024-09-17T05:24:14.752626+0000","last_peered":"2024-09-17T05:24:14.752626+0000","last_clean":"2024-09-17T05:24:14.752626+0000","last_became_active":"2024-09-17T05:24:13.709983+0000","last_became_peered":"2024-09-17T05:24:13.709983+0000","last_unstale":"2024-09-17T05:24:14.752626+0000","last_undegraded":"2024-09-17T05:24:14.752626+0000","last_fullsized":"2024-09-17T05:24:14.752626+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:14.090582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751555+0000","last_change":"2024-09-17T05:24:12.721714+0000","last_active":"2024-09-17T05:24:14.751555+0000","last_peered":"2024-09-17T05:24:14.751555+0000","last_clean":"2024-09-17T05:24:14.751555+0000","last_became_active":"2024-09-17T05:24:12.720906+0000","last_became_peered":"2024-09-17T05:24:12.720906+0000","last_unstale":"2024-09-17T05:24:14.751555+0000","last_undegraded":"2024-09-17T05:24:14.751555+0000","last_fullsized":"2024-09-17T05:24:14.751555+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:36.798282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751426+0000","last_change":"2024-09-17T05:24:13.710887+0000","last_active":"2024-09-17T05:24:14.751426+0000","last_peered":"2024-09-17T05:24:14.751426+0000","last_clean":"2024-09-17T05:24:14.751426+0000","last_became_active":"2024-09-17T05:24:13.710526+0000","last_became_peered":"2024-09-17T05:24:13.710526+0000","last_unstale":"2024-09-17T05:24:14.751426+0000","last_undegraded":"2024-09-17T05:24:14.751426+0000","last_fullsized":"2024-09-17T05:24:14.751426+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:19.565402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704934+0000","last_change":"2024-09-17T05:24:12.720027+0000","last_active":"2024-09-17T05:24:14.704934+0000","last_peered":"2024-09-17T05:24:14.704934+0000","last_clean":"2024-09-17T05:24:14.704934+0000","last_became_active":"2024-09-17T05:24:12.719642+0000","last_became_peered":"2024-09-17T05:24:12.719642+0000","last_unstale":"2024-09-17T05:24:14.704934+0000","last_undegraded":"2024-09-17T05:24:14.704934+0000","last_fullsized":"2024-09-17T05:24:14.704934+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:22.897449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704118+0000","last_change":"2024-09-17T05:24:13.726189+0000","last_active":"2024-09-17T05:24:14.704118+0000","last_peered":"2024-09-17T05:24:14.704118+0000","last_clean":"2024-09-17T05:24:14.704118+0000","last_became_active":"2024-09-17T05:24:13.723397+0000","last_became_peered":"2024-09-17T05:24:13.723397+0000","last_unstale":"2024-09-17T05:24:14.704118+0000","last_undegraded":"2024-09-17T05:24:14.704118+0000","last_fullsized":"2024-09-17T05:24:14.704118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:45.070058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751844+0000","last_change":"2024-09-17T05:24:12.725312+0000","last_active":"2024-09-17T05:24:14.751844+0000","last_peered":"2024-09-17T05:24:14.751844+0000","last_clean":"2024-09-17T05:24:14.751844+0000","last_became_active":"2024-09-17T05:24:12.724944+0000","last_became_peered":"2024-09-17T05:24:12.724944+0000","last_unstale":"2024-09-17T05:24:14.751844+0000","last_undegraded":"2024-09-17T05:24:14.751844+0000","last_fullsized":"2024-09-17T05:24:14.751844+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:03.211116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701195+0000","last_change":"2024-09-17T05:24:13.720351+0000","last_active":"2024-09-17T05:24:14.701195+0000","last_peered":"2024-09-17T05:24:14.701195+0000","last_clean":"2024-09-17T05:24:14.701195+0000","last_became_active":"2024-09-17T05:24:13.719551+0000","last_became_peered":"2024-09-17T05:24:13.719551+0000","last_unstale":"2024-09-17T05:24:14.701195+0000","last_undegraded":"2024-09-17T05:24:14.701195+0000","last_fullsized":"2024-09-17T05:24:14.701195+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:18.585144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751916+0000","last_change":"2024-09-17T05:24:12.722972+0000","last_active":"2024-09-17T05:24:14.751916+0000","last_peered":"2024-09-17T05:24:14.751916+0000","last_clean":"2024-09-17T05:24:14.751916+0000","last_became_active":"2024-09-17T05:24:12.722631+0000","last_became_peered":"2024-09-17T05:24:12.722631+0000","last_unstale":"2024-09-17T05:24:14.751916+0000","last_undegraded":"2024-09-17T05:24:14.751916+0000","last_fullsized":"2024-09-17T05:24:14.751916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:59.627166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704989+0000","last_change":"2024-09-17T05:24:13.713868+0000","last_active":"2024-09-17T05:24:14.704989+0000","last_peered":"2024-09-17T05:24:14.704989+0000","last_clean":"2024-09-17T05:24:14.704989+0000","last_became_active":"2024-09-17T05:24:13.713304+0000","last_became_peered":"2024-09-17T05:24:13.713304+0000","last_unstale":"2024-09-17T05:24:14.704989+0000","last_undegraded":"2024-09-17T05:24:14.704989+0000","last_fullsized":"2024-09-17T05:24:14.704989+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:19.968719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751247+0000","last_change":"2024-09-17T05:24:12.722175+0000","last_active":"2024-09-17T05:24:14.751247+0000","last_peered":"2024-09-17T05:24:14.751247+0000","last_clean":"2024-09-17T05:24:14.751247+0000","last_became_active":"2024-09-17T05:24:12.721887+0000","last_became_peered":"2024-09-17T05:24:12.721887+0000","last_unstale":"2024-09-17T05:24:14.751247+0000","last_undegraded":"2024-09-17T05:24:14.751247+0000","last_fullsized":"2024-09-17T05:24:14.751247+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:05.894860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703853+0000","last_change":"2024-09-17T05:24:13.717528+0000","last_active":"2024-09-17T05:24:14.703853+0000","last_peered":"2024-09-17T05:24:14.703853+0000","last_clean":"2024-09-17T05:24:14.703853+0000","last_became_active":"2024-09-17T05:24:13.713911+0000","last_became_peered":"2024-09-17T05:24:13.713911+0000","last_unstale":"2024-09-17T05:24:14.703853+0000","last_undegraded":"2024-09-17T05:24:14.703853+0000","last_fullsized":"2024-09-17T05:24:14.703853+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:07.828887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750660+0000","last_change":"2024-09-17T05:24:12.717903+0000","last_active":"2024-09-17T05:24:14.750660+0000","last_peered":"2024-09-17T05:24:14.750660+0000","last_clean":"2024-09-17T05:24:14.750660+0000","last_became_active":"2024-09-17T05:24:12.717605+0000","last_became_peered":"2024-09-17T05:24:12.717605+0000","last_unstale":"2024-09-17T05:24:14.750660+0000","last_undegraded":"2024-09-17T05:24:14.750660+0000","last_fullsized":"2024-09-17T05:24:14.750660+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:11.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751562+0000","last_change":"2024-09-17T05:24:13.713226+0000","last_active":"2024-09-17T05:24:14.751562+0000","last_peered":"2024-09-17T05:24:14.751562+0000","last_clean":"2024-09-17T05:24:14.751562+0000","last_became_active":"2024-09-17T05:24:13.712962+0000","last_became_peered":"2024-09-17T05:24:13.712962+0000","last_unstale":"2024-09-17T05:24:14.751562+0000","last_undegraded":"2024-09-17T05:24:14.751562+0000","last_fullsized":"2024-09-17T05:24:14.751562+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:37.917371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750761+0000","last_change":"2024-09-17T05:24:12.719527+0000","last_active":"2024-09-17T05:24:14.750761+0000","last_peered":"2024-09-17T05:24:14.750761+0000","last_clean":"2024-09-17T05:24:14.750761+0000","last_became_active":"2024-09-17T05:24:12.719252+0000","last_became_peered":"2024-09-17T05:24:12.719252+0000","last_unstale":"2024-09-17T05:24:14.750761+0000","last_undegraded":"2024-09-17T05:24:14.750761+0000","last_fullsized":"2024-09-17T05:24:14.750761+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:27.063079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.705245+0000","last_change":"2024-09-17T05:24:13.716482+0000","last_active":"2024-09-17T05:24:14.705245+0000","last_peered":"2024-09-17T05:24:14.705245+0000","last_clean":"2024-09-17T05:24:14.705245+0000","last_became_active":"2024-09-17T05:24:13.715235+0000","last_became_peered":"2024-09-17T05:24:13.715235+0000","last_unstale":"2024-09-17T05:24:14.705245+0000","last_undegraded":"2024-09-17T05:24:14.705245+0000","last_fullsized":"2024-09-17T05:24:14.705245+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.483246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701604+0000","last_change":"2024-09-17T05:24:12.720665+0000","last_active":"2024-09-17T05:24:14.701604+0000","last_peered":"2024-09-17T05:24:14.701604+0000","last_clean":"2024-09-17T05:24:14.701604+0000","last_became_active":"2024-09-17T05:24:12.719805+0000","last_became_peered":"2024-09-17T05:24:12.719805+0000","last_unstale":"2024-09-17T05:24:14.701604+0000","last_undegraded":"2024-09-17T05:24:14.701604+0000","last_fullsized":"2024-09-17T05:24:14.701604+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:39.191332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701527+0000","last_change":"2024-09-17T05:24:13.712853+0000","last_active":"2024-09-17T05:24:14.701527+0000","last_peered":"2024-09-17T05:24:14.701527+0000","last_clean":"2024-09-17T05:24:14.701527+0000","last_became_active":"2024-09-17T05:24:13.712574+0000","last_became_peered":"2024-09-17T05:24:13.712574+0000","last_unstale":"2024-09-17T05:24:14.701527+0000","last_undegraded":"2024-09-17T05:24:14.701527+0000","last_fullsized":"2024-09-17T05:24:14.701527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:39.391960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751672+0000","last_change":"2024-09-17T05:24:12.720956+0000","last_active":"2024-09-17T05:24:14.751672+0000","last_peered":"2024-09-17T05:24:14.751672+0000","last_clean":"2024-09-17T05:24:14.751672+0000","last_became_active":"2024-09-17T05:24:12.720677+0000","last_became_peered":"2024-09-17T05:24:12.720677+0000","last_unstale":"2024-09-17T05:24:14.751672+0000","last_undegraded":"2024-09-17T05:24:14.751672+0000","last_fullsized":"2024-09-17T05:24:14.751672+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:43.459753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704052+0000","last_change":"2024-09-17T05:24:13.717549+0000","last_active":"2024-09-17T05:24:14.704052+0000","last_peered":"2024-09-17T05:24:14.704052+0000","last_clean":"2024-09-17T05:24:14.704052+0000","last_became_active":"2024-09-17T05:24:13.717284+0000","last_became_peered":"2024-09-17T05:24:13.717284+0000","last_unstale":"2024-09-17T05:24:14.704052+0000","last_undegraded":"2024-09-17T05:24:14.704052+0000","last_fullsized":"2024-09-17T05:24:14.704052+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:17.770629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703959+0000","last_change":"2024-09-17T05:24:12.723488+0000","last_active":"2024-09-17T05:24:14.703959+0000","last_peered":"2024-09-17T05:24:14.703959+0000","last_clean":"2024-09-17T05:24:14.703959+0000","last_became_active":"2024-09-17T05:24:12.723168+0000","last_became_peered":"2024-09-17T05:24:12.723168+0000","last_unstale":"2024-09-17T05:24:14.703959+0000","last_undegraded":"2024-09-17T05:24:14.703959+0000","last_fullsized":"2024-09-17T05:24:14.703959+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:10.342261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704949+0000","last_change":"2024-09-17T05:24:13.714327+0000","last_active":"2024-09-17T05:24:14.704949+0000","last_peered":"2024-09-17T05:24:14.704949+0000","last_clean":"2024-09-17T05:24:14.704949+0000","last_became_active":"2024-09-17T05:24:13.713987+0000","last_became_peered":"2024-09-17T05:24:13.713987+0000","last_unstale":"2024-09-17T05:24:14.704949+0000","last_undegraded":"2024-09-17T05:24:14.704949+0000","last_fullsized":"2024-09-17T05:24:14.704949+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:39.819211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750801+0000","last_change":"2024-09-17T05:24:12.727151+0000","last_active":"2024-09-17T05:24:14.750801+0000","last_peered":"2024-09-17T05:24:14.750801+0000","last_clean":"2024-09-17T05:24:14.750801+0000","last_became_active":"2024-09-17T05:24:12.726809+0000","last_became_peered":"2024-09-17T05:24:12.726809+0000","last_unstale":"2024-09-17T05:24:14.750801+0000","last_undegraded":"2024-09-17T05:24:14.750801+0000","last_fullsized":"2024-09-17T05:24:14.750801+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:15.333940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751969+0000","last_change":"2024-09-17T05:24:13.721083+0000","last_active":"2024-09-17T05:24:14.751969+0000","last_peered":"2024-09-17T05:24:14.751969+0000","last_clean":"2024-09-17T05:24:14.751969+0000","last_became_active":"2024-09-17T05:24:13.720256+0000","last_became_peered":"2024-09-17T05:24:13.720256+0000","last_unstale":"2024-09-17T05:24:14.751969+0000","last_undegraded":"2024-09-17T05:24:14.751969+0000","last_fullsized":"2024-09-17T05:24:14.751969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:13.611003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703820+0000","last_change":"2024-09-17T05:24:12.719867+0000","last_active":"2024-09-17T05:24:14.703820+0000","last_peered":"2024-09-17T05:24:14.703820+0000","last_clean":"2024-09-17T05:24:14.703820+0000","last_became_active":"2024-09-17T05:24:12.719579+0000","last_became_peered":"2024-09-17T05:24:12.719579+0000","last_unstale":"2024-09-17T05:24:14.703820+0000","last_undegraded":"2024-09-17T05:24:14.703820+0000","last_fullsized":"2024-09-17T05:24:14.703820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:19.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751792+0000","last_change":"2024-09-17T05:24:13.713945+0000","last_active":"2024-09-17T05:24:14.751792+0000","last_peered":"2024-09-17T05:24:14.751792+0000","last_clean":"2024-09-17T05:24:14.751792+0000","last_became_active":"2024-09-17T05:24:13.712100+0000","last_became_peered":"2024-09-17T05:24:13.712100+0000","last_unstale":"2024-09-17T05:24:14.751792+0000","last_undegraded":"2024-09-17T05:24:14.751792+0000","last_fullsized":"2024-09-17T05:24:14.751792+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:29.093680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752082+0000","last_change":"2024-09-17T05:24:12.723088+0000","last_active":"2024-09-17T05:24:14.752082+0000","last_peered":"2024-09-17T05:24:14.752082+0000","last_clean":"2024-09-17T05:24:14.752082+0000","last_became_active":"2024-09-17T05:24:12.722820+0000","last_became_peered":"2024-09-17T05:24:12.722820+0000","last_unstale":"2024-09-17T05:24:14.752082+0000","last_undegraded":"2024-09-17T05:24:14.752082+0000","last_fullsized":"2024-09-17T05:24:14.752082+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:00.212088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750976+0000","last_change":"2024-09-17T05:24:13.707430+0000","last_active":"2024-09-17T05:24:14.750976+0000","last_peered":"2024-09-17T05:24:14.750976+0000","last_clean":"2024-09-17T05:24:14.750976+0000","last_became_active":"2024-09-17T05:24:13.706959+0000","last_became_peered":"2024-09-17T05:24:13.706959+0000","last_unstale":"2024-09-17T05:24:14.750976+0000","last_undegraded":"2024-09-17T05:24:14.750976+0000","last_fullsized":"2024-09-17T05:24:14.750976+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.483246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751174+0000","last_change":"2024-09-17T05:24:12.718546+0000","last_active":"2024-09-17T05:24:14.751174+0000","last_peered":"2024-09-17T05:24:14.751174+0000","last_clean":"2024-09-17T05:24:14.751174+0000","last_became_active":"2024-09-17T05:24:12.718286+0000","last_became_peered":"2024-09-17T05:24:12.718286+0000","last_unstale":"2024-09-17T05:24:14.751174+0000","last_undegraded":"2024-09-17T05:24:14.751174+0000","last_fullsized":"2024-09-17T05:24:14.751174+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:43.459753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703728+0000","last_change":"2024-09-17T05:24:13.716878+0000","last_active":"2024-09-17T05:24:14.703728+0000","last_peered":"2024-09-17T05:24:14.703728+0000","last_clean":"2024-09-17T05:24:14.703728+0000","last_became_active":"2024-09-17T05:24:13.716633+0000","last_became_peered":"2024-09-17T05:24:13.716633+0000","last_unstale":"2024-09-17T05:24:14.703728+0000","last_undegraded":"2024-09-17T05:24:14.703728+0000","last_fullsized":"2024-09-17T05:24:14.703728+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:30.237020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751405+0000","last_change":"2024-09-17T05:24:12.721781+0000","last_active":"2024-09-17T05:24:14.751405+0000","last_peered":"2024-09-17T05:24:14.751405+0000","last_clean":"2024-09-17T05:24:14.751405+0000","last_became_active":"2024-09-17T05:24:12.721513+0000","last_became_peered":"2024-09-17T05:24:12.721513+0000","last_unstale":"2024-09-17T05:24:14.751405+0000","last_undegraded":"2024-09-17T05:24:14.751405+0000","last_fullsized":"2024-09-17T05:24:14.751405+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:20.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751732+0000","last_change":"2024-09-17T05:24:13.725344+0000","last_active":"2024-09-17T05:24:14.751732+0000","last_peered":"2024-09-17T05:24:14.751732+0000","last_clean":"2024-09-17T05:24:14.751732+0000","last_became_active":"2024-09-17T05:24:13.725049+0000","last_became_peered":"2024-09-17T05:24:13.725049+0000","last_unstale":"2024-09-17T05:24:14.751732+0000","last_undegraded":"2024-09-17T05:24:14.751732+0000","last_fullsized":"2024-09-17T05:24:14.751732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.483246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752394+0000","last_change":"2024-09-17T05:24:12.723473+0000","last_active":"2024-09-17T05:24:14.752394+0000","last_peered":"2024-09-17T05:24:14.752394+0000","last_clean":"2024-09-17T05:24:14.752394+0000","last_became_active":"2024-09-17T05:24:12.723166+0000","last_became_peered":"2024-09-17T05:24:12.723166+0000","last_unstale":"2024-09-17T05:24:14.752394+0000","last_undegraded":"2024-09-17T05:24:14.752394+0000","last_fullsized":"2024-09-17T05:24:14.752394+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:10.292836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":307,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751160+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:24:14.751160+0000","last_peered":"2024-09-17T05:24:14.751160+0000","last_clean":"2024-09-17T05:24:14.751160+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:24:14.751160+0000","last_undegraded":"2024-09-17T05:24:14.751160+0000","last_fullsized":"2024-09-17T05:24:14.751160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2060288,"data_stored":1225054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1454080,"data_stored":634048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1462272,"data_stored":638892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1445888,"data_stored":632506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":632596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":639396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509511,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1441792,"data_stored":632436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2035712,"data_stored":1222804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:24:16.678 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:24:16.697 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-17T05:24:16.697+0000 7fbd5308a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:24:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.797+0000 7fa4359d3640 1 -- 172.21.15.81:0/3302677504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 msgr2=0x7fa41c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.797+0000 7fa4359d3640 1 --2- 172.21.15.81:0/3302677504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 0x7fa41c003e50 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fa420001dc0 tx=0x7fa41c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:16.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.797+0000 7fa42f7fe640 1 -- 172.21.15.81:0/3302677504 reap_dead start 2024-09-17T05:24:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.797+0000 7fa4359d3640 1 -- 172.21.15.81:0/3302677504 shutdown_connections 2024-09-17T05:24:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.797+0000 7fa4359d3640 1 -- 172.21.15.81:0/3302677504 >> 172.21.15.81:0/3302677504 conn(0x7fa4300d3e60 msgr2=0x7fa4300d4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.797+0000 7fa4359d3640 1 -- 172.21.15.81:0/3302677504 shutdown_connections 2024-09-17T05:24:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.797+0000 7fa4359d3640 1 -- 172.21.15.81:0/3302677504 wait complete. 2024-09-17T05:24:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.798+0000 7fa4359d3640 1 Processor -- start 2024-09-17T05:24:16.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.798+0000 7fa4359d3640 1 -- start start 2024-09-17T05:24:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa4359d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 0x7fa4300cd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa4359d3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4300cc5e0 0x7fa4300ca820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa4359d3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa43015b1b0 0x7fa4301f79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa4359d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300b20d0 con 0x7fa41c003a30 2024-09-17T05:24:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa4359d3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa4300b5650 con 0x7fa4300cc5e0 2024-09-17T05:24:16.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa4359d3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa4300b2250 con 0x7fa43015b1b0 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 0x7fa4300cd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 0x7fa4300cd2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49612/0 (socket says 172.21.15.81:49612) 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 -- 172.21.15.81:0/1012249851 learned_addr learned my addr 172.21.15.81:0/1012249851 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42f7fe640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa43015b1b0 0x7fa4301f79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 -- 172.21.15.81:0/1012249851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa43015b1b0 msgr2=0x7fa4301f79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa43015b1b0 0x7fa4301f79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 -- 172.21.15.81:0/1012249851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4300cc5e0 msgr2=0x7fa4300ca820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4300cc5e0 0x7fa4300ca820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.799+0000 7fa42effd640 1 -- 172.21.15.81:0/1012249851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4300cd8b0 con 0x7fa41c003a30 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.800+0000 7fa42effd640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 0x7fa4300cd2d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fa420001eb0 tx=0x7fa420006db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.800+0000 7fa42cff9640 1 -- 172.21.15.81:0/1012249851 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa420006250 con 0x7fa41c003a30 2024-09-17T05:24:16.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.800+0000 7fa42cff9640 1 -- 172.21.15.81:0/1012249851 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa4200064e0 con 0x7fa41c003a30 2024-09-17T05:24:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.800+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4300cbb20 con 0x7fa41c003a30 2024-09-17T05:24:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.800+0000 7fa42cff9640 1 -- 172.21.15.81:0/1012249851 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4200068b0 con 0x7fa41c003a30 2024-09-17T05:24:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.800+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa43015b630 con 0x7fa41c003a30 2024-09-17T05:24:16.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.801+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4300b19c0 con 0x7fa41c003a30 2024-09-17T05:24:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.801+0000 7fa42cff9640 1 -- 172.21.15.81:0/1012249851 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fa420033480 con 0x7fa41c003a30 2024-09-17T05:24:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.802+0000 7fa42cff9640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4100791b0 0x7fa41007b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.802+0000 7fa42cff9640 1 -- 172.21.15.81:0/1012249851 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fa4200bba90 con 0x7fa41c003a30 2024-09-17T05:24:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.802+0000 7fa4267fc640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4100791b0 0x7fa41007b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:16.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.802+0000 7fa4267fc640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4100791b0 0x7fa41007b670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4300cd200 tx=0x7fa418005af0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:16.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.806+0000 7fa42cff9640 1 -- 172.21.15.81:0/1012249851 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa4200bde20 con 0x7fa41c003a30 2024-09-17T05:24:16.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.979+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa4300cb8e0 con 0x7fa4100791b0 2024-09-17T05:24:16.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.982+0000 7fa42cff9640 1 -- 172.21.15.81:0/1012249851 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252472 (secure 0 0 0) 0x7fa4300cb8e0 con 0x7fa4100791b0 2024-09-17T05:24:16.986 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:16.987 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4100791b0 msgr2=0x7fa41007b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4100791b0 0x7fa41007b670 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa4300cd200 tx=0x7fa418005af0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 msgr2=0x7fa4300cd2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 0x7fa4300cd2d0 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fa420001eb0 tx=0x7fa420006db0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 shutdown_connections 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa43015b1b0 0x7fa4301f79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4100791b0 0x7fa41007b670 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa4300cc5e0 0x7fa4300ca820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 --2- 172.21.15.81:0/1012249851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa41c003a30 0x7fa4300cd2d0 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 >> 172.21.15.81:0/1012249851 conn(0x7fa4300d3e60 msgr2=0x7fa4300cf3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 shutdown_connections 2024-09-17T05:24:16.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:16.986+0000 7fa4359d3640 1 -- 172.21.15.81:0/1012249851 wait complete. 2024-09-17T05:24:16.999 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":95,"stamp":"2024-09-17T05:24:16.040846+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":157,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":119,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262056,"kb_used_data":12512,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754712664,"statfs":{"total":773094113280,"available":772825767936,"internally_reserved":0,"allocated":12812288,"data_stored":6257732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":24,"apply_latency_ms":24,"commit_latency_ns":24000000,"apply_latency_ns":24000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.338927"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701497+0000","last_change":"2024-09-17T05:24:13.719963+0000","last_active":"2024-09-17T05:24:14.701497+0000","last_peered":"2024-09-17T05:24:14.701497+0000","last_clean":"2024-09-17T05:24:14.701497+0000","last_became_active":"2024-09-17T05:24:13.719678+0000","last_became_peered":"2024-09-17T05:24:13.719678+0000","last_unstale":"2024-09-17T05:24:14.701497+0000","last_undegraded":"2024-09-17T05:24:14.701497+0000","last_fullsized":"2024-09-17T05:24:14.701497+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:45:44.272695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704025+0000","last_change":"2024-09-17T05:24:13.724676+0000","last_active":"2024-09-17T05:24:14.704025+0000","last_peered":"2024-09-17T05:24:14.704025+0000","last_clean":"2024-09-17T05:24:14.704025+0000","last_became_active":"2024-09-17T05:24:13.724423+0000","last_became_peered":"2024-09-17T05:24:13.724423+0000","last_unstale":"2024-09-17T05:24:14.704025+0000","last_undegraded":"2024-09-17T05:24:14.704025+0000","last_fullsized":"2024-09-17T05:24:14.704025+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:52.858863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752431+0000","last_change":"2024-09-17T05:24:13.710229+0000","last_active":"2024-09-17T05:24:14.752431+0000","last_peered":"2024-09-17T05:24:14.752431+0000","last_clean":"2024-09-17T05:24:14.752431+0000","last_became_active":"2024-09-17T05:24:13.709731+0000","last_became_peered":"2024-09-17T05:24:13.709731+0000","last_unstale":"2024-09-17T05:24:14.752431+0000","last_undegraded":"2024-09-17T05:24:14.752431+0000","last_fullsized":"2024-09-17T05:24:14.752431+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:17.655496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701347+0000","last_change":"2024-09-17T05:24:13.719670+0000","last_active":"2024-09-17T05:24:14.701347+0000","last_peered":"2024-09-17T05:24:14.701347+0000","last_clean":"2024-09-17T05:24:14.701347+0000","last_became_active":"2024-09-17T05:24:13.719282+0000","last_became_peered":"2024-09-17T05:24:13.719282+0000","last_unstale":"2024-09-17T05:24:14.701347+0000","last_undegraded":"2024-09-17T05:24:14.701347+0000","last_fullsized":"2024-09-17T05:24:14.701347+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:36.470887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752247+0000","last_change":"2024-09-17T05:24:13.719383+0000","last_active":"2024-09-17T05:24:14.752247+0000","last_peered":"2024-09-17T05:24:14.752247+0000","last_clean":"2024-09-17T05:24:14.752247+0000","last_became_active":"2024-09-17T05:24:13.719086+0000","last_became_peered":"2024-09-17T05:24:13.719086+0000","last_unstale":"2024-09-17T05:24:14.752247+0000","last_undegraded":"2024-09-17T05:24:14.752247+0000","last_fullsized":"2024-09-17T05:24:14.752247+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:47.871465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704745+0000","last_change":"2024-09-17T05:24:13.715685+0000","last_active":"2024-09-17T05:24:14.704745+0000","last_peered":"2024-09-17T05:24:14.704745+0000","last_clean":"2024-09-17T05:24:14.704745+0000","last_became_active":"2024-09-17T05:24:13.715429+0000","last_became_peered":"2024-09-17T05:24:13.715429+0000","last_unstale":"2024-09-17T05:24:14.704745+0000","last_undegraded":"2024-09-17T05:24:14.704745+0000","last_fullsized":"2024-09-17T05:24:14.704745+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.663140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704522+0000","last_change":"2024-09-17T05:24:13.713628+0000","last_active":"2024-09-17T05:24:14.704522+0000","last_peered":"2024-09-17T05:24:14.704522+0000","last_clean":"2024-09-17T05:24:14.704522+0000","last_became_active":"2024-09-17T05:24:13.713391+0000","last_became_peered":"2024-09-17T05:24:13.713391+0000","last_unstale":"2024-09-17T05:24:14.704522+0000","last_undegraded":"2024-09-17T05:24:14.704522+0000","last_fullsized":"2024-09-17T05:24:14.704522+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:52:28.083420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752544+0000","last_change":"2024-09-17T05:24:13.707915+0000","last_active":"2024-09-17T05:24:14.752544+0000","last_peered":"2024-09-17T05:24:14.752544+0000","last_clean":"2024-09-17T05:24:14.752544+0000","last_became_active":"2024-09-17T05:24:13.707570+0000","last_became_peered":"2024-09-17T05:24:13.707570+0000","last_unstale":"2024-09-17T05:24:14.752544+0000","last_undegraded":"2024-09-17T05:24:14.752544+0000","last_fullsized":"2024-09-17T05:24:14.752544+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:23.899014+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752154+0000","last_change":"2024-09-17T05:24:13.712370+0000","last_active":"2024-09-17T05:24:14.752154+0000","last_peered":"2024-09-17T05:24:14.752154+0000","last_clean":"2024-09-17T05:24:14.752154+0000","last_became_active":"2024-09-17T05:24:13.712027+0000","last_became_peered":"2024-09-17T05:24:13.712027+0000","last_unstale":"2024-09-17T05:24:14.752154+0000","last_undegraded":"2024-09-17T05:24:14.752154+0000","last_fullsized":"2024-09-17T05:24:14.752154+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:50:27.857847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704127+0000","last_change":"2024-09-17T05:24:13.725258+0000","last_active":"2024-09-17T05:24:14.704127+0000","last_peered":"2024-09-17T05:24:14.704127+0000","last_clean":"2024-09-17T05:24:14.704127+0000","last_became_active":"2024-09-17T05:24:13.724952+0000","last_became_peered":"2024-09-17T05:24:13.724952+0000","last_unstale":"2024-09-17T05:24:14.704127+0000","last_undegraded":"2024-09-17T05:24:14.704127+0000","last_fullsized":"2024-09-17T05:24:14.704127+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:09.281535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751095+0000","last_change":"2024-09-17T05:24:13.724685+0000","last_active":"2024-09-17T05:24:14.751095+0000","last_peered":"2024-09-17T05:24:14.751095+0000","last_clean":"2024-09-17T05:24:14.751095+0000","last_became_active":"2024-09-17T05:24:13.724375+0000","last_became_peered":"2024-09-17T05:24:13.724375+0000","last_unstale":"2024-09-17T05:24:14.751095+0000","last_undegraded":"2024-09-17T05:24:14.751095+0000","last_fullsized":"2024-09-17T05:24:14.751095+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:25:11.291533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751640+0000","last_change":"2024-09-17T05:24:13.708867+0000","last_active":"2024-09-17T05:24:14.751640+0000","last_peered":"2024-09-17T05:24:14.751640+0000","last_clean":"2024-09-17T05:24:14.751640+0000","last_became_active":"2024-09-17T05:24:13.708310+0000","last_became_peered":"2024-09-17T05:24:13.708310+0000","last_unstale":"2024-09-17T05:24:14.751640+0000","last_undegraded":"2024-09-17T05:24:14.751640+0000","last_fullsized":"2024-09-17T05:24:14.751640+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:14.090582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701461+0000","last_change":"2024-09-17T05:24:13.715912+0000","last_active":"2024-09-17T05:24:14.701461+0000","last_peered":"2024-09-17T05:24:14.701461+0000","last_clean":"2024-09-17T05:24:14.701461+0000","last_became_active":"2024-09-17T05:24:13.715660+0000","last_became_peered":"2024-09-17T05:24:13.715660+0000","last_unstale":"2024-09-17T05:24:14.701461+0000","last_undegraded":"2024-09-17T05:24:14.701461+0000","last_fullsized":"2024-09-17T05:24:14.701461+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:48.889269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703847+0000","last_change":"2024-09-17T05:24:13.715993+0000","last_active":"2024-09-17T05:24:14.703847+0000","last_peered":"2024-09-17T05:24:14.703847+0000","last_clean":"2024-09-17T05:24:14.703847+0000","last_became_active":"2024-09-17T05:24:13.713708+0000","last_became_peered":"2024-09-17T05:24:13.713708+0000","last_unstale":"2024-09-17T05:24:14.703847+0000","last_undegraded":"2024-09-17T05:24:14.703847+0000","last_fullsized":"2024-09-17T05:24:14.703847+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:29.093680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701068+0000","last_change":"2024-09-17T05:24:13.712229+0000","last_active":"2024-09-17T05:24:14.701068+0000","last_peered":"2024-09-17T05:24:14.701068+0000","last_clean":"2024-09-17T05:24:14.701068+0000","last_became_active":"2024-09-17T05:24:13.711963+0000","last_became_peered":"2024-09-17T05:24:13.711963+0000","last_unstale":"2024-09-17T05:24:14.701068+0000","last_undegraded":"2024-09-17T05:24:14.701068+0000","last_fullsized":"2024-09-17T05:24:14.701068+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:44:34.145838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750774+0000","last_change":"2024-09-17T05:24:13.711697+0000","last_active":"2024-09-17T05:24:14.750774+0000","last_peered":"2024-09-17T05:24:14.750774+0000","last_clean":"2024-09-17T05:24:14.750774+0000","last_became_active":"2024-09-17T05:24:13.711472+0000","last_became_peered":"2024-09-17T05:24:13.711472+0000","last_unstale":"2024-09-17T05:24:14.750774+0000","last_undegraded":"2024-09-17T05:24:14.750774+0000","last_fullsized":"2024-09-17T05:24:14.750774+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:37.917371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.705152+0000","last_change":"2024-09-17T05:24:13.715016+0000","last_active":"2024-09-17T05:24:14.705152+0000","last_peered":"2024-09-17T05:24:14.705152+0000","last_clean":"2024-09-17T05:24:14.705152+0000","last_became_active":"2024-09-17T05:24:13.714758+0000","last_became_peered":"2024-09-17T05:24:13.714758+0000","last_unstale":"2024-09-17T05:24:14.705152+0000","last_undegraded":"2024-09-17T05:24:14.705152+0000","last_fullsized":"2024-09-17T05:24:14.705152+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:37.917371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751345+0000","last_change":"2024-09-17T05:24:13.717555+0000","last_active":"2024-09-17T05:24:14.751345+0000","last_peered":"2024-09-17T05:24:14.751345+0000","last_clean":"2024-09-17T05:24:14.751345+0000","last_became_active":"2024-09-17T05:24:13.717254+0000","last_became_peered":"2024-09-17T05:24:13.717254+0000","last_unstale":"2024-09-17T05:24:14.751345+0000","last_undegraded":"2024-09-17T05:24:14.751345+0000","last_fullsized":"2024-09-17T05:24:14.751345+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:21.842848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751327+0000","last_change":"2024-09-17T05:24:13.716009+0000","last_active":"2024-09-17T05:24:14.751327+0000","last_peered":"2024-09-17T05:24:14.751327+0000","last_clean":"2024-09-17T05:24:14.751327+0000","last_became_active":"2024-09-17T05:24:13.715733+0000","last_became_peered":"2024-09-17T05:24:13.715733+0000","last_unstale":"2024-09-17T05:24:14.751327+0000","last_undegraded":"2024-09-17T05:24:14.751327+0000","last_fullsized":"2024-09-17T05:24:14.751327+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:01:48.720794+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751391+0000","last_change":"2024-09-17T05:24:13.714993+0000","last_active":"2024-09-17T05:24:14.751391+0000","last_peered":"2024-09-17T05:24:14.751391+0000","last_clean":"2024-09-17T05:24:14.751391+0000","last_became_active":"2024-09-17T05:24:13.714745+0000","last_became_peered":"2024-09-17T05:24:13.714745+0000","last_unstale":"2024-09-17T05:24:14.751391+0000","last_undegraded":"2024-09-17T05:24:14.751391+0000","last_fullsized":"2024-09-17T05:24:14.751391+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:47.871465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752020+0000","last_change":"2024-09-17T05:24:13.716858+0000","last_active":"2024-09-17T05:24:14.752020+0000","last_peered":"2024-09-17T05:24:14.752020+0000","last_clean":"2024-09-17T05:24:14.752020+0000","last_became_active":"2024-09-17T05:24:13.716583+0000","last_became_peered":"2024-09-17T05:24:13.716583+0000","last_unstale":"2024-09-17T05:24:14.752020+0000","last_undegraded":"2024-09-17T05:24:14.752020+0000","last_fullsized":"2024-09-17T05:24:14.752020+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:21.842848+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750805+0000","last_change":"2024-09-17T05:24:13.714349+0000","last_active":"2024-09-17T05:24:14.750805+0000","last_peered":"2024-09-17T05:24:14.750805+0000","last_clean":"2024-09-17T05:24:14.750805+0000","last_became_active":"2024-09-17T05:24:13.714090+0000","last_became_peered":"2024-09-17T05:24:13.714090+0000","last_unstale":"2024-09-17T05:24:14.750805+0000","last_undegraded":"2024-09-17T05:24:14.750805+0000","last_fullsized":"2024-09-17T05:24:14.750805+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:41.509068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752051+0000","last_change":"2024-09-17T05:24:13.708466+0000","last_active":"2024-09-17T05:24:14.752051+0000","last_peered":"2024-09-17T05:24:14.752051+0000","last_clean":"2024-09-17T05:24:14.752051+0000","last_became_active":"2024-09-17T05:24:13.708157+0000","last_became_peered":"2024-09-17T05:24:13.708157+0000","last_unstale":"2024-09-17T05:24:14.752051+0000","last_undegraded":"2024-09-17T05:24:14.752051+0000","last_fullsized":"2024-09-17T05:24:14.752051+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:30:42.813994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750665+0000","last_change":"2024-09-17T05:24:13.711518+0000","last_active":"2024-09-17T05:24:14.750665+0000","last_peered":"2024-09-17T05:24:14.750665+0000","last_clean":"2024-09-17T05:24:14.750665+0000","last_became_active":"2024-09-17T05:24:13.711087+0000","last_became_peered":"2024-09-17T05:24:13.711087+0000","last_unstale":"2024-09-17T05:24:14.750665+0000","last_undegraded":"2024-09-17T05:24:14.750665+0000","last_fullsized":"2024-09-17T05:24:14.750665+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:33:13.838726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704009+0000","last_change":"2024-09-17T05:24:13.717026+0000","last_active":"2024-09-17T05:24:14.704009+0000","last_peered":"2024-09-17T05:24:14.704009+0000","last_clean":"2024-09-17T05:24:14.704009+0000","last_became_active":"2024-09-17T05:24:13.716752+0000","last_became_peered":"2024-09-17T05:24:13.716752+0000","last_unstale":"2024-09-17T05:24:14.704009+0000","last_undegraded":"2024-09-17T05:24:14.704009+0000","last_fullsized":"2024-09-17T05:24:14.704009+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:14.090582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751437+0000","last_change":"2024-09-17T05:24:13.712621+0000","last_active":"2024-09-17T05:24:14.751437+0000","last_peered":"2024-09-17T05:24:14.751437+0000","last_clean":"2024-09-17T05:24:14.751437+0000","last_became_active":"2024-09-17T05:24:13.712358+0000","last_became_peered":"2024-09-17T05:24:13.712358+0000","last_unstale":"2024-09-17T05:24:14.751437+0000","last_undegraded":"2024-09-17T05:24:14.751437+0000","last_fullsized":"2024-09-17T05:24:14.751437+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:14.630085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701280+0000","last_change":"2024-09-17T05:24:13.719995+0000","last_active":"2024-09-17T05:24:14.701280+0000","last_peered":"2024-09-17T05:24:14.701280+0000","last_clean":"2024-09-17T05:24:14.701280+0000","last_became_active":"2024-09-17T05:24:13.719551+0000","last_became_peered":"2024-09-17T05:24:13.719551+0000","last_unstale":"2024-09-17T05:24:14.701280+0000","last_undegraded":"2024-09-17T05:24:14.701280+0000","last_fullsized":"2024-09-17T05:24:14.701280+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:20:31.360563+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751717+0000","last_change":"2024-09-17T05:24:13.711079+0000","last_active":"2024-09-17T05:24:14.751717+0000","last_peered":"2024-09-17T05:24:14.751717+0000","last_clean":"2024-09-17T05:24:14.751717+0000","last_became_active":"2024-09-17T05:24:13.710807+0000","last_became_peered":"2024-09-17T05:24:13.710807+0000","last_unstale":"2024-09-17T05:24:14.751717+0000","last_undegraded":"2024-09-17T05:24:14.751717+0000","last_fullsized":"2024-09-17T05:24:14.751717+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:30.237020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701489+0000","last_change":"2024-09-17T05:24:13.711676+0000","last_active":"2024-09-17T05:24:14.701489+0000","last_peered":"2024-09-17T05:24:14.701489+0000","last_clean":"2024-09-17T05:24:14.701489+0000","last_became_active":"2024-09-17T05:24:13.711063+0000","last_became_peered":"2024-09-17T05:24:13.711063+0000","last_unstale":"2024-09-17T05:24:14.701489+0000","last_undegraded":"2024-09-17T05:24:14.701489+0000","last_fullsized":"2024-09-17T05:24:14.701489+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:45.714777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701258+0000","last_change":"2024-09-17T05:24:13.712876+0000","last_active":"2024-09-17T05:24:14.701258+0000","last_peered":"2024-09-17T05:24:14.701258+0000","last_clean":"2024-09-17T05:24:14.701258+0000","last_became_active":"2024-09-17T05:24:13.712603+0000","last_became_peered":"2024-09-17T05:24:13.712603+0000","last_unstale":"2024-09-17T05:24:14.701258+0000","last_undegraded":"2024-09-17T05:24:14.701258+0000","last_fullsized":"2024-09-17T05:24:14.701258+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:07:03.129876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752421+0000","last_change":"2024-09-17T05:24:13.725294+0000","last_active":"2024-09-17T05:24:14.752421+0000","last_peered":"2024-09-17T05:24:14.752421+0000","last_clean":"2024-09-17T05:24:14.752421+0000","last_became_active":"2024-09-17T05:24:13.725027+0000","last_became_peered":"2024-09-17T05:24:13.725027+0000","last_unstale":"2024-09-17T05:24:14.752421+0000","last_undegraded":"2024-09-17T05:24:14.752421+0000","last_fullsized":"2024-09-17T05:24:14.752421+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:14.630085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704450+0000","last_change":"2024-09-17T05:24:13.714712+0000","last_active":"2024-09-17T05:24:14.704450+0000","last_peered":"2024-09-17T05:24:14.704450+0000","last_clean":"2024-09-17T05:24:14.704450+0000","last_became_active":"2024-09-17T05:24:13.714447+0000","last_became_peered":"2024-09-17T05:24:13.714447+0000","last_unstale":"2024-09-17T05:24:14.704450+0000","last_undegraded":"2024-09-17T05:24:14.704450+0000","last_fullsized":"2024-09-17T05:24:14.704450+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:30:19.122444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751530+0000","last_change":"2024-09-17T05:24:13.711299+0000","last_active":"2024-09-17T05:24:14.751530+0000","last_peered":"2024-09-17T05:24:14.751530+0000","last_clean":"2024-09-17T05:24:14.751530+0000","last_became_active":"2024-09-17T05:24:13.711013+0000","last_became_peered":"2024-09-17T05:24:13.711013+0000","last_unstale":"2024-09-17T05:24:14.751530+0000","last_undegraded":"2024-09-17T05:24:14.751530+0000","last_fullsized":"2024-09-17T05:24:14.751530+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:23.326418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"116'4","reported_seq":19,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752360+0000","last_change":"2024-09-17T05:24:12.725911+0000","last_active":"2024-09-17T05:24:14.752360+0000","last_peered":"2024-09-17T05:24:14.752360+0000","last_clean":"2024-09-17T05:24:14.752360+0000","last_became_active":"2024-09-17T05:24:12.725513+0000","last_became_peered":"2024-09-17T05:24:12.725513+0000","last_unstale":"2024-09-17T05:24:14.752360+0000","last_undegraded":"2024-09-17T05:24:14.752360+0000","last_fullsized":"2024-09-17T05:24:14.752360+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:11.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752026+0000","last_change":"2024-09-17T05:24:13.714550+0000","last_active":"2024-09-17T05:24:14.752026+0000","last_peered":"2024-09-17T05:24:14.752026+0000","last_clean":"2024-09-17T05:24:14.752026+0000","last_became_active":"2024-09-17T05:24:13.714299+0000","last_became_peered":"2024-09-17T05:24:13.714299+0000","last_unstale":"2024-09-17T05:24:14.752026+0000","last_undegraded":"2024-09-17T05:24:14.752026+0000","last_fullsized":"2024-09-17T05:24:14.752026+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:45.070058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752136+0000","last_change":"2024-09-17T05:24:12.724408+0000","last_active":"2024-09-17T05:24:14.752136+0000","last_peered":"2024-09-17T05:24:14.752136+0000","last_clean":"2024-09-17T05:24:14.752136+0000","last_became_active":"2024-09-17T05:24:12.724051+0000","last_became_peered":"2024-09-17T05:24:12.724051+0000","last_unstale":"2024-09-17T05:24:14.752136+0000","last_undegraded":"2024-09-17T05:24:14.752136+0000","last_fullsized":"2024-09-17T05:24:14.752136+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:02.850979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752775+0000","last_change":"2024-09-17T05:24:13.719502+0000","last_active":"2024-09-17T05:24:14.752775+0000","last_peered":"2024-09-17T05:24:14.752775+0000","last_clean":"2024-09-17T05:24:14.752775+0000","last_became_active":"2024-09-17T05:24:13.719261+0000","last_became_peered":"2024-09-17T05:24:13.719261+0000","last_unstale":"2024-09-17T05:24:14.752775+0000","last_undegraded":"2024-09-17T05:24:14.752775+0000","last_fullsized":"2024-09-17T05:24:14.752775+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:13:55.098580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751394+0000","last_change":"2024-09-17T05:24:12.724220+0000","last_active":"2024-09-17T05:24:14.751394+0000","last_peered":"2024-09-17T05:24:14.751394+0000","last_clean":"2024-09-17T05:24:14.751394+0000","last_became_active":"2024-09-17T05:24:12.723925+0000","last_became_peered":"2024-09-17T05:24:12.723925+0000","last_unstale":"2024-09-17T05:24:14.751394+0000","last_undegraded":"2024-09-17T05:24:14.751394+0000","last_fullsized":"2024-09-17T05:24:14.751394+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:23.549917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752306+0000","last_change":"2024-09-17T05:24:13.726701+0000","last_active":"2024-09-17T05:24:14.752306+0000","last_peered":"2024-09-17T05:24:14.752306+0000","last_clean":"2024-09-17T05:24:14.752306+0000","last_became_active":"2024-09-17T05:24:13.726454+0000","last_became_peered":"2024-09-17T05:24:13.726454+0000","last_unstale":"2024-09-17T05:24:14.752306+0000","last_undegraded":"2024-09-17T05:24:14.752306+0000","last_fullsized":"2024-09-17T05:24:14.752306+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:19.565402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703974+0000","last_change":"2024-09-17T05:24:12.726353+0000","last_active":"2024-09-17T05:24:14.703974+0000","last_peered":"2024-09-17T05:24:14.703974+0000","last_clean":"2024-09-17T05:24:14.703974+0000","last_became_active":"2024-09-17T05:24:12.725883+0000","last_became_peered":"2024-09-17T05:24:12.725883+0000","last_unstale":"2024-09-17T05:24:14.703974+0000","last_undegraded":"2024-09-17T05:24:14.703974+0000","last_fullsized":"2024-09-17T05:24:14.703974+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:41:49.292076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751021+0000","last_change":"2024-09-17T05:24:13.718350+0000","last_active":"2024-09-17T05:24:14.751021+0000","last_peered":"2024-09-17T05:24:14.751021+0000","last_clean":"2024-09-17T05:24:14.751021+0000","last_became_active":"2024-09-17T05:24:13.718085+0000","last_became_peered":"2024-09-17T05:24:13.718085+0000","last_unstale":"2024-09-17T05:24:14.751021+0000","last_undegraded":"2024-09-17T05:24:14.751021+0000","last_fullsized":"2024-09-17T05:24:14.751021+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:13.611003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703711+0000","last_change":"2024-09-17T05:24:12.727711+0000","last_active":"2024-09-17T05:24:14.703711+0000","last_peered":"2024-09-17T05:24:14.703711+0000","last_clean":"2024-09-17T05:24:14.703711+0000","last_became_active":"2024-09-17T05:24:12.727406+0000","last_became_peered":"2024-09-17T05:24:12.727406+0000","last_unstale":"2024-09-17T05:24:14.703711+0000","last_undegraded":"2024-09-17T05:24:14.703711+0000","last_fullsized":"2024-09-17T05:24:14.703711+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:36:41.287331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704744+0000","last_change":"2024-09-17T05:24:13.714223+0000","last_active":"2024-09-17T05:24:14.704744+0000","last_peered":"2024-09-17T05:24:14.704744+0000","last_clean":"2024-09-17T05:24:14.704744+0000","last_became_active":"2024-09-17T05:24:13.713592+0000","last_became_peered":"2024-09-17T05:24:13.713592+0000","last_unstale":"2024-09-17T05:24:14.704744+0000","last_undegraded":"2024-09-17T05:24:14.704744+0000","last_fullsized":"2024-09-17T05:24:14.704744+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:19:54.578026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751149+0000","last_change":"2024-09-17T05:24:12.724067+0000","last_active":"2024-09-17T05:24:14.751149+0000","last_peered":"2024-09-17T05:24:14.751149+0000","last_clean":"2024-09-17T05:24:14.751149+0000","last_became_active":"2024-09-17T05:24:12.723795+0000","last_became_peered":"2024-09-17T05:24:12.723795+0000","last_unstale":"2024-09-17T05:24:14.751149+0000","last_undegraded":"2024-09-17T05:24:14.751149+0000","last_fullsized":"2024-09-17T05:24:14.751149+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:10.292836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752764+0000","last_change":"2024-09-17T05:24:13.704947+0000","last_active":"2024-09-17T05:24:14.752764+0000","last_peered":"2024-09-17T05:24:14.752764+0000","last_clean":"2024-09-17T05:24:14.752764+0000","last_became_active":"2024-09-17T05:24:13.704527+0000","last_became_peered":"2024-09-17T05:24:13.704527+0000","last_unstale":"2024-09-17T05:24:14.752764+0000","last_undegraded":"2024-09-17T05:24:14.752764+0000","last_fullsized":"2024-09-17T05:24:14.752764+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:17:51.798907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704389+0000","last_change":"2024-09-17T05:24:12.717905+0000","last_active":"2024-09-17T05:24:14.704389+0000","last_peered":"2024-09-17T05:24:14.704389+0000","last_clean":"2024-09-17T05:24:14.704389+0000","last_became_active":"2024-09-17T05:24:12.717634+0000","last_became_peered":"2024-09-17T05:24:12.717634+0000","last_unstale":"2024-09-17T05:24:14.704389+0000","last_undegraded":"2024-09-17T05:24:14.704389+0000","last_fullsized":"2024-09-17T05:24:14.704389+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:16.653931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703694+0000","last_change":"2024-09-17T05:24:13.715128+0000","last_active":"2024-09-17T05:24:14.703694+0000","last_peered":"2024-09-17T05:24:14.703694+0000","last_clean":"2024-09-17T05:24:14.703694+0000","last_became_active":"2024-09-17T05:24:13.714818+0000","last_became_peered":"2024-09-17T05:24:13.714818+0000","last_unstale":"2024-09-17T05:24:14.703694+0000","last_undegraded":"2024-09-17T05:24:14.703694+0000","last_fullsized":"2024-09-17T05:24:14.703694+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:28:12.107916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703811+0000","last_change":"2024-09-17T05:24:12.721910+0000","last_active":"2024-09-17T05:24:14.703811+0000","last_peered":"2024-09-17T05:24:14.703811+0000","last_clean":"2024-09-17T05:24:14.703811+0000","last_became_active":"2024-09-17T05:24:12.721652+0000","last_became_peered":"2024-09-17T05:24:12.721652+0000","last_unstale":"2024-09-17T05:24:14.703811+0000","last_undegraded":"2024-09-17T05:24:14.703811+0000","last_fullsized":"2024-09-17T05:24:14.703811+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:04.123266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701451+0000","last_change":"2024-09-17T05:24:13.711925+0000","last_active":"2024-09-17T05:24:14.701451+0000","last_peered":"2024-09-17T05:24:14.701451+0000","last_clean":"2024-09-17T05:24:14.701451+0000","last_became_active":"2024-09-17T05:24:13.711513+0000","last_became_peered":"2024-09-17T05:24:13.711513+0000","last_unstale":"2024-09-17T05:24:14.701451+0000","last_undegraded":"2024-09-17T05:24:14.701451+0000","last_fullsized":"2024-09-17T05:24:14.701451+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:19.664164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752807+0000","last_change":"2024-09-17T05:24:12.722894+0000","last_active":"2024-09-17T05:24:14.752807+0000","last_peered":"2024-09-17T05:24:14.752807+0000","last_clean":"2024-09-17T05:24:14.752807+0000","last_became_active":"2024-09-17T05:24:12.722566+0000","last_became_peered":"2024-09-17T05:24:12.722566+0000","last_unstale":"2024-09-17T05:24:14.752807+0000","last_undegraded":"2024-09-17T05:24:14.752807+0000","last_fullsized":"2024-09-17T05:24:14.752807+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:59.768999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752429+0000","last_change":"2024-09-17T05:24:13.710276+0000","last_active":"2024-09-17T05:24:14.752429+0000","last_peered":"2024-09-17T05:24:14.752429+0000","last_clean":"2024-09-17T05:24:14.752429+0000","last_became_active":"2024-09-17T05:24:13.709971+0000","last_became_peered":"2024-09-17T05:24:13.709971+0000","last_unstale":"2024-09-17T05:24:14.752429+0000","last_undegraded":"2024-09-17T05:24:14.752429+0000","last_fullsized":"2024-09-17T05:24:14.752429+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:34:48.662889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751492+0000","last_change":"2024-09-17T05:24:12.719470+0000","last_active":"2024-09-17T05:24:14.751492+0000","last_peered":"2024-09-17T05:24:14.751492+0000","last_clean":"2024-09-17T05:24:14.751492+0000","last_became_active":"2024-09-17T05:24:12.719143+0000","last_became_peered":"2024-09-17T05:24:12.719143+0000","last_unstale":"2024-09-17T05:24:14.751492+0000","last_undegraded":"2024-09-17T05:24:14.751492+0000","last_fullsized":"2024-09-17T05:24:14.751492+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:01.864170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752750+0000","last_change":"2024-09-17T05:24:13.715466+0000","last_active":"2024-09-17T05:24:14.752750+0000","last_peered":"2024-09-17T05:24:14.752750+0000","last_clean":"2024-09-17T05:24:14.752750+0000","last_became_active":"2024-09-17T05:24:13.715114+0000","last_became_peered":"2024-09-17T05:24:13.715114+0000","last_unstale":"2024-09-17T05:24:14.752750+0000","last_undegraded":"2024-09-17T05:24:14.752750+0000","last_fullsized":"2024-09-17T05:24:14.752750+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:33:18.956212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"116'3","reported_seq":18,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752047+0000","last_change":"2024-09-17T05:24:12.725893+0000","last_active":"2024-09-17T05:24:14.752047+0000","last_peered":"2024-09-17T05:24:14.752047+0000","last_clean":"2024-09-17T05:24:14.752047+0000","last_became_active":"2024-09-17T05:24:12.725577+0000","last_became_peered":"2024-09-17T05:24:12.725577+0000","last_unstale":"2024-09-17T05:24:14.752047+0000","last_undegraded":"2024-09-17T05:24:14.752047+0000","last_fullsized":"2024-09-17T05:24:14.752047+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:42:21.111120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752487+0000","last_change":"2024-09-17T05:24:13.718530+0000","last_active":"2024-09-17T05:24:14.752487+0000","last_peered":"2024-09-17T05:24:14.752487+0000","last_clean":"2024-09-17T05:24:14.752487+0000","last_became_active":"2024-09-17T05:24:13.718184+0000","last_became_peered":"2024-09-17T05:24:13.718184+0000","last_unstale":"2024-09-17T05:24:14.752487+0000","last_undegraded":"2024-09-17T05:24:14.752487+0000","last_fullsized":"2024-09-17T05:24:14.752487+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:23.326418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"116'6","reported_seq":21,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751773+0000","last_change":"2024-09-17T05:24:12.717488+0000","last_active":"2024-09-17T05:24:14.751773+0000","last_peered":"2024-09-17T05:24:14.751773+0000","last_clean":"2024-09-17T05:24:14.751773+0000","last_became_active":"2024-09-17T05:24:12.717170+0000","last_became_peered":"2024-09-17T05:24:12.717170+0000","last_unstale":"2024-09-17T05:24:14.751773+0000","last_undegraded":"2024-09-17T05:24:14.751773+0000","last_fullsized":"2024-09-17T05:24:14.751773+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:59.768999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701633+0000","last_change":"2024-09-17T05:24:13.711398+0000","last_active":"2024-09-17T05:24:14.701633+0000","last_peered":"2024-09-17T05:24:14.701633+0000","last_clean":"2024-09-17T05:24:14.701633+0000","last_became_active":"2024-09-17T05:24:13.710794+0000","last_became_peered":"2024-09-17T05:24:13.710794+0000","last_unstale":"2024-09-17T05:24:14.701633+0000","last_undegraded":"2024-09-17T05:24:14.701633+0000","last_fullsized":"2024-09-17T05:24:14.701633+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:44:21.161006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701295+0000","last_change":"2024-09-17T05:24:12.711267+0000","last_active":"2024-09-17T05:24:14.701295+0000","last_peered":"2024-09-17T05:24:14.701295+0000","last_clean":"2024-09-17T05:24:14.701295+0000","last_became_active":"2024-09-17T05:24:12.710967+0000","last_became_peered":"2024-09-17T05:24:12.710967+0000","last_unstale":"2024-09-17T05:24:14.701295+0000","last_undegraded":"2024-09-17T05:24:14.701295+0000","last_fullsized":"2024-09-17T05:24:14.701295+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:06.283226+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703706+0000","last_change":"2024-09-17T05:24:13.718987+0000","last_active":"2024-09-17T05:24:14.703706+0000","last_peered":"2024-09-17T05:24:14.703706+0000","last_clean":"2024-09-17T05:24:14.703706+0000","last_became_active":"2024-09-17T05:24:13.718700+0000","last_became_peered":"2024-09-17T05:24:13.718700+0000","last_unstale":"2024-09-17T05:24:14.703706+0000","last_undegraded":"2024-09-17T05:24:14.703706+0000","last_fullsized":"2024-09-17T05:24:14.703706+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:18:15.880802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703829+0000","last_change":"2024-09-17T05:24:12.723321+0000","last_active":"2024-09-17T05:24:14.703829+0000","last_peered":"2024-09-17T05:24:14.703829+0000","last_clean":"2024-09-17T05:24:14.703829+0000","last_became_active":"2024-09-17T05:24:12.723029+0000","last_became_peered":"2024-09-17T05:24:12.723029+0000","last_unstale":"2024-09-17T05:24:14.703829+0000","last_undegraded":"2024-09-17T05:24:14.703829+0000","last_fullsized":"2024-09-17T05:24:14.703829+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:17.912893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751739+0000","last_change":"2024-09-17T05:24:13.709701+0000","last_active":"2024-09-17T05:24:14.751739+0000","last_peered":"2024-09-17T05:24:14.751739+0000","last_clean":"2024-09-17T05:24:14.751739+0000","last_became_active":"2024-09-17T05:24:13.708314+0000","last_became_peered":"2024-09-17T05:24:13.708314+0000","last_unstale":"2024-09-17T05:24:14.751739+0000","last_undegraded":"2024-09-17T05:24:14.751739+0000","last_fullsized":"2024-09-17T05:24:14.751739+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:17.770629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"116'8","reported_seq":23,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752889+0000","last_change":"2024-09-17T05:24:12.722884+0000","last_active":"2024-09-17T05:24:14.752889+0000","last_peered":"2024-09-17T05:24:14.752889+0000","last_clean":"2024-09-17T05:24:14.752889+0000","last_became_active":"2024-09-17T05:24:12.722563+0000","last_became_peered":"2024-09-17T05:24:12.722563+0000","last_unstale":"2024-09-17T05:24:14.752889+0000","last_undegraded":"2024-09-17T05:24:14.752889+0000","last_fullsized":"2024-09-17T05:24:14.752889+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:58.714535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751675+0000","last_change":"2024-09-17T05:24:13.713597+0000","last_active":"2024-09-17T05:24:14.751675+0000","last_peered":"2024-09-17T05:24:14.751675+0000","last_clean":"2024-09-17T05:24:14.751675+0000","last_became_active":"2024-09-17T05:24:13.713341+0000","last_became_peered":"2024-09-17T05:24:13.713341+0000","last_unstale":"2024-09-17T05:24:14.751675+0000","last_undegraded":"2024-09-17T05:24:14.751675+0000","last_fullsized":"2024-09-17T05:24:14.751675+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:06:41.910091+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752919+0000","last_change":"2024-09-17T05:24:12.721853+0000","last_active":"2024-09-17T05:24:14.752919+0000","last_peered":"2024-09-17T05:24:14.752919+0000","last_clean":"2024-09-17T05:24:14.752919+0000","last_became_active":"2024-09-17T05:24:12.721574+0000","last_became_peered":"2024-09-17T05:24:12.721574+0000","last_unstale":"2024-09-17T05:24:14.752919+0000","last_undegraded":"2024-09-17T05:24:14.752919+0000","last_fullsized":"2024-09-17T05:24:14.752919+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:56:58.714535+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752626+0000","last_change":"2024-09-17T05:24:13.710270+0000","last_active":"2024-09-17T05:24:14.752626+0000","last_peered":"2024-09-17T05:24:14.752626+0000","last_clean":"2024-09-17T05:24:14.752626+0000","last_became_active":"2024-09-17T05:24:13.709983+0000","last_became_peered":"2024-09-17T05:24:13.709983+0000","last_unstale":"2024-09-17T05:24:14.752626+0000","last_undegraded":"2024-09-17T05:24:14.752626+0000","last_fullsized":"2024-09-17T05:24:14.752626+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:51:14.090582+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751555+0000","last_change":"2024-09-17T05:24:12.721714+0000","last_active":"2024-09-17T05:24:14.751555+0000","last_peered":"2024-09-17T05:24:14.751555+0000","last_clean":"2024-09-17T05:24:14.751555+0000","last_became_active":"2024-09-17T05:24:12.720906+0000","last_became_peered":"2024-09-17T05:24:12.720906+0000","last_unstale":"2024-09-17T05:24:14.751555+0000","last_undegraded":"2024-09-17T05:24:14.751555+0000","last_fullsized":"2024-09-17T05:24:14.751555+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:47:36.798282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751426+0000","last_change":"2024-09-17T05:24:13.710887+0000","last_active":"2024-09-17T05:24:14.751426+0000","last_peered":"2024-09-17T05:24:14.751426+0000","last_clean":"2024-09-17T05:24:14.751426+0000","last_became_active":"2024-09-17T05:24:13.710526+0000","last_became_peered":"2024-09-17T05:24:13.710526+0000","last_unstale":"2024-09-17T05:24:14.751426+0000","last_undegraded":"2024-09-17T05:24:14.751426+0000","last_fullsized":"2024-09-17T05:24:14.751426+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:19.565402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"116'1","reported_seq":16,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704934+0000","last_change":"2024-09-17T05:24:12.720027+0000","last_active":"2024-09-17T05:24:14.704934+0000","last_peered":"2024-09-17T05:24:14.704934+0000","last_clean":"2024-09-17T05:24:14.704934+0000","last_became_active":"2024-09-17T05:24:12.719642+0000","last_became_peered":"2024-09-17T05:24:12.719642+0000","last_unstale":"2024-09-17T05:24:14.704934+0000","last_undegraded":"2024-09-17T05:24:14.704934+0000","last_fullsized":"2024-09-17T05:24:14.704934+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:22.897449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704118+0000","last_change":"2024-09-17T05:24:13.726189+0000","last_active":"2024-09-17T05:24:14.704118+0000","last_peered":"2024-09-17T05:24:14.704118+0000","last_clean":"2024-09-17T05:24:14.704118+0000","last_became_active":"2024-09-17T05:24:13.723397+0000","last_became_peered":"2024-09-17T05:24:13.723397+0000","last_unstale":"2024-09-17T05:24:14.704118+0000","last_undegraded":"2024-09-17T05:24:14.704118+0000","last_fullsized":"2024-09-17T05:24:14.704118+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:58:45.070058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751844+0000","last_change":"2024-09-17T05:24:12.725312+0000","last_active":"2024-09-17T05:24:14.751844+0000","last_peered":"2024-09-17T05:24:14.751844+0000","last_clean":"2024-09-17T05:24:14.751844+0000","last_became_active":"2024-09-17T05:24:12.724944+0000","last_became_peered":"2024-09-17T05:24:12.724944+0000","last_unstale":"2024-09-17T05:24:14.751844+0000","last_undegraded":"2024-09-17T05:24:14.751844+0000","last_fullsized":"2024-09-17T05:24:14.751844+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:03.211116+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701195+0000","last_change":"2024-09-17T05:24:13.720351+0000","last_active":"2024-09-17T05:24:14.701195+0000","last_peered":"2024-09-17T05:24:14.701195+0000","last_clean":"2024-09-17T05:24:14.701195+0000","last_became_active":"2024-09-17T05:24:13.719551+0000","last_became_peered":"2024-09-17T05:24:13.719551+0000","last_unstale":"2024-09-17T05:24:14.701195+0000","last_undegraded":"2024-09-17T05:24:14.701195+0000","last_fullsized":"2024-09-17T05:24:14.701195+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:45:18.585144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751916+0000","last_change":"2024-09-17T05:24:12.722972+0000","last_active":"2024-09-17T05:24:14.751916+0000","last_peered":"2024-09-17T05:24:14.751916+0000","last_clean":"2024-09-17T05:24:14.751916+0000","last_became_active":"2024-09-17T05:24:12.722631+0000","last_became_peered":"2024-09-17T05:24:12.722631+0000","last_unstale":"2024-09-17T05:24:14.751916+0000","last_undegraded":"2024-09-17T05:24:14.751916+0000","last_fullsized":"2024-09-17T05:24:14.751916+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:59.627166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704989+0000","last_change":"2024-09-17T05:24:13.713868+0000","last_active":"2024-09-17T05:24:14.704989+0000","last_peered":"2024-09-17T05:24:14.704989+0000","last_clean":"2024-09-17T05:24:14.704989+0000","last_became_active":"2024-09-17T05:24:13.713304+0000","last_became_peered":"2024-09-17T05:24:13.713304+0000","last_unstale":"2024-09-17T05:24:14.704989+0000","last_undegraded":"2024-09-17T05:24:14.704989+0000","last_fullsized":"2024-09-17T05:24:14.704989+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:39:19.968719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751247+0000","last_change":"2024-09-17T05:24:12.722175+0000","last_active":"2024-09-17T05:24:14.751247+0000","last_peered":"2024-09-17T05:24:14.751247+0000","last_clean":"2024-09-17T05:24:14.751247+0000","last_became_active":"2024-09-17T05:24:12.721887+0000","last_became_peered":"2024-09-17T05:24:12.721887+0000","last_unstale":"2024-09-17T05:24:14.751247+0000","last_undegraded":"2024-09-17T05:24:14.751247+0000","last_fullsized":"2024-09-17T05:24:14.751247+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:05.894860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703853+0000","last_change":"2024-09-17T05:24:13.717528+0000","last_active":"2024-09-17T05:24:14.703853+0000","last_peered":"2024-09-17T05:24:14.703853+0000","last_clean":"2024-09-17T05:24:14.703853+0000","last_became_active":"2024-09-17T05:24:13.713911+0000","last_became_peered":"2024-09-17T05:24:13.713911+0000","last_unstale":"2024-09-17T05:24:14.703853+0000","last_undegraded":"2024-09-17T05:24:14.703853+0000","last_fullsized":"2024-09-17T05:24:14.703853+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:07.828887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750660+0000","last_change":"2024-09-17T05:24:12.717903+0000","last_active":"2024-09-17T05:24:14.750660+0000","last_peered":"2024-09-17T05:24:14.750660+0000","last_clean":"2024-09-17T05:24:14.750660+0000","last_became_active":"2024-09-17T05:24:12.717605+0000","last_became_peered":"2024-09-17T05:24:12.717605+0000","last_unstale":"2024-09-17T05:24:14.750660+0000","last_undegraded":"2024-09-17T05:24:14.750660+0000","last_fullsized":"2024-09-17T05:24:14.750660+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:07:11.868037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751562+0000","last_change":"2024-09-17T05:24:13.713226+0000","last_active":"2024-09-17T05:24:14.751562+0000","last_peered":"2024-09-17T05:24:14.751562+0000","last_clean":"2024-09-17T05:24:14.751562+0000","last_became_active":"2024-09-17T05:24:13.712962+0000","last_became_peered":"2024-09-17T05:24:13.712962+0000","last_unstale":"2024-09-17T05:24:14.751562+0000","last_undegraded":"2024-09-17T05:24:14.751562+0000","last_fullsized":"2024-09-17T05:24:14.751562+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:37.917371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750761+0000","last_change":"2024-09-17T05:24:12.719527+0000","last_active":"2024-09-17T05:24:14.750761+0000","last_peered":"2024-09-17T05:24:14.750761+0000","last_clean":"2024-09-17T05:24:14.750761+0000","last_became_active":"2024-09-17T05:24:12.719252+0000","last_became_peered":"2024-09-17T05:24:12.719252+0000","last_unstale":"2024-09-17T05:24:14.750761+0000","last_undegraded":"2024-09-17T05:24:14.750761+0000","last_fullsized":"2024-09-17T05:24:14.750761+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:11:27.063079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.705245+0000","last_change":"2024-09-17T05:24:13.716482+0000","last_active":"2024-09-17T05:24:14.705245+0000","last_peered":"2024-09-17T05:24:14.705245+0000","last_clean":"2024-09-17T05:24:14.705245+0000","last_became_active":"2024-09-17T05:24:13.715235+0000","last_became_peered":"2024-09-17T05:24:13.715235+0000","last_unstale":"2024-09-17T05:24:14.705245+0000","last_undegraded":"2024-09-17T05:24:14.705245+0000","last_fullsized":"2024-09-17T05:24:14.705245+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.483246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701604+0000","last_change":"2024-09-17T05:24:12.720665+0000","last_active":"2024-09-17T05:24:14.701604+0000","last_peered":"2024-09-17T05:24:14.701604+0000","last_clean":"2024-09-17T05:24:14.701604+0000","last_became_active":"2024-09-17T05:24:12.719805+0000","last_became_peered":"2024-09-17T05:24:12.719805+0000","last_unstale":"2024-09-17T05:24:14.701604+0000","last_undegraded":"2024-09-17T05:24:14.701604+0000","last_fullsized":"2024-09-17T05:24:14.701604+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:54:39.191332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.701527+0000","last_change":"2024-09-17T05:24:13.712853+0000","last_active":"2024-09-17T05:24:14.701527+0000","last_peered":"2024-09-17T05:24:14.701527+0000","last_clean":"2024-09-17T05:24:14.701527+0000","last_became_active":"2024-09-17T05:24:13.712574+0000","last_became_peered":"2024-09-17T05:24:13.712574+0000","last_unstale":"2024-09-17T05:24:14.701527+0000","last_undegraded":"2024-09-17T05:24:14.701527+0000","last_fullsized":"2024-09-17T05:24:14.701527+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:55:39.391960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751672+0000","last_change":"2024-09-17T05:24:12.720956+0000","last_active":"2024-09-17T05:24:14.751672+0000","last_peered":"2024-09-17T05:24:14.751672+0000","last_clean":"2024-09-17T05:24:14.751672+0000","last_became_active":"2024-09-17T05:24:12.720677+0000","last_became_peered":"2024-09-17T05:24:12.720677+0000","last_unstale":"2024-09-17T05:24:14.751672+0000","last_undegraded":"2024-09-17T05:24:14.751672+0000","last_fullsized":"2024-09-17T05:24:14.751672+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:43.459753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704052+0000","last_change":"2024-09-17T05:24:13.717549+0000","last_active":"2024-09-17T05:24:14.704052+0000","last_peered":"2024-09-17T05:24:14.704052+0000","last_clean":"2024-09-17T05:24:14.704052+0000","last_became_active":"2024-09-17T05:24:13.717284+0000","last_became_peered":"2024-09-17T05:24:13.717284+0000","last_unstale":"2024-09-17T05:24:14.704052+0000","last_undegraded":"2024-09-17T05:24:14.704052+0000","last_fullsized":"2024-09-17T05:24:14.704052+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:17.770629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703959+0000","last_change":"2024-09-17T05:24:12.723488+0000","last_active":"2024-09-17T05:24:14.703959+0000","last_peered":"2024-09-17T05:24:14.703959+0000","last_clean":"2024-09-17T05:24:14.703959+0000","last_became_active":"2024-09-17T05:24:12.723168+0000","last_became_peered":"2024-09-17T05:24:12.723168+0000","last_unstale":"2024-09-17T05:24:14.703959+0000","last_undegraded":"2024-09-17T05:24:14.703959+0000","last_fullsized":"2024-09-17T05:24:14.703959+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:57:10.342261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.704949+0000","last_change":"2024-09-17T05:24:13.714327+0000","last_active":"2024-09-17T05:24:14.704949+0000","last_peered":"2024-09-17T05:24:14.704949+0000","last_clean":"2024-09-17T05:24:14.704949+0000","last_became_active":"2024-09-17T05:24:13.713987+0000","last_became_peered":"2024-09-17T05:24:13.713987+0000","last_unstale":"2024-09-17T05:24:14.704949+0000","last_undegraded":"2024-09-17T05:24:14.704949+0000","last_fullsized":"2024-09-17T05:24:14.704949+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:42:39.819211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750801+0000","last_change":"2024-09-17T05:24:12.727151+0000","last_active":"2024-09-17T05:24:14.750801+0000","last_peered":"2024-09-17T05:24:14.750801+0000","last_clean":"2024-09-17T05:24:14.750801+0000","last_became_active":"2024-09-17T05:24:12.726809+0000","last_became_peered":"2024-09-17T05:24:12.726809+0000","last_unstale":"2024-09-17T05:24:14.750801+0000","last_undegraded":"2024-09-17T05:24:14.750801+0000","last_fullsized":"2024-09-17T05:24:14.750801+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:15.333940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751969+0000","last_change":"2024-09-17T05:24:13.721083+0000","last_active":"2024-09-17T05:24:14.751969+0000","last_peered":"2024-09-17T05:24:14.751969+0000","last_clean":"2024-09-17T05:24:14.751969+0000","last_became_active":"2024-09-17T05:24:13.720256+0000","last_became_peered":"2024-09-17T05:24:13.720256+0000","last_unstale":"2024-09-17T05:24:14.751969+0000","last_undegraded":"2024-09-17T05:24:14.751969+0000","last_fullsized":"2024-09-17T05:24:14.751969+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:19:13.611003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703820+0000","last_change":"2024-09-17T05:24:12.719867+0000","last_active":"2024-09-17T05:24:14.703820+0000","last_peered":"2024-09-17T05:24:14.703820+0000","last_clean":"2024-09-17T05:24:14.703820+0000","last_became_active":"2024-09-17T05:24:12.719579+0000","last_became_peered":"2024-09-17T05:24:12.719579+0000","last_unstale":"2024-09-17T05:24:14.703820+0000","last_undegraded":"2024-09-17T05:24:14.703820+0000","last_fullsized":"2024-09-17T05:24:14.703820+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:19.907031+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751792+0000","last_change":"2024-09-17T05:24:13.713945+0000","last_active":"2024-09-17T05:24:14.751792+0000","last_peered":"2024-09-17T05:24:14.751792+0000","last_clean":"2024-09-17T05:24:14.751792+0000","last_became_active":"2024-09-17T05:24:13.712100+0000","last_became_peered":"2024-09-17T05:24:13.712100+0000","last_unstale":"2024-09-17T05:24:14.751792+0000","last_undegraded":"2024-09-17T05:24:14.751792+0000","last_fullsized":"2024-09-17T05:24:14.751792+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:29.093680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752082+0000","last_change":"2024-09-17T05:24:12.723088+0000","last_active":"2024-09-17T05:24:14.752082+0000","last_peered":"2024-09-17T05:24:14.752082+0000","last_clean":"2024-09-17T05:24:14.752082+0000","last_became_active":"2024-09-17T05:24:12.722820+0000","last_became_peered":"2024-09-17T05:24:12.722820+0000","last_unstale":"2024-09-17T05:24:14.752082+0000","last_undegraded":"2024-09-17T05:24:14.752082+0000","last_fullsized":"2024-09-17T05:24:14.752082+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:37:00.212088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.750976+0000","last_change":"2024-09-17T05:24:13.707430+0000","last_active":"2024-09-17T05:24:14.750976+0000","last_peered":"2024-09-17T05:24:14.750976+0000","last_clean":"2024-09-17T05:24:14.750976+0000","last_became_active":"2024-09-17T05:24:13.706959+0000","last_became_peered":"2024-09-17T05:24:13.706959+0000","last_unstale":"2024-09-17T05:24:14.750976+0000","last_undegraded":"2024-09-17T05:24:14.750976+0000","last_fullsized":"2024-09-17T05:24:14.750976+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.483246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751174+0000","last_change":"2024-09-17T05:24:12.718546+0000","last_active":"2024-09-17T05:24:14.751174+0000","last_peered":"2024-09-17T05:24:14.751174+0000","last_clean":"2024-09-17T05:24:14.751174+0000","last_became_active":"2024-09-17T05:24:12.718286+0000","last_became_peered":"2024-09-17T05:24:12.718286+0000","last_unstale":"2024-09-17T05:24:14.751174+0000","last_undegraded":"2024-09-17T05:24:14.751174+0000","last_fullsized":"2024-09-17T05:24:14.751174+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:10:43.459753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.703728+0000","last_change":"2024-09-17T05:24:13.716878+0000","last_active":"2024-09-17T05:24:14.703728+0000","last_peered":"2024-09-17T05:24:14.703728+0000","last_clean":"2024-09-17T05:24:14.703728+0000","last_became_active":"2024-09-17T05:24:13.716633+0000","last_became_peered":"2024-09-17T05:24:13.716633+0000","last_unstale":"2024-09-17T05:24:14.703728+0000","last_undegraded":"2024-09-17T05:24:14.703728+0000","last_fullsized":"2024-09-17T05:24:14.703728+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:41:30.237020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":15,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751405+0000","last_change":"2024-09-17T05:24:12.721781+0000","last_active":"2024-09-17T05:24:14.751405+0000","last_peered":"2024-09-17T05:24:14.751405+0000","last_clean":"2024-09-17T05:24:14.751405+0000","last_became_active":"2024-09-17T05:24:12.721513+0000","last_became_peered":"2024-09-17T05:24:12.721513+0000","last_unstale":"2024-09-17T05:24:14.751405+0000","last_undegraded":"2024-09-17T05:24:14.751405+0000","last_fullsized":"2024-09-17T05:24:14.751405+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:20.637655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":13,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751732+0000","last_change":"2024-09-17T05:24:13.725344+0000","last_active":"2024-09-17T05:24:14.751732+0000","last_peered":"2024-09-17T05:24:14.751732+0000","last_clean":"2024-09-17T05:24:14.751732+0000","last_became_active":"2024-09-17T05:24:13.725049+0000","last_became_peered":"2024-09-17T05:24:13.725049+0000","last_unstale":"2024-09-17T05:24:14.751732+0000","last_undegraded":"2024-09-17T05:24:14.751732+0000","last_fullsized":"2024-09-17T05:24:14.751732+0000","mapping_epoch":115,"log_start":"0'0","ondisk_log_start":"0'0","created":115,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:12.701795+0000","last_clean_scrub_stamp":"2024-09-17T05:24:12.701795+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:20:43.483246+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"116'2","reported_seq":17,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.752394+0000","last_change":"2024-09-17T05:24:12.723473+0000","last_active":"2024-09-17T05:24:14.752394+0000","last_peered":"2024-09-17T05:24:14.752394+0000","last_clean":"2024-09-17T05:24:14.752394+0000","last_became_active":"2024-09-17T05:24:12.723166+0000","last_became_peered":"2024-09-17T05:24:12.723166+0000","last_unstale":"2024-09-17T05:24:14.752394+0000","last_undegraded":"2024-09-17T05:24:14.752394+0000","last_fullsized":"2024-09-17T05:24:14.752394+0000","mapping_epoch":114,"log_start":"0'0","ondisk_log_start":"0'0","created":114,"last_epoch_clean":115,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:11.700230+0000","last_clean_scrub_stamp":"2024-09-17T05:24:11.700230+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:41:10.292836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":307,"reported_epoch":117,"state":"active+clean","last_fresh":"2024-09-17T05:24:14.751160+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:24:14.751160+0000","last_peered":"2024-09-17T05:24:14.751160+0000","last_clean":"2024-09-17T05:24:14.751160+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:24:14.751160+0000","last_undegraded":"2024-09-17T05:24:14.751160+0000","last_fullsized":"2024-09-17T05:24:14.751160+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509512,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2060288,"data_stored":1225054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509512,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32616,"kb_used_data":1420,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339224,"statfs":{"total":96636764160,"available":96603365376,"internally_reserved":0,"allocated":1454080,"data_stored":634048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32624,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339216,"statfs":{"total":96636764160,"available":96603357184,"internally_reserved":0,"allocated":1462272,"data_stored":638892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509511,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1412,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1445888,"data_stored":632506,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509511,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32608,"kb_used_data":1416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339232,"statfs":{"total":96636764160,"available":96603373568,"internally_reserved":0,"allocated":1449984,"data_stored":632596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509512,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32620,"kb_used_data":1428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339220,"statfs":{"total":96636764160,"available":96603361280,"internally_reserved":0,"allocated":1462272,"data_stored":639396,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509511,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32596,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339244,"statfs":{"total":96636764160,"available":96603385856,"internally_reserved":0,"allocated":1441792,"data_stored":632436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574920,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33180,"kb_used_data":1988,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338660,"statfs":{"total":96636764160,"available":96602787840,"internally_reserved":0,"allocated":2035712,"data_stored":1222804,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":70,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":112,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":18,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":19,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:24:17.003 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:24:17.003 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 -- 172.21.15.81:0/107755165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1815b380 msgr2=0x7fce18072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 --2- 172.21.15.81:0/107755165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1815b380 0x7fce18072b50 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fce08005fd0 tx=0x7fce0802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 -- 172.21.15.81:0/107755165 shutdown_connections 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 --2- 172.21.15.81:0/107755165 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce180ce120 0x7fce180cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 --2- 172.21.15.81:0/107755165 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce1815b380 0x7fce18072b50 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 -- 172.21.15.81:0/107755165 >> 172.21.15.81:0/107755165 conn(0x7fce180b1700 msgr2=0x7fce180b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 -- 172.21.15.81:0/107755165 shutdown_connections 2024-09-17T05:24:17.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.148+0000 7fce1cc60640 1 -- 172.21.15.81:0/107755165 wait complete. 2024-09-17T05:24:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.149+0000 7fce1cc60640 1 Processor -- start 2024-09-17T05:24:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1cc60640 1 -- start start 2024-09-17T05:24:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1cc60640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18073090 0x7fce181f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1cc60640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce180ce120 0x7fce180c4d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1cc60640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1815b380 0x7fce180c9530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1cc60640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fce180cc940 con 0x7fce1815b380 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1cc60640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fce180cc7c0 con 0x7fce18073090 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1cc60640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fce180ccac0 con 0x7fce180ce120 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce16d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1815b380 0x7fce180c9530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce16d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1815b380 0x7fce180c9530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49616/0 (socket says 172.21.15.81:49616) 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce16d9d640 1 -- 172.21.15.81:0/2957813073 learned_addr learned my addr 172.21.15.81:0/2957813073 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.150+0000 7fce1659c640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18073090 0x7fce181f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce15d9b640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce180ce120 0x7fce180c4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce16d9d640 1 -- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce180ce120 msgr2=0x7fce180c4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce16d9d640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce180ce120 0x7fce180c4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce16d9d640 1 -- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18073090 msgr2=0x7fce181f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce16d9d640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18073090 0x7fce181f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce16d9d640 1 -- 172.21.15.81:0/2957813073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce180c54e0 con 0x7fce1815b380 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce16d9d640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1815b380 0x7fce180c9530 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fce1000ec60 tx=0x7fce1000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce06ffd640 1 -- 172.21.15.81:0/2957813073 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce10004d20 con 0x7fce1815b380 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce06ffd640 1 -- 172.21.15.81:0/2957813073 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fce1000b570 con 0x7fce1815b380 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce181f2c10 con 0x7fce1815b380 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce06ffd640 1 -- 172.21.15.81:0/2957813073 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fce1000b980 con 0x7fce1815b380 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.151+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce181f31d0 con 0x7fce1815b380 2024-09-17T05:24:17.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.152+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce1806a100 con 0x7fce1815b380 2024-09-17T05:24:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.153+0000 7fce06ffd640 1 -- 172.21.15.81:0/2957813073 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fce1000bb20 con 0x7fce1815b380 2024-09-17T05:24:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.153+0000 7fce06ffd640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcdf8079010 0x7fcdf807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.154+0000 7fce06ffd640 1 -- 172.21.15.81:0/2957813073 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fce1009c1a0 con 0x7fce1815b380 2024-09-17T05:24:17.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.154+0000 7fce1659c640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcdf8079010 0x7fcdf807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.154+0000 7fce1659c640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcdf8079010 0x7fcdf807b4d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce08033000 tx=0x7fce08004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:17.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.158+0000 7fce06ffd640 1 -- 172.21.15.81:0/2957813073 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fce1806a100 con 0x7fce1815b380 2024-09-17T05:24:17.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.401+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fce180b1d40 con 0x7fce1815b380 2024-09-17T05:24:17.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.403+0000 7fce06ffd640 1 -- 172.21.15.81:0/2957813073 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) ==== 190+0+147 (secure 0 0 0) 0x7fce100637a0 con 0x7fce1815b380 2024-09-17T05:24:17.404 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:24:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:24:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:24:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:24:17.404 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:24:17.404 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:24:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcdf8079010 msgr2=0x7fcdf807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcdf8079010 0x7fcdf807b4d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fce08033000 tx=0x7fce08004730 comp rx=0 tx=0).stop 2024-09-17T05:24:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1815b380 msgr2=0x7fce180c9530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1815b380 0x7fce180c9530 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fce1000ec60 tx=0x7fce1000c7a0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 shutdown_connections 2024-09-17T05:24:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fce1815b380 0x7fce180c9530 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fce180ce120 0x7fce180c4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcdf8079010 0x7fcdf807b4d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 --2- 172.21.15.81:0/2957813073 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fce18073090 0x7fce181f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 >> 172.21.15.81:0/2957813073 conn(0x7fce180b1700 msgr2=0x7fce18072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 shutdown_connections 2024-09-17T05:24:17.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.405+0000 7fce1cc60640 1 -- 172.21.15.81:0/2957813073 wait complete. 2024-09-17T05:24:17.417 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:17.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.517+0000 7fe1a62cf640 1 -- 172.21.15.81:0/788492885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe188003a30 msgr2=0x7fe188003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.517+0000 7fe1a62cf640 1 --2- 172.21.15.81:0/788492885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe188003a30 0x7fe188003e50 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe19000c260 tx=0x7fe188005830 comp rx=0 tx=0).stop 2024-09-17T05:24:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.517+0000 7fe1a486c640 1 -- 172.21.15.81:0/788492885 reap_dead start 2024-09-17T05:24:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.517+0000 7fe1a62cf640 1 -- 172.21.15.81:0/788492885 shutdown_connections 2024-09-17T05:24:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.517+0000 7fe1a62cf640 1 -- 172.21.15.81:0/788492885 >> 172.21.15.81:0/788492885 conn(0x7fe1a00b1690 msgr2=0x7fe1a00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.517+0000 7fe1a62cf640 1 -- 172.21.15.81:0/788492885 shutdown_connections 2024-09-17T05:24:17.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.517+0000 7fe1a62cf640 1 -- 172.21.15.81:0/788492885 wait complete. 2024-09-17T05:24:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 Processor -- start 2024-09-17T05:24:17.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 -- start start 2024-09-17T05:24:17.521 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe188003a30 0x7fe1a01f6690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1a00c4970 0x7fe1a01f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a0153150 0x7fe1a00ccea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a00739a0 con 0x7fe1a00c4970 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe1a00707f0 con 0x7fe188003a30 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.519+0000 7fe1a62cf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe1a0073b20 con 0x7fe1a0153150 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1a00c4970 0x7fe1a01f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1a00c4970 0x7fe1a01f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49620/0 (socket says 172.21.15.81:49620) 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 -- 172.21.15.81:0/1949283024 learned_addr learned my addr 172.21.15.81:0/1949283024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19ffff640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe188003a30 0x7fe1a01f6690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe1a486c640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a0153150 0x7fe1a00ccea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 -- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a0153150 msgr2=0x7fe1a00ccea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a0153150 0x7fe1a00ccea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 -- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe188003a30 msgr2=0x7fe1a01f6690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe188003a30 0x7fe1a01f6690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 -- 172.21.15.81:0/1949283024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1a01f5bd0 con 0x7fe1a00c4970 2024-09-17T05:24:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19ffff640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe188003a30 0x7fe1a01f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:17.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19f7fe640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1a00c4970 0x7fe1a01f3080 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe194004650 tx=0x7fe19400ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19cff9640 1 -- 172.21.15.81:0/1949283024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1940107f0 con 0x7fe1a00c4970 2024-09-17T05:24:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19cff9640 1 -- 172.21.15.81:0/1949283024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe194010990 con 0x7fe1a00c4970 2024-09-17T05:24:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1a01e8d80 con 0x7fe1a00c4970 2024-09-17T05:24:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe19cff9640 1 -- 172.21.15.81:0/1949283024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe194010dc0 con 0x7fe1a00c4970 2024-09-17T05:24:17.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.520+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1a01f5e90 con 0x7fe1a00c4970 2024-09-17T05:24:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.521+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1a00b4690 con 0x7fe1a00c4970 2024-09-17T05:24:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.522+0000 7fe19cff9640 1 -- 172.21.15.81:0/1949283024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fe194023440 con 0x7fe1a00c4970 2024-09-17T05:24:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.522+0000 7fe19cff9640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe18c079040 0x7fe18c07b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.523+0000 7fe19cff9640 1 -- 172.21.15.81:0/1949283024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fe19409c180 con 0x7fe1a00c4970 2024-09-17T05:24:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.523+0000 7fe19ffff640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe18c079040 0x7fe18c07b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:17.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.523+0000 7fe19ffff640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe18c079040 0x7fe18c07b500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe190033000 tx=0x7fe19002d000 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:17.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.527+0000 7fe19cff9640 1 -- 172.21.15.81:0/1949283024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe194063e60 con 0x7fe1a00c4970 2024-09-17T05:24:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.742+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe1a00b4b50 con 0x7fe1a00c4970 2024-09-17T05:24:17.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.742+0000 7fe19cff9640 1 -- 172.21.15.81:0/1949283024 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 68 v68) ==== 94+0+5231 (secure 0 0 0) 0x7fe194063760 con 0x7fe1a00c4970 2024-09-17T05:24:17.743 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:17.743 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":68,"btime":"2024-09-17T05:24:15:717521+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3436145099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3436145099},{"type":"v1","addr":"172.21.15.160:6834","nonce":3436145099}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3146864973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3146864973},{"type":"v1","addr":"172.21.15.160:6835","nonce":3146864973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7515,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/3025598693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3025598693},{"type":"v1","addr":"172.21.15.81:6833","nonce":3025598693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:13.064331+0000","modified":"2024-09-17T05:24:15.061074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7518":{"gid":7518,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1143442034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1143442034},{"type":"v1","addr":"172.21.15.81:6835","nonce":1143442034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7518,"qdb_cluster":[7518]},"id":9}]} 2024-09-17T05:24:17.744 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 68 2024-09-17T05:24:17.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe18c079040 msgr2=0x7fe18c07b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe18c079040 0x7fe18c07b500 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fe190033000 tx=0x7fe19002d000 comp rx=0 tx=0).stop 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1a00c4970 msgr2=0x7fe1a01f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1a00c4970 0x7fe1a01f3080 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe194004650 tx=0x7fe19400ba40 comp rx=0 tx=0).stop 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 shutdown_connections 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe1a0153150 0x7fe1a00ccea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe1a00c4970 0x7fe1a01f3080 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe18c079040 0x7fe18c07b500 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 --2- 172.21.15.81:0/1949283024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe188003a30 0x7fe1a01f6690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 >> 172.21.15.81:0/1949283024 conn(0x7fe1a00b1690 msgr2=0x7fe1a015c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 shutdown_connections 2024-09-17T05:24:17.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:17.744+0000 7fe1a62cf640 1 -- 172.21.15.81:0/1949283024 wait complete. 2024-09-17T05:24:18.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 68, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:24:13.064331+0000', 'modified': '2024-09-17T05:24:15.061074+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7518}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7518': {'gid': 7518, 'name': 'c', 'rank': 0, 'incarnation': 66, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.81:6835/1143442034', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6834', 'nonce': 1143442034}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1143442034}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7518, 'qdb_cluster': [7518]} 2024-09-17T05:24:18.160 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:24:18.160 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:24:18.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 -- 172.21.15.81:0/3437530376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 msgr2=0x7f7cf0073c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3437530376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf0073c20 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4005fd0 tx=0x7f7ce402a540 comp rx=0 tx=0).stop 2024-09-17T05:24:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 -- 172.21.15.81:0/3437530376 shutdown_connections 2024-09-17T05:24:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3437530376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf0073c20 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3437530376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cf015ad00 0x7f7cf00736e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 -- 172.21.15.81:0/3437530376 >> 172.21.15.81:0/3437530376 conn(0x7f7cf00d0c20 msgr2=0x7f7cf00d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 -- 172.21.15.81:0/3437530376 shutdown_connections 2024-09-17T05:24:18.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.263+0000 7f7cf5272640 1 -- 172.21.15.81:0/3437530376 wait complete. 2024-09-17T05:24:18.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 Processor -- start 2024-09-17T05:24:18.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 -- start start 2024-09-17T05:24:18.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf015df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cf00746e0 0x7f7cf0157980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cf015ad00 0x7f7cf00c6180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00d0820 con 0x7f7cf0074280 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf00d06a0 con 0x7f7cf015ad00 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.265+0000 7f7cf5272640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf00cef00 con 0x7f7cf00746e0 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf015df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf015df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49640/0 (socket says 172.21.15.81:49640) 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 -- 172.21.15.81:0/3772356735 learned_addr learned my addr 172.21.15.81:0/3772356735 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cf00746e0 0x7f7cf0157980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7cef7fe640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cf015ad00 0x7f7cf00c6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 -- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cf00746e0 msgr2=0x7f7cf0157980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cf00746e0 0x7f7cf0157980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 -- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cf015ad00 msgr2=0x7f7cf00c6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cf015ad00 0x7f7cf00c6180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 -- 172.21.15.81:0/3772356735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf00c5350 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf015df80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000eb60 tx=0x7f7ce000c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7cd77fe640 1 -- 172.21.15.81:0/3772356735 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0010630 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7cd77fe640 1 -- 172.21.15.81:0/3772356735 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce00108c0 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf00c5630 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7cd77fe640 1 -- 172.21.15.81:0/3772356735 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce0010d10 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.266+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf015e4c0 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.268+0000 7f7cd77fe640 1 -- 172.21.15.81:0/3772356735 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f7ce0018420 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.268+0000 7f7cd77fe640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cdc079010 0x7f7cdc07b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.268+0000 7f7cd77fe640 1 -- 172.21.15.81:0/3772356735 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f7ce009c380 con 0x7f7cf0074280 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.268+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cdc079010 0x7f7cdc07b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.269+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cdc079010 0x7f7cdc07b4d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4033000 tx=0x7f7ce4004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.269+0000 7f7cf803e740 1 Processor -- start 2024-09-17T05:24:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.269+0000 7f7cf803e740 1 -- start start 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1ffacb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 0x555b1fff51f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffaa5f0 0x555b1ffaaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cf803e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b1ff21820 con 0x555b1ffd51b0 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555b1ff10c50 con 0x555b1ffaa5f0 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x555b1ff14a60 con 0x555b1fff4df0 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1ffacb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1ffacb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49654/0 (socket says 172.21.15.81:49654) 2024-09-17T05:24:18.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 -- 172.21.15.81:0/173013281 learned_addr learned my addr 172.21.15.81:0/173013281 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 0x555b1fff51f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7cef7fe640 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffaa5f0 0x555b1ffaaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 -- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 msgr2=0x555b1fff51f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 0x555b1fff51f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 -- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffaa5f0 msgr2=0x555b1ffaaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffaa5f0 0x555b1ffaaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.270+0000 7f7ceeffd640 1 -- 172.21.15.81:0/173013281 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b1fc72850 con 0x555b1ffd51b0 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1ffacb20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7ce009a3d0 tx=0x7f7ce00638b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0c37370fc94a21c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cd4ff9640 1 -- 172.21.15.81:0/173013281 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce000ee60 con 0x555b1ffd51b0 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cd4ff9640 1 -- 172.21.15.81:0/173013281 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce00640e0 con 0x555b1ffd51b0 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cd4ff9640 1 -- 172.21.15.81:0/173013281 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce00639e0 con 0x555b1ffd51b0 2024-09-17T05:24:18.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cf803e740 1 -- 172.21.15.81:0/173013281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 msgr2=0x555b1ffacb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cf803e740 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1ffacb20 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f7ce009a3d0 tx=0x7f7ce00638b0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cf803e740 1 -- 172.21.15.81:0/173013281 shutdown_connections 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cf803e740 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffaa5f0 0x555b1ffaaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cf803e740 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 0x555b1fff51f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cf803e740 1 --2- 172.21.15.81:0/173013281 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1ffacb20 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.271+0000 7f7cf803e740 1 -- 172.21.15.81:0/173013281 >> 172.21.15.81:0/173013281 conn(0x555b1ffab6a0 msgr2=0x555b1ffaf0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.272+0000 7f7cf803e740 1 -- 172.21.15.81:0/173013281 shutdown_connections 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.272+0000 7f7cf803e740 1 -- 172.21.15.81:0/173013281 wait complete. 2024-09-17T05:24:18.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.272+0000 7f7cf803e740 1 -- start start 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.272+0000 7f7cf803e740 1 Processor -- start 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd51b0 0x555b20003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 0x555b1ffeca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd4330 0x555b1ffd2e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cf803e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b1fc81620 con 0x555b1ffd4330 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555b1feb65f0 con 0x555b1fff4df0 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x555b1ffa9b30 con 0x555b1ffd51b0 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cf803e740 10 client.0 _ll_register_callbacks cb 0x555b1feba0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd4330 0x555b1ffd2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd4330 0x555b1ffd2e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49658/0 (socket says 172.21.15.81:49658) 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 -- 172.21.15.81:0/3055470186 learned_addr learned my addr 172.21.15.81:0/3055470186 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:18.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 -- 172.21.15.81:0/3055470186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd51b0 msgr2=0x555b20003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd51b0 0x555b20003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 -- 172.21.15.81:0/3055470186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 msgr2=0x555b1ffeca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 0x555b1ffeca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 0x555b1ffeca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.273+0000 7f7cef7fe640 1 -- 172.21.15.81:0/3055470186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b1fce96b0 con 0x555b1ffd4330 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cef7fe640 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd4330 0x555b1ffd2e40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8003a40 tx=0x7f7ce8003f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b1b124b3037b9a server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7ccdffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7ccdffb640 1 -- 172.21.15.81:0/3055470186 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce801a060 con 0x555b1ffd4330 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7ccdffb640 1 -- 172.21.15.81:0/3055470186 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f7ce8001b90 con 0x555b1ffd4330 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ce00640e0 con 0x555b1ffd4330 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7ccdffb640 1 -- 172.21.15.81:0/3055470186 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f7ce801f3b0 con 0x555b1ffd4330 2024-09-17T05:24:18.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 10 client.7644 fetch_fsmap learned FSMap version 68 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x555b1ffd38a0 con 0x555b1ffd4330 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7ccdffb640 1 -- 172.21.15.81:0/3055470186 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce00640e0 con 0x555b1ffd4330 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7ccdffb640 1 -- 172.21.15.81:0/3055470186 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f7ce801f550 con 0x555b1ffd4330 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 10 client.7644 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 10 client.7644 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 20 client.7644 populate_metadata read hostname 'smithi081' 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b20007810 0x555b20007bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 4 client.7644 mds_command: new command op to 7518 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 --> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555b1ff23770 con 0x555b20007810 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.274+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b20007810 0x555b20007bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b20007810 0x555b20007bf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8ffeade8f2a0ab3 server_cookie=cff6d9386e8619a4 in_seq=0 out_seq=0 2024-09-17T05:24:18.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7ccdffb640 10 client.7644 ms_handle_connect on v2:172.21.15.81:6834/1143442034 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7ccdffb640 1 -- 172.21.15.81:0/3055470186 <== mds.0 v2:172.21.15.81:6834/1143442034 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x555b1ff23770 con 0x555b20007810 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7ccdffb640 10 client.7644 handle_command_reply: tid=0 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 client.7644 shutdown 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd4330 msgr2=0x555b1ffd2e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd4330 0x555b1ffd2e40 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f7ce8003a40 tx=0x7f7ce8003f00 comp rx=0 tx=0).stop 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 shutdown_connections 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b20007810 0x555b20007bf0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd4330 0x555b1ffd2e40 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 0x555b1ffeca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 --2- 172.21.15.81:0/3055470186 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd51b0 0x555b20003d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 >> 172.21.15.81:0/3055470186 conn(0x555b1ffaa5f0 msgr2=0x555b1ffaeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7ccdffb640 0 client.7644 ms_handle_reset on v2:172.21.15.81:6834/1143442034 2024-09-17T05:24:18.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 shutdown_connections 2024-09-17T05:24:18.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.275+0000 7f7cf803e740 1 -- 172.21.15.81:0/3055470186 wait complete. 2024-09-17T05:24:18.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.276+0000 7f7cf803e740 20 client.7644 trim_cache size 0 max 16384 2024-09-17T05:24:18.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.293+0000 7f7cf803e740 1 Processor -- start 2024-09-17T05:24:18.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.293+0000 7f7cf803e740 1 -- start start 2024-09-17T05:24:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd4330 0x555b2000d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1fff4220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 0x555b1fff4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cf803e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf01fbe60 con 0x555b1ffd51b0 2024-09-17T05:24:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0159930 con 0x555b1fff4df0 2024-09-17T05:24:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7cf006d730 con 0x555b1ffd4330 2024-09-17T05:24:18.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1fff4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1fff4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49666/0 (socket says 172.21.15.81:49666) 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 -- 172.21.15.81:0/1704661540 learned_addr learned my addr 172.21.15.81:0/1704661540 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 -- 172.21.15.81:0/1704661540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd4330 msgr2=0x555b2000d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/1704661540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd4330 0x555b2000d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 -- 172.21.15.81:0/1704661540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 msgr2=0x555b1fff4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/1704661540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 0x555b1fff4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.294+0000 7f7cee7fc640 1 -- 172.21.15.81:0/1704661540 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b1ffd31b0 con 0x555b1ffd51b0 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/1704661540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1fff4220 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40099f0 tx=0x7f7ce403c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c92217ce96300de server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7ccffff640 1 -- 172.21.15.81:0/1704661540 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4035050 con 0x555b1ffd51b0 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7ccffff640 1 -- 172.21.15.81:0/1704661540 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce4049460 con 0x555b1ffd51b0 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7ccffff640 1 -- 172.21.15.81:0/1704661540 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4049870 con 0x555b1ffd51b0 2024-09-17T05:24:18.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 -- 172.21.15.81:0/1704661540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 msgr2=0x555b1fff4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 --2- 172.21.15.81:0/1704661540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1fff4220 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f7ce40099f0 tx=0x7f7ce403c000 comp rx=0 tx=0).stop 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 -- 172.21.15.81:0/1704661540 shutdown_connections 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 --2- 172.21.15.81:0/1704661540 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1fff4df0 0x555b1fff4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 --2- 172.21.15.81:0/1704661540 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b1fff4220 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 --2- 172.21.15.81:0/1704661540 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1ffd4330 0x555b2000d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 -- 172.21.15.81:0/1704661540 >> 172.21.15.81:0/1704661540 conn(0x555b1ffaa5f0 msgr2=0x555b1ffd5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 -- 172.21.15.81:0/1704661540 shutdown_connections 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.295+0000 7f7cf803e740 1 -- 172.21.15.81:0/1704661540 wait complete. 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.296+0000 7f7cf803e740 1 -- start start 2024-09-17T05:24:18.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.296+0000 7f7cf803e740 1 Processor -- start 2024-09-17T05:24:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffd4330 0x555b200789c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b20074300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 0x555b20005d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x555b1ffd47b0 con 0x555b1ffd51b0 2024-09-17T05:24:18.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x555b1ffcde60 con 0x555b1ffd4330 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x555b1ffd0f50 con 0x555b1fff4df0 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 10 client.0 _ll_register_callbacks cb 0x7f7ce8007d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b20074300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b20074300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49670/0 (socket says 172.21.15.81:49670) 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 -- 172.21.15.81:0/4144284118 learned_addr learned my addr 172.21.15.81:0/4144284118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 -- 172.21.15.81:0/4144284118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 msgr2=0x555b20005d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 0x555b20005d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 -- 172.21.15.81:0/4144284118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffd4330 msgr2=0x555b200789c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffd4330 0x555b200789c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 -- 172.21.15.81:0/4144284118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b1fff7380 con 0x555b1ffd51b0 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cee7fc640 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b20074300 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009850 tx=0x7f7ce4004340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f87c17ced4119fdb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7ccdffb640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7ccdffb640 1 -- 172.21.15.81:0/4144284118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ce4057070 con 0x555b1ffd51b0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7ccdffb640 1 -- 172.21.15.81:0/4144284118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f7ce4049a20 con 0x555b1ffd51b0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.297+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ce4049460 con 0x555b1ffd51b0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ccdffb640 1 -- 172.21.15.81:0/4144284118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=68) ==== 24+0+0 (secure 0 0 0) 0x7f7ce4062050 con 0x555b1ffd51b0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 10 client.7650 fetch_fsmap learned FSMap version 68 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=68,monmap=2+}) -- 0x555b200065f0 con 0x555b1ffd51b0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ccdffb640 1 -- 172.21.15.81:0/4144284118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ce4049460 con 0x555b1ffd51b0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ccdffb640 1 -- 172.21.15.81:0/4144284118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 68) ==== 3502+0+0 (secure 0 0 0) 0x7f7ce4065020 con 0x555b1ffd51b0 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 10 client.7650 fetch_fsmap finished waiting for FSMap version 68 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 10 client.7650 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 20 client.7650 populate_metadata read hostname 'smithi081' 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b1ffd20d0 0x555b1ffe9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 4 client.7650 mds_command: new command op to 7518 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 --> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] -- command(tid 0: {"prefix": "status"}) -- 0x555b1ff1f220 con 0x555b1ffd20d0 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b1ffd20d0 0x555b1ffe9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ceeffd640 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b1ffd20d0 0x555b1ffe9e30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=785521dfd8f32e6d server_cookie=1a4d85cec5e1f778 in_seq=0 out_seq=0 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ccdffb640 10 client.7650 ms_handle_connect on v2:172.21.15.81:6834/1143442034 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ccdffb640 1 -- 172.21.15.81:0/4144284118 <== mds.0 v2:172.21.15.81:6834/1143442034 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x555b1ff1f220 con 0x555b1ffd20d0 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7ccdffb640 10 client.7650 handle_command_reply: tid=0 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.298+0000 7f7cf803e740 1 client.7650 shutdown 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 msgr2=0x555b20074300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b20074300 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4009850 tx=0x7f7ce4004340 comp rx=0 tx=0).stop 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 shutdown_connections 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:6834/1143442034,v1:172.21.15.81:6835/1143442034] conn(0x555b1ffd20d0 0x555b1ffe9e30 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.306 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x555b1fff4df0 0x555b20005d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x555b1ffd51b0 0x555b20074300 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 --2- 172.21.15.81:0/4144284118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x555b1ffd4330 0x555b200789c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7ccdffb640 0 client.7650 ms_handle_reset on v2:172.21.15.81:6834/1143442034 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 >> 172.21.15.81:0/4144284118 conn(0x555b1ffaa5f0 msgr2=0x555b1ffaaa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 shutdown_connections 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 1 -- 172.21.15.81:0/4144284118 wait complete. 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf803e740 20 client.7650 trim_cache size 0 max 16384 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:24:18.307 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7518, 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.5849410690000001, 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 68, 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 117, 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 117, 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.3327409100000001 2024-09-17T05:24:18.308 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cdc079010 msgr2=0x7f7cdc07b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cdc079010 0x7f7cdc07b4d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f7ce4033000 tx=0x7f7ce4004730 comp rx=0 tx=0).stop 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 msgr2=0x7f7cf015df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf015df80 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7f7ce000eb60 tx=0x7f7ce000c6a0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 shutdown_connections 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cdc079010 0x7f7cdc07b4d0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cf015ad00 0x7f7cf00c6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cf00746e0 0x7f7cf0157980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 --2- 172.21.15.81:0/3772356735 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cf0074280 0x7f7cf015df80 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 >> 172.21.15.81:0/3772356735 conn(0x7f7cf00d0c20 msgr2=0x7f7cf0070fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 shutdown_connections 2024-09-17T05:24:18.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.299+0000 7f7cf5272640 1 -- 172.21.15.81:0/3772356735 wait complete. 2024-09-17T05:24:18.311 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:24:18.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 -- 172.21.15.81:0/2722597612 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d0d40 msgr2=0x7f287c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 --2- 172.21.15.81:0/2722597612 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d0d40 0x7f287c0cf9b0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f2870005fd0 tx=0x7f287002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 -- 172.21.15.81:0/2722597612 shutdown_connections 2024-09-17T05:24:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 --2- 172.21.15.81:0/2722597612 >> v2:172.21.15.160:3300/0 conn(0x7f287c0d49c0 0x7f287c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 --2- 172.21.15.81:0/2722597612 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d0d40 0x7f287c0cf9b0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 -- 172.21.15.81:0/2722597612 >> 172.21.15.81:0/2722597612 conn(0x7f287c0d3ea0 msgr2=0x7f287c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 -- 172.21.15.81:0/2722597612 shutdown_connections 2024-09-17T05:24:18.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.413+0000 7f288156b640 1 -- 172.21.15.81:0/2722597612 wait complete. 2024-09-17T05:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.414+0000 7f288156b640 1 Processor -- start 2024-09-17T05:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.414+0000 7f288156b640 1 -- start start 2024-09-17T05:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f288156b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f287c0d0d40 0x7f287c1614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f288156b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d49c0 0x7f287c15e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f288156b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f287c15df90 0x7f287c1f8360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f288156b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f287c0b3d40 con 0x7f287c15df90 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f288156b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f287c162710 con 0x7f287c0d0d40 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f288156b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f287c0b3ec0 con 0x7f287c0d49c0 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f287b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f287c15df90 0x7f287c1f8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f287b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f287c15df90 0x7f287c1f8360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49684/0 (socket says 172.21.15.81:49684) 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f287b7fe640 1 -- 172.21.15.81:0/1097427541 learned_addr learned my addr 172.21.15.81:0/1097427541 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f287affd640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f287c0d0d40 0x7f287c1614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.415+0000 7f287a7fc640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d49c0 0x7f287c15e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f287b7fe640 1 -- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d49c0 msgr2=0x7f287c15e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f287b7fe640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d49c0 0x7f287c15e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f287b7fe640 1 -- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f287c0d0d40 msgr2=0x7f287c1614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f287b7fe640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f287c0d0d40 0x7f287c1614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f287b7fe640 1 -- 172.21.15.81:0/1097427541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c161a20 con 0x7f287c15df90 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f287b7fe640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f287c15df90 0x7f287c1f8360 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f287400e9a0 tx=0x7f287400eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f28637fe640 1 -- 172.21.15.81:0/1097427541 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f287400ccc0 con 0x7f287c15df90 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f28637fe640 1 -- 172.21.15.81:0/1097427541 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f287400ce60 con 0x7f287c15df90 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287c1f5800 con 0x7f287c15df90 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f28637fe640 1 -- 172.21.15.81:0/1097427541 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874005280 con 0x7f287c15df90 2024-09-17T05:24:18.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.416+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287c160a00 con 0x7f287c15df90 2024-09-17T05:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.417+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287c0b3ab0 con 0x7f287c15df90 2024-09-17T05:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.418+0000 7f28637fe640 1 -- 172.21.15.81:0/1097427541 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f2874005420 con 0x7f287c15df90 2024-09-17T05:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.418+0000 7f28637fe640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2868079010 0x7f286807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.418+0000 7f287affd640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2868079010 0x7f286807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.418+0000 7f28637fe640 1 -- 172.21.15.81:0/1097427541 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f287409c060 con 0x7f287c15df90 2024-09-17T05:24:18.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.419+0000 7f287affd640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2868079010 0x7f286807b4d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f286c007fd0 tx=0x7f286c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:18.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.422+0000 7f28637fe640 1 -- 172.21.15.81:0/1097427541 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f287c0b3ab0 con 0x7f287c15df90 2024-09-17T05:24:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.633+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f287c0d4590 con 0x7f287c15df90 2024-09-17T05:24:18.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.633+0000 7f28637fe640 1 -- 172.21.15.81:0/1097427541 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f28740636f0 con 0x7f287c15df90 2024-09-17T05:24:18.633 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:24:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2868079010 msgr2=0x7f286807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2868079010 0x7f286807b4d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f286c007fd0 tx=0x7f286c009040 comp rx=0 tx=0).stop 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f287c15df90 msgr2=0x7f287c1f8360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f287c15df90 0x7f287c1f8360 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f287400e9a0 tx=0x7f287400eda0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 shutdown_connections 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f287c15df90 0x7f287c1f8360 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f287c0d49c0 0x7f287c15e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2868079010 0x7f286807b4d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 --2- 172.21.15.81:0/1097427541 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f287c0d0d40 0x7f287c1614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 >> 172.21.15.81:0/1097427541 conn(0x7f287c0d3ea0 msgr2=0x7f287c0b1e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 shutdown_connections 2024-09-17T05:24:18.636 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18.635+0000 7f288156b640 1 -- 172.21.15.81:0/1097427541 wait complete. 2024-09-17T05:24:18.646 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:24:18.646 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:24:18.646 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:24:18.647 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:24:18.647 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:18.647 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:24:18.647 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:24:18.647 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:24:18.647 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:24:18.647 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:18.647 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:24:18.663 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:18.664 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:24:18.665 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42459sec preferred_lft 42459sec 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:18.666 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:18.667 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:24:18.667 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:18.667 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:18.667 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:18.667 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:24:18.667 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:18.668 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:18.668 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:24:18.727 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:24:18.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:18.729 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:24:18.786 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:24:18.786 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:24:18.786 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:24:18.786 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:24:18.786 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:24:18.786 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:24:18.787 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:24:18.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:24:18.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:24:18.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:24:18.787 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:24:18.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:24:18.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:18 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:18.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:18.913 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:24:18.929 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:24:18.929 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:24:18.929 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:24:18.929 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:18.930 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:24:18.994 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:24:18.995 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:18.995 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:19.051 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:24:19.051 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:19.052 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:19.106 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:24:19.172 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:19.229 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:24:19.229 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:24:19.230 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:19.231 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:19.232 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:19.233 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:19.233 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:19.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:19.233 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:24:19.290 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:24:19.290 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:24:19.333 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:24:19.358 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:19.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:24:19.413+0000 7efcd092a480 -1 init, newargv = 0x56534f7225a0 newargc=15 2024-09-17T05:24:19.414 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[69329]: starting ceph client 2024-09-17T05:24:19.415 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:24:19.415 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:24:19.415 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:24:19.415 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:24:19.416 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:24:19.416 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:24:19.416 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:24:19.416 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:24:19.416 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:24:19.416 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:24:19.416 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:24:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:24:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:24:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:24:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:24:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:24:19.417 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:19.418 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:24:19.418 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:19.418 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:19.419 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:19.419 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:19.419 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:24:19.419 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:24:19.419 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:24:19.419 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:24:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:24:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:24:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:24:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:19.420 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:19.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:19.421 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:24:19.422 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[69329]: starting fuse 2024-09-17T05:24:19.437 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:24:19.438 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:24:19.438 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:24:19.438 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:24:19.438 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:24:19.438 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:24:19.439 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:24:19.439 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:19.439 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:24:19.439 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:24:19.439 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:24:19.439 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:24:19.439 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:19.440 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:24:19.440 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:24:19.440 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:24:19.440 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:24:19.440 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:19.440 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:24:19.440 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:24:19.441 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:24:19.441 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:24:19.441 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:24:19.441 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:24:19.441 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:24:19.441 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:24:19.441 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:19.442 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:24:19.442 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:24:19.554 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.69329.asok 2024-09-17T05:24:19.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:19.564 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.69329.asok 2024-09-17T05:24:19.564 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:19.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.69329.asok status 2024-09-17T05:24:19.698 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:24:19.698 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:24:19.698 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:24:19.698 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "69329", 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7662, 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:24:19.699 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 7662 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 911409380 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:24:19.700 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 911409380 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.7662 192.168.0.1:0/911409380", 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/911409380", 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 68, 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 117, 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:24:19.701 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:24:19.705 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:19.706 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:24:19.706 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:19.722 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:24:19.722 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:19.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:19.723 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:19.788 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:24:19.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 -- 172.21.15.81:0/800636339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3815df90 msgr2=0x7f9b380cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 --2- 172.21.15.81:0/800636339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3815df90 0x7f9b380cf9b0 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f9b380d1380 tx=0x7f9b3002aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 -- 172.21.15.81:0/800636339 shutdown_connections 2024-09-17T05:24:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 --2- 172.21.15.81:0/800636339 >> v2:172.21.15.160:3300/0 conn(0x7f9b38162480 0x7f9b380d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 --2- 172.21.15.81:0/800636339 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b380d49c0 0x7f9b380d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:19.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 --2- 172.21.15.81:0/800636339 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b3815df90 0x7f9b380cf9b0 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 -- 172.21.15.81:0/800636339 >> 172.21.15.81:0/800636339 conn(0x7f9b380d3ea0 msgr2=0x7f9b380d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 -- 172.21.15.81:0/800636339 shutdown_connections 2024-09-17T05:24:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.929+0000 7f9b3d356640 1 -- 172.21.15.81:0/800636339 wait complete. 2024-09-17T05:24:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.930+0000 7f9b3d356640 1 Processor -- start 2024-09-17T05:24:19.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b3d356640 1 -- start start 2024-09-17T05:24:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b3d356640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b380d49c0 0x7f9b3814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b3d356640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3815df90 0x7f9b3806dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b3d356640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b38162480 0x7f9b3806e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b3d356640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9b380b3b90 con 0x7f9b380d49c0 2024-09-17T05:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b3d356640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9b380b3a10 con 0x7f9b3815df90 2024-09-17T05:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b3d356640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9b380b3d10 con 0x7f9b38162480 2024-09-17T05:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b380d49c0 0x7f9b3814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b36ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b380d49c0 0x7f9b3814f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49696/0 (socket says 172.21.15.81:49696) 2024-09-17T05:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b36ffd640 1 -- 172.21.15.81:0/3663430723 learned_addr learned my addr 172.21.15.81:0/3663430723 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b367fc640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3815df90 0x7f9b3806dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.931+0000 7f9b377fe640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b38162480 0x7f9b3806e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b36ffd640 1 -- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b38162480 msgr2=0x7f9b3806e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b36ffd640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b38162480 0x7f9b3806e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:19.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b36ffd640 1 -- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3815df90 msgr2=0x7f9b3806dbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b36ffd640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3815df90 0x7f9b3806dbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b36ffd640 1 -- 172.21.15.81:0/3663430723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b38150a90 con 0x7f9b380d49c0 2024-09-17T05:24:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b36ffd640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b380d49c0 0x7f9b3814f680 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009bf0 tx=0x7f9b30003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b2f7fe640 1 -- 172.21.15.81:0/3663430723 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30047070 con 0x7f9b380d49c0 2024-09-17T05:24:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b2f7fe640 1 -- 172.21.15.81:0/3663430723 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9b30004250 con 0x7f9b380d49c0 2024-09-17T05:24:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b381f8ce0 con 0x7f9b380d49c0 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b2f7fe640 1 -- 172.21.15.81:0/3663430723 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b30033050 con 0x7f9b380d49c0 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.932+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b3814ffb0 con 0x7f9b380d49c0 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.933+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b380cf9b0 con 0x7f9b380d49c0 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.934+0000 7f9b2f7fe640 1 -- 172.21.15.81:0/3663430723 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f9b3004a070 con 0x7f9b380d49c0 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.934+0000 7f9b2f7fe640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9b18079010 0x7f9b1807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.934+0000 7f9b2f7fe640 1 -- 172.21.15.81:0/3663430723 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f9b300bc8c0 con 0x7f9b380d49c0 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.934+0000 7f9b367fc640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9b18079010 0x7f9b1807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.934+0000 7f9b367fc640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9b18079010 0x7f9b1807b4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b20005fd0 tx=0x7f9b2000b390 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:19.938+0000 7f9b2f7fe640 1 -- 172.21.15.81:0/3663430723 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9b30083fd0 con 0x7f9b380d49c0 2024-09-17T05:24:20.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.152+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9b380a1b60 con 0x7f9b380d49c0 2024-09-17T05:24:20.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.153+0000 7f9b2f7fe640 1 -- 172.21.15.81:0/3663430723 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v68) ==== 53+0+73 (secure 0 0 0) 0x7f9b30088a00 con 0x7f9b380d49c0 2024-09-17T05:24:20.153 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:24:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9b18079010 msgr2=0x7f9b1807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9b18079010 0x7f9b1807b4d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f9b20005fd0 tx=0x7f9b2000b390 comp rx=0 tx=0).stop 2024-09-17T05:24:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b380d49c0 msgr2=0x7f9b3814f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b380d49c0 0x7f9b3814f680 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f9b30009bf0 tx=0x7f9b30003f10 comp rx=0 tx=0).stop 2024-09-17T05:24:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 shutdown_connections 2024-09-17T05:24:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9b38162480 0x7f9b3806e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:20.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9b18079010 0x7f9b1807b4d0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9b3815df90 0x7f9b3806dbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 --2- 172.21.15.81:0/3663430723 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9b380d49c0 0x7f9b3814f680 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 >> 172.21.15.81:0/3663430723 conn(0x7f9b380d3ea0 msgr2=0x7f9b380b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 shutdown_connections 2024-09-17T05:24:20.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:20.155+0000 7f9b3d356640 1 -- 172.21.15.81:0/3663430723 wait complete. 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:24:20.166 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:24:20.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:20.167 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:24:20.186 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:20.187 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42455sec preferred_lft 42455sec 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:20.188 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:24:20.189 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:20.190 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:20.190 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:24:20.254 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:24:20.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:20.256 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:24:20.314 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:24:20.314 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:24:20.314 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:24:20.315 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:24:20.315 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:24:20.315 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:24:20.316 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:24:20.316 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:24:20.316 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:24:20.316 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:24:20.316 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:24:20.406 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:24:20 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:24:20.439 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:24:20 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:20.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:20.445 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:24:20.461 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:24:20.461 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:24:20.461 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:24:20.461 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:20.461 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:24:20.526 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:24:20.526 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:20.526 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:20.582 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:24:20.582 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:20.582 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:20.637 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:24:20.704 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:20.796 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:24:20.796 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:24:20.796 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:24:20.796 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:24:20.796 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:24:20.797 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:24:20.797 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:24:20.797 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:24:20.797 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:24:20.797 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:24:20.797 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:24:20.797 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:20.798 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:20.799 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:20.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:20.800 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:24:20.852 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:24:20.853 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:24:20.895 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:24:20.920 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:20.976 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:24:20.976+0000 7fce5600e480 -1 init, newargv = 0x561847a53680 newargc=15 2024-09-17T05:24:20.977 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:24:20.977 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:24:20.977 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:24:20.977 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:24:20.977 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:24:20.977 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:24:20.977 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:20.978 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:24:20.979 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:24:20.980 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:24:20.980 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:24:20.980 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:20.980 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:20.980 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:20.980 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:20.980 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[48062]: starting ceph client 2024-09-17T05:24:20.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:20.981 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:24:20.982 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[48062]: starting fuse 2024-09-17T05:24:21.037 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:24:21.037 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:24:21.037 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:24:21.037 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:24:21.037 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:24:21.037 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:24:21.038 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:24:21.039 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:24:21.156 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.48062.asok 2024-09-17T05:24:21.159 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:24:21 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:21.166 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.48062.asok 2024-09-17T05:24:21.166 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:21.166 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.48062.asok status 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:24:21.300 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "48062", 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 6781, 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 6781 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:24:21.301 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 2843198246 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 2843198246 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.6781 192.168.0.1:0/2843198246", 2024-09-17T05:24:21.302 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/2843198246", 2024-09-17T05:24:21.303 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:24:21.303 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 68, 2024-09-17T05:24:21.303 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 117, 2024-09-17T05:24:21.303 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:24:21.303 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:24:21.303 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:24:21.303 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:24:21.309 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:21.309 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:24:21.309 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:21.325 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:24:21.326 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:21.326 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:21.326 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:21.390 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:24:21.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 -- 172.21.15.81:0/1704860341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018072530 msgr2=0x7f4018070160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 --2- 172.21.15.81:0/1704860341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018072530 0x7f4018070160 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f4000005fd0 tx=0x7f400002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:24:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 -- 172.21.15.81:0/1704860341 shutdown_connections 2024-09-17T05:24:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 --2- 172.21.15.81:0/1704860341 >> v2:172.21.15.160:3300/0 conn(0x7f40180ceb70 0x7f40180cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:21.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 --2- 172.21.15.81:0/1704860341 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4018072530 0x7f4018070160 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 -- 172.21.15.81:0/1704860341 >> 172.21.15.81:0/1704860341 conn(0x7f40180b1620 msgr2=0x7f40180b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 -- 172.21.15.81:0/1704860341 shutdown_connections 2024-09-17T05:24:21.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.508+0000 7f401de2a640 1 -- 172.21.15.81:0/1704860341 wait complete. 2024-09-17T05:24:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.509+0000 7f401de2a640 1 Processor -- start 2024-09-17T05:24:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.509+0000 7f401de2a640 1 -- start start 2024-09-17T05:24:21.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f401de2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4018072530 0x7f401814fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f401de2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40180ceb70 0x7f4018140460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f401de2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401815f600 0x7f401814aed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f401de2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4018156320 con 0x7f401815f600 2024-09-17T05:24:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f401de2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f401806f060 con 0x7f40180ceb70 2024-09-17T05:24:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f401de2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f40181564a0 con 0x7f4018072530 2024-09-17T05:24:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401815f600 0x7f401814aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:21.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401815f600 0x7f401814aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49708/0 (socket says 172.21.15.81:49708) 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 -- 172.21.15.81:0/1461072086 learned_addr learned my addr 172.21.15.81:0/1461072086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f400ffff640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40180ceb70 0x7f4018140460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f40177fe640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4018072530 0x7f401814fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 -- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4018072530 msgr2=0x7f401814fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4018072530 0x7f401814fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 -- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40180ceb70 msgr2=0x7f4018140460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40180ceb70 0x7f4018140460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 -- 172.21.15.81:0/1461072086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f401814b410 con 0x7f401815f600 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.510+0000 7f4017fff640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401815f600 0x7f401814aed0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f401000eaa0 tx=0x7f401000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.511+0000 7f4014ff9640 1 -- 172.21.15.81:0/1461072086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f401000cdb0 con 0x7f401815f600 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.511+0000 7f4014ff9640 1 -- 172.21.15.81:0/1461072086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4010004c10 con 0x7f401815f600 2024-09-17T05:24:21.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.511+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40181f2bb0 con 0x7f401815f600 2024-09-17T05:24:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.511+0000 7f4014ff9640 1 -- 172.21.15.81:0/1461072086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4010005020 con 0x7f401815f600 2024-09-17T05:24:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.511+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40181f3170 con 0x7f401815f600 2024-09-17T05:24:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.512+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40180cfea0 con 0x7f401815f600 2024-09-17T05:24:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.512+0000 7f4014ff9640 1 -- 172.21.15.81:0/1461072086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f40100051c0 con 0x7f401815f600 2024-09-17T05:24:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.513+0000 7f4014ff9640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ff8079040 0x7f3ff807b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:21.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.513+0000 7f40177fe640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ff8079040 0x7f3ff807b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.513+0000 7f4014ff9640 1 -- 172.21.15.81:0/1461072086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f401009bed0 con 0x7f401815f600 2024-09-17T05:24:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.513+0000 7f40177fe640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ff8079040 0x7f3ff807b500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f40181602e0 tx=0x7f4008009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:21.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.517+0000 7f4014ff9640 1 -- 172.21.15.81:0/1461072086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4010016030 con 0x7f401815f600 2024-09-17T05:24:21.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:21.733+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4018074100 con 0x7f401815f600 2024-09-17T05:24:22.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.144+0000 7f4014ff9640 1 -- 172.21.15.81:0/1461072086 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v69) ==== 136+0+0 (secure 0 0 0) 0x7f40100635e0 con 0x7f401815f600 2024-09-17T05:24:22.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ff8079040 msgr2=0x7f3ff807b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ff8079040 0x7f3ff807b500 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f40181602e0 tx=0x7f4008009040 comp rx=0 tx=0).stop 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401815f600 msgr2=0x7f401814aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401815f600 0x7f401814aed0 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f401000eaa0 tx=0x7f401000ef60 comp rx=0 tx=0).stop 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 shutdown_connections 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f401815f600 0x7f401814aed0 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ff8079040 0x7f3ff807b500 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40180ceb70 0x7f4018140460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 --2- 172.21.15.81:0/1461072086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4018072530 0x7f401814fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 >> 172.21.15.81:0/1461072086 conn(0x7f40180b1620 msgr2=0x7f40180b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 shutdown_connections 2024-09-17T05:24:22.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.146+0000 7f401de2a640 1 -- 172.21.15.81:0/1461072086 wait complete. 2024-09-17T05:24:22.158 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:24:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 -- 172.21.15.81:0/3778594420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c0d2410 msgr2=0x7f7c7c0b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 --2- 172.21.15.81:0/3778594420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c0d2410 0x7f7c7c0b3090 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c074b30 tx=0x7f7c6c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 -- 172.21.15.81:0/3778594420 shutdown_connections 2024-09-17T05:24:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 --2- 172.21.15.81:0/3778594420 >> v2:172.21.15.160:3300/0 conn(0x7f7c7c0cfce0 0x7f7c7c0d00f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 --2- 172.21.15.81:0/3778594420 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c0d2410 0x7f7c7c0b3090 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 -- 172.21.15.81:0/3778594420 >> 172.21.15.81:0/3778594420 conn(0x7f7c7c09aa30 msgr2=0x7f7c7c09ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 -- 172.21.15.81:0/3778594420 shutdown_connections 2024-09-17T05:24:22.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.259+0000 7f7c81564640 1 -- 172.21.15.81:0/3778594420 wait complete. 2024-09-17T05:24:22.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.260+0000 7f7c81564640 1 Processor -- start 2024-09-17T05:24:22.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.260+0000 7f7c81564640 1 -- start start 2024-09-17T05:24:22.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c81564640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c7c0cfce0 0x7f7c7c15b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c81564640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c7c0d2410 0x7f7c7c06f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c81564640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c15f6d0 0x7f7c7c06f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c81564640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0b13c0 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c81564640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c7c0b1240 con 0x7f7c7c0cfce0 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c81564640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7c7c0b1540 con 0x7f7c7c0d2410 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c15f6d0 0x7f7c7c06f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c15f6d0 0x7f7c7c06f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49732/0 (socket says 172.21.15.81:49732) 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 -- 172.21.15.81:0/217305670 learned_addr learned my addr 172.21.15.81:0/217305670 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7affd640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c7c0cfce0 0x7f7c7c15b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7a7fc640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c7c0d2410 0x7f7c7c06f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 -- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c7c0d2410 msgr2=0x7f7c7c06f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c7c0d2410 0x7f7c7c06f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 -- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c7c0cfce0 msgr2=0x7f7c7c15b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c7c0cfce0 0x7f7c7c15b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7b7fe640 1 -- 172.21.15.81:0/217305670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c7c159c70 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.261+0000 7f7c7affd640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c7c0cfce0 0x7f7c7c15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.262+0000 7f7c7b7fe640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c15f6d0 0x7f7c7c06f8c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400b970 tx=0x7f7c7400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.262+0000 7f7c637fe640 1 -- 172.21.15.81:0/217305670 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c74019070 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.262+0000 7f7c637fe640 1 -- 172.21.15.81:0/217305670 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7c7400cc50 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.262+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c7c159f70 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.262+0000 7f7c637fe640 1 -- 172.21.15.81:0/217305670 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c740146a0 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.262+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c7c15a7b0 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.263+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c7c0b19f0 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.263+0000 7f7c637fe640 1 -- 172.21.15.81:0/217305670 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f7c7401c070 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.264+0000 7f7c637fe640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c68079010 0x7f7c6807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.264+0000 7f7c637fe640 1 -- 172.21.15.81:0/217305670 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f7c7409b400 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.264+0000 7f7c7affd640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c68079010 0x7f7c6807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.264+0000 7f7c7affd640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c68079010 0x7f7c6807b4d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c034000 tx=0x7f7c6c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:22.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.268+0000 7f7c637fe640 1 -- 172.21.15.81:0/217305670 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7c7c159f70 con 0x7f7c7c15f6d0 2024-09-17T05:24:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.465+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f7c7c0d29a0 con 0x7f7c68079010 2024-09-17T05:24:22.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.467+0000 7f7c637fe640 1 -- 172.21.15.81:0/217305670 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f7c7c0d29a0 con 0x7f7c68079010 2024-09-17T05:24:22.467 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:24:22.467 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:22.467 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:24:22.467 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:22.467 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:24:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c68079010 msgr2=0x7f7c6807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c68079010 0x7f7c6807b4d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c034000 tx=0x7f7c6c004730 comp rx=0 tx=0).stop 2024-09-17T05:24:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c15f6d0 msgr2=0x7f7c7c06f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c15f6d0 0x7f7c7c06f8c0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400b970 tx=0x7f7c7400be30 comp rx=0 tx=0).stop 2024-09-17T05:24:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 shutdown_connections 2024-09-17T05:24:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c7c15f6d0 0x7f7c7c06f8c0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c7c0d2410 0x7f7c7c06f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7c68079010 0x7f7c6807b4d0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 --2- 172.21.15.81:0/217305670 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c7c0cfce0 0x7f7c7c15b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 >> 172.21.15.81:0/217305670 conn(0x7f7c7c09aa30 msgr2=0x7f7c7c0b2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 shutdown_connections 2024-09-17T05:24:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.469+0000 7f7c81564640 1 -- 172.21.15.81:0/217305670 wait complete. 2024-09-17T05:24:22.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:24:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.584+0000 7fcd8d639640 1 -- 172.21.15.81:0/573461189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 msgr2=0x7fcd700051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.584+0000 7fcd8d639640 1 --2- 172.21.15.81:0/573461189 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 0x7fcd700051c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fcd80009b20 tx=0x7fcd70005830 comp rx=0 tx=0).stop 2024-09-17T05:24:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.584+0000 7fcd877fe640 1 -- 172.21.15.81:0/573461189 reap_dead start 2024-09-17T05:24:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.584+0000 7fcd8d639640 1 -- 172.21.15.81:0/573461189 shutdown_connections 2024-09-17T05:24:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.584+0000 7fcd8d639640 1 -- 172.21.15.81:0/573461189 >> 172.21.15.81:0/573461189 conn(0x7fcd880b1700 msgr2=0x7fcd880b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.585+0000 7fcd8d639640 1 -- 172.21.15.81:0/573461189 shutdown_connections 2024-09-17T05:24:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.585+0000 7fcd8d639640 1 -- 172.21.15.81:0/573461189 wait complete. 2024-09-17T05:24:22.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.586+0000 7fcd8d639640 1 Processor -- start 2024-09-17T05:24:22.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.586+0000 7fcd8d639640 1 -- start start 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.586+0000 7fcd8d639640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 0x7fcd880c3370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.586+0000 7fcd8d639640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8814adc0 0x7fcd881f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd8d639640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8815acb0 0x7fcd8814b730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd8d639640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880ce3e0 con 0x7fcd70004d40 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd8d639640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcd880ce260 con 0x7fcd8814adc0 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd8d639640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8806fc60 con 0x7fcd8815acb0 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 0x7fcd880c3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 0x7fcd880c3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49742/0 (socket says 172.21.15.81:49742) 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 -- 172.21.15.81:0/4181279323 learned_addr learned my addr 172.21.15.81:0/4181279323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd877fe640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8815acb0 0x7fcd8814b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd867fc640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8814adc0 0x7fcd881f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 -- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8815acb0 msgr2=0x7fcd8814b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8815acb0 0x7fcd8814b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 -- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8814adc0 msgr2=0x7fcd881f7db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8814adc0 0x7fcd881f7db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 -- 172.21.15.81:0/4181279323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8814d5a0 con 0x7fcd70004d40 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd867fc640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8814adc0 0x7fcd881f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd86ffd640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 0x7fcd880c3370 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006140 tx=0x7fcd78006600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/4181279323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78015070 con 0x7fcd70004d40 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/4181279323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd78006850 con 0x7fcd70004d40 2024-09-17T05:24:22.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/4181279323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd78011430 con 0x7fcd70004d40 2024-09-17T05:24:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd881f8440 con 0x7fcd70004d40 2024-09-17T05:24:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.587+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd881f8a00 con 0x7fcd70004d40 2024-09-17T05:24:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.588+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd881f8c00 con 0x7fcd70004d40 2024-09-17T05:24:22.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.589+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/4181279323 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fcd780115d0 con 0x7fcd70004d40 2024-09-17T05:24:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.589+0000 7fcd6f7fe640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd74079010 0x7fcd7407b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.589+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/4181279323 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fcd7809c570 con 0x7fcd70004d40 2024-09-17T05:24:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.589+0000 7fcd867fc640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd74079010 0x7fcd7407b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:22.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.590+0000 7fcd867fc640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd74079010 0x7fcd7407b4d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c001860 tx=0x7fcd7c001df0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:22.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.593+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/4181279323 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcd881f8c00 con 0x7fcd70004d40 2024-09-17T05:24:22.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.769+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fcd880cc8a0 con 0x7fcd70004d40 2024-09-17T05:24:22.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.769+0000 7fcd6f7fe640 1 -- 172.21.15.81:0/4181279323 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v40)=0 v40) ==== 122+0+0 (secure 0 0 0) 0x7fcd8814d5a0 con 0x7fcd70004d40 2024-09-17T05:24:22.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd74079010 msgr2=0x7fcd7407b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd74079010 0x7fcd7407b4d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c001860 tx=0x7fcd7c001df0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 msgr2=0x7fcd880c3370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:22.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 0x7fcd880c3370 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fcd78006140 tx=0x7fcd78006600 comp rx=0 tx=0).stop 2024-09-17T05:24:22.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 shutdown_connections 2024-09-17T05:24:22.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8815acb0 0x7fcd8814b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd74079010 0x7fcd7407b4d0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8814adc0 0x7fcd881f7db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 --2- 172.21.15.81:0/4181279323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd70004d40 0x7fcd880c3370 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:22.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 >> 172.21.15.81:0/4181279323 conn(0x7fcd880b1700 msgr2=0x7fcd88072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:22.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 shutdown_connections 2024-09-17T05:24:22.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:22.772+0000 7fcd8d639640 1 -- 172.21.15.81:0/4181279323 wait complete. 2024-09-17T05:24:22.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:22.784 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol71190/ae70a46e-9bd4-4c8d-ba56-6e0863e2de2e) 2024-09-17T05:24:22.818 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:22.818 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol71190/ae70a46e-9bd4-4c8d-ba56-6e0863e2de2e/.snap/fake) 2024-09-17T05:24:22.891 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:22.892 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:24:22.948 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:24:22.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:22.948 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol71190/ae70a46e-9bd4-4c8d-ba56-6e0863e2de2e) 2024-09-17T05:24:23.017 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:23.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol71190/.meta 2024-09-17T05:24:23.086 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:23.087 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp43540/subvol77731/45a51883-5cfd-4ea5-a7af-2bb4f4452d82) 2024-09-17T05:24:23.156 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:23.157 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp43540/subvol77731/45a51883-5cfd-4ea5-a7af-2bb4f4452d82/.snap/fake) 2024-09-17T05:24:23.231 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:23.231 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:24:23.287 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:24:23.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:23.288 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp43540/subvol77731/45a51883-5cfd-4ea5-a7af-2bb4f4452d82) 2024-09-17T05:24:23.357 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:23.357 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp43540/subvol77731/.meta 2024-09-17T05:24:23.425 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:23.425 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol75742/6ec7f396-39e8-48f7-893a-6e07dc9700df) 2024-09-17T05:24:23.494 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:23.494 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:24:23.552 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:24:23.552 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:23.553 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol75742/6ec7f396-39e8-48f7-893a-6e07dc9700df) 2024-09-17T05:24:23.622 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:23.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol75742/.meta 2024-09-17T05:24:23.690 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol71190 2024-09-17T05:24:23.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 -- 172.21.15.81:0/1082025879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d80cc500 msgr2=0x7fa6d80cc930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:23.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/1082025879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d80cc500 0x7fa6d80cc930 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fa6d80b5750 tx=0x7fa6d002aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 -- 172.21.15.81:0/1082025879 shutdown_connections 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/1082025879 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d80cc500 0x7fa6d80cc930 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/1082025879 >> v2:172.21.15.160:3300/0 conn(0x7fa6d8072f20 0x7fa6d8152af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 -- 172.21.15.81:0/1082025879 >> 172.21.15.81:0/1082025879 conn(0x7fa6d80b1700 msgr2=0x7fa6d80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 -- 172.21.15.81:0/1082025879 shutdown_connections 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.833+0000 7fa6df0bf640 1 -- 172.21.15.81:0/1082025879 wait complete. 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.834+0000 7fa6df0bf640 1 Processor -- start 2024-09-17T05:24:23.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.834+0000 7fa6df0bf640 1 -- start start 2024-09-17T05:24:23.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6df0bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d8072f20 0x7fa6d81506b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:23.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6df0bf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6d80cc500 0x7fa6d80c77c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:23.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6df0bf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6d8152710 0x7fa6d80cb560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:23.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6df0bf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d806fd70 con 0x7fa6d8072f20 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6df0bf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa6d806fbf0 con 0x7fa6d80cc500 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6df0bf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa6d806fef0 con 0x7fa6d8152710 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6dce5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d8072f20 0x7fa6d81506b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6dce5b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d8072f20 0x7fa6d81506b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57082/0 (socket says 172.21.15.81:57082) 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6dce5b640 1 -- 172.21.15.81:0/2988281710 learned_addr learned my addr 172.21.15.81:0/2988281710 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6d7fff640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6d80cc500 0x7fa6d80c77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.835+0000 7fa6dd65c640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6d8152710 0x7fa6d80cb560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6dce5b640 1 -- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6d8152710 msgr2=0x7fa6d80cb560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6dce5b640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6d8152710 0x7fa6d80cb560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6dce5b640 1 -- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6d80cc500 msgr2=0x7fa6d80c77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:23.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6dce5b640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6d80cc500 0x7fa6d80c77c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6dce5b640 1 -- 172.21.15.81:0/2988281710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6d8154eb0 con 0x7fa6d8072f20 2024-09-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6dce5b640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d8072f20 0x7fa6d81506b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c410 tx=0x7fa6c800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6d57fa640 1 -- 172.21.15.81:0/2988281710 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8017070 con 0x7fa6d8072f20 2024-09-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6d57fa640 1 -- 172.21.15.81:0/2988281710 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6c80035f0 con 0x7fa6d8072f20 2024-09-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6d8155150 con 0x7fa6d8072f20 2024-09-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6d57fa640 1 -- 172.21.15.81:0/2988281710 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6c8003a80 con 0x7fa6d8072f20 2024-09-17T05:24:23.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.836+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6d8155710 con 0x7fa6d8072f20 2024-09-17T05:24:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.837+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6d8152af0 con 0x7fa6d8072f20 2024-09-17T05:24:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.837+0000 7fa6d57fa640 1 -- 172.21.15.81:0/2988281710 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fa6c801a070 con 0x7fa6d8072f20 2024-09-17T05:24:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.838+0000 7fa6d57fa640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6c4079010 0x7fa6c407b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.838+0000 7fa6d7fff640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6c4079010 0x7fa6c407b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.838+0000 7fa6d57fa640 1 -- 172.21.15.81:0/2988281710 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fa6c809a9f0 con 0x7fa6d8072f20 2024-09-17T05:24:23.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.838+0000 7fa6d7fff640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6c4079010 0x7fa6c407b4d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8150bf0 tx=0x7fa6cc008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:23.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:23.842+0000 7fa6d57fa640 1 -- 172.21.15.81:0/2988281710 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa6c8062750 con 0x7fa6d8072f20 2024-09-17T05:24:24.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.047+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol71190", "target": ["mon-mgr", ""]}) -- 0x7fa6d815fa40 con 0x7fa6c4079010 2024-09-17T05:24:24.053 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:24.053+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:24.053 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:24.053+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:24.053 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:24.053+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:24.053 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:24.053+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:24.053 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:24.053+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:24.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.075+0000 7fa6d57fa640 1 -- 172.21.15.81:0/2988281710 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7fa6d815fa40 con 0x7fa6c4079010 2024-09-17T05:24:24.075 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol71190/ae70a46e-9bd4-4c8d-ba56-6e0863e2de2e 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6c4079010 msgr2=0x7fa6c407b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6c4079010 0x7fa6c407b4d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fa6d8150bf0 tx=0x7fa6cc008040 comp rx=0 tx=0).stop 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d8072f20 msgr2=0x7fa6d81506b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d8072f20 0x7fa6d81506b0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fa6c800c410 tx=0x7fa6c800c8d0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 shutdown_connections 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6d8152710 0x7fa6d80cb560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6c4079010 0x7fa6c407b4d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6d80cc500 0x7fa6d80c77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 --2- 172.21.15.81:0/2988281710 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6d8072f20 0x7fa6d81506b0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 >> 172.21.15.81:0/2988281710 conn(0x7fa6d80b1700 msgr2=0x7fa6d80b5550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 shutdown_connections 2024-09-17T05:24:24.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.078+0000 7fa6df0bf640 1 -- 172.21.15.81:0/2988281710 wait complete. 2024-09-17T05:24:24.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol77731 subvol_grp43540 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.194+0000 7f0d55d5d640 1 -- 172.21.15.81:0/1871022971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500aec50 msgr2=0x7f0d50072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.194+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/1871022971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500aec50 0x7f0d50072a10 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0d44009830 tx=0x7f0d4402a5a0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.195+0000 7f0d55d5d640 1 -- 172.21.15.81:0/1871022971 shutdown_connections 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.195+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/1871022971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500aec50 0x7f0d50072a10 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.195+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/1871022971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d5015d610 0x7f0d50070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.195+0000 7f0d55d5d640 1 -- 172.21.15.81:0/1871022971 >> 172.21.15.81:0/1871022971 conn(0x7f0d500b1620 msgr2=0x7f0d500b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.195+0000 7f0d55d5d640 1 -- 172.21.15.81:0/1871022971 shutdown_connections 2024-09-17T05:24:24.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.195+0000 7f0d55d5d640 1 -- 172.21.15.81:0/1871022971 wait complete. 2024-09-17T05:24:24.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.196+0000 7f0d55d5d640 1 Processor -- start 2024-09-17T05:24:24.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.196+0000 7f0d55d5d640 1 -- start start 2024-09-17T05:24:24.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d55d5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500ae690 0x7f0d5014a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d55d5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d500aec50 0x7f0d5014b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d55d5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d5015d610 0x7f0d50167e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d55d5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0d50072f50 con 0x7f0d5015d610 2024-09-17T05:24:24.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d55d5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0d500b35f0 con 0x7f0d500ae690 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d55d5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0d500730d0 con 0x7f0d500aec50 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d5015d610 0x7f0d50167e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d5015d610 0x7f0d50167e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57114/0 (socket says 172.21.15.81:57114) 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 -- 172.21.15.81:0/3371436251 learned_addr learned my addr 172.21.15.81:0/3371436251 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4f7fe640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500ae690 0x7f0d5014a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4effd640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d500aec50 0x7f0d5014b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 -- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d500aec50 msgr2=0x7f0d5014b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d500aec50 0x7f0d5014b320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 -- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500ae690 msgr2=0x7f0d5014a220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500ae690 0x7f0d5014a220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 -- 172.21.15.81:0/3371436251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d5014ab60 con 0x7f0d5015d610 2024-09-17T05:24:24.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d4ffff640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d5015d610 0x7f0d50167e70 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c3c0 tx=0x7f0d4800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:24.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.197+0000 7f0d37fff640 1 -- 172.21.15.81:0/3371436251 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011790 con 0x7f0d5015d610 2024-09-17T05:24:24.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.198+0000 7f0d37fff640 1 -- 172.21.15.81:0/3371436251 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0d48017070 con 0x7f0d5015d610 2024-09-17T05:24:24.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.198+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d50168af0 con 0x7f0d5015d610 2024-09-17T05:24:24.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.198+0000 7f0d37fff640 1 -- 172.21.15.81:0/3371436251 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d48011c60 con 0x7f0d5015d610 2024-09-17T05:24:24.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.198+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d50169090 con 0x7f0d5015d610 2024-09-17T05:24:24.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.198+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d50072a10 con 0x7f0d5015d610 2024-09-17T05:24:24.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.199+0000 7f0d37fff640 1 -- 172.21.15.81:0/3371436251 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f0d4801c460 con 0x7f0d5015d610 2024-09-17T05:24:24.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.200+0000 7f0d37fff640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d3c079040 0x7f0d3c07b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.200+0000 7f0d37fff640 1 -- 172.21.15.81:0/3371436251 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f0d4809b290 con 0x7f0d5015d610 2024-09-17T05:24:24.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.200+0000 7f0d4f7fe640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d3c079040 0x7f0d3c07b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.200+0000 7f0d4f7fe640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d3c079040 0x7f0d3c07b500 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d400099a0 tx=0x7f0d40009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:24.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.204+0000 7f0d37fff640 1 -- 172.21.15.81:0/3371436251 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0d48063090 con 0x7f0d5015d610 2024-09-17T05:24:24.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.408+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol77731", "group_name": "subvol_grp43540", "target": ["mon-mgr", ""]}) -- 0x7f0d5014be20 con 0x7f0d3c079040 2024-09-17T05:24:24.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.428+0000 7f0d37fff640 1 -- 172.21.15.81:0/3371436251 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7f0d5014be20 con 0x7f0d3c079040 2024-09-17T05:24:24.429 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp43540/subvol77731/45a51883-5cfd-4ea5-a7af-2bb4f4452d82 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d3c079040 msgr2=0x7f0d3c07b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d3c079040 0x7f0d3c07b500 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0d400099a0 tx=0x7f0d40009500 comp rx=0 tx=0).stop 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d5015d610 msgr2=0x7f0d50167e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d5015d610 0x7f0d50167e70 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7f0d4800c3c0 tx=0x7f0d4800c880 comp rx=0 tx=0).stop 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 shutdown_connections 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0d5015d610 0x7f0d50167e70 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0d500aec50 0x7f0d5014b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0d3c079040 0x7f0d3c07b500 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 --2- 172.21.15.81:0/3371436251 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0d500ae690 0x7f0d5014a220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 >> 172.21.15.81:0/3371436251 conn(0x7f0d500b1620 msgr2=0x7f0d50153680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 shutdown_connections 2024-09-17T05:24:24.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.430+0000 7f0d55d5d640 1 -- 172.21.15.81:0/3371436251 wait complete. 2024-09-17T05:24:24.442 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status cephfs subvol75742 2024-09-17T05:24:24.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 -- 172.21.15.81:0/3631648312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d4073550 msgr2=0x7fa3d4073a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 --2- 172.21.15.81:0/3631648312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d4073550 0x7fa3d4073a00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fa3d40d1b20 tx=0x7fa3cc02a560 comp rx=0 tx=0).stop 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 -- 172.21.15.81:0/3631648312 shutdown_connections 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 --2- 172.21.15.81:0/3631648312 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d4073550 0x7fa3d4073a00 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 --2- 172.21.15.81:0/3631648312 >> v2:172.21.15.160:3300/0 conn(0x7fa3d415af10 0x7fa3d415b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 --2- 172.21.15.81:0/3631648312 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3d40cd090 0x7fa3d4140990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 -- 172.21.15.81:0/3631648312 >> 172.21.15.81:0/3631648312 conn(0x7fa3d40d0b60 msgr2=0x7fa3d40d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 -- 172.21.15.81:0/3631648312 shutdown_connections 2024-09-17T05:24:24.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.545+0000 7fa3d9552640 1 -- 172.21.15.81:0/3631648312 wait complete. 2024-09-17T05:24:24.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.546+0000 7fa3d9552640 1 Processor -- start 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.546+0000 7fa3d9552640 1 -- start start 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d9552640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3d4073550 0x7fa3d413f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d9552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40cd090 0x7fa3d4153c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d9552640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3d415af10 0x7fa3d41e8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d9552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d40b3b10 con 0x7fa3d40cd090 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d9552640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa3d4070bc0 con 0x7fa3d415af10 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d9552640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa3d40b3c90 con 0x7fa3d4073550 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40cd090 0x7fa3d4153c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40cd090 0x7fa3d4153c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57128/0 (socket says 172.21.15.81:57128) 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 -- 172.21.15.81:0/2908072152 learned_addr learned my addr 172.21.15.81:0/2908072152 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d37fe640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3d415af10 0x7fa3d41e8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d2ffd640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3d4073550 0x7fa3d413f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 -- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3d4073550 msgr2=0x7fa3d413f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3d4073550 0x7fa3d413f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 -- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3d415af10 msgr2=0x7fa3d41e8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3d415af10 0x7fa3d41e8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.547+0000 7fa3d27fc640 1 -- 172.21.15.81:0/2908072152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3d41f8ae0 con 0x7fa3d40cd090 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.548+0000 7fa3d2ffd640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3d4073550 0x7fa3d413f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:24.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.548+0000 7fa3d27fc640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40cd090 0x7fa3d4153c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00b410 tx=0x7fa3bc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.548+0000 7fa3cb7fe640 1 -- 172.21.15.81:0/2908072152 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc015020 con 0x7fa3d40cd090 2024-09-17T05:24:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.548+0000 7fa3cb7fe640 1 -- 172.21.15.81:0/2908072152 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa3bc011920 con 0x7fa3d40cd090 2024-09-17T05:24:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.548+0000 7fa3cb7fe640 1 -- 172.21.15.81:0/2908072152 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3bc011d70 con 0x7fa3d40cd090 2024-09-17T05:24:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.548+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3d4152280 con 0x7fa3d40cd090 2024-09-17T05:24:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.548+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3d41541c0 con 0x7fa3d40cd090 2024-09-17T05:24:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.549+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3d40d01e0 con 0x7fa3d40cd090 2024-09-17T05:24:24.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.550+0000 7fa3cb7fe640 1 -- 172.21.15.81:0/2908072152 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fa3bc018020 con 0x7fa3d40cd090 2024-09-17T05:24:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.550+0000 7fa3cb7fe640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa3b4079040 0x7fa3b407b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.550+0000 7fa3cb7fe640 1 -- 172.21.15.81:0/2908072152 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fa3bc09b510 con 0x7fa3d40cd090 2024-09-17T05:24:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.550+0000 7fa3d2ffd640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa3b4079040 0x7fa3b407b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.551+0000 7fa3d2ffd640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa3b4079040 0x7fa3b407b500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009fa0 tx=0x7fa3c4009570 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:24.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.554+0000 7fa3cb7fe640 1 -- 172.21.15.81:0/2908072152 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa3d40d01e0 con 0x7fa3d40cd090 2024-09-17T05:24:24.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.764+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "cephfs", "clone_name": "subvol75742", "target": ["mon-mgr", ""]}) -- 0x7fa3d40710a0 con 0x7fa3b4079040 2024-09-17T05:24:24.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.781+0000 7fa3cb7fe640 1 -- 172.21.15.81:0/2908072152 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+144 (secure 0 0 0) 0x7fa3d40710a0 con 0x7fa3b4079040 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: "status": { 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "pending", 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: "source": { 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: "volume": "fake", 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: "subvolume": "fake", 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: "snapshot": "fake" 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:24.783 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa3b4079040 msgr2=0x7fa3b407b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa3b4079040 0x7fa3b407b500 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009fa0 tx=0x7fa3c4009570 comp rx=0 tx=0).stop 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40cd090 msgr2=0x7fa3d4153c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40cd090 0x7fa3d4153c80 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7fa3bc00b410 tx=0x7fa3bc00b8d0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 shutdown_connections 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa3b4079040 0x7fa3b407b500 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa3d415af10 0x7fa3d41e8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa3d40cd090 0x7fa3d4153c80 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 --2- 172.21.15.81:0/2908072152 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa3d4073550 0x7fa3d413f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.783+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 >> 172.21.15.81:0/2908072152 conn(0x7fa3d40d0b60 msgr2=0x7fa3d4159f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:24.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.784+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 shutdown_connections 2024-09-17T05:24:24.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.784+0000 7fa3d9552640 1 -- 172.21.15.81:0/2908072152 wait complete. 2024-09-17T05:24:24.795 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol71190 fake 2024-09-17T05:24:24.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.900+0000 7f08a24ef640 1 -- 172.21.15.81:0/2236323551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c06e940 msgr2=0x7f089c06fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.900+0000 7f08a24ef640 1 --2- 172.21.15.81:0/2236323551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c06e940 0x7f089c06fe80 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f0890005fd0 tx=0x7f089002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.900+0000 7f08a24ef640 1 -- 172.21.15.81:0/2236323551 shutdown_connections 2024-09-17T05:24:24.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.900+0000 7f08a24ef640 1 --2- 172.21.15.81:0/2236323551 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c06e940 0x7f089c06fe80 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.900+0000 7f08a24ef640 1 -- 172.21.15.81:0/2236323551 >> 172.21.15.81:0/2236323551 conn(0x7f089c0b1620 msgr2=0x7f089c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.900+0000 7f08a24ef640 1 -- 172.21.15.81:0/2236323551 shutdown_connections 2024-09-17T05:24:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.900+0000 7f08a24ef640 1 -- 172.21.15.81:0/2236323551 wait complete. 2024-09-17T05:24:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.901+0000 7f08a24ef640 1 Processor -- start 2024-09-17T05:24:24.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.901+0000 7f08a24ef640 1 -- start start 2024-09-17T05:24:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a24ef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f089c06e940 0x7f089c157630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a24ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c0703c0 0x7f089c1e6260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a24ef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c0aee40 0x7f089c1e67a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a24ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f089c158580 con 0x7f089c0703c0 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a24ef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f089c158400 con 0x7f089c0aee40 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a24ef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f089c158700 con 0x7f089c06e940 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c0703c0 0x7f089c1e6260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c0703c0 0x7f089c1e6260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57150/0 (socket says 172.21.15.81:57150) 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 -- 172.21.15.81:0/1615044904 learned_addr learned my addr 172.21.15.81:0/1615044904 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 -- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f089c06e940 msgr2=0x7f089c157630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f089c06e940 0x7f089c157630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 -- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c0aee40 msgr2=0x7f089c1e67a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a0a8c640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c0aee40 0x7f089c1e67a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c0aee40 0x7f089c1e67a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 -- 172.21.15.81:0/1615044904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c1e6ce0 con 0x7f089c0703c0 2024-09-17T05:24:24.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f08a0a8c640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c0aee40 0x7f089c1e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.902+0000 7f089b7fe640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c0703c0 0x7f089c1e6260 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0890034040 tx=0x7f08900038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.903+0000 7f0898ff9640 1 -- 172.21.15.81:0/1615044904 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089003e030 con 0x7f089c0703c0 2024-09-17T05:24:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.903+0000 7f0898ff9640 1 -- 172.21.15.81:0/1615044904 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0890003ca0 con 0x7f089c0703c0 2024-09-17T05:24:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.903+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c1f9290 con 0x7f089c0703c0 2024-09-17T05:24:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.903+0000 7f0898ff9640 1 -- 172.21.15.81:0/1615044904 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0890035040 con 0x7f089c0703c0 2024-09-17T05:24:24.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.903+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c1472e0 con 0x7f089c0703c0 2024-09-17T05:24:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.904+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c06fe80 con 0x7f089c0703c0 2024-09-17T05:24:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.904+0000 7f0898ff9640 1 -- 172.21.15.81:0/1615044904 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f0890041030 con 0x7f089c0703c0 2024-09-17T05:24:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.905+0000 7f0898ff9640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0888079010 0x7f088807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.905+0000 7f0898ff9640 1 -- 172.21.15.81:0/1615044904 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f08900bbc10 con 0x7f089c0703c0 2024-09-17T05:24:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.905+0000 7f089bfff640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0888079010 0x7f088807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:24.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.905+0000 7f089bfff640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0888079010 0x7f088807b4d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f088c000f60 tx=0x7f088c0079b0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:24.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:24.909+0000 7f0898ff9640 1 -- 172.21.15.81:0/1615044904 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f08900838f0 con 0x7f089c0703c0 2024-09-17T05:24:25.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.121+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol71190", "snap_name": "fake", "target": ["mon-mgr", ""]}) -- 0x7f089c06e720 con 0x7f0888079010 2024-09-17T05:24:25.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.145+0000 7f0898ff9640 1 -- 172.21.15.81:0/1615044904 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f089c06e720 con 0x7f0888079010 2024-09-17T05:24:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0888079010 msgr2=0x7f088807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0888079010 0x7f088807b4d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f088c000f60 tx=0x7f088c0079b0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c0703c0 msgr2=0x7f089c1e6260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c0703c0 0x7f089c1e6260 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f0890034040 tx=0x7f08900038a0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 shutdown_connections 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0888079010 0x7f088807b4d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f089c0aee40 0x7f089c1e67a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f089c0703c0 0x7f089c1e6260 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 --2- 172.21.15.81:0/1615044904 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f089c06e940 0x7f089c157630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 >> 172.21.15.81:0/1615044904 conn(0x7f089c0b1620 msgr2=0x7f089c06f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 shutdown_connections 2024-09-17T05:24:25.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.147+0000 7f08a24ef640 1 -- 172.21.15.81:0/1615044904 wait complete. 2024-09-17T05:24:25.159 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm cephfs subvol77731 fake subvol_grp43540 2024-09-17T05:24:25.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.265+0000 7fb326416640 1 -- 172.21.15.81:0/4110032084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb308004d40 msgr2=0x7fb3080051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.265+0000 7fb326416640 1 --2- 172.21.15.81:0/4110032084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb308004d40 0x7fb3080051c0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb31800c610 tx=0x7fb308005830 comp rx=0 tx=0).stop 2024-09-17T05:24:25.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.265+0000 7fb3249b3640 1 -- 172.21.15.81:0/4110032084 reap_dead start 2024-09-17T05:24:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.265+0000 7fb326416640 1 -- 172.21.15.81:0/4110032084 shutdown_connections 2024-09-17T05:24:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.265+0000 7fb326416640 1 -- 172.21.15.81:0/4110032084 >> 172.21.15.81:0/4110032084 conn(0x7fb3200b1700 msgr2=0x7fb3200b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.265+0000 7fb326416640 1 -- 172.21.15.81:0/4110032084 shutdown_connections 2024-09-17T05:24:25.267 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.265+0000 7fb326416640 1 -- 172.21.15.81:0/4110032084 wait complete. 2024-09-17T05:24:25.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.266+0000 7fb326416640 1 Processor -- start 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.266+0000 7fb326416640 1 -- start start 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb326416640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308004d40 0x7fb3200abc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb326416640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3201f2fa0 0x7fb320153720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb326416640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3200a9970 0x7fb3200a9df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb326416640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3200ce470 con 0x7fb3200a9970 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb326416640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb3200ce2f0 con 0x7fb308004d40 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb326416640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb32006fc60 con 0x7fb3201f2fa0 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3200a9970 0x7fb3200a9df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:25.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3200a9970 0x7fb3200a9df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57154/0 (socket says 172.21.15.81:57154) 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 -- 172.21.15.81:0/1661092807 learned_addr learned my addr 172.21.15.81:0/1661092807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb31ffff640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308004d40 0x7fb3200abc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 -- 172.21.15.81:0/1661092807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3201f2fa0 msgr2=0x7fb320153720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3201f2fa0 0x7fb320153720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 -- 172.21.15.81:0/1661092807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308004d40 msgr2=0x7fb3200abc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308004d40 0x7fb3200abc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.267+0000 7fb3249b3640 1 -- 172.21.15.81:0/1661092807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb320156fa0 con 0x7fb3200a9970 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.268+0000 7fb3249b3640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3200a9970 0x7fb3200a9df0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb31802b4a0 tx=0x7fb318001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:25.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.268+0000 7fb31cff9640 1 -- 172.21.15.81:0/1661092807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb31802bc00 con 0x7fb3200a9970 2024-09-17T05:24:25.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.268+0000 7fb31cff9640 1 -- 172.21.15.81:0/1661092807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb318006070 con 0x7fb3200a9970 2024-09-17T05:24:25.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.268+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3200ab150 con 0x7fb3200a9970 2024-09-17T05:24:25.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.268+0000 7fb31cff9640 1 -- 172.21.15.81:0/1661092807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb318006480 con 0x7fb3200a9970 2024-09-17T05:24:25.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.268+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb320157280 con 0x7fb3200a9970 2024-09-17T05:24:25.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.269+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb320155a60 con 0x7fb3200a9970 2024-09-17T05:24:25.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.269+0000 7fb31cff9640 1 -- 172.21.15.81:0/1661092807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7fb318006620 con 0x7fb3200a9970 2024-09-17T05:24:25.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.270+0000 7fb31cff9640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb30c079040 0x7fb30c07b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.270+0000 7fb31cff9640 1 -- 172.21.15.81:0/1661092807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7fb3180bb570 con 0x7fb3200a9970 2024-09-17T05:24:25.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.270+0000 7fb31ffff640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb30c079040 0x7fb30c07b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:25.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.270+0000 7fb31ffff640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb30c079040 0x7fb30c07b500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb320156b50 tx=0x7fb310006b70 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:25.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.274+0000 7fb31cff9640 1 -- 172.21.15.81:0/1661092807 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb320155a60 con 0x7fb3200a9970 2024-09-17T05:24:25.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.482+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "cephfs", "sub_name": "subvol77731", "snap_name": "fake", "group_name": "subvol_grp43540", "target": ["mon-mgr", ""]}) -- 0x7fb3200b2a00 con 0x7fb30c079040 2024-09-17T05:24:25.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.510+0000 7fb31cff9640 1 -- 172.21.15.81:0/1661092807 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb3200b2a00 con 0x7fb30c079040 2024-09-17T05:24:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb30c079040 msgr2=0x7fb30c07b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb30c079040 0x7fb30c07b500 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fb320156b50 tx=0x7fb310006b70 comp rx=0 tx=0).stop 2024-09-17T05:24:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3200a9970 msgr2=0x7fb3200a9df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3200a9970 0x7fb3200a9df0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb31802b4a0 tx=0x7fb318001aa0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 shutdown_connections 2024-09-17T05:24:25.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3200a9970 0x7fb3200a9df0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3201f2fa0 0x7fb320153720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb30c079040 0x7fb30c07b500 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 --2- 172.21.15.81:0/1661092807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb308004d40 0x7fb3200abc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 >> 172.21.15.81:0/1661092807 conn(0x7fb3200b1700 msgr2=0x7fb320072360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 shutdown_connections 2024-09-17T05:24:25.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.513+0000 7fb326416640 1 -- 172.21.15.81:0/1661092807 wait complete. 2024-09-17T05:24:25.525 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:25.525 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol71190/.meta) 2024-09-17T05:24:25.552 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:24:25.553 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:24:25.553 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:24:25.553 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol71190/ae70a46e-9bd4-4c8d-ba56-6e0863e2de2e 2024-09-17T05:24:25.553 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:24:25.553 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:25.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:25.554 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp43540/subvol77731/.meta) 2024-09-17T05:24:25.622 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:24:25.622 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:24:25.622 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:24:25.622 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/subvol_grp43540/subvol77731/45a51883-5cfd-4ea5-a7af-2bb4f4452d82 2024-09-17T05:24:25.622 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:24:25.623 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:25.624 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol71190 2024-09-17T05:24:25.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.768+0000 7f632adc6640 1 -- 172.21.15.81:0/2386695653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63140052e0 msgr2=0x7f631400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.768+0000 7f632adc6640 1 --2- 172.21.15.81:0/2386695653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63140052e0 0x7f631400b9c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f631c005fd0 tx=0x7f6314005830 comp rx=0 tx=0).stop 2024-09-17T05:24:25.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.768+0000 7f632adc6640 1 -- 172.21.15.81:0/2386695653 shutdown_connections 2024-09-17T05:24:25.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.768+0000 7f632adc6640 1 --2- 172.21.15.81:0/2386695653 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f63140052e0 0x7f631400b9c0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.768+0000 7f632adc6640 1 -- 172.21.15.81:0/2386695653 >> 172.21.15.81:0/2386695653 conn(0x7f63240b1700 msgr2=0x7f63240b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:25.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.768+0000 7f632adc6640 1 -- 172.21.15.81:0/2386695653 shutdown_connections 2024-09-17T05:24:25.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.768+0000 7f632adc6640 1 -- 172.21.15.81:0/2386695653 wait complete. 2024-09-17T05:24:25.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.769+0000 7f632adc6640 1 Processor -- start 2024-09-17T05:24:25.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.769+0000 7f632adc6640 1 -- start start 2024-09-17T05:24:25.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f632adc6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63140052e0 0x7f6324157a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f632adc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6324158440 0x7f63240b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f632adc6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63240c94a0 0x7f63240c9920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f632adc6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f632415b3d0 con 0x7f6324158440 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f632adc6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f63240cc9c0 con 0x7f63240c94a0 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f632adc6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f632415b550 con 0x7f63140052e0 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6324158440 0x7f63240b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6324158440 0x7f63240b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57176/0 (socket says 172.21.15.81:57176) 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 -- 172.21.15.81:0/714936594 learned_addr learned my addr 172.21.15.81:0/714936594 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6329363640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63240c94a0 0x7f63240c9920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6328b62640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63140052e0 0x7f6324157a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 -- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63140052e0 msgr2=0x7f6324157a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63140052e0 0x7f6324157a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 -- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63240c94a0 msgr2=0x7f63240c9920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63240c94a0 0x7f63240c9920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.770+0000 7f6323fff640 1 -- 172.21.15.81:0/714936594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6324157f90 con 0x7f6324158440 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.771+0000 7f6323fff640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6324158440 0x7f63240b4e80 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f6310004db0 tx=0x7f6310001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.771+0000 7f63217fa640 1 -- 172.21.15.81:0/714936594 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63100107d0 con 0x7f6324158440 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.771+0000 7f63217fa640 1 -- 172.21.15.81:0/714936594 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6310016070 con 0x7f6324158440 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.771+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63241f6270 con 0x7f6324158440 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.771+0000 7f63217fa640 1 -- 172.21.15.81:0/714936594 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6310010cc0 con 0x7f6324158440 2024-09-17T05:24:25.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.771+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63241f6830 con 0x7f6324158440 2024-09-17T05:24:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.772+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f632415bab0 con 0x7f6324158440 2024-09-17T05:24:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.772+0000 7f63217fa640 1 -- 172.21.15.81:0/714936594 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f631001b460 con 0x7f6324158440 2024-09-17T05:24:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.773+0000 7f63217fa640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6308079010 0x7f630807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.773+0000 7f63217fa640 1 -- 172.21.15.81:0/714936594 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f631009bde0 con 0x7f6324158440 2024-09-17T05:24:25.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.773+0000 7f6328b62640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6308079010 0x7f630807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:25.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.773+0000 7f6328b62640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6308079010 0x7f630807b4d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6318001240 tx=0x7f6318001190 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:25.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.777+0000 7f63217fa640 1 -- 172.21.15.81:0/714936594 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6310063b60 con 0x7f6324158440 2024-09-17T05:24:25.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:25.980+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol71190", "target": ["mon-mgr", ""]}) -- 0x7f632415c790 con 0x7f6308079010 2024-09-17T05:24:26.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.016+0000 7f63217fa640 1 -- 172.21.15.81:0/714936594 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f632415c790 con 0x7f6308079010 2024-09-17T05:24:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6308079010 msgr2=0x7f630807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6308079010 0x7f630807b4d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6318001240 tx=0x7f6318001190 comp rx=0 tx=0).stop 2024-09-17T05:24:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6324158440 msgr2=0x7f63240b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6324158440 0x7f63240b4e80 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7f6310004db0 tx=0x7f6310001670 comp rx=0 tx=0).stop 2024-09-17T05:24:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 shutdown_connections 2024-09-17T05:24:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6308079010 0x7f630807b4d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f63240c94a0 0x7f63240c9920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6324158440 0x7f63240b4e80 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 --2- 172.21.15.81:0/714936594 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f63140052e0 0x7f6324157a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 >> 172.21.15.81:0/714936594 conn(0x7f63240b1700 msgr2=0x7f63240b0c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 shutdown_connections 2024-09-17T05:24:26.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.019+0000 7f632adc6640 1 -- 172.21.15.81:0/714936594 wait complete. 2024-09-17T05:24:26.022 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.021+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.022 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.021+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.022 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.021+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.022 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.021+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.022 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.021+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.032 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol77731 subvol_grp43540 2024-09-17T05:24:26.034 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.034+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.034 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.034+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.035 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.034+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.035 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.034+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.035 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.034+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.144+0000 7f0f117b4640 1 -- 172.21.15.81:0/1881819012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ef4003a50 msgr2=0x7f0ef4003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.144+0000 7f0f117b4640 1 --2- 172.21.15.81:0/1881819012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ef4003a50 0x7f0ef4003e70 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f0efc001690 tx=0x7f0ef4005830 comp rx=0 tx=0).stop 2024-09-17T05:24:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.144+0000 7f0f117b4640 1 -- 172.21.15.81:0/1881819012 shutdown_connections 2024-09-17T05:24:26.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.144+0000 7f0f117b4640 1 --2- 172.21.15.81:0/1881819012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0ef4003a50 0x7f0ef4003e70 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.144+0000 7f0f117b4640 1 -- 172.21.15.81:0/1881819012 >> 172.21.15.81:0/1881819012 conn(0x7f0f0c0d3e20 msgr2=0x7f0f0c0d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.144+0000 7f0f117b4640 1 -- 172.21.15.81:0/1881819012 shutdown_connections 2024-09-17T05:24:26.147 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.144+0000 7f0f117b4640 1 -- 172.21.15.81:0/1881819012 wait complete. 2024-09-17T05:24:26.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 Processor -- start 2024-09-17T05:24:26.150 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 -- start start 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ef4003a50 0x7f0f0c1f4f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f0c09db40 0x7f0f0c09fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f0c15dfc0 0x7f0f0c15e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c0d4cd0 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0f0c0d4b50 con 0x7f0ef4003a50 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f117b4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0f0c0d2ce0 con 0x7f0f0c09db40 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f0b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f0c15dfc0 0x7f0f0c15e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f0b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f0c15dfc0 0x7f0f0c15e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57234/0 (socket says 172.21.15.81:57234) 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.146+0000 7f0f0b7fe640 1 -- 172.21.15.81:0/2880697187 learned_addr learned my addr 172.21.15.81:0/2880697187 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0affd640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ef4003a50 0x7f0f0c1f4f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0a7fc640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f0c09db40 0x7f0f0c09fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0b7fe640 1 -- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f0c09db40 msgr2=0x7f0f0c09fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0b7fe640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f0c09db40 0x7f0f0c09fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0b7fe640 1 -- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ef4003a50 msgr2=0x7f0f0c1f4f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0b7fe640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ef4003a50 0x7f0f0c1f4f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0b7fe640 1 -- 172.21.15.81:0/2880697187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f0c1f5470 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f0b7fe640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f0c15dfc0 0x7f0f0c15e450 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c069860 tx=0x7f0f0400ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f04015020 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0f0400cd10 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f040116c0 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f0c0cbfe0 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.147+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f0c0cc560 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.148+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f0c0d2230 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.149+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 20) ==== 101849+0+0 (secure 0 0 0) 0x7f0f04018020 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.149+0000 7f0ef37fe640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0ef8079010 0x7f0ef807b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.149+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f0f0409b800 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.149+0000 7f0f0affd640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0ef8079010 0x7f0ef807b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.150+0000 7f0f0affd640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0ef8079010 0x7f0ef807b4d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0efc032000 tx=0x7f0efc02c040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:26.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.154+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0f0401f030 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.165+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 21) ==== 101900+0+0 (secure 0 0 0) 0x7f0f0405f180 con 0x7f0f0c15dfc0 2024-09-17T05:24:26.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.357+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol77731", "group_name": "subvol_grp43540", "target": ["mon-mgr", ""]}) -- 0x7f0f0c0b8140 con 0x7f0ef8079010 2024-09-17T05:24:26.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.388+0000 7f0ef37fe640 1 -- 172.21.15.81:0/2880697187 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f0f0c0b8140 con 0x7f0ef8079010 2024-09-17T05:24:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0ef8079010 msgr2=0x7f0ef807b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0ef8079010 0x7f0ef807b4d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f0efc032000 tx=0x7f0efc02c040 comp rx=0 tx=0).stop 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f0c15dfc0 msgr2=0x7f0f0c15e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f0c15dfc0 0x7f0f0c15e450 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f0f0c069860 tx=0x7f0f0400ed10 comp rx=0 tx=0).stop 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 shutdown_connections 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0f0c15dfc0 0x7f0f0c15e450 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0f0c09db40 0x7f0f0c09fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0ef8079010 0x7f0ef807b4d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 --2- 172.21.15.81:0/2880697187 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0ef4003a50 0x7f0f0c1f4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 >> 172.21.15.81:0/2880697187 conn(0x7f0f0c0d3e20 msgr2=0x7f0f0c0b8420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 shutdown_connections 2024-09-17T05:24:26.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.390+0000 7f0f117b4640 1 -- 172.21.15.81:0/2880697187 wait complete. 2024-09-17T05:24:26.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol75742 2024-09-17T05:24:26.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.506+0000 7f38deda0640 1 -- 172.21.15.81:0/1325482772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d81617f0 msgr2=0x7f38d80d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.506+0000 7f38deda0640 1 --2- 172.21.15.81:0/1325482772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d81617f0 0x7f38d80d1d30 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009830 tx=0x7f38cc02a480 comp rx=0 tx=0).stop 2024-09-17T05:24:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.506+0000 7f38deda0640 1 -- 172.21.15.81:0/1325482772 shutdown_connections 2024-09-17T05:24:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.506+0000 7f38deda0640 1 --2- 172.21.15.81:0/1325482772 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d81617f0 0x7f38d80d1d30 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.506+0000 7f38deda0640 1 -- 172.21.15.81:0/1325482772 >> 172.21.15.81:0/1325482772 conn(0x7f38d80d3e30 msgr2=0x7f38d80d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.506+0000 7f38deda0640 1 -- 172.21.15.81:0/1325482772 shutdown_connections 2024-09-17T05:24:26.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.506+0000 7f38deda0640 1 -- 172.21.15.81:0/1325482772 wait complete. 2024-09-17T05:24:26.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.507+0000 7f38deda0640 1 Processor -- start 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.507+0000 7f38deda0640 1 -- start start 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38deda0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80b3de0 0x7f38d80b8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38deda0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38d80d01b0 0x7f38d8157720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38deda0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38d81617f0 0x7f38d815d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38deda0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38d80b4a80 con 0x7f38d80b3de0 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38deda0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38d80b4900 con 0x7f38d80d01b0 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38deda0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f38d80b4c00 con 0x7f38d81617f0 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38dcb3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80b3de0 0x7f38d80b8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38dcb3c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80b3de0 0x7f38d80b8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57252/0 (socket says 172.21.15.81:57252) 2024-09-17T05:24:26.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38dcb3c640 1 -- 172.21.15.81:0/430737695 learned_addr learned my addr 172.21.15.81:0/430737695 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.508+0000 7f38d7fff640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38d80d01b0 0x7f38d8157720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dd33d640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38d81617f0 0x7f38d815d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dcb3c640 1 -- 172.21.15.81:0/430737695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38d81617f0 msgr2=0x7f38d815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dcb3c640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38d81617f0 0x7f38d815d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dcb3c640 1 -- 172.21.15.81:0/430737695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38d80d01b0 msgr2=0x7f38d8157720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dcb3c640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38d80d01b0 0x7f38d8157720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dcb3c640 1 -- 172.21.15.81:0/430737695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38d815dd60 con 0x7f38d80b3de0 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dd33d640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38d81617f0 0x7f38d815d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38dcb3c640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38d80b3de0 0x7f38d80b8790 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7f38cc009950 tx=0x7f38cc033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38d57fa640 1 -- 172.21.15.81:0/430737695 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc031d60 con 0x7f38d80b3de0 2024-09-17T05:24:26.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38d57fa640 1 -- 172.21.15.81:0/430737695 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f38cc033e10 con 0x7f38d80b3de0 2024-09-17T05:24:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38deda0640 1 -- 172.21.15.81:0/430737695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38d815e040 con 0x7f38d80b3de0 2024-09-17T05:24:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38d57fa640 1 -- 172.21.15.81:0/430737695 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38cc005280 con 0x7f38d80b3de0 2024-09-17T05:24:26.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.509+0000 7f38deda0640 1 -- 172.21.15.81:0/430737695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38d80b7f90 con 0x7f38d80b3de0 2024-09-17T05:24:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.510+0000 7f38deda0640 1 -- 172.21.15.81:0/430737695 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38d80b41f0 con 0x7f38d80b3de0 2024-09-17T05:24:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.511+0000 7f38d57fa640 1 -- 172.21.15.81:0/430737695 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) ==== 101900+0+0 (secure 0 0 0) 0x7f38cc005420 con 0x7f38d80b3de0 2024-09-17T05:24:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.511+0000 7f38d57fa640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38bc0790d0 0x7f38bc07b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.511+0000 7f38d57fa640 1 -- 172.21.15.81:0/430737695 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f38cc0bc680 con 0x7f38d80b3de0 2024-09-17T05:24:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.511+0000 7f38d7fff640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38bc0790d0 0x7f38bc07b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.512+0000 7f38d7fff640 1 --2- 172.21.15.81:0/430737695 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f38bc0790d0 0x7f38bc07b590 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f38c4007f00 tx=0x7f38c4007e90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:26.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.516+0000 7f38d57fa640 1 -- 172.21.15.81:0/430737695 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f38cc03f030 con 0x7f38d80b3de0 2024-09-17T05:24:26.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.716+0000 7f38deda0640 1 -- 172.21.15.81:0/430737695 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol75742", "target": ["mon-mgr", ""]}) -- 0x7f38d80b5700 con 0x7f38bc0790d0 2024-09-17T05:24:26.723 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:26.722+0000 7fe39376f640 -1 mgr.server reply reply (11) Resource temporarily unavailable subvolume 'subvol75742' is not ready for operation rm (use --force to override) 2024-09-17T05:24:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.722+0000 7f38d57fa640 1 -- 172.21.15.81:0/430737695 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -11 subvolume 'subvol75742' is not ready for operation rm (use --force to override)) ==== 87+0+0 (secure 0 0 0) 0x7f38d80b5700 con 0x7f38bc0790d0 2024-09-17T05:24:26.723 INFO:teuthology.orchestra.run.smithi081.stderr:Error EAGAIN: subvolume 'subvol75742' is not ready for operation rm (use --force to override) 2024-09-17T05:24:26.728 DEBUG:teuthology.orchestra.run:got remote process result: 11 2024-09-17T05:24:26.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:26.729 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol75742/.meta) 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:type = clone 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol75742/6ec7f396-39e8-48f7-893a-6e07dc9700df 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:state = pending 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:[source] 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:volume = fake 2024-09-17T05:24:26.756 INFO:teuthology.orchestra.run.smithi081.stdout:subvolume = fake 2024-09-17T05:24:26.757 INFO:teuthology.orchestra.run.smithi081.stdout:snapshot = fake 2024-09-17T05:24:26.758 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol75742 --force 2024-09-17T05:24:26.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.901+0000 7f959372c640 1 -- 172.21.15.81:0/3096821673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9578004d40 msgr2=0x7f95780051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.901+0000 7f959372c640 1 --2- 172.21.15.81:0/3096821673 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9578004d40 0x7f95780051c0 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f9584009b50 tx=0x7f9578005830 comp rx=0 tx=0).stop 2024-09-17T05:24:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.901+0000 7f9591cc9640 1 -- 172.21.15.81:0/3096821673 reap_dead start 2024-09-17T05:24:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.901+0000 7f959372c640 1 -- 172.21.15.81:0/3096821673 shutdown_connections 2024-09-17T05:24:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.901+0000 7f959372c640 1 -- 172.21.15.81:0/3096821673 >> 172.21.15.81:0/3096821673 conn(0x7f958c0b1620 msgr2=0x7f958c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.901+0000 7f959372c640 1 -- 172.21.15.81:0/3096821673 shutdown_connections 2024-09-17T05:24:26.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.901+0000 7f959372c640 1 -- 172.21.15.81:0/3096821673 wait complete. 2024-09-17T05:24:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 Processor -- start 2024-09-17T05:24:26.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 -- start start 2024-09-17T05:24:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9578004d40 0x7f958c1f6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958c0c9ea0 0x7f958c1f19a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c15c9d0 0x7f958c15ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0cc5c0 con 0x7f958c0c9ea0 2024-09-17T05:24:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f958c0cc440 con 0x7f958c15c9d0 2024-09-17T05:24:26.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f959372c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f958c0cc740 con 0x7f9578004d40 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f9590cc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958c0c9ea0 0x7f958c1f19a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f9590cc7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958c0c9ea0 0x7f958c1f19a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57264/0 (socket says 172.21.15.81:57264) 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f9590cc7640 1 -- 172.21.15.81:0/3682141877 learned_addr learned my addr 172.21.15.81:0/3682141877 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.903+0000 7f95914c8640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9578004d40 0x7f958c1f6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9591cc9640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c15c9d0 0x7f958c15ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9590cc7640 1 -- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9578004d40 msgr2=0x7f958c1f6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9590cc7640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9578004d40 0x7f958c1f6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9590cc7640 1 -- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c15c9d0 msgr2=0x7f958c15ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9590cc7640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c15c9d0 0x7f958c15ce60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9590cc7640 1 -- 172.21.15.81:0/3682141877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c1f65b0 con 0x7f958c0c9ea0 2024-09-17T05:24:26.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9590cc7640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958c0c9ea0 0x7f958c1f19a0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f957c00e600 tx=0x7f957c00ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9581ffb640 1 -- 172.21.15.81:0/3682141877 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c015070 con 0x7f958c0c9ea0 2024-09-17T05:24:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9581ffb640 1 -- 172.21.15.81:0/3682141877 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f957c00c9e0 con 0x7f958c0c9ea0 2024-09-17T05:24:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f9581ffb640 1 -- 172.21.15.81:0/3682141877 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f957c00ce30 con 0x7f958c0c9ea0 2024-09-17T05:24:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c1f1ee0 con 0x7f958c0c9ea0 2024-09-17T05:24:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.904+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c146a30 con 0x7f958c0c9ea0 2024-09-17T05:24:26.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.905+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c15f4b0 con 0x7f958c0c9ea0 2024-09-17T05:24:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.906+0000 7f9581ffb640 1 -- 172.21.15.81:0/3682141877 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) ==== 101900+0+0 (secure 0 0 0) 0x7f957c018070 con 0x7f958c0c9ea0 2024-09-17T05:24:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.906+0000 7f9581ffb640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95700790d0 0x7f957007b590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.906+0000 7f9581ffb640 1 -- 172.21.15.81:0/3682141877 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f957c09b9e0 con 0x7f958c0c9ea0 2024-09-17T05:24:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.906+0000 7f95914c8640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95700790d0 0x7f957007b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:26.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.907+0000 7f95914c8640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95700790d0 0x7f957007b590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f958c14aa60 tx=0x7f9588009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:26.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:26.910+0000 7f9581ffb640 1 -- 172.21.15.81:0/3682141877 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f958c1f65b0 con 0x7f958c0c9ea0 2024-09-17T05:24:27.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.110+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol75742", "force": true, "target": ["mon-mgr", ""]}) -- 0x7f958c15d3a0 con 0x7f95700790d0 2024-09-17T05:24:27.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.125+0000 7f9581ffb640 1 -- 172.21.15.81:0/3682141877 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f958801c420 con 0x7f95700790d0 2024-09-17T05:24:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95700790d0 msgr2=0x7f957007b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95700790d0 0x7f957007b590 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f958c14aa60 tx=0x7f9588009500 comp rx=0 tx=0).stop 2024-09-17T05:24:27.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958c0c9ea0 msgr2=0x7f958c1f19a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958c0c9ea0 0x7f958c1f19a0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f957c00e600 tx=0x7f957c00ea00 comp rx=0 tx=0).stop 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 shutdown_connections 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f95700790d0 0x7f957007b590 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f958c15c9d0 0x7f958c15ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f958c0c9ea0 0x7f958c1f19a0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 --2- 172.21.15.81:0/3682141877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9578004d40 0x7f958c1f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 >> 172.21.15.81:0/3682141877 conn(0x7f958c0b1620 msgr2=0x7f958c15d590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 shutdown_connections 2024-09-17T05:24:27.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.127+0000 7f959372c640 1 -- 172.21.15.81:0/3682141877 wait complete. 2024-09-17T05:24:27.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls cephfs 2024-09-17T05:24:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3521386801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 msgr2=0x7f7d540cc800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3521386801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d540cc800 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f7d540b2740 tx=0x7f7d4c02a980 comp rx=0 tx=0).stop 2024-09-17T05:24:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3521386801 shutdown_connections 2024-09-17T05:24:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3521386801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d540cc800 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3521386801 >> v2:172.21.15.160:3300/0 conn(0x7f7d5415aa00 0x7f7d540cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3521386801 >> 172.21.15.81:0/3521386801 conn(0x7f7d540b1700 msgr2=0x7f7d540b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:27.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3521386801 shutdown_connections 2024-09-17T05:24:27.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.244+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3521386801 wait complete. 2024-09-17T05:24:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.245+0000 7f7d5b8bd640 1 Processor -- start 2024-09-17T05:24:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.245+0000 7f7d5b8bd640 1 -- start start 2024-09-17T05:24:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d5b8bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d541e4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d5b8bd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d5415aa00 0x7f7d541f5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d5b8bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5415f270 0x7f7d5415d640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d5b8bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5406f590 con 0x7f7d540cc3f0 2024-09-17T05:24:27.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d5b8bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5406f410 con 0x7f7d5415f270 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d5b8bd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5406f710 con 0x7f7d5415aa00 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d541e4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d541e4450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57274/0 (socket says 172.21.15.81:57274) 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 -- 172.21.15.81:0/3363621229 learned_addr learned my addr 172.21.15.81:0/3363621229 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59e5a640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5415f270 0x7f7d5415d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d58e58640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d5415aa00 0x7f7d541f5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 -- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d5415aa00 msgr2=0x7f7d541f5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d5415aa00 0x7f7d541f5860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 -- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5415f270 msgr2=0x7f7d5415d640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5415f270 0x7f7d5415d640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 -- 172.21.15.81:0/3363621229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5414aed0 con 0x7f7d540cc3f0 2024-09-17T05:24:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d58e58640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d5415aa00 0x7f7d541f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d59659640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d541e4450 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000d950 tx=0x7f7d5000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d49ffb640 1 -- 172.21.15.81:0/3363621229 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d50017070 con 0x7f7d540cc3f0 2024-09-17T05:24:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d49ffb640 1 -- 172.21.15.81:0/3363621229 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d50009cc0 con 0x7f7d540cc3f0 2024-09-17T05:24:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d49ffb640 1 -- 172.21.15.81:0/3363621229 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d500106c0 con 0x7f7d540cc3f0 2024-09-17T05:24:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.246+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d541f61b0 con 0x7f7d540cc3f0 2024-09-17T05:24:27.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.247+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d541f6450 con 0x7f7d540cc3f0 2024-09-17T05:24:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.248+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5406fc80 con 0x7f7d540cc3f0 2024-09-17T05:24:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.248+0000 7f7d49ffb640 1 -- 172.21.15.81:0/3363621229 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) ==== 101900+0+0 (secure 0 0 0) 0x7f7d50010860 con 0x7f7d540cc3f0 2024-09-17T05:24:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.248+0000 7f7d49ffb640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d380790a0 0x7f7d3807b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.249+0000 7f7d49ffb640 1 -- 172.21.15.81:0/3363621229 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f7d5009b9d0 con 0x7f7d540cc3f0 2024-09-17T05:24:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.249+0000 7f7d58e58640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d380790a0 0x7f7d3807b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.249+0000 7f7d58e58640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d380790a0 0x7f7d3807b560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d540b0580 tx=0x7f7d44008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:27.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.253+0000 7f7d49ffb640 1 -- 172.21.15.81:0/3363621229 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7d500637a0 con 0x7f7d540cc3f0 2024-09-17T05:24:27.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.455+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "cephfs", "target": ["mon-mgr", ""]}) -- 0x7f7d5414a9a0 con 0x7f7d380790a0 2024-09-17T05:24:27.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.458+0000 7f7d49ffb640 1 -- 172.21.15.81:0/3363621229 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f7d5414a9a0 con 0x7f7d380790a0 2024-09-17T05:24:27.459 INFO:teuthology.orchestra.run.smithi081.stdout:[] 2024-09-17T05:24:27.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d380790a0 msgr2=0x7f7d3807b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d380790a0 0x7f7d3807b560 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f7d540b0580 tx=0x7f7d44008040 comp rx=0 tx=0).stop 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 msgr2=0x7f7d541e4450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d541e4450 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f7d5000d950 tx=0x7f7d5000de10 comp rx=0 tx=0).stop 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 shutdown_connections 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d380790a0 0x7f7d3807b560 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d5415f270 0x7f7d5415d640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d5415aa00 0x7f7d541f5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 --2- 172.21.15.81:0/3363621229 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d540cc3f0 0x7f7d541e4450 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.460+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 >> 172.21.15.81:0/3363621229 conn(0x7f7d540b1700 msgr2=0x7f7d540b0a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.461+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 shutdown_connections 2024-09-17T05:24:27.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.461+0000 7f7d5b8bd640 1 -- 172.21.15.81:0/3363621229 wait complete. 2024-09-17T05:24:27.472 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:24:27.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:24:27.523 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-17T05:24:27.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:27.529 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:24:27.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:27.567 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:27.633 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:24:27.634 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:27.634 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:27.634 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:27.650 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:27.650 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:27.708 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:24:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.849+0000 7f432507f640 1 -- 172.21.15.81:0/3273332850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43080039e0 msgr2=0x7f4308003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.849+0000 7f432507f640 1 --2- 172.21.15.81:0/3273332850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43080039e0 0x7f4308003de0 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f431000c610 tx=0x7f4308005830 comp rx=0 tx=0).stop 2024-09-17T05:24:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.849+0000 7f431f59e640 1 -- 172.21.15.81:0/3273332850 reap_dead start 2024-09-17T05:24:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.849+0000 7f432507f640 1 -- 172.21.15.81:0/3273332850 shutdown_connections 2024-09-17T05:24:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.849+0000 7f432507f640 1 -- 172.21.15.81:0/3273332850 >> 172.21.15.81:0/3273332850 conn(0x7f43200b1690 msgr2=0x7f43200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.849+0000 7f432507f640 1 -- 172.21.15.81:0/3273332850 shutdown_connections 2024-09-17T05:24:27.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.849+0000 7f432507f640 1 -- 172.21.15.81:0/3273332850 wait complete. 2024-09-17T05:24:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.851+0000 7f432507f640 1 Processor -- start 2024-09-17T05:24:27.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.851+0000 7f432507f640 1 -- start start 2024-09-17T05:24:27.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f432507f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43080039e0 0x7f4320141960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f432507f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43201f6860 0x7f4320155750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f432507f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43201f2620 0x7f432015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f432507f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43200ceac0 con 0x7f43201f6860 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f432507f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f43200ccb10 con 0x7f43080039e0 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f432507f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f43200cec40 con 0x7f43201f2620 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43201f6860 0x7f4320155750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43201f6860 0x7f4320155750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57282/0 (socket says 172.21.15.81:57282) 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 -- 172.21.15.81:0/1093113001 learned_addr learned my addr 172.21.15.81:0/1093113001 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431ed9d640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43080039e0 0x7f4320141960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431f59e640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43201f2620 0x7f432015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 -- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43201f2620 msgr2=0x7f432015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43201f2620 0x7f432015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 -- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43080039e0 msgr2=0x7f4320141960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43080039e0 0x7f4320141960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 -- 172.21.15.81:0/1093113001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43201f3070 con 0x7f43201f6860 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f431e59c640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43201f6860 0x7f4320155750 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f431400d600 tx=0x7f431400dac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f43077fe640 1 -- 172.21.15.81:0/1093113001 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4314014070 con 0x7f43201f6860 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f43077fe640 1 -- 172.21.15.81:0/1093113001 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f431400f9c0 con 0x7f43201f6860 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.852+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43201f3350 con 0x7f43201f6860 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.853+0000 7f43077fe640 1 -- 172.21.15.81:0/1093113001 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431400fe10 con 0x7f43201f6860 2024-09-17T05:24:27.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.853+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4320141440 con 0x7f43201f6860 2024-09-17T05:24:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.854+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4320141f00 con 0x7f43201f6860 2024-09-17T05:24:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.854+0000 7f43077fe640 1 -- 172.21.15.81:0/1093113001 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 21) ==== 101900+0+0 (secure 0 0 0) 0x7f4314017070 con 0x7f43201f6860 2024-09-17T05:24:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.855+0000 7f43077fe640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f430c0790a0 0x7f430c07b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:27.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.855+0000 7f43077fe640 1 -- 172.21.15.81:0/1093113001 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f431409b900 con 0x7f43201f6860 2024-09-17T05:24:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.855+0000 7f431ed9d640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f430c0790a0 0x7f430c07b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:27.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.855+0000 7f431ed9d640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f430c0790a0 0x7f430c07b560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4310033000 tx=0x7f4310038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:27.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:27.859+0000 7f43077fe640 1 -- 172.21.15.81:0/1093113001 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4314062ff0 con 0x7f43201f6860 2024-09-17T05:24:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.048+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f4320141610 con 0x7f43201f6860 2024-09-17T05:24:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.048+0000 7f43077fe640 1 -- 172.21.15.81:0/1093113001 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7f4314067a20 con 0x7f43201f6860 2024-09-17T05:24:28.049 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:24:28.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f430c0790a0 msgr2=0x7f430c07b560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f430c0790a0 0x7f430c07b560 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4310033000 tx=0x7f4310038040 comp rx=0 tx=0).stop 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43201f6860 msgr2=0x7f4320155750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43201f6860 0x7f4320155750 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f431400d600 tx=0x7f431400dac0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 shutdown_connections 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f43201f2620 0x7f432015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43201f6860 0x7f4320155750 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f430c0790a0 0x7f430c07b560 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 --2- 172.21.15.81:0/1093113001 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43080039e0 0x7f4320141960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 >> 172.21.15.81:0/1093113001 conn(0x7f43200b1690 msgr2=0x7f43200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 shutdown_connections 2024-09-17T05:24:28.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.050+0000 7f432507f640 1 -- 172.21.15.81:0/1093113001 wait complete. 2024-09-17T05:24:28.063 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:24:28.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:28.063 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:28.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[69329]: fuse finished with error 0 and tester_r 0 2024-09-17T05:24:28.088 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:24:28.088 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:28.089 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:24:28.212 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:28.212 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:28.212 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:28.230 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:28.230 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:28.287 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:24:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.389+0000 7f1e9959b640 1 -- 172.21.15.81:0/2012332728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940d2760 msgr2=0x7f1e940ce630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.389+0000 7f1e9959b640 1 --2- 172.21.15.81:0/2012332728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940d2760 0x7f1e940ce630 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f1e88005fd0 tx=0x7f1e8802a4a0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.389+0000 7f1e9959b640 1 -- 172.21.15.81:0/2012332728 shutdown_connections 2024-09-17T05:24:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.389+0000 7f1e9959b640 1 --2- 172.21.15.81:0/2012332728 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940ceb70 0x7f1e940cd1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.389+0000 7f1e9959b640 1 --2- 172.21.15.81:0/2012332728 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940d2760 0x7f1e940ce630 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.389+0000 7f1e9959b640 1 -- 172.21.15.81:0/2012332728 >> 172.21.15.81:0/2012332728 conn(0x7f1e940d1c40 msgr2=0x7f1e940d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.390+0000 7f1e9959b640 1 -- 172.21.15.81:0/2012332728 shutdown_connections 2024-09-17T05:24:28.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.390+0000 7f1e9959b640 1 -- 172.21.15.81:0/2012332728 wait complete. 2024-09-17T05:24:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.391+0000 7f1e9959b640 1 Processor -- start 2024-09-17T05:24:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.391+0000 7f1e9959b640 1 -- start start 2024-09-17T05:24:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.391+0000 7f1e9959b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940ceb70 0x7f1e941f2540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e9959b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940d2760 0x7f1e940c9720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e9959b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9415bd30 0x7f1e941f6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e9959b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e940cf590 con 0x7f1e940ceb70 2024-09-17T05:24:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e9959b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1e940cf410 con 0x7f1e9415bd30 2024-09-17T05:24:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e9959b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1e940cd730 con 0x7f1e940d2760 2024-09-17T05:24:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940ceb70 0x7f1e941f2540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940ceb70 0x7f1e941f2540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57306/0 (socket says 172.21.15.81:57306) 2024-09-17T05:24:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 -- 172.21.15.81:0/4278628430 learned_addr learned my addr 172.21.15.81:0/4278628430 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e927fc640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940d2760 0x7f1e940c9720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e937fe640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9415bd30 0x7f1e941f6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 -- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940d2760 msgr2=0x7f1e940c9720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940d2760 0x7f1e940c9720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 -- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9415bd30 msgr2=0x7f1e941f6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9415bd30 0x7f1e941f6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 -- 172.21.15.81:0/4278628430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e940ca100 con 0x7f1e940ceb70 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e92ffd640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940ceb70 0x7f1e941f2540 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400ba50 tx=0x7f1e8400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e7b7fe640 1 -- 172.21.15.81:0/4278628430 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e84019070 con 0x7f1e940ceb70 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e7b7fe640 1 -- 172.21.15.81:0/4278628430 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e8400cd10 con 0x7f1e940ceb70 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e940ca3e0 con 0x7f1e940ceb70 2024-09-17T05:24:28.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e7b7fe640 1 -- 172.21.15.81:0/4278628430 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e840146a0 con 0x7f1e940ceb70 2024-09-17T05:24:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.392+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e9415c4f0 con 0x7f1e940ceb70 2024-09-17T05:24:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.393+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e940cf1f0 con 0x7f1e940ceb70 2024-09-17T05:24:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.394+0000 7f1e7b7fe640 1 -- 172.21.15.81:0/4278628430 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f1e8401c070 con 0x7f1e940ceb70 2024-09-17T05:24:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.395+0000 7f1e7b7fe640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e800791c0 0x7f1e8007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.395+0000 7f1e927fc640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e800791c0 0x7f1e8007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.395+0000 7f1e7b7fe640 1 -- 172.21.15.81:0/4278628430 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f1e8409b640 con 0x7f1e940ceb70 2024-09-17T05:24:28.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.395+0000 7f1e927fc640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e800791c0 0x7f1e8007b680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1e88033000 tx=0x7f1e88004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:28.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.399+0000 7f1e7b7fe640 1 -- 172.21.15.81:0/4278628430 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1e84062a40 con 0x7f1e940ceb70 2024-09-17T05:24:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.586+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f1e940cd1d0 con 0x7f1e940ceb70 2024-09-17T05:24:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.586+0000 7f1e7b7fe640 1 -- 172.21.15.81:0/4278628430 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v117) ==== 80+0+0 (secure 0 0 0) 0x7f1e84067470 con 0x7f1e940ceb70 2024-09-17T05:24:28.587 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:24:28.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e800791c0 msgr2=0x7f1e8007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e800791c0 0x7f1e8007b680 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f1e88033000 tx=0x7f1e88004730 comp rx=0 tx=0).stop 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940ceb70 msgr2=0x7f1e941f2540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940ceb70 0x7f1e941f2540 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f1e8400ba50 tx=0x7f1e8400bf10 comp rx=0 tx=0).stop 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 shutdown_connections 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e800791c0 0x7f1e8007b680 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e9415bd30 0x7f1e941f6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e940d2760 0x7f1e940c9720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 --2- 172.21.15.81:0/4278628430 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e940ceb70 0x7f1e941f2540 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 >> 172.21.15.81:0/4278628430 conn(0x7f1e940d1c40 msgr2=0x7f1e94152cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:28.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 shutdown_connections 2024-09-17T05:24:28.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.588+0000 7f1e9959b640 1 -- 172.21.15.81:0/4278628430 wait complete. 2024-09-17T05:24:28.600 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:24:28.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:28.601 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:28.629 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[48062]: fuse finished with error 0 and tester_r 0 2024-09-17T05:24:28.630 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:24:28.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:28.631 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:24:28.776 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:28.776 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:28.776 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:28.792 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:24:28.792 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:24:28.792 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:28.792 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:28.810 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:24:28.810 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.932+0000 7f77f127f640 1 -- 172.21.15.81:0/2748374696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec0d49c0 msgr2=0x7f77ec0d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.932+0000 7f77f127f640 1 --2- 172.21.15.81:0/2748374696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec0d49c0 0x7f77ec0d0630 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f77ec08cf10 tx=0x7f77d402a560 comp rx=0 tx=0).stop 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.932+0000 7f77f127f640 1 -- 172.21.15.81:0/2748374696 shutdown_connections 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.933+0000 7f77f127f640 1 --2- 172.21.15.81:0/2748374696 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77ec162480 0x7f77ec0d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.933+0000 7f77f127f640 1 --2- 172.21.15.81:0/2748374696 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec0d49c0 0x7f77ec0d0630 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.933+0000 7f77f127f640 1 --2- 172.21.15.81:0/2748374696 >> v2:172.21.15.160:3300/0 conn(0x7f77ec15df90 0x7f77ec0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.933+0000 7f77f127f640 1 -- 172.21.15.81:0/2748374696 >> 172.21.15.81:0/2748374696 conn(0x7f77ec0d3ea0 msgr2=0x7f77ec0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.933+0000 7f77f127f640 1 -- 172.21.15.81:0/2748374696 shutdown_connections 2024-09-17T05:24:28.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.933+0000 7f77f127f640 1 -- 172.21.15.81:0/2748374696 wait complete. 2024-09-17T05:24:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.934+0000 7f77f127f640 1 Processor -- start 2024-09-17T05:24:28.935 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.934+0000 7f77f127f640 1 -- start start 2024-09-17T05:24:28.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77f127f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77ec0d49c0 0x7f77ec09db80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77f127f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec15df90 0x7f77ec0ca7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77f127f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77ec162480 0x7f77ec1f8150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77f127f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec0b3b90 con 0x7f77ec15df90 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77f127f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f77ec0b3a10 con 0x7f77ec0d49c0 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77f127f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f77ec0b3d10 con 0x7f77ec162480 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec15df90 0x7f77ec0ca7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec15df90 0x7f77ec0ca7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57314/0 (socket says 172.21.15.81:57314) 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 -- 172.21.15.81:0/322390062 learned_addr learned my addr 172.21.15.81:0/322390062 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77eaffd640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77ec0d49c0 0x7f77ec09db80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77eb7fe640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77ec162480 0x7f77ec1f8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 -- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77ec162480 msgr2=0x7f77ec1f8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77ec162480 0x7f77ec1f8150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 -- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77ec0d49c0 msgr2=0x7f77ec09db80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77ec0d49c0 0x7f77ec09db80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 -- 172.21.15.81:0/322390062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77ec09e0c0 con 0x7f77ec15df90 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77eaffd640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77ec0d49c0 0x7f77ec09db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e27fc640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec15df90 0x7f77ec0ca7f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f77d4000c00 tx=0x7f77d40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e3fff640 1 -- 172.21.15.81:0/322390062 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d403f070 con 0x7f77ec15df90 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e3fff640 1 -- 172.21.15.81:0/322390062 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f77d4004890 con 0x7f77ec15df90 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77ec0cad30 con 0x7f77ec15df90 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.935+0000 7f77e3fff640 1 -- 172.21.15.81:0/322390062 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77d4035030 con 0x7f77ec15df90 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.936+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77ec0a0750 con 0x7f77ec15df90 2024-09-17T05:24:28.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.937+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77ec06ebd0 con 0x7f77ec15df90 2024-09-17T05:24:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.937+0000 7f77e3fff640 1 -- 172.21.15.81:0/322390062 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f77d4042070 con 0x7f77ec15df90 2024-09-17T05:24:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.938+0000 7f77e3fff640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77cc0791c0 0x7f77cc07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.938+0000 7f77e3fff640 1 -- 172.21.15.81:0/322390062 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f77d40bc600 con 0x7f77ec15df90 2024-09-17T05:24:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.938+0000 7f77eaffd640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77cc0791c0 0x7f77cc07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:28.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.938+0000 7f77eaffd640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77cc0791c0 0x7f77cc07b680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006fd0 tx=0x7f77dc008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:28.942+0000 7f77e3fff640 1 -- 172.21.15.81:0/322390062 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f77ec06ebd0 con 0x7f77ec15df90 2024-09-17T05:24:29.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.154+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77ec0b4270 con 0x7f77ec15df90 2024-09-17T05:24:29.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.155+0000 7f77e3fff640 1 -- 172.21.15.81:0/322390062 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7f77d4084350 con 0x7f77ec15df90 2024-09-17T05:24:29.156 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:29.156 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"btime":"2024-09-17T05:24:22:137896+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3436145099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3436145099},{"type":"v1","addr":"172.21.15.160:6834","nonce":3436145099}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3146864973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3146864973},{"type":"v1","addr":"172.21.15.160:6835","nonce":3146864973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7515,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/3025598693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3025598693},{"type":"v1","addr":"172.21.15.81:6833","nonce":3025598693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:13.064331+0000","modified":"2024-09-17T05:24:15.061074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7518":{"gid":7518,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1143442034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1143442034},{"type":"v1","addr":"172.21.15.81:6835","nonce":1143442034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7518,"qdb_cluster":[7518]},"id":9}]} 2024-09-17T05:24:29.157 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 69 2024-09-17T05:24:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77cc0791c0 msgr2=0x7f77cc07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77cc0791c0 0x7f77cc07b680 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f77dc006fd0 tx=0x7f77dc008040 comp rx=0 tx=0).stop 2024-09-17T05:24:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec15df90 msgr2=0x7f77ec0ca7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec15df90 0x7f77ec0ca7f0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f77d4000c00 tx=0x7f77d40039e0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 shutdown_connections 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77ec162480 0x7f77ec1f8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77ec15df90 0x7f77ec0ca7f0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77cc0791c0 0x7f77cc07b680 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 --2- 172.21.15.81:0/322390062 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77ec0d49c0 0x7f77ec09db80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 >> 172.21.15.81:0/322390062 conn(0x7f77ec0d3ea0 msgr2=0x7f77ec0b5220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 shutdown_connections 2024-09-17T05:24:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.157+0000 7f77f127f640 1 -- 172.21.15.81:0/322390062 wait complete. 2024-09-17T05:24:29.170 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 -- 172.21.15.81:0/3144678456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd80d49c0 msgr2=0x7f7dd80d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 --2- 172.21.15.81:0/3144678456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd80d49c0 0x7f7dd80d0630 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f7dd808cf10 tx=0x7f7dcc02a560 comp rx=0 tx=0).stop 2024-09-17T05:24:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 -- 172.21.15.81:0/3144678456 shutdown_connections 2024-09-17T05:24:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 --2- 172.21.15.81:0/3144678456 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd8162480 0x7f7dd80d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 --2- 172.21.15.81:0/3144678456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd80d49c0 0x7f7dd80d0630 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 --2- 172.21.15.81:0/3144678456 >> v2:172.21.15.160:3300/0 conn(0x7f7dd815df90 0x7f7dd80cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 -- 172.21.15.81:0/3144678456 >> 172.21.15.81:0/3144678456 conn(0x7f7dd80d3ea0 msgr2=0x7f7dd80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 -- 172.21.15.81:0/3144678456 shutdown_connections 2024-09-17T05:24:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.270+0000 7f7de07ec640 1 -- 172.21.15.81:0/3144678456 wait complete. 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 Processor -- start 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 -- start start 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd80d49c0 0x7f7dd81616c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd815df90 0x7f7dd8150de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd8162480 0x7f7dd814d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd80b3b90 con 0x7f7dd8162480 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7dd80b3a10 con 0x7f7dd80d49c0 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7de07ec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7dd80b3d10 con 0x7f7dd815df90 2024-09-17T05:24:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7dded89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd8162480 0x7f7dd814d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.272+0000 7f7dded89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd8162480 0x7f7dd814d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57336/0 (socket says 172.21.15.81:57336) 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dded89640 1 -- 172.21.15.81:0/4033824167 learned_addr learned my addr 172.21.15.81:0/4033824167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dded89640 1 -- 172.21.15.81:0/4033824167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd815df90 msgr2=0x7f7dd8150de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dded89640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd815df90 0x7f7dd8150de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dded89640 1 -- 172.21.15.81:0/4033824167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd80d49c0 msgr2=0x7f7dd81616c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dded89640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd80d49c0 0x7f7dd81616c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dded89640 1 -- 172.21.15.81:0/4033824167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7dd809ddd0 con 0x7f7dd8162480 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dded89640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd8162480 0x7f7dd814d9f0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d750 tx=0x7f7dd000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dd6ffd640 1 -- 172.21.15.81:0/4033824167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0017070 con 0x7f7dd8162480 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dd6ffd640 1 -- 172.21.15.81:0/4033824167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7dd0009d40 con 0x7f7dd8162480 2024-09-17T05:24:29.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7dd6ffd640 1 -- 172.21.15.81:0/4033824167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7dd0004280 con 0x7f7dd8162480 2024-09-17T05:24:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7dd80cc300 con 0x7f7dd8162480 2024-09-17T05:24:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.273+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7dd809e0b0 con 0x7f7dd8162480 2024-09-17T05:24:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.274+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7dd80cf9b0 con 0x7f7dd8162480 2024-09-17T05:24:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.275+0000 7f7dd6ffd640 1 -- 172.21.15.81:0/4033824167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f7dd00035f0 con 0x7f7dd8162480 2024-09-17T05:24:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.275+0000 7f7dd6ffd640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7dc40791c0 0x7f7dc407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.275+0000 7f7dde588640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7dc40791c0 0x7f7dc407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.275+0000 7f7dd6ffd640 1 -- 172.21.15.81:0/4033824167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f7dd009b930 con 0x7f7dd8162480 2024-09-17T05:24:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.276+0000 7f7dde588640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7dc40791c0 0x7f7dc407b680 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8005c40 tx=0x7f7dc8005bd0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.280+0000 7f7dd6ffd640 1 -- 172.21.15.81:0/4033824167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7dd0020030 con 0x7f7dd8162480 2024-09-17T05:24:29.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.490+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f7dd80b49d0 con 0x7f7dd8162480 2024-09-17T05:24:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.491+0000 7f7dd6ffd640 1 -- 172.21.15.81:0/4033824167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7f7dd000de60 con 0x7f7dd8162480 2024-09-17T05:24:29.492 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:29.492 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"btime":"2024-09-17T05:24:22:137896+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3436145099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3436145099},{"type":"v1","addr":"172.21.15.160:6834","nonce":3436145099}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3146864973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3146864973},{"type":"v1","addr":"172.21.15.160:6835","nonce":3146864973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7515,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/3025598693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3025598693},{"type":"v1","addr":"172.21.15.81:6833","nonce":3025598693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:13.064331+0000","modified":"2024-09-17T05:24:15.061074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7518":{"gid":7518,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1143442034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1143442034},{"type":"v1","addr":"172.21.15.81:6835","nonce":1143442034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7518,"qdb_cluster":[7518]},"id":9}]} 2024-09-17T05:24:29.492 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 69 2024-09-17T05:24:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7dc40791c0 msgr2=0x7f7dc407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7dc40791c0 0x7f7dc407b680 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f7dc8005c40 tx=0x7f7dc8005bd0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd8162480 msgr2=0x7f7dd814d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd8162480 0x7f7dd814d9f0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f7dd000d750 tx=0x7f7dd000dc10 comp rx=0 tx=0).stop 2024-09-17T05:24:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 shutdown_connections 2024-09-17T05:24:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7dd8162480 0x7f7dd814d9f0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7dd815df90 0x7f7dd8150de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7dc40791c0 0x7f7dc407b680 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 --2- 172.21.15.81:0/4033824167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7dd80d49c0 0x7f7dd81616c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 >> 172.21.15.81:0/4033824167 conn(0x7f7dd80d3ea0 msgr2=0x7f7dd80b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 shutdown_connections 2024-09-17T05:24:29.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.493+0000 7f7de07ec640 1 -- 172.21.15.81:0/4033824167 wait complete. 2024-09-17T05:24:29.505 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 -- 172.21.15.81:0/3442083089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d300ce780 msgr2=0x7f8d300cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 --2- 172.21.15.81:0/3442083089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d300ce780 0x7f8d300cbb80 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8d30071730 tx=0x7f8d2002aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 -- 172.21.15.81:0/3442083089 shutdown_connections 2024-09-17T05:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 --2- 172.21.15.81:0/3442083089 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d300ce780 0x7f8d300cbb80 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 --2- 172.21.15.81:0/3442083089 >> v2:172.21.15.160:3300/0 conn(0x7f8d3006f490 0x7f8d300ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 --2- 172.21.15.81:0/3442083089 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3006f0b0 0x7f8d300cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 -- 172.21.15.81:0/3442083089 >> 172.21.15.81:0/3442083089 conn(0x7f8d300741f0 msgr2=0x7f8d30074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 -- 172.21.15.81:0/3442083089 shutdown_connections 2024-09-17T05:24:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.604+0000 7f8d37784640 1 -- 172.21.15.81:0/3442083089 wait complete. 2024-09-17T05:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.605+0000 7f8d37784640 1 Processor -- start 2024-09-17T05:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.605+0000 7f8d37784640 1 -- start start 2024-09-17T05:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d37784640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3006f0b0 0x7f8d3009ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d37784640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3006f490 0x7f8d300c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d37784640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d300ce780 0x7f8d301f30a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d37784640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3015e5e0 con 0x7f8d3006f0b0 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d37784640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8d3015e460 con 0x7f8d300ce780 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d37784640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8d300cc0c0 con 0x7f8d3006f490 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3006f0b0 0x7f8d3009ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3006f0b0 0x7f8d3009ab90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57360/0 (socket says 172.21.15.81:57360) 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 -- 172.21.15.81:0/850908360 learned_addr learned my addr 172.21.15.81:0/850908360 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35d21640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d300ce780 0x7f8d301f30a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d34d1f640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3006f490 0x7f8d300c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 -- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3006f490 msgr2=0x7f8d300c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3006f490 0x7f8d300c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 -- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d300ce780 msgr2=0x7f8d301f30a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d300ce780 0x7f8d301f30a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.606+0000 7f8d35520640 1 -- 172.21.15.81:0/850908360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d300c6c90 con 0x7f8d3006f0b0 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.607+0000 7f8d35520640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3006f0b0 0x7f8d3009ab90 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c940 tx=0x7f8d2800ce00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.607+0000 7f8d2dffb640 1 -- 172.21.15.81:0/850908360 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d28007bb0 con 0x7f8d3006f0b0 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.607+0000 7f8d2dffb640 1 -- 172.21.15.81:0/850908360 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d28007e40 con 0x7f8d3006f0b0 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.607+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d300c3db0 con 0x7f8d3006f0b0 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.607+0000 7f8d2dffb640 1 -- 172.21.15.81:0/850908360 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d28005260 con 0x7f8d3006f0b0 2024-09-17T05:24:29.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.607+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d300c4370 con 0x7f8d3006f0b0 2024-09-17T05:24:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.608+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d300cc560 con 0x7f8d3006f0b0 2024-09-17T05:24:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.609+0000 7f8d2dffb640 1 -- 172.21.15.81:0/850908360 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f8d28005400 con 0x7f8d3006f0b0 2024-09-17T05:24:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.609+0000 7f8d2dffb640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d1c0791c0 0x7f8d1c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.609+0000 7f8d2dffb640 1 -- 172.21.15.81:0/850908360 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f8d2809c030 con 0x7f8d3006f0b0 2024-09-17T05:24:29.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.609+0000 7f8d34d1f640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d1c0791c0 0x7f8d1c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.610+0000 7f8d34d1f640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d1c0791c0 0x7f8d1c07b680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d300c5270 tx=0x7f8d24010040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:29.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.613+0000 7f8d2dffb640 1 -- 172.21.15.81:0/850908360 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8d300c6c90 con 0x7f8d3006f0b0 2024-09-17T05:24:29.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.794+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d30075070 con 0x7f8d3006f0b0 2024-09-17T05:24:29.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.795+0000 7f8d2dffb640 1 -- 172.21.15.81:0/850908360 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v117) ==== 74+0+16806 (secure 0 0 0) 0x7f8d28014030 con 0x7f8d3006f0b0 2024-09-17T05:24:29.796 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:29.796 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":117,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:14.697841+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:11.682378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:12.014580+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"117","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d1c0791c0 msgr2=0x7f8d1c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d1c0791c0 0x7f8d1c07b680 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8d300c5270 tx=0x7f8d24010040 comp rx=0 tx=0).stop 2024-09-17T05:24:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3006f0b0 msgr2=0x7f8d3009ab90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3006f0b0 0x7f8d3009ab90 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8d2800c940 tx=0x7f8d2800ce00 comp rx=0 tx=0).stop 2024-09-17T05:24:29.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 shutdown_connections 2024-09-17T05:24:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d1c0791c0 0x7f8d1c07b680 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d300ce780 0x7f8d301f30a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d3006f490 0x7f8d300c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 --2- 172.21.15.81:0/850908360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d3006f0b0 0x7f8d3009ab90 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 >> 172.21.15.81:0/850908360 conn(0x7f8d300741f0 msgr2=0x7f8d300b5380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 shutdown_connections 2024-09-17T05:24:29.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.797+0000 7f8d37784640 1 -- 172.21.15.81:0/850908360 wait complete. 2024-09-17T05:24:29.809 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:24:29.809 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.910+0000 7f965c516640 1 -- 172.21.15.81:0/926106893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f963c004800 msgr2=0x7f963c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.910+0000 7f965c516640 1 --2- 172.21.15.81:0/926106893 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f963c004800 0x7f963c004c80 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f964800c4d0 tx=0x7f963c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.910+0000 7f965aab3640 1 -- 172.21.15.81:0/926106893 reap_dead start 2024-09-17T05:24:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.910+0000 7f965c516640 1 -- 172.21.15.81:0/926106893 shutdown_connections 2024-09-17T05:24:29.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.910+0000 7f965c516640 1 -- 172.21.15.81:0/926106893 >> 172.21.15.81:0/926106893 conn(0x7f96540d3ea0 msgr2=0x7f96540d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.910+0000 7f965c516640 1 -- 172.21.15.81:0/926106893 shutdown_connections 2024-09-17T05:24:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.910+0000 7f965c516640 1 -- 172.21.15.81:0/926106893 wait complete. 2024-09-17T05:24:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.911+0000 7f965c516640 1 Processor -- start 2024-09-17T05:24:29.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.911+0000 7f965c516640 1 -- start start 2024-09-17T05:24:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965c516640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f963c004800 0x7f96541f8080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965c516640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96540cdf30 0x7f96541f51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965c516640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96541f5700 0x7f9654160ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965c516640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9654162690 con 0x7f96540cdf30 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965c516640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f96540b3800 con 0x7f963c004800 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965c516640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f96541f8710 con 0x7f96541f5700 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96540cdf30 0x7f96541f51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96540cdf30 0x7f96541f51c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57378/0 (socket says 172.21.15.81:57378) 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 -- 172.21.15.81:0/4210458704 learned_addr learned my addr 172.21.15.81:0/4210458704 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965a2b2640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f963c004800 0x7f96541f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f965aab3640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96541f5700 0x7f9654160ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 -- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96541f5700 msgr2=0x7f9654160ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96541f5700 0x7f9654160ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 -- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f963c004800 msgr2=0x7f96541f8080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f963c004800 0x7f96541f8080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 -- 172.21.15.81:0/4210458704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96541f89f0 con 0x7f96540cdf30 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9659ab1640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96540cdf30 0x7f96541f51c0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f9648000c00 tx=0x7f9648006310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.912+0000 7f9652ffd640 1 -- 172.21.15.81:0/4210458704 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9648039070 con 0x7f96540cdf30 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.913+0000 7f9652ffd640 1 -- 172.21.15.81:0/4210458704 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f964802b910 con 0x7f96540cdf30 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.913+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96541f8cd0 con 0x7f96540cdf30 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.913+0000 7f9652ffd640 1 -- 172.21.15.81:0/4210458704 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f964802bd40 con 0x7f96540cdf30 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.913+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9654161220 con 0x7f96540cdf30 2024-09-17T05:24:29.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.913+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96541f8f10 con 0x7f96540cdf30 2024-09-17T05:24:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.914+0000 7f9652ffd640 1 -- 172.21.15.81:0/4210458704 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f9648044020 con 0x7f96540cdf30 2024-09-17T05:24:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.914+0000 7f9652ffd640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96400791c0 0x7f964007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.915+0000 7f9652ffd640 1 -- 172.21.15.81:0/4210458704 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(117..117 src has 1..117) ==== 5753+0+0 (secure 0 0 0) 0x7f96480bb110 con 0x7f96540cdf30 2024-09-17T05:24:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.915+0000 7f965a2b2640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96400791c0 0x7f964007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:29.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.915+0000 7f965a2b2640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96400791c0 0x7f964007b680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f964c009c50 tx=0x7f964c005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:29.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:29.919+0000 7f9652ffd640 1 -- 172.21.15.81:0/4210458704 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f96541f8f10 con 0x7f96540cdf30 2024-09-17T05:24:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.133+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96541f4a90 con 0x7f96540cdf30 2024-09-17T05:24:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.134+0000 7f9652ffd640 1 -- 172.21.15.81:0/4210458704 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7f96540ce970 con 0x7f96540cdf30 2024-09-17T05:24:30.135 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:30.135 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"btime":"2024-09-17T05:24:22:137896+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3436145099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3436145099},{"type":"v1","addr":"172.21.15.160:6834","nonce":3436145099}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3146864973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3146864973},{"type":"v1","addr":"172.21.15.160:6835","nonce":3146864973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7515,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/3025598693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3025598693},{"type":"v1","addr":"172.21.15.81:6833","nonce":3025598693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:13.064331+0000","modified":"2024-09-17T05:24:15.061074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7518":{"gid":7518,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1143442034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1143442034},{"type":"v1","addr":"172.21.15.81:6835","nonce":1143442034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7518,"qdb_cluster":[7518]},"id":9}]} 2024-09-17T05:24:30.135 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 69 2024-09-17T05:24:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96400791c0 msgr2=0x7f964007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96400791c0 0x7f964007b680 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f964c009c50 tx=0x7f964c005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:30.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96540cdf30 msgr2=0x7f96541f51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96540cdf30 0x7f96541f51c0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7f9648000c00 tx=0x7f9648006310 comp rx=0 tx=0).stop 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 shutdown_connections 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f96541f5700 0x7f9654160ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f96540cdf30 0x7f96541f51c0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f96400791c0 0x7f964007b680 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 --2- 172.21.15.81:0/4210458704 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f963c004800 0x7f96541f8080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 >> 172.21.15.81:0/4210458704 conn(0x7f96540d3ea0 msgr2=0x7f965406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 shutdown_connections 2024-09-17T05:24:30.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.136+0000 7f965c516640 1 -- 172.21.15.81:0/4210458704 wait complete. 2024-09-17T05:24:30.149 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.256+0000 7f92307e2640 1 -- 172.21.15.81:0/2348809999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9214005ea0 msgr2=0x7f9214006320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.256+0000 7f92307e2640 1 --2- 172.21.15.81:0/2348809999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9214005ea0 0x7f9214006320 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7f9220005fd0 tx=0x7f9214006940 comp rx=0 tx=0).stop 2024-09-17T05:24:30.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.256+0000 7f922ed7f640 1 -- 172.21.15.81:0/2348809999 reap_dead start 2024-09-17T05:24:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.256+0000 7f92307e2640 1 -- 172.21.15.81:0/2348809999 shutdown_connections 2024-09-17T05:24:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.256+0000 7f92307e2640 1 -- 172.21.15.81:0/2348809999 >> 172.21.15.81:0/2348809999 conn(0x7f92280b1690 msgr2=0x7f92280b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.256+0000 7f92307e2640 1 -- 172.21.15.81:0/2348809999 shutdown_connections 2024-09-17T05:24:30.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.256+0000 7f92307e2640 1 -- 172.21.15.81:0/2348809999 wait complete. 2024-09-17T05:24:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.257+0000 7f92307e2640 1 Processor -- start 2024-09-17T05:24:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.257+0000 7f92307e2640 1 -- start start 2024-09-17T05:24:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f92307e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9214005ea0 0x7f9228145d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f92307e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92281468c0 0x7f9228150440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f92307e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9228153b50 0x7f922814d830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f92307e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f922806e970 con 0x7f9228153b50 2024-09-17T05:24:30.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f92307e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f922806e7f0 con 0x7f92281468c0 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f92307e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f922806eaf0 con 0x7f9214005ea0 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9228153b50 0x7f922814d830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9228153b50 0x7f922814d830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57392/0 (socket says 172.21.15.81:57392) 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 -- 172.21.15.81:0/3345994337 learned_addr learned my addr 172.21.15.81:0/3345994337 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922e57e640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9214005ea0 0x7f9228145d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922dd7d640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92281468c0 0x7f9228150440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 -- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9214005ea0 msgr2=0x7f9228145d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9214005ea0 0x7f9228145d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 -- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92281468c0 msgr2=0x7f9228150440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92281468c0 0x7f9228150440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 -- 172.21.15.81:0/3345994337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9228150980 con 0x7f9228153b50 2024-09-17T05:24:30.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.258+0000 7f922ed7f640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9228153b50 0x7f922814d830 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f9220005fd0 tx=0x7f9220034680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.259+0000 7f921effd640 1 -- 172.21.15.81:0/3345994337 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220043070 con 0x7f9228153b50 2024-09-17T05:24:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.259+0000 7f921effd640 1 -- 172.21.15.81:0/3345994337 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9220003970 con 0x7f9228153b50 2024-09-17T05:24:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.259+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92281465e0 con 0x7f9228153b50 2024-09-17T05:24:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.259+0000 7f921effd640 1 -- 172.21.15.81:0/3345994337 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9220038040 con 0x7f9228153b50 2024-09-17T05:24:30.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.259+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92281e0c60 con 0x7f9228153b50 2024-09-17T05:24:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.260+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92280725a0 con 0x7f9228153b50 2024-09-17T05:24:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.260+0000 7f921effd640 1 -- 172.21.15.81:0/3345994337 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f9220046070 con 0x7f9228153b50 2024-09-17T05:24:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.261+0000 7f921effd640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f920c0791c0 0x7f920c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.261+0000 7f921effd640 1 -- 172.21.15.81:0/3345994337 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5809+0+0 (secure 0 0 0) 0x7f92200bb500 con 0x7f9228153b50 2024-09-17T05:24:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.261+0000 7f922e57e640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f920c0791c0 0x7f920c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.261+0000 7f922e57e640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f920c0791c0 0x7f920c07b680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92281e4a00 tx=0x7f92240067a0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:30.266 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.265+0000 7f921effd640 1 -- 172.21.15.81:0/3345994337 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9220082830 con 0x7f9228153b50 2024-09-17T05:24:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.481+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9228159e00 con 0x7f9228153b50 2024-09-17T05:24:30.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.482+0000 7f921effd640 1 -- 172.21.15.81:0/3345994337 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 69 v69) ==== 94+0+5231 (secure 0 0 0) 0x7f9220087260 con 0x7f9228153b50 2024-09-17T05:24:30.483 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:30.483 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":69,"btime":"2024-09-17T05:24:22:137896+0000","default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3436145099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3436145099},{"type":"v1","addr":"172.21.15.160:6834","nonce":3436145099}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3146864973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3146864973},{"type":"v1","addr":"172.21.15.160:6835","nonce":3146864973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7515,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/3025598693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3025598693},{"type":"v1","addr":"172.21.15.81:6833","nonce":3025598693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64}],"filesystems":[{"mdsmap":{"epoch":68,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:13.064331+0000","modified":"2024-09-17T05:24:15.061074+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7518},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7518":{"gid":7518,"name":"c","rank":0,"incarnation":66,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1143442034","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":1143442034},{"type":"v1","addr":"172.21.15.81:6835","nonce":1143442034}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7518,"qdb_cluster":[7518]},"id":9}]} 2024-09-17T05:24:30.483 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 69 2024-09-17T05:24:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f920c0791c0 msgr2=0x7f920c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f920c0791c0 0x7f920c07b680 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f92281e4a00 tx=0x7f92240067a0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9228153b50 msgr2=0x7f922814d830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9228153b50 0x7f922814d830 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7f9220005fd0 tx=0x7f9220034680 comp rx=0 tx=0).stop 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 shutdown_connections 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9228153b50 0x7f922814d830 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f920c0791c0 0x7f920c07b680 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f92281468c0 0x7f9228150440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 --2- 172.21.15.81:0/3345994337 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9214005ea0 0x7f9228145d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 >> 172.21.15.81:0/3345994337 conn(0x7f92280b1690 msgr2=0x7f92280d02c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 shutdown_connections 2024-09-17T05:24:30.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.484+0000 7f92307e2640 1 -- 172.21.15.81:0/3345994337 wait complete. 2024-09-17T05:24:30.496 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.597+0000 7fb47812b640 1 -- 172.21.15.81:0/3465354750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c004080 msgr2=0x7fb45c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.597+0000 7fb47812b640 1 --2- 172.21.15.81:0/3465354750 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb45c004080 0x7fb45c004800 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7fb46c00baf0 tx=0x7fb45c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.597+0000 7fb4766c8640 1 -- 172.21.15.81:0/3465354750 reap_dead start 2024-09-17T05:24:30.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.597+0000 7fb47812b640 1 -- 172.21.15.81:0/3465354750 shutdown_connections 2024-09-17T05:24:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.597+0000 7fb47812b640 1 -- 172.21.15.81:0/3465354750 >> 172.21.15.81:0/3465354750 conn(0x7fb4700d3ea0 msgr2=0x7fb4700d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.597+0000 7fb47812b640 1 -- 172.21.15.81:0/3465354750 shutdown_connections 2024-09-17T05:24:30.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.597+0000 7fb47812b640 1 -- 172.21.15.81:0/3465354750 wait complete. 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.598+0000 7fb47812b640 1 Processor -- start 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.598+0000 7fb47812b640 1 -- start start 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb47812b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45c004080 0x7fb4701f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb47812b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca350 0x7fb4701f4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb47812b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4700cd7a0 0x7fb4700cdc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb47812b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4700b42a0 con 0x7fb4700cd7a0 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb47812b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb4700b4120 con 0x7fb4700ca350 2024-09-17T05:24:30.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb47812b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb4700b4420 con 0x7fb45c004080 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4700cd7a0 0x7fb4700cdc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4700cd7a0 0x7fb4700cdc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57406/0 (socket says 172.21.15.81:57406) 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 -- 172.21.15.81:0/176480801 learned_addr learned my addr 172.21.15.81:0/176480801 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4756c6640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca350 0x7fb4701f4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb475ec7640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45c004080 0x7fb4701f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 -- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45c004080 msgr2=0x7fb4701f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45c004080 0x7fb4701f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 -- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca350 msgr2=0x7fb4701f4790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca350 0x7fb4701f4790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 -- 172.21.15.81:0/176480801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4700ce160 con 0x7fb4700cd7a0 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4766c8640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4700cd7a0 0x7fb4700cdc20 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb470162860 tx=0x7fb468006420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:30.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.599+0000 7fb4627fc640 1 -- 172.21.15.81:0/176480801 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468010890 con 0x7fb4700cd7a0 2024-09-17T05:24:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.600+0000 7fb4627fc640 1 -- 172.21.15.81:0/176480801 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb468017070 con 0x7fb4700cd7a0 2024-09-17T05:24:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.600+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4701f4ff0 con 0x7fb4700cd7a0 2024-09-17T05:24:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.600+0000 7fb4627fc640 1 -- 172.21.15.81:0/176480801 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb468010da0 con 0x7fb4700cd7a0 2024-09-17T05:24:30.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.600+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4701f55b0 con 0x7fb4700cd7a0 2024-09-17T05:24:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.600+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4700cf9b0 con 0x7fb4700cd7a0 2024-09-17T05:24:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.601+0000 7fb4627fc640 1 -- 172.21.15.81:0/176480801 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fb46801c460 con 0x7fb4700cd7a0 2024-09-17T05:24:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.602+0000 7fb4627fc640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4540791f0 0x7fb45407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.602+0000 7fb4627fc640 1 -- 172.21.15.81:0/176480801 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5809+0+0 (secure 0 0 0) 0x7fb46809c1c0 con 0x7fb4700cd7a0 2024-09-17T05:24:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.602+0000 7fb475ec7640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4540791f0 0x7fb45407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.602+0000 7fb475ec7640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4540791f0 0x7fb45407b6b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4640058c0 tx=0x7fb46400d490 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:30.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.606+0000 7fb4627fc640 1 -- 172.21.15.81:0/176480801 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb4700ce970 con 0x7fb4700cd7a0 2024-09-17T05:24:30.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.783+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb470161bb0 con 0x7fb4700cd7a0 2024-09-17T05:24:30.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.784+0000 7fb4627fc640 1 -- 172.21.15.81:0/176480801 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) ==== 74+0+16918 (secure 0 0 0) 0x7fb468063580 con 0x7fb4700cd7a0 2024-09-17T05:24:30.785 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:30.786 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":118,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:30.168898+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:11.682378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"116","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:12.014580+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"118","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":5,"snap_epoch":118,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4540791f0 msgr2=0x7fb45407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4540791f0 0x7fb45407b6b0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7fb4640058c0 tx=0x7fb46400d490 comp rx=0 tx=0).stop 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4700cd7a0 msgr2=0x7fb4700cdc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4700cd7a0 0x7fb4700cdc20 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fb470162860 tx=0x7fb468006420 comp rx=0 tx=0).stop 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 shutdown_connections 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4700cd7a0 0x7fb4700cdc20 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4540791f0 0x7fb45407b6b0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4700ca350 0x7fb4701f4790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 --2- 172.21.15.81:0/176480801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb45c004080 0x7fb4701f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 >> 172.21.15.81:0/176480801 conn(0x7fb4700d3ea0 msgr2=0x7fb47006e980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:30.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 shutdown_connections 2024-09-17T05:24:30.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.786+0000 7fb47812b640 1 -- 172.21.15.81:0/176480801 wait complete. 2024-09-17T05:24:30.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:24:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.900+0000 7f2163e70640 1 -- 172.21.15.81:0/3970454351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 msgr2=0x7f21440051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.900+0000 7f2163e70640 1 --2- 172.21.15.81:0/3970454351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 0x7f21440051c0 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f215c0b2350 tx=0x7f2144005830 comp rx=0 tx=0).stop 2024-09-17T05:24:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.900+0000 7f216240d640 1 -- 172.21.15.81:0/3970454351 reap_dead start 2024-09-17T05:24:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.900+0000 7f2163e70640 1 -- 172.21.15.81:0/3970454351 shutdown_connections 2024-09-17T05:24:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.900+0000 7f2163e70640 1 -- 172.21.15.81:0/3970454351 >> 172.21.15.81:0/3970454351 conn(0x7f215c0b1690 msgr2=0x7f215c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.901+0000 7f2163e70640 1 -- 172.21.15.81:0/3970454351 shutdown_connections 2024-09-17T05:24:30.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.901+0000 7f2163e70640 1 -- 172.21.15.81:0/3970454351 wait complete. 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 Processor -- start 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 -- start start 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 0x7f215c0a9730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f215c15a480 0x7f215c153120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f215c15a900 0x7f215c153660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f215c0cf1d0 con 0x7f2144004d40 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f215c0ccc20 con 0x7f215c15a480 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2163e70640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f215c0cf350 con 0x7f215c15a900 2024-09-17T05:24:30.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2161c0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 0x7f215c0a9730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2161c0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 0x7f215c0a9730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57426/0 (socket says 172.21.15.81:57426) 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.902+0000 7f2161c0c640 1 -- 172.21.15.81:0/125287192 learned_addr learned my addr 172.21.15.81:0/125287192 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2161c0c640 1 -- 172.21.15.81:0/125287192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f215c15a900 msgr2=0x7f215c153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2161c0c640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f215c15a900 0x7f215c153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2161c0c640 1 -- 172.21.15.81:0/125287192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f215c15a480 msgr2=0x7f215c153120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2161c0c640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f215c15a480 0x7f215c153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2161c0c640 1 -- 172.21.15.81:0/125287192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f215c153ce0 con 0x7f2144004d40 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2161c0c640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 0x7f215c0a9730 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f214c011d60 tx=0x7f214c00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f215a7fc640 1 -- 172.21.15.81:0/125287192 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c003d80 con 0x7f2144004d40 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f215a7fc640 1 -- 172.21.15.81:0/125287192 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f214c004b20 con 0x7f2144004d40 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f215c153fc0 con 0x7f2144004d40 2024-09-17T05:24:30.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f215a7fc640 1 -- 172.21.15.81:0/125287192 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f214c004050 con 0x7f2144004d40 2024-09-17T05:24:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.903+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f215c0a9c70 con 0x7f2144004d40 2024-09-17T05:24:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.904+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f215c15f750 con 0x7f2144004d40 2024-09-17T05:24:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.905+0000 7f215a7fc640 1 -- 172.21.15.81:0/125287192 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f214c0041f0 con 0x7f2144004d40 2024-09-17T05:24:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.905+0000 7f215a7fc640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21480791f0 0x7f214807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:30.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.905+0000 7f216140b640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21480791f0 0x7f214807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.905+0000 7f215a7fc640 1 -- 172.21.15.81:0/125287192 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(118..118 src has 1..118) ==== 5809+0+0 (secure 0 0 0) 0x7f214c09ca60 con 0x7f2144004d40 2024-09-17T05:24:30.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.906+0000 7f216140b640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21480791f0 0x7f214807b6b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f215c0cc380 tx=0x7f2150006a60 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:30.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:30.909+0000 7f215a7fc640 1 -- 172.21.15.81:0/125287192 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f214c064500 con 0x7f2144004d40 2024-09-17T05:24:31.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.123+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f215c15ba50 con 0x7f2144004d40 2024-09-17T05:24:31.125 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:24:31.124+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:24:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.126+0000 7f215a7fc640 1 -- 172.21.15.81:0/125287192 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v70) ==== 161+0+0 (secure 0 0 0) 0x7f214c063e00 con 0x7f2144004d40 2024-09-17T05:24:31.127 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:24:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.128+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21480791f0 msgr2=0x7f214807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.128+0000 7f2163e70640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21480791f0 0x7f214807b6b0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f215c0cc380 tx=0x7f2150006a60 comp rx=0 tx=0).stop 2024-09-17T05:24:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.128+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 msgr2=0x7f215c0a9730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.128+0000 7f2163e70640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 0x7f215c0a9730 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f214c011d60 tx=0x7f214c00f790 comp rx=0 tx=0).stop 2024-09-17T05:24:31.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 shutdown_connections 2024-09-17T05:24:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f215c15a900 0x7f215c153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21480791f0 0x7f214807b6b0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f215c15a480 0x7f215c153120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 --2- 172.21.15.81:0/125287192 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2144004d40 0x7f215c0a9730 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 >> 172.21.15.81:0/125287192 conn(0x7f215c0b1690 msgr2=0x7f215c0b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 shutdown_connections 2024-09-17T05:24:31.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.129+0000 7f2163e70640 1 -- 172.21.15.81:0/125287192 wait complete. 2024-09-17T05:24:31.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:24:31.167 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.245+0000 7f25a1857640 1 -- 172.21.15.81:0/3083179686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c15dcf0 msgr2=0x7f259c0d2640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.245+0000 7f25a1857640 1 --2- 172.21.15.81:0/3083179686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c15dcf0 0x7f259c0d2640 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f258c009860 tx=0x7f258c02a580 comp rx=0 tx=0).stop 2024-09-17T05:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.245+0000 7f25a1857640 1 -- 172.21.15.81:0/3083179686 shutdown_connections 2024-09-17T05:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.245+0000 7f25a1857640 1 --2- 172.21.15.81:0/3083179686 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c15dcf0 0x7f259c0d2640 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.245+0000 7f25a1857640 1 -- 172.21.15.81:0/3083179686 >> 172.21.15.81:0/3083179686 conn(0x7f259c069620 msgr2=0x7f259c09d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:31.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.245+0000 7f25a1857640 1 -- 172.21.15.81:0/3083179686 shutdown_connections 2024-09-17T05:24:31.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.245+0000 7f25a1857640 1 -- 172.21.15.81:0/3083179686 wait complete. 2024-09-17T05:24:31.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 Processor -- start 2024-09-17T05:24:31.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 -- start start 2024-09-17T05:24:31.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c0b44b0 0x7f259c1f7e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259c15dcf0 0x7f259c0d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259c1620c0 0x7f259c0d0690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f259c0b17e0 con 0x7f259c1620c0 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f259c0b1660 con 0x7f259c0b44b0 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.247+0000 7f25a1857640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f259c0b1960 con 0x7f259c15dcf0 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259c1620c0 0x7f259c0d0690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259c1620c0 0x7f259c0d0690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57450/0 (socket says 172.21.15.81:57450) 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 -- 172.21.15.81:0/3154993118 learned_addr learned my addr 172.21.15.81:0/3154993118 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259affd640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c0b44b0 0x7f259c1f7e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259a7fc640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259c15dcf0 0x7f259c0d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 -- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259c15dcf0 msgr2=0x7f259c0d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:31.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259c15dcf0 0x7f259c0d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 -- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c0b44b0 msgr2=0x7f259c1f7e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c0b44b0 0x7f259c1f7e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 -- 172.21.15.81:0/3154993118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f259c1f8650 con 0x7f259c1620c0 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f259b7fe640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259c1620c0 0x7f259c0d0690 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f259400c700 tx=0x7f259400cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f2583fff640 1 -- 172.21.15.81:0/3154993118 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2594003b70 con 0x7f259c1620c0 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f2583fff640 1 -- 172.21.15.81:0/3154993118 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2594003d10 con 0x7f259c1620c0 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f259c1f8930 con 0x7f259c1620c0 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f2583fff640 1 -- 172.21.15.81:0/3154993118 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f259400aab0 con 0x7f259c1620c0 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.248+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f259c1f8340 con 0x7f259c1620c0 2024-09-17T05:24:31.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.249+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f259c0b1e10 con 0x7f259c1620c0 2024-09-17T05:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.250+0000 7f2583fff640 1 -- 172.21.15.81:0/3154993118 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f259400ac50 con 0x7f259c1620c0 2024-09-17T05:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.250+0000 7f2583fff640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25880791c0 0x7f258807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.250+0000 7f2583fff640 1 -- 172.21.15.81:0/3154993118 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5867+0+0 (secure 0 0 0) 0x7f259409b680 con 0x7f259c1620c0 2024-09-17T05:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.250+0000 7f259affd640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25880791c0 0x7f258807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:31.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.251+0000 7f259affd640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25880791c0 0x7f258807b680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f258c034000 tx=0x7f258c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:31.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.254+0000 7f2583fff640 1 -- 172.21.15.81:0/3154993118 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2594062a10 con 0x7f259c1620c0 2024-09-17T05:24:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:31.468+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f259c0cf950 con 0x7f259c1620c0 2024-09-17T05:24:32.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.127+0000 7f2583fff640 1 -- 172.21.15.81:0/3154993118 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v71) ==== 104+0+0 (secure 0 0 0) 0x7f2594067440 con 0x7f259c1620c0 2024-09-17T05:24:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25880791c0 msgr2=0x7f258807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25880791c0 0x7f258807b680 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f258c034000 tx=0x7f258c004730 comp rx=0 tx=0).stop 2024-09-17T05:24:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259c1620c0 msgr2=0x7f259c0d0690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259c1620c0 0x7f259c0d0690 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f259400c700 tx=0x7f259400cbc0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 shutdown_connections 2024-09-17T05:24:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f259c1620c0 0x7f259c0d0690 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f259c15dcf0 0x7f259c0d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25880791c0 0x7f258807b680 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 --2- 172.21.15.81:0/3154993118 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f259c0b44b0 0x7f259c1f7e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 >> 172.21.15.81:0/3154993118 conn(0x7f259c069620 msgr2=0x7f259c0b3b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:32.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 shutdown_connections 2024-09-17T05:24:32.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.130+0000 7f25a1857640 1 -- 172.21.15.81:0/3154993118 wait complete. 2024-09-17T05:24:32.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:24:32.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 -- 172.21.15.81:0/1999450446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed015f600 msgr2=0x7f7ed0072530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:32.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 --2- 172.21.15.81:0/1999450446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed015f600 0x7f7ed0072530 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0005fd0 tx=0x7f7ec002a4f0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 -- 172.21.15.81:0/1999450446 shutdown_connections 2024-09-17T05:24:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 --2- 172.21.15.81:0/1999450446 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed00ceb70 0x7f7ed00cf000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 --2- 172.21.15.81:0/1999450446 >> v2:172.21.15.160:3300/0 conn(0x7f7ed015f9e0 0x7f7ed0070160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 --2- 172.21.15.81:0/1999450446 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed015f600 0x7f7ed0072530 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 -- 172.21.15.81:0/1999450446 >> 172.21.15.81:0/1999450446 conn(0x7f7ed00b1620 msgr2=0x7f7ed00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 -- 172.21.15.81:0/1999450446 shutdown_connections 2024-09-17T05:24:32.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.287+0000 7f7ed670e640 1 -- 172.21.15.81:0/1999450446 wait complete. 2024-09-17T05:24:32.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.288+0000 7f7ed670e640 1 Processor -- start 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.288+0000 7f7ed670e640 1 -- start start 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed670e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed00ceb70 0x7f7ed01403d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed670e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed015f600 0x7f7ed014f990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed670e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed015f9e0 0x7f7ed0151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed670e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed0070820 con 0x7f7ed00ceb70 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed670e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7ed00706a0 con 0x7f7ed015f9e0 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed670e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7ed0156320 con 0x7f7ed015f600 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed00ceb70 0x7f7ed01403d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:32.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed00ceb70 0x7f7ed01403d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:57466/0 (socket says 172.21.15.81:57466) 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 -- 172.21.15.81:0/4191076854 learned_addr learned my addr 172.21.15.81:0/4191076854 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecf7fe640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed015f600 0x7f7ed014f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed4cab640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed015f9e0 0x7f7ed0151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 -- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed015f600 msgr2=0x7f7ed014f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed015f600 0x7f7ed014f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 -- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed015f9e0 msgr2=0x7f7ed0151190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed015f9e0 0x7f7ed0151190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 -- 172.21.15.81:0/4191076854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ed0140910 con 0x7f7ed00ceb70 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ed4cab640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed015f9e0 0x7f7ed0151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:32.293 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.289+0000 7f7ecffff640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed00ceb70 0x7f7ed01403d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009850 tx=0x7f7ec00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:32.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.290+0000 7f7eccff9640 1 -- 172.21.15.81:0/4191076854 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec003f070 con 0x7f7ed00ceb70 2024-09-17T05:24:32.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.290+0000 7f7eccff9640 1 -- 172.21.15.81:0/4191076854 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ec00047a0 con 0x7f7ed00ceb70 2024-09-17T05:24:32.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.290+0000 7f7eccff9640 1 -- 172.21.15.81:0/4191076854 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ec0035030 con 0x7f7ed00ceb70 2024-09-17T05:24:32.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.290+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ed0150290 con 0x7f7ed00ceb70 2024-09-17T05:24:32.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.290+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ed0150850 con 0x7f7ed00ceb70 2024-09-17T05:24:32.294 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.291+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ed0072530 con 0x7f7ed00ceb70 2024-09-17T05:24:32.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.291+0000 7f7eccff9640 1 -- 172.21.15.81:0/4191076854 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f7ec0042070 con 0x7f7ed00ceb70 2024-09-17T05:24:32.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.292+0000 7f7eccff9640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ebc0791c0 0x7f7ebc07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:32.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.292+0000 7f7ecf7fe640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ebc0791c0 0x7f7ebc07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:32.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.292+0000 7f7eccff9640 1 -- 172.21.15.81:0/4191076854 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(119..119 src has 1..119) ==== 5867+0+0 (secure 0 0 0) 0x7f7ec00bc5c0 con 0x7f7ed00ceb70 2024-09-17T05:24:32.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.292+0000 7f7ecf7fe640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ebc0791c0 0x7f7ebc07b680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0073310 tx=0x7f7ec400b2e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:32.297 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.296+0000 7f7eccff9640 1 -- 172.21.15.81:0/4191076854 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7ec0083ac0 con 0x7f7ed00ceb70 2024-09-17T05:24:32.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:32.471+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7ed0074100 con 0x7f7ed00ceb70 2024-09-17T05:24:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.192+0000 7f7eccff9640 1 -- 172.21.15.81:0/4191076854 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v120) ==== 181+0+0 (secure 0 0 0) 0x7f7ec00884f0 con 0x7f7ed00ceb70 2024-09-17T05:24:33.193 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:24:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ebc0791c0 msgr2=0x7f7ebc07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ebc0791c0 0x7f7ebc07b680 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7ed0073310 tx=0x7f7ec400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed00ceb70 msgr2=0x7f7ed01403d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:33.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed00ceb70 0x7f7ed01403d0 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f7ec0009850 tx=0x7f7ec00038a0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 shutdown_connections 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ebc0791c0 0x7f7ebc07b680 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7ed015f9e0 0x7f7ed0151190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ed015f600 0x7f7ed014f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 --2- 172.21.15.81:0/4191076854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ed00ceb70 0x7f7ed01403d0 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 >> 172.21.15.81:0/4191076854 conn(0x7f7ed00b1620 msgr2=0x7f7ed00b0720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 shutdown_connections 2024-09-17T05:24:33.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.195+0000 7f7ed670e640 1 -- 172.21.15.81:0/4191076854 wait complete. 2024-09-17T05:24:33.211 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:24:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.320+0000 7f48f9505640 1 -- 172.21.15.81:0/3071553956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 msgr2=0x7f48f415fa60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.320+0000 7f48f9505640 1 --2- 172.21.15.81:0/3071553956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f415fa60 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7f48f40ce2d0 tx=0x7f48dc02a510 comp rx=0 tx=0).stop 2024-09-17T05:24:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.320+0000 7f48f9505640 1 -- 172.21.15.81:0/3071553956 shutdown_connections 2024-09-17T05:24:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.320+0000 7f48f9505640 1 --2- 172.21.15.81:0/3071553956 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f415fa60 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.320+0000 7f48f9505640 1 -- 172.21.15.81:0/3071553956 >> 172.21.15.81:0/3071553956 conn(0x7f48f40b1620 msgr2=0x7f48f40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.321+0000 7f48f9505640 1 -- 172.21.15.81:0/3071553956 shutdown_connections 2024-09-17T05:24:33.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.321+0000 7f48f9505640 1 -- 172.21.15.81:0/3071553956 wait complete. 2024-09-17T05:24:33.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 Processor -- start 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 -- start start 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48f40ce8c0 0x7f48f413f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48f4156170 0x7f48f4141850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f4141d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f48f406f630 con 0x7f48f415f600 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f48f4070870 con 0x7f48f4156170 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f9505640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f48f40cf420 con 0x7f48f40ce8c0 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.322+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f4141d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f4141d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34670/0 (socket says 172.21.15.81:34670) 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 -- 172.21.15.81:0/2807475647 learned_addr learned my addr 172.21.15.81:0/2807475647 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:33.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f2ffd640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48f40ce8c0 0x7f48f413f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48ebfff640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48f4156170 0x7f48f4141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 -- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48f40ce8c0 msgr2=0x7f48f413f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48f40ce8c0 0x7f48f413f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 -- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48f4156170 msgr2=0x7f48f4141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48f4156170 0x7f48f4141850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 -- 172.21.15.81:0/2807475647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48f413f540 con 0x7f48f415f600 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f37fe640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f4141d90 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00c770 tx=0x7f48ec00cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48eb7fe640 1 -- 172.21.15.81:0/2807475647 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec003da0 con 0x7f48f415f600 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48eb7fe640 1 -- 172.21.15.81:0/2807475647 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f48ec005070 con 0x7f48f415f600 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48eb7fe640 1 -- 172.21.15.81:0/2807475647 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48ec005500 con 0x7f48f415f600 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48f41f6160 con 0x7f48f415f600 2024-09-17T05:24:33.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.323+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48f4142700 con 0x7f48f415f600 2024-09-17T05:24:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.324+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48f415fa60 con 0x7f48f415f600 2024-09-17T05:24:33.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.325+0000 7f48eb7fe640 1 -- 172.21.15.81:0/2807475647 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f48ec0056a0 con 0x7f48f415f600 2024-09-17T05:24:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.325+0000 7f48eb7fe640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f48d40791c0 0x7f48d407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.326+0000 7f48f2ffd640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f48d40791c0 0x7f48d407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.326+0000 7f48eb7fe640 1 -- 172.21.15.81:0/2807475647 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(120..120 src has 1..120) ==== 5429+0+0 (secure 0 0 0) 0x7f48ec09b500 con 0x7f48f415f600 2024-09-17T05:24:33.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.326+0000 7f48f2ffd640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f48d40791c0 0x7f48d407b680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48e40015d0 tx=0x7f48e4009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:33.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.330+0000 7f48eb7fe640 1 -- 172.21.15.81:0/2807475647 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f48f413f540 con 0x7f48f415f600 2024-09-17T05:24:33.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:33.511+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f48f4073310 con 0x7f48f415f600 2024-09-17T05:24:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.198+0000 7f48eb7fe640 1 -- 172.21.15.81:0/2807475647 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v121) ==== 169+0+0 (secure 0 0 0) 0x7f48ec063220 con 0x7f48f415f600 2024-09-17T05:24:34.199 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f48d40791c0 msgr2=0x7f48d407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f48d40791c0 0x7f48d407b680 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f48e40015d0 tx=0x7f48e4009040 comp rx=0 tx=0).stop 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 msgr2=0x7f48f4141d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f4141d90 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7f48ec00c770 tx=0x7f48ec00cc30 comp rx=0 tx=0).stop 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 shutdown_connections 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f48f415f600 0x7f48f4141d90 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f48d40791c0 0x7f48d407b680 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f48f4156170 0x7f48f4141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 --2- 172.21.15.81:0/2807475647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f48f40ce8c0 0x7f48f413f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 >> 172.21.15.81:0/2807475647 conn(0x7f48f40b1620 msgr2=0x7f48f40b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 shutdown_connections 2024-09-17T05:24:34.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.201+0000 7f48f9505640 1 -- 172.21.15.81:0/2807475647 wait complete. 2024-09-17T05:24:34.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:24:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.319+0000 7fa6cb589640 1 -- 172.21.15.81:0/3320309574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 msgr2=0x7fa6c40cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.319+0000 7fa6cb589640 1 --2- 172.21.15.81:0/3320309574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40cf9b0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fa6c40cf6a0 tx=0x7fa6c002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.319+0000 7fa6cb589640 1 -- 172.21.15.81:0/3320309574 shutdown_connections 2024-09-17T05:24:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.319+0000 7fa6cb589640 1 --2- 172.21.15.81:0/3320309574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40cf9b0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.319+0000 7fa6cb589640 1 -- 172.21.15.81:0/3320309574 >> 172.21.15.81:0/3320309574 conn(0x7fa6c40d3ea0 msgr2=0x7fa6c40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.319+0000 7fa6cb589640 1 -- 172.21.15.81:0/3320309574 shutdown_connections 2024-09-17T05:24:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.319+0000 7fa6cb589640 1 -- 172.21.15.81:0/3320309574 wait complete. 2024-09-17T05:24:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.320+0000 7fa6cb589640 1 Processor -- start 2024-09-17T05:24:34.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.320+0000 7fa6cb589640 1 -- start start 2024-09-17T05:24:34.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6cb589640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6c40d0d40 0x7fa6c4161420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6cb589640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6c40d49c0 0x7fa6c40c8a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6cb589640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40c8f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6cb589640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c4162690 con 0x7fa6c415df90 2024-09-17T05:24:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6cb589640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c40b3f10 con 0x7fa6c40d49c0 2024-09-17T05:24:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6cb589640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c40ce2a0 con 0x7fa6c40d0d40 2024-09-17T05:24:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6c9b26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40c8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6c9b26640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40c8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34680/0 (socket says 172.21.15.81:34680) 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6c9b26640 1 -- 172.21.15.81:0/1870563508 learned_addr learned my addr 172.21.15.81:0/1870563508 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6c8b24640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6c40d49c0 0x7fa6c40c8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.321+0000 7fa6c9325640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6c40d0d40 0x7fa6c4161420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6c9b26640 1 -- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6c40d0d40 msgr2=0x7fa6c4161420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6c9b26640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6c40d0d40 0x7fa6c4161420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6c9b26640 1 -- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6c40d49c0 msgr2=0x7fa6c40c8a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6c9b26640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6c40d49c0 0x7fa6c40c8a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6c9b26640 1 -- 172.21.15.81:0/1870563508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c4160660 con 0x7fa6c415df90 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6c9325640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6c40d0d40 0x7fa6c4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6c9b26640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40c8f60 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00c780 tx=0x7fa6bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:34.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6b9ffb640 1 -- 172.21.15.81:0/1870563508 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc004b60 con 0x7fa6c415df90 2024-09-17T05:24:34.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6b9ffb640 1 -- 172.21.15.81:0/1870563508 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa6bc004df0 con 0x7fa6c415df90 2024-09-17T05:24:34.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c4160940 con 0x7fa6c415df90 2024-09-17T05:24:34.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6b9ffb640 1 -- 172.21.15.81:0/1870563508 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6bc00aa70 con 0x7fa6c415df90 2024-09-17T05:24:34.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.322+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c4160370 con 0x7fa6c415df90 2024-09-17T05:24:34.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.323+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c40b5600 con 0x7fa6c415df90 2024-09-17T05:24:34.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.323+0000 7fa6b9ffb640 1 -- 172.21.15.81:0/1870563508 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fa6bc00ac10 con 0x7fa6c415df90 2024-09-17T05:24:34.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.324+0000 7fa6b9ffb640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6a80791c0 0x7fa6a807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.324+0000 7fa6c9325640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6a80791c0 0x7fa6a807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.324+0000 7fa6b9ffb640 1 -- 172.21.15.81:0/1870563508 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7fa6bc09b8a0 con 0x7fa6c415df90 2024-09-17T05:24:34.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.324+0000 7fa6c9325640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6a80791c0 0x7fa6a807b680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0033000 tx=0x7fa6c0004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:34.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.328+0000 7fa6b9ffb640 1 -- 172.21.15.81:0/1870563508 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa6bc020070 con 0x7fa6c415df90 2024-09-17T05:24:34.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.507+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fa6c4160b10 con 0x7fa6c415df90 2024-09-17T05:24:34.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.511+0000 7fa6b9ffb640 1 -- 172.21.15.81:0/1870563508 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v41) ==== 71+0+0 (secure 0 0 0) 0x7fa6bc063660 con 0x7fa6c415df90 2024-09-17T05:24:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6a80791c0 msgr2=0x7fa6a807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6a80791c0 0x7fa6a807b680 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fa6c0033000 tx=0x7fa6c0004730 comp rx=0 tx=0).stop 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 msgr2=0x7fa6c40c8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40c8f60 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fa6bc00c780 tx=0x7fa6bc00cc40 comp rx=0 tx=0).stop 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 shutdown_connections 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa6c415df90 0x7fa6c40c8f60 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa6a80791c0 0x7fa6a807b680 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa6c40d49c0 0x7fa6c40c8a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 --2- 172.21.15.81:0/1870563508 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa6c40d0d40 0x7fa6c4161420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 >> 172.21.15.81:0/1870563508 conn(0x7fa6c40d3ea0 msgr2=0x7fa6c406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 shutdown_connections 2024-09-17T05:24:34.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.513+0000 7fa6cb589640 1 -- 172.21.15.81:0/1870563508 wait complete. 2024-09-17T05:24:34.525 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2' 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.624+0000 7f0e88b94640 1 -- 172.21.15.81:0/3165055604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8415df90 msgr2=0x7f0e840cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.624+0000 7f0e88b94640 1 --2- 172.21.15.81:0/3165055604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8415df90 0x7f0e840cf9b0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f0e840d1c90 tx=0x7f0e7c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.625+0000 7f0e88b94640 1 -- 172.21.15.81:0/3165055604 shutdown_connections 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.625+0000 7f0e88b94640 1 --2- 172.21.15.81:0/3165055604 >> v2:172.21.15.160:3300/0 conn(0x7f0e840d49c0 0x7f0e840d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.625+0000 7f0e88b94640 1 --2- 172.21.15.81:0/3165055604 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e8415df90 0x7f0e840cf9b0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.625+0000 7f0e88b94640 1 -- 172.21.15.81:0/3165055604 >> 172.21.15.81:0/3165055604 conn(0x7f0e840d3ea0 msgr2=0x7f0e840d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.625+0000 7f0e88b94640 1 -- 172.21.15.81:0/3165055604 shutdown_connections 2024-09-17T05:24:34.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.625+0000 7f0e88b94640 1 -- 172.21.15.81:0/3165055604 wait complete. 2024-09-17T05:24:34.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.626+0000 7f0e88b94640 1 Processor -- start 2024-09-17T05:24:34.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.626+0000 7f0e88b94640 1 -- start start 2024-09-17T05:24:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e840d49c0 0x7f0e841f46c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e8415df90 0x7f0e8415d340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e84162480 0x7f0e840caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e840d0f00 con 0x7f0e840d49c0 2024-09-17T05:24:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e840d0d80 con 0x7f0e84162480 2024-09-17T05:24:34.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0e840b3f10 con 0x7f0e8415df90 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e840d49c0 0x7f0e841f46c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e840d49c0 0x7f0e841f46c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34704/0 (socket says 172.21.15.81:34704) 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 -- 172.21.15.81:0/2344054999 learned_addr learned my addr 172.21.15.81:0/2344054999 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e82d9d640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e84162480 0x7f0e840caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e81d9b640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e8415df90 0x7f0e8415d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 -- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e8415df90 msgr2=0x7f0e8415d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e8415df90 0x7f0e8415d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 -- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e84162480 msgr2=0x7f0e840caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e84162480 0x7f0e840caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 -- 172.21.15.81:0/2344054999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e841615a0 con 0x7f0e840d49c0 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e82d9d640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e84162480 0x7f0e840caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:34.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e8259c640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e840d49c0 0x7f0e841f46c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c02aea0 tx=0x7f0e7c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e7affd640 1 -- 172.21.15.81:0/2344054999 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c040070 con 0x7f0e840d49c0 2024-09-17T05:24:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e7affd640 1 -- 172.21.15.81:0/2344054999 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e7c004330 con 0x7f0e840d49c0 2024-09-17T05:24:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e8415d880 con 0x7f0e840d49c0 2024-09-17T05:24:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e7affd640 1 -- 172.21.15.81:0/2344054999 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e7c0047a0 con 0x7f0e840d49c0 2024-09-17T05:24:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.627+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e841f5110 con 0x7f0e840d49c0 2024-09-17T05:24:34.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.628+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e840b4430 con 0x7f0e840d49c0 2024-09-17T05:24:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.629+0000 7f0e7affd640 1 -- 172.21.15.81:0/2344054999 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f0e7c039040 con 0x7f0e840d49c0 2024-09-17T05:24:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.629+0000 7f0e7affd640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e640791c0 0x7f0e6407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.630+0000 7f0e7affd640 1 -- 172.21.15.81:0/2344054999 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7f0e7c0bcc70 con 0x7f0e840d49c0 2024-09-17T05:24:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.630+0000 7f0e81d9b640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e640791c0 0x7f0e6407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:34.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.630+0000 7f0e81d9b640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e640791c0 0x7f0e6407b680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c005fd0 tx=0x7f0e6c005850 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:34.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.634+0000 7f0e7affd640 1 -- 172.21.15.81:0/2344054999 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0e841615a0 con 0x7f0e840d49c0 2024-09-17T05:24:34.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:34.884+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]} v 0) -- 0x7f0e8408d590 con 0x7f0e840d49c0 2024-09-17T05:24:35.200 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.200+0000 7f0e7affd640 1 -- 172.21.15.81:0/2344054999 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_no_upgrade_v1_to_v2"]}]=0 v321) ==== 148+0+0 (secure 0 0 0) 0x7f0e7c084b10 con 0x7f0e840d49c0 2024-09-17T05:24:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e640791c0 msgr2=0x7f0e6407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e640791c0 0x7f0e6407b680 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f0e6c005fd0 tx=0x7f0e6c005850 comp rx=0 tx=0).stop 2024-09-17T05:24:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e840d49c0 msgr2=0x7f0e841f46c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e840d49c0 0x7f0e841f46c0 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f0e7c02aea0 tx=0x7f0e7c003970 comp rx=0 tx=0).stop 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 shutdown_connections 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e640791c0 0x7f0e6407b680 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e84162480 0x7f0e840caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e8415df90 0x7f0e8415d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 --2- 172.21.15.81:0/2344054999 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e840d49c0 0x7f0e841f46c0 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 >> 172.21.15.81:0/2344054999 conn(0x7f0e840d3ea0 msgr2=0x7f0e840b9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 shutdown_connections 2024-09-17T05:24:35.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.202+0000 7f0e88b94640 1 -- 172.21.15.81:0/2344054999 wait complete. 2024-09-17T05:24:35.214 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-17T05:24:35.214 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:24:35.215 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:35.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.315+0000 7f53d0990640 1 -- 172.21.15.81:0/1187100662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b8005080 msgr2=0x7f53b8005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.315+0000 7f53d0990640 1 --2- 172.21.15.81:0/1187100662 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53b8005080 0x7f53b8005910 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c260 tx=0x7f53b8006940 comp rx=0 tx=0).stop 2024-09-17T05:24:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.315+0000 7f53cad9d640 1 -- 172.21.15.81:0/1187100662 reap_dead start 2024-09-17T05:24:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.315+0000 7f53d0990640 1 -- 172.21.15.81:0/1187100662 shutdown_connections 2024-09-17T05:24:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.315+0000 7f53d0990640 1 -- 172.21.15.81:0/1187100662 >> 172.21.15.81:0/1187100662 conn(0x7f53cc0b1690 msgr2=0x7f53cc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.315+0000 7f53d0990640 1 -- 172.21.15.81:0/1187100662 shutdown_connections 2024-09-17T05:24:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.315+0000 7f53d0990640 1 -- 172.21.15.81:0/1187100662 wait complete. 2024-09-17T05:24:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.316+0000 7f53d0990640 1 Processor -- start 2024-09-17T05:24:35.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53d0990640 1 -- start start 2024-09-17T05:24:35.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53d0990640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b8005080 0x7f53cc146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53d0990640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc155610 0x7f53cc1f5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53d0990640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53cc155ad0 0x7f53cc14c270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53d0990640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc06e970 con 0x7f53cc155610 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53d0990640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f53cc06e7f0 con 0x7f53cc155ad0 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53d0990640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f53cc06eaf0 con 0x7f53b8005080 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53c1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc155610 0x7f53cc1f5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53c1d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc155610 0x7f53cc1f5c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34720/0 (socket says 172.21.15.81:34720) 2024-09-17T05:24:35.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.317+0000 7f53c1d9b640 1 -- 172.21.15.81:0/785072883 learned_addr learned my addr 172.21.15.81:0/785072883 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:35.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53ca59c640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b8005080 0x7f53cc146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53cad9d640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53cc155ad0 0x7f53cc14c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c1d9b640 1 -- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b8005080 msgr2=0x7f53cc146930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c1d9b640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b8005080 0x7f53cc146930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c1d9b640 1 -- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53cc155ad0 msgr2=0x7f53cc14c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c1d9b640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53cc155ad0 0x7f53cc14c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c1d9b640 1 -- 172.21.15.81:0/785072883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53cc0cc7a0 con 0x7f53cc155610 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c1d9b640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc155610 0x7f53cc1f5c60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c380 tx=0x7f53b4001180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c37fe640 1 -- 172.21.15.81:0/785072883 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4031040 con 0x7f53cc155610 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c37fe640 1 -- 172.21.15.81:0/785072883 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f53b40035f0 con 0x7f53cc155610 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53c37fe640 1 -- 172.21.15.81:0/785072883 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53b4003a60 con 0x7f53cc155610 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53cc0cca80 con 0x7f53cc155610 2024-09-17T05:24:35.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.318+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53cc0cd040 con 0x7f53cc155610 2024-09-17T05:24:35.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.319+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53cc0725a0 con 0x7f53cc155610 2024-09-17T05:24:35.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.320+0000 7f53c37fe640 1 -- 172.21.15.81:0/785072883 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f53b4034070 con 0x7f53cc155610 2024-09-17T05:24:35.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.320+0000 7f53c37fe640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f53ac0791c0 0x7f53ac07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.320+0000 7f53c37fe640 1 -- 172.21.15.81:0/785072883 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7f53b40bb3d0 con 0x7f53cc155610 2024-09-17T05:24:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.320+0000 7f53ca59c640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f53ac0791c0 0x7f53ac07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.321+0000 7f53ca59c640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f53ac0791c0 0x7f53ac07b680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0cc690 tx=0x7f53bc006ac0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:35.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.324+0000 7f53c37fe640 1 -- 172.21.15.81:0/785072883 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f53b4083290 con 0x7f53cc155610 2024-09-17T05:24:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.501+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f53cc0d0230 con 0x7f53cc155610 2024-09-17T05:24:35.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.502+0000 7f53c37fe640 1 -- 172.21.15.81:0/785072883 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) ==== 74+0+13154 (secure 0 0 0) 0x7f53b4082b90 con 0x7f53cc155610 2024-09-17T05:24:35.503 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:35.503 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":121,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:34.193613+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":115,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/1143442034":"2024-09-18T05:24:31.125318+0000","172.21.15.81:6834/1143442034":"2024-09-18T05:24:31.125318+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f53ac0791c0 msgr2=0x7f53ac07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f53ac0791c0 0x7f53ac07b680 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f53cc0cc690 tx=0x7f53bc006ac0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc155610 msgr2=0x7f53cc1f5c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc155610 0x7f53cc1f5c60 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f53b400c380 tx=0x7f53b4001180 comp rx=0 tx=0).stop 2024-09-17T05:24:35.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 shutdown_connections 2024-09-17T05:24:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f53ac0791c0 0x7f53ac07b680 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f53cc155ad0 0x7f53cc14c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f53cc155610 0x7f53cc1f5c60 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 --2- 172.21.15.81:0/785072883 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f53b8005080 0x7f53cc146930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 >> 172.21.15.81:0/785072883 conn(0x7f53cc0b1690 msgr2=0x7f53cc15a7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 shutdown_connections 2024-09-17T05:24:35.506 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.504+0000 7f53d0990640 1 -- 172.21.15.81:0/785072883 wait complete. 2024-09-17T05:24:35.516 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:24:35.516 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:24:35.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 -- 172.21.15.81:0/3913246273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 msgr2=0x7f24800cc970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 --2- 172.21.15.81:0/3913246273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 0x7f24800cc970 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f2478005fd0 tx=0x7f247802a8b0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 -- 172.21.15.81:0/3913246273 shutdown_connections 2024-09-17T05:24:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 --2- 172.21.15.81:0/3913246273 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 0x7f24800cc970 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 --2- 172.21.15.81:0/3913246273 >> v2:172.21.15.160:3300/0 conn(0x7f2480152710 0x7f2480072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 -- 172.21.15.81:0/3913246273 >> 172.21.15.81:0/3913246273 conn(0x7f24800b1700 msgr2=0x7f24800b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 -- 172.21.15.81:0/3913246273 shutdown_connections 2024-09-17T05:24:35.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.619+0000 7f24864f6640 1 -- 172.21.15.81:0/3913246273 wait complete. 2024-09-17T05:24:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.620+0000 7f24864f6640 1 Processor -- start 2024-09-17T05:24:35.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.621+0000 7f24864f6640 1 -- start start 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.621+0000 7f24864f6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 0x7f24800b3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.621+0000 7f24864f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480152710 0x7f24801558b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.621+0000 7f24864f6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2480152af0 0x7f2480155df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.621+0000 7f24864f6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f248006fd70 con 0x7f2480152710 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.621+0000 7f24864f6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f248006fbf0 con 0x7f2480152af0 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.621+0000 7f24864f6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f248006fef0 con 0x7f24800cc500 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480152710 0x7f24801558b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480152710 0x7f24801558b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34728/0 (socket says 172.21.15.81:34728) 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 -- 172.21.15.81:0/2969164012 learned_addr learned my addr 172.21.15.81:0/2969164012 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:35.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247ffff640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 0x7f24800b3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f2484a93640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2480152af0 0x7f2480155df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 -- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 msgr2=0x7f24800b3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 0x7f24800b3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 -- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2480152af0 msgr2=0x7f2480155df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2480152af0 0x7f2480155df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 -- 172.21.15.81:0/2969164012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f24800b4000 con 0x7f2480152710 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f2484a93640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2480152af0 0x7f2480155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247f7fe640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480152710 0x7f24801558b0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f247400c450 tx=0x7f247400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247cff9640 1 -- 172.21.15.81:0/2969164012 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474016020 con 0x7f2480152710 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247cff9640 1 -- 172.21.15.81:0/2969164012 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2474012920 con 0x7f2480152710 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2480154040 con 0x7f2480152710 2024-09-17T05:24:35.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f247cff9640 1 -- 172.21.15.81:0/2969164012 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2474012d70 con 0x7f2480152710 2024-09-17T05:24:35.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.622+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24801f6130 con 0x7f2480152710 2024-09-17T05:24:35.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.623+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24800cc970 con 0x7f2480152710 2024-09-17T05:24:35.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.624+0000 7f247cff9640 1 -- 172.21.15.81:0/2969164012 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f2474019020 con 0x7f2480152710 2024-09-17T05:24:35.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.625+0000 7f247cff9640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f246c0791c0 0x7f246c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.625+0000 7f247ffff640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f246c0791c0 0x7f246c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.625+0000 7f247cff9640 1 -- 172.21.15.81:0/2969164012 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7f247409b3c0 con 0x7f2480152710 2024-09-17T05:24:35.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.625+0000 7f247ffff640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f246c0791c0 0x7f246c07b680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f248015ef00 tx=0x7f2470005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:35.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.629+0000 7f247cff9640 1 -- 172.21.15.81:0/2969164012 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2474020030 con 0x7f2480152710 2024-09-17T05:24:35.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.805+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f24801f6840 con 0x7f2480152710 2024-09-17T05:24:35.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.806+0000 7f247cff9640 1 -- 172.21.15.81:0/2969164012 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v121) ==== 93+0+10 (secure 0 0 0) 0x7f2474063100 con 0x7f2480152710 2024-09-17T05:24:35.807 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:24:35.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f246c0791c0 msgr2=0x7f246c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f246c0791c0 0x7f246c07b680 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f248015ef00 tx=0x7f2470005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480152710 msgr2=0x7f24801558b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480152710 0x7f24801558b0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f247400c450 tx=0x7f247400c910 comp rx=0 tx=0).stop 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 shutdown_connections 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f246c0791c0 0x7f246c07b680 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2480152af0 0x7f2480155df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2480152710 0x7f24801558b0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 --2- 172.21.15.81:0/2969164012 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f24800cc500 0x7f24800b3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 >> 172.21.15.81:0/2969164012 conn(0x7f24800b1700 msgr2=0x7f24800b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 shutdown_connections 2024-09-17T05:24:35.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.808+0000 7f24864f6640 1 -- 172.21.15.81:0/2969164012 wait complete. 2024-09-17T05:24:35.820 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-17T05:24:35.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 -- 172.21.15.81:0/1254562412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80d2410 msgr2=0x7f3ab80b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 --2- 172.21.15.81:0/1254562412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80d2410 0x7f3ab80b3090 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8005fd0 tx=0x7f3aa802aa90 comp rx=0 tx=0).stop 2024-09-17T05:24:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 -- 172.21.15.81:0/1254562412 shutdown_connections 2024-09-17T05:24:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 --2- 172.21.15.81:0/1254562412 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ab80cfce0 0x7f3ab80d0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 --2- 172.21.15.81:0/1254562412 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80d2410 0x7f3ab80b3090 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 -- 172.21.15.81:0/1254562412 >> 172.21.15.81:0/1254562412 conn(0x7f3ab809aa30 msgr2=0x7f3ab809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 -- 172.21.15.81:0/1254562412 shutdown_connections 2024-09-17T05:24:35.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.920+0000 7f3abd816640 1 -- 172.21.15.81:0/1254562412 wait complete. 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.921+0000 7f3abd816640 1 Processor -- start 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.921+0000 7f3abd816640 1 -- start start 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3abd816640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80cfce0 0x7f3ab8150580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3abd816640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ab80d2410 0x7f3ab80b4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3abd816640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ab815f6d0 0x7f3ab815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3abd816640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab80b13c0 con 0x7f3ab80cfce0 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3abd816640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3ab80b1240 con 0x7f3ab815f6d0 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3abd816640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3ab80b1540 con 0x7f3ab80d2410 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80cfce0 0x7f3ab8150580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3ab6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80cfce0 0x7f3ab8150580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34748/0 (socket says 172.21.15.81:34748) 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.922+0000 7f3ab6ffd640 1 -- 172.21.15.81:0/2870870358 learned_addr learned my addr 172.21.15.81:0/2870870358 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab67fc640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ab80d2410 0x7f3ab80b4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab6ffd640 1 -- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ab80d2410 msgr2=0x7f3ab80b4aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab77fe640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ab815f6d0 0x7f3ab815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab6ffd640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ab80d2410 0x7f3ab80b4aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab6ffd640 1 -- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ab815f6d0 msgr2=0x7f3ab815d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab6ffd640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ab815f6d0 0x7f3ab815d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab6ffd640 1 -- 172.21.15.81:0/2870870358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ab80b4fe0 con 0x7f3ab80cfce0 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab67fc640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ab80d2410 0x7f3ab80b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab77fe640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ab815f6d0 0x7f3ab815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:35.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3ab6ffd640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80cfce0 0x7f3ab8150580 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009bf0 tx=0x7f3aa8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3aaffff640 1 -- 172.21.15.81:0/2870870358 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8046070 con 0x7f3ab80cfce0 2024-09-17T05:24:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3aaffff640 1 -- 172.21.15.81:0/2870870358 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3aa8004250 con 0x7f3ab80cfce0 2024-09-17T05:24:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ab80c5cf0 con 0x7f3ab80cfce0 2024-09-17T05:24:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3aaffff640 1 -- 172.21.15.81:0/2870870358 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8004680 con 0x7f3ab80cfce0 2024-09-17T05:24:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.923+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ab80ca430 con 0x7f3ab80cfce0 2024-09-17T05:24:35.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.924+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ab80b19f0 con 0x7f3ab80cfce0 2024-09-17T05:24:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.925+0000 7f3aaffff640 1 -- 172.21.15.81:0/2870870358 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f3aa8049070 con 0x7f3ab80cfce0 2024-09-17T05:24:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.925+0000 7f3aaffff640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3a980791c0 0x7f3a9807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.925+0000 7f3ab67fc640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3a980791c0 0x7f3a9807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.925+0000 7f3aaffff640 1 -- 172.21.15.81:0/2870870358 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7f3aa80bc5d0 con 0x7f3ab80cfce0 2024-09-17T05:24:35.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.926+0000 7f3ab67fc640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3a980791c0 0x7f3a9807b680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3ab81f6270 tx=0x7f3aa0008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:35.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:35.930+0000 7f3aaffff640 1 -- 172.21.15.81:0/2870870358 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3aa8032030 con 0x7f3ab80cfce0 2024-09-17T05:24:36.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.177+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7f3ab815bec0 con 0x7f3ab80cfce0 2024-09-17T05:24:36.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.204+0000 7f3aaffff640 1 -- 172.21.15.81:0/2870870358 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v322) ==== 154+0+0 (secure 0 0 0) 0x7f3ab815c0e0 con 0x7f3ab80cfce0 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.206+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3a980791c0 msgr2=0x7f3a9807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.206+0000 7f3abd816640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3a980791c0 0x7f3a9807b680 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3ab81f6270 tx=0x7f3aa0008040 comp rx=0 tx=0).stop 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.206+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80cfce0 msgr2=0x7f3ab8150580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.206+0000 7f3abd816640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80cfce0 0x7f3ab8150580 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f3aa8009bf0 tx=0x7f3aa8003f10 comp rx=0 tx=0).stop 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 shutdown_connections 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3a980791c0 0x7f3a9807b680 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3ab815f6d0 0x7f3ab815d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3ab80d2410 0x7f3ab80b4aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 --2- 172.21.15.81:0/2870870358 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3ab80cfce0 0x7f3ab8150580 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 >> 172.21.15.81:0/2870870358 conn(0x7f3ab809aa30 msgr2=0x7f3ab80cc4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:36.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 shutdown_connections 2024-09-17T05:24:36.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.207+0000 7f3abd816640 1 -- 172.21.15.81:0/2870870358 wait complete. 2024-09-17T05:24:36.219 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:24:36.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.319+0000 7f25d75f8640 1 -- 172.21.15.81:0/461350299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25bc004800 msgr2=0x7f25bc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.319+0000 7f25d75f8640 1 --2- 172.21.15.81:0/461350299 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25bc004800 0x7f25bc004c80 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f25c0006fc0 tx=0x7f25bc005830 comp rx=0 tx=0).stop 2024-09-17T05:24:36.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.319+0000 7f25d5b95640 1 -- 172.21.15.81:0/461350299 reap_dead start 2024-09-17T05:24:36.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.319+0000 7f25d75f8640 1 -- 172.21.15.81:0/461350299 shutdown_connections 2024-09-17T05:24:36.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.319+0000 7f25d75f8640 1 -- 172.21.15.81:0/461350299 >> 172.21.15.81:0/461350299 conn(0x7f25d00b1690 msgr2=0x7f25d00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:36.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.319+0000 7f25d75f8640 1 -- 172.21.15.81:0/461350299 shutdown_connections 2024-09-17T05:24:36.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.319+0000 7f25d75f8640 1 -- 172.21.15.81:0/461350299 wait complete. 2024-09-17T05:24:36.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.320+0000 7f25d75f8640 1 Processor -- start 2024-09-17T05:24:36.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d75f8640 1 -- start start 2024-09-17T05:24:36.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d75f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc004800 0x7f25d0152020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d75f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25d0156f50 0x7f25d01573d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d75f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d014e1f0 0x7f25d014e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d75f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f25d00cf1d0 con 0x7f25d014e1f0 2024-09-17T05:24:36.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d75f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f25d00ccc20 con 0x7f25bc004800 2024-09-17T05:24:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d75f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f25d00cf350 con 0x7f25d0156f50 2024-09-17T05:24:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d5b95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d014e1f0 0x7f25d014e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d5b95640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d014e1f0 0x7f25d014e650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34762/0 (socket says 172.21.15.81:34762) 2024-09-17T05:24:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d5b95640 1 -- 172.21.15.81:0/1593852496 learned_addr learned my addr 172.21.15.81:0/1593852496 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d5394640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc004800 0x7f25d0152020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.321+0000 7f25d4b93640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25d0156f50 0x7f25d01573d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d5b95640 1 -- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25d0156f50 msgr2=0x7f25d01573d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d5b95640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25d0156f50 0x7f25d01573d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d5b95640 1 -- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc004800 msgr2=0x7f25d0152020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d5b95640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc004800 0x7f25d0152020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d5b95640 1 -- 172.21.15.81:0/1593852496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f25d014eb90 con 0x7f25d014e1f0 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d5b95640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d014e1f0 0x7f25d014e650 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f25d015d170 tx=0x7f25c80019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25c5ffb640 1 -- 172.21.15.81:0/1593852496 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011870 con 0x7f25d014e1f0 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25c5ffb640 1 -- 172.21.15.81:0/1593852496 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f25c8017070 con 0x7f25d014e1f0 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f25d01f2520 con 0x7f25d014e1f0 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25c5ffb640 1 -- 172.21.15.81:0/1593852496 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f25c8011dc0 con 0x7f25d014e1f0 2024-09-17T05:24:36.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.322+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f25d01f2ae0 con 0x7f25d014e1f0 2024-09-17T05:24:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.323+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f25d0074680 con 0x7f25d014e1f0 2024-09-17T05:24:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.324+0000 7f25c5ffb640 1 -- 172.21.15.81:0/1593852496 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f25c801c460 con 0x7f25d014e1f0 2024-09-17T05:24:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.324+0000 7f25c5ffb640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25b40791c0 0x7f25b407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.324+0000 7f25d5394640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25b40791c0 0x7f25b407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.324+0000 7f25c5ffb640 1 -- 172.21.15.81:0/1593852496 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7f25c809bd20 con 0x7f25d014e1f0 2024-09-17T05:24:36.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.325+0000 7f25d5394640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25b40791c0 0x7f25b407b680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009be0 tx=0x7f25cc005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:36.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.328+0000 7f25c5ffb640 1 -- 172.21.15.81:0/1593852496 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f25d0074680 con 0x7f25d014e1f0 2024-09-17T05:24:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.502+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f25d015f750 con 0x7f25d014e1f0 2024-09-17T05:24:36.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.502+0000 7f25c5ffb640 1 -- 172.21.15.81:0/1593852496 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v41) ==== 59+0+1998 (secure 0 0 0) 0x7f25c8063a50 con 0x7f25d014e1f0 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:24:36.504 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:24:36.505 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:24:36.506 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:24:36.506 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:24:36.506 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:24:36.506 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:24:36.506 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:24:36.506 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:24:36.506 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:24:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25b40791c0 msgr2=0x7f25b407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25b40791c0 0x7f25b407b680 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f25cc009be0 tx=0x7f25cc005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d014e1f0 msgr2=0x7f25d014e650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.507 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d014e1f0 0x7f25d014e650 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f25d015d170 tx=0x7f25c80019b0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 shutdown_connections 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f25d014e1f0 0x7f25d014e650 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f25d0156f50 0x7f25d01573d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f25b40791c0 0x7f25b407b680 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 --2- 172.21.15.81:0/1593852496 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f25bc004800 0x7f25d0152020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 >> 172.21.15.81:0/1593852496 conn(0x7f25d00b1690 msgr2=0x7f25d015bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 shutdown_connections 2024-09-17T05:24:36.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.505+0000 7f25d75f8640 1 -- 172.21.15.81:0/1593852496 wait complete. 2024-09-17T05:24:36.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:24:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.619+0000 7fd5c09bc640 1 -- 172.21.15.81:0/3161536779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 msgr2=0x7fd5bc0d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.619+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/3161536779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 0x7fd5bc0d1d30 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fd5a4009830 tx=0x7fd5a402a4b0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.620+0000 7fd5c09bc640 1 -- 172.21.15.81:0/3161536779 shutdown_connections 2024-09-17T05:24:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.620+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/3161536779 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 0x7fd5bc0d1d30 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.620+0000 7fd5c09bc640 1 -- 172.21.15.81:0/3161536779 >> 172.21.15.81:0/3161536779 conn(0x7fd5bc0d3e30 msgr2=0x7fd5bc0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.620+0000 7fd5c09bc640 1 -- 172.21.15.81:0/3161536779 shutdown_connections 2024-09-17T05:24:36.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.620+0000 7fd5c09bc640 1 -- 172.21.15.81:0/3161536779 wait complete. 2024-09-17T05:24:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.621+0000 7fd5c09bc640 1 Processor -- start 2024-09-17T05:24:36.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.621+0000 7fd5c09bc640 1 -- start start 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5c09bc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5bc0b3de0 0x7fd5bc1f5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5c09bc640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5bc0d01b0 0x7fd5bc06e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5c09bc640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 0x7fd5bc1f8450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5c09bc640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc0b4a80 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5c09bc640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5bc0b4900 con 0x7fd5bc1617f0 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5c09bc640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd5bc0b4c00 con 0x7fd5bc0d01b0 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5bc0b3de0 0x7fd5bc1f5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5bc0b3de0 0x7fd5bc1f5870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34776/0 (socket says 172.21.15.81:34776) 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 -- 172.21.15.81:0/2563371191 learned_addr learned my addr 172.21.15.81:0/2563371191 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5b9d9b640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5bc0d01b0 0x7fd5bc06e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5bad9d640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 0x7fd5bc1f8450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 -- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5bc0d01b0 msgr2=0x7fd5bc06e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5bc0d01b0 0x7fd5bc06e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 -- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 msgr2=0x7fd5bc1f8450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 0x7fd5bc1f8450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 -- 172.21.15.81:0/2563371191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5bc0cc2f0 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5b9d9b640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5bc0d01b0 0x7fd5bc06e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.622+0000 7fd5ba59c640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5bc0b3de0 0x7fd5bc1f5870 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd5a402aaa0 tx=0x7fd5a4003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.623+0000 7fd5b2ffd640 1 -- 172.21.15.81:0/2563371191 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4005c90 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.623+0000 7fd5b2ffd640 1 -- 172.21.15.81:0/2563371191 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd5a4005110 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.623+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5bc0cc630 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.623+0000 7fd5b2ffd640 1 -- 172.21.15.81:0/2563371191 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5a4005520 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.623+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5bc0cce70 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.624+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5bc0b41f0 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.624+0000 7fd5b2ffd640 1 -- 172.21.15.81:0/2563371191 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fd5a40317c0 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.625+0000 7fd5b2ffd640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd59c0791c0 0x7fd59c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.625+0000 7fd5b2ffd640 1 -- 172.21.15.81:0/2563371191 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7fd5a40bc550 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.625+0000 7fd5b9d9b640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd59c0791c0 0x7fd59c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:36.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.625+0000 7fd5b9d9b640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd59c0791c0 0x7fd59c07b680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc1ebf50 tx=0x7fd5ac009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:36.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.629+0000 7fd5b2ffd640 1 -- 172.21.15.81:0/2563371191 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd5bc0cc630 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.806+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd5bc0ce2f0 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.809+0000 7fd5b2ffd640 1 -- 172.21.15.81:0/2563371191 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7fd5a403f030 con 0x7fd5bc0b3de0 2024-09-17T05:24:36.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd59c0791c0 msgr2=0x7fd59c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd59c0791c0 0x7fd59c07b680 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc1ebf50 tx=0x7fd5ac009040 comp rx=0 tx=0).stop 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5bc0b3de0 msgr2=0x7fd5bc1f5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5bc0b3de0 0x7fd5bc1f5870 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7fd5a402aaa0 tx=0x7fd5a4003c10 comp rx=0 tx=0).stop 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 shutdown_connections 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd59c0791c0 0x7fd59c07b680 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5bc1617f0 0x7fd5bc1f8450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd5bc0d01b0 0x7fd5bc06e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 --2- 172.21.15.81:0/2563371191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5bc0b3de0 0x7fd5bc1f5870 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 >> 172.21.15.81:0/2563371191 conn(0x7fd5bc0d3e30 msgr2=0x7fd5bc0b0c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 shutdown_connections 2024-09-17T05:24:36.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:36.811+0000 7fd5c09bc640 1 -- 172.21.15.81:0/2563371191 wait complete. 2024-09-17T05:24:36.823 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:24:36.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:36.856 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:24:36.907 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:24:36.907 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:36.908 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:36.923 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:24:36.923 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:36.924 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:36.942 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:24:36.942 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:24:36.942 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:36.979 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:24:36.979 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:24:36.979 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:24:37.000 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:24:37.001 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:24:37.001 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:37.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 -- 172.21.15.81:0/3756440270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa75815aa70 msgr2=0x7fa7580b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 --2- 172.21.15.81:0/3756440270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa75815aa70 0x7fa7580b4690 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7fa75806ee40 tx=0x7fa74802aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:37.120 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 -- 172.21.15.81:0/3756440270 shutdown_connections 2024-09-17T05:24:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 --2- 172.21.15.81:0/3756440270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa75806ff80 0x7fa758070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 --2- 172.21.15.81:0/3756440270 >> v2:172.21.15.160:3300/0 conn(0x7fa7580735a0 0x7fa7580739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 --2- 172.21.15.81:0/3756440270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa75815aa70 0x7fa7580b4690 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 -- 172.21.15.81:0/3756440270 >> 172.21.15.81:0/3756440270 conn(0x7fa7580b1690 msgr2=0x7fa7580b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 -- 172.21.15.81:0/3756440270 shutdown_connections 2024-09-17T05:24:37.121 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.119+0000 7fa75e02a640 1 -- 172.21.15.81:0/3756440270 wait complete. 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.120+0000 7fa75e02a640 1 Processor -- start 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.120+0000 7fa75e02a640 1 -- start start 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa75e02a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa75806ff80 0x7fa758156f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa75e02a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7580735a0 0x7fa758157470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa75e02a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa75815aa70 0x7fa7581579b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa75e02a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa7580cd060 con 0x7fa7580735a0 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa75e02a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa7580ccee0 con 0x7fa75815aa70 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa75e02a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa7580cd1e0 con 0x7fa75806ff80 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7580735a0 0x7fa758157470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7580735a0 0x7fa758157470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34782/0 (socket says 172.21.15.81:34782) 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 -- 172.21.15.81:0/1590644177 learned_addr learned my addr 172.21.15.81:0/1590644177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa7577fe640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa75806ff80 0x7fa758156f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa757fff640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa75815aa70 0x7fa7581579b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 -- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa75806ff80 msgr2=0x7fa758156f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa75806ff80 0x7fa758156f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 -- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa75815aa70 msgr2=0x7fa7581579b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa75815aa70 0x7fa7581579b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 -- 172.21.15.81:0/1590644177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa758159680 con 0x7fa7580735a0 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa7577fe640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa75806ff80 0x7fa758156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa757fff640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa75815aa70 0x7fa7581579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:37.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.121+0000 7fa756ffd640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7580735a0 0x7fa758157470 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b4a0 tx=0x7fa74c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.122+0000 7fa73ffff640 1 -- 172.21.15.81:0/1590644177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c014070 con 0x7fa7580735a0 2024-09-17T05:24:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.122+0000 7fa73ffff640 1 -- 172.21.15.81:0/1590644177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa74c010700 con 0x7fa7580735a0 2024-09-17T05:24:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.122+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa758159960 con 0x7fa7580735a0 2024-09-17T05:24:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.122+0000 7fa73ffff640 1 -- 172.21.15.81:0/1590644177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa74c010b50 con 0x7fa7580735a0 2024-09-17T05:24:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.122+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa758149860 con 0x7fa7580735a0 2024-09-17T05:24:37.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.123+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7580739d0 con 0x7fa7580735a0 2024-09-17T05:24:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.123+0000 7fa73ffff640 1 -- 172.21.15.81:0/1590644177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fa74c017070 con 0x7fa7580735a0 2024-09-17T05:24:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.124+0000 7fa73ffff640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7440791f0 0x7fa74407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.124+0000 7fa7577fe640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7440791f0 0x7fa74407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.124+0000 7fa73ffff640 1 -- 172.21.15.81:0/1590644177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7fa74c09b130 con 0x7fa7580735a0 2024-09-17T05:24:37.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.124+0000 7fa7577fe640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7440791f0 0x7fa74407b6b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa748035000 tx=0x7fa748004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:37.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.128+0000 7fa73ffff640 1 -- 172.21.15.81:0/1590644177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa74c062e60 con 0x7fa7580735a0 2024-09-17T05:24:37.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.339+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7580b1db0 con 0x7fa7580735a0 2024-09-17T05:24:37.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.339+0000 7fa73ffff640 1 -- 172.21.15.81:0/1590644177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 71 v71) ==== 94+0+3917 (secure 0 0 0) 0x7fa74c062760 con 0x7fa7580735a0 2024-09-17T05:24:37.341 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:37.341 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":71,"btime":"2024-09-17T05:24:32:127159+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6676,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/3436145099","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":3436145099},{"type":"v1","addr":"172.21.15.160:6834","nonce":3436145099}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":6679,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3146864973","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3146864973},{"type":"v1","addr":"172.21.15.160:6835","nonce":3146864973}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":65},{"gid":7515,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6833/3025598693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3025598693},{"type":"v1","addr":"172.21.15.81:6833","nonce":3025598693}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":64},{"gid":7833,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3760589682","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6834","nonce":3760589682},{"type":"v1","addr":"172.21.15.81:6835","nonce":3760589682}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":71}],"filesystems":[]} 2024-09-17T05:24:37.341 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 71 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.341+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7440791f0 msgr2=0x7fa74407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.341+0000 7fa75e02a640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7440791f0 0x7fa74407b6b0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fa748035000 tx=0x7fa748004ab0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.341+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7580735a0 msgr2=0x7fa758157470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.341+0000 7fa75e02a640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7580735a0 0x7fa758157470 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fa74c00b4a0 tx=0x7fa74c00b960 comp rx=0 tx=0).stop 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 shutdown_connections 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa7440791f0 0x7fa74407b6b0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa75815aa70 0x7fa7581579b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa7580735a0 0x7fa758157470 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 --2- 172.21.15.81:0/1590644177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa75806ff80 0x7fa758156f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 >> 172.21.15.81:0/1590644177 conn(0x7fa7580b1690 msgr2=0x7fa75806ec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 shutdown_connections 2024-09-17T05:24:37.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.342+0000 7fa75e02a640 1 -- 172.21.15.81:0/1590644177 wait complete. 2024-09-17T05:24:37.354 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:24:37.354 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:24:37.354 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:24:37.354 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:37.354 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:24:37.354 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:24:37.355 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:24:37.355 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:37.355 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:24:37.355 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:24:37.355 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:24:37.355 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:37.356 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:24:37.356 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:24:37.356 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:24:37.356 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:24:37.363 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:24:37.364 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:24:37.365 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:24:37.365 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:24:37.367 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:24:37.367 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:24:37.368 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:24:37.369 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:24:37.406 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:24:37.407 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:37.407 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:24:37.407 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:37.410 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:24:37.410 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:37.411 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:24:37.411 DEBUG:teuthology.parallel:result is None 2024-09-17T05:24:37.411 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:24:37.480 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:24:37.481 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:24:37.492 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:24:37.492 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:24:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.518+0000 7f9c798b8640 1 -- 172.21.15.81:0/2531614355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0040d0 msgr2=0x7f9c5c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.518+0000 7f9c798b8640 1 --2- 172.21.15.81:0/2531614355 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c5c0040d0 0x7f9c5c004800 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7f9c680016c0 tx=0x7f9c5c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.518+0000 7f9c737fe640 1 -- 172.21.15.81:0/2531614355 reap_dead start 2024-09-17T05:24:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.518+0000 7f9c798b8640 1 -- 172.21.15.81:0/2531614355 shutdown_connections 2024-09-17T05:24:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.518+0000 7f9c798b8640 1 -- 172.21.15.81:0/2531614355 >> 172.21.15.81:0/2531614355 conn(0x7f9c740d3ea0 msgr2=0x7f9c740d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.518+0000 7f9c798b8640 1 -- 172.21.15.81:0/2531614355 shutdown_connections 2024-09-17T05:24:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.518+0000 7f9c798b8640 1 -- 172.21.15.81:0/2531614355 wait complete. 2024-09-17T05:24:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.519+0000 7f9c798b8640 1 Processor -- start 2024-09-17T05:24:37.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.519+0000 7f9c798b8640 1 -- start start 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c798b8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c0040d0 0x7f9c741f8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c798b8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c740ca560 0x7f9c7415a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c798b8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c740cb760 0x7f9c740cbc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c798b8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9c74162690 con 0x7f9c740cb760 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c798b8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9c740cf9b0 con 0x7f9c5c0040d0 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c798b8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9c7415a690 con 0x7f9c740ca560 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c740cb760 0x7f9c740cbc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c737fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c740cb760 0x7f9c740cbc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34848/0 (socket says 172.21.15.81:34848) 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c737fe640 1 -- 172.21.15.81:0/3875932505 learned_addr learned my addr 172.21.15.81:0/3875932505 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:37.523 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c72ffd640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c0040d0 0x7f9c741f8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c727fc640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c740ca560 0x7f9c7415a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c737fe640 1 -- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c740ca560 msgr2=0x7f9c7415a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c737fe640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c740ca560 0x7f9c7415a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c737fe640 1 -- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c0040d0 msgr2=0x7f9c741f8ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.520+0000 7f9c737fe640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c0040d0 0x7f9c741f8ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.521+0000 7f9c737fe640 1 -- 172.21.15.81:0/3875932505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c740cd780 con 0x7f9c740cb760 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.521+0000 7f9c737fe640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c740cb760 0x7f9c740cbc10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005fd0 tx=0x7f9c6c00fd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.521+0000 7f9c5bfff640 1 -- 172.21.15.81:0/3875932505 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c015070 con 0x7f9c740cb760 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.521+0000 7f9c5bfff640 1 -- 172.21.15.81:0/3875932505 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9c6c004b20 con 0x7f9c740cb760 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.521+0000 7f9c5bfff640 1 -- 172.21.15.81:0/3875932505 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c6c00d8c0 con 0x7f9c740cb760 2024-09-17T05:24:37.524 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.521+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c740cdfc0 con 0x7f9c740cb760 2024-09-17T05:24:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.521+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c740caa40 con 0x7f9c740cb760 2024-09-17T05:24:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.522+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c740b2d20 con 0x7f9c740cb760 2024-09-17T05:24:37.525 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.523+0000 7f9c5bfff640 1 -- 172.21.15.81:0/3875932505 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f9c6c00da60 con 0x7f9c740cb760 2024-09-17T05:24:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.523+0000 7f9c5bfff640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c600791c0 0x7f9c6007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.523+0000 7f9c5bfff640 1 -- 172.21.15.81:0/3875932505 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(121..121 src has 1..121) ==== 5015+0+0 (secure 0 0 0) 0x7f9c6c09bee0 con 0x7f9c740cb760 2024-09-17T05:24:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.523+0000 7f9c72ffd640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c600791c0 0x7f9c6007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:37.526 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.524+0000 7f9c72ffd640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c600791c0 0x7f9c6007b680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000fb0 tx=0x7f9c640013b0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:37.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.527+0000 7f9c5bfff640 1 -- 172.21.15.81:0/3875932505 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9c740b2d20 con 0x7f9c740cb760 2024-09-17T05:24:37.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:37.715+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f9c7415f880 con 0x7f9c740cb760 2024-09-17T05:24:38.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.222+0000 7f9c5bfff640 1 -- 172.21.15.81:0/3875932505 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v123) ==== 97+0+0 (secure 0 0 0) 0x7f9c740cd780 con 0x7f9c740cb760 2024-09-17T05:24:38.224 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.225+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c600791c0 msgr2=0x7f9c6007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.225+0000 7f9c798b8640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c600791c0 0x7f9c6007b680 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f9c64000fb0 tx=0x7f9c640013b0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.225+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c740cb760 msgr2=0x7f9c740cbc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.225+0000 7f9c798b8640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c740cb760 0x7f9c740cbc10 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f9c6c005fd0 tx=0x7f9c6c00fd90 comp rx=0 tx=0).stop 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 shutdown_connections 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9c740cb760 0x7f9c740cbc10 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9c740ca560 0x7f9c7415a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9c600791c0 0x7f9c6007b680 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 --2- 172.21.15.81:0/3875932505 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9c5c0040d0 0x7f9c741f8ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 >> 172.21.15.81:0/3875932505 conn(0x7f9c740d3ea0 msgr2=0x7f9c740b2610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:38.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 shutdown_connections 2024-09-17T05:24:38.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.226+0000 7f9c798b8640 1 -- 172.21.15.81:0/3875932505 wait complete. 2024-09-17T05:24:38.241 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 -- 172.21.15.81:0/1523480109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d0d40 msgr2=0x7ffb340cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/1523480109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d0d40 0x7ffb340cf9b0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7ffb340b9f50 tx=0x7ffb2802a560 comp rx=0 tx=0).stop 2024-09-17T05:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 -- 172.21.15.81:0/1523480109 shutdown_connections 2024-09-17T05:24:38.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/1523480109 >> v2:172.21.15.160:3300/0 conn(0x7ffb340d49c0 0x7ffb340b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/1523480109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d0d40 0x7ffb340cf9b0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 -- 172.21.15.81:0/1523480109 >> 172.21.15.81:0/1523480109 conn(0x7ffb340d3ea0 msgr2=0x7ffb340d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:38.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 -- 172.21.15.81:0/1523480109 shutdown_connections 2024-09-17T05:24:38.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.343+0000 7ffb3a48e640 1 -- 172.21.15.81:0/1523480109 wait complete. 2024-09-17T05:24:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.344+0000 7ffb3a48e640 1 Processor -- start 2024-09-17T05:24:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb3a48e640 1 -- start start 2024-09-17T05:24:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb3a48e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb340d0d40 0x7ffb34150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb3a48e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d49c0 0x7ffb340cd140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb3a48e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb3415df90 0x7ffb340cfc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb3a48e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb34162690 con 0x7ffb340d49c0 2024-09-17T05:24:38.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb3a48e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb340b3d40 con 0x7ffb340d0d40 2024-09-17T05:24:38.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb3a48e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ffb340cd680 con 0x7ffb3415df90 2024-09-17T05:24:38.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d49c0 0x7ffb340cd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb337fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d49c0 0x7ffb340cd140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34868/0 (socket says 172.21.15.81:34868) 2024-09-17T05:24:38.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.345+0000 7ffb337fe640 1 -- 172.21.15.81:0/134467100 learned_addr learned my addr 172.21.15.81:0/134467100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb33fff640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb340d0d40 0x7ffb34150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb38a2b640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb3415df90 0x7ffb340cfc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb337fe640 1 -- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb3415df90 msgr2=0x7ffb340cfc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb337fe640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb3415df90 0x7ffb340cfc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb337fe640 1 -- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb340d0d40 msgr2=0x7ffb34150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb337fe640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb340d0d40 0x7ffb34150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb337fe640 1 -- 172.21.15.81:0/134467100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb340cd8a0 con 0x7ffb340d49c0 2024-09-17T05:24:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb38a2b640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb3415df90 0x7ffb340cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb33fff640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb340d0d40 0x7ffb34150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb337fe640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d49c0 0x7ffb340cd140 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009850 tx=0x7ffb280039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:38.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb30ff9640 1 -- 172.21.15.81:0/134467100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2803f070 con 0x7ffb340d49c0 2024-09-17T05:24:38.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb30ff9640 1 -- 172.21.15.81:0/134467100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb28004890 con 0x7ffb340d49c0 2024-09-17T05:24:38.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb30ff9640 1 -- 172.21.15.81:0/134467100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28035030 con 0x7ffb340d49c0 2024-09-17T05:24:38.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb340cdb80 con 0x7ffb340d49c0 2024-09-17T05:24:38.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.346+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb340ce140 con 0x7ffb340d49c0 2024-09-17T05:24:38.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.347+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb340d3090 con 0x7ffb340d49c0 2024-09-17T05:24:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.348+0000 7ffb30ff9640 1 -- 172.21.15.81:0/134467100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7ffb28042070 con 0x7ffb340d49c0 2024-09-17T05:24:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.348+0000 7ffb30ff9640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb200791c0 0x7ffb2007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.348+0000 7ffb33fff640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb200791c0 0x7ffb2007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.349+0000 7ffb30ff9640 1 -- 172.21.15.81:0/134467100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4929+0+0 (secure 0 0 0) 0x7ffb280bc2f0 con 0x7ffb340d49c0 2024-09-17T05:24:38.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.349+0000 7ffb33fff640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb200791c0 0x7ffb2007b680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400a810 tx=0x7ffb24008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:38.358 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.353+0000 7ffb30ff9640 1 -- 172.21.15.81:0/134467100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ffb340d3090 con 0x7ffb340d49c0 2024-09-17T05:24:38.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.598+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7ffb340b4270 con 0x7ffb340d49c0 2024-09-17T05:24:38.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.599+0000 7ffb30ff9640 1 -- 172.21.15.81:0/134467100 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v23) ==== 80+0+5304 (secure 0 0 0) 0x7ffb340ce970 con 0x7ffb340d49c0 2024-09-17T05:24:38.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:38.600 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:24:38.600 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:24:38.600 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.601 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:24:38.601 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:24:38.601 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.601 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.601 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:38.601 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.602 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:24:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:24:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:38.603 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:24:38.604 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:24:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.605 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:24:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:24:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.606 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.607 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.608 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.608 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:24:38.608 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:24:38.608 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.608 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.608 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.609 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.609 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.609 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.609 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.609 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:24:38.610 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:24:38.611 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.611 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.611 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.611 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.611 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.612 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.612 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:24:38.612 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.613 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.614 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.615 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.616 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:24:38.617 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:24:38.618 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:24:38.619 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.620 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:24:38.621 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:24:38.622 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:24:38.623 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:24:38.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.623 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.623 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:24:38.623 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:24:38.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb200791c0 msgr2=0x7ffb2007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb200791c0 0x7ffb2007b680 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7ffb2400a810 tx=0x7ffb24008040 comp rx=0 tx=0).stop 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d49c0 msgr2=0x7ffb340cd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d49c0 0x7ffb340cd140 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7ffb28009850 tx=0x7ffb280039e0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 shutdown_connections 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb3415df90 0x7ffb340cfc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb340d49c0 0x7ffb340cd140 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb200791c0 0x7ffb2007b680 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 --2- 172.21.15.81:0/134467100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb340d0d40 0x7ffb34150ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 >> 172.21.15.81:0/134467100 conn(0x7ffb340d3ea0 msgr2=0x7ffb340b6250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 shutdown_connections 2024-09-17T05:24:38.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.601+0000 7ffb3a48e640 1 -- 172.21.15.81:0/134467100 wait complete. 2024-09-17T05:24:38.626 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:24:38.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.727+0000 7fcffe184640 1 -- 172.21.15.81:0/1227709364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe4005210 msgr2=0x7fcfe400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.727+0000 7fcffe184640 1 --2- 172.21.15.81:0/1227709364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe4005210 0x7fcfe400b9c0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7fcff000a790 tx=0x7fcfe4005830 comp rx=0 tx=0).stop 2024-09-17T05:24:38.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.727+0000 7fcffe184640 1 -- 172.21.15.81:0/1227709364 shutdown_connections 2024-09-17T05:24:38.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.727+0000 7fcffe184640 1 --2- 172.21.15.81:0/1227709364 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcfe4005210 0x7fcfe400b9c0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.727+0000 7fcffe184640 1 -- 172.21.15.81:0/1227709364 >> 172.21.15.81:0/1227709364 conn(0x7fcff80d3ea0 msgr2=0x7fcff80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:38.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.727+0000 7fcffe184640 1 -- 172.21.15.81:0/1227709364 shutdown_connections 2024-09-17T05:24:38.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.727+0000 7fcffe184640 1 -- 172.21.15.81:0/1227709364 wait complete. 2024-09-17T05:24:38.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.728+0000 7fcffe184640 1 Processor -- start 2024-09-17T05:24:38.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.728+0000 7fcffe184640 1 -- start start 2024-09-17T05:24:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcffe184640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfe4005210 0x7fcff8158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcffe184640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff81f7f00 0x7fcff81554e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcffe184640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff806e300 0x7fcff806e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcffe184640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcff80cf9b0 con 0x7fcff806e300 2024-09-17T05:24:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcffe184640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcff81627a0 con 0x7fcff81f7f00 2024-09-17T05:24:38.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcffe184640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcff80cfb30 con 0x7fcfe4005210 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff806e300 0x7fcff806e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff806e300 0x7fcff806e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34882/0 (socket says 172.21.15.81:34882) 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 -- 172.21.15.81:0/874502797 learned_addr learned my addr 172.21.15.81:0/874502797 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff77fe640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfe4005210 0x7fcff8158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcfeeffd640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff81f7f00 0x7fcff81554e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 -- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfe4005210 msgr2=0x7fcff8158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfe4005210 0x7fcff8158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 -- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff81f7f00 msgr2=0x7fcff81554e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff81f7f00 0x7fcff81554e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcff7fff640 1 -- 172.21.15.81:0/874502797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcff81f8380 con 0x7fcff806e300 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.729+0000 7fcfeeffd640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff81f7f00 0x7fcff81554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.730+0000 7fcff7fff640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff806e300 0x7fcff806e760 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcff002b6b0 tx=0x7fcff0003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.730+0000 7fcff4ff9640 1 -- 172.21.15.81:0/874502797 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff002bdd0 con 0x7fcff806e300 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.730+0000 7fcff4ff9640 1 -- 172.21.15.81:0/874502797 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcff003a070 con 0x7fcff806e300 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.730+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcff81f8600 con 0x7fcff806e300 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.730+0000 7fcff4ff9640 1 -- 172.21.15.81:0/874502797 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcff00346d0 con 0x7fcff806e300 2024-09-17T05:24:38.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.730+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcff81f8bc0 con 0x7fcff806e300 2024-09-17T05:24:38.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.731+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcff80d07a0 con 0x7fcff806e300 2024-09-17T05:24:38.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.731+0000 7fcff4ff9640 1 -- 172.21.15.81:0/874502797 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fcff003c020 con 0x7fcff806e300 2024-09-17T05:24:38.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.732+0000 7fcff4ff9640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcfd80791f0 0x7fcfd807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:38.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.732+0000 7fcff4ff9640 1 -- 172.21.15.81:0/874502797 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4929+0+0 (secure 0 0 0) 0x7fcff00bb000 con 0x7fcff806e300 2024-09-17T05:24:38.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.732+0000 7fcff77fe640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcfd80791f0 0x7fcfd807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:38.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.732+0000 7fcff77fe640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcfd80791f0 0x7fcfd807b6b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009a20 tx=0x7fcfe8005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:38.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.736+0000 7fcff4ff9640 1 -- 172.21.15.81:0/874502797 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcff81f8380 con 0x7fcff806e300 2024-09-17T05:24:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.912+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fcff80b9c00 con 0x7fcff806e300 2024-09-17T05:24:38.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.912+0000 7fcff4ff9640 1 -- 172.21.15.81:0/874502797 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v125) ==== 84+0+65 (secure 0 0 0) 0x7fcff80ce970 con 0x7fcff806e300 2024-09-17T05:24:38.913 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:38.914 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:24:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:24:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:24:38.914 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:38.914 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:24:38.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcfd80791f0 msgr2=0x7fcfd807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcfd80791f0 0x7fcfd807b6b0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcfe8009a20 tx=0x7fcfe8005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff806e300 msgr2=0x7fcff806e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff806e300 0x7fcff806e760 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7fcff002b6b0 tx=0x7fcff0003c20 comp rx=0 tx=0).stop 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 shutdown_connections 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcff806e300 0x7fcff806e760 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcfd80791f0 0x7fcfd807b6b0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcff81f7f00 0x7fcff81554e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 --2- 172.21.15.81:0/874502797 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcfe4005210 0x7fcff8158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.914+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 >> 172.21.15.81:0/874502797 conn(0x7fcff80d3ea0 msgr2=0x7fcff80b7200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.915+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 shutdown_connections 2024-09-17T05:24:38.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:38.915+0000 7fcffe184640 1 -- 172.21.15.81:0/874502797 wait complete. 2024-09-17T05:24:38.927 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:24:38.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:24:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.030+0000 7fcac8317640 1 -- 172.21.15.81:0/3685533403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 msgr2=0x7fcac00cf560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.030+0000 7fcac8317640 1 --2- 172.21.15.81:0/3685533403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac00cf560 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7fcabc005fd0 tx=0x7fcabc02a540 comp rx=0 tx=0).stop 2024-09-17T05:24:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.030+0000 7fcac8317640 1 -- 172.21.15.81:0/3685533403 shutdown_connections 2024-09-17T05:24:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.030+0000 7fcac8317640 1 --2- 172.21.15.81:0/3685533403 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac00cf560 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.031 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.030+0000 7fcac8317640 1 -- 172.21.15.81:0/3685533403 >> 172.21.15.81:0/3685533403 conn(0x7fcac00cfdf0 msgr2=0x7fcac00d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.030+0000 7fcac8317640 1 -- 172.21.15.81:0/3685533403 shutdown_connections 2024-09-17T05:24:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.030+0000 7fcac8317640 1 -- 172.21.15.81:0/3685533403 wait complete. 2024-09-17T05:24:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.031+0000 7fcac8317640 1 Processor -- start 2024-09-17T05:24:39.032 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.031+0000 7fcac8317640 1 -- start start 2024-09-17T05:24:39.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac8317640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac0070120 0x7fcac0159e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac8317640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0072d50 0x7fcac01562f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac8317640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac015d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac8317640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcac00cec50 con 0x7fcac015ac80 2024-09-17T05:24:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac8317640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcac00cead0 con 0x7fcac0072d50 2024-09-17T05:24:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac8317640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcac00cedd0 con 0x7fcac0070120 2024-09-17T05:24:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac015d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:39.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac015d110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34900/0 (socket says 172.21.15.81:34900) 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 -- 172.21.15.81:0/311675006 learned_addr learned my addr 172.21.15.81:0/311675006 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 -- 172.21.15.81:0/311675006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac0070120 msgr2=0x7fcac0159e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac0070120 0x7fcac0159e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 -- 172.21.15.81:0/311675006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0072d50 msgr2=0x7fcac01562f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0072d50 0x7fcac01562f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 -- 172.21.15.81:0/311675006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcac015a3c0 con 0x7fcac015ac80 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.032+0000 7fcac68b4640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac015d110 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c730 tx=0x7fcab800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.033+0000 7fcab6ffd640 1 -- 172.21.15.81:0/311675006 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8003b70 con 0x7fcac015ac80 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.033+0000 7fcab6ffd640 1 -- 172.21.15.81:0/311675006 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcab8003d10 con 0x7fcac015ac80 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.033+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcac0156830 con 0x7fcac015ac80 2024-09-17T05:24:39.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.033+0000 7fcab6ffd640 1 -- 172.21.15.81:0/311675006 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcab8005330 con 0x7fcac015ac80 2024-09-17T05:24:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.033+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcac01f2ba0 con 0x7fcac015ac80 2024-09-17T05:24:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.033+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcac01f3540 con 0x7fcac015ac80 2024-09-17T05:24:39.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.034+0000 7fcab6ffd640 1 -- 172.21.15.81:0/311675006 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fcab80056e0 con 0x7fcac015ac80 2024-09-17T05:24:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.035+0000 7fcab6ffd640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaa40791c0 0x7fcaa407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.035+0000 7fcac60b3640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaa40791c0 0x7fcaa407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.035+0000 7fcab6ffd640 1 -- 172.21.15.81:0/311675006 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(125..125 src has 1..125) ==== 4929+0+0 (secure 0 0 0) 0x7fcab809b670 con 0x7fcac015ac80 2024-09-17T05:24:39.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.035+0000 7fcac60b3640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaa40791c0 0x7fcaa407b680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcabc033000 tx=0x7fcabc0046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:39.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.039+0000 7fcab6ffd640 1 -- 172.21.15.81:0/311675006 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcac01f3540 con 0x7fcac015ac80 2024-09-17T05:24:39.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.216+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fcac00cf560 con 0x7fcac015ac80 2024-09-17T05:24:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.236+0000 7fcab6ffd640 1 -- 172.21.15.81:0/311675006 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v126) ==== 138+0+0 (secure 0 0 0) 0x7fcac00749a0 con 0x7fcac015ac80 2024-09-17T05:24:39.237 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:24:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaa40791c0 msgr2=0x7fcaa407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaa40791c0 0x7fcaa407b680 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcabc033000 tx=0x7fcabc0046c0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 msgr2=0x7fcac015d110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac015d110 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7fcab800c730 tx=0x7fcab800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 shutdown_connections 2024-09-17T05:24:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcac015ac80 0x7fcac015d110 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.240 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcaa40791c0 0x7fcaa407b680 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcac0072d50 0x7fcac01562f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 --2- 172.21.15.81:0/311675006 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcac0070120 0x7fcac0159e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 >> 172.21.15.81:0/311675006 conn(0x7fcac00cfdf0 msgr2=0x7fcac006ec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.239+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 shutdown_connections 2024-09-17T05:24:39.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.240+0000 7fcac8317640 1 -- 172.21.15.81:0/311675006 wait complete. 2024-09-17T05:24:39.254 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:24:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 -- 172.21.15.81:0/3117402699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2815bda0 msgr2=0x7f3b280cd1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3117402699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2815bda0 0x7f3b280cd1d0 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f3b280cc230 tx=0x7f3b1802a980 comp rx=0 tx=0).stop 2024-09-17T05:24:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 -- 172.21.15.81:0/3117402699 shutdown_connections 2024-09-17T05:24:39.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3117402699 >> v2:172.21.15.160:3300/0 conn(0x7f3b280ceb00 0x7f3b280cfc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3117402699 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b280d2740 0x7f3b280ce5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3117402699 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b2815bda0 0x7f3b280cd1d0 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 -- 172.21.15.81:0/3117402699 >> 172.21.15.81:0/3117402699 conn(0x7f3b280d1bb0 msgr2=0x7f3b280d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 -- 172.21.15.81:0/3117402699 shutdown_connections 2024-09-17T05:24:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.362+0000 7f3b2f208640 1 -- 172.21.15.81:0/3117402699 wait complete. 2024-09-17T05:24:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.363+0000 7f3b2f208640 1 Processor -- start 2024-09-17T05:24:39.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.363+0000 7f3b2f208640 1 -- start start 2024-09-17T05:24:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2f208640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b280ceb00 0x7f3b2806dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2f208640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280d2740 0x7f3b2806e400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2f208640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2815bda0 0x7f3b2815e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2f208640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b280d0500 con 0x7f3b280d2740 2024-09-17T05:24:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2f208640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3b280d0380 con 0x7f3b2815bda0 2024-09-17T05:24:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2f208640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3b280d0680 con 0x7f3b280ceb00 2024-09-17T05:24:39.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b27fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280d2740 0x7f3b2806e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b27fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280d2740 0x7f3b2806e400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34924/0 (socket says 172.21.15.81:34924) 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b27fff640 1 -- 172.21.15.81:0/3650455994 learned_addr learned my addr 172.21.15.81:0/3650455994 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2d7a5640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2815bda0 0x7f3b2815e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b2cfa4640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b280ceb00 0x7f3b2806dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b27fff640 1 -- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b280ceb00 msgr2=0x7f3b2806dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b27fff640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b280ceb00 0x7f3b2806dec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b27fff640 1 -- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2815bda0 msgr2=0x7f3b2815e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.364+0000 7f3b27fff640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2815bda0 0x7f3b2815e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.365+0000 7f3b27fff640 1 -- 172.21.15.81:0/3650455994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b280cb760 con 0x7f3b280d2740 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.365+0000 7f3b27fff640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280d2740 0x7f3b2806e400 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00b4a0 tx=0x7f3b1c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:39.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.365+0000 7f3b257fa640 1 -- 172.21.15.81:0/3650455994 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c014070 con 0x7f3b280d2740 2024-09-17T05:24:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.365+0000 7f3b257fa640 1 -- 172.21.15.81:0/3650455994 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3b1c010700 con 0x7f3b280d2740 2024-09-17T05:24:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.365+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b280cba10 con 0x7f3b280d2740 2024-09-17T05:24:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.365+0000 7f3b257fa640 1 -- 172.21.15.81:0/3650455994 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b1c010b50 con 0x7f3b280d2740 2024-09-17T05:24:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.365+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b2815ded0 con 0x7f3b280d2740 2024-09-17T05:24:39.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.366+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b280cde30 con 0x7f3b280d2740 2024-09-17T05:24:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.367+0000 7f3b257fa640 1 -- 172.21.15.81:0/3650455994 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f3b1c017070 con 0x7f3b280d2740 2024-09-17T05:24:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.367+0000 7f3b257fa640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3b140791c0 0x7f3b1407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.367+0000 7f3b257fa640 1 -- 172.21.15.81:0/3650455994 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(126..126 src has 1..126) ==== 5299+0+0 (secure 0 0 0) 0x7f3b1c09b230 con 0x7f3b280d2740 2024-09-17T05:24:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.367+0000 7f3b2cfa4640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3b140791c0 0x7f3b1407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:39.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.368+0000 7f3b2cfa4640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3b140791c0 0x7f3b1407b680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b18035000 tx=0x7f3b18004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:39.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.372+0000 7f3b257fa640 1 -- 172.21.15.81:0/3650455994 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3b1c062770 con 0x7f3b280d2740 2024-09-17T05:24:39.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:39.550+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f3b2806e9a0 con 0x7f3b280d2740 2024-09-17T05:24:40.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.243+0000 7f3b257fa640 1 -- 172.21.15.81:0/3650455994 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v127) ==== 170+0+0 (secure 0 0 0) 0x7f3b1c0671a0 con 0x7f3b280d2740 2024-09-17T05:24:40.245 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:24:40.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3b140791c0 msgr2=0x7f3b1407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3b140791c0 0x7f3b1407b680 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f3b18035000 tx=0x7f3b18004ab0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280d2740 msgr2=0x7f3b2806e400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280d2740 0x7f3b2806e400 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f3b1c00b4a0 tx=0x7f3b1c00b960 comp rx=0 tx=0).stop 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 shutdown_connections 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3b140791c0 0x7f3b1407b680 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b2815bda0 0x7f3b2815e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b280d2740 0x7f3b2806e400 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 --2- 172.21.15.81:0/3650455994 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b280ceb00 0x7f3b2806dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 >> 172.21.15.81:0/3650455994 conn(0x7f3b280d1bb0 msgr2=0x7f3b280aea60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:40.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 shutdown_connections 2024-09-17T05:24:40.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.246+0000 7f3b2f208640 1 -- 172.21.15.81:0/3650455994 wait complete. 2024-09-17T05:24:40.268 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:24:40.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 -- 172.21.15.81:0/317856351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c80cc540 msgr2=0x7fd7c80cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:40.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/317856351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c80cc540 0x7fd7c80cc980 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0005fd0 tx=0x7fd7b002a530 comp rx=0 tx=0).stop 2024-09-17T05:24:40.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 -- 172.21.15.81:0/317856351 shutdown_connections 2024-09-17T05:24:40.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/317856351 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c80cc540 0x7fd7c80cc980 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/317856351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7c8151e30 0x7fd7c806fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 -- 172.21.15.81:0/317856351 >> 172.21.15.81:0/317856351 conn(0x7fd7c80b1700 msgr2=0x7fd7c80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:40.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 -- 172.21.15.81:0/317856351 shutdown_connections 2024-09-17T05:24:40.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.372+0000 7fd7ccc79640 1 -- 172.21.15.81:0/317856351 wait complete. 2024-09-17T05:24:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 Processor -- start 2024-09-17T05:24:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 -- start start 2024-09-17T05:24:40.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7c80cc540 0x7fd7c81f9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c8151e30 0x7fd7c80c9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7c815b3d0 0x7fd7c81f5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80cb0e0 con 0x7fd7c8151e30 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd7c80caf60 con 0x7fd7c80cc540 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.374+0000 7fd7ccc79640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd7c80cb260 con 0x7fd7c815b3d0 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c8151e30 0x7fd7c80c9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c8151e30 0x7fd7c80c9890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34944/0 (socket says 172.21.15.81:34944) 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 -- 172.21.15.81:0/1618101557 learned_addr learned my addr 172.21.15.81:0/1618101557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c659c640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7c80cc540 0x7fd7c81f9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c6d9d640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7c815b3d0 0x7fd7c81f5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 -- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7c815b3d0 msgr2=0x7fd7c81f5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:40.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7c815b3d0 0x7fd7c81f5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 -- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7c80cc540 msgr2=0x7fd7c81f9560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7c80cc540 0x7fd7c81f9560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 -- 172.21.15.81:0/1618101557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7c80c5340 con 0x7fd7c8151e30 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7c5d9b640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c8151e30 0x7fd7c80c9890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009850 tx=0x7fd7b00038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7beffd640 1 -- 172.21.15.81:0/1618101557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b003f070 con 0x7fd7c8151e30 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7beffd640 1 -- 172.21.15.81:0/1618101557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7b00047a0 con 0x7fd7c8151e30 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7c80c9dd0 con 0x7fd7c8151e30 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7beffd640 1 -- 172.21.15.81:0/1618101557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7b0035030 con 0x7fd7c8151e30 2024-09-17T05:24:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.375+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7c81f5f10 con 0x7fd7c8151e30 2024-09-17T05:24:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.376+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7c80cb780 con 0x7fd7c8151e30 2024-09-17T05:24:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.377+0000 7fd7beffd640 1 -- 172.21.15.81:0/1618101557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fd7b0042070 con 0x7fd7c8151e30 2024-09-17T05:24:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.377+0000 7fd7beffd640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7a80791c0 0x7fd7a807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.378+0000 7fd7c659c640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7a80791c0 0x7fd7a807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.378+0000 7fd7beffd640 1 -- 172.21.15.81:0/1618101557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(127..127 src has 1..127) ==== 5681+0+0 (secure 0 0 0) 0x7fd7b00bc970 con 0x7fd7c8151e30 2024-09-17T05:24:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.378+0000 7fd7c659c640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7a80791c0 0x7fd7a807b680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8005fd0 tx=0x7fd7b8009680 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.381+0000 7fd7beffd640 1 -- 172.21.15.81:0/1618101557 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd7c80c5340 con 0x7fd7c8151e30 2024-09-17T05:24:40.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:40.593+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd7c80d0880 con 0x7fd7c8151e30 2024-09-17T05:24:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.247+0000 7fd7beffd640 1 -- 172.21.15.81:0/1618101557 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v74) ==== 174+0+0 (secure 0 0 0) 0x7fd7b0084020 con 0x7fd7c8151e30 2024-09-17T05:24:41.248 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 20 and data pool 21 2024-09-17T05:24:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.250+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7a80791c0 msgr2=0x7fd7a807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.250+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7a80791c0 0x7fd7a807b680 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fd7b8005fd0 tx=0x7fd7b8009680 comp rx=0 tx=0).stop 2024-09-17T05:24:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.250+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c8151e30 msgr2=0x7fd7c80c9890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.250+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c8151e30 0x7fd7c80c9890 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7fd7b0009850 tx=0x7fd7b00038a0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 shutdown_connections 2024-09-17T05:24:41.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7c815b3d0 0x7fd7c81f5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7c8151e30 0x7fd7c80c9890 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7a80791c0 0x7fd7a807b680 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 --2- 172.21.15.81:0/1618101557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7c80cc540 0x7fd7c81f9560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 >> 172.21.15.81:0/1618101557 conn(0x7fd7c80b1700 msgr2=0x7fd7c815a910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:41.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 shutdown_connections 2024-09-17T05:24:41.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.251+0000 7fd7ccc79640 1 -- 172.21.15.81:0/1618101557 wait complete. 2024-09-17T05:24:41.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.372+0000 7fd044047640 1 -- 172.21.15.81:0/2861709448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd024003a50 msgr2=0x7fd024003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.372+0000 7fd044047640 1 --2- 172.21.15.81:0/2861709448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd024003a50 0x7fd024003e70 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7fd034001690 tx=0x7fd024005830 comp rx=0 tx=0).stop 2024-09-17T05:24:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.372+0000 7fd044047640 1 -- 172.21.15.81:0/2861709448 shutdown_connections 2024-09-17T05:24:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.372+0000 7fd044047640 1 --2- 172.21.15.81:0/2861709448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd024003a50 0x7fd024003e70 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.372+0000 7fd044047640 1 -- 172.21.15.81:0/2861709448 >> 172.21.15.81:0/2861709448 conn(0x7fd03c09af50 msgr2=0x7fd03c0d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.372+0000 7fd044047640 1 -- 172.21.15.81:0/2861709448 shutdown_connections 2024-09-17T05:24:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.372+0000 7fd044047640 1 -- 172.21.15.81:0/2861709448 wait complete. 2024-09-17T05:24:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.373+0000 7fd044047640 1 Processor -- start 2024-09-17T05:24:41.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.373+0000 7fd044047640 1 -- start start 2024-09-17T05:24:41.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd044047640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd024003a50 0x7fd03c1f46a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd044047640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd03c15a5a0 0x7fd03c15fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd044047640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03c1f3c20 0x7fd03c160290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd044047640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c0d2800 con 0x7fd03c1f3c20 2024-09-17T05:24:41.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd044047640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd03c0d2680 con 0x7fd024003a50 2024-09-17T05:24:41.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd044047640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd03c0ce530 con 0x7fd03c15a5a0 2024-09-17T05:24:41.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03c1f3c20 0x7fd03c160290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03c1f3c20 0x7fd03c160290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34958/0 (socket says 172.21.15.81:34958) 2024-09-17T05:24:41.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 -- 172.21.15.81:0/4189694976 learned_addr learned my addr 172.21.15.81:0/4189694976 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:41.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0415e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd03c15a5a0 0x7fd03c15fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd041de3640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd024003a50 0x7fd03c1f46a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 -- 172.21.15.81:0/4189694976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd03c15a5a0 msgr2=0x7fd03c15fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd03c15a5a0 0x7fd03c15fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 -- 172.21.15.81:0/4189694976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd024003a50 msgr2=0x7fd03c1f46a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd024003a50 0x7fd03c1f46a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 -- 172.21.15.81:0/4189694976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd03c1f0980 con 0x7fd03c1f3c20 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.374+0000 7fd0425e4640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03c1f3c20 0x7fd03c160290 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd02c005fd0 tx=0x7fd02c010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.375+0000 7fd03a7fc640 1 -- 172.21.15.81:0/4189694976 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c003970 con 0x7fd03c1f3c20 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.375+0000 7fd03a7fc640 1 -- 172.21.15.81:0/4189694976 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd02c015070 con 0x7fd03c1f3c20 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.375+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd03c1f0c60 con 0x7fd03c1f3c20 2024-09-17T05:24:41.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.375+0000 7fd03a7fc640 1 -- 172.21.15.81:0/4189694976 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd02c004050 con 0x7fd03c1f3c20 2024-09-17T05:24:41.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.375+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd03c1f1220 con 0x7fd03c1f3c20 2024-09-17T05:24:41.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.376+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd03c0698c0 con 0x7fd03c1f3c20 2024-09-17T05:24:41.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.376+0000 7fd03a7fc640 1 -- 172.21.15.81:0/4189694976 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fd02c0041f0 con 0x7fd03c1f3c20 2024-09-17T05:24:41.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.377+0000 7fd03a7fc640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0280791c0 0x7fd02807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.377+0000 7fd041de3640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0280791c0 0x7fd02807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.377+0000 7fd03a7fc640 1 -- 172.21.15.81:0/4189694976 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5781+0+0 (secure 0 0 0) 0x7fd02c09c370 con 0x7fd03c1f3c20 2024-09-17T05:24:41.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.377+0000 7fd041de3640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0280791c0 0x7fd02807b680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd034032000 tx=0x7fd0340011d0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.381+0000 7fd03a7fc640 1 -- 172.21.15.81:0/4189694976 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd02c063750 con 0x7fd03c1f3c20 2024-09-17T05:24:41.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.559+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd03c0cea20 con 0x7fd03c1f3c20 2024-09-17T05:24:41.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.560+0000 7fd03a7fc640 1 -- 172.21.15.81:0/4189694976 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16864 (secure 0 0 0) 0x7fd02c068180 con 0x7fd03c1f3c20 2024-09-17T05:24:41.561 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:41.562 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":128,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:40.594689+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:39.221468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:39.555911+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0280791c0 msgr2=0x7fd02807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0280791c0 0x7fd02807b680 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fd034032000 tx=0x7fd0340011d0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03c1f3c20 msgr2=0x7fd03c160290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03c1f3c20 0x7fd03c160290 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fd02c005fd0 tx=0x7fd02c010f40 comp rx=0 tx=0).stop 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 shutdown_connections 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd03c1f3c20 0x7fd03c160290 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd03c15a5a0 0x7fd03c15fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0280791c0 0x7fd02807b680 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 --2- 172.21.15.81:0/4189694976 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd024003a50 0x7fd03c1f46a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.562+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 >> 172.21.15.81:0/4189694976 conn(0x7fd03c09af50 msgr2=0x7fd03c0d11f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:41.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.563+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 shutdown_connections 2024-09-17T05:24:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.563+0000 7fd044047640 1 -- 172.21.15.81:0/4189694976 wait complete. 2024-09-17T05:24:41.575 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.679+0000 7fe4466ef640 1 -- 172.21.15.81:0/2285705272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe428004d40 msgr2=0x7fe4280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.679+0000 7fe4466ef640 1 --2- 172.21.15.81:0/2285705272 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe428004d40 0x7fe4280051c0 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fe43800c670 tx=0x7fe428005830 comp rx=0 tx=0).stop 2024-09-17T05:24:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.679+0000 7fe444c8c640 1 -- 172.21.15.81:0/2285705272 reap_dead start 2024-09-17T05:24:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.679+0000 7fe4466ef640 1 -- 172.21.15.81:0/2285705272 shutdown_connections 2024-09-17T05:24:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.679+0000 7fe4466ef640 1 -- 172.21.15.81:0/2285705272 >> 172.21.15.81:0/2285705272 conn(0x7fe4400b1690 msgr2=0x7fe4400b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.679+0000 7fe4466ef640 1 -- 172.21.15.81:0/2285705272 shutdown_connections 2024-09-17T05:24:41.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.679+0000 7fe4466ef640 1 -- 172.21.15.81:0/2285705272 wait complete. 2024-09-17T05:24:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.681+0000 7fe4466ef640 1 Processor -- start 2024-09-17T05:24:41.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.681+0000 7fe4466ef640 1 -- start start 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.681+0000 7fe4466ef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe428004d40 0x7fe44013ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe4466ef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4401f61c0 0x7fe44015a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe4466ef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4401f6640 0x7fe44015e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe4466ef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe4400cf560 con 0x7fe4401f61c0 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe4466ef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe4400cf3e0 con 0x7fe428004d40 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe4466ef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe44015fc90 con 0x7fe4401f6640 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4401f61c0 0x7fe44015a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.684 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4401f61c0 0x7fe44015a5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34968/0 (socket says 172.21.15.81:34968) 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 -- 172.21.15.81:0/2232809465 learned_addr learned my addr 172.21.15.81:0/2232809465 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe444c8c640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4401f6640 0x7fe44015e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43ffff640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe428004d40 0x7fe44013ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 -- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4401f6640 msgr2=0x7fe44015e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4401f6640 0x7fe44015e4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 -- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe428004d40 msgr2=0x7fe44013ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe428004d40 0x7fe44013ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 -- 172.21.15.81:0/2232809465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4401f2700 con 0x7fe4401f61c0 2024-09-17T05:24:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43ffff640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe428004d40 0x7fe44013ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43f7fe640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4401f61c0 0x7fe44015a5b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe434005f60 tx=0x7fe434011cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43cff9640 1 -- 172.21.15.81:0/2232809465 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe43401f070 con 0x7fe4401f61c0 2024-09-17T05:24:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43cff9640 1 -- 172.21.15.81:0/2232809465 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe43400fe40 con 0x7fe4401f61c0 2024-09-17T05:24:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe43cff9640 1 -- 172.21.15.81:0/2232809465 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4340126b0 con 0x7fe4401f61c0 2024-09-17T05:24:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4401f29e0 con 0x7fe4401f61c0 2024-09-17T05:24:41.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.682+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4401f2fa0 con 0x7fe4401f61c0 2024-09-17T05:24:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.683+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe44015f750 con 0x7fe4401f61c0 2024-09-17T05:24:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.684+0000 7fe43cff9640 1 -- 172.21.15.81:0/2232809465 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fe434022070 con 0x7fe4401f61c0 2024-09-17T05:24:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.684+0000 7fe43cff9640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe42c0791c0 0x7fe42c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.685+0000 7fe43cff9640 1 -- 172.21.15.81:0/2232809465 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5781+0+0 (secure 0 0 0) 0x7fe43409c3f0 con 0x7fe4401f61c0 2024-09-17T05:24:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.685+0000 7fe43ffff640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe42c0791c0 0x7fe42c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.685+0000 7fe43ffff640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe42c0791c0 0x7fe42c07b680 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe440141e00 tx=0x7fe430005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:41.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.689+0000 7fe43cff9640 1 -- 172.21.15.81:0/2232809465 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe4340637d0 con 0x7fe4401f61c0 2024-09-17T05:24:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.866+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe44015b840 con 0x7fe4401f61c0 2024-09-17T05:24:41.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.867+0000 7fe43cff9640 1 -- 172.21.15.81:0/2232809465 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v128) ==== 74+0+16864 (secure 0 0 0) 0x7fe434068200 con 0x7fe4401f61c0 2024-09-17T05:24:41.869 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:41.869 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":128,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:40.594689+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:39.221468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:39.555911+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe42c0791c0 msgr2=0x7fe42c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe42c0791c0 0x7fe42c07b680 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe440141e00 tx=0x7fe430005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4401f61c0 msgr2=0x7fe44015a5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4401f61c0 0x7fe44015a5b0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7fe434005f60 tx=0x7fe434011cb0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 shutdown_connections 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe4401f6640 0x7fe44015e4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4401f61c0 0x7fe44015a5b0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe42c0791c0 0x7fe42c07b680 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 --2- 172.21.15.81:0/2232809465 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe428004d40 0x7fe44013ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 >> 172.21.15.81:0/2232809465 conn(0x7fe4400b1690 msgr2=0x7fe4400afd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:41.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.869+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 shutdown_connections 2024-09-17T05:24:41.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.870+0000 7fe4466ef640 1 -- 172.21.15.81:0/2232809465 wait complete. 2024-09-17T05:24:41.882 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.984+0000 7f1921132640 1 -- 172.21.15.81:0/2872397913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0b3de0 msgr2=0x7f191c0b41f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.984+0000 7f1921132640 1 --2- 172.21.15.81:0/2872397913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0b3de0 0x7f191c0b41f0 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f191c06a240 tx=0x7f191402a970 comp rx=0 tx=0).stop 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.985+0000 7f1921132640 1 -- 172.21.15.81:0/2872397913 shutdown_connections 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.985+0000 7f1921132640 1 --2- 172.21.15.81:0/2872397913 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0b3de0 0x7f191c0b41f0 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.985+0000 7f1921132640 1 --2- 172.21.15.81:0/2872397913 >> v2:172.21.15.160:3300/0 conn(0x7f191c0d01b0 0x7f191c0d2440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.985+0000 7f1921132640 1 -- 172.21.15.81:0/2872397913 >> 172.21.15.81:0/2872397913 conn(0x7f191c0d3e30 msgr2=0x7f191c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.985+0000 7f1921132640 1 -- 172.21.15.81:0/2872397913 shutdown_connections 2024-09-17T05:24:41.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.985+0000 7f1921132640 1 -- 172.21.15.81:0/2872397913 wait complete. 2024-09-17T05:24:41.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.986+0000 7f1921132640 1 Processor -- start 2024-09-17T05:24:41.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.986+0000 7f1921132640 1 -- start start 2024-09-17T05:24:41.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f1921132640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f191c0b3de0 0x7f191c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f1921132640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0d01b0 0x7f191c0c9c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f1921132640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f191c1617f0 0x7f191c0b7fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f1921132640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0b48b0 con 0x7f191c0d01b0 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f1921132640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f191c0b4730 con 0x7f191c0b3de0 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f1921132640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f191c0b4a30 con 0x7f191c1617f0 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0d01b0 0x7f191c0c9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0d01b0 0x7f191c0c9c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34992/0 (socket says 172.21.15.81:34992) 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 -- 172.21.15.81:0/2701298323 learned_addr learned my addr 172.21.15.81:0/2701298323 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191ad9d640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f191c0b3de0 0x7f191c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191b59e640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f191c1617f0 0x7f191c0b7fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 -- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f191c1617f0 msgr2=0x7f191c0b7fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f191c1617f0 0x7f191c0b7fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 -- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f191c0b3de0 msgr2=0x7f191c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:41.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f191c0b3de0 0x7f191c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:41.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 -- 172.21.15.81:0/2701298323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f191c14f850 con 0x7f191c0d01b0 2024-09-17T05:24:41.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191ad9d640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f191c0b3de0 0x7f191c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191b59e640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f191c1617f0 0x7f191c0b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f191a59c640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0d01b0 0x7f191c0c9c50 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f191000b4d0 tx=0x7f191000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.987+0000 7f19037fe640 1 -- 172.21.15.81:0/2701298323 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910014070 con 0x7f191c0d01b0 2024-09-17T05:24:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.988+0000 7f19037fe640 1 -- 172.21.15.81:0/2701298323 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1910010610 con 0x7f191c0d01b0 2024-09-17T05:24:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.988+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f191c0b6c60 con 0x7f191c0d01b0 2024-09-17T05:24:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.988+0000 7f19037fe640 1 -- 172.21.15.81:0/2701298323 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1910010a60 con 0x7f191c0d01b0 2024-09-17T05:24:41.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.988+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f191c0b7220 con 0x7f191c0d01b0 2024-09-17T05:24:41.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.989+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f191c0b4fd0 con 0x7f191c0d01b0 2024-09-17T05:24:41.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.989+0000 7f19037fe640 1 -- 172.21.15.81:0/2701298323 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f1910017070 con 0x7f191c0d01b0 2024-09-17T05:24:41.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.990+0000 7f19037fe640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19080791c0 0x7f190807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:41.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.990+0000 7f191ad9d640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19080791c0 0x7f190807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:41.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.990+0000 7f19037fe640 1 -- 172.21.15.81:0/2701298323 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(128..128 src has 1..128) ==== 5781+0+0 (secure 0 0 0) 0x7f191009b400 con 0x7f191c0d01b0 2024-09-17T05:24:41.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.990+0000 7f191ad9d640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19080791c0 0x7f190807b680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f190c006fd0 tx=0x7f190c008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:41.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:41.994+0000 7f19037fe640 1 -- 172.21.15.81:0/2701298323 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f191c14f850 con 0x7f191c0d01b0 2024-09-17T05:24:42.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.209+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f191c0b5700 con 0x7f191c0d01b0 2024-09-17T05:24:42.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.250+0000 7f19037fe640 1 -- 172.21.15.81:0/2701298323 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v75) ==== 118+0+0 (secure 0 0 0) 0x7f1910062db0 con 0x7f191c0d01b0 2024-09-17T05:24:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19080791c0 msgr2=0x7f190807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19080791c0 0x7f190807b680 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f190c006fd0 tx=0x7f190c008040 comp rx=0 tx=0).stop 2024-09-17T05:24:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0d01b0 msgr2=0x7f191c0c9c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0d01b0 0x7f191c0c9c50 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f191000b4d0 tx=0x7f191000b990 comp rx=0 tx=0).stop 2024-09-17T05:24:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 shutdown_connections 2024-09-17T05:24:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f191c1617f0 0x7f191c0b7fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f191c0d01b0 0x7f191c0c9c50 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19080791c0 0x7f190807b680 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 --2- 172.21.15.81:0/2701298323 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f191c0b3de0 0x7f191c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 >> 172.21.15.81:0/2701298323 conn(0x7f191c0d3e30 msgr2=0x7f191c0b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 shutdown_connections 2024-09-17T05:24:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.253+0000 7f1921132640 1 -- 172.21.15.81:0/2701298323 wait complete. 2024-09-17T05:24:42.265 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:24:42.265 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:24:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.368+0000 7f7cb3fff640 1 -- 172.21.15.81:0/1516192760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9c003a30 msgr2=0x7f7c9c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.368+0000 7f7cb3fff640 1 --2- 172.21.15.81:0/1516192760 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c9c003a30 0x7f7c9c003e50 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f7ca40016c0 tx=0x7f7c9c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.368+0000 7f7cb37fe640 1 -- 172.21.15.81:0/1516192760 reap_dead start 2024-09-17T05:24:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.368+0000 7f7cb3fff640 1 -- 172.21.15.81:0/1516192760 shutdown_connections 2024-09-17T05:24:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.368+0000 7f7cb3fff640 1 -- 172.21.15.81:0/1516192760 >> 172.21.15.81:0/1516192760 conn(0x7f7cb40d3ce0 msgr2=0x7f7cb40d40f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.368+0000 7f7cb3fff640 1 -- 172.21.15.81:0/1516192760 shutdown_connections 2024-09-17T05:24:42.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.368+0000 7f7cb3fff640 1 -- 172.21.15.81:0/1516192760 wait complete. 2024-09-17T05:24:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 Processor -- start 2024-09-17T05:24:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 -- start start 2024-09-17T05:24:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c9c003a30 0x7f7cb40cdbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb41f4a40 0x7f7cb41f5050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cb41f5590 0x7f7cb41580d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:42.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb4161dd0 con 0x7f7cb41f4a40 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7cb40d1660 con 0x7f7cb41f5590 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb3fff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7cb4161f50 con 0x7f7c9c003a30 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb41f4a40 0x7f7cb41f5050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb27fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb41f4a40 0x7f7cb41f5050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35006/0 (socket says 172.21.15.81:35006) 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.370+0000 7f7cb27fc640 1 -- 172.21.15.81:0/3570751467 learned_addr learned my addr 172.21.15.81:0/3570751467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb37fe640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cb41f5590 0x7f7cb41580d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb2ffd640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c9c003a30 0x7f7cb40cdbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb27fc640 1 -- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c9c003a30 msgr2=0x7f7cb40cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb27fc640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c9c003a30 0x7f7cb40cdbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb27fc640 1 -- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cb41f5590 msgr2=0x7f7cb41580d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:42.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb27fc640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cb41f5590 0x7f7cb41580d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb27fc640 1 -- 172.21.15.81:0/3570751467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cb415a160 con 0x7f7cb41f4a40 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb37fe640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cb41f5590 0x7f7cb41580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb27fc640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb41f4a40 0x7f7cb41f5050 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011a50 tx=0x7f7ca8011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7c9b7fe640 1 -- 172.21.15.81:0/3570751467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca801f070 con 0x7f7cb41f4a40 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7c9b7fe640 1 -- 172.21.15.81:0/3570751467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7ca800fe80 con 0x7f7cb41f4a40 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cb415a3d0 con 0x7f7cb41f4a40 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7c9b7fe640 1 -- 172.21.15.81:0/3570751467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ca8012690 con 0x7f7cb41f4a40 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.371+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cb415a990 con 0x7f7cb41f4a40 2024-09-17T05:24:42.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.372+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cb41628a0 con 0x7f7cb41f4a40 2024-09-17T05:24:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.373+0000 7f7c9b7fe640 1 -- 172.21.15.81:0/3570751467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f7ca8022070 con 0x7f7cb41f4a40 2024-09-17T05:24:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.373+0000 7f7c9b7fe640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ca00791c0 0x7f7ca007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.373+0000 7f7cb2ffd640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ca00791c0 0x7f7ca007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.373+0000 7f7c9b7fe640 1 -- 172.21.15.81:0/3570751467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f7ca809c320 con 0x7f7cb41f4a40 2024-09-17T05:24:42.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.374+0000 7f7cb2ffd640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ca00791c0 0x7f7ca007b680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4032000 tx=0x7f7ca402c040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:42.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.377+0000 7f7c9b7fe640 1 -- 172.21.15.81:0/3570751467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7ca8063700 con 0x7f7cb41f4a40 2024-09-17T05:24:42.594 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:42.593+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f7cb40b1830 con 0x7f7cb41f4a40 2024-09-17T05:24:43.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.252+0000 7f7c9b7fe640 1 -- 172.21.15.81:0/3570751467 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v76) ==== 122+0+0 (secure 0 0 0) 0x7f7ca8068130 con 0x7f7cb41f4a40 2024-09-17T05:24:43.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ca00791c0 msgr2=0x7f7ca007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ca00791c0 0x7f7ca007b680 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7ca4032000 tx=0x7f7ca402c040 comp rx=0 tx=0).stop 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb41f4a40 msgr2=0x7f7cb41f5050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb41f4a40 0x7f7cb41f5050 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7ca8011a50 tx=0x7f7ca8011f10 comp rx=0 tx=0).stop 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 shutdown_connections 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7ca00791c0 0x7f7ca007b680 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cb41f5590 0x7f7cb41580d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cb41f4a40 0x7f7cb41f5050 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 --2- 172.21.15.81:0/3570751467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c9c003a30 0x7f7cb40cdbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 >> 172.21.15.81:0/3570751467 conn(0x7f7cb40d3ce0 msgr2=0x7f7cb40b09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:43.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 shutdown_connections 2024-09-17T05:24:43.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.254+0000 7f7cb3fff640 1 -- 172.21.15.81:0/3570751467 wait complete. 2024-09-17T05:24:43.267 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:24:43.267 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:43.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 -- 172.21.15.81:0/276938164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b3015aa70 msgr2=0x7f8b300b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/276938164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b3015aa70 0x7f8b300b4690 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8b20005fd0 tx=0x7f8b2002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 -- 172.21.15.81:0/276938164 shutdown_connections 2024-09-17T05:24:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/276938164 >> v2:172.21.15.160:3300/0 conn(0x7f8b300735a0 0x7f8b300739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/276938164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b3015aa70 0x7f8b300b4690 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 -- 172.21.15.81:0/276938164 >> 172.21.15.81:0/276938164 conn(0x7f8b300b1690 msgr2=0x7f8b300b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 -- 172.21.15.81:0/276938164 shutdown_connections 2024-09-17T05:24:43.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.367+0000 7f8b34d3d640 1 -- 172.21.15.81:0/276938164 wait complete. 2024-09-17T05:24:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 Processor -- start 2024-09-17T05:24:43.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 -- start start 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b3006ff80 0x7f8b301f6000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b300735a0 0x7f8b301f6540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b3015aa70 0x7f8b301583c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b300707c0 con 0x7f8b3006ff80 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8b30070640 con 0x7f8b3015aa70 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b34d3d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8b300cd5f0 con 0x7f8b300735a0 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b2e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b3006ff80 0x7f8b301f6000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b2e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b3006ff80 0x7f8b301f6000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34836/0 (socket says 172.21.15.81:34836) 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.369+0000 7f8b2e59c640 1 -- 172.21.15.81:0/270819837 learned_addr learned my addr 172.21.15.81:0/270819837 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2dd9b640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b300735a0 0x7f8b301f6540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2ed9d640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b3015aa70 0x7f8b301583c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2e59c640 1 -- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b300735a0 msgr2=0x7f8b301f6540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2e59c640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b300735a0 0x7f8b301f6540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2e59c640 1 -- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b3015aa70 msgr2=0x7f8b301583c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2e59c640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b3015aa70 0x7f8b301583c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2e59c640 1 -- 172.21.15.81:0/270819837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b30157640 con 0x7f8b3006ff80 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b2e59c640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b3006ff80 0x7f8b301f6000 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8b20000f80 tx=0x7f8b20003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b1effd640 1 -- 172.21.15.81:0/270819837 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20031990 con 0x7f8b3006ff80 2024-09-17T05:24:43.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b1effd640 1 -- 172.21.15.81:0/270819837 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b20031c20 con 0x7f8b3006ff80 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b300a9a50 con 0x7f8b3006ff80 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b1effd640 1 -- 172.21.15.81:0/270819837 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b20033330 con 0x7f8b3006ff80 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.370+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b30157ea0 con 0x7f8b3006ff80 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.371+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b301579f0 con 0x7f8b3006ff80 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.372+0000 7f8b1effd640 1 -- 172.21.15.81:0/270819837 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f8b200334d0 con 0x7f8b3006ff80 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.372+0000 7f8b1effd640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b100791c0 0x7f8b1007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.372+0000 7f8b2dd9b640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b100791c0 0x7f8b1007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.372+0000 7f8b1effd640 1 -- 172.21.15.81:0/270819837 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f8b200bcaa0 con 0x7f8b3006ff80 2024-09-17T05:24:43.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.373+0000 7f8b2dd9b640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b100791c0 0x7f8b1007b680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b240095f0 tx=0x7f8b24005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:43.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.377+0000 7f8b1effd640 1 -- 172.21.15.81:0/270819837 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8b2003f030 con 0x7f8b3006ff80 2024-09-17T05:24:43.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.588+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b300739a0 con 0x7f8b3006ff80 2024-09-17T05:24:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.589+0000 7f8b1effd640 1 -- 172.21.15.81:0/270819837 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5227 (secure 0 0 0) 0x7f8b200317b0 con 0x7f8b3006ff80 2024-09-17T05:24:43.590 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:43.590 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":76,"btime":"2024-09-17T05:24:43:251755+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6958,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/79515014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":79515014},{"type":"v1","addr":"172.21.15.160:6801","nonce":79515014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6961,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3823420234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3823420234},{"type":"v1","addr":"172.21.15.160:6835","nonce":3823420234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3648115084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3648115084},{"type":"v1","addr":"172.21.15.81:6834","nonce":3648115084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:40.594653+0000","modified":"2024-09-17T05:24:42.594562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1714561444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1714561444},{"type":"v1","addr":"172.21.15.81:6835","nonce":1714561444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7917,"qdb_cluster":[7917]},"id":10}]} 2024-09-17T05:24:43.590 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 76 2024-09-17T05:24:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b100791c0 msgr2=0x7f8b1007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b100791c0 0x7f8b1007b680 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f8b240095f0 tx=0x7f8b24005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b3006ff80 msgr2=0x7f8b301f6000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b3006ff80 0x7f8b301f6000 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f8b20000f80 tx=0x7f8b20003970 comp rx=0 tx=0).stop 2024-09-17T05:24:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 shutdown_connections 2024-09-17T05:24:43.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b100791c0 0x7f8b1007b680 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b3015aa70 0x7f8b301583c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b300735a0 0x7f8b301f6540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 --2- 172.21.15.81:0/270819837 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b3006ff80 0x7f8b301f6000 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 >> 172.21.15.81:0/270819837 conn(0x7f8b300b1690 msgr2=0x7f8b300ce0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:43.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 shutdown_connections 2024-09-17T05:24:43.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.591+0000 7f8b34d3d640 1 -- 172.21.15.81:0/270819837 wait complete. 2024-09-17T05:24:43.603 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:24:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.704+0000 7f801bf56640 1 -- 172.21.15.81:0/1576199284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc003a00 msgr2=0x7f7ffc003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.704+0000 7f801bf56640 1 --2- 172.21.15.81:0/1576199284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc003a00 0x7f7ffc003e00 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f800400c610 tx=0x7f7ffc005830 comp rx=0 tx=0).stop 2024-09-17T05:24:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.704+0000 7f801bf56640 1 -- 172.21.15.81:0/1576199284 shutdown_connections 2024-09-17T05:24:43.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.704+0000 7f801bf56640 1 --2- 172.21.15.81:0/1576199284 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7ffc003a00 0x7f7ffc003e00 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.704+0000 7f801bf56640 1 -- 172.21.15.81:0/1576199284 >> 172.21.15.81:0/1576199284 conn(0x7f80140d1c40 msgr2=0x7f80140d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:43.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.704+0000 7f801bf56640 1 -- 172.21.15.81:0/1576199284 shutdown_connections 2024-09-17T05:24:43.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.704+0000 7f801bf56640 1 -- 172.21.15.81:0/1576199284 wait complete. 2024-09-17T05:24:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.705+0000 7f801bf56640 1 Processor -- start 2024-09-17T05:24:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.705+0000 7f801bf56640 1 -- start start 2024-09-17T05:24:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ffc003a00 0x7f80140b5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801415a260 0x7f801415c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801415e8b0 0x7f801415ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f80140cf590 con 0x7f801415a260 2024-09-17T05:24:43.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f80140cf410 con 0x7f801415e8b0 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f80140ce630 con 0x7f7ffc003a00 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801415a260 0x7f801415c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801415a260 0x7f801415c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34844/0 (socket says 172.21.15.81:34844) 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 -- 172.21.15.81:0/2323973882 learned_addr learned my addr 172.21.15.81:0/2323973882 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f8019cf2640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ffc003a00 0x7f80140b5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801a4f3640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801415e8b0 0x7f801415ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 -- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ffc003a00 msgr2=0x7f80140b5ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ffc003a00 0x7f80140b5ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 -- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801415e8b0 msgr2=0x7f801415ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801415e8b0 0x7f801415ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 -- 172.21.15.81:0/2323973882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f801406ddf0 con 0x7f801415a260 2024-09-17T05:24:43.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801a4f3640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801415e8b0 0x7f801415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:43.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f8019cf2640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ffc003a00 0x7f80140b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:43.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80194f1640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801415a260 0x7f801415c110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f80080011f0 tx=0x7f80080016b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:43.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80127fc640 1 -- 172.21.15.81:0/2323973882 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008016030 con 0x7f801415a260 2024-09-17T05:24:43.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80127fc640 1 -- 172.21.15.81:0/2323973882 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f80080063d0 con 0x7f801415a260 2024-09-17T05:24:43.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f801406e0d0 con 0x7f801415a260 2024-09-17T05:24:43.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f80127fc640 1 -- 172.21.15.81:0/2323973882 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8008003850 con 0x7f801415a260 2024-09-17T05:24:43.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.706+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f801415f2a0 con 0x7f801415a260 2024-09-17T05:24:43.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.707+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f801406e310 con 0x7f801415a260 2024-09-17T05:24:43.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.708+0000 7f80127fc640 1 -- 172.21.15.81:0/2323973882 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f8008019070 con 0x7f801415a260 2024-09-17T05:24:43.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.709+0000 7f80127fc640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f80000791c0 0x7f800007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:43.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.709+0000 7f8019cf2640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f80000791c0 0x7f800007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:43.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.709+0000 7f80127fc640 1 -- 172.21.15.81:0/2323973882 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f800809bcb0 con 0x7f801415a260 2024-09-17T05:24:43.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.709+0000 7f8019cf2640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f80000791c0 0x7f800007b680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8004033000 tx=0x7f8004001cb0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:43.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.713+0000 7f80127fc640 1 -- 172.21.15.81:0/2323973882 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f801406e310 con 0x7f801415a260 2024-09-17T05:24:43.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.890+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f80140ceb30 con 0x7f801415a260 2024-09-17T05:24:43.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.891+0000 7f80127fc640 1 -- 172.21.15.81:0/2323973882 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16851 (secure 0 0 0) 0x7f80080636e0 con 0x7f801415a260 2024-09-17T05:24:43.892 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:43.892 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":129,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:42.226355+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:39.221468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:39.555911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:24:43.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f80000791c0 msgr2=0x7f800007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f80000791c0 0x7f800007b680 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f8004033000 tx=0x7f8004001cb0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801415a260 msgr2=0x7f801415c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:43.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801415a260 0x7f801415c110 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f80080011f0 tx=0x7f80080016b0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 shutdown_connections 2024-09-17T05:24:43.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f80000791c0 0x7f800007b680 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f801415e8b0 0x7f801415ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f801415a260 0x7f801415c110 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 --2- 172.21.15.81:0/2323973882 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7ffc003a00 0x7f80140b5ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:43.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 >> 172.21.15.81:0/2323973882 conn(0x7f80140d1c40 msgr2=0x7f80140d2020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:43.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 shutdown_connections 2024-09-17T05:24:43.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:43.893+0000 7f801bf56640 1 -- 172.21.15.81:0/2323973882 wait complete. 2024-09-17T05:24:43.906 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:24:43.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:24:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.007+0000 7f2758500640 1 -- 172.21.15.81:0/377115250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f273c004d90 msgr2=0x7f273c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.007+0000 7f2758500640 1 --2- 172.21.15.81:0/377115250 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f273c004d90 0x7f273c005210 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f2748001d90 tx=0x7f273c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.007+0000 7f2756a9d640 1 -- 172.21.15.81:0/377115250 reap_dead start 2024-09-17T05:24:44.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.007+0000 7f2758500640 1 -- 172.21.15.81:0/377115250 shutdown_connections 2024-09-17T05:24:44.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.007+0000 7f2758500640 1 -- 172.21.15.81:0/377115250 >> 172.21.15.81:0/377115250 conn(0x7f27500d3ea0 msgr2=0x7f27500d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:44.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.007+0000 7f2758500640 1 -- 172.21.15.81:0/377115250 shutdown_connections 2024-09-17T05:24:44.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.007+0000 7f2758500640 1 -- 172.21.15.81:0/377115250 wait complete. 2024-09-17T05:24:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.008+0000 7f2758500640 1 Processor -- start 2024-09-17T05:24:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.008+0000 7f2758500640 1 -- start start 2024-09-17T05:24:44.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2758500640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c004d90 0x7f27500b9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2758500640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27501509f0 0x7f2750161750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2758500640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750160170 0x7f27501605f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2758500640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27500cf9b0 con 0x7f2750160170 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2758500640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2750162710 con 0x7f273c004d90 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2758500640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f27500cfb30 con 0x7f27501509f0 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750160170 0x7f27501605f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750160170 0x7f27501605f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34854/0 (socket says 172.21.15.81:34854) 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 -- 172.21.15.81:0/2486874795 learned_addr learned my addr 172.21.15.81:0/2486874795 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2755a9b640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27501509f0 0x7f2750161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f275629c640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c004d90 0x7f27500b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 -- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27501509f0 msgr2=0x7f2750161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27501509f0 0x7f2750161750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 -- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c004d90 msgr2=0x7f27500b9140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c004d90 0x7f27500b9140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 -- 172.21.15.81:0/2486874795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2750161c90 con 0x7f2750160170 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f275629c640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c004d90 0x7f27500b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2755a9b640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27501509f0 0x7f2750161750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.009+0000 7f2756a9d640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750160170 0x7f27501605f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2748001e80 tx=0x7f2748001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.010+0000 7f2742ffd640 1 -- 172.21.15.81:0/2486874795 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480062b0 con 0x7f2750160170 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.010+0000 7f2742ffd640 1 -- 172.21.15.81:0/2486874795 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2748006450 con 0x7f2750160170 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.010+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f275015e7c0 con 0x7f2750160170 2024-09-17T05:24:44.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.010+0000 7f2742ffd640 1 -- 172.21.15.81:0/2486874795 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748006860 con 0x7f2750160170 2024-09-17T05:24:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.010+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27500b8940 con 0x7f2750160170 2024-09-17T05:24:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.011+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f275015ece0 con 0x7f2750160170 2024-09-17T05:24:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.011+0000 7f2742ffd640 1 -- 172.21.15.81:0/2486874795 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f2748003a30 con 0x7f2750160170 2024-09-17T05:24:44.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.012+0000 7f2742ffd640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27340791f0 0x7f273407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.012+0000 7f275629c640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27340791f0 0x7f273407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.012+0000 7f2742ffd640 1 -- 172.21.15.81:0/2486874795 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f27480bb880 con 0x7f2750160170 2024-09-17T05:24:44.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.012+0000 7f275629c640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27340791f0 0x7f273407b6b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2744001a30 tx=0x7f2744001150 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:44.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.016+0000 7f2742ffd640 1 -- 172.21.15.81:0/2486874795 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f27480834b0 con 0x7f2750160170 2024-09-17T05:24:44.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.194+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f275015e570 con 0x7f27340791f0 2024-09-17T05:24:44.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.198+0000 7f2742ffd640 1 -- 172.21.15.81:0/2486874795 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240214 (secure 0 0 0) 0x7f275015e570 con 0x7f27340791f0 2024-09-17T05:24:44.201 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:44.202 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:24:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27340791f0 msgr2=0x7f273407b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27340791f0 0x7f273407b6b0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2744001a30 tx=0x7f2744001150 comp rx=0 tx=0).stop 2024-09-17T05:24:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750160170 msgr2=0x7f27501605f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750160170 0x7f27501605f0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f2748001e80 tx=0x7f2748001b10 comp rx=0 tx=0).stop 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 shutdown_connections 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2750160170 0x7f27501605f0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27501509f0 0x7f2750161750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27340791f0 0x7f273407b6b0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 --2- 172.21.15.81:0/2486874795 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f273c004d90 0x7f27500b9140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 >> 172.21.15.81:0/2486874795 conn(0x7f27500d3ea0 msgr2=0x7f275006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 shutdown_connections 2024-09-17T05:24:44.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.201+0000 7f2758500640 1 -- 172.21.15.81:0/2486874795 wait complete. 2024-09-17T05:24:44.212 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-17T05:24:44.046151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262956,"kb_used_data":13412,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711764,"statfs":{"total":773094113280,"available":772824846336,"internally_reserved":0,"allocated":13733888,"data_stored":6680141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.807908"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245626+0000","last_change":"2024-09-17T05:24:39.245626+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245626+0000","last_undegraded":"2024-09-17T05:24:39.245626+0000","last_fullsized":"2024-09-17T05:24:39.245626+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243519+0000","last_change":"2024-09-17T05:24:39.243519+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243519+0000","last_undegraded":"2024-09-17T05:24:39.243519+0000","last_fullsized":"2024-09-17T05:24:39.243519+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240649+0000","last_change":"2024-09-17T05:24:39.240649+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240649+0000","last_undegraded":"2024-09-17T05:24:39.240649+0000","last_fullsized":"2024-09-17T05:24:39.240649+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240476+0000","last_change":"2024-09-17T05:24:39.240476+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240476+0000","last_undegraded":"2024-09-17T05:24:39.240476+0000","last_fullsized":"2024-09-17T05:24:39.240476+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241550+0000","last_change":"2024-09-17T05:24:39.241550+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241550+0000","last_undegraded":"2024-09-17T05:24:39.241550+0000","last_fullsized":"2024-09-17T05:24:39.241550+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244966+0000","last_change":"2024-09-17T05:24:39.244966+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244966+0000","last_undegraded":"2024-09-17T05:24:39.244966+0000","last_fullsized":"2024-09-17T05:24:39.244966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241139+0000","last_change":"2024-09-17T05:24:39.241139+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241139+0000","last_undegraded":"2024-09-17T05:24:39.241139+0000","last_fullsized":"2024-09-17T05:24:39.241139+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240906+0000","last_change":"2024-09-17T05:24:39.240906+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240906+0000","last_undegraded":"2024-09-17T05:24:39.240906+0000","last_fullsized":"2024-09-17T05:24:39.240906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242640+0000","last_change":"2024-09-17T05:24:39.242640+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242640+0000","last_undegraded":"2024-09-17T05:24:39.242640+0000","last_fullsized":"2024-09-17T05:24:39.242640+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245097+0000","last_change":"2024-09-17T05:24:39.245097+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245097+0000","last_undegraded":"2024-09-17T05:24:39.245097+0000","last_fullsized":"2024-09-17T05:24:39.245097+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242447+0000","last_change":"2024-09-17T05:24:39.242447+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242447+0000","last_undegraded":"2024-09-17T05:24:39.242447+0000","last_fullsized":"2024-09-17T05:24:39.242447+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240877+0000","last_change":"2024-09-17T05:24:39.240877+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240877+0000","last_undegraded":"2024-09-17T05:24:39.240877+0000","last_fullsized":"2024-09-17T05:24:39.240877+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241061+0000","last_change":"2024-09-17T05:24:39.241061+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241061+0000","last_undegraded":"2024-09-17T05:24:39.241061+0000","last_fullsized":"2024-09-17T05:24:39.241061+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244585+0000","last_change":"2024-09-17T05:24:39.244585+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244585+0000","last_undegraded":"2024-09-17T05:24:39.244585+0000","last_fullsized":"2024-09-17T05:24:39.244585+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240910+0000","last_change":"2024-09-17T05:24:39.240910+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240910+0000","last_undegraded":"2024-09-17T05:24:39.240910+0000","last_fullsized":"2024-09-17T05:24:39.240910+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244864+0000","last_change":"2024-09-17T05:24:39.244864+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244864+0000","last_undegraded":"2024-09-17T05:24:39.244864+0000","last_fullsized":"2024-09-17T05:24:39.244864+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243140+0000","last_change":"2024-09-17T05:24:39.243140+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243140+0000","last_undegraded":"2024-09-17T05:24:39.243140+0000","last_fullsized":"2024-09-17T05:24:39.243140+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240921+0000","last_change":"2024-09-17T05:24:39.240921+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240921+0000","last_undegraded":"2024-09-17T05:24:39.240921+0000","last_fullsized":"2024-09-17T05:24:39.240921+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242840+0000","last_change":"2024-09-17T05:24:39.242840+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242840+0000","last_undegraded":"2024-09-17T05:24:39.242840+0000","last_fullsized":"2024-09-17T05:24:39.242840+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243111+0000","last_change":"2024-09-17T05:24:39.243111+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243111+0000","last_undegraded":"2024-09-17T05:24:39.243111+0000","last_fullsized":"2024-09-17T05:24:39.243111+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245619+0000","last_change":"2024-09-17T05:24:39.245619+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245619+0000","last_undegraded":"2024-09-17T05:24:39.245619+0000","last_fullsized":"2024-09-17T05:24:39.245619+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245099+0000","last_change":"2024-09-17T05:24:39.245099+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245099+0000","last_undegraded":"2024-09-17T05:24:39.245099+0000","last_fullsized":"2024-09-17T05:24:39.245099+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240401+0000","last_change":"2024-09-17T05:24:39.240401+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240401+0000","last_undegraded":"2024-09-17T05:24:39.240401+0000","last_fullsized":"2024-09-17T05:24:39.240401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245098+0000","last_change":"2024-09-17T05:24:39.245098+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245098+0000","last_undegraded":"2024-09-17T05:24:39.245098+0000","last_fullsized":"2024-09-17T05:24:39.245098+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242827+0000","last_change":"2024-09-17T05:24:39.242827+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242827+0000","last_undegraded":"2024-09-17T05:24:39.242827+0000","last_fullsized":"2024-09-17T05:24:39.242827+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242835+0000","last_change":"2024-09-17T05:24:39.242835+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242835+0000","last_undegraded":"2024-09-17T05:24:39.242835+0000","last_fullsized":"2024-09-17T05:24:39.242835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243253+0000","last_change":"2024-09-17T05:24:39.243253+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243253+0000","last_undegraded":"2024-09-17T05:24:39.243253+0000","last_fullsized":"2024-09-17T05:24:39.243253+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242489+0000","last_change":"2024-09-17T05:24:39.242489+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242489+0000","last_undegraded":"2024-09-17T05:24:39.242489+0000","last_fullsized":"2024-09-17T05:24:39.242489+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244725+0000","last_change":"2024-09-17T05:24:39.244725+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244725+0000","last_undegraded":"2024-09-17T05:24:39.244725+0000","last_fullsized":"2024-09-17T05:24:39.244725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240722+0000","last_change":"2024-09-17T05:24:39.240722+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240722+0000","last_undegraded":"2024-09-17T05:24:39.240722+0000","last_fullsized":"2024-09-17T05:24:39.240722+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242504+0000","last_change":"2024-09-17T05:24:39.242504+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242504+0000","last_undegraded":"2024-09-17T05:24:39.242504+0000","last_fullsized":"2024-09-17T05:24:39.242504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240535+0000","last_change":"2024-09-17T05:24:39.240535+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240535+0000","last_undegraded":"2024-09-17T05:24:39.240535+0000","last_fullsized":"2024-09-17T05:24:39.240535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":322,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-17T05:24:39.246065+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:24:39.246065+0000","last_peered":"2024-09-17T05:24:39.246065+0000","last_clean":"2024-09-17T05:24:39.246065+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:24:39.246065+0000","last_undegraded":"2024-09-17T05:24:39.246065+0000","last_fullsized":"2024-09-17T05:24:39.246065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33308,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338532,"statfs":{"total":96636764160,"available":96602656768,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33316,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338524,"statfs":{"total":96636764160,"available":96602648576,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:24:44.217 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:24:44.234 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-17T05:24:44.233+0000 7f85ba524640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 -- 172.21.15.81:0/2135741816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 msgr2=0x7fb4c80d1a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/2135741816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c80d1a10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc009900 tx=0x7fb4bc02a560 comp rx=0 tx=0).stop 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 -- 172.21.15.81:0/2135741816 shutdown_connections 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/2135741816 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4c8160ac0 0x7fb4c8160f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/2135741816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c80d1a10 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 -- 172.21.15.81:0/2135741816 >> 172.21.15.81:0/2135741816 conn(0x7fb4c80d3e40 msgr2=0x7fb4c80d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 -- 172.21.15.81:0/2135741816 shutdown_connections 2024-09-17T05:24:44.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.334+0000 7fb4ccda0640 1 -- 172.21.15.81:0/2135741816 wait complete. 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 Processor -- start 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 -- start start 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c814c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4c8160ac0 0x7fb4c80b7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4c8161b30 0x7fb4c80cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c80b39e0 con 0x7fb4c80cf920 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb4c8161940 con 0x7fb4c8160ac0 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4ccda0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb4c80b3b60 con 0x7fb4c8161b30 2024-09-17T05:24:44.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c814c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4c659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c814c3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34864/0 (socket says 172.21.15.81:34864) 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.336+0000 7fb4c659c640 1 -- 172.21.15.81:0/3730757646 learned_addr learned my addr 172.21.15.81:0/3730757646 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c5d9b640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4c8160ac0 0x7fb4c80b7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c6d9d640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4c8161b30 0x7fb4c80cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c659c640 1 -- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4c8161b30 msgr2=0x7fb4c80cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c659c640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4c8161b30 0x7fb4c80cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c659c640 1 -- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4c8160ac0 msgr2=0x7fb4c80b7990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c659c640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4c8160ac0 0x7fb4c80b7990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c659c640 1 -- 172.21.15.81:0/3730757646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb4c80b8450 con 0x7fb4c80cf920 2024-09-17T05:24:44.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4c659c640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c814c3d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800b3e0 tx=0x7fb4b800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4b6ffd640 1 -- 172.21.15.81:0/3730757646 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8015020 con 0x7fb4c80cf920 2024-09-17T05:24:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4b6ffd640 1 -- 172.21.15.81:0/3730757646 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb4b8011940 con 0x7fb4c80cf920 2024-09-17T05:24:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb4c80b8730 con 0x7fb4c80cf920 2024-09-17T05:24:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4b6ffd640 1 -- 172.21.15.81:0/3730757646 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb4b8011d90 con 0x7fb4c80cf920 2024-09-17T05:24:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.337+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4c814cc70 con 0x7fb4c80cf920 2024-09-17T05:24:44.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.338+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb4c80b8970 con 0x7fb4c80cf920 2024-09-17T05:24:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.339+0000 7fb4b6ffd640 1 -- 172.21.15.81:0/3730757646 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fb4b8018020 con 0x7fb4c80cf920 2024-09-17T05:24:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.339+0000 7fb4b6ffd640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4a80791f0 0x7fb4a807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.339+0000 7fb4c5d9b640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4a80791f0 0x7fb4a807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.339+0000 7fb4b6ffd640 1 -- 172.21.15.81:0/3730757646 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fb4b809b900 con 0x7fb4c80cf920 2024-09-17T05:24:44.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.340+0000 7fb4c5d9b640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4a80791f0 0x7fb4a807b6b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc033000 tx=0x7fb4bc004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:44.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.343+0000 7fb4b6ffd640 1 -- 172.21.15.81:0/3730757646 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb4c80b8970 con 0x7fb4c80cf920 2024-09-17T05:24:44.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.518+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb4c80d1a10 con 0x7fb4a80791f0 2024-09-17T05:24:44.522 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.521+0000 7fb4b6ffd640 1 -- 172.21.15.81:0/3730757646 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240214 (secure 0 0 0) 0x7fb4c80d1a10 con 0x7fb4a80791f0 2024-09-17T05:24:44.525 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:44.526 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:24:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4a80791f0 msgr2=0x7fb4a807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4a80791f0 0x7fb4a807b6b0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb4bc033000 tx=0x7fb4bc004730 comp rx=0 tx=0).stop 2024-09-17T05:24:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 msgr2=0x7fb4c814c3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c814c3d0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7fb4b800b3e0 tx=0x7fb4b800b8a0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 shutdown_connections 2024-09-17T05:24:44.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb4c8161b30 0x7fb4c80cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb4a80791f0 0x7fb4a807b6b0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb4c8160ac0 0x7fb4c80b7990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 --2- 172.21.15.81:0/3730757646 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb4c80cf920 0x7fb4c814c3d0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.524+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 >> 172.21.15.81:0/3730757646 conn(0x7fb4c80d3e40 msgr2=0x7fb4c8161f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.525+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 shutdown_connections 2024-09-17T05:24:44.529 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.525+0000 7fb4ccda0640 1 -- 172.21.15.81:0/3730757646 wait complete. 2024-09-17T05:24:44.536 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-17T05:24:44.046151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262956,"kb_used_data":13412,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711764,"statfs":{"total":773094113280,"available":772824846336,"internally_reserved":0,"allocated":13733888,"data_stored":6680141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.807908"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245626+0000","last_change":"2024-09-17T05:24:39.245626+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245626+0000","last_undegraded":"2024-09-17T05:24:39.245626+0000","last_fullsized":"2024-09-17T05:24:39.245626+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243519+0000","last_change":"2024-09-17T05:24:39.243519+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243519+0000","last_undegraded":"2024-09-17T05:24:39.243519+0000","last_fullsized":"2024-09-17T05:24:39.243519+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240649+0000","last_change":"2024-09-17T05:24:39.240649+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240649+0000","last_undegraded":"2024-09-17T05:24:39.240649+0000","last_fullsized":"2024-09-17T05:24:39.240649+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240476+0000","last_change":"2024-09-17T05:24:39.240476+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240476+0000","last_undegraded":"2024-09-17T05:24:39.240476+0000","last_fullsized":"2024-09-17T05:24:39.240476+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241550+0000","last_change":"2024-09-17T05:24:39.241550+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241550+0000","last_undegraded":"2024-09-17T05:24:39.241550+0000","last_fullsized":"2024-09-17T05:24:39.241550+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244966+0000","last_change":"2024-09-17T05:24:39.244966+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244966+0000","last_undegraded":"2024-09-17T05:24:39.244966+0000","last_fullsized":"2024-09-17T05:24:39.244966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241139+0000","last_change":"2024-09-17T05:24:39.241139+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241139+0000","last_undegraded":"2024-09-17T05:24:39.241139+0000","last_fullsized":"2024-09-17T05:24:39.241139+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240906+0000","last_change":"2024-09-17T05:24:39.240906+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240906+0000","last_undegraded":"2024-09-17T05:24:39.240906+0000","last_fullsized":"2024-09-17T05:24:39.240906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242640+0000","last_change":"2024-09-17T05:24:39.242640+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242640+0000","last_undegraded":"2024-09-17T05:24:39.242640+0000","last_fullsized":"2024-09-17T05:24:39.242640+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245097+0000","last_change":"2024-09-17T05:24:39.245097+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245097+0000","last_undegraded":"2024-09-17T05:24:39.245097+0000","last_fullsized":"2024-09-17T05:24:39.245097+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242447+0000","last_change":"2024-09-17T05:24:39.242447+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242447+0000","last_undegraded":"2024-09-17T05:24:39.242447+0000","last_fullsized":"2024-09-17T05:24:39.242447+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240877+0000","last_change":"2024-09-17T05:24:39.240877+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240877+0000","last_undegraded":"2024-09-17T05:24:39.240877+0000","last_fullsized":"2024-09-17T05:24:39.240877+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241061+0000","last_change":"2024-09-17T05:24:39.241061+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241061+0000","last_undegraded":"2024-09-17T05:24:39.241061+0000","last_fullsized":"2024-09-17T05:24:39.241061+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244585+0000","last_change":"2024-09-17T05:24:39.244585+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244585+0000","last_undegraded":"2024-09-17T05:24:39.244585+0000","last_fullsized":"2024-09-17T05:24:39.244585+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240910+0000","last_change":"2024-09-17T05:24:39.240910+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240910+0000","last_undegraded":"2024-09-17T05:24:39.240910+0000","last_fullsized":"2024-09-17T05:24:39.240910+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244864+0000","last_change":"2024-09-17T05:24:39.244864+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244864+0000","last_undegraded":"2024-09-17T05:24:39.244864+0000","last_fullsized":"2024-09-17T05:24:39.244864+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243140+0000","last_change":"2024-09-17T05:24:39.243140+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243140+0000","last_undegraded":"2024-09-17T05:24:39.243140+0000","last_fullsized":"2024-09-17T05:24:39.243140+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240921+0000","last_change":"2024-09-17T05:24:39.240921+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240921+0000","last_undegraded":"2024-09-17T05:24:39.240921+0000","last_fullsized":"2024-09-17T05:24:39.240921+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242840+0000","last_change":"2024-09-17T05:24:39.242840+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242840+0000","last_undegraded":"2024-09-17T05:24:39.242840+0000","last_fullsized":"2024-09-17T05:24:39.242840+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243111+0000","last_change":"2024-09-17T05:24:39.243111+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243111+0000","last_undegraded":"2024-09-17T05:24:39.243111+0000","last_fullsized":"2024-09-17T05:24:39.243111+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245619+0000","last_change":"2024-09-17T05:24:39.245619+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245619+0000","last_undegraded":"2024-09-17T05:24:39.245619+0000","last_fullsized":"2024-09-17T05:24:39.245619+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245099+0000","last_change":"2024-09-17T05:24:39.245099+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245099+0000","last_undegraded":"2024-09-17T05:24:39.245099+0000","last_fullsized":"2024-09-17T05:24:39.245099+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240401+0000","last_change":"2024-09-17T05:24:39.240401+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240401+0000","last_undegraded":"2024-09-17T05:24:39.240401+0000","last_fullsized":"2024-09-17T05:24:39.240401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245098+0000","last_change":"2024-09-17T05:24:39.245098+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245098+0000","last_undegraded":"2024-09-17T05:24:39.245098+0000","last_fullsized":"2024-09-17T05:24:39.245098+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242827+0000","last_change":"2024-09-17T05:24:39.242827+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242827+0000","last_undegraded":"2024-09-17T05:24:39.242827+0000","last_fullsized":"2024-09-17T05:24:39.242827+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242835+0000","last_change":"2024-09-17T05:24:39.242835+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242835+0000","last_undegraded":"2024-09-17T05:24:39.242835+0000","last_fullsized":"2024-09-17T05:24:39.242835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243253+0000","last_change":"2024-09-17T05:24:39.243253+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243253+0000","last_undegraded":"2024-09-17T05:24:39.243253+0000","last_fullsized":"2024-09-17T05:24:39.243253+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242489+0000","last_change":"2024-09-17T05:24:39.242489+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242489+0000","last_undegraded":"2024-09-17T05:24:39.242489+0000","last_fullsized":"2024-09-17T05:24:39.242489+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244725+0000","last_change":"2024-09-17T05:24:39.244725+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244725+0000","last_undegraded":"2024-09-17T05:24:39.244725+0000","last_fullsized":"2024-09-17T05:24:39.244725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240722+0000","last_change":"2024-09-17T05:24:39.240722+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240722+0000","last_undegraded":"2024-09-17T05:24:39.240722+0000","last_fullsized":"2024-09-17T05:24:39.240722+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242504+0000","last_change":"2024-09-17T05:24:39.242504+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242504+0000","last_undegraded":"2024-09-17T05:24:39.242504+0000","last_fullsized":"2024-09-17T05:24:39.242504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240535+0000","last_change":"2024-09-17T05:24:39.240535+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240535+0000","last_undegraded":"2024-09-17T05:24:39.240535+0000","last_fullsized":"2024-09-17T05:24:39.240535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":322,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-17T05:24:39.246065+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:24:39.246065+0000","last_peered":"2024-09-17T05:24:39.246065+0000","last_clean":"2024-09-17T05:24:39.246065+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:24:39.246065+0000","last_undegraded":"2024-09-17T05:24:39.246065+0000","last_fullsized":"2024-09-17T05:24:39.246065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33308,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338532,"statfs":{"total":96636764160,"available":96602656768,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33316,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338524,"statfs":{"total":96636764160,"available":96602648576,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:24:44.540 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:24:44.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 -- 172.21.15.81:0/3010231729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c15fe60 msgr2=0x7fbb6c0ceac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 --2- 172.21.15.81:0/3010231729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c15fe60 0x7fbb6c0ceac0 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009860 tx=0x7fbb6402a540 comp rx=0 tx=0).stop 2024-09-17T05:24:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 -- 172.21.15.81:0/3010231729 shutdown_connections 2024-09-17T05:24:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 --2- 172.21.15.81:0/3010231729 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c15fe60 0x7fbb6c0ceac0 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 --2- 172.21.15.81:0/3010231729 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbb6c159680 0x7fbb6c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 -- 172.21.15.81:0/3010231729 >> 172.21.15.81:0/3010231729 conn(0x7fbb6c0b1690 msgr2=0x7fbb6c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 -- 172.21.15.81:0/3010231729 shutdown_connections 2024-09-17T05:24:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.676+0000 7fbb70df3640 1 -- 172.21.15.81:0/3010231729 wait complete. 2024-09-17T05:24:44.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.677+0000 7fbb70df3640 1 Processor -- start 2024-09-17T05:24:44.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.677+0000 7fbb70df3640 1 -- start start 2024-09-17T05:24:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb70df3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbb6c0cc490 0x7fbb6c1f62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb70df3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c159680 0x7fbb6c1f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb70df3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb6c15fe60 0x7fbb6c0af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb70df3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c0cca50 con 0x7fbb6c159680 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb70df3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbb6c0cc8d0 con 0x7fbb6c15fe60 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb70df3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbb6c0ccbd0 con 0x7fbb6c0cc490 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb69d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c159680 0x7fbb6c1f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb69d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c159680 0x7fbb6c1f6800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34878/0 (socket says 172.21.15.81:34878) 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb69d9b640 1 -- 172.21.15.81:0/297806844 learned_addr learned my addr 172.21.15.81:0/297806844 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb6a59c640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbb6c0cc490 0x7fbb6c1f62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb69d9b640 1 -- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbb6c0cc490 msgr2=0x7fbb6c1f62c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb69d9b640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbb6c0cc490 0x7fbb6c1f62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb69d9b640 1 -- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb6c15fe60 msgr2=0x7fbb6c0af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.678+0000 7fbb6ad9d640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb6c15fe60 0x7fbb6c0af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb69d9b640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb6c15fe60 0x7fbb6c0af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb69d9b640 1 -- 172.21.15.81:0/297806844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb6c1f27f0 con 0x7fbb6c159680 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb69d9b640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c159680 0x7fbb6c1f6800 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c530 tx=0x7fbb5400c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb62ffd640 1 -- 172.21.15.81:0/297806844 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54017070 con 0x7fbb6c159680 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb62ffd640 1 -- 172.21.15.81:0/297806844 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbb540035f0 con 0x7fbb6c159680 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb62ffd640 1 -- 172.21.15.81:0/297806844 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb54003a40 con 0x7fbb6c159680 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb6c1f2a90 con 0x7fbb6c159680 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.679+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb6c1f3050 con 0x7fbb6c159680 2024-09-17T05:24:44.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.680+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb6c1f3490 con 0x7fbb6c159680 2024-09-17T05:24:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.680+0000 7fbb62ffd640 1 -- 172.21.15.81:0/297806844 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fbb5401a070 con 0x7fbb6c159680 2024-09-17T05:24:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.681+0000 7fbb62ffd640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbb4c0791c0 0x7fbb4c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.681+0000 7fbb62ffd640 1 -- 172.21.15.81:0/297806844 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fbb5409ad70 con 0x7fbb6c159680 2024-09-17T05:24:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.681+0000 7fbb6a59c640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbb4c0791c0 0x7fbb4c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:44.683 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.681+0000 7fbb6a59c640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbb4c0791c0 0x7fbb4c07b680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c005c40 tx=0x7fbb5c005bd0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:44.686 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.685+0000 7fbb62ffd640 1 -- 172.21.15.81:0/297806844 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbb54062830 con 0x7fbb6c159680 2024-09-17T05:24:44.857 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.856+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbb6c0ceac0 con 0x7fbb4c0791c0 2024-09-17T05:24:44.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.860+0000 7fbb62ffd640 1 -- 172.21.15.81:0/297806844 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240214 (secure 0 0 0) 0x7fbb6c0ceac0 con 0x7fbb4c0791c0 2024-09-17T05:24:44.863 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:44.865 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:24:44.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbb4c0791c0 msgr2=0x7fbb4c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbb4c0791c0 0x7fbb4c07b680 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fbb5c005c40 tx=0x7fbb5c005bd0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c159680 msgr2=0x7fbb6c1f6800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c159680 0x7fbb6c1f6800 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fbb5400c530 tx=0x7fbb5400c9f0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 shutdown_connections 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbb4c0791c0 0x7fbb4c07b680 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbb6c15fe60 0x7fbb6c0af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbb6c159680 0x7fbb6c1f6800 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 --2- 172.21.15.81:0/297806844 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbb6c0cc490 0x7fbb6c1f62c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 >> 172.21.15.81:0/297806844 conn(0x7fbb6c0b1690 msgr2=0x7fbb6c15db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 shutdown_connections 2024-09-17T05:24:44.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:44.863+0000 7fbb70df3640 1 -- 172.21.15.81:0/297806844 wait complete. 2024-09-17T05:24:44.875 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-17T05:24:44.046151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262956,"kb_used_data":13412,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711764,"statfs":{"total":773094113280,"available":772824846336,"internally_reserved":0,"allocated":13733888,"data_stored":6680141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.807908"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245626+0000","last_change":"2024-09-17T05:24:39.245626+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245626+0000","last_undegraded":"2024-09-17T05:24:39.245626+0000","last_fullsized":"2024-09-17T05:24:39.245626+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243519+0000","last_change":"2024-09-17T05:24:39.243519+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243519+0000","last_undegraded":"2024-09-17T05:24:39.243519+0000","last_fullsized":"2024-09-17T05:24:39.243519+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240649+0000","last_change":"2024-09-17T05:24:39.240649+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240649+0000","last_undegraded":"2024-09-17T05:24:39.240649+0000","last_fullsized":"2024-09-17T05:24:39.240649+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240476+0000","last_change":"2024-09-17T05:24:39.240476+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240476+0000","last_undegraded":"2024-09-17T05:24:39.240476+0000","last_fullsized":"2024-09-17T05:24:39.240476+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241550+0000","last_change":"2024-09-17T05:24:39.241550+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241550+0000","last_undegraded":"2024-09-17T05:24:39.241550+0000","last_fullsized":"2024-09-17T05:24:39.241550+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244966+0000","last_change":"2024-09-17T05:24:39.244966+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244966+0000","last_undegraded":"2024-09-17T05:24:39.244966+0000","last_fullsized":"2024-09-17T05:24:39.244966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241139+0000","last_change":"2024-09-17T05:24:39.241139+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241139+0000","last_undegraded":"2024-09-17T05:24:39.241139+0000","last_fullsized":"2024-09-17T05:24:39.241139+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240906+0000","last_change":"2024-09-17T05:24:39.240906+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240906+0000","last_undegraded":"2024-09-17T05:24:39.240906+0000","last_fullsized":"2024-09-17T05:24:39.240906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242640+0000","last_change":"2024-09-17T05:24:39.242640+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242640+0000","last_undegraded":"2024-09-17T05:24:39.242640+0000","last_fullsized":"2024-09-17T05:24:39.242640+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245097+0000","last_change":"2024-09-17T05:24:39.245097+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245097+0000","last_undegraded":"2024-09-17T05:24:39.245097+0000","last_fullsized":"2024-09-17T05:24:39.245097+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242447+0000","last_change":"2024-09-17T05:24:39.242447+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242447+0000","last_undegraded":"2024-09-17T05:24:39.242447+0000","last_fullsized":"2024-09-17T05:24:39.242447+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240877+0000","last_change":"2024-09-17T05:24:39.240877+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240877+0000","last_undegraded":"2024-09-17T05:24:39.240877+0000","last_fullsized":"2024-09-17T05:24:39.240877+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241061+0000","last_change":"2024-09-17T05:24:39.241061+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241061+0000","last_undegraded":"2024-09-17T05:24:39.241061+0000","last_fullsized":"2024-09-17T05:24:39.241061+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244585+0000","last_change":"2024-09-17T05:24:39.244585+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244585+0000","last_undegraded":"2024-09-17T05:24:39.244585+0000","last_fullsized":"2024-09-17T05:24:39.244585+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240910+0000","last_change":"2024-09-17T05:24:39.240910+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240910+0000","last_undegraded":"2024-09-17T05:24:39.240910+0000","last_fullsized":"2024-09-17T05:24:39.240910+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244864+0000","last_change":"2024-09-17T05:24:39.244864+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244864+0000","last_undegraded":"2024-09-17T05:24:39.244864+0000","last_fullsized":"2024-09-17T05:24:39.244864+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243140+0000","last_change":"2024-09-17T05:24:39.243140+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243140+0000","last_undegraded":"2024-09-17T05:24:39.243140+0000","last_fullsized":"2024-09-17T05:24:39.243140+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240921+0000","last_change":"2024-09-17T05:24:39.240921+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240921+0000","last_undegraded":"2024-09-17T05:24:39.240921+0000","last_fullsized":"2024-09-17T05:24:39.240921+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242840+0000","last_change":"2024-09-17T05:24:39.242840+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242840+0000","last_undegraded":"2024-09-17T05:24:39.242840+0000","last_fullsized":"2024-09-17T05:24:39.242840+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243111+0000","last_change":"2024-09-17T05:24:39.243111+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243111+0000","last_undegraded":"2024-09-17T05:24:39.243111+0000","last_fullsized":"2024-09-17T05:24:39.243111+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245619+0000","last_change":"2024-09-17T05:24:39.245619+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245619+0000","last_undegraded":"2024-09-17T05:24:39.245619+0000","last_fullsized":"2024-09-17T05:24:39.245619+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245099+0000","last_change":"2024-09-17T05:24:39.245099+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245099+0000","last_undegraded":"2024-09-17T05:24:39.245099+0000","last_fullsized":"2024-09-17T05:24:39.245099+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240401+0000","last_change":"2024-09-17T05:24:39.240401+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240401+0000","last_undegraded":"2024-09-17T05:24:39.240401+0000","last_fullsized":"2024-09-17T05:24:39.240401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245098+0000","last_change":"2024-09-17T05:24:39.245098+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245098+0000","last_undegraded":"2024-09-17T05:24:39.245098+0000","last_fullsized":"2024-09-17T05:24:39.245098+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242827+0000","last_change":"2024-09-17T05:24:39.242827+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242827+0000","last_undegraded":"2024-09-17T05:24:39.242827+0000","last_fullsized":"2024-09-17T05:24:39.242827+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242835+0000","last_change":"2024-09-17T05:24:39.242835+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242835+0000","last_undegraded":"2024-09-17T05:24:39.242835+0000","last_fullsized":"2024-09-17T05:24:39.242835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243253+0000","last_change":"2024-09-17T05:24:39.243253+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243253+0000","last_undegraded":"2024-09-17T05:24:39.243253+0000","last_fullsized":"2024-09-17T05:24:39.243253+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242489+0000","last_change":"2024-09-17T05:24:39.242489+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242489+0000","last_undegraded":"2024-09-17T05:24:39.242489+0000","last_fullsized":"2024-09-17T05:24:39.242489+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244725+0000","last_change":"2024-09-17T05:24:39.244725+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244725+0000","last_undegraded":"2024-09-17T05:24:39.244725+0000","last_fullsized":"2024-09-17T05:24:39.244725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240722+0000","last_change":"2024-09-17T05:24:39.240722+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240722+0000","last_undegraded":"2024-09-17T05:24:39.240722+0000","last_fullsized":"2024-09-17T05:24:39.240722+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242504+0000","last_change":"2024-09-17T05:24:39.242504+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242504+0000","last_undegraded":"2024-09-17T05:24:39.242504+0000","last_fullsized":"2024-09-17T05:24:39.242504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240535+0000","last_change":"2024-09-17T05:24:39.240535+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240535+0000","last_undegraded":"2024-09-17T05:24:39.240535+0000","last_fullsized":"2024-09-17T05:24:39.240535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":322,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-17T05:24:39.246065+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:24:39.246065+0000","last_peered":"2024-09-17T05:24:39.246065+0000","last_clean":"2024-09-17T05:24:39.246065+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:24:39.246065+0000","last_undegraded":"2024-09-17T05:24:39.246065+0000","last_fullsized":"2024-09-17T05:24:39.246065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33308,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338532,"statfs":{"total":96636764160,"available":96602656768,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33316,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338524,"statfs":{"total":96636764160,"available":96602648576,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3f is not active+clean 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3e is not active+clean 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3d is not active+clean 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3c is not active+clean 2024-09-17T05:24:44.879 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3b is not active+clean 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3a is not active+clean 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:PG 21.39 is not active+clean 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:PG 21.38 is not active+clean 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:PG 21.37 is not active+clean 2024-09-17T05:24:44.880 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.36 is not active+clean 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.35 is not active+clean 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.34 is not active+clean 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.33 is not active+clean 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:PG 21.32 is not active+clean 2024-09-17T05:24:44.881 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:PG 21.31 is not active+clean 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:PG 21.30 is not active+clean 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2f is not active+clean 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2e is not active+clean 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2d is not active+clean 2024-09-17T05:24:44.882 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2c is not active+clean 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2b is not active+clean 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2a is not active+clean 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:PG 21.29 is not active+clean 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:PG 21.28 is not active+clean 2024-09-17T05:24:44.883 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:PG 21.27 is not active+clean 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:PG 21.26 is not active+clean 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:PG 21.25 is not active+clean 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:PG 21.24 is not active+clean 2024-09-17T05:24:44.884 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:PG 21.23 is not active+clean 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:PG 21.22 is not active+clean 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:PG 21.21 is not active+clean 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:PG 21.20 is not active+clean 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1e is not active+clean 2024-09-17T05:24:44.885 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1f is not active+clean 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.245626+0000', 'last_change': '2024-09-17T05:24:39.245626+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.245626+0000', 'last_undegraded': '2024-09-17T05:24:39.245626+0000', 'last_fullsized': '2024-09-17T05:24:39.245626+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1f is not active+clean 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1e is not active+clean 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.243519+0000', 'last_change': '2024-09-17T05:24:39.243519+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.243519+0000', 'last_undegraded': '2024-09-17T05:24:39.243519+0000', 'last_fullsized': '2024-09-17T05:24:39.243519+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1c is not active+clean 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1d is not active+clean 2024-09-17T05:24:44.886 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240649+0000', 'last_change': '2024-09-17T05:24:39.240649+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240649+0000', 'last_undegraded': '2024-09-17T05:24:39.240649+0000', 'last_fullsized': '2024-09-17T05:24:39.240649+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1d is not active+clean 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1c is not active+clean 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240476+0000', 'last_change': '2024-09-17T05:24:39.240476+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240476+0000', 'last_undegraded': '2024-09-17T05:24:39.240476+0000', 'last_fullsized': '2024-09-17T05:24:39.240476+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1a is not active+clean 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1b is not active+clean 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.241550+0000', 'last_change': '2024-09-17T05:24:39.241550+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.241550+0000', 'last_undegraded': '2024-09-17T05:24:39.241550+0000', 'last_fullsized': '2024-09-17T05:24:39.241550+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:24:44.887 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1b is not active+clean 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1a is not active+clean 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.244966+0000', 'last_change': '2024-09-17T05:24:39.244966+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.244966+0000', 'last_undegraded': '2024-09-17T05:24:39.244966+0000', 'last_fullsized': '2024-09-17T05:24:39.244966+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:PG 21.18 is not active+clean 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:PG 20.19 is not active+clean 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.241139+0000', 'last_change': '2024-09-17T05:24:39.241139+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.241139+0000', 'last_undegraded': '2024-09-17T05:24:39.241139+0000', 'last_fullsized': '2024-09-17T05:24:39.241139+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:PG 21.19 is not active+clean 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:PG 20.18 is not active+clean 2024-09-17T05:24:44.888 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240906+0000', 'last_change': '2024-09-17T05:24:39.240906+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240906+0000', 'last_undegraded': '2024-09-17T05:24:39.240906+0000', 'last_fullsized': '2024-09-17T05:24:39.240906+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:PG 21.16 is not active+clean 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:PG 20.17 is not active+clean 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.242640+0000', 'last_change': '2024-09-17T05:24:39.242640+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.242640+0000', 'last_undegraded': '2024-09-17T05:24:39.242640+0000', 'last_fullsized': '2024-09-17T05:24:39.242640+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:PG 21.17 is not active+clean 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:PG 20.16 is not active+clean 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.245097+0000', 'last_change': '2024-09-17T05:24:39.245097+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.245097+0000', 'last_undegraded': '2024-09-17T05:24:39.245097+0000', 'last_fullsized': '2024-09-17T05:24:39.245097+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:PG 21.15 is not active+clean 2024-09-17T05:24:44.889 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:PG 20.14 is not active+clean 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.242447+0000', 'last_change': '2024-09-17T05:24:39.242447+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.242447+0000', 'last_undegraded': '2024-09-17T05:24:39.242447+0000', 'last_fullsized': '2024-09-17T05:24:39.242447+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:PG 21.12 is not active+clean 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:PG 20.13 is not active+clean 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240877+0000', 'last_change': '2024-09-17T05:24:39.240877+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240877+0000', 'last_undegraded': '2024-09-17T05:24:39.240877+0000', 'last_fullsized': '2024-09-17T05:24:39.240877+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:PG 21.13 is not active+clean 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.890 INFO:tasks.ceph.ceph_manager.ceph:PG 20.12 is not active+clean 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.241061+0000', 'last_change': '2024-09-17T05:24:39.241061+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.241061+0000', 'last_undegraded': '2024-09-17T05:24:39.241061+0000', 'last_fullsized': '2024-09-17T05:24:39.241061+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:PG 21.10 is not active+clean 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:PG 20.11 is not active+clean 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.244585+0000', 'last_change': '2024-09-17T05:24:39.244585+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.244585+0000', 'last_undegraded': '2024-09-17T05:24:39.244585+0000', 'last_fullsized': '2024-09-17T05:24:39.244585+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:PG 21.11 is not active+clean 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:PG 20.10 is not active+clean 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240910+0000', 'last_change': '2024-09-17T05:24:39.240910+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240910+0000', 'last_undegraded': '2024-09-17T05:24:39.240910+0000', 'last_fullsized': '2024-09-17T05:24:39.240910+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:PG 21.e is not active+clean 2024-09-17T05:24:44.891 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.892 INFO:tasks.ceph.ceph_manager.ceph:PG 20.f is not active+clean 2024-09-17T05:24:44.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.244864+0000', 'last_change': '2024-09-17T05:24:39.244864+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.244864+0000', 'last_undegraded': '2024-09-17T05:24:39.244864+0000', 'last_fullsized': '2024-09-17T05:24:39.244864+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:24:44.892 INFO:tasks.ceph.ceph_manager.ceph:PG 21.f is not active+clean 2024-09-17T05:24:44.892 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.893 INFO:tasks.ceph.ceph_manager.ceph:PG 20.e is not active+clean 2024-09-17T05:24:44.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.243140+0000', 'last_change': '2024-09-17T05:24:39.243140+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.243140+0000', 'last_undegraded': '2024-09-17T05:24:39.243140+0000', 'last_fullsized': '2024-09-17T05:24:39.243140+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:24:44.893 INFO:tasks.ceph.ceph_manager.ceph:PG 21.c is not active+clean 2024-09-17T05:24:44.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.893 INFO:tasks.ceph.ceph_manager.ceph:PG 20.d is not active+clean 2024-09-17T05:24:44.893 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240921+0000', 'last_change': '2024-09-17T05:24:39.240921+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240921+0000', 'last_undegraded': '2024-09-17T05:24:39.240921+0000', 'last_fullsized': '2024-09-17T05:24:39.240921+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:PG 21.d is not active+clean 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:PG 20.c is not active+clean 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.242840+0000', 'last_change': '2024-09-17T05:24:39.242840+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.242840+0000', 'last_undegraded': '2024-09-17T05:24:39.242840+0000', 'last_fullsized': '2024-09-17T05:24:39.242840+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:PG 21.a is not active+clean 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:PG 20.b is not active+clean 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.243111+0000', 'last_change': '2024-09-17T05:24:39.243111+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.243111+0000', 'last_undegraded': '2024-09-17T05:24:39.243111+0000', 'last_fullsized': '2024-09-17T05:24:39.243111+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:PG 21.b is not active+clean 2024-09-17T05:24:44.894 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.895 INFO:tasks.ceph.ceph_manager.ceph:PG 20.a is not active+clean 2024-09-17T05:24:44.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.245619+0000', 'last_change': '2024-09-17T05:24:39.245619+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.245619+0000', 'last_undegraded': '2024-09-17T05:24:39.245619+0000', 'last_fullsized': '2024-09-17T05:24:39.245619+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:24:44.895 INFO:tasks.ceph.ceph_manager.ceph:PG 21.8 is not active+clean 2024-09-17T05:24:44.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.895 INFO:tasks.ceph.ceph_manager.ceph:PG 20.9 is not active+clean 2024-09-17T05:24:44.895 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.245099+0000', 'last_change': '2024-09-17T05:24:39.245099+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.245099+0000', 'last_undegraded': '2024-09-17T05:24:39.245099+0000', 'last_fullsized': '2024-09-17T05:24:39.245099+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:PG 21.9 is not active+clean 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:PG 20.8 is not active+clean 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240401+0000', 'last_change': '2024-09-17T05:24:39.240401+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240401+0000', 'last_undegraded': '2024-09-17T05:24:39.240401+0000', 'last_fullsized': '2024-09-17T05:24:39.240401+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:PG 21.6 is not active+clean 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:PG 20.7 is not active+clean 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.245098+0000', 'last_change': '2024-09-17T05:24:39.245098+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.245098+0000', 'last_undegraded': '2024-09-17T05:24:39.245098+0000', 'last_fullsized': '2024-09-17T05:24:39.245098+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:PG 21.7 is not active+clean 2024-09-17T05:24:44.896 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.897 INFO:tasks.ceph.ceph_manager.ceph:PG 20.6 is not active+clean 2024-09-17T05:24:44.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.242827+0000', 'last_change': '2024-09-17T05:24:39.242827+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.242827+0000', 'last_undegraded': '2024-09-17T05:24:39.242827+0000', 'last_fullsized': '2024-09-17T05:24:39.242827+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:24:44.897 INFO:tasks.ceph.ceph_manager.ceph:PG 21.4 is not active+clean 2024-09-17T05:24:44.897 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:PG 20.5 is not active+clean 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.242835+0000', 'last_change': '2024-09-17T05:24:39.242835+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.242835+0000', 'last_undegraded': '2024-09-17T05:24:39.242835+0000', 'last_fullsized': '2024-09-17T05:24:39.242835+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:PG 21.5 is not active+clean 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:PG 20.4 is not active+clean 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.243253+0000', 'last_change': '2024-09-17T05:24:39.243253+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.243253+0000', 'last_undegraded': '2024-09-17T05:24:39.243253+0000', 'last_fullsized': '2024-09-17T05:24:39.243253+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:PG 21.2 is not active+clean 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:PG 20.3 is not active+clean 2024-09-17T05:24:44.898 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.242489+0000', 'last_change': '2024-09-17T05:24:39.242489+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.242489+0000', 'last_undegraded': '2024-09-17T05:24:39.242489+0000', 'last_fullsized': '2024-09-17T05:24:39.242489+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:24:44.899 INFO:tasks.ceph.ceph_manager.ceph:PG 21.3 is not active+clean 2024-09-17T05:24:44.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.899 INFO:tasks.ceph.ceph_manager.ceph:PG 20.2 is not active+clean 2024-09-17T05:24:44.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.244725+0000', 'last_change': '2024-09-17T05:24:39.244725+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.244725+0000', 'last_undegraded': '2024-09-17T05:24:39.244725+0000', 'last_fullsized': '2024-09-17T05:24:39.244725+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:24:44.899 INFO:tasks.ceph.ceph_manager.ceph:PG 21.0 is not active+clean 2024-09-17T05:24:44.899 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:PG 20.1 is not active+clean 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240722+0000', 'last_change': '2024-09-17T05:24:39.240722+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240722+0000', 'last_undegraded': '2024-09-17T05:24:39.240722+0000', 'last_fullsized': '2024-09-17T05:24:39.240722+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:PG 21.1 is not active+clean 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:PG 20.0 is not active+clean 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.242504+0000', 'last_change': '2024-09-17T05:24:39.242504+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.242504+0000', 'last_undegraded': '2024-09-17T05:24:39.242504+0000', 'last_fullsized': '2024-09-17T05:24:39.242504+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:PG 21.14 is not active+clean 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2024-09-17T05:24:40.238234+0000', 'last_change': '2024-09-17T05:24:40.238234+0000', 'last_active': '2024-09-17T05:24:40.238234+0000', 'last_peered': '2024-09-17T05:24:40.238234+0000', 'last_clean': '2024-09-17T05:24:40.238234+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:40.238234+0000', 'last_undegraded': '2024-09-17T05:24:40.238234+0000', 'last_fullsized': '2024-09-17T05:24:40.238234+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:40.238234+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2024-09-17T05:24:44.900 INFO:tasks.ceph.ceph_manager.ceph:PG 20.15 is not active+clean 2024-09-17T05:24:44.901 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 126, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:24:39.240535+0000', 'last_change': '2024-09-17T05:24:39.240535+0000', 'last_active': '2024-09-17T05:24:39.234195+0000', 'last_peered': '2024-09-17T05:24:39.234195+0000', 'last_clean': '2024-09-17T05:24:39.234195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:24:39.240535+0000', 'last_undegraded': '2024-09-17T05:24:39.240535+0000', 'last_fullsized': '2024-09-17T05:24:39.240535+0000', 'mapping_epoch': 126, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 126, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'last_clean_scrub_stamp': '2024-09-17T05:24:39.234195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:24:44.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:24:45.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.016+0000 7f94ad517640 1 -- 172.21.15.81:0/3773220826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 msgr2=0x7f9494004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.016+0000 7f94ad517640 1 --2- 172.21.15.81:0/3773220826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f9494004c80 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f9490009b50 tx=0x7f9494005830 comp rx=0 tx=0).stop 2024-09-17T05:24:45.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.016+0000 7f94ad517640 1 -- 172.21.15.81:0/3773220826 shutdown_connections 2024-09-17T05:24:45.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.016+0000 7f94ad517640 1 --2- 172.21.15.81:0/3773220826 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f9494004c80 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.016+0000 7f94ad517640 1 -- 172.21.15.81:0/3773220826 >> 172.21.15.81:0/3773220826 conn(0x7f94a8074cb0 msgr2=0x7f94a809b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:45.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.016+0000 7f94ad517640 1 -- 172.21.15.81:0/3773220826 shutdown_connections 2024-09-17T05:24:45.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.016+0000 7f94ad517640 1 -- 172.21.15.81:0/3773220826 wait complete. 2024-09-17T05:24:45.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.017+0000 7f94ad517640 1 Processor -- start 2024-09-17T05:24:45.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.017+0000 7f94ad517640 1 -- start start 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94ad517640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f94a81f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94ad517640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b06d0 0x7f94a81f29b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94ad517640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a80b0b30 0x7f94a81f2ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94ad517640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f94a80cdc40 con 0x7f9494004800 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94ad517640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f94a80cdac0 con 0x7f94a80b06d0 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94ad517640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f94a80d2170 con 0x7f94a80b0b30 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f94a81f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f94a81f6210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34896/0 (socket says 172.21.15.81:34896) 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 -- 172.21.15.81:0/1451534536 learned_addr learned my addr 172.21.15.81:0/1451534536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a77fe640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a80b0b30 0x7f94a81f2ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f949ffff640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b06d0 0x7f94a81f29b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 -- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a80b0b30 msgr2=0x7f94a81f2ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a80b0b30 0x7f94a81f2ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 -- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b06d0 msgr2=0x7f94a81f29b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b06d0 0x7f94a81f29b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a6ffd640 1 -- 172.21.15.81:0/1451534536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94a80af690 con 0x7f9494004800 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.018+0000 7f94a77fe640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a80b0b30 0x7f94a81f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.019+0000 7f94a6ffd640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f94a81f6210 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f9498004d90 tx=0x7f9498001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.019+0000 7f949f7fe640 1 -- 172.21.15.81:0/1451534536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9498017070 con 0x7f9494004800 2024-09-17T05:24:45.023 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.019+0000 7f949f7fe640 1 -- 172.21.15.81:0/1451534536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f94980108c0 con 0x7f9494004800 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.019+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94a80af930 con 0x7f9494004800 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.019+0000 7f949f7fe640 1 -- 172.21.15.81:0/1451534536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9498001d40 con 0x7f9494004800 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.019+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94a80afef0 con 0x7f9494004800 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.020+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94a80d26d0 con 0x7f9494004800 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.020+0000 7f949f7fe640 1 -- 172.21.15.81:0/1451534536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f949801a070 con 0x7f9494004800 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.021+0000 7f949f7fe640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f94880791f0 0x7f948807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.021+0000 7f949ffff640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f94880791f0 0x7f948807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.021+0000 7f949f7fe640 1 -- 172.21.15.81:0/1451534536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f949809b620 con 0x7f9494004800 2024-09-17T05:24:45.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.021+0000 7f949ffff640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f94880791f0 0x7f948807b6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9490035000 tx=0x7f94900046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:45.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.025+0000 7f949f7fe640 1 -- 172.21.15.81:0/1451534536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f94980630e0 con 0x7f9494004800 2024-09-17T05:24:45.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.273+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7f94a815d410 con 0x7f9494004800 2024-09-17T05:24:45.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.274+0000 7f949f7fe640 1 -- 172.21.15.81:0/1451534536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1574 (secure 0 0 0) 0x7f94980629e0 con 0x7f9494004800 2024-09-17T05:24:45.275 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:45.275 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":382,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":129,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550316,"num_in_osds":8,"osd_in_since":1726550306,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":269266944,"bytes_avail":772824846336,"bytes_total":773094113280,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":76,"btime":"2024-09-17T05:24:43:251755+0000","id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"c","status":"up:active","gid":7917}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":13,"modified":"2024-09-17T05:24:32.044112+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:24:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f94880791f0 msgr2=0x7f948807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f94880791f0 0x7f948807b6b0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f9490035000 tx=0x7f94900046c0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 msgr2=0x7f94a81f6210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f94a81f6210 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f9498004d90 tx=0x7f9498001630 comp rx=0 tx=0).stop 2024-09-17T05:24:45.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 shutdown_connections 2024-09-17T05:24:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94a80b0b30 0x7f94a81f2ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f94880791f0 0x7f948807b6b0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f94a80b06d0 0x7f94a81f29b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 --2- 172.21.15.81:0/1451534536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9494004800 0x7f94a81f6210 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 >> 172.21.15.81:0/1451534536 conn(0x7f94a8074cb0 msgr2=0x7f94a8070810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 shutdown_connections 2024-09-17T05:24:45.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.276+0000 7f94ad517640 1 -- 172.21.15.81:0/1451534536 wait complete. 2024-09-17T05:24:45.288 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:24:45.288 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:24:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.389+0000 7f40ebcf7640 1 -- 172.21.15.81:0/3704104694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 msgr2=0x7f40d0005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.389+0000 7f40ebcf7640 1 --2- 172.21.15.81:0/3704104694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 0x7f40d0005910 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f40d400c2e0 tx=0x7f40d0006940 comp rx=0 tx=0).stop 2024-09-17T05:24:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.389+0000 7f40ea294640 1 -- 172.21.15.81:0/3704104694 reap_dead start 2024-09-17T05:24:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.389+0000 7f40ebcf7640 1 -- 172.21.15.81:0/3704104694 shutdown_connections 2024-09-17T05:24:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.389+0000 7f40ebcf7640 1 -- 172.21.15.81:0/3704104694 >> 172.21.15.81:0/3704104694 conn(0x7f40e40b1690 msgr2=0x7f40e40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.389+0000 7f40ebcf7640 1 -- 172.21.15.81:0/3704104694 shutdown_connections 2024-09-17T05:24:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.389+0000 7f40ebcf7640 1 -- 172.21.15.81:0/3704104694 wait complete. 2024-09-17T05:24:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.390+0000 7f40ebcf7640 1 Processor -- start 2024-09-17T05:24:45.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ebcf7640 1 -- start start 2024-09-17T05:24:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ebcf7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 0x7f40e4142a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ebcf7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40e40cfe40 0x7f40e40d02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ebcf7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40e41ef6a0 0x7f40e41efb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ebcf7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40e406fb90 con 0x7f40d0005080 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ebcf7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f40e406fa10 con 0x7f40e41ef6a0 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ebcf7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f40e406fd10 con 0x7f40e40cfe40 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40e9a93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 0x7f40e4142a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40e9a93640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 0x7f40e4142a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34904/0 (socket says 172.21.15.81:34904) 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40e9a93640 1 -- 172.21.15.81:0/998081048 learned_addr learned my addr 172.21.15.81:0/998081048 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40ea294640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40e41ef6a0 0x7f40e41efb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.391+0000 7f40e9292640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40e40cfe40 0x7f40e40d02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40e9a93640 1 -- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40e40cfe40 msgr2=0x7f40e40d02c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40e9a93640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40e40cfe40 0x7f40e40d02c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40e9a93640 1 -- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40e41ef6a0 msgr2=0x7f40e41efb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40e9a93640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40e41ef6a0 0x7f40e41efb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40e9a93640 1 -- 172.21.15.81:0/998081048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e40d0800 con 0x7f40d0005080 2024-09-17T05:24:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40e9a93640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 0x7f40e4142a10 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f40e0003ed0 tx=0x7f40e0001730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40da7fc640 1 -- 172.21.15.81:0/998081048 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0015070 con 0x7f40d0005080 2024-09-17T05:24:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40da7fc640 1 -- 172.21.15.81:0/998081048 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40e0011920 con 0x7f40d0005080 2024-09-17T05:24:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40da7fc640 1 -- 172.21.15.81:0/998081048 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40e0011d70 con 0x7f40d0005080 2024-09-17T05:24:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e41f08c0 con 0x7f40d0005080 2024-09-17T05:24:45.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.392+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e41f0e80 con 0x7f40d0005080 2024-09-17T05:24:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.393+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40e413f290 con 0x7f40d0005080 2024-09-17T05:24:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.394+0000 7f40da7fc640 1 -- 172.21.15.81:0/998081048 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f40e0018070 con 0x7f40d0005080 2024-09-17T05:24:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.394+0000 7f40da7fc640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f40c80791c0 0x7f40c807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.394+0000 7f40e9292640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f40c80791c0 0x7f40c807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.395+0000 7f40da7fc640 1 -- 172.21.15.81:0/998081048 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f40e009c1d0 con 0x7f40d0005080 2024-09-17T05:24:45.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.395+0000 7f40e9292640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f40c80791c0 0x7f40c807b680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f40d4033000 tx=0x7f40d403b040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:45.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.399+0000 7f40da7fc640 1 -- 172.21.15.81:0/998081048 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f40e00636b0 con 0x7f40d0005080 2024-09-17T05:24:45.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.573+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f40e40b4160 con 0x7f40c80791c0 2024-09-17T05:24:45.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.577+0000 7f40da7fc640 1 -- 172.21.15.81:0/998081048 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+240214 (secure 0 0 0) 0x7f40e40b4160 con 0x7f40c80791c0 2024-09-17T05:24:45.580 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:45.581 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:24:45.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f40c80791c0 msgr2=0x7f40c807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f40c80791c0 0x7f40c807b680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f40d4033000 tx=0x7f40d403b040 comp rx=0 tx=0).stop 2024-09-17T05:24:45.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 msgr2=0x7f40e4142a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:45.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 0x7f40e4142a10 secure :-1 s=READY pgs=1377 cs=0 l=1 rev1=1 crypto rx=0x7f40e0003ed0 tx=0x7f40e0001730 comp rx=0 tx=0).stop 2024-09-17T05:24:45.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 shutdown_connections 2024-09-17T05:24:45.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f40c80791c0 0x7f40c807b680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40e41ef6a0 0x7f40e41efb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40e40cfe40 0x7f40e40d02c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 --2- 172.21.15.81:0/998081048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40d0005080 0x7f40e4142a10 unknown :-1 s=CLOSED pgs=1377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:45.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 >> 172.21.15.81:0/998081048 conn(0x7f40e40b1690 msgr2=0x7f40e40b2990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:45.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 shutdown_connections 2024-09-17T05:24:45.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:45.580+0000 7f40ebcf7640 1 -- 172.21.15.81:0/998081048 wait complete. 2024-09-17T05:24:45.592 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-09-17T05:24:44.046151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":262956,"kb_used_data":13412,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711764,"statfs":{"total":773094113280,"available":772824846336,"internally_reserved":0,"allocated":13733888,"data_stored":6680141,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.807908"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245626+0000","last_change":"2024-09-17T05:24:39.245626+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245626+0000","last_undegraded":"2024-09-17T05:24:39.245626+0000","last_fullsized":"2024-09-17T05:24:39.245626+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243519+0000","last_change":"2024-09-17T05:24:39.243519+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243519+0000","last_undegraded":"2024-09-17T05:24:39.243519+0000","last_fullsized":"2024-09-17T05:24:39.243519+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240649+0000","last_change":"2024-09-17T05:24:39.240649+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240649+0000","last_undegraded":"2024-09-17T05:24:39.240649+0000","last_fullsized":"2024-09-17T05:24:39.240649+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240476+0000","last_change":"2024-09-17T05:24:39.240476+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240476+0000","last_undegraded":"2024-09-17T05:24:39.240476+0000","last_fullsized":"2024-09-17T05:24:39.240476+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241550+0000","last_change":"2024-09-17T05:24:39.241550+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241550+0000","last_undegraded":"2024-09-17T05:24:39.241550+0000","last_fullsized":"2024-09-17T05:24:39.241550+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244966+0000","last_change":"2024-09-17T05:24:39.244966+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244966+0000","last_undegraded":"2024-09-17T05:24:39.244966+0000","last_fullsized":"2024-09-17T05:24:39.244966+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241139+0000","last_change":"2024-09-17T05:24:39.241139+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241139+0000","last_undegraded":"2024-09-17T05:24:39.241139+0000","last_fullsized":"2024-09-17T05:24:39.241139+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240906+0000","last_change":"2024-09-17T05:24:39.240906+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240906+0000","last_undegraded":"2024-09-17T05:24:39.240906+0000","last_fullsized":"2024-09-17T05:24:39.240906+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242640+0000","last_change":"2024-09-17T05:24:39.242640+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242640+0000","last_undegraded":"2024-09-17T05:24:39.242640+0000","last_fullsized":"2024-09-17T05:24:39.242640+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245097+0000","last_change":"2024-09-17T05:24:39.245097+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245097+0000","last_undegraded":"2024-09-17T05:24:39.245097+0000","last_fullsized":"2024-09-17T05:24:39.245097+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242447+0000","last_change":"2024-09-17T05:24:39.242447+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242447+0000","last_undegraded":"2024-09-17T05:24:39.242447+0000","last_fullsized":"2024-09-17T05:24:39.242447+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240877+0000","last_change":"2024-09-17T05:24:39.240877+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240877+0000","last_undegraded":"2024-09-17T05:24:39.240877+0000","last_fullsized":"2024-09-17T05:24:39.240877+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.241061+0000","last_change":"2024-09-17T05:24:39.241061+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.241061+0000","last_undegraded":"2024-09-17T05:24:39.241061+0000","last_fullsized":"2024-09-17T05:24:39.241061+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244585+0000","last_change":"2024-09-17T05:24:39.244585+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244585+0000","last_undegraded":"2024-09-17T05:24:39.244585+0000","last_fullsized":"2024-09-17T05:24:39.244585+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240910+0000","last_change":"2024-09-17T05:24:39.240910+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240910+0000","last_undegraded":"2024-09-17T05:24:39.240910+0000","last_fullsized":"2024-09-17T05:24:39.240910+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244864+0000","last_change":"2024-09-17T05:24:39.244864+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244864+0000","last_undegraded":"2024-09-17T05:24:39.244864+0000","last_fullsized":"2024-09-17T05:24:39.244864+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243140+0000","last_change":"2024-09-17T05:24:39.243140+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243140+0000","last_undegraded":"2024-09-17T05:24:39.243140+0000","last_fullsized":"2024-09-17T05:24:39.243140+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240921+0000","last_change":"2024-09-17T05:24:39.240921+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240921+0000","last_undegraded":"2024-09-17T05:24:39.240921+0000","last_fullsized":"2024-09-17T05:24:39.240921+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242840+0000","last_change":"2024-09-17T05:24:39.242840+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242840+0000","last_undegraded":"2024-09-17T05:24:39.242840+0000","last_fullsized":"2024-09-17T05:24:39.242840+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243111+0000","last_change":"2024-09-17T05:24:39.243111+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243111+0000","last_undegraded":"2024-09-17T05:24:39.243111+0000","last_fullsized":"2024-09-17T05:24:39.243111+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245619+0000","last_change":"2024-09-17T05:24:39.245619+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245619+0000","last_undegraded":"2024-09-17T05:24:39.245619+0000","last_fullsized":"2024-09-17T05:24:39.245619+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245099+0000","last_change":"2024-09-17T05:24:39.245099+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245099+0000","last_undegraded":"2024-09-17T05:24:39.245099+0000","last_fullsized":"2024-09-17T05:24:39.245099+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240401+0000","last_change":"2024-09-17T05:24:39.240401+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240401+0000","last_undegraded":"2024-09-17T05:24:39.240401+0000","last_fullsized":"2024-09-17T05:24:39.240401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.245098+0000","last_change":"2024-09-17T05:24:39.245098+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.245098+0000","last_undegraded":"2024-09-17T05:24:39.245098+0000","last_fullsized":"2024-09-17T05:24:39.245098+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242827+0000","last_change":"2024-09-17T05:24:39.242827+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242827+0000","last_undegraded":"2024-09-17T05:24:39.242827+0000","last_fullsized":"2024-09-17T05:24:39.242827+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242835+0000","last_change":"2024-09-17T05:24:39.242835+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242835+0000","last_undegraded":"2024-09-17T05:24:39.242835+0000","last_fullsized":"2024-09-17T05:24:39.242835+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.243253+0000","last_change":"2024-09-17T05:24:39.243253+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.243253+0000","last_undegraded":"2024-09-17T05:24:39.243253+0000","last_fullsized":"2024-09-17T05:24:39.243253+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242489+0000","last_change":"2024-09-17T05:24:39.242489+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242489+0000","last_undegraded":"2024-09-17T05:24:39.242489+0000","last_fullsized":"2024-09-17T05:24:39.242489+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.244725+0000","last_change":"2024-09-17T05:24:39.244725+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.244725+0000","last_undegraded":"2024-09-17T05:24:39.244725+0000","last_fullsized":"2024-09-17T05:24:39.244725+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240722+0000","last_change":"2024-09-17T05:24:39.240722+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240722+0000","last_undegraded":"2024-09-17T05:24:39.240722+0000","last_fullsized":"2024-09-17T05:24:39.240722+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.242504+0000","last_change":"2024-09-17T05:24:39.242504+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.242504+0000","last_undegraded":"2024-09-17T05:24:39.242504+0000","last_fullsized":"2024-09-17T05:24:39.242504+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:24:40.238234+0000","last_change":"2024-09-17T05:24:40.238234+0000","last_active":"2024-09-17T05:24:40.238234+0000","last_peered":"2024-09-17T05:24:40.238234+0000","last_clean":"2024-09-17T05:24:40.238234+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:40.238234+0000","last_undegraded":"2024-09-17T05:24:40.238234+0000","last_fullsized":"2024-09-17T05:24:40.238234+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":126,"state":"creating+peering","last_fresh":"2024-09-17T05:24:39.240535+0000","last_change":"2024-09-17T05:24:39.240535+0000","last_active":"2024-09-17T05:24:39.234195+0000","last_peered":"2024-09-17T05:24:39.234195+0000","last_clean":"2024-09-17T05:24:39.234195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:24:39.240535+0000","last_undegraded":"2024-09-17T05:24:39.240535+0000","last_fullsized":"2024-09-17T05:24:39.240535+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":322,"reported_epoch":126,"state":"active+clean","last_fresh":"2024-09-17T05:24:39.246065+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:24:39.246065+0000","last_peered":"2024-09-17T05:24:39.246065+0000","last_clean":"2024-09-17T05:24:39.246065+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:24:39.246065+0000","last_undegraded":"2024-09-17T05:24:39.246065+0000","last_fullsized":"2024-09-17T05:24:39.246065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509517,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33308,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338532,"statfs":{"total":96636764160,"available":96602656768,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509517,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32740,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339100,"statfs":{"total":96636764160,"available":96603238400,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509516,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32724,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339116,"statfs":{"total":96636764160,"available":96603254784,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509517,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32732,"kb_used_data":1536,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339108,"statfs":{"total":96636764160,"available":96603246592,"internally_reserved":0,"allocated":1572864,"data_stored":689634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509516,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32712,"kb_used_data":1524,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339128,"statfs":{"total":96636764160,"available":96603267072,"internally_reserved":0,"allocated":1560576,"data_stored":683745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574925,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33316,"kb_used_data":2116,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338524,"statfs":{"total":96636764160,"available":96602648576,"internally_reserved":0,"allocated":2166784,"data_stored":1280002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:24:45.676 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:24:45.679 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:24:48.597 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:24:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.709+0000 7f90fcdd3640 1 -- 172.21.15.81:0/2205598613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e40040b0 msgr2=0x7f90e4004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.709+0000 7f90fcdd3640 1 --2- 172.21.15.81:0/2205598613 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90e40040b0 0x7f90e4004800 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7f90e0001690 tx=0x7f90e4005830 comp rx=0 tx=0).stop 2024-09-17T05:24:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.709+0000 7f90f6d9d640 1 -- 172.21.15.81:0/2205598613 reap_dead start 2024-09-17T05:24:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.709+0000 7f90fcdd3640 1 -- 172.21.15.81:0/2205598613 shutdown_connections 2024-09-17T05:24:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.709+0000 7f90fcdd3640 1 -- 172.21.15.81:0/2205598613 >> 172.21.15.81:0/2205598613 conn(0x7f90f80b1690 msgr2=0x7f90f80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.709+0000 7f90fcdd3640 1 -- 172.21.15.81:0/2205598613 shutdown_connections 2024-09-17T05:24:48.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.709+0000 7f90fcdd3640 1 -- 172.21.15.81:0/2205598613 wait complete. 2024-09-17T05:24:48.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.711+0000 7f90fcdd3640 1 Processor -- start 2024-09-17T05:24:48.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.711+0000 7f90fcdd3640 1 -- start start 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90fcdd3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e40040b0 0x7f90f8159c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90fcdd3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f81f8180 0x7f90f8151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90fcdd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f8153f40 0x7f90f81543a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90fcdd3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90f80ccee0 con 0x7f90f8153f40 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90fcdd3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f90f8073c30 con 0x7f90f81f8180 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90fcdd3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f90f80cd060 con 0x7f90e40040b0 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f8153f40 0x7f90f81543a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f8153f40 0x7f90f81543a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34934/0 (socket says 172.21.15.81:34934) 2024-09-17T05:24:48.714 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 -- 172.21.15.81:0/1518813225 learned_addr learned my addr 172.21.15.81:0/1518813225 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f659c640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e40040b0 0x7f90f8159c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90edd9b640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f81f8180 0x7f90f8151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 -- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e40040b0 msgr2=0x7f90f8159c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e40040b0 0x7f90f8159c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 -- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f81f8180 msgr2=0x7f90f8151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f81f8180 0x7f90f8151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 -- 172.21.15.81:0/1518813225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90f81f4370 con 0x7f90f8153f40 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90edd9b640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f81f8180 0x7f90f8151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f659c640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e40040b0 0x7f90f8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90f6d9d640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f8153f40 0x7f90f81543a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f90f80727e0 tx=0x7f90f0010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90ef7fe640 1 -- 172.21.15.81:0/1518813225 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f000ee70 con 0x7f90f8153f40 2024-09-17T05:24:48.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90ef7fe640 1 -- 172.21.15.81:0/1518813225 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90f0004b20 con 0x7f90f8153f40 2024-09-17T05:24:48.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90f81f4650 con 0x7f90f8153f40 2024-09-17T05:24:48.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.712+0000 7f90ef7fe640 1 -- 172.21.15.81:0/1518813225 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90f0003970 con 0x7f90f8153f40 2024-09-17T05:24:48.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.713+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90f81f4c10 con 0x7f90f8153f40 2024-09-17T05:24:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.714+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f90f8073db0 con 0x7f90f8153f40 2024-09-17T05:24:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.714+0000 7f90ef7fe640 1 -- 172.21.15.81:0/1518813225 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f90f0003b10 con 0x7f90f8153f40 2024-09-17T05:24:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.715+0000 7f90ef7fe640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90d80791c0 0x7f90d807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.715+0000 7f90f659c640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90d80791c0 0x7f90d807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.715+0000 7f90ef7fe640 1 -- 172.21.15.81:0/1518813225 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f90f009c4e0 con 0x7f90f8153f40 2024-09-17T05:24:48.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.715+0000 7f90f659c640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90d80791c0 0x7f90d807b680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f90f80cf990 tx=0x7f90e80014d0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:48.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.719+0000 7f90ef7fe640 1 -- 172.21.15.81:0/1518813225 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f90f0016030 con 0x7f90f8153f40 2024-09-17T05:24:48.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.892+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f90f81f4de0 con 0x7f90d80791c0 2024-09-17T05:24:48.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.896+0000 7f90ef7fe640 1 -- 172.21.15.81:0/1518813225 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252483 (secure 0 0 0) 0x7f90f81f4de0 con 0x7f90d80791c0 2024-09-17T05:24:48.902 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:48.904 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:24:48.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90d80791c0 msgr2=0x7f90d807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90d80791c0 0x7f90d807b680 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f90f80cf990 tx=0x7f90e80014d0 comp rx=0 tx=0).stop 2024-09-17T05:24:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f8153f40 msgr2=0x7f90f81543a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f8153f40 0x7f90f81543a0 secure :-1 s=READY pgs=1380 cs=0 l=1 rev1=1 crypto rx=0x7f90f80727e0 tx=0x7f90f0010f00 comp rx=0 tx=0).stop 2024-09-17T05:24:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 shutdown_connections 2024-09-17T05:24:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90f8153f40 0x7f90f81543a0 unknown :-1 s=CLOSED pgs=1380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:48.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90d80791c0 0x7f90d807b680 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90f81f8180 0x7f90f8151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 --2- 172.21.15.81:0/1518813225 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90e40040b0 0x7f90f8159c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 >> 172.21.15.81:0/1518813225 conn(0x7f90f80b1690 msgr2=0x7f90f8155f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 shutdown_connections 2024-09-17T05:24:48.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:48.899+0000 7f90fcdd3640 1 -- 172.21.15.81:0/1518813225 wait complete. 2024-09-17T05:24:48.911 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":123,"stamp":"2024-09-17T05:24:48.046957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":263320,"kb_used_data":13800,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754711400,"statfs":{"total":773094113280,"available":772824473600,"internally_reserved":0,"allocated":14131200,"data_stored":6859156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":23,"apply_latency_ms":23,"commit_latency_ns":23000000,"apply_latency_ns":23000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.799184"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230722+0000","last_change":"2024-09-17T05:24:41.239037+0000","last_active":"2024-09-17T05:24:42.230722+0000","last_peered":"2024-09-17T05:24:42.230722+0000","last_clean":"2024-09-17T05:24:42.230722+0000","last_became_active":"2024-09-17T05:24:41.238787+0000","last_became_peered":"2024-09-17T05:24:41.238787+0000","last_unstale":"2024-09-17T05:24:42.230722+0000","last_undegraded":"2024-09-17T05:24:42.230722+0000","last_fullsized":"2024-09-17T05:24:42.230722+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:43:16.546417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654533+0000","last_change":"2024-09-17T05:24:41.239630+0000","last_active":"2024-09-17T05:24:42.654533+0000","last_peered":"2024-09-17T05:24:42.654533+0000","last_clean":"2024-09-17T05:24:42.654533+0000","last_became_active":"2024-09-17T05:24:41.239328+0000","last_became_peered":"2024-09-17T05:24:41.239328+0000","last_unstale":"2024-09-17T05:24:42.654533+0000","last_undegraded":"2024-09-17T05:24:42.654533+0000","last_fullsized":"2024-09-17T05:24:42.654533+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:15.016007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655214+0000","last_change":"2024-09-17T05:24:41.241381+0000","last_active":"2024-09-17T05:24:42.655214+0000","last_peered":"2024-09-17T05:24:42.655214+0000","last_clean":"2024-09-17T05:24:42.655214+0000","last_became_active":"2024-09-17T05:24:41.241075+0000","last_became_peered":"2024-09-17T05:24:41.241075+0000","last_unstale":"2024-09-17T05:24:42.655214+0000","last_undegraded":"2024-09-17T05:24:42.655214+0000","last_fullsized":"2024-09-17T05:24:42.655214+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:39.563752+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655578+0000","last_change":"2024-09-17T05:24:41.244263+0000","last_active":"2024-09-17T05:24:42.655578+0000","last_peered":"2024-09-17T05:24:42.655578+0000","last_clean":"2024-09-17T05:24:42.655578+0000","last_became_active":"2024-09-17T05:24:41.243837+0000","last_became_peered":"2024-09-17T05:24:41.243837+0000","last_unstale":"2024-09-17T05:24:42.655578+0000","last_undegraded":"2024-09-17T05:24:42.655578+0000","last_fullsized":"2024-09-17T05:24:42.655578+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:57.222829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230852+0000","last_change":"2024-09-17T05:24:41.248355+0000","last_active":"2024-09-17T05:24:42.230852+0000","last_peered":"2024-09-17T05:24:42.230852+0000","last_clean":"2024-09-17T05:24:42.230852+0000","last_became_active":"2024-09-17T05:24:41.248092+0000","last_became_peered":"2024-09-17T05:24:41.248092+0000","last_unstale":"2024-09-17T05:24:42.230852+0000","last_undegraded":"2024-09-17T05:24:42.230852+0000","last_fullsized":"2024-09-17T05:24:42.230852+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:42.779188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230447+0000","last_change":"2024-09-17T05:24:41.240941+0000","last_active":"2024-09-17T05:24:42.230447+0000","last_peered":"2024-09-17T05:24:42.230447+0000","last_clean":"2024-09-17T05:24:42.230447+0000","last_became_active":"2024-09-17T05:24:41.240679+0000","last_became_peered":"2024-09-17T05:24:41.240679+0000","last_unstale":"2024-09-17T05:24:42.230447+0000","last_undegraded":"2024-09-17T05:24:42.230447+0000","last_fullsized":"2024-09-17T05:24:42.230447+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:42.102188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654129+0000","last_change":"2024-09-17T05:24:41.247377+0000","last_active":"2024-09-17T05:24:42.654129+0000","last_peered":"2024-09-17T05:24:42.654129+0000","last_clean":"2024-09-17T05:24:42.654129+0000","last_became_active":"2024-09-17T05:24:41.246761+0000","last_became_peered":"2024-09-17T05:24:41.246761+0000","last_unstale":"2024-09-17T05:24:42.654129+0000","last_undegraded":"2024-09-17T05:24:42.654129+0000","last_fullsized":"2024-09-17T05:24:42.654129+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:12.414775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230146+0000","last_change":"2024-09-17T05:24:41.243917+0000","last_active":"2024-09-17T05:24:42.230146+0000","last_peered":"2024-09-17T05:24:42.230146+0000","last_clean":"2024-09-17T05:24:42.230146+0000","last_became_active":"2024-09-17T05:24:41.243447+0000","last_became_peered":"2024-09-17T05:24:41.243447+0000","last_unstale":"2024-09-17T05:24:42.230146+0000","last_undegraded":"2024-09-17T05:24:42.230146+0000","last_fullsized":"2024-09-17T05:24:42.230146+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:38.654544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654189+0000","last_change":"2024-09-17T05:24:41.238091+0000","last_active":"2024-09-17T05:24:42.654189+0000","last_peered":"2024-09-17T05:24:42.654189+0000","last_clean":"2024-09-17T05:24:42.654189+0000","last_became_active":"2024-09-17T05:24:41.237814+0000","last_became_peered":"2024-09-17T05:24:41.237814+0000","last_unstale":"2024-09-17T05:24:42.654189+0000","last_undegraded":"2024-09-17T05:24:42.654189+0000","last_fullsized":"2024-09-17T05:24:42.654189+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:29.517268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348202+0000","last_change":"2024-09-17T05:24:41.248222+0000","last_active":"2024-09-17T05:24:42.348202+0000","last_peered":"2024-09-17T05:24:42.348202+0000","last_clean":"2024-09-17T05:24:42.348202+0000","last_became_active":"2024-09-17T05:24:41.247925+0000","last_became_peered":"2024-09-17T05:24:41.247925+0000","last_unstale":"2024-09-17T05:24:42.348202+0000","last_undegraded":"2024-09-17T05:24:42.348202+0000","last_fullsized":"2024-09-17T05:24:42.348202+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:06:54.379071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230611+0000","last_change":"2024-09-17T05:24:41.243753+0000","last_active":"2024-09-17T05:24:42.230611+0000","last_peered":"2024-09-17T05:24:42.230611+0000","last_clean":"2024-09-17T05:24:42.230611+0000","last_became_active":"2024-09-17T05:24:41.243403+0000","last_became_peered":"2024-09-17T05:24:41.243403+0000","last_unstale":"2024-09-17T05:24:42.230611+0000","last_undegraded":"2024-09-17T05:24:42.230611+0000","last_fullsized":"2024-09-17T05:24:42.230611+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:26.420926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348207+0000","last_change":"2024-09-17T05:24:41.250753+0000","last_active":"2024-09-17T05:24:42.348207+0000","last_peered":"2024-09-17T05:24:42.348207+0000","last_clean":"2024-09-17T05:24:42.348207+0000","last_became_active":"2024-09-17T05:24:41.250498+0000","last_became_peered":"2024-09-17T05:24:41.250498+0000","last_unstale":"2024-09-17T05:24:42.348207+0000","last_undegraded":"2024-09-17T05:24:42.348207+0000","last_fullsized":"2024-09-17T05:24:42.348207+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:19.938697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.231149+0000","last_change":"2024-09-17T05:24:41.247568+0000","last_active":"2024-09-17T05:24:42.231149+0000","last_peered":"2024-09-17T05:24:42.231149+0000","last_clean":"2024-09-17T05:24:42.231149+0000","last_became_active":"2024-09-17T05:24:41.247310+0000","last_became_peered":"2024-09-17T05:24:41.247310+0000","last_unstale":"2024-09-17T05:24:42.231149+0000","last_undegraded":"2024-09-17T05:24:42.231149+0000","last_fullsized":"2024-09-17T05:24:42.231149+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:47.971873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655635+0000","last_change":"2024-09-17T05:24:41.243322+0000","last_active":"2024-09-17T05:24:42.655635+0000","last_peered":"2024-09-17T05:24:42.655635+0000","last_clean":"2024-09-17T05:24:42.655635+0000","last_became_active":"2024-09-17T05:24:41.241605+0000","last_became_peered":"2024-09-17T05:24:41.241605+0000","last_unstale":"2024-09-17T05:24:42.655635+0000","last_undegraded":"2024-09-17T05:24:42.655635+0000","last_fullsized":"2024-09-17T05:24:42.655635+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:55.069838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.347871+0000","last_change":"2024-09-17T05:24:41.245449+0000","last_active":"2024-09-17T05:24:42.347871+0000","last_peered":"2024-09-17T05:24:42.347871+0000","last_clean":"2024-09-17T05:24:42.347871+0000","last_became_active":"2024-09-17T05:24:41.245177+0000","last_became_peered":"2024-09-17T05:24:41.245177+0000","last_unstale":"2024-09-17T05:24:42.347871+0000","last_undegraded":"2024-09-17T05:24:42.347871+0000","last_fullsized":"2024-09-17T05:24:42.347871+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:44:29.847632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229966+0000","last_change":"2024-09-17T05:24:41.240674+0000","last_active":"2024-09-17T05:24:42.229966+0000","last_peered":"2024-09-17T05:24:42.229966+0000","last_clean":"2024-09-17T05:24:42.229966+0000","last_became_active":"2024-09-17T05:24:41.240402+0000","last_became_peered":"2024-09-17T05:24:41.240402+0000","last_unstale":"2024-09-17T05:24:42.229966+0000","last_undegraded":"2024-09-17T05:24:42.229966+0000","last_fullsized":"2024-09-17T05:24:42.229966+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:00.675267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348497+0000","last_change":"2024-09-17T05:24:41.248350+0000","last_active":"2024-09-17T05:24:42.348497+0000","last_peered":"2024-09-17T05:24:42.348497+0000","last_clean":"2024-09-17T05:24:42.348497+0000","last_became_active":"2024-09-17T05:24:41.247694+0000","last_became_peered":"2024-09-17T05:24:41.247694+0000","last_unstale":"2024-09-17T05:24:42.348497+0000","last_undegraded":"2024-09-17T05:24:42.348497+0000","last_fullsized":"2024-09-17T05:24:42.348497+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:54.380120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655556+0000","last_change":"2024-09-17T05:24:41.240969+0000","last_active":"2024-09-17T05:24:42.655556+0000","last_peered":"2024-09-17T05:24:42.655556+0000","last_clean":"2024-09-17T05:24:42.655556+0000","last_became_active":"2024-09-17T05:24:41.240671+0000","last_became_peered":"2024-09-17T05:24:41.240671+0000","last_unstale":"2024-09-17T05:24:42.655556+0000","last_undegraded":"2024-09-17T05:24:42.655556+0000","last_fullsized":"2024-09-17T05:24:42.655556+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:17.271857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230809+0000","last_change":"2024-09-17T05:24:41.238228+0000","last_active":"2024-09-17T05:24:42.230809+0000","last_peered":"2024-09-17T05:24:42.230809+0000","last_clean":"2024-09-17T05:24:42.230809+0000","last_became_active":"2024-09-17T05:24:41.237811+0000","last_became_peered":"2024-09-17T05:24:41.237811+0000","last_unstale":"2024-09-17T05:24:42.230809+0000","last_undegraded":"2024-09-17T05:24:42.230809+0000","last_fullsized":"2024-09-17T05:24:42.230809+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:00.433189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229722+0000","last_change":"2024-09-17T05:24:41.241520+0000","last_active":"2024-09-17T05:24:42.229722+0000","last_peered":"2024-09-17T05:24:42.229722+0000","last_clean":"2024-09-17T05:24:42.229722+0000","last_became_active":"2024-09-17T05:24:41.241085+0000","last_became_peered":"2024-09-17T05:24:41.241085+0000","last_unstale":"2024-09-17T05:24:42.229722+0000","last_undegraded":"2024-09-17T05:24:42.229722+0000","last_fullsized":"2024-09-17T05:24:42.229722+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:20.395302+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348329+0000","last_change":"2024-09-17T05:24:41.248291+0000","last_active":"2024-09-17T05:24:42.348329+0000","last_peered":"2024-09-17T05:24:42.348329+0000","last_clean":"2024-09-17T05:24:42.348329+0000","last_became_active":"2024-09-17T05:24:41.248003+0000","last_became_peered":"2024-09-17T05:24:41.248003+0000","last_unstale":"2024-09-17T05:24:42.348329+0000","last_undegraded":"2024-09-17T05:24:42.348329+0000","last_fullsized":"2024-09-17T05:24:42.348329+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:45.456860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655532+0000","last_change":"2024-09-17T05:24:41.239527+0000","last_active":"2024-09-17T05:24:42.655532+0000","last_peered":"2024-09-17T05:24:42.655532+0000","last_clean":"2024-09-17T05:24:42.655532+0000","last_became_active":"2024-09-17T05:24:41.239223+0000","last_became_peered":"2024-09-17T05:24:41.239223+0000","last_unstale":"2024-09-17T05:24:42.655532+0000","last_undegraded":"2024-09-17T05:24:42.655532+0000","last_fullsized":"2024-09-17T05:24:42.655532+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:27.205350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655410+0000","last_change":"2024-09-17T05:24:41.238709+0000","last_active":"2024-09-17T05:24:42.655410+0000","last_peered":"2024-09-17T05:24:42.655410+0000","last_clean":"2024-09-17T05:24:42.655410+0000","last_became_active":"2024-09-17T05:24:41.237773+0000","last_became_peered":"2024-09-17T05:24:41.237773+0000","last_unstale":"2024-09-17T05:24:42.655410+0000","last_undegraded":"2024-09-17T05:24:42.655410+0000","last_fullsized":"2024-09-17T05:24:42.655410+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:46.035402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.347961+0000","last_change":"2024-09-17T05:24:41.248951+0000","last_active":"2024-09-17T05:24:42.347961+0000","last_peered":"2024-09-17T05:24:42.347961+0000","last_clean":"2024-09-17T05:24:42.347961+0000","last_became_active":"2024-09-17T05:24:41.247390+0000","last_became_peered":"2024-09-17T05:24:41.247390+0000","last_unstale":"2024-09-17T05:24:42.347961+0000","last_undegraded":"2024-09-17T05:24:42.347961+0000","last_fullsized":"2024-09-17T05:24:42.347961+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:46.543170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229810+0000","last_change":"2024-09-17T05:24:41.238293+0000","last_active":"2024-09-17T05:24:42.229810+0000","last_peered":"2024-09-17T05:24:42.229810+0000","last_clean":"2024-09-17T05:24:42.229810+0000","last_became_active":"2024-09-17T05:24:41.238025+0000","last_became_peered":"2024-09-17T05:24:41.238025+0000","last_unstale":"2024-09-17T05:24:42.229810+0000","last_undegraded":"2024-09-17T05:24:42.229810+0000","last_fullsized":"2024-09-17T05:24:42.229810+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:11:00.597279+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230927+0000","last_change":"2024-09-17T05:24:41.237730+0000","last_active":"2024-09-17T05:24:42.230927+0000","last_peered":"2024-09-17T05:24:42.230927+0000","last_clean":"2024-09-17T05:24:42.230927+0000","last_became_active":"2024-09-17T05:24:41.237217+0000","last_became_peered":"2024-09-17T05:24:41.237217+0000","last_unstale":"2024-09-17T05:24:42.230927+0000","last_undegraded":"2024-09-17T05:24:42.230927+0000","last_fullsized":"2024-09-17T05:24:42.230927+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:18:50.534453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229924+0000","last_change":"2024-09-17T05:24:41.242736+0000","last_active":"2024-09-17T05:24:42.229924+0000","last_peered":"2024-09-17T05:24:42.229924+0000","last_clean":"2024-09-17T05:24:42.229924+0000","last_became_active":"2024-09-17T05:24:41.242463+0000","last_became_peered":"2024-09-17T05:24:41.242463+0000","last_unstale":"2024-09-17T05:24:42.229924+0000","last_undegraded":"2024-09-17T05:24:42.229924+0000","last_fullsized":"2024-09-17T05:24:42.229924+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:36.817973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654410+0000","last_change":"2024-09-17T05:24:41.244812+0000","last_active":"2024-09-17T05:24:42.654410+0000","last_peered":"2024-09-17T05:24:42.654410+0000","last_clean":"2024-09-17T05:24:42.654410+0000","last_became_active":"2024-09-17T05:24:41.243881+0000","last_became_peered":"2024-09-17T05:24:41.243881+0000","last_unstale":"2024-09-17T05:24:42.654410+0000","last_undegraded":"2024-09-17T05:24:42.654410+0000","last_fullsized":"2024-09-17T05:24:42.654410+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:43:08.170921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230219+0000","last_change":"2024-09-17T05:24:41.240614+0000","last_active":"2024-09-17T05:24:42.230219+0000","last_peered":"2024-09-17T05:24:42.230219+0000","last_clean":"2024-09-17T05:24:42.230219+0000","last_became_active":"2024-09-17T05:24:41.240320+0000","last_became_peered":"2024-09-17T05:24:41.240320+0000","last_unstale":"2024-09-17T05:24:42.230219+0000","last_undegraded":"2024-09-17T05:24:42.230219+0000","last_fullsized":"2024-09-17T05:24:42.230219+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:09.546234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655794+0000","last_change":"2024-09-17T05:24:41.241931+0000","last_active":"2024-09-17T05:24:42.655794+0000","last_peered":"2024-09-17T05:24:42.655794+0000","last_clean":"2024-09-17T05:24:42.655794+0000","last_became_active":"2024-09-17T05:24:41.241653+0000","last_became_peered":"2024-09-17T05:24:41.241653+0000","last_unstale":"2024-09-17T05:24:42.655794+0000","last_undegraded":"2024-09-17T05:24:42.655794+0000","last_fullsized":"2024-09-17T05:24:42.655794+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:33.047821+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654352+0000","last_change":"2024-09-17T05:24:41.244791+0000","last_active":"2024-09-17T05:24:42.654352+0000","last_peered":"2024-09-17T05:24:42.654352+0000","last_clean":"2024-09-17T05:24:42.654352+0000","last_became_active":"2024-09-17T05:24:41.244243+0000","last_became_peered":"2024-09-17T05:24:41.244243+0000","last_unstale":"2024-09-17T05:24:42.654352+0000","last_undegraded":"2024-09-17T05:24:42.654352+0000","last_fullsized":"2024-09-17T05:24:42.654352+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:19.327334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229518+0000","last_change":"2024-09-17T05:24:41.244524+0000","last_active":"2024-09-17T05:24:42.229518+0000","last_peered":"2024-09-17T05:24:42.229518+0000","last_clean":"2024-09-17T05:24:42.229518+0000","last_became_active":"2024-09-17T05:24:41.243631+0000","last_became_peered":"2024-09-17T05:24:41.243631+0000","last_unstale":"2024-09-17T05:24:42.229518+0000","last_undegraded":"2024-09-17T05:24:42.229518+0000","last_fullsized":"2024-09-17T05:24:42.229518+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:59:35.365325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348333+0000","last_change":"2024-09-17T05:24:41.246396+0000","last_active":"2024-09-17T05:24:42.348333+0000","last_peered":"2024-09-17T05:24:42.348333+0000","last_clean":"2024-09-17T05:24:42.348333+0000","last_became_active":"2024-09-17T05:24:41.246120+0000","last_became_peered":"2024-09-17T05:24:41.246120+0000","last_unstale":"2024-09-17T05:24:42.348333+0000","last_undegraded":"2024-09-17T05:24:42.348333+0000","last_fullsized":"2024-09-17T05:24:42.348333+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:12:39.168915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"128'4","reported_seq":19,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348296+0000","last_change":"2024-09-17T05:24:40.266088+0000","last_active":"2024-09-17T05:24:42.348296+0000","last_peered":"2024-09-17T05:24:42.348296+0000","last_clean":"2024-09-17T05:24:42.348296+0000","last_became_active":"2024-09-17T05:24:40.265779+0000","last_became_peered":"2024-09-17T05:24:40.265779+0000","last_unstale":"2024-09-17T05:24:42.348296+0000","last_undegraded":"2024-09-17T05:24:42.348296+0000","last_fullsized":"2024-09-17T05:24:42.348296+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:03.975823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654317+0000","last_change":"2024-09-17T05:24:41.239106+0000","last_active":"2024-09-17T05:24:42.654317+0000","last_peered":"2024-09-17T05:24:42.654317+0000","last_clean":"2024-09-17T05:24:42.654317+0000","last_became_active":"2024-09-17T05:24:41.238852+0000","last_became_peered":"2024-09-17T05:24:41.238852+0000","last_unstale":"2024-09-17T05:24:42.654317+0000","last_undegraded":"2024-09-17T05:24:42.654317+0000","last_fullsized":"2024-09-17T05:24:42.654317+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:12.540267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654405+0000","last_change":"2024-09-17T05:24:40.262370+0000","last_active":"2024-09-17T05:24:42.654405+0000","last_peered":"2024-09-17T05:24:42.654405+0000","last_clean":"2024-09-17T05:24:42.654405+0000","last_became_active":"2024-09-17T05:24:40.262150+0000","last_became_peered":"2024-09-17T05:24:40.262150+0000","last_unstale":"2024-09-17T05:24:42.654405+0000","last_undegraded":"2024-09-17T05:24:42.654405+0000","last_fullsized":"2024-09-17T05:24:42.654405+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:49.344120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230937+0000","last_change":"2024-09-17T05:24:41.235702+0000","last_active":"2024-09-17T05:24:42.230937+0000","last_peered":"2024-09-17T05:24:42.230937+0000","last_clean":"2024-09-17T05:24:42.230937+0000","last_became_active":"2024-09-17T05:24:41.235426+0000","last_became_peered":"2024-09-17T05:24:41.235426+0000","last_unstale":"2024-09-17T05:24:42.230937+0000","last_undegraded":"2024-09-17T05:24:42.230937+0000","last_fullsized":"2024-09-17T05:24:42.230937+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:07:35.475880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655499+0000","last_change":"2024-09-17T05:24:40.267070+0000","last_active":"2024-09-17T05:24:42.655499+0000","last_peered":"2024-09-17T05:24:42.655499+0000","last_clean":"2024-09-17T05:24:42.655499+0000","last_became_active":"2024-09-17T05:24:40.266654+0000","last_became_peered":"2024-09-17T05:24:40.266654+0000","last_unstale":"2024-09-17T05:24:42.655499+0000","last_undegraded":"2024-09-17T05:24:42.655499+0000","last_fullsized":"2024-09-17T05:24:42.655499+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:37.650505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348082+0000","last_change":"2024-09-17T05:24:41.250556+0000","last_active":"2024-09-17T05:24:42.348082+0000","last_peered":"2024-09-17T05:24:42.348082+0000","last_clean":"2024-09-17T05:24:42.348082+0000","last_became_active":"2024-09-17T05:24:41.250280+0000","last_became_peered":"2024-09-17T05:24:41.250280+0000","last_unstale":"2024-09-17T05:24:42.348082+0000","last_undegraded":"2024-09-17T05:24:42.348082+0000","last_fullsized":"2024-09-17T05:24:42.348082+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:20:40.272332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655544+0000","last_change":"2024-09-17T05:24:40.263598+0000","last_active":"2024-09-17T05:24:42.655544+0000","last_peered":"2024-09-17T05:24:42.655544+0000","last_clean":"2024-09-17T05:24:42.655544+0000","last_became_active":"2024-09-17T05:24:40.263336+0000","last_became_peered":"2024-09-17T05:24:40.263336+0000","last_unstale":"2024-09-17T05:24:42.655544+0000","last_undegraded":"2024-09-17T05:24:42.655544+0000","last_fullsized":"2024-09-17T05:24:42.655544+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:08.542195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654129+0000","last_change":"2024-09-17T05:24:41.244550+0000","last_active":"2024-09-17T05:24:42.654129+0000","last_peered":"2024-09-17T05:24:42.654129+0000","last_clean":"2024-09-17T05:24:42.654129+0000","last_became_active":"2024-09-17T05:24:41.244263+0000","last_became_peered":"2024-09-17T05:24:41.244263+0000","last_unstale":"2024-09-17T05:24:42.654129+0000","last_undegraded":"2024-09-17T05:24:42.654129+0000","last_fullsized":"2024-09-17T05:24:42.654129+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:16.731173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229401+0000","last_change":"2024-09-17T05:24:40.262795+0000","last_active":"2024-09-17T05:24:42.229401+0000","last_peered":"2024-09-17T05:24:42.229401+0000","last_clean":"2024-09-17T05:24:42.229401+0000","last_became_active":"2024-09-17T05:24:40.261353+0000","last_became_peered":"2024-09-17T05:24:40.261353+0000","last_unstale":"2024-09-17T05:24:42.229401+0000","last_undegraded":"2024-09-17T05:24:42.229401+0000","last_fullsized":"2024-09-17T05:24:42.229401+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:39:30.745081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655558+0000","last_change":"2024-09-17T05:24:41.246879+0000","last_active":"2024-09-17T05:24:42.655558+0000","last_peered":"2024-09-17T05:24:42.655558+0000","last_clean":"2024-09-17T05:24:42.655558+0000","last_became_active":"2024-09-17T05:24:41.246549+0000","last_became_peered":"2024-09-17T05:24:41.246549+0000","last_unstale":"2024-09-17T05:24:42.655558+0000","last_undegraded":"2024-09-17T05:24:42.655558+0000","last_fullsized":"2024-09-17T05:24:42.655558+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:35.305994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230640+0000","last_change":"2024-09-17T05:24:40.272553+0000","last_active":"2024-09-17T05:24:42.230640+0000","last_peered":"2024-09-17T05:24:42.230640+0000","last_clean":"2024-09-17T05:24:42.230640+0000","last_became_active":"2024-09-17T05:24:40.272256+0000","last_became_peered":"2024-09-17T05:24:40.272256+0000","last_unstale":"2024-09-17T05:24:42.230640+0000","last_undegraded":"2024-09-17T05:24:42.230640+0000","last_fullsized":"2024-09-17T05:24:42.230640+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:12:45.020787+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654445+0000","last_change":"2024-09-17T05:24:41.244967+0000","last_active":"2024-09-17T05:24:42.654445+0000","last_peered":"2024-09-17T05:24:42.654445+0000","last_clean":"2024-09-17T05:24:42.654445+0000","last_became_active":"2024-09-17T05:24:41.244696+0000","last_became_peered":"2024-09-17T05:24:41.244696+0000","last_unstale":"2024-09-17T05:24:42.654445+0000","last_undegraded":"2024-09-17T05:24:42.654445+0000","last_fullsized":"2024-09-17T05:24:42.654445+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:41.960337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229427+0000","last_change":"2024-09-17T05:24:40.267580+0000","last_active":"2024-09-17T05:24:42.229427+0000","last_peered":"2024-09-17T05:24:42.229427+0000","last_clean":"2024-09-17T05:24:42.229427+0000","last_became_active":"2024-09-17T05:24:40.267262+0000","last_became_peered":"2024-09-17T05:24:40.267262+0000","last_unstale":"2024-09-17T05:24:42.229427+0000","last_undegraded":"2024-09-17T05:24:42.229427+0000","last_fullsized":"2024-09-17T05:24:42.229427+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:00.673636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230831+0000","last_change":"2024-09-17T05:24:41.243979+0000","last_active":"2024-09-17T05:24:42.230831+0000","last_peered":"2024-09-17T05:24:42.230831+0000","last_clean":"2024-09-17T05:24:42.230831+0000","last_became_active":"2024-09-17T05:24:41.243668+0000","last_became_peered":"2024-09-17T05:24:41.243668+0000","last_unstale":"2024-09-17T05:24:42.230831+0000","last_undegraded":"2024-09-17T05:24:42.230831+0000","last_fullsized":"2024-09-17T05:24:42.230831+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:21:11.019684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655356+0000","last_change":"2024-09-17T05:24:40.262388+0000","last_active":"2024-09-17T05:24:42.655356+0000","last_peered":"2024-09-17T05:24:42.655356+0000","last_clean":"2024-09-17T05:24:42.655356+0000","last_became_active":"2024-09-17T05:24:40.261795+0000","last_became_peered":"2024-09-17T05:24:40.261795+0000","last_unstale":"2024-09-17T05:24:42.655356+0000","last_undegraded":"2024-09-17T05:24:42.655356+0000","last_fullsized":"2024-09-17T05:24:42.655356+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:53:38.559713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.231060+0000","last_change":"2024-09-17T05:24:41.239981+0000","last_active":"2024-09-17T05:24:42.231060+0000","last_peered":"2024-09-17T05:24:42.231060+0000","last_clean":"2024-09-17T05:24:42.231060+0000","last_became_active":"2024-09-17T05:24:41.239695+0000","last_became_peered":"2024-09-17T05:24:41.239695+0000","last_unstale":"2024-09-17T05:24:42.231060+0000","last_undegraded":"2024-09-17T05:24:42.231060+0000","last_fullsized":"2024-09-17T05:24:42.231060+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:02:41.315249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654243+0000","last_change":"2024-09-17T05:24:40.265820+0000","last_active":"2024-09-17T05:24:42.654243+0000","last_peered":"2024-09-17T05:24:42.654243+0000","last_clean":"2024-09-17T05:24:42.654243+0000","last_became_active":"2024-09-17T05:24:40.265561+0000","last_became_peered":"2024-09-17T05:24:40.265561+0000","last_unstale":"2024-09-17T05:24:42.654243+0000","last_undegraded":"2024-09-17T05:24:42.654243+0000","last_fullsized":"2024-09-17T05:24:42.654243+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:15:13.926601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348389+0000","last_change":"2024-09-17T05:24:41.248661+0000","last_active":"2024-09-17T05:24:42.348389+0000","last_peered":"2024-09-17T05:24:42.348389+0000","last_clean":"2024-09-17T05:24:42.348389+0000","last_became_active":"2024-09-17T05:24:41.248055+0000","last_became_peered":"2024-09-17T05:24:41.248055+0000","last_unstale":"2024-09-17T05:24:42.348389+0000","last_undegraded":"2024-09-17T05:24:42.348389+0000","last_fullsized":"2024-09-17T05:24:42.348389+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:00.990873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348461+0000","last_change":"2024-09-17T05:24:40.268189+0000","last_active":"2024-09-17T05:24:42.348461+0000","last_peered":"2024-09-17T05:24:42.348461+0000","last_clean":"2024-09-17T05:24:42.348461+0000","last_became_active":"2024-09-17T05:24:40.267500+0000","last_became_peered":"2024-09-17T05:24:40.267500+0000","last_unstale":"2024-09-17T05:24:42.348461+0000","last_undegraded":"2024-09-17T05:24:42.348461+0000","last_fullsized":"2024-09-17T05:24:42.348461+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:32.043783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229989+0000","last_change":"2024-09-17T05:24:41.240404+0000","last_active":"2024-09-17T05:24:42.229989+0000","last_peered":"2024-09-17T05:24:42.229989+0000","last_clean":"2024-09-17T05:24:42.229989+0000","last_became_active":"2024-09-17T05:24:41.239895+0000","last_became_peered":"2024-09-17T05:24:41.239895+0000","last_unstale":"2024-09-17T05:24:42.229989+0000","last_undegraded":"2024-09-17T05:24:42.229989+0000","last_fullsized":"2024-09-17T05:24:42.229989+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:03:57.364718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"128'6","reported_seq":21,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654469+0000","last_change":"2024-09-17T05:24:40.263381+0000","last_active":"2024-09-17T05:24:42.654469+0000","last_peered":"2024-09-17T05:24:42.654469+0000","last_clean":"2024-09-17T05:24:42.654469+0000","last_became_active":"2024-09-17T05:24:40.263128+0000","last_became_peered":"2024-09-17T05:24:40.263128+0000","last_unstale":"2024-09-17T05:24:42.654469+0000","last_undegraded":"2024-09-17T05:24:42.654469+0000","last_fullsized":"2024-09-17T05:24:42.654469+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:29.245994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654889+0000","last_change":"2024-09-17T05:24:41.247302+0000","last_active":"2024-09-17T05:24:42.654889+0000","last_peered":"2024-09-17T05:24:42.654889+0000","last_clean":"2024-09-17T05:24:42.654889+0000","last_became_active":"2024-09-17T05:24:41.247060+0000","last_became_peered":"2024-09-17T05:24:41.247060+0000","last_unstale":"2024-09-17T05:24:42.654889+0000","last_undegraded":"2024-09-17T05:24:42.654889+0000","last_fullsized":"2024-09-17T05:24:42.654889+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:52:39.561214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655369+0000","last_change":"2024-09-17T05:24:40.263126+0000","last_active":"2024-09-17T05:24:42.655369+0000","last_peered":"2024-09-17T05:24:42.655369+0000","last_clean":"2024-09-17T05:24:42.655369+0000","last_became_active":"2024-09-17T05:24:40.262868+0000","last_became_peered":"2024-09-17T05:24:40.262868+0000","last_unstale":"2024-09-17T05:24:42.655369+0000","last_undegraded":"2024-09-17T05:24:42.655369+0000","last_fullsized":"2024-09-17T05:24:42.655369+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:04.567806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654110+0000","last_change":"2024-09-17T05:24:41.239828+0000","last_active":"2024-09-17T05:24:42.654110+0000","last_peered":"2024-09-17T05:24:42.654110+0000","last_clean":"2024-09-17T05:24:42.654110+0000","last_became_active":"2024-09-17T05:24:41.239142+0000","last_became_peered":"2024-09-17T05:24:41.239142+0000","last_unstale":"2024-09-17T05:24:42.654110+0000","last_undegraded":"2024-09-17T05:24:42.654110+0000","last_fullsized":"2024-09-17T05:24:42.654110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:02.060192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654854+0000","last_change":"2024-09-17T05:24:40.268321+0000","last_active":"2024-09-17T05:24:42.654854+0000","last_peered":"2024-09-17T05:24:42.654854+0000","last_clean":"2024-09-17T05:24:42.654854+0000","last_became_active":"2024-09-17T05:24:40.267315+0000","last_became_peered":"2024-09-17T05:24:40.267315+0000","last_unstale":"2024-09-17T05:24:42.654854+0000","last_undegraded":"2024-09-17T05:24:42.654854+0000","last_fullsized":"2024-09-17T05:24:42.654854+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:10:46.967834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230722+0000","last_change":"2024-09-17T05:24:41.246879+0000","last_active":"2024-09-17T05:24:42.230722+0000","last_peered":"2024-09-17T05:24:42.230722+0000","last_clean":"2024-09-17T05:24:42.230722+0000","last_became_active":"2024-09-17T05:24:41.246571+0000","last_became_peered":"2024-09-17T05:24:41.246571+0000","last_unstale":"2024-09-17T05:24:42.230722+0000","last_undegraded":"2024-09-17T05:24:42.230722+0000","last_fullsized":"2024-09-17T05:24:42.230722+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:27:31.922592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230100+0000","last_change":"2024-09-17T05:24:40.261637+0000","last_active":"2024-09-17T05:24:42.230100+0000","last_peered":"2024-09-17T05:24:42.230100+0000","last_clean":"2024-09-17T05:24:42.230100+0000","last_became_active":"2024-09-17T05:24:40.261363+0000","last_became_peered":"2024-09-17T05:24:40.261363+0000","last_unstale":"2024-09-17T05:24:42.230100+0000","last_undegraded":"2024-09-17T05:24:42.230100+0000","last_fullsized":"2024-09-17T05:24:42.230100+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:53:48.375248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654736+0000","last_change":"2024-09-17T05:24:41.241742+0000","last_active":"2024-09-17T05:24:42.654736+0000","last_peered":"2024-09-17T05:24:42.654736+0000","last_clean":"2024-09-17T05:24:42.654736+0000","last_became_active":"2024-09-17T05:24:41.241472+0000","last_became_peered":"2024-09-17T05:24:41.241472+0000","last_unstale":"2024-09-17T05:24:42.654736+0000","last_undegraded":"2024-09-17T05:24:42.654736+0000","last_fullsized":"2024-09-17T05:24:42.654736+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:02:55.818800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"128'8","reported_seq":23,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229572+0000","last_change":"2024-09-17T05:24:40.259561+0000","last_active":"2024-09-17T05:24:42.229572+0000","last_peered":"2024-09-17T05:24:42.229572+0000","last_clean":"2024-09-17T05:24:42.229572+0000","last_became_active":"2024-09-17T05:24:40.259281+0000","last_became_peered":"2024-09-17T05:24:40.259281+0000","last_unstale":"2024-09-17T05:24:42.229572+0000","last_undegraded":"2024-09-17T05:24:42.229572+0000","last_fullsized":"2024-09-17T05:24:42.229572+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:28:30.384945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348436+0000","last_change":"2024-09-17T05:24:41.247302+0000","last_active":"2024-09-17T05:24:42.348436+0000","last_peered":"2024-09-17T05:24:42.348436+0000","last_clean":"2024-09-17T05:24:42.348436+0000","last_became_active":"2024-09-17T05:24:41.247021+0000","last_became_peered":"2024-09-17T05:24:41.247021+0000","last_unstale":"2024-09-17T05:24:42.348436+0000","last_undegraded":"2024-09-17T05:24:42.348436+0000","last_fullsized":"2024-09-17T05:24:42.348436+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:41.334190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230863+0000","last_change":"2024-09-17T05:24:40.268180+0000","last_active":"2024-09-17T05:24:42.230863+0000","last_peered":"2024-09-17T05:24:42.230863+0000","last_clean":"2024-09-17T05:24:42.230863+0000","last_became_active":"2024-09-17T05:24:40.267881+0000","last_became_peered":"2024-09-17T05:24:40.267881+0000","last_unstale":"2024-09-17T05:24:42.230863+0000","last_undegraded":"2024-09-17T05:24:42.230863+0000","last_fullsized":"2024-09-17T05:24:42.230863+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:41:33.428825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229765+0000","last_change":"2024-09-17T05:24:41.239565+0000","last_active":"2024-09-17T05:24:42.229765+0000","last_peered":"2024-09-17T05:24:42.229765+0000","last_clean":"2024-09-17T05:24:42.229765+0000","last_became_active":"2024-09-17T05:24:41.239295+0000","last_became_peered":"2024-09-17T05:24:41.239295+0000","last_unstale":"2024-09-17T05:24:42.229765+0000","last_undegraded":"2024-09-17T05:24:42.229765+0000","last_fullsized":"2024-09-17T05:24:42.229765+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:03.066442+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654525+0000","last_change":"2024-09-17T05:24:40.259694+0000","last_active":"2024-09-17T05:24:42.654525+0000","last_peered":"2024-09-17T05:24:42.654525+0000","last_clean":"2024-09-17T05:24:42.654525+0000","last_became_active":"2024-09-17T05:24:40.259442+0000","last_became_peered":"2024-09-17T05:24:40.259442+0000","last_unstale":"2024-09-17T05:24:42.654525+0000","last_undegraded":"2024-09-17T05:24:42.654525+0000","last_fullsized":"2024-09-17T05:24:42.654525+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:55:36.033187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655283+0000","last_change":"2024-09-17T05:24:41.251108+0000","last_active":"2024-09-17T05:24:42.655283+0000","last_peered":"2024-09-17T05:24:42.655283+0000","last_clean":"2024-09-17T05:24:42.655283+0000","last_became_active":"2024-09-17T05:24:41.250801+0000","last_became_peered":"2024-09-17T05:24:41.250801+0000","last_unstale":"2024-09-17T05:24:42.655283+0000","last_undegraded":"2024-09-17T05:24:42.655283+0000","last_fullsized":"2024-09-17T05:24:42.655283+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:18.687267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"128'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229974+0000","last_change":"2024-09-17T05:24:40.262024+0000","last_active":"2024-09-17T05:24:42.229974+0000","last_peered":"2024-09-17T05:24:42.229974+0000","last_clean":"2024-09-17T05:24:42.229974+0000","last_became_active":"2024-09-17T05:24:40.261691+0000","last_became_peered":"2024-09-17T05:24:40.261691+0000","last_unstale":"2024-09-17T05:24:42.229974+0000","last_undegraded":"2024-09-17T05:24:42.229974+0000","last_fullsized":"2024-09-17T05:24:42.229974+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:27.302965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230459+0000","last_change":"2024-09-17T05:24:41.242492+0000","last_active":"2024-09-17T05:24:42.230459+0000","last_peered":"2024-09-17T05:24:42.230459+0000","last_clean":"2024-09-17T05:24:42.230459+0000","last_became_active":"2024-09-17T05:24:41.241670+0000","last_became_peered":"2024-09-17T05:24:41.241670+0000","last_unstale":"2024-09-17T05:24:42.230459+0000","last_undegraded":"2024-09-17T05:24:42.230459+0000","last_fullsized":"2024-09-17T05:24:42.230459+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:31:40.640767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654524+0000","last_change":"2024-09-17T05:24:40.265765+0000","last_active":"2024-09-17T05:24:42.654524+0000","last_peered":"2024-09-17T05:24:42.654524+0000","last_clean":"2024-09-17T05:24:42.654524+0000","last_became_active":"2024-09-17T05:24:40.265488+0000","last_became_peered":"2024-09-17T05:24:40.265488+0000","last_unstale":"2024-09-17T05:24:42.654524+0000","last_undegraded":"2024-09-17T05:24:42.654524+0000","last_fullsized":"2024-09-17T05:24:42.654524+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:15:54.742840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655873+0000","last_change":"2024-09-17T05:24:41.238747+0000","last_active":"2024-09-17T05:24:42.655873+0000","last_peered":"2024-09-17T05:24:42.655873+0000","last_clean":"2024-09-17T05:24:42.655873+0000","last_became_active":"2024-09-17T05:24:41.237648+0000","last_became_peered":"2024-09-17T05:24:41.237648+0000","last_unstale":"2024-09-17T05:24:42.655873+0000","last_undegraded":"2024-09-17T05:24:42.655873+0000","last_fullsized":"2024-09-17T05:24:42.655873+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:04.979862+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654172+0000","last_change":"2024-09-17T05:24:40.260395+0000","last_active":"2024-09-17T05:24:42.654172+0000","last_peered":"2024-09-17T05:24:42.654172+0000","last_clean":"2024-09-17T05:24:42.654172+0000","last_became_active":"2024-09-17T05:24:40.260138+0000","last_became_peered":"2024-09-17T05:24:40.260138+0000","last_unstale":"2024-09-17T05:24:42.654172+0000","last_undegraded":"2024-09-17T05:24:42.654172+0000","last_fullsized":"2024-09-17T05:24:42.654172+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:18:02.731398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654110+0000","last_change":"2024-09-17T05:24:41.246983+0000","last_active":"2024-09-17T05:24:42.654110+0000","last_peered":"2024-09-17T05:24:42.654110+0000","last_clean":"2024-09-17T05:24:42.654110+0000","last_became_active":"2024-09-17T05:24:41.246692+0000","last_became_peered":"2024-09-17T05:24:41.246692+0000","last_unstale":"2024-09-17T05:24:42.654110+0000","last_undegraded":"2024-09-17T05:24:42.654110+0000","last_fullsized":"2024-09-17T05:24:42.654110+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:17:03.583180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.347935+0000","last_change":"2024-09-17T05:24:40.265700+0000","last_active":"2024-09-17T05:24:42.347935+0000","last_peered":"2024-09-17T05:24:42.347935+0000","last_clean":"2024-09-17T05:24:42.347935+0000","last_became_active":"2024-09-17T05:24:40.265431+0000","last_became_peered":"2024-09-17T05:24:40.265431+0000","last_unstale":"2024-09-17T05:24:42.347935+0000","last_undegraded":"2024-09-17T05:24:42.347935+0000","last_fullsized":"2024-09-17T05:24:42.347935+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:44:56.218790+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655418+0000","last_change":"2024-09-17T05:24:41.239984+0000","last_active":"2024-09-17T05:24:42.655418+0000","last_peered":"2024-09-17T05:24:42.655418+0000","last_clean":"2024-09-17T05:24:42.655418+0000","last_became_active":"2024-09-17T05:24:41.239657+0000","last_became_peered":"2024-09-17T05:24:41.239657+0000","last_unstale":"2024-09-17T05:24:42.655418+0000","last_undegraded":"2024-09-17T05:24:42.655418+0000","last_fullsized":"2024-09-17T05:24:42.655418+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:50.348159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.347703+0000","last_change":"2024-09-17T05:24:40.267661+0000","last_active":"2024-09-17T05:24:42.347703+0000","last_peered":"2024-09-17T05:24:42.347703+0000","last_clean":"2024-09-17T05:24:42.347703+0000","last_became_active":"2024-09-17T05:24:40.267394+0000","last_became_peered":"2024-09-17T05:24:40.267394+0000","last_unstale":"2024-09-17T05:24:42.347703+0000","last_undegraded":"2024-09-17T05:24:42.347703+0000","last_fullsized":"2024-09-17T05:24:42.347703+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:34.301955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.653935+0000","last_change":"2024-09-17T05:24:41.247550+0000","last_active":"2024-09-17T05:24:42.653935+0000","last_peered":"2024-09-17T05:24:42.653935+0000","last_clean":"2024-09-17T05:24:42.653935+0000","last_became_active":"2024-09-17T05:24:41.247199+0000","last_became_peered":"2024-09-17T05:24:41.247199+0000","last_unstale":"2024-09-17T05:24:42.653935+0000","last_undegraded":"2024-09-17T05:24:42.653935+0000","last_fullsized":"2024-09-17T05:24:42.653935+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:43:04.049863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654529+0000","last_change":"2024-09-17T05:24:40.261513+0000","last_active":"2024-09-17T05:24:42.654529+0000","last_peered":"2024-09-17T05:24:42.654529+0000","last_clean":"2024-09-17T05:24:42.654529+0000","last_became_active":"2024-09-17T05:24:40.261247+0000","last_became_peered":"2024-09-17T05:24:40.261247+0000","last_unstale":"2024-09-17T05:24:42.654529+0000","last_undegraded":"2024-09-17T05:24:42.654529+0000","last_fullsized":"2024-09-17T05:24:42.654529+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:08.276259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.231206+0000","last_change":"2024-09-17T05:24:41.244488+0000","last_active":"2024-09-17T05:24:42.231206+0000","last_peered":"2024-09-17T05:24:42.231206+0000","last_clean":"2024-09-17T05:24:42.231206+0000","last_became_active":"2024-09-17T05:24:41.244223+0000","last_became_peered":"2024-09-17T05:24:41.244223+0000","last_unstale":"2024-09-17T05:24:42.231206+0000","last_undegraded":"2024-09-17T05:24:42.231206+0000","last_fullsized":"2024-09-17T05:24:42.231206+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:05.571844+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"128'2","reported_seq":17,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348456+0000","last_change":"2024-09-17T05:24:40.265375+0000","last_active":"2024-09-17T05:24:42.348456+0000","last_peered":"2024-09-17T05:24:42.348456+0000","last_clean":"2024-09-17T05:24:42.348456+0000","last_became_active":"2024-09-17T05:24:40.265020+0000","last_became_peered":"2024-09-17T05:24:40.265020+0000","last_unstale":"2024-09-17T05:24:42.348456+0000","last_undegraded":"2024-09-17T05:24:42.348456+0000","last_fullsized":"2024-09-17T05:24:42.348456+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:30:32.963337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655754+0000","last_change":"2024-09-17T05:24:41.249418+0000","last_active":"2024-09-17T05:24:42.655754+0000","last_peered":"2024-09-17T05:24:42.655754+0000","last_clean":"2024-09-17T05:24:42.655754+0000","last_became_active":"2024-09-17T05:24:41.248677+0000","last_became_peered":"2024-09-17T05:24:41.248677+0000","last_unstale":"2024-09-17T05:24:42.655754+0000","last_undegraded":"2024-09-17T05:24:42.655754+0000","last_fullsized":"2024-09-17T05:24:42.655754+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:47.504374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"129'1","reported_seq":16,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230468+0000","last_change":"2024-09-17T05:24:40.262412+0000","last_active":"2024-09-17T05:24:42.230468+0000","last_peered":"2024-09-17T05:24:42.230468+0000","last_clean":"2024-09-17T05:24:42.230468+0000","last_became_active":"2024-09-17T05:24:40.262141+0000","last_became_peered":"2024-09-17T05:24:40.262141+0000","last_unstale":"2024-09-17T05:24:42.230468+0000","last_undegraded":"2024-09-17T05:24:42.230468+0000","last_fullsized":"2024-09-17T05:24:42.230468+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:50:46.097802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654602+0000","last_change":"2024-09-17T05:24:41.243128+0000","last_active":"2024-09-17T05:24:42.654602+0000","last_peered":"2024-09-17T05:24:42.654602+0000","last_clean":"2024-09-17T05:24:42.654602+0000","last_became_active":"2024-09-17T05:24:41.242855+0000","last_became_peered":"2024-09-17T05:24:41.242855+0000","last_unstale":"2024-09-17T05:24:42.654602+0000","last_undegraded":"2024-09-17T05:24:42.654602+0000","last_fullsized":"2024-09-17T05:24:42.654602+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:07.879143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230708+0000","last_change":"2024-09-17T05:24:40.261054+0000","last_active":"2024-09-17T05:24:42.230708+0000","last_peered":"2024-09-17T05:24:42.230708+0000","last_clean":"2024-09-17T05:24:42.230708+0000","last_became_active":"2024-09-17T05:24:40.260788+0000","last_became_peered":"2024-09-17T05:24:40.260788+0000","last_unstale":"2024-09-17T05:24:42.230708+0000","last_undegraded":"2024-09-17T05:24:42.230708+0000","last_fullsized":"2024-09-17T05:24:42.230708+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:27:41.162485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230653+0000","last_change":"2024-09-17T05:24:41.238376+0000","last_active":"2024-09-17T05:24:42.230653+0000","last_peered":"2024-09-17T05:24:42.230653+0000","last_clean":"2024-09-17T05:24:42.230653+0000","last_became_active":"2024-09-17T05:24:41.238117+0000","last_became_peered":"2024-09-17T05:24:41.238117+0000","last_unstale":"2024-09-17T05:24:42.230653+0000","last_undegraded":"2024-09-17T05:24:42.230653+0000","last_fullsized":"2024-09-17T05:24:42.230653+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:42.605448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230300+0000","last_change":"2024-09-17T05:24:40.260987+0000","last_active":"2024-09-17T05:24:42.230300+0000","last_peered":"2024-09-17T05:24:42.230300+0000","last_clean":"2024-09-17T05:24:42.230300+0000","last_became_active":"2024-09-17T05:24:40.260727+0000","last_became_peered":"2024-09-17T05:24:40.260727+0000","last_unstale":"2024-09-17T05:24:42.230300+0000","last_undegraded":"2024-09-17T05:24:42.230300+0000","last_fullsized":"2024-09-17T05:24:42.230300+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:14.403865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.229527+0000","last_change":"2024-09-17T05:24:41.232618+0000","last_active":"2024-09-17T05:24:42.229527+0000","last_peered":"2024-09-17T05:24:42.229527+0000","last_clean":"2024-09-17T05:24:42.229527+0000","last_became_active":"2024-09-17T05:24:41.232352+0000","last_became_peered":"2024-09-17T05:24:41.232352+0000","last_unstale":"2024-09-17T05:24:42.229527+0000","last_undegraded":"2024-09-17T05:24:42.229527+0000","last_fullsized":"2024-09-17T05:24:42.229527+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:35:16.199327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654191+0000","last_change":"2024-09-17T05:24:40.262813+0000","last_active":"2024-09-17T05:24:42.654191+0000","last_peered":"2024-09-17T05:24:42.654191+0000","last_clean":"2024-09-17T05:24:42.654191+0000","last_became_active":"2024-09-17T05:24:40.262566+0000","last_became_peered":"2024-09-17T05:24:40.262566+0000","last_unstale":"2024-09-17T05:24:42.654191+0000","last_undegraded":"2024-09-17T05:24:42.654191+0000","last_fullsized":"2024-09-17T05:24:42.654191+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:56.511005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.231244+0000","last_change":"2024-09-17T05:24:41.243713+0000","last_active":"2024-09-17T05:24:42.231244+0000","last_peered":"2024-09-17T05:24:42.231244+0000","last_clean":"2024-09-17T05:24:42.231244+0000","last_became_active":"2024-09-17T05:24:41.243447+0000","last_became_peered":"2024-09-17T05:24:41.243447+0000","last_unstale":"2024-09-17T05:24:42.231244+0000","last_undegraded":"2024-09-17T05:24:42.231244+0000","last_fullsized":"2024-09-17T05:24:42.231244+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:09.280297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348062+0000","last_change":"2024-09-17T05:24:40.266474+0000","last_active":"2024-09-17T05:24:42.348062+0000","last_peered":"2024-09-17T05:24:42.348062+0000","last_clean":"2024-09-17T05:24:42.348062+0000","last_became_active":"2024-09-17T05:24:40.264422+0000","last_became_peered":"2024-09-17T05:24:40.264422+0000","last_unstale":"2024-09-17T05:24:42.348062+0000","last_undegraded":"2024-09-17T05:24:42.348062+0000","last_fullsized":"2024-09-17T05:24:42.348062+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:54.065800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.347887+0000","last_change":"2024-09-17T05:24:41.245707+0000","last_active":"2024-09-17T05:24:42.347887+0000","last_peered":"2024-09-17T05:24:42.347887+0000","last_clean":"2024-09-17T05:24:42.347887+0000","last_became_active":"2024-09-17T05:24:41.245402+0000","last_became_peered":"2024-09-17T05:24:41.245402+0000","last_unstale":"2024-09-17T05:24:42.347887+0000","last_undegraded":"2024-09-17T05:24:42.347887+0000","last_fullsized":"2024-09-17T05:24:42.347887+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:00.688731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654696+0000","last_change":"2024-09-17T05:24:40.264137+0000","last_active":"2024-09-17T05:24:42.654696+0000","last_peered":"2024-09-17T05:24:42.654696+0000","last_clean":"2024-09-17T05:24:42.654696+0000","last_became_active":"2024-09-17T05:24:40.263833+0000","last_became_peered":"2024-09-17T05:24:40.263833+0000","last_unstale":"2024-09-17T05:24:42.654696+0000","last_undegraded":"2024-09-17T05:24:42.654696+0000","last_fullsized":"2024-09-17T05:24:42.654696+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:49.858818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.230840+0000","last_change":"2024-09-17T05:24:41.243664+0000","last_active":"2024-09-17T05:24:42.230840+0000","last_peered":"2024-09-17T05:24:42.230840+0000","last_clean":"2024-09-17T05:24:42.230840+0000","last_became_active":"2024-09-17T05:24:41.242891+0000","last_became_peered":"2024-09-17T05:24:41.242891+0000","last_unstale":"2024-09-17T05:24:42.230840+0000","last_undegraded":"2024-09-17T05:24:42.230840+0000","last_fullsized":"2024-09-17T05:24:42.230840+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:40:40.385776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":15,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.653796+0000","last_change":"2024-09-17T05:24:40.263969+0000","last_active":"2024-09-17T05:24:42.653796+0000","last_peered":"2024-09-17T05:24:42.653796+0000","last_clean":"2024-09-17T05:24:42.653796+0000","last_became_active":"2024-09-17T05:24:40.263740+0000","last_became_peered":"2024-09-17T05:24:40.263740+0000","last_unstale":"2024-09-17T05:24:42.653796+0000","last_undegraded":"2024-09-17T05:24:42.653796+0000","last_fullsized":"2024-09-17T05:24:42.653796+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:06:40.638224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":13,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.654530+0000","last_change":"2024-09-17T05:24:41.247642+0000","last_active":"2024-09-17T05:24:42.654530+0000","last_peered":"2024-09-17T05:24:42.654530+0000","last_clean":"2024-09-17T05:24:42.654530+0000","last_became_active":"2024-09-17T05:24:41.247212+0000","last_became_peered":"2024-09-17T05:24:41.247212+0000","last_unstale":"2024-09-17T05:24:42.654530+0000","last_undegraded":"2024-09-17T05:24:42.654530+0000","last_fullsized":"2024-09-17T05:24:42.654530+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":127,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:40.238234+0000","last_clean_scrub_stamp":"2024-09-17T05:24:40.238234+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:05.404304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"128'3","reported_seq":18,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.655204+0000","last_change":"2024-09-17T05:24:40.261989+0000","last_active":"2024-09-17T05:24:42.655204+0000","last_peered":"2024-09-17T05:24:42.655204+0000","last_clean":"2024-09-17T05:24:42.655204+0000","last_became_active":"2024-09-17T05:24:40.261224+0000","last_became_peered":"2024-09-17T05:24:40.261224+0000","last_unstale":"2024-09-17T05:24:42.655204+0000","last_undegraded":"2024-09-17T05:24:42.655204+0000","last_fullsized":"2024-09-17T05:24:42.655204+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":126,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:24:39.234195+0000","last_clean_scrub_stamp":"2024-09-17T05:24:39.234195+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:22:36.538597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":329,"reported_epoch":129,"state":"active+clean","last_fresh":"2024-09-17T05:24:42.348186+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:24:42.348186+0000","last_peered":"2024-09-17T05:24:42.348186+0000","last_clean":"2024-09-17T05:24:42.348186+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:24:42.348186+0000","last_undegraded":"2024-09-17T05:24:42.348186+0000","last_fullsized":"2024-09-17T05:24:42.348186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509518,"num_pgs":32,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33356,"kb_used_data":2160,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338484,"statfs":{"total":96636764160,"available":96602607616,"internally_reserved":0,"allocated":2211840,"data_stored":1300220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509518,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32772,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339068,"statfs":{"total":96636764160,"available":96603205632,"internally_reserved":0,"allocated":1622016,"data_stored":709346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509517,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":709222,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509517,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32760,"kb_used_data":1572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339080,"statfs":{"total":96636764160,"available":96603217920,"internally_reserved":0,"allocated":1609728,"data_stored":709200,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509517,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32764,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339076,"statfs":{"total":96636764160,"available":96603213824,"internally_reserved":0,"allocated":1613824,"data_stored":709290,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509518,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32780,"kb_used_data":1588,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339060,"statfs":{"total":96636764160,"available":96603197440,"internally_reserved":0,"allocated":1626112,"data_stored":710882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509517,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32768,"kb_used_data":1576,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339072,"statfs":{"total":96636764160,"available":96603209728,"internally_reserved":0,"allocated":1613824,"data_stored":709782,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574926,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33356,"kb_used_data":2168,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338484,"statfs":{"total":96636764160,"available":96602607616,"internally_reserved":0,"allocated":2220032,"data_stored":1301214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":20,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":652,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":21,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:24:48.919 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:24:48.919 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:24:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/2946185526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 msgr2=0x7fcd140cc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/2946185526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140cc980 secure :-1 s=READY pgs=1382 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c005fd0 tx=0x7fcd0c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:24:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/2946185526 shutdown_connections 2024-09-17T05:24:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/2946185526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140cc980 unknown :-1 s=CLOSED pgs=1382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/2946185526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd14151e30 0x7fcd1406fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/2946185526 >> 172.21.15.81:0/2946185526 conn(0x7fcd140b1700 msgr2=0x7fcd140b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:49.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/2946185526 shutdown_connections 2024-09-17T05:24:49.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.059+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/2946185526 wait complete. 2024-09-17T05:24:49.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.060+0000 7fcd1b8cf640 1 Processor -- start 2024-09-17T05:24:49.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.060+0000 7fcd1b8cf640 1 -- start start 2024-09-17T05:24:49.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd1b8cf640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd140cc540 0x7fcd140c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd1b8cf640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd14151e30 0x7fcd140ae8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd1b8cf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140aee00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd1b8cf640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd140cb110 con 0x7fcd1415bae0 2024-09-17T05:24:49.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd1b8cf640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcd140caf90 con 0x7fcd14151e30 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd1b8cf640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcd140cb290 con 0x7fcd140cc540 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140aee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140aee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34960/0 (socket says 172.21.15.81:34960) 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 -- 172.21.15.81:0/3285410086 learned_addr learned my addr 172.21.15.81:0/3285410086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 -- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd140cc540 msgr2=0x7fcd140c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd1966b640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd140cc540 0x7fcd140c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd140cc540 0x7fcd140c6c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 -- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd14151e30 msgr2=0x7fcd140ae8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd18e6a640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd14151e30 0x7fcd140ae8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd14151e30 0x7fcd140ae8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 -- 172.21.15.81:0/3285410086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd140adb00 con 0x7fcd1415bae0 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd18e6a640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd14151e30 0x7fcd140ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:49.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.061+0000 7fcd19e6c640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140aee00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006010 tx=0x7fcd0c003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.062+0000 7fcd09ffb640 1 -- 172.21.15.81:0/3285410086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c044070 con 0x7fcd1415bae0 2024-09-17T05:24:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.062+0000 7fcd09ffb640 1 -- 172.21.15.81:0/3285410086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd0c004250 con 0x7fcd1415bae0 2024-09-17T05:24:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.062+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd140adde0 con 0x7fcd1415bae0 2024-09-17T05:24:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.062+0000 7fcd09ffb640 1 -- 172.21.15.81:0/3285410086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c004680 con 0x7fcd1415bae0 2024-09-17T05:24:49.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.062+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd140ae3a0 con 0x7fcd1415bae0 2024-09-17T05:24:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.063+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd140cb7b0 con 0x7fcd1415bae0 2024-09-17T05:24:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.063+0000 7fcd09ffb640 1 -- 172.21.15.81:0/3285410086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fcd0c047070 con 0x7fcd1415bae0 2024-09-17T05:24:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.064+0000 7fcd09ffb640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccf80791f0 0x7fccf807b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.064+0000 7fcd09ffb640 1 -- 172.21.15.81:0/3285410086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fcd0c0bc870 con 0x7fcd1415bae0 2024-09-17T05:24:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.064+0000 7fcd1966b640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccf80791f0 0x7fccf807b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:49.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.064+0000 7fcd1966b640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccf80791f0 0x7fccf807b6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400a810 tx=0x7fcd04008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:49.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.068+0000 7fcd09ffb640 1 -- 172.21.15.81:0/3285410086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fcd0c032030 con 0x7fcd1415bae0 2024-09-17T05:24:49.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.323+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fcd140ae570 con 0x7fcd1415bae0 2024-09-17T05:24:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.325+0000 7fcd09ffb640 1 -- 172.21.15.81:0/3285410086 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v24) ==== 190+0+147 (secure 0 0 0) 0x7fcd0c004820 con 0x7fcd1415bae0 2024-09-17T05:24:49.326 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:24:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:24:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:24:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:24:49.326 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:24:49.326 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:24:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccf80791f0 msgr2=0x7fccf807b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccf80791f0 0x7fccf807b6b0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fcd0400a810 tx=0x7fcd04008040 comp rx=0 tx=0).stop 2024-09-17T05:24:49.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 msgr2=0x7fcd140aee00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140aee00 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c006010 tx=0x7fcd0c003f10 comp rx=0 tx=0).stop 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 shutdown_connections 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd1415bae0 0x7fcd140aee00 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fccf80791f0 0x7fccf807b6b0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd14151e30 0x7fcd140ae8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 --2- 172.21.15.81:0/3285410086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd140cc540 0x7fcd140c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.327+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 >> 172.21.15.81:0/3285410086 conn(0x7fcd140b1700 msgr2=0x7fcd140cd700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.328+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 shutdown_connections 2024-09-17T05:24:49.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.328+0000 7fcd1b8cf640 1 -- 172.21.15.81:0/3285410086 wait complete. 2024-09-17T05:24:49.340 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:24:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 -- 172.21.15.81:0/2502970829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c0d0d40 msgr2=0x7f5f9c0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 --2- 172.21.15.81:0/2502970829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c0d0d40 0x7f5f9c0b3800 secure :-1 s=READY pgs=1385 cs=0 l=1 rev1=1 crypto rx=0x7f5f9c08cf10 tx=0x7f5f9402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 -- 172.21.15.81:0/2502970829 shutdown_connections 2024-09-17T05:24:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 --2- 172.21.15.81:0/2502970829 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c0d0d40 0x7f5f9c0b3800 unknown :-1 s=CLOSED pgs=1385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 --2- 172.21.15.81:0/2502970829 >> v2:172.21.15.160:3300/0 conn(0x7f5f9c15df90 0x7f5f9c0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 -- 172.21.15.81:0/2502970829 >> 172.21.15.81:0/2502970829 conn(0x7f5f9c0d3ea0 msgr2=0x7f5f9c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 -- 172.21.15.81:0/2502970829 shutdown_connections 2024-09-17T05:24:49.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.440+0000 7f5fa109b640 1 -- 172.21.15.81:0/2502970829 wait complete. 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.442+0000 7f5fa109b640 1 Processor -- start 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.442+0000 7f5fa109b640 1 -- start start 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5fa109b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f9c0d0d40 0x7f5f9c0b91d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5fa109b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f9c0d49c0 0x7f5f9c0b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5fa109b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c15df90 0x7f5f9c0b8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5fa109b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c162690 con 0x7f5f9c15df90 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5fa109b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5f9c0b3d40 con 0x7f5f9c0d0d40 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5fa109b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5f9c0cde00 con 0x7f5f9c0d49c0 2024-09-17T05:24:49.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c15df90 0x7f5f9c0b8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c15df90 0x7f5f9c0b8260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34980/0 (socket says 172.21.15.81:34980) 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 -- 172.21.15.81:0/386769915 learned_addr learned my addr 172.21.15.81:0/386769915 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 -- 172.21.15.81:0/386769915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f9c0d49c0 msgr2=0x7f5f9c0b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f9c0d49c0 0x7f5f9c0b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 -- 172.21.15.81:0/386769915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f9c0d0d40 msgr2=0x7f5f9c0b91d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9ad9d640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f9c0d0d40 0x7f5f9c0b91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f9c0d0d40 0x7f5f9c0b91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 -- 172.21.15.81:0/386769915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f9c0ce0e0 con 0x7f5f9c15df90 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f9b59e640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c15df90 0x7f5f9c0b8260 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009ca0 tx=0x7f5f94031720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:49.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f93fff640 1 -- 172.21.15.81:0/386769915 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94040070 con 0x7f5f9c15df90 2024-09-17T05:24:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5f93fff640 1 -- 172.21.15.81:0/386769915 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f94004040 con 0x7f5f9c15df90 2024-09-17T05:24:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.443+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f9c14e190 con 0x7f5f9c15df90 2024-09-17T05:24:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.444+0000 7f5f93fff640 1 -- 172.21.15.81:0/386769915 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f94004450 con 0x7f5f9c15df90 2024-09-17T05:24:49.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.444+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f9c0cdab0 con 0x7f5f9c15df90 2024-09-17T05:24:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.444+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f9c08d590 con 0x7f5f9c15df90 2024-09-17T05:24:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.445+0000 7f5f93fff640 1 -- 172.21.15.81:0/386769915 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f5f94039040 con 0x7f5f9c15df90 2024-09-17T05:24:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.446+0000 7f5f93fff640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f7c0791c0 0x7f5f7c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.446+0000 7f5f9ad9d640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f7c0791c0 0x7f5f7c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.446+0000 7f5f93fff640 1 -- 172.21.15.81:0/386769915 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f5f940bce80 con 0x7f5f9c15df90 2024-09-17T05:24:49.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.446+0000 7f5f9ad9d640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f7c0791c0 0x7f5f7c07b680 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00b9a0 tx=0x7f5f8c005c20 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:49.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.450+0000 7f5f93fff640 1 -- 172.21.15.81:0/386769915 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5f94084a20 con 0x7f5f9c15df90 2024-09-17T05:24:49.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.662+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f9c0d4780 con 0x7f5f9c15df90 2024-09-17T05:24:49.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.662+0000 7f5f93fff640 1 -- 172.21.15.81:0/386769915 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 76 v76) ==== 94+0+5227 (secure 0 0 0) 0x7f5f94084320 con 0x7f5f9c15df90 2024-09-17T05:24:49.663 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:24:49.663 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":76,"btime":"2024-09-17T05:24:43:251755+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6958,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/79515014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":79515014},{"type":"v1","addr":"172.21.15.160:6801","nonce":79515014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6961,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3823420234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3823420234},{"type":"v1","addr":"172.21.15.160:6835","nonce":3823420234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3648115084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3648115084},{"type":"v1","addr":"172.21.15.81:6834","nonce":3648115084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:40.594653+0000","modified":"2024-09-17T05:24:42.594562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1714561444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1714561444},{"type":"v1","addr":"172.21.15.81:6835","nonce":1714561444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7917,"qdb_cluster":[7917]},"id":10}]} 2024-09-17T05:24:49.664 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 76 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f7c0791c0 msgr2=0x7f5f7c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f7c0791c0 0x7f5f7c07b680 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f5f8c00b9a0 tx=0x7f5f8c005c20 comp rx=0 tx=0).stop 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c15df90 msgr2=0x7f5f9c0b8260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c15df90 0x7f5f9c0b8260 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f5f94009ca0 tx=0x7f5f94031720 comp rx=0 tx=0).stop 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 shutdown_connections 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f9c15df90 0x7f5f9c0b8260 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f9c0d49c0 0x7f5f9c0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f7c0791c0 0x7f5f7c07b680 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 --2- 172.21.15.81:0/386769915 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f9c0d0d40 0x7f5f9c0b91d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 >> 172.21.15.81:0/386769915 conn(0x7f5f9c0d3ea0 msgr2=0x7f5f9c0b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 shutdown_connections 2024-09-17T05:24:49.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:49.665+0000 7f5fa109b640 1 -- 172.21.15.81:0/386769915 wait complete. 2024-09-17T05:24:50.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 76, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:24:40.594653+0000', 'modified': '2024-09-17T05:24:42.594562+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7917}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7917': {'gid': 7917, 'name': 'c', 'rank': 0, 'incarnation': 74, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.81:6835/1714561444', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 1714561444}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 1714561444}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 7917, 'qdb_cluster': [7917]} 2024-09-17T05:24:50.079 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:24:50.080 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:24:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.186+0000 7f66a61f3640 1 -- 172.21.15.81:0/2953740455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 msgr2=0x7f6688003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.186+0000 7f66a61f3640 1 --2- 172.21.15.81:0/2953740455 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 0x7f6688003e20 secure :-1 s=READY pgs=1388 cs=0 l=1 rev1=1 crypto rx=0x7f669000c260 tx=0x7f6688005830 comp rx=0 tx=0).stop 2024-09-17T05:24:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.186+0000 7f669ffff640 1 -- 172.21.15.81:0/2953740455 reap_dead start 2024-09-17T05:24:50.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.186+0000 7f66a61f3640 1 -- 172.21.15.81:0/2953740455 shutdown_connections 2024-09-17T05:24:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.186+0000 7f66a61f3640 1 -- 172.21.15.81:0/2953740455 >> 172.21.15.81:0/2953740455 conn(0x7f66a00b1690 msgr2=0x7f66a00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.186+0000 7f66a61f3640 1 -- 172.21.15.81:0/2953740455 shutdown_connections 2024-09-17T05:24:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.186+0000 7f66a61f3640 1 -- 172.21.15.81:0/2953740455 wait complete. 2024-09-17T05:24:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.187+0000 7f66a61f3640 1 Processor -- start 2024-09-17T05:24:50.188 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.187+0000 7f66a61f3640 1 -- start start 2024-09-17T05:24:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f66a61f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 0x7f66a0144e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f66a61f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66a0153e70 0x7f66a01542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f66a61f3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66a0145c90 0x7f66a0146120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f66a61f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66a006e760 con 0x7f6688003a00 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f66a61f3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f66a006e5e0 con 0x7f66a0153e70 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f66a61f3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f66a006e8e0 con 0x7f66a0145c90 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 0x7f66a0144e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 0x7f66a0144e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34986/0 (socket says 172.21.15.81:34986) 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 -- 172.21.15.81:0/340070689 learned_addr learned my addr 172.21.15.81:0/340070689 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669effd640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66a0153e70 0x7f66a01542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669ffff640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66a0145c90 0x7f66a0146120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.191 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 -- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66a0145c90 msgr2=0x7f66a0146120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66a0145c90 0x7f66a0146120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 -- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66a0153e70 msgr2=0x7f66a01542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66a0153e70 0x7f66a01542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669f7fe640 1 -- 172.21.15.81:0/340070689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66a01e4c40 con 0x7f6688003a00 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.188+0000 7f669effd640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66a0153e70 0x7f66a01542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.189+0000 7f669f7fe640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 0x7f66a0144e80 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f669000c260 tx=0x7f6690006670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.189+0000 7f6687fff640 1 -- 172.21.15.81:0/340070689 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690032030 con 0x7f6688003a00 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.189+0000 7f6687fff640 1 -- 172.21.15.81:0/340070689 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6690003af0 con 0x7f6688003a00 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.189+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66a01e4f20 con 0x7f6688003a00 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.189+0000 7f6687fff640 1 -- 172.21.15.81:0/340070689 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690037450 con 0x7f6688003a00 2024-09-17T05:24:50.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.189+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66a01e54e0 con 0x7f6688003a00 2024-09-17T05:24:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.191+0000 7f6687fff640 1 -- 172.21.15.81:0/340070689 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f6690035020 con 0x7f6688003a00 2024-09-17T05:24:50.195 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.191+0000 7f6687fff640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c0791c0 0x7f668c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.191+0000 7f669effd640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c0791c0 0x7f668c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.191+0000 7f6687fff640 1 -- 172.21.15.81:0/340070689 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f66900bbc40 con 0x7f6688003a00 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.192+0000 7f669effd640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c0791c0 0x7f668c07b680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f669400abd0 tx=0x7f6694005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.192+0000 7f66a8fc5740 1 Processor -- start 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.192+0000 7f66a8fc5740 1 -- start start 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0393b1b0 0x55fd03912b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd0395b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd039105f0 0x55fd03910a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd03887820 con 0x55fd0393b1b0 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fd03876c50 con 0x55fd039105f0 2024-09-17T05:24:50.196 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55fd0387aa60 con 0x55fd0395adf0 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0393b1b0 0x55fd03912b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0393b1b0 0x55fd03912b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34988/0 (socket says 172.21.15.81:34988) 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 -- 172.21.15.81:0/588823267 learned_addr learned my addr 172.21.15.81:0/588823267 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 -- 172.21.15.81:0/588823267 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 msgr2=0x55fd0395b1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 --2- 172.21.15.81:0/588823267 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd0395b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 -- 172.21.15.81:0/588823267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd039105f0 msgr2=0x55fd03910a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 --2- 172.21.15.81:0/588823267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd039105f0 0x55fd03910a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 -- 172.21.15.81:0/588823267 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd035d8850 con 0x55fd0393b1b0 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f669f7fe640 1 --2- 172.21.15.81:0/588823267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0393b1b0 0x55fd03912b20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f669002b020 tx=0x7f6690082e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7f2513c0b9fe8ce server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66857fa640 1 -- 172.21.15.81:0/588823267 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6690083700 con 0x55fd0393b1b0 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66857fa640 1 -- 172.21.15.81:0/588823267 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6690083000 con 0x55fd0393b1b0 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.193+0000 7f66857fa640 1 -- 172.21.15.81:0/588823267 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900a9330 con 0x55fd0393b1b0 2024-09-17T05:24:50.197 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 -- 172.21.15.81:0/588823267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0393b1b0 msgr2=0x55fd03912b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/588823267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0393b1b0 0x55fd03912b20 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7f669002b020 tx=0x7f6690082e90 comp rx=0 tx=0).stop 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 -- 172.21.15.81:0/588823267 shutdown_connections 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/588823267 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd039105f0 0x55fd03910a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/588823267 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd0395b1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/588823267 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0393b1b0 0x55fd03912b20 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 -- 172.21.15.81:0/588823267 >> 172.21.15.81:0/588823267 conn(0x55fd039116a0 msgr2=0x55fd039150c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 -- 172.21.15.81:0/588823267 shutdown_connections 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.194+0000 7f66a8fc5740 1 -- 172.21.15.81:0/588823267 wait complete. 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 -- start start 2024-09-17T05:24:50.198 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 Processor -- start 2024-09-17T05:24:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd0393f410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03933350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd03934d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.202 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd035e7620 con 0x55fd039348c0 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fd0381c5f0 con 0x55fd0393b1b0 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.195+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55fd03876c50 con 0x55fd0395adf0 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f66a8fc5740 10 client.0 _ll_register_callbacks cb 0x55fd038200a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd03934d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd03934d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34990/0 (socket says 172.21.15.81:34990) 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 -- 172.21.15.81:0/3338473552 learned_addr learned my addr 172.21.15.81:0/3338473552 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669f7fe640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd0393f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669effd640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03933350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 -- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 msgr2=0x55fd03933350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03933350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 -- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 msgr2=0x55fd0393f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd0393f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 -- 172.21.15.81:0/3338473552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd0364f6b0 con 0x55fd039348c0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669effd640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03933350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f669ffff640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd03934d20 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f66a0154d40 tx=0x7f66980117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9561f02bcc38557e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f667e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f667e7fc640 1 -- 172.21.15.81:0/3338473552 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698003d80 con 0x55fd039348c0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f667e7fc640 1 -- 172.21.15.81:0/3338473552 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f6698004ab0 con 0x55fd039348c0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6690083000 con 0x55fd039348c0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f667e7fc640 1 -- 172.21.15.81:0/3338473552 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f6698021050 con 0x55fd039348c0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f66a8fc5740 10 client.8073 fetch_fsmap learned FSMap version 76 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x55fd0393e0c0 con 0x55fd039348c0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f667e7fc640 1 -- 172.21.15.81:0/3338473552 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6690083000 con 0x55fd039348c0 2024-09-17T05:24:50.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.196+0000 7f667e7fc640 1 -- 172.21.15.81:0/3338473552 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f6698024020 con 0x55fd039348c0 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f66a8fc5740 10 client.8073 fetch_fsmap finished waiting for FSMap version 76 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f66a8fc5740 10 client.8073 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f66a8fc5740 20 client.8073 populate_metadata read hostname 'smithi081' 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039554b0 0x55fd03955890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f66a8fc5740 4 client.8073 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 --> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd03889770 con 0x55fd039554b0 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f669f7fe640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039554b0 0x55fd03955890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f667e7fc640 10 client.8073 ms_handle_connect on v2:172.21.15.81:6833/1714561444 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.197+0000 7f669f7fe640 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039554b0 0x55fd03955890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ea49b69d71cee32 server_cookie=425076c9d80cbd5d in_seq=0 out_seq=0 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f667e7fc640 1 -- 172.21.15.81:0/3338473552 <== mds.0 v2:172.21.15.81:6833/1714561444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55fd03889770 con 0x55fd039554b0 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f667e7fc640 10 client.8073 handle_command_reply: tid=0 2024-09-17T05:24:50.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 client.8073 shutdown 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 msgr2=0x55fd03934d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd03934d20 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7f66a0154d40 tx=0x7f66980117b0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 shutdown_connections 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039554b0 0x55fd03955890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd03934d20 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03933350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f667e7fc640 0 client.8073 ms_handle_reset on v2:172.21.15.81:6833/1714561444 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/3338473552 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd0393f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 >> 172.21.15.81:0/3338473552 conn(0x55fd039105f0 msgr2=0x55fd03914ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 shutdown_connections 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 1 -- 172.21.15.81:0/3338473552 wait complete. 2024-09-17T05:24:50.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.198+0000 7f66a8fc5740 20 client.8073 trim_cache size 0 max 16384 2024-09-17T05:24:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.216+0000 7f66a8fc5740 1 Processor -- start 2024-09-17T05:24:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.216+0000 7f66a8fc5740 1 -- start start 2024-09-17T05:24:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd039109d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03910f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.219 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03955ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01fe7b0 con 0x55fd039348c0 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f66a01e6c80 con 0x55fd0393b1b0 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f66a01fe160 con 0x55fd0395adf0 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd039109d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd039109d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35002/0 (socket says 172.21.15.81:35002) 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 -- 172.21.15.81:0/1260354870 learned_addr learned my addr 172.21.15.81:0/1260354870 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669ffff640 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03955ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669effd640 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03910f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 -- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 msgr2=0x55fd03955ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03955ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.220 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 -- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 msgr2=0x55fd03910f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03910f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 -- 172.21.15.81:0/1260354870 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd0390f510 con 0x55fd039348c0 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f669f7fe640 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd039109d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f6690031040 tx=0x7f669006c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32be660e1943e4c server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f6684ff9640 1 -- 172.21.15.81:0/1260354870 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f669009b070 con 0x55fd039348c0 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f6684ff9640 1 -- 172.21.15.81:0/1260354870 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6690087ae0 con 0x55fd039348c0 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.217+0000 7f6684ff9640 1 -- 172.21.15.81:0/1260354870 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66900a9330 con 0x55fd039348c0 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 -- 172.21.15.81:0/1260354870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 msgr2=0x55fd039109d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd039109d0 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7f6690031040 tx=0x7f669006c040 comp rx=0 tx=0).stop 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 -- 172.21.15.81:0/1260354870 shutdown_connections 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd0395adf0 0x55fd03955ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03910f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/1260354870 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd039348c0 0x55fd039109d0 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 -- 172.21.15.81:0/1260354870 >> 172.21.15.81:0/1260354870 conn(0x55fd039105f0 msgr2=0x55fd0395b3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 -- 172.21.15.81:0/1260354870 shutdown_connections 2024-09-17T05:24:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.218+0000 7f66a8fc5740 1 -- 172.21.15.81:0/1260354870 wait complete. 2024-09-17T05:24:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 -- start start 2024-09-17T05:24:50.222 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 Processor -- start 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd039348c0 0x55fd0397ca80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03955a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0395adf0 0x55fd03912b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55fd0393d350 con 0x55fd0395adf0 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55fd03887820 con 0x55fd0393b1b0 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55fd03936950 con 0x55fd039348c0 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f66a8fc5740 10 client.0 _ll_register_callbacks cb 0x7f6698009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:24:50.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.219+0000 7f669ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0395adf0 0x55fd03912b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0395adf0 0x55fd03912b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35008/0 (socket says 172.21.15.81:35008) 2024-09-17T05:24:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 -- 172.21.15.81:0/126957780 learned_addr learned my addr 172.21.15.81:0/126957780 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669f7fe640 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd039348c0 0x55fd0397ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669effd640 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03955a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 -- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd039348c0 msgr2=0x55fd0397ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd039348c0 0x55fd0397ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 -- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 msgr2=0x55fd03955a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03955a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 -- 172.21.15.81:0/126957780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd03915ae0 con 0x55fd0395adf0 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f669ffff640 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0395adf0 0x55fd03912b20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f66a0154d40 tx=0x7f6698004ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab4ab1603c5e22a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f667e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f667e7fc640 1 -- 172.21.15.81:0/126957780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6698033060 con 0x55fd0395adf0 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f667e7fc640 1 -- 172.21.15.81:0/126957780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f6698003b80 con 0x55fd0395adf0 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6690087ae0 con 0x55fd0395adf0 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f667e7fc640 1 -- 172.21.15.81:0/126957780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=76) ==== 24+0+0 (secure 0 0 0) 0x7f6698039050 con 0x55fd0395adf0 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f66a8fc5740 10 client.8079 fetch_fsmap learned FSMap version 76 2024-09-17T05:24:50.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=76,monmap=2+}) -- 0x55fd0392de40 con 0x55fd0395adf0 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.220+0000 7f667e7fc640 1 -- 172.21.15.81:0/126957780 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6690087ae0 con 0x55fd0395adf0 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f667e7fc640 1 -- 172.21.15.81:0/126957780 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 76) ==== 3502+0+0 (secure 0 0 0) 0x7f669803c020 con 0x55fd0395adf0 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 10 client.8079 fetch_fsmap finished waiting for FSMap version 76 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 10 client.8079 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 20 client.8079 populate_metadata read hostname 'smithi081' 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039d9ae0 0x55fd039d9ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 4 client.8079 mds_command: new command op to 7917 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 --> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] -- command(tid 0: {"prefix": "status"}) -- 0x55fd03885220 con 0x55fd039d9ae0 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f669f7fe640 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039d9ae0 0x55fd039d9ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f667e7fc640 10 client.8079 ms_handle_connect on v2:172.21.15.81:6833/1714561444 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f669f7fe640 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039d9ae0 0x55fd039d9ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9f725ba29bf55537 server_cookie=a00fccce5a614eeb in_seq=0 out_seq=0 2024-09-17T05:24:50.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f667e7fc640 1 -- 172.21.15.81:0/126957780 <== mds.0 v2:172.21.15.81:6833/1714561444 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x55fd03885220 con 0x55fd039d9ae0 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f667e7fc640 10 client.8079 handle_command_reply: tid=0 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 client.8079 shutdown 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0395adf0 msgr2=0x55fd03912b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0395adf0 0x55fd03912b20 secure :-1 s=READY pgs=1393 cs=0 l=1 rev1=1 crypto rx=0x7f66a0154d40 tx=0x7f6698004ea0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 shutdown_connections 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:6833/1714561444,v1:172.21.15.81:6835/1714561444] conn(0x55fd039d9ae0 0x55fd039d9ec0 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55fd0395adf0 0x55fd03912b20 unknown :-1 s=CLOSED pgs=1393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55fd0393b1b0 0x55fd03955a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f667e7fc640 0 client.8079 ms_handle_reset on v2:172.21.15.81:6833/1714561444 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 --2- 172.21.15.81:0/126957780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55fd039348c0 0x55fd0397ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 >> 172.21.15.81:0/126957780 conn(0x55fd039105f0 msgr2=0x55fd0390abe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 shutdown_connections 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.221+0000 7f66a8fc5740 1 -- 172.21.15.81:0/126957780 wait complete. 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a8fc5740 20 client.8079 trim_cache size 0 max 16384 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 7917, 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:24:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:24:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:24:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 8.9733932240000005, 2024-09-17T05:24:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 76, 2024-09-17T05:24:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 129, 2024-09-17T05:24:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 129, 2024-09-17T05:24:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 12.740001229000001 2024-09-17T05:24:50.233 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:24:50.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c0791c0 msgr2=0x7f668c07b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c0791c0 0x7f668c07b680 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f669400abd0 tx=0x7f6694005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 msgr2=0x7f66a0144e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 0x7f66a0144e80 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7f669000c260 tx=0x7f6690006670 comp rx=0 tx=0).stop 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 shutdown_connections 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66a0145c90 0x7f66a0146120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c0791c0 0x7f668c07b680 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66a0153e70 0x7f66a01542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 --2- 172.21.15.81:0/340070689 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6688003a00 0x7f66a0144e80 unknown :-1 s=CLOSED pgs=1389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 >> 172.21.15.81:0/340070689 conn(0x7f66a00b1690 msgr2=0x7f66a00af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 shutdown_connections 2024-09-17T05:24:50.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.222+0000 7f66a61f3640 1 -- 172.21.15.81:0/340070689 wait complete. 2024-09-17T05:24:50.236 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:24:50.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.336+0000 7f88f935a640 1 -- 172.21.15.81:0/2593069357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 msgr2=0x7f88dc004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.336+0000 7f88f935a640 1 --2- 172.21.15.81:0/2593069357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88dc004c80 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7f88e8009b20 tx=0x7f88dc005830 comp rx=0 tx=0).stop 2024-09-17T05:24:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.336+0000 7f88f935a640 1 -- 172.21.15.81:0/2593069357 shutdown_connections 2024-09-17T05:24:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.336+0000 7f88f935a640 1 --2- 172.21.15.81:0/2593069357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88dc004c80 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.336+0000 7f88f935a640 1 -- 172.21.15.81:0/2593069357 >> 172.21.15.81:0/2593069357 conn(0x7f88f40d0c20 msgr2=0x7f88f40d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.336+0000 7f88f935a640 1 -- 172.21.15.81:0/2593069357 shutdown_connections 2024-09-17T05:24:50.338 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.336+0000 7f88f935a640 1 -- 172.21.15.81:0/2593069357 wait complete. 2024-09-17T05:24:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 Processor -- start 2024-09-17T05:24:50.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 -- start start 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88f415d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88f40c4ca0 0x7f88f40ca590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88f40caad0 0x7f88f4158590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88f4073860 con 0x7f88dc004800 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f88f40736e0 con 0x7f88f40caad0 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.338+0000 7f88f935a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f88f40739e0 con 0x7f88f40c4ca0 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88f415d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88f415d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35030/0 (socket says 172.21.15.81:35030) 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 -- 172.21.15.81:0/3036540628 learned_addr learned my addr 172.21.15.81:0/3036540628 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f27fc640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88f40c4ca0 0x7f88f40ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f37fe640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88f40caad0 0x7f88f4158590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 -- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88f40c4ca0 msgr2=0x7f88f40ca590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88f40c4ca0 0x7f88f40ca590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 -- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88f40caad0 msgr2=0x7f88f4158590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88f40caad0 0x7f88f4158590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 -- 172.21.15.81:0/3036540628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88f41f1680 con 0x7f88dc004800 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f2ffd640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88f415d720 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f88e4006690 tx=0x7f88e40016f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88db7fe640 1 -- 172.21.15.81:0/3036540628 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4015070 con 0x7f88dc004800 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88db7fe640 1 -- 172.21.15.81:0/3036540628 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f88e4011900 con 0x7f88dc004800 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f88f41f1960 con 0x7f88dc004800 2024-09-17T05:24:50.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88db7fe640 1 -- 172.21.15.81:0/3036540628 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88e4011d30 con 0x7f88dc004800 2024-09-17T05:24:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.339+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88f41f1f20 con 0x7f88dc004800 2024-09-17T05:24:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.340+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88f4073f40 con 0x7f88dc004800 2024-09-17T05:24:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.341+0000 7f88db7fe640 1 -- 172.21.15.81:0/3036540628 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f88e4018070 con 0x7f88dc004800 2024-09-17T05:24:50.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.341+0000 7f88db7fe640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f88e00791c0 0x7f88e007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.341+0000 7f88db7fe640 1 -- 172.21.15.81:0/3036540628 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f88e409c660 con 0x7f88dc004800 2024-09-17T05:24:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.341+0000 7f88f27fc640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f88e00791c0 0x7f88e007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.342+0000 7f88f27fc640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f88e00791c0 0x7f88e007b680 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f88e8035000 tx=0x7f88e802d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.346+0000 7f88db7fe640 1 -- 172.21.15.81:0/3036540628 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f88e4064090 con 0x7f88dc004800 2024-09-17T05:24:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.559+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f88f40706c0 con 0x7f88dc004800 2024-09-17T05:24:50.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.559+0000 7f88db7fe640 1 -- 172.21.15.81:0/3036540628 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7f88e4063990 con 0x7f88dc004800 2024-09-17T05:24:50.561 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f88e00791c0 msgr2=0x7f88e007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f88e00791c0 0x7f88e007b680 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f88e8035000 tx=0x7f88e802d040 comp rx=0 tx=0).stop 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 msgr2=0x7f88f415d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88f415d720 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f88e4006690 tx=0x7f88e40016f0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 shutdown_connections 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f88e00791c0 0x7f88e007b680 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f88f40caad0 0x7f88f4158590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88f40c4ca0 0x7f88f40ca590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 --2- 172.21.15.81:0/3036540628 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88dc004800 0x7f88f415d720 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 >> 172.21.15.81:0/3036540628 conn(0x7f88f40d0c20 msgr2=0x7f88f40b2b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 shutdown_connections 2024-09-17T05:24:50.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50.562+0000 7f88f935a640 1 -- 172.21.15.81:0/3036540628 wait complete. 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:24:50.574 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:24:50.574 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:50.575 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:24:50.590 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:50.591 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42427sec preferred_lft 42427sec 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:50.592 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:50.593 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:24:50.594 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:50.594 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:50.594 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:24:50.654 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:24:50.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:50.656 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:24:50.712 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:24:50.712 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:24:50.712 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:24:50.712 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:24:50.712 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:24:50.713 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:24:50.713 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:24:50.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:24:50.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:24:50.713 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:24:50.713 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:24:50.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:24:50.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:50.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:50.838 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:24:50.853 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:24:50.854 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:24:50.854 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:24:50.854 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:50.854 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:24:50.918 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:24:50.919 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:50.919 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:50.975 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:24:50.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:50.976 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:51.030 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:24:51.095 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:51.151 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:24:51.151 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:24:51.151 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:24:51.151 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:24:51.151 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:24:51.152 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:51.153 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:51.154 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:51.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:51.155 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:24:51.210 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:24:51.211 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:24:51.249 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:24:51.273 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:51.330 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:24:51.330 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:24:51.330 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:24:51.331 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:24:51.332 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:24:51.333 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:51.334 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:24:51.334 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:51.334 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:24:51.334 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:51.334 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:24:51.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:24:51.331+0000 7f7022e0c480 -1 init, newargv = 0x555773f69510 newargc=15 2024-09-17T05:24:51.335 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[72738]: starting ceph client 2024-09-17T05:24:51.339 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[72738]: starting fuse 2024-09-17T05:24:51.351 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:24:51.351 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:51.352 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:24:51.353 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:24:51.354 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:24:51.469 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.72738.asok 2024-09-17T05:24:51.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:51.479 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.72738.asok 2024-09-17T05:24:51.479 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:51.480 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.72738.asok status 2024-09-17T05:24:51.611 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "72738", 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:24:51.612 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8091, 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8091 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1492599000 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:51.613 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 1492599000 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.8091 192.168.0.1:0/1492599000", 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/1492599000", 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 76, 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 129, 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:24:51.614 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:24:51.615 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:24:51.615 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:24:51.620 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:51.620 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:24:51.620 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:51.636 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:24:51.636 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:51.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:51.636 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:24:51.701 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:24:51.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.841+0000 7f1987310640 1 -- 172.21.15.81:0/310982617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 msgr2=0x7f198015fc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:51.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.841+0000 7f1987310640 1 --2- 172.21.15.81:0/310982617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f198015fc90 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f1978005fd0 tx=0x7f197802aa00 comp rx=0 tx=0).stop 2024-09-17T05:24:51.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.841+0000 7f1987310640 1 -- 172.21.15.81:0/310982617 shutdown_connections 2024-09-17T05:24:51.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.841+0000 7f1987310640 1 --2- 172.21.15.81:0/310982617 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f198015fc90 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:51.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.841+0000 7f1987310640 1 --2- 172.21.15.81:0/310982617 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19800cc490 0x7f198015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:51.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.841+0000 7f1987310640 1 -- 172.21.15.81:0/310982617 >> 172.21.15.81:0/310982617 conn(0x7f19800b1690 msgr2=0x7f19800b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:51.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.842+0000 7f1987310640 1 -- 172.21.15.81:0/310982617 shutdown_connections 2024-09-17T05:24:51.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.842+0000 7f1987310640 1 -- 172.21.15.81:0/310982617 wait complete. 2024-09-17T05:24:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 Processor -- start 2024-09-17T05:24:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 -- start start 2024-09-17T05:24:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19800cc490 0x7f1980154580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f1980154d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:51.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1980159680 0x7f19800738b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19800cec40 con 0x7f19800cc8d0 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f19800ceac0 con 0x7f1980159680 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.843+0000 7f1987310640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f19800cedc0 con 0x7f19800cc490 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f1980154d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f1980154d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:35040/0 (socket says 172.21.15.81:35040) 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 -- 172.21.15.81:0/3634552581 learned_addr learned my addr 172.21.15.81:0/3634552581 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19858ad640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1980159680 0x7f19800738b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19850ac640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19800cc490 0x7f1980154580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 -- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19800cc490 msgr2=0x7f1980154580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19800cc490 0x7f1980154580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:51.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 -- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1980159680 msgr2=0x7f19800738b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1980159680 0x7f19800738b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 -- 172.21.15.81:0/3634552581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19801f4ed0 con 0x7f19800cc8d0 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f19848ab640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f1980154d10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f197c00b4a0 tx=0x7f197c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f1971ffb640 1 -- 172.21.15.81:0/3634552581 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c014070 con 0x7f19800cc8d0 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f1971ffb640 1 -- 172.21.15.81:0/3634552581 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f197c010700 con 0x7f19800cc8d0 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19801f8950 con 0x7f19800cc8d0 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f1971ffb640 1 -- 172.21.15.81:0/3634552581 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f197c010b50 con 0x7f19800cc8d0 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.844+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19801f8f10 con 0x7f19800cc8d0 2024-09-17T05:24:51.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.845+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19801f50a0 con 0x7f19800cc8d0 2024-09-17T05:24:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.846+0000 7f1971ffb640 1 -- 172.21.15.81:0/3634552581 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f197c017070 con 0x7f19800cc8d0 2024-09-17T05:24:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.847+0000 7f1971ffb640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19640791c0 0x7f196407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.847+0000 7f1971ffb640 1 -- 172.21.15.81:0/3634552581 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f197c09b390 con 0x7f19800cc8d0 2024-09-17T05:24:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.847+0000 7f19850ac640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19640791c0 0x7f196407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:51.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.847+0000 7f19850ac640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19640791c0 0x7f196407b680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1974006fd0 tx=0x7f1974009060 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:51.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:51.851+0000 7f1971ffb640 1 -- 172.21.15.81:0/3634552581 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f197c062770 con 0x7f19800cc8d0 2024-09-17T05:24:52.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.064+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f19801f9250 con 0x7f19800cc8d0 2024-09-17T05:24:52.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.065+0000 7f1971ffb640 1 -- 172.21.15.81:0/3634552581 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v76) ==== 53+0+73 (secure 0 0 0) 0x7f197c0671a0 con 0x7f19800cc8d0 2024-09-17T05:24:52.099 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:24:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19640791c0 msgr2=0x7f196407b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19640791c0 0x7f196407b680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f1974006fd0 tx=0x7f1974009060 comp rx=0 tx=0).stop 2024-09-17T05:24:52.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 msgr2=0x7f1980154d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f1980154d10 secure :-1 s=READY pgs=1401 cs=0 l=1 rev1=1 crypto rx=0x7f197c00b4a0 tx=0x7f197c00b960 comp rx=0 tx=0).stop 2024-09-17T05:24:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 shutdown_connections 2024-09-17T05:24:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19640791c0 0x7f196407b680 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1980159680 0x7f19800738b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19800cc8d0 0x7f1980154d10 unknown :-1 s=CLOSED pgs=1401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:52.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 --2- 172.21.15.81:0/3634552581 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19800cc490 0x7f1980154580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:52.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 >> 172.21.15.81:0/3634552581 conn(0x7f19800b1690 msgr2=0x7f19800aed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:52.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 shutdown_connections 2024-09-17T05:24:52.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:52.067+0000 7f1987310640 1 -- 172.21.15.81:0/3634552581 wait complete. 2024-09-17T05:24:52.104 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:24:52.105 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:24:52.105 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:24:52.105 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:24:52.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:52.105 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:24:52.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:24:52.106 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:24:52.106 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:24:52.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:52.106 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:24:52.128 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:52.129 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42423sec preferred_lft 42423sec 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:24:52.130 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:24:52.131 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:24:52.132 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:52.132 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:24:52.197 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:24:52.198 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:52.199 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:24:52.260 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:24:52.260 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:24:52.260 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:24:52.260 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:24:52.261 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:24:52.261 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:24:52.261 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:24:52.261 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:24:52.261 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:24:52.261 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:24:52.261 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:24:52.354 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:24:52 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:24:52.388 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:24:52 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:52.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:52.395 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:24:52.410 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:24:52.410 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:24:52.411 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:24:52.411 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:52.411 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:24:52.476 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:24:52.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:52.476 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:52.532 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:24:52.532 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:24:52.532 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:52.588 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:24:52.654 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:52.711 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:24:52.711 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:24:52.712 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:24:52.712 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:24:52.712 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:24:52.712 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:24:52.712 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:24:52.713 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:24:52.713 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:24:52.713 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:24:52.713 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:24:52.713 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:24:52.714 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:52.714 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:24:52.714 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:24:52.714 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:24:52.714 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:24:52.714 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:52.715 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:24:52.715 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:52.715 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:52.715 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:52.715 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:52.715 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:24:52.716 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:24:52.716 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:24:52.716 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:24:52.716 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:24:52.716 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:24:52.717 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:24:52.717 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:52.717 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:52.717 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:52.717 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:52.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:52.719 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:24:52.766 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:24:52.767 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:24:52.809 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:24:52.836 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:24:52.889 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:24:52.888+0000 7fbf32812480 -1 init, newargv = 0x557df95ba550 newargc=15 2024-09-17T05:24:52.890 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[48692]: starting ceph client 2024-09-17T05:24:52.893 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:24:52.893 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:24:52.893 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:24:52.893 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:24:52.893 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:24:52.894 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:24:52.895 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:24:52.896 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:24:52.896 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:24:52.896 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:52.896 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:24:52.896 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:52.896 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:24:52.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:52.896 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:24:52.897 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[48692]: starting fuse 2024-09-17T05:24:52.911 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:24:52.911 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:24:52.912 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:24:52.913 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:24:52.914 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:24:52.914 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:24:52.914 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:24:52.914 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:24:53.029 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.48692.asok 2024-09-17T05:24:53.031 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:24:53 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:24:53.039 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.48692.asok 2024-09-17T05:24:53.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:53.039 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.48692.asok status 2024-09-17T05:24:53.172 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:24:53.172 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:24:53.172 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:24:53.172 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:24:53.172 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:24:53.172 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:24:53.172 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "48692", 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 6626, 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:24:53.173 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 6626 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 2812402476 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:24:53.174 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 2812402476 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.6626 192.168.0.1:0/2812402476", 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/2812402476", 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 76, 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 129, 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:24:53.175 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:24:53.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:53.180 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:24:53.180 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:53.196 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:24:53.196 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:53.196 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:24:53.196 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:24:53.261 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:24:53.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 -- 172.21.15.81:0/665266964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb41616e0 msgr2=0x7f4bb40d1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/665266964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb41616e0 0x7f4bb40d1ea0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f4ba0009830 tx=0x7f4ba002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 -- 172.21.15.81:0/665266964 shutdown_connections 2024-09-17T05:24:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/665266964 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb41616e0 0x7f4bb40d1ea0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/665266964 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb4161300 0x7f4bb40d4940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 -- 172.21.15.81:0/665266964 >> 172.21.15.81:0/665266964 conn(0x7f4bb40d3e20 msgr2=0x7f4bb40d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 -- 172.21.15.81:0/665266964 shutdown_connections 2024-09-17T05:24:53.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.378+0000 7f4bbaabd640 1 -- 172.21.15.81:0/665266964 wait complete. 2024-09-17T05:24:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.379+0000 7f4bbaabd640 1 Processor -- start 2024-09-17T05:24:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.379+0000 7f4bbaabd640 1 -- start start 2024-09-17T05:24:53.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bbaabd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb40d23e0 0x7f4bb40c9520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bbaabd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb4161300 0x7f4bb41f86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bbaabd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bb41616e0 0x7f4bb40cd170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bbaabd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb40d2c20 con 0x7f4bb41616e0 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bbaabd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4bb40d2aa0 con 0x7f4bb4161300 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bbaabd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4bb40d0cc0 con 0x7f4bb40d23e0 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bb905a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bb41616e0 0x7f4bb40cd170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bb905a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bb41616e0 0x7f4bb40cd170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39640/0 (socket says 172.21.15.81:39640) 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bb905a640 1 -- 172.21.15.81:0/1838379982 learned_addr learned my addr 172.21.15.81:0/1838379982 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bb8859640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb40d23e0 0x7f4bb40c9520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.380+0000 7f4bb3fff640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb4161300 0x7f4bb41f86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb905a640 1 -- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb40d23e0 msgr2=0x7f4bb40c9520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb905a640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb40d23e0 0x7f4bb40c9520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb905a640 1 -- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb4161300 msgr2=0x7f4bb41f86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb905a640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb4161300 0x7f4bb41f86b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb905a640 1 -- 172.21.15.81:0/1838379982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bb40ca760 con 0x7f4bb41616e0 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb905a640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bb41616e0 0x7f4bb40cd170 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00cbc0 tx=0x7f4bac00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb17fa640 1 -- 172.21.15.81:0/1838379982 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac016020 con 0x7f4bb41616e0 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb17fa640 1 -- 172.21.15.81:0/1838379982 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4bac00add0 con 0x7f4bb41616e0 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bb40ca480 con 0x7f4bb41616e0 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bb17fa640 1 -- 172.21.15.81:0/1838379982 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4bac012680 con 0x7f4bb41616e0 2024-09-17T05:24:53.384 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.381+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bb40c8d20 con 0x7f4bb41616e0 2024-09-17T05:24:53.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.382+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bb40d11e0 con 0x7f4bb41616e0 2024-09-17T05:24:53.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.383+0000 7f4bb17fa640 1 -- 172.21.15.81:0/1838379982 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f4bac019020 con 0x7f4bb41616e0 2024-09-17T05:24:53.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.383+0000 7f4bb17fa640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b980791c0 0x7f4b9807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.383+0000 7f4bb17fa640 1 -- 172.21.15.81:0/1838379982 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f4bac09bbd0 con 0x7f4bb41616e0 2024-09-17T05:24:53.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.383+0000 7f4bb8859640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b980791c0 0x7f4b9807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.384+0000 7f4bb8859640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b980791c0 0x7f4b9807b680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80095f0 tx=0x7f4ba8005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:53.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.388+0000 7f4bb17fa640 1 -- 172.21.15.81:0/1838379982 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4bac020030 con 0x7f4bb41616e0 2024-09-17T05:24:53.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.600+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4bb406ec10 con 0x7f4bb41616e0 2024-09-17T05:24:53.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.652+0000 7f4bb17fa640 1 -- 172.21.15.81:0/1838379982 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v77) ==== 136+0+0 (secure 0 0 0) 0x7f4bac062fb0 con 0x7f4bb41616e0 2024-09-17T05:24:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b980791c0 msgr2=0x7f4b9807b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b980791c0 0x7f4b9807b680 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f4ba80095f0 tx=0x7f4ba8005f90 comp rx=0 tx=0).stop 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bb41616e0 msgr2=0x7f4bb40cd170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bb41616e0 0x7f4bb40cd170 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7f4bac00cbc0 tx=0x7f4bac00a430 comp rx=0 tx=0).stop 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 shutdown_connections 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4bb41616e0 0x7f4bb40cd170 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b980791c0 0x7f4b9807b680 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4bb4161300 0x7f4bb41f86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 --2- 172.21.15.81:0/1838379982 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4bb40d23e0 0x7f4bb40c9520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 >> 172.21.15.81:0/1838379982 conn(0x7f4bb40d3e20 msgr2=0x7f4bb40b8b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:53.656 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 shutdown_connections 2024-09-17T05:24:53.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.654+0000 7f4bbaabd640 1 -- 172.21.15.81:0/1838379982 wait complete. 2024-09-17T05:24:53.667 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 -- 172.21.15.81:0/3946479721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f8070690 msgr2=0x7f51f80739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 --2- 172.21.15.81:0/3946479721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f8070690 0x7f51f80739d0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7f51f80b26e0 tx=0x7f51f002aac0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 -- 172.21.15.81:0/3946479721 shutdown_connections 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 --2- 172.21.15.81:0/3946479721 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f8070690 0x7f51f80739d0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 --2- 172.21.15.81:0/3946479721 >> v2:172.21.15.160:3300/0 conn(0x7f51f815aa70 0x7f51f80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 -- 172.21.15.81:0/3946479721 >> 172.21.15.81:0/3946479721 conn(0x7f51f80b1690 msgr2=0x7f51f80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 -- 172.21.15.81:0/3946479721 shutdown_connections 2024-09-17T05:24:53.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.767+0000 7f5200039640 1 -- 172.21.15.81:0/3946479721 wait complete. 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 Processor -- start 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 -- start start 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f8070690 0x7f51f80cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f80735a0 0x7f51f80c8d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51f815aa70 0x7f51f81571a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f51f80cd270 con 0x7f51f80735a0 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f51f80cd0f0 con 0x7f51f8070690 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f5200039640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f51f80cd3f0 con 0x7f51f815aa70 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f51fd5d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f80735a0 0x7f51f80c8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f51fd5d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f80735a0 0x7f51f80c8d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39662/0 (socket says 172.21.15.81:39662) 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f51fd5d4640 1 -- 172.21.15.81:0/3888472908 learned_addr learned my addr 172.21.15.81:0/3888472908 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.769+0000 7f51fddd5640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f8070690 0x7f51f80cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51fe5d6640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51f815aa70 0x7f51f81571a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51fd5d4640 1 -- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51f815aa70 msgr2=0x7f51f81571a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51fd5d4640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51f815aa70 0x7f51f81571a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51fd5d4640 1 -- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f8070690 msgr2=0x7f51f80cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51fd5d4640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f8070690 0x7f51f80cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51fd5d4640 1 -- 172.21.15.81:0/3888472908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51f81f4790 con 0x7f51f80735a0 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51fd5d4640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f80735a0 0x7f51f80c8d10 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c450 tx=0x7f51e800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51ee7fc640 1 -- 172.21.15.81:0/3888472908 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8017070 con 0x7f51f80735a0 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51ee7fc640 1 -- 172.21.15.81:0/3888472908 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f51e80053c0 con 0x7f51f80735a0 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51f81f8210 con 0x7f51f80735a0 2024-09-17T05:24:53.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f51ee7fc640 1 -- 172.21.15.81:0/3888472908 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51e8003850 con 0x7f51f80735a0 2024-09-17T05:24:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.770+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51f81f87d0 con 0x7f51f80735a0 2024-09-17T05:24:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.771+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51f80ce0d0 con 0x7f51f80735a0 2024-09-17T05:24:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.772+0000 7f51ee7fc640 1 -- 172.21.15.81:0/3888472908 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f51e801a070 con 0x7f51f80735a0 2024-09-17T05:24:53.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.772+0000 7f51ee7fc640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f51dc0791f0 0x7f51dc07b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.772+0000 7f51ee7fc640 1 -- 172.21.15.81:0/3888472908 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f51e809ac00 con 0x7f51f80735a0 2024-09-17T05:24:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.772+0000 7f51fddd5640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f51dc0791f0 0x7f51dc07b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:53.775 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.773+0000 7f51fddd5640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f51dc0791f0 0x7f51dc07b6b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51f8151cc0 tx=0x7f51f400b2e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:53.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.777+0000 7f51ee7fc640 1 -- 172.21.15.81:0/3888472908 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f51e8062070 con 0x7f51f80735a0 2024-09-17T05:24:53.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.976+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f51f80b2fa0 con 0x7f51dc0791f0 2024-09-17T05:24:53.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.977+0000 7f51ee7fc640 1 -- 172.21.15.81:0/3888472908 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f51f80b2fa0 con 0x7f51dc0791f0 2024-09-17T05:24:53.978 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:24:53.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:24:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:24:53.979 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:24:53.979 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.979+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f51dc0791f0 msgr2=0x7f51dc07b6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.979+0000 7f5200039640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f51dc0791f0 0x7f51dc07b6b0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f51f8151cc0 tx=0x7f51f400b2e0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.979+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f80735a0 msgr2=0x7f51f80c8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.979+0000 7f5200039640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f80735a0 0x7f51f80c8d10 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7f51e800c450 tx=0x7f51e800c910 comp rx=0 tx=0).stop 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 shutdown_connections 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f51f815aa70 0x7f51f81571a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f51f80735a0 0x7f51f80c8d10 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f51dc0791f0 0x7f51dc07b6b0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 --2- 172.21.15.81:0/3888472908 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f51f8070690 0x7f51f80cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 >> 172.21.15.81:0/3888472908 conn(0x7f51f80b1690 msgr2=0x7f51f815d540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 shutdown_connections 2024-09-17T05:24:53.982 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:53.980+0000 7f5200039640 1 -- 172.21.15.81:0/3888472908 wait complete. 2024-09-17T05:24:53.992 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:24:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 -- 172.21.15.81:0/1156692638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 msgr2=0x7f44940d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1156692638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44940d1d30 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f449406a240 tx=0x7f448402a560 comp rx=0 tx=0).stop 2024-09-17T05:24:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 -- 172.21.15.81:0/1156692638 shutdown_connections 2024-09-17T05:24:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1156692638 >> v2:172.21.15.160:3300/0 conn(0x7f44940b3de0 0x7f44940b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1156692638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44940d1d30 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 -- 172.21.15.81:0/1156692638 >> 172.21.15.81:0/1156692638 conn(0x7f44940d3e30 msgr2=0x7f44940d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 -- 172.21.15.81:0/1156692638 shutdown_connections 2024-09-17T05:24:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.095+0000 7f449a2a9640 1 -- 172.21.15.81:0/1156692638 wait complete. 2024-09-17T05:24:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.096+0000 7f449a2a9640 1 Processor -- start 2024-09-17T05:24:54.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.096+0000 7f449a2a9640 1 -- start start 2024-09-17T05:24:54.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f449a2a9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44940b3de0 0x7f44940cd670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f449a2a9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44940d01b0 0x7f449415e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f449a2a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44941f8400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f449a2a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44940b48b0 con 0x7f44941617f0 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f449a2a9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f44940b4730 con 0x7f44940b3de0 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f449a2a9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f44940b4a30 con 0x7f44940d01b0 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44941f8400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44941f8400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39684/0 (socket says 172.21.15.81:39684) 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 -- 172.21.15.81:0/1609511241 learned_addr learned my addr 172.21.15.81:0/1609511241 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:54.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4493fff640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44940b3de0 0x7f44940cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f44937fe640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44940d01b0 0x7f449415e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 -- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44940d01b0 msgr2=0x7f449415e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44940d01b0 0x7f449415e2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 -- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44940b3de0 msgr2=0x7f44940cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44940b3de0 0x7f44940cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f4498846640 1 -- 172.21.15.81:0/1609511241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44941f9210 con 0x7f44941617f0 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.097+0000 7f44937fe640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44940d01b0 0x7f449415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.098+0000 7f4498846640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44941f8400 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f448c00cce0 tx=0x7f448c00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.098+0000 7f4490ff9640 1 -- 172.21.15.81:0/1609511241 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c00f450 con 0x7f44941617f0 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.098+0000 7f4490ff9640 1 -- 172.21.15.81:0/1609511241 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f448c00f700 con 0x7f44941617f0 2024-09-17T05:24:54.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.098+0000 7f4490ff9640 1 -- 172.21.15.81:0/1609511241 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f448c00fb50 con 0x7f44941617f0 2024-09-17T05:24:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.098+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f44940cbab0 con 0x7f44941617f0 2024-09-17T05:24:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.098+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44940cc070 con 0x7f44941617f0 2024-09-17T05:24:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.099+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44940b4f50 con 0x7f44941617f0 2024-09-17T05:24:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.100+0000 7f4490ff9640 1 -- 172.21.15.81:0/1609511241 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f448c004b20 con 0x7f44941617f0 2024-09-17T05:24:54.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.100+0000 7f4490ff9640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f44800791c0 0x7f448007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.100+0000 7f4493fff640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f44800791c0 0x7f448007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.100+0000 7f4490ff9640 1 -- 172.21.15.81:0/1609511241 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f448c09c5d0 con 0x7f44941617f0 2024-09-17T05:24:54.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.101+0000 7f4493fff640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f44800791c0 0x7f448007b680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4484033000 tx=0x7f4484004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:54.104 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.104+0000 7f4490ff9640 1 -- 172.21.15.81:0/1609511241 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f448c014030 con 0x7f44941617f0 2024-09-17T05:24:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.280+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f44940b5700 con 0x7f44941617f0 2024-09-17T05:24:54.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.280+0000 7f4490ff9640 1 -- 172.21.15.81:0/1609511241 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v42)=0 v42) ==== 122+0+0 (secure 0 0 0) 0x7f448c064070 con 0x7f44941617f0 2024-09-17T05:24:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.282+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f44800791c0 msgr2=0x7f448007b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.282+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f44800791c0 0x7f448007b680 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4484033000 tx=0x7f4484004730 comp rx=0 tx=0).stop 2024-09-17T05:24:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.282+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 msgr2=0x7f44941f8400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.282+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44941f8400 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7f448c00cce0 tx=0x7f448c00a620 comp rx=0 tx=0).stop 2024-09-17T05:24:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 shutdown_connections 2024-09-17T05:24:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f44941617f0 0x7f44941f8400 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44940d01b0 0x7f449415e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f44800791c0 0x7f448007b680 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 --2- 172.21.15.81:0/1609511241 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f44940b3de0 0x7f44940cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 >> 172.21.15.81:0/1609511241 conn(0x7f44940d3e30 msgr2=0x7f449406d490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 shutdown_connections 2024-09-17T05:24:54.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.283+0000 7f449a2a9640 1 -- 172.21.15.81:0/1609511241 wait complete. 2024-09-17T05:24:54.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume create non_existent_subvolume subvolume_1 2024-09-17T05:24:54.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.399+0000 7f91ac033640 1 -- 172.21.15.81:0/1959905332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a40b4df0 msgr2=0x7f91a4168ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.399+0000 7f91ac033640 1 --2- 172.21.15.81:0/1959905332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a40b4df0 0x7f91a4168ce0 secure :-1 s=READY pgs=1409 cs=0 l=1 rev1=1 crypto rx=0x7f919c005fd0 tx=0x7f919c02a820 comp rx=0 tx=0).stop 2024-09-17T05:24:54.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.399+0000 7f91ac033640 1 -- 172.21.15.81:0/1959905332 shutdown_connections 2024-09-17T05:24:54.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.399+0000 7f91ac033640 1 --2- 172.21.15.81:0/1959905332 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a40b4df0 0x7f91a4168ce0 unknown :-1 s=CLOSED pgs=1409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.399+0000 7f91ac033640 1 -- 172.21.15.81:0/1959905332 >> 172.21.15.81:0/1959905332 conn(0x7f91a40d3e30 msgr2=0x7f91a40d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:54.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.399+0000 7f91ac033640 1 -- 172.21.15.81:0/1959905332 shutdown_connections 2024-09-17T05:24:54.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.399+0000 7f91ac033640 1 -- 172.21.15.81:0/1959905332 wait complete. 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.400+0000 7f91ac033640 1 Processor -- start 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.400+0000 7f91ac033640 1 -- start start 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91a40b4df0 0x7f91a415e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91a40d01b0 0x7f91a40ca330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a41617f0 0x7f91a4160a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91a41695b0 con 0x7f91a41617f0 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f91a4169430 con 0x7f91a40b4df0 2024-09-17T05:24:54.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f91a4169730 con 0x7f91a40d01b0 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a41617f0 0x7f91a4160a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a41617f0 0x7f91a4160a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39700/0 (socket says 172.21.15.81:39700) 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 -- 172.21.15.81:0/1179151071 learned_addr learned my addr 172.21.15.81:0/1179151071 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91a9dcf640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91a40b4df0 0x7f91a415e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91a95ce640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91a40d01b0 0x7f91a40ca330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 -- 172.21.15.81:0/1179151071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91a40d01b0 msgr2=0x7f91a40ca330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91a40d01b0 0x7f91a40ca330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 -- 172.21.15.81:0/1179151071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91a40b4df0 msgr2=0x7f91a415e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91a40b4df0 0x7f91a415e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 -- 172.21.15.81:0/1179151071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91a4140910 con 0x7f91a41617f0 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91aa5d0640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91a41617f0 0x7f91a4160a80 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f919c006010 tx=0x7f919c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f919a7fc640 1 -- 172.21.15.81:0/1179151071 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c037040 con 0x7f91a41617f0 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f919a7fc640 1 -- 172.21.15.81:0/1179151071 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f919c042070 con 0x7f91a41617f0 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 -- 172.21.15.81:0/1179151071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91a4140bf0 con 0x7f91a41617f0 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f919a7fc640 1 -- 172.21.15.81:0/1179151071 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f919c0042a0 con 0x7f91a41617f0 2024-09-17T05:24:54.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.401+0000 7f91ac033640 1 -- 172.21.15.81:0/1179151071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91a414eb70 con 0x7f91a41617f0 2024-09-17T05:24:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.402+0000 7f91ac033640 1 -- 172.21.15.81:0/1179151071 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91a40d1d30 con 0x7f91a41617f0 2024-09-17T05:24:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.403+0000 7f919a7fc640 1 -- 172.21.15.81:0/1179151071 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f919c004440 con 0x7f91a41617f0 2024-09-17T05:24:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.404+0000 7f919a7fc640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91880791c0 0x7f918807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.404+0000 7f91a9dcf640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91880791c0 0x7f918807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.404+0000 7f919a7fc640 1 -- 172.21.15.81:0/1179151071 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f919c0bc640 con 0x7f91a41617f0 2024-09-17T05:24:54.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.404+0000 7f91a9dcf640 1 --2- 172.21.15.81:0/1179151071 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f91880791c0 0x7f918807b680 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f91a000a750 tx=0x7f91a0008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:54.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.408+0000 7f919a7fc640 1 -- 172.21.15.81:0/1179151071 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f919c084170 con 0x7f91a41617f0 2024-09-17T05:24:54.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.607+0000 7f91ac033640 1 -- 172.21.15.81:0/1179151071 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f91a40b3570 con 0x7f91880791c0 2024-09-17T05:24:54.609 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:54.608+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.609+0000 7f919a7fc640 1 -- 172.21.15.81:0/1179151071 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f91a40b3570 con 0x7f91880791c0 2024-09-17T05:24:54.610 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:54.615 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:54.616 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm non_existent_subvolume subvolume_1 2024-09-17T05:24:54.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 -- 172.21.15.81:0/369197943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc9c0b4c20 msgr2=0x7fbc9c0d1af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 --2- 172.21.15.81:0/369197943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc9c0b4c20 0x7fbc9c0d1af0 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7fbc9c08e100 tx=0x7fbc8402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 -- 172.21.15.81:0/369197943 shutdown_connections 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 --2- 172.21.15.81:0/369197943 >> v2:172.21.15.160:3300/0 conn(0x7fbc9c0d2030 0x7fbc9c0d0720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 --2- 172.21.15.81:0/369197943 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc9c0b4c20 0x7fbc9c0d1af0 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 --2- 172.21.15.81:0/369197943 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c161500 0x7fbc9c0cf950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 -- 172.21.15.81:0/369197943 >> 172.21.15.81:0/369197943 conn(0x7fbc9c09d190 msgr2=0x7fbc9c0d3f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 -- 172.21.15.81:0/369197943 shutdown_connections 2024-09-17T05:24:54.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.718+0000 7fbca0dfb640 1 -- 172.21.15.81:0/369197943 wait complete. 2024-09-17T05:24:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.719+0000 7fbca0dfb640 1 Processor -- start 2024-09-17T05:24:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbca0dfb640 1 -- start start 2024-09-17T05:24:54.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbca0dfb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0b4c20 0x7fbc9c0a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbca0dfb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc9c0d2030 0x7fbc9c0b96d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbca0dfb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c161500 0x7fbc9c1f7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbca0dfb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c0d2640 con 0x7fbc9c0d2030 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbca0dfb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc9c0d24c0 con 0x7fbc9c0b4c20 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbca0dfb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbc9c0d27c0 con 0x7fbc9c161500 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbc99d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc9c0d2030 0x7fbc9c0b96d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbc9a59c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0b4c20 0x7fbc9c0a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbc99d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc9c0d2030 0x7fbc9c0b96d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39720/0 (socket says 172.21.15.81:39720) 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbc99d9b640 1 -- 172.21.15.81:0/2353178230 learned_addr learned my addr 172.21.15.81:0/2353178230 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.720+0000 7fbc9ad9d640 1 --2- 172.21.15.81:0/2353178230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c161500 0x7fbc9c1f7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc99d9b640 1 -- 172.21.15.81:0/2353178230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c161500 msgr2=0x7fbc9c1f7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc99d9b640 1 --2- 172.21.15.81:0/2353178230 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc9c161500 0x7fbc9c1f7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc99d9b640 1 -- 172.21.15.81:0/2353178230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0b4c20 msgr2=0x7fbc9c0a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc99d9b640 1 --2- 172.21.15.81:0/2353178230 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc9c0b4c20 0x7fbc9c0a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc99d9b640 1 -- 172.21.15.81:0/2353178230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc9c1f8590 con 0x7fbc9c0d2030 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc99d9b640 1 --2- 172.21.15.81:0/2353178230 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc9c0d2030 0x7fbc9c0b96d0 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7fbc84034040 tx=0x7fbc840039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc92ffd640 1 -- 172.21.15.81:0/2353178230 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8403e030 con 0x7fbc9c0d2030 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc92ffd640 1 -- 172.21.15.81:0/2353178230 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc840047a0 con 0x7fbc9c0d2030 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbca0dfb640 1 -- 172.21.15.81:0/2353178230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc9c1f8870 con 0x7fbc9c0d2030 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbc92ffd640 1 -- 172.21.15.81:0/2353178230 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc84035040 con 0x7fbc9c0d2030 2024-09-17T05:24:54.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.721+0000 7fbca0dfb640 1 -- 172.21.15.81:0/2353178230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc9c0b8bc0 con 0x7fbc9c0d2030 2024-09-17T05:24:54.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.722+0000 7fbca0dfb640 1 -- 172.21.15.81:0/2353178230 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc9c0d0720 con 0x7fbc9c0d2030 2024-09-17T05:24:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.723+0000 7fbc92ffd640 1 -- 172.21.15.81:0/2353178230 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fbc84041030 con 0x7fbc9c0d2030 2024-09-17T05:24:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.723+0000 7fbc92ffd640 1 --2- 172.21.15.81:0/2353178230 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc7c0791c0 0x7fbc7c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.723+0000 7fbc92ffd640 1 -- 172.21.15.81:0/2353178230 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fbc840bbd80 con 0x7fbc9c0d2030 2024-09-17T05:24:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.723+0000 7fbc9a59c640 1 --2- 172.21.15.81:0/2353178230 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc7c0791c0 0x7fbc7c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:54.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.724+0000 7fbc9a59c640 1 --2- 172.21.15.81:0/2353178230 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc7c0791c0 0x7fbc7c07b680 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c005fd0 tx=0x7fbc8c009680 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:54.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.727+0000 7fbc92ffd640 1 -- 172.21.15.81:0/2353178230 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbc84083360 con 0x7fbc9c0d2030 2024-09-17T05:24:54.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.930+0000 7fbca0dfb640 1 -- 172.21.15.81:0/2353178230 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7fbc9c1609a0 con 0x7fbc7c0791c0 2024-09-17T05:24:54.932 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:54.931+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:54.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:54.931+0000 7fbc92ffd640 1 -- 172.21.15.81:0/2353178230 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fbc9c1609a0 con 0x7fbc7c0791c0 2024-09-17T05:24:54.933 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:54.938 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:54.939 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath non_existent_subvolume subvolume_1 2024-09-17T05:24:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.042+0000 7fe59abd3640 1 -- 172.21.15.81:0/1129189960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe59415bd10 msgr2=0x7fe5940d05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.042+0000 7fe59abd3640 1 --2- 172.21.15.81:0/1129189960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe59415bd10 0x7fe5940d05e0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7fe5940697d0 tx=0x7fe59002a560 comp rx=0 tx=0).stop 2024-09-17T05:24:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.042+0000 7fe59abd3640 1 -- 172.21.15.81:0/1129189960 shutdown_connections 2024-09-17T05:24:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.042+0000 7fe59abd3640 1 --2- 172.21.15.81:0/1129189960 >> v2:172.21.15.160:3300/0 conn(0x7fe5940d1860 0x7fe5940d1c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.042+0000 7fe59abd3640 1 --2- 172.21.15.81:0/1129189960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940b14f0 0x7fe5940ce1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.043+0000 7fe59abd3640 1 --2- 172.21.15.81:0/1129189960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe59415bd10 0x7fe5940d05e0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.043+0000 7fe59abd3640 1 -- 172.21.15.81:0/1129189960 >> 172.21.15.81:0/1129189960 conn(0x7fe59409aa30 msgr2=0x7fe59409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:55.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.043+0000 7fe59abd3640 1 -- 172.21.15.81:0/1129189960 shutdown_connections 2024-09-17T05:24:55.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.043+0000 7fe59abd3640 1 -- 172.21.15.81:0/1129189960 wait complete. 2024-09-17T05:24:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.044+0000 7fe59abd3640 1 Processor -- start 2024-09-17T05:24:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.044+0000 7fe59abd3640 1 -- start start 2024-09-17T05:24:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59abd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5940b14f0 0x7fe59415a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59abd3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1860 0x7fe59414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59abd3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe59415bd10 0x7fe5940cae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59abd3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe59415fa50 con 0x7fe5940b14f0 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59abd3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe59415f8d0 con 0x7fe59415bd10 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59abd3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe59415fbd0 con 0x7fe5940d1860 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5940b14f0 0x7fe59415a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5940b14f0 0x7fe59415a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39742/0 (socket says 172.21.15.81:39742) 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 -- 172.21.15.81:0/72984470 learned_addr learned my addr 172.21.15.81:0/72984470 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe58bfff640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1860 0x7fe59414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe599170640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe59415bd10 0x7fe5940cae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 -- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1860 msgr2=0x7fe59414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1860 0x7fe59414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 -- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe59415bd10 msgr2=0x7fe5940cae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe59415bd10 0x7fe5940cae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 -- 172.21.15.81:0/72984470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe59414d540 con 0x7fe5940b14f0 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe58bfff640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe5940d1860 0x7fe59414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe599170640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe59415bd10 0x7fe5940cae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59896f640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5940b14f0 0x7fe59415a7c0 secure :-1 s=READY pgs=1414 cs=0 l=1 rev1=1 crypto rx=0x7fe590034040 tx=0x7fe590003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe5897fa640 1 -- 172.21.15.81:0/72984470 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe59003e030 con 0x7fe5940b14f0 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe5897fa640 1 -- 172.21.15.81:0/72984470 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe590003e00 con 0x7fe5940b14f0 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe59abd3640 1 -- 172.21.15.81:0/72984470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5940b5520 con 0x7fe5940b14f0 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.045+0000 7fe5897fa640 1 -- 172.21.15.81:0/72984470 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe590035040 con 0x7fe5940b14f0 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.046+0000 7fe59abd3640 1 -- 172.21.15.81:0/72984470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5940b5ae0 con 0x7fe5940b14f0 2024-09-17T05:24:55.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.046+0000 7fe59abd3640 1 -- 172.21.15.81:0/72984470 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5940d1c90 con 0x7fe5940b14f0 2024-09-17T05:24:55.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.047+0000 7fe5897fa640 1 -- 172.21.15.81:0/72984470 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fe590041030 con 0x7fe5940b14f0 2024-09-17T05:24:55.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.048+0000 7fe5897fa640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe5800791c0 0x7fe58007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.048+0000 7fe58bfff640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe5800791c0 0x7fe58007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.048+0000 7fe5897fa640 1 -- 172.21.15.81:0/72984470 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fe5900bc260 con 0x7fe5940b14f0 2024-09-17T05:24:55.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.048+0000 7fe58bfff640 1 --2- 172.21.15.81:0/72984470 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe5800791c0 0x7fe58007b680 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fe5941f5830 tx=0x7fe584005ef0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:55.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.051+0000 7fe5897fa640 1 -- 172.21.15.81:0/72984470 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe590083f90 con 0x7fe5940b14f0 2024-09-17T05:24:55.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.251+0000 7fe59abd3640 1 -- 172.21.15.81:0/72984470 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7fe5940b62e0 con 0x7fe5800791c0 2024-09-17T05:24:55.253 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:55.252+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.252+0000 7fe5897fa640 1 -- 172.21.15.81:0/72984470 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fe5940b62e0 con 0x7fe5800791c0 2024-09-17T05:24:55.253 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:55.258 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:55.259 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume info non_existent_subvolume subvolume_1 2024-09-17T05:24:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.362+0000 7f12da89b640 1 -- 172.21.15.81:0/711133180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc004d40 msgr2=0x7f12bc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.362+0000 7f12da89b640 1 --2- 172.21.15.81:0/711133180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc004d40 0x7f12bc0051c0 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7f12cc005fd0 tx=0x7f12bc005830 comp rx=0 tx=0).stop 2024-09-17T05:24:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.362+0000 7f12d8e38640 1 -- 172.21.15.81:0/711133180 reap_dead start 2024-09-17T05:24:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.362+0000 7f12da89b640 1 -- 172.21.15.81:0/711133180 shutdown_connections 2024-09-17T05:24:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.362+0000 7f12da89b640 1 -- 172.21.15.81:0/711133180 >> 172.21.15.81:0/711133180 conn(0x7f12d40b1700 msgr2=0x7f12d40b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.362+0000 7f12da89b640 1 -- 172.21.15.81:0/711133180 shutdown_connections 2024-09-17T05:24:55.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.362+0000 7f12da89b640 1 -- 172.21.15.81:0/711133180 wait complete. 2024-09-17T05:24:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 Processor -- start 2024-09-17T05:24:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 -- start start 2024-09-17T05:24:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc004d40 0x7f12d414b240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12d414acf0 0x7f12d41f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.367 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12d41522b0 0x7f12d40c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12d40ccd40 con 0x7f12bc004d40 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f12d40ccbc0 con 0x7f12d41522b0 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.364+0000 7f12da89b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f12d40cac40 con 0x7f12d414acf0 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc004d40 0x7f12d414b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc004d40 0x7f12d414b240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39758/0 (socket says 172.21.15.81:39758) 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 -- 172.21.15.81:0/2188294532 learned_addr learned my addr 172.21.15.81:0/2188294532 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d37fe640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12d414acf0 0x7f12d41f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d8e38640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12d41522b0 0x7f12d40c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 -- 172.21.15.81:0/2188294532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12d414acf0 msgr2=0x7f12d41f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12d414acf0 0x7f12d41f2210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 -- 172.21.15.81:0/2188294532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12d41522b0 msgr2=0x7f12d40c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12d41522b0 0x7f12d40c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 -- 172.21.15.81:0/2188294532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12d40c7d80 con 0x7f12bc004d40 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d8e38640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12d41522b0 0x7f12d40c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d3fff640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12bc004d40 0x7f12d414b240 secure :-1 s=READY pgs=1417 cs=0 l=1 rev1=1 crypto rx=0x7f12c400b5b0 tx=0x7f12c400b9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d0ff9640 1 -- 172.21.15.81:0/2188294532 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c40109e0 con 0x7f12bc004d40 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d0ff9640 1 -- 172.21.15.81:0/2188294532 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12c4015070 con 0x7f12bc004d40 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12da89b640 1 -- 172.21.15.81:0/2188294532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12d40c8060 con 0x7f12bc004d40 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12d0ff9640 1 -- 172.21.15.81:0/2188294532 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12c4010e00 con 0x7f12bc004d40 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.365+0000 7f12da89b640 1 -- 172.21.15.81:0/2188294532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12d40c8620 con 0x7f12bc004d40 2024-09-17T05:24:55.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.366+0000 7f12da89b640 1 -- 172.21.15.81:0/2188294532 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12d406fb90 con 0x7f12bc004d40 2024-09-17T05:24:55.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.367+0000 7f12d0ff9640 1 -- 172.21.15.81:0/2188294532 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f12c401a470 con 0x7f12bc004d40 2024-09-17T05:24:55.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.367+0000 7f12d0ff9640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12c00791f0 0x7f12c007b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.367+0000 7f12d37fe640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12c00791f0 0x7f12c007b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.368+0000 7f12d0ff9640 1 -- 172.21.15.81:0/2188294532 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f12c409c450 con 0x7f12bc004d40 2024-09-17T05:24:55.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.368+0000 7f12d37fe640 1 --2- 172.21.15.81:0/2188294532 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12c00791f0 0x7f12c007b6b0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f12d4145980 tx=0x7f12c8001b90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:55.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.372+0000 7f12d0ff9640 1 -- 172.21.15.81:0/2188294532 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f12c4063f10 con 0x7f12bc004d40 2024-09-17T05:24:55.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.575+0000 7f12da89b640 1 -- 172.21.15.81:0/2188294532 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f12d41f2750 con 0x7f12c00791f0 2024-09-17T05:24:55.577 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:55.576+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:55.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.577+0000 7f12d0ff9640 1 -- 172.21.15.81:0/2188294532 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f12c8006d90 con 0x7f12c00791f0 2024-09-17T05:24:55.578 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:55.583 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:55.583 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume resize non_existent_subvolume subvolname_1 inf 2024-09-17T05:24:55.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 -- 172.21.15.81:0/730822133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e64072c40 msgr2=0x7f5e6415f6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 --2- 172.21.15.81:0/730822133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e64072c40 0x7f5e6415f6a0 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f5e5c005fd0 tx=0x7f5e5c02a8a0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 -- 172.21.15.81:0/730822133 shutdown_connections 2024-09-17T05:24:55.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 --2- 172.21.15.81:0/730822133 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e64072c40 0x7f5e6415f6a0 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 --2- 172.21.15.81:0/730822133 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e6415bad0 0x7f5e640cf0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 -- 172.21.15.81:0/730822133 >> 172.21.15.81:0/730822133 conn(0x7f5e640b1620 msgr2=0x7f5e640b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:55.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 -- 172.21.15.81:0/730822133 shutdown_connections 2024-09-17T05:24:55.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.689+0000 7f5e6a74b640 1 -- 172.21.15.81:0/730822133 wait complete. 2024-09-17T05:24:55.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.690+0000 7f5e6a74b640 1 Processor -- start 2024-09-17T05:24:55.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.690+0000 7f5e6a74b640 1 -- start start 2024-09-17T05:24:55.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e6a74b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64072c40 0x7f5e64142ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e6a74b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e640cf620 0x7f5e64142350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e6a74b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e6415bad0 0x7f5e64150ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e6a74b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5e6415fbe0 con 0x7f5e640cf620 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e6a74b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5e640af270 con 0x7f5e64072c40 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e6a74b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5e6415fd60 con 0x7f5e6415bad0 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e640cf620 0x7f5e64142350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e640cf620 0x7f5e64142350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39784/0 (socket says 172.21.15.81:39784) 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 -- 172.21.15.81:0/2063877565 learned_addr learned my addr 172.21.15.81:0/2063877565 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e68ce8640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e6415bad0 0x7f5e64150ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e63fff640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64072c40 0x7f5e64142ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 -- 172.21.15.81:0/2063877565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e6415bad0 msgr2=0x7f5e64150ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5e6415bad0 0x7f5e64150ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 -- 172.21.15.81:0/2063877565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64072c40 msgr2=0x7f5e64142ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5e64072c40 0x7f5e64142ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.691+0000 7f5e637fe640 1 -- 172.21.15.81:0/2063877565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e64158030 con 0x7f5e640cf620 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.692+0000 7f5e637fe640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5e640cf620 0x7f5e64142350 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f5e5800c430 tx=0x7f5e5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.692+0000 7f5e60ff9640 1 -- 172.21.15.81:0/2063877565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58011790 con 0x7f5e640cf620 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.692+0000 7f5e60ff9640 1 -- 172.21.15.81:0/2063877565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5e58017070 con 0x7f5e640cf620 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.692+0000 7f5e6a74b640 1 -- 172.21.15.81:0/2063877565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e64158310 con 0x7f5e640cf620 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.692+0000 7f5e60ff9640 1 -- 172.21.15.81:0/2063877565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e58011cc0 con 0x7f5e640cf620 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.692+0000 7f5e6a74b640 1 -- 172.21.15.81:0/2063877565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e641588d0 con 0x7f5e640cf620 2024-09-17T05:24:55.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.693+0000 7f5e6a74b640 1 -- 172.21.15.81:0/2063877565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e64160210 con 0x7f5e640cf620 2024-09-17T05:24:55.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.693+0000 7f5e60ff9640 1 -- 172.21.15.81:0/2063877565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f5e5801c460 con 0x7f5e640cf620 2024-09-17T05:24:55.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.694+0000 7f5e60ff9640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e500791c0 0x7f5e5007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:55.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.694+0000 7f5e63fff640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e500791c0 0x7f5e5007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:55.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.694+0000 7f5e60ff9640 1 -- 172.21.15.81:0/2063877565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f5e5809b610 con 0x7f5e640cf620 2024-09-17T05:24:55.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.694+0000 7f5e63fff640 1 --2- 172.21.15.81:0/2063877565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5e500791c0 0x7f5e5007b680 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f5e5400a490 tx=0x7f5e5400a420 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:55.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.698+0000 7f5e60ff9640 1 -- 172.21.15.81:0/2063877565 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5e58062a80 con 0x7f5e640cf620 2024-09-17T05:24:55.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.906+0000 7f5e6a74b640 1 -- 172.21.15.81:0/2063877565 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume resize", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "new_size": "inf", "target": ["mon-mgr", ""]}) -- 0x7f5e64074100 con 0x7f5e500791c0 2024-09-17T05:24:55.908 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:55.907+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:55.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:55.907+0000 7f5e60ff9640 1 -- 172.21.15.81:0/2063877565 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f5e64074100 con 0x7f5e500791c0 2024-09-17T05:24:55.909 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:55.914 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:55.914 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume pin non_existent_subvolume subvolname_1 export 1 2024-09-17T05:24:56.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 -- 172.21.15.81:0/1877227038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19681616e0 msgr2=0x7f19680d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 --2- 172.21.15.81:0/1877227038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19681616e0 0x7f19680d4940 secure :-1 s=READY pgs=1422 cs=0 l=1 rev1=1 crypto rx=0x7f19680b6df0 tx=0x7f195c02a5c0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 -- 172.21.15.81:0/1877227038 shutdown_connections 2024-09-17T05:24:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 --2- 172.21.15.81:0/1877227038 >> v2:172.21.15.160:3300/0 conn(0x7f19680d25b0 0x7f19680b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 --2- 172.21.15.81:0/1877227038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19681616e0 0x7f19680d4940 unknown :-1 s=CLOSED pgs=1422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 -- 172.21.15.81:0/1877227038 >> 172.21.15.81:0/1877227038 conn(0x7f19680d3e20 msgr2=0x7f19680d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 -- 172.21.15.81:0/1877227038 shutdown_connections 2024-09-17T05:24:56.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.019+0000 7f196e4bd640 1 -- 172.21.15.81:0/1877227038 wait complete. 2024-09-17T05:24:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.020+0000 7f196e4bd640 1 Processor -- start 2024-09-17T05:24:56.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f196e4bd640 1 -- start start 2024-09-17T05:24:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f196e4bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19680d25b0 0x7f19681f4640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f196e4bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1968161300 0x7f19681f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f196e4bd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19681616e0 0x7f19680c7910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.024 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f196e4bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f19680b7cf0 con 0x7f19680d25b0 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f196e4bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f19680b7b70 con 0x7f1968161300 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f196e4bd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f19680b7e70 con 0x7f19681616e0 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f1967fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19680d25b0 0x7f19681f4640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f1967fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19680d25b0 0x7f19681f4640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39814/0 (socket says 172.21.15.81:39814) 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.021+0000 7f1967fff640 1 -- 172.21.15.81:0/1223119376 learned_addr learned my addr 172.21.15.81:0/1223119376 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f196ca5a640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19681616e0 0x7f19680c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f19677fe640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1968161300 0x7f19681f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1967fff640 1 -- 172.21.15.81:0/1223119376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19681616e0 msgr2=0x7f19680c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1967fff640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19681616e0 0x7f19680c7910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1967fff640 1 -- 172.21.15.81:0/1223119376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1968161300 msgr2=0x7f19681f7c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1967fff640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1968161300 0x7f19681f7c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1967fff640 1 -- 172.21.15.81:0/1223119376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19680c7e50 con 0x7f19680d25b0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f19677fe640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1968161300 0x7f19681f7c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1967fff640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f19680d25b0 0x7f19681f4640 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f195800c450 tx=0x7f195800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1964ff9640 1 -- 172.21.15.81:0/1223119376 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958016020 con 0x7f19680d25b0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1964ff9640 1 -- 172.21.15.81:0/1223119376 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1958012920 con 0x7f19680d25b0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f196e4bd640 1 -- 172.21.15.81:0/1223119376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f196815e5a0 con 0x7f19680d25b0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f1964ff9640 1 -- 172.21.15.81:0/1223119376 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1958012d70 con 0x7f19680d25b0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.022+0000 7f196e4bd640 1 -- 172.21.15.81:0/1223119376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19681f85d0 con 0x7f19680d25b0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.023+0000 7f196e4bd640 1 -- 172.21.15.81:0/1223119376 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19680b8390 con 0x7f19680d25b0 2024-09-17T05:24:56.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.024+0000 7f1964ff9640 1 -- 172.21.15.81:0/1223119376 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f1958019020 con 0x7f19680d25b0 2024-09-17T05:24:56.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.024+0000 7f1964ff9640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19540791f0 0x7f195407b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.024+0000 7f1964ff9640 1 -- 172.21.15.81:0/1223119376 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f195809b6a0 con 0x7f19680d25b0 2024-09-17T05:24:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.024+0000 7f19677fe640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19540791f0 0x7f195407b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.024+0000 7f19677fe640 1 --2- 172.21.15.81:0/1223119376 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f19540791f0 0x7f195407b6b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f195c034000 tx=0x7f195c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:56.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.028+0000 7f1964ff9640 1 -- 172.21.15.81:0/1223119376 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1958020030 con 0x7f19680d25b0 2024-09-17T05:24:56.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.236+0000 7f196e4bd640 1 -- 172.21.15.81:0/1223119376 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume pin", "vol_name": "non_existent_subvolume", "sub_name": "subvolname_1", "pin_type": "export", "pin_setting": "1", "target": ["mon-mgr", ""]}) -- 0x7f196806ee30 con 0x7f19540791f0 2024-09-17T05:24:56.238 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:56.237+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.237+0000 7f1964ff9640 1 -- 172.21.15.81:0/1223119376 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f196806ee30 con 0x7f19540791f0 2024-09-17T05:24:56.238 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:56.244 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:56.244 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume ls non_existent_subvolume 2024-09-17T05:24:56.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.347+0000 7ffb22117640 1 -- 172.21.15.81:0/772922930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb1c1617f0 msgr2=0x7ffb1c0d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.347+0000 7ffb22117640 1 --2- 172.21.15.81:0/772922930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb1c1617f0 0x7ffb1c0d1d30 secure :-1 s=READY pgs=1425 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c005fd0 tx=0x7ffb0c02a820 comp rx=0 tx=0).stop 2024-09-17T05:24:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.347+0000 7ffb22117640 1 -- 172.21.15.81:0/772922930 shutdown_connections 2024-09-17T05:24:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.347+0000 7ffb22117640 1 --2- 172.21.15.81:0/772922930 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb1c1617f0 0x7ffb1c0d1d30 unknown :-1 s=CLOSED pgs=1425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.347+0000 7ffb22117640 1 -- 172.21.15.81:0/772922930 >> 172.21.15.81:0/772922930 conn(0x7ffb1c0d3e30 msgr2=0x7ffb1c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.347+0000 7ffb22117640 1 -- 172.21.15.81:0/772922930 shutdown_connections 2024-09-17T05:24:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.347+0000 7ffb22117640 1 -- 172.21.15.81:0/772922930 wait complete. 2024-09-17T05:24:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.348+0000 7ffb22117640 1 Processor -- start 2024-09-17T05:24:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.348+0000 7ffb22117640 1 -- start start 2024-09-17T05:24:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb22117640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb1c0b3de0 0x7ffb1c0c8850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb22117640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb1c0d01b0 0x7ffb1c158310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb22117640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb1c1617f0 0x7ffb1c1598d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb22117640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0b4a80 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb22117640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffb1c0b4900 con 0x7ffb1c1617f0 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb22117640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ffb1c0b4c00 con 0x7ffb1c0b3de0 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb1c0d01b0 0x7ffb1c158310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb1affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb1c0d01b0 0x7ffb1c158310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39834/0 (socket says 172.21.15.81:39834) 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.349+0000 7ffb1affd640 1 -- 172.21.15.81:0/2240616740 learned_addr learned my addr 172.21.15.81:0/2240616740 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1b7fe640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb1c0b3de0 0x7ffb1c0c8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1bfff640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb1c1617f0 0x7ffb1c1598d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1affd640 1 -- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb1c0b3de0 msgr2=0x7ffb1c0c8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1affd640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb1c0b3de0 0x7ffb1c0c8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1affd640 1 -- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb1c1617f0 msgr2=0x7ffb1c1598d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1affd640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb1c1617f0 0x7ffb1c1598d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1affd640 1 -- 172.21.15.81:0/2240616740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb1c0b9ca0 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1b7fe640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffb1c0b3de0 0x7ffb1c0c8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1bfff640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffb1c1617f0 0x7ffb1c1598d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb1affd640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffb1c0d01b0 0x7ffb1c158310 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7ffb1000c420 tx=0x7ffb1000c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb03fff640 1 -- 172.21.15.81:0/2240616740 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10006890 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb03fff640 1 -- 172.21.15.81:0/2240616740 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffb10006b20 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb03fff640 1 -- 172.21.15.81:0/2240616740 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10007020 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb22117640 1 -- 172.21.15.81:0/2240616740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb1c0c8f10 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.350+0000 7ffb22117640 1 -- 172.21.15.81:0/2240616740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb1c0b6fe0 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.351+0000 7ffb22117640 1 -- 172.21.15.81:0/2240616740 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb1c0b41f0 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.352+0000 7ffb03fff640 1 -- 172.21.15.81:0/2240616740 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7ffb10019020 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.352+0000 7ffb03fff640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb080791c0 0x7ffb0807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.352+0000 7ffb03fff640 1 -- 172.21.15.81:0/2240616740 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7ffb1009b060 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.352+0000 7ffb1b7fe640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb080791c0 0x7ffb0807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.353+0000 7ffb1b7fe640 1 --2- 172.21.15.81:0/2240616740 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffb080791c0 0x7ffb0807b680 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ffb0c034000 tx=0x7ffb0c004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:56.357 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.356+0000 7ffb03fff640 1 -- 172.21.15.81:0/2240616740 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ffb10062b20 con 0x7ffb1c0d01b0 2024-09-17T05:24:56.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.556+0000 7ffb22117640 1 -- 172.21.15.81:0/2240616740 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7ffb1c0b3570 con 0x7ffb080791c0 2024-09-17T05:24:56.558 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:56.557+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:56.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.557+0000 7ffb03fff640 1 -- 172.21.15.81:0/2240616740 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7ffb1c0b3570 con 0x7ffb080791c0 2024-09-17T05:24:56.559 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:56.564 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:56.565 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot create non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:24:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 -- 172.21.15.81:0/922803452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2170074160 msgr2=0x7f21700738c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 --2- 172.21.15.81:0/922803452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2170074160 0x7f21700738c0 secure :-1 s=READY pgs=1428 cs=0 l=1 rev1=1 crypto rx=0x7f2160009830 tx=0x7f216002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 -- 172.21.15.81:0/922803452 shutdown_connections 2024-09-17T05:24:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 --2- 172.21.15.81:0/922803452 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2170074160 0x7f21700738c0 unknown :-1 s=CLOSED pgs=1428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 --2- 172.21.15.81:0/922803452 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f21700734e0 0x7f21700cbfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 -- 172.21.15.81:0/922803452 >> 172.21.15.81:0/922803452 conn(0x7f21700d0b20 msgr2=0x7f21700d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 -- 172.21.15.81:0/922803452 shutdown_connections 2024-09-17T05:24:56.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.671+0000 7f2177eb6640 1 -- 172.21.15.81:0/922803452 wait complete. 2024-09-17T05:24:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.672+0000 7f2177eb6640 1 Processor -- start 2024-09-17T05:24:56.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.672+0000 7f2177eb6640 1 -- start start 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2177eb6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21700734e0 0x7f217006d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2177eb6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2170074160 0x7f21701f2130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2177eb6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217015b8e0 0x7f217006cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2177eb6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f217015ede0 con 0x7f21700734e0 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2177eb6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f217015ec60 con 0x7f217015b8e0 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2177eb6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f217015ef60 con 0x7f2170074160 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21700734e0 0x7f217006d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21700734e0 0x7f217006d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39842/0 (socket says 172.21.15.81:39842) 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 -- 172.21.15.81:0/1821666766 learned_addr learned my addr 172.21.15.81:0/1821666766 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175451640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2170074160 0x7f21701f2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2176453640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217015b8e0 0x7f217006cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 -- 172.21.15.81:0/1821666766 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2170074160 msgr2=0x7f21701f2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2170074160 0x7f21701f2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 -- 172.21.15.81:0/1821666766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217015b8e0 msgr2=0x7f217006cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f217015b8e0 0x7f217006cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.673+0000 7f2175c52640 1 -- 172.21.15.81:0/1821666766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21700c42f0 con 0x7f21700734e0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.674+0000 7f2175c52640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f21700734e0 0x7f217006d6e0 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f216c00d950 tx=0x7f216c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.674+0000 7f21667fc640 1 -- 172.21.15.81:0/1821666766 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c017070 con 0x7f21700734e0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.674+0000 7f21667fc640 1 -- 172.21.15.81:0/1821666766 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f216c009d20 con 0x7f21700734e0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.674+0000 7f2177eb6640 1 -- 172.21.15.81:0/1821666766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21700c45d0 con 0x7f21700734e0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.674+0000 7f21667fc640 1 -- 172.21.15.81:0/1821666766 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f216c0106c0 con 0x7f21700734e0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.674+0000 7f2177eb6640 1 -- 172.21.15.81:0/1821666766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21701f6b70 con 0x7f21700734e0 2024-09-17T05:24:56.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.675+0000 7f2177eb6640 1 -- 172.21.15.81:0/1821666766 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21700cbfd0 con 0x7f21700734e0 2024-09-17T05:24:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.675+0000 7f21667fc640 1 -- 172.21.15.81:0/1821666766 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f216c010860 con 0x7f21700734e0 2024-09-17T05:24:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.676+0000 7f21667fc640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21540791c0 0x7f215407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.676+0000 7f2175451640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21540791c0 0x7f215407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:56.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.676+0000 7f21667fc640 1 -- 172.21.15.81:0/1821666766 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f216c09bd30 con 0x7f21700734e0 2024-09-17T05:24:56.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.677+0000 7f2175451640 1 --2- 172.21.15.81:0/1821666766 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f21540791c0 0x7f215407b680 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f2160034000 tx=0x7f2160004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:56.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.680+0000 7f21667fc640 1 -- 172.21.15.81:0/1821666766 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f216c063110 con 0x7f21700734e0 2024-09-17T05:24:56.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.888+0000 7f2177eb6640 1 -- 172.21.15.81:0/1821666766 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot create", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f21700d1880 con 0x7f21540791c0 2024-09-17T05:24:56.890 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:56.889+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:56.889+0000 7f21667fc640 1 -- 172.21.15.81:0/1821666766 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f21700d1880 con 0x7f21540791c0 2024-09-17T05:24:56.890 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:56.896 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:56.896 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot rm non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:24:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.002+0000 7feda6fc2640 1 -- 172.21.15.81:0/911128409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c004d40 msgr2=0x7fed8c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.002+0000 7feda6fc2640 1 --2- 172.21.15.81:0/911128409 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fed8c004d40 0x7fed8c0051c0 secure :-1 s=READY pgs=1431 cs=0 l=1 rev1=1 crypto rx=0x7fed98009b50 tx=0x7fed8c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.002+0000 7feda555f640 1 -- 172.21.15.81:0/911128409 reap_dead start 2024-09-17T05:24:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.002+0000 7feda6fc2640 1 -- 172.21.15.81:0/911128409 shutdown_connections 2024-09-17T05:24:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.002+0000 7feda6fc2640 1 -- 172.21.15.81:0/911128409 >> 172.21.15.81:0/911128409 conn(0x7feda00b1620 msgr2=0x7feda00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.002+0000 7feda6fc2640 1 -- 172.21.15.81:0/911128409 shutdown_connections 2024-09-17T05:24:57.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.002+0000 7feda6fc2640 1 -- 172.21.15.81:0/911128409 wait complete. 2024-09-17T05:24:57.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.003+0000 7feda6fc2640 1 Processor -- start 2024-09-17T05:24:57.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.003+0000 7feda6fc2640 1 -- start start 2024-09-17T05:24:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda6fc2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed8c004d40 0x7feda01f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda6fc2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feda01414e0 0x7feda01531f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda6fc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feda00b4070 0x7feda00b4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda6fc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feda0159e60 con 0x7feda00b4070 2024-09-17T05:24:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda6fc2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feda0159ce0 con 0x7feda01414e0 2024-09-17T05:24:57.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda6fc2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7feda0159fe0 con 0x7fed8c004d40 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feda00b4070 0x7feda00b4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feda00b4070 0x7feda00b4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39856/0 (socket says 172.21.15.81:39856) 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 -- 172.21.15.81:0/2765717759 learned_addr learned my addr 172.21.15.81:0/2765717759 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 -- 172.21.15.81:0/2765717759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed8c004d40 msgr2=0x7feda01f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 --2- 172.21.15.81:0/2765717759 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fed8c004d40 0x7feda01f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 -- 172.21.15.81:0/2765717759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feda01414e0 msgr2=0x7feda01531f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 --2- 172.21.15.81:0/2765717759 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feda01414e0 0x7feda01531f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 -- 172.21.15.81:0/2765717759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feda0153a40 con 0x7feda00b4070 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.004+0000 7feda555f640 1 --2- 172.21.15.81:0/2765717759 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feda00b4070 0x7feda00b4520 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fed9802b4d0 tx=0x7fed98034660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.005+0000 7fed9d7fa640 1 -- 172.21.15.81:0/2765717759 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98038040 con 0x7feda00b4070 2024-09-17T05:24:57.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.005+0000 7fed9d7fa640 1 -- 172.21.15.81:0/2765717759 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fed98042070 con 0x7feda00b4070 2024-09-17T05:24:57.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.005+0000 7feda6fc2640 1 -- 172.21.15.81:0/2765717759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feda0153d20 con 0x7feda00b4070 2024-09-17T05:24:57.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.005+0000 7fed9d7fa640 1 -- 172.21.15.81:0/2765717759 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed98034b40 con 0x7feda00b4070 2024-09-17T05:24:57.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.005+0000 7feda6fc2640 1 -- 172.21.15.81:0/2765717759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feda0153730 con 0x7feda00b4070 2024-09-17T05:24:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.006+0000 7feda6fc2640 1 -- 172.21.15.81:0/2765717759 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feda0154240 con 0x7feda00b4070 2024-09-17T05:24:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.006+0000 7fed9d7fa640 1 -- 172.21.15.81:0/2765717759 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fed98034ce0 con 0x7feda00b4070 2024-09-17T05:24:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.007+0000 7fed9d7fa640 1 --2- 172.21.15.81:0/2765717759 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fed800791f0 0x7fed8007b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.007+0000 7feda4d5e640 1 --2- 172.21.15.81:0/2765717759 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fed800791f0 0x7fed8007b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.007+0000 7fed9d7fa640 1 -- 172.21.15.81:0/2765717759 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fed980bbf80 con 0x7feda00b4070 2024-09-17T05:24:57.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.007+0000 7feda4d5e640 1 --2- 172.21.15.81:0/2765717759 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fed800791f0 0x7fed8007b6b0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fed90006d10 tx=0x7fed90006c60 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:57.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.011+0000 7fed9d7fa640 1 -- 172.21.15.81:0/2765717759 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fed98083a40 con 0x7feda00b4070 2024-09-17T05:24:57.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.220+0000 7feda6fc2640 1 -- 172.21.15.81:0/2765717759 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot rm", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7feda015a570 con 0x7fed800791f0 2024-09-17T05:24:57.222 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:57.222+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.222+0000 7fed9d7fa640 1 -- 172.21.15.81:0/2765717759 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7feda015a570 con 0x7fed800791f0 2024-09-17T05:24:57.223 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:57.228 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:57.228 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot info non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:24:57.336 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 -- 172.21.15.81:0/3355091695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe00aee40 msgr2=0x7effe015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 --2- 172.21.15.81:0/3355091695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe00aee40 0x7effe015b970 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7effe00cc230 tx=0x7effd002aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 -- 172.21.15.81:0/3355091695 shutdown_connections 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 --2- 172.21.15.81:0/3355091695 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7effe00703c0 0x7effe0157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 --2- 172.21.15.81:0/3355091695 >> v2:172.21.15.160:3300/0 conn(0x7effe006e940 0x7effe006fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 --2- 172.21.15.81:0/3355091695 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe00aee40 0x7effe015b970 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 -- 172.21.15.81:0/3355091695 >> 172.21.15.81:0/3355091695 conn(0x7effe00b1620 msgr2=0x7effe00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 -- 172.21.15.81:0/3355091695 shutdown_connections 2024-09-17T05:24:57.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.335+0000 7effe767f640 1 -- 172.21.15.81:0/3355091695 wait complete. 2024-09-17T05:24:57.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.336+0000 7effe767f640 1 Processor -- start 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.336+0000 7effe767f640 1 -- start start 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe767f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe006e940 0x7effe01538a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe767f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7effe00703c0 0x7effe0159e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe767f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effe00aee40 0x7effe01f1b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe767f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7effe01585c0 con 0x7effe006e940 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe767f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7effe0158440 con 0x7effe00aee40 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe767f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7effe0158740 con 0x7effe00703c0 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe006e940 0x7effe01538a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe006e940 0x7effe01538a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39882/0 (socket says 172.21.15.81:39882) 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 -- 172.21.15.81:0/4043060178 learned_addr learned my addr 172.21.15.81:0/4043060178 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:57.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe4c1a640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7effe00703c0 0x7effe0159e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe5c1c640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effe00aee40 0x7effe01f1b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 -- 172.21.15.81:0/4043060178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7effe00703c0 msgr2=0x7effe0159e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7effe00703c0 0x7effe0159e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 -- 172.21.15.81:0/4043060178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effe00aee40 msgr2=0x7effe01f1b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effe00aee40 0x7effe01f1b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe541b640 1 -- 172.21.15.81:0/4043060178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effe00a9790 con 0x7effe006e940 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.337+0000 7effe5c1c640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7effe00aee40 0x7effe01f1b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.338+0000 7effe541b640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7effe006e940 0x7effe01538a0 secure :-1 s=READY pgs=1434 cs=0 l=1 rev1=1 crypto rx=0x7effd0009bf0 tx=0x7effd0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.338+0000 7effddffb640 1 -- 172.21.15.81:0/4043060178 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0033050 con 0x7effe006e940 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.338+0000 7effddffb640 1 -- 172.21.15.81:0/4043060178 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7effd0004550 con 0x7effe006e940 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.338+0000 7effe767f640 1 -- 172.21.15.81:0/4043060178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effe01f26e0 con 0x7effe006e940 2024-09-17T05:24:57.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.338+0000 7effddffb640 1 -- 172.21.15.81:0/4043060178 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7effd0038450 con 0x7effe006e940 2024-09-17T05:24:57.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.338+0000 7effe767f640 1 -- 172.21.15.81:0/4043060178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effe01530a0 con 0x7effe006e940 2024-09-17T05:24:57.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.339+0000 7effe767f640 1 -- 172.21.15.81:0/4043060178 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effe0157cf0 con 0x7effe006e940 2024-09-17T05:24:57.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.340+0000 7effddffb640 1 -- 172.21.15.81:0/4043060178 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7effd0036070 con 0x7effe006e940 2024-09-17T05:24:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.340+0000 7effddffb640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7effcc0791c0 0x7effcc07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.340+0000 7effe4c1a640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7effcc0791c0 0x7effcc07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.340+0000 7effddffb640 1 -- 172.21.15.81:0/4043060178 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7effd00bcd80 con 0x7effe006e940 2024-09-17T05:24:57.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.341+0000 7effe4c1a640 1 --2- 172.21.15.81:0/4043060178 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7effcc0791c0 0x7effcc07b680 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7effe00ae850 tx=0x7effd400a2d0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:57.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.344+0000 7effddffb640 1 -- 172.21.15.81:0/4043060178 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7effd0084840 con 0x7effe006e940 2024-09-17T05:24:57.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.552+0000 7effe767f640 1 -- 172.21.15.81:0/4043060178 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot info", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7effe00b4770 con 0x7effcc0791c0 2024-09-17T05:24:57.554 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:57.553+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:57.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.554+0000 7effddffb640 1 -- 172.21.15.81:0/4043060178 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7effe00b4770 con 0x7effcc0791c0 2024-09-17T05:24:57.555 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:57.560 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:57.560 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot protect non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:24:57.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 -- 172.21.15.81:0/3286288816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b80aee40 msgr2=0x7f39b815b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 --2- 172.21.15.81:0/3286288816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b80aee40 0x7f39b815b970 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7f39b8074950 tx=0x7f39a802a530 comp rx=0 tx=0).stop 2024-09-17T05:24:57.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 -- 172.21.15.81:0/3286288816 shutdown_connections 2024-09-17T05:24:57.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 --2- 172.21.15.81:0/3286288816 >> v2:172.21.15.160:3300/0 conn(0x7f39b8070590 0x7f39b8157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 --2- 172.21.15.81:0/3286288816 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b80aee40 0x7f39b815b970 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 -- 172.21.15.81:0/3286288816 >> 172.21.15.81:0/3286288816 conn(0x7f39b80b1620 msgr2=0x7f39b80b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:57.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 -- 172.21.15.81:0/3286288816 shutdown_connections 2024-09-17T05:24:57.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.671+0000 7f39bca0c640 1 -- 172.21.15.81:0/3286288816 wait complete. 2024-09-17T05:24:57.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.673+0000 7f39bca0c640 1 Processor -- start 2024-09-17T05:24:57.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.673+0000 7f39bca0c640 1 -- start start 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39bca0c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b806e940 0x7f39b814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39bca0c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39b8070590 0x7f39b80b3800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39bca0c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39b80aee40 0x7f39b80b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39bca0c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39b81586a0 con 0x7f39b806e940 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39bca0c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f39b8158520 con 0x7f39b8070590 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39bca0c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f39b8158820 con 0x7f39b80aee40 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b806e940 0x7f39b814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b806e940 0x7f39b814fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39894/0 (socket says 172.21.15.81:39894) 2024-09-17T05:24:57.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 -- 172.21.15.81:0/235058906 learned_addr learned my addr 172.21.15.81:0/235058906 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b5d9b640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39b8070590 0x7f39b80b3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b6d9d640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39b80aee40 0x7f39b80b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 -- 172.21.15.81:0/235058906 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39b80aee40 msgr2=0x7f39b80b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39b80aee40 0x7f39b80b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 -- 172.21.15.81:0/235058906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39b8070590 msgr2=0x7f39b80b3800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39b8070590 0x7f39b80b3800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 -- 172.21.15.81:0/235058906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39b81f6040 con 0x7f39b806e940 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39b659c640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39b806e940 0x7f39b814fe90 secure :-1 s=READY pgs=1437 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009780 tx=0x7f39a8033d60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.674+0000 7f39a6ffd640 1 -- 172.21.15.81:0/235058906 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8031d60 con 0x7f39b806e940 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.675+0000 7f39a6ffd640 1 -- 172.21.15.81:0/235058906 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39a8005020 con 0x7f39b806e940 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.675+0000 7f39bca0c640 1 -- 172.21.15.81:0/235058906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39b81f6320 con 0x7f39b806e940 2024-09-17T05:24:57.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.675+0000 7f39a6ffd640 1 -- 172.21.15.81:0/235058906 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39a8005470 con 0x7f39b806e940 2024-09-17T05:24:57.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.675+0000 7f39bca0c640 1 -- 172.21.15.81:0/235058906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39b81f68e0 con 0x7f39b806e940 2024-09-17T05:24:57.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.676+0000 7f39bca0c640 1 -- 172.21.15.81:0/235058906 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39b80cf7a0 con 0x7f39b806e940 2024-09-17T05:24:57.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.676+0000 7f39a6ffd640 1 -- 172.21.15.81:0/235058906 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f39a80047a0 con 0x7f39b806e940 2024-09-17T05:24:57.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.677+0000 7f39a6ffd640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39980791c0 0x7f399807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:57.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.677+0000 7f39a6ffd640 1 -- 172.21.15.81:0/235058906 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f39a80bc8c0 con 0x7f39b806e940 2024-09-17T05:24:57.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.677+0000 7f39b5d9b640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39980791c0 0x7f399807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:57.679 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.677+0000 7f39b5d9b640 1 --2- 172.21.15.81:0/235058906 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39980791c0 0x7f399807b680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f39ac007fd0 tx=0x7f39ac009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:57.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.681+0000 7f39a6ffd640 1 -- 172.21.15.81:0/235058906 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f39a803f030 con 0x7f39b806e940 2024-09-17T05:24:57.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.890+0000 7f39bca0c640 1 -- 172.21.15.81:0/235058906 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot protect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f39b806e720 con 0x7f39980791c0 2024-09-17T05:24:57.892 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:57.891+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:57.893 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:57.891+0000 7f39a6ffd640 1 -- 172.21.15.81:0/235058906 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f39b806e720 con 0x7f39980791c0 2024-09-17T05:24:57.893 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:57.897 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:57.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot unprotect non_existent_subvolume subvolume_1 snapshot_1 2024-09-17T05:24:58.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.004+0000 7f69d4a47640 1 -- 172.21.15.81:0/1370020574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69bc003a50 msgr2=0x7f69bc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.004+0000 7f69d4a47640 1 --2- 172.21.15.81:0/1370020574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69bc003a50 0x7f69bc003e70 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f69c8001d90 tx=0x7f69bc005830 comp rx=0 tx=0).stop 2024-09-17T05:24:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.004+0000 7f69d4a47640 1 -- 172.21.15.81:0/1370020574 shutdown_connections 2024-09-17T05:24:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.004+0000 7f69d4a47640 1 --2- 172.21.15.81:0/1370020574 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69bc003a50 0x7f69bc003e70 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.004+0000 7f69d4a47640 1 -- 172.21.15.81:0/1370020574 >> 172.21.15.81:0/1370020574 conn(0x7f69d00d1b80 msgr2=0x7f69d00d1f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.004+0000 7f69d4a47640 1 -- 172.21.15.81:0/1370020574 shutdown_connections 2024-09-17T05:24:58.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.004+0000 7f69d4a47640 1 -- 172.21.15.81:0/1370020574 wait complete. 2024-09-17T05:24:58.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.005+0000 7f69d4a47640 1 Processor -- start 2024-09-17T05:24:58.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69d4a47640 1 -- start start 2024-09-17T05:24:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69d4a47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69bc003a50 0x7f69d01f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69d4a47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015bd00 0x7f69d00b49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69d4a47640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69d015c180 0x7f69d00b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69d4a47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f69d015f870 con 0x7f69d015bd00 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69d4a47640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f69d015f6f0 con 0x7f69d015c180 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69d4a47640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f69d00ce430 con 0x7f69bc003a50 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69cdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015bd00 0x7f69d00b49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69cdd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015bd00 0x7f69d00b49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39902/0 (socket says 172.21.15.81:39902) 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.006+0000 7f69cdd9b640 1 -- 172.21.15.81:0/1497789174 learned_addr learned my addr 172.21.15.81:0/1497789174 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69ce59c640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69bc003a50 0x7f69d01f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69ced9d640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69d015c180 0x7f69d00b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69cdd9b640 1 -- 172.21.15.81:0/1497789174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69bc003a50 msgr2=0x7f69d01f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69cdd9b640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f69bc003a50 0x7f69d01f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69cdd9b640 1 -- 172.21.15.81:0/1497789174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69d015c180 msgr2=0x7f69d00b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69cdd9b640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f69d015c180 0x7f69d00b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69cdd9b640 1 -- 172.21.15.81:0/1497789174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69d01f4580 con 0x7f69d015bd00 2024-09-17T05:24:58.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69cdd9b640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f69d015bd00 0x7f69d00b49b0 secure :-1 s=READY pgs=1440 cs=0 l=1 rev1=1 crypto rx=0x7f69b800e700 tx=0x7f69b800ebc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69c6ffd640 1 -- 172.21.15.81:0/1497789174 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b8015020 con 0x7f69d015bd00 2024-09-17T05:24:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69c6ffd640 1 -- 172.21.15.81:0/1497789174 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f69b8004480 con 0x7f69d015bd00 2024-09-17T05:24:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69d4a47640 1 -- 172.21.15.81:0/1497789174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69d01f89c0 con 0x7f69d015bd00 2024-09-17T05:24:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69c6ffd640 1 -- 172.21.15.81:0/1497789174 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69b800ca40 con 0x7f69d015bd00 2024-09-17T05:24:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.007+0000 7f69d4a47640 1 -- 172.21.15.81:0/1497789174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69d015b500 con 0x7f69d015bd00 2024-09-17T05:24:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.008+0000 7f69d4a47640 1 -- 172.21.15.81:0/1497789174 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69d00d0560 con 0x7f69d015bd00 2024-09-17T05:24:58.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.009+0000 7f69c6ffd640 1 -- 172.21.15.81:0/1497789174 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f69b8018020 con 0x7f69d015bd00 2024-09-17T05:24:58.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.009+0000 7f69c6ffd640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f69b00791c0 0x7f69b007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.009+0000 7f69ce59c640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f69b00791c0 0x7f69b007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.009+0000 7f69c6ffd640 1 -- 172.21.15.81:0/1497789174 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f69b809be20 con 0x7f69d015bd00 2024-09-17T05:24:58.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.010+0000 7f69ce59c640 1 --2- 172.21.15.81:0/1497789174 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f69b00791c0 0x7f69b007b680 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f69c8032000 tx=0x7f69c8001510 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:58.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.014+0000 7f69c6ffd640 1 -- 172.21.15.81:0/1497789174 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f69b801f020 con 0x7f69d015bd00 2024-09-17T05:24:58.225 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.224+0000 7f69d4a47640 1 -- 172.21.15.81:0/1497789174 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot unprotect", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f69d01f8ca0 con 0x7f69b00791c0 2024-09-17T05:24:58.226 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.225+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:58.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.226+0000 7f69c6ffd640 1 -- 172.21.15.81:0/1497789174 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f69d01f8ca0 con 0x7f69b00791c0 2024-09-17T05:24:58.227 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:58.233 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:58.233 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot ls non_existent_subvolume subvolume_1 2024-09-17T05:24:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.338+0000 7f0c42f53640 1 -- 172.21.15.81:0/2551617302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c2c004d90 msgr2=0x7f0c2c005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.338+0000 7f0c42f53640 1 --2- 172.21.15.81:0/2551617302 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c2c004d90 0x7f0c2c005210 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f0c340043e0 tx=0x7f0c2c005830 comp rx=0 tx=0).stop 2024-09-17T05:24:58.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.338+0000 7f0c414f0640 1 -- 172.21.15.81:0/2551617302 reap_dead start 2024-09-17T05:24:58.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.338+0000 7f0c42f53640 1 -- 172.21.15.81:0/2551617302 shutdown_connections 2024-09-17T05:24:58.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.338+0000 7f0c42f53640 1 -- 172.21.15.81:0/2551617302 >> 172.21.15.81:0/2551617302 conn(0x7f0c3c0d3e20 msgr2=0x7f0c3c0d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:58.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.338+0000 7f0c42f53640 1 -- 172.21.15.81:0/2551617302 shutdown_connections 2024-09-17T05:24:58.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.338+0000 7f0c42f53640 1 -- 172.21.15.81:0/2551617302 wait complete. 2024-09-17T05:24:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.339+0000 7f0c42f53640 1 Processor -- start 2024-09-17T05:24:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.339+0000 7f0c42f53640 1 -- start start 2024-09-17T05:24:58.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c42f53640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c2c004d90 0x7f0c3c1f7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c42f53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0cc990 0x7f0c3c152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c42f53640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c3c09db40 0x7f0c3c153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c42f53640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c0d4cd0 con 0x7f0c3c0cc990 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c42f53640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c0d4b50 con 0x7f0c2c004d90 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c42f53640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3c0b7af0 con 0x7f0c3c09db40 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c3bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0cc990 0x7f0c3c152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c3bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0cc990 0x7f0c3c152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39912/0 (socket says 172.21.15.81:39912) 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c3bfff640 1 -- 172.21.15.81:0/3840911392 learned_addr learned my addr 172.21.15.81:0/3840911392 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c40cef640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c2c004d90 0x7f0c3c1f7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c414f0640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c3c09db40 0x7f0c3c153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.340+0000 7f0c3bfff640 1 -- 172.21.15.81:0/3840911392 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c3c09db40 msgr2=0x7f0c3c153490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c3bfff640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c3c09db40 0x7f0c3c153490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c3bfff640 1 -- 172.21.15.81:0/3840911392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c2c004d90 msgr2=0x7f0c3c1f7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c3bfff640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c2c004d90 0x7f0c3c1f7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c3bfff640 1 -- 172.21.15.81:0/3840911392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c0ccf00 con 0x7f0c3c0cc990 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c40cef640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c2c004d90 0x7f0c3c1f7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c3bfff640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c3c0cc990 0x7f0c3c152f50 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0c28003fd0 tx=0x7f0c2800ba60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c397fa640 1 -- 172.21.15.81:0/3840911392 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28010810 con 0x7f0c3c0cc990 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c397fa640 1 -- 172.21.15.81:0/3840911392 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c280109b0 con 0x7f0c3c0cc990 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c42f53640 1 -- 172.21.15.81:0/3840911392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3c0cd1e0 con 0x7f0c3c0cc990 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c397fa640 1 -- 172.21.15.81:0/3840911392 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c28010da0 con 0x7f0c3c0cc990 2024-09-17T05:24:58.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.341+0000 7f0c42f53640 1 -- 172.21.15.81:0/3840911392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3c0cd7a0 con 0x7f0c3c0cc990 2024-09-17T05:24:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.342+0000 7f0c42f53640 1 -- 172.21.15.81:0/3840911392 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3c0b73e0 con 0x7f0c3c0cc990 2024-09-17T05:24:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.342+0000 7f0c397fa640 1 -- 172.21.15.81:0/3840911392 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f0c28023440 con 0x7f0c3c0cc990 2024-09-17T05:24:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.343+0000 7f0c397fa640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c200791c0 0x7f0c2007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.343+0000 7f0c397fa640 1 -- 172.21.15.81:0/3840911392 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f0c2809c3d0 con 0x7f0c3c0cc990 2024-09-17T05:24:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.343+0000 7f0c40cef640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c200791c0 0x7f0c2007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.343+0000 7f0c40cef640 1 --2- 172.21.15.81:0/3840911392 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c200791c0 0x7f0c2007b680 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0c30006cd0 tx=0x7f0c300067a0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:58.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.347+0000 7f0c397fa640 1 -- 172.21.15.81:0/3840911392 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0c28064000 con 0x7f0c3c0cc990 2024-09-17T05:24:58.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.551+0000 7f0c42f53640 1 -- 172.21.15.81:0/3840911392 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot ls", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "target": ["mon-mgr", ""]}) -- 0x7f0c3c0cd970 con 0x7f0c200791c0 2024-09-17T05:24:58.553 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.552+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.552+0000 7f0c397fa640 1 -- 172.21.15.81:0/3840911392 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f0c3c0cd970 con 0x7f0c200791c0 2024-09-17T05:24:58.553 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:58.559 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:58.559 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume snapshot clone non_existent_subvolume subvolume_1 snapshot_1 clone_1 2024-09-17T05:24:58.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.666+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2069866602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe881617f0 msgr2=0x7fbe880d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.666+0000 7fbe8fd2b640 1 --2- 172.21.15.81:0/2069866602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe881617f0 0x7fbe880d1d30 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7fbe84005fd0 tx=0x7fbe8402a540 comp rx=0 tx=0).stop 2024-09-17T05:24:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.666+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2069866602 shutdown_connections 2024-09-17T05:24:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.666+0000 7fbe8fd2b640 1 --2- 172.21.15.81:0/2069866602 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe881617f0 0x7fbe880d1d30 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.666+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2069866602 >> 172.21.15.81:0/2069866602 conn(0x7fbe880d3e30 msgr2=0x7fbe880d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.666+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2069866602 shutdown_connections 2024-09-17T05:24:58.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.666+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2069866602 wait complete. 2024-09-17T05:24:58.670 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.667+0000 7fbe8fd2b640 1 Processor -- start 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.667+0000 7fbe8fd2b640 1 -- start start 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8fd2b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe880b3de0 0x7fbe880c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8fd2b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe880d01b0 0x7fbe88156eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8fd2b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe881617f0 0x7fbe881f86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8fd2b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe880b4a80 con 0x7fbe880d01b0 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8fd2b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe880b4900 con 0x7fbe881617f0 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8fd2b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbe880b4c00 con 0x7fbe880b3de0 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8d2c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe880d01b0 0x7fbe88156eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8d2c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe880d01b0 0x7fbe88156eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39928/0 (socket says 172.21.15.81:39928) 2024-09-17T05:24:58.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8d2c6640 1 -- 172.21.15.81:0/2943918278 learned_addr learned my addr 172.21.15.81:0/2943918278 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8dac7640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe880b3de0 0x7fbe880c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.668+0000 7fbe8e2c8640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe881617f0 0x7fbe881f86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8d2c6640 1 -- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe880b3de0 msgr2=0x7fbe880c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8d2c6640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe880b3de0 0x7fbe880c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8d2c6640 1 -- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe881617f0 msgr2=0x7fbe881f86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8d2c6640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe881617f0 0x7fbe881f86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8d2c6640 1 -- 172.21.15.81:0/2943918278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe881f9590 con 0x7fbe880d01b0 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8dac7640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe880b3de0 0x7fbe880c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8e2c8640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe881617f0 0x7fbe881f86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:58.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8d2c6640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe880d01b0 0x7fbe88156eb0 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fbe7800c530 tx=0x7fbe7800c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/2943918278 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe780052d0 con 0x7fbe880d01b0 2024-09-17T05:24:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/2943918278 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe78005470 con 0x7fbe880d01b0 2024-09-17T05:24:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2943918278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe881f8fd0 con 0x7fbe880d01b0 2024-09-17T05:24:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/2943918278 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe78012870 con 0x7fbe880d01b0 2024-09-17T05:24:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.669+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2943918278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe880cc080 con 0x7fbe880d01b0 2024-09-17T05:24:58.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.670+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2943918278 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe880b4490 con 0x7fbe880d01b0 2024-09-17T05:24:58.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.671+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/2943918278 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fbe78003610 con 0x7fbe880d01b0 2024-09-17T05:24:58.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.671+0000 7fbe7e7fc640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe6c0791f0 0x7fbe6c07b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:58.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.671+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/2943918278 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fbe7809b510 con 0x7fbe880d01b0 2024-09-17T05:24:58.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.671+0000 7fbe8dac7640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe6c0791f0 0x7fbe6c07b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:58.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.672+0000 7fbe8dac7640 1 --2- 172.21.15.81:0/2943918278 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe6c0791f0 0x7fbe6c07b6b0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fbe84033000 tx=0x7fbe84004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:58.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.676+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/2943918278 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbe880b4490 con 0x7fbe880d01b0 2024-09-17T05:24:58.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.885+0000 7fbe8fd2b640 1 -- 172.21.15.81:0/2943918278 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume snapshot clone", "vol_name": "non_existent_subvolume", "sub_name": "subvolume_1", "snap_name": "snapshot_1", "target_sub_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7fbe880c9ae0 con 0x7fbe6c0791f0 2024-09-17T05:24:58.891 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.890+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:58.891 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.890+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:58.891 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.890+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:58.891 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.890+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:58.891 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.890+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:24:58.895 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:58.894+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:58.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:58.895+0000 7fbe7e7fc640 1 -- 172.21.15.81:0/2943918278 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fbe84005020 con 0x7fbe6c0791f0 2024-09-17T05:24:58.896 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:58.901 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:58.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs clone status non_existent_subvolume clone_1 2024-09-17T05:24:59.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 -- 172.21.15.81:0/3549665895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc0cd090 msgr2=0x7f40bc140990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 --2- 172.21.15.81:0/3549665895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc0cd090 0x7f40bc140990 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f40b4005fd0 tx=0x7f40b402a5d0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 -- 172.21.15.81:0/3549665895 shutdown_connections 2024-09-17T05:24:59.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 --2- 172.21.15.81:0/3549665895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40bc15af10 0x7f40bc15b370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 --2- 172.21.15.81:0/3549665895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc0cd090 0x7f40bc140990 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 -- 172.21.15.81:0/3549665895 >> 172.21.15.81:0/3549665895 conn(0x7f40bc0d0b60 msgr2=0x7f40bc0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:59.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 -- 172.21.15.81:0/3549665895 shutdown_connections 2024-09-17T05:24:59.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.004+0000 7f40c1105640 1 -- 172.21.15.81:0/3549665895 wait complete. 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.005+0000 7f40c1105640 1 Processor -- start 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40c1105640 1 -- start start 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40c1105640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40bc073550 0x7f40bc152030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40c1105640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40bc0cd090 0x7f40bc15a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40c1105640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc15af10 0x7f40bc157e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40c1105640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc073d90 con 0x7f40bc15af10 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40c1105640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f40bc073c10 con 0x7f40bc073550 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40c1105640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f40bc0b4220 con 0x7f40bc0cd090 2024-09-17T05:24:59.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40bb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc15af10 0x7f40bc157e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40bb59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc15af10 0x7f40bc157e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39966/0 (socket says 172.21.15.81:39966) 2024-09-17T05:24:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40bb59e640 1 -- 172.21.15.81:0/2167627085 learned_addr learned my addr 172.21.15.81:0/2167627085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40ba59c640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40bc0cd090 0x7f40bc15a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.006+0000 7f40bad9d640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40bc073550 0x7f40bc152030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40bb59e640 1 -- 172.21.15.81:0/2167627085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40bc0cd090 msgr2=0x7f40bc15a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40bb59e640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f40bc0cd090 0x7f40bc15a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40bb59e640 1 -- 172.21.15.81:0/2167627085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40bc073550 msgr2=0x7f40bc152030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40bb59e640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f40bc073550 0x7f40bc152030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40bb59e640 1 -- 172.21.15.81:0/2167627085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40bc156dd0 con 0x7f40bc15af10 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40bb59e640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f40bc15af10 0x7f40bc157e70 secure :-1 s=READY pgs=1450 cs=0 l=1 rev1=1 crypto rx=0x7f40ac00c3f0 tx=0x7f40ac00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40b37fe640 1 -- 172.21.15.81:0/2167627085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac017070 con 0x7f40bc15af10 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40b37fe640 1 -- 172.21.15.81:0/2167627085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f40ac0053c0 con 0x7f40bc15af10 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40c1105640 1 -- 172.21.15.81:0/2167627085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40bc1570b0 con 0x7f40bc15af10 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40b37fe640 1 -- 172.21.15.81:0/2167627085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40ac003850 con 0x7f40bc15af10 2024-09-17T05:24:59.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.007+0000 7f40c1105640 1 -- 172.21.15.81:0/2167627085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40bc157670 con 0x7f40bc15af10 2024-09-17T05:24:59.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.008+0000 7f40c1105640 1 -- 172.21.15.81:0/2167627085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f40bc140970 con 0x7f40bc15af10 2024-09-17T05:24:59.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.009+0000 7f40b37fe640 1 -- 172.21.15.81:0/2167627085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f40ac01a070 con 0x7f40bc15af10 2024-09-17T05:24:59.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.009+0000 7f40b37fe640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f409c0791c0 0x7f409c07b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.009+0000 7f40b37fe640 1 -- 172.21.15.81:0/2167627085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f40ac09ad20 con 0x7f40bc15af10 2024-09-17T05:24:59.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.009+0000 7f40bad9d640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f409c0791c0 0x7f409c07b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.010+0000 7f40bad9d640 1 --2- 172.21.15.81:0/2167627085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f409c0791c0 0x7f409c07b680 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f40b4033000 tx=0x7f40b4004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.013+0000 7f40b37fe640 1 -- 172.21.15.81:0/2167627085 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f40ac062070 con 0x7f40bc15af10 2024-09-17T05:24:59.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.225+0000 7f40c1105640 1 -- 172.21.15.81:0/2167627085 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs clone status", "vol_name": "non_existent_subvolume", "clone_name": "clone_1", "target": ["mon-mgr", ""]}) -- 0x7f40bc0d10e0 con 0x7f409c0791c0 2024-09-17T05:24:59.228 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:59.227+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.227+0000 7f40b37fe640 1 -- 172.21.15.81:0/2167627085 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f40bc0d10e0 con 0x7f409c0791c0 2024-09-17T05:24:59.228 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:59.233 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:59.234 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup create non_existent_subvolume group_1 2024-09-17T05:24:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 -- 172.21.15.81:0/2508485515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe374151c60 msgr2=0x7fe37406fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 --2- 172.21.15.81:0/2508485515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe374151c60 0x7fe37406fe00 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7fe3740c7b20 tx=0x7fe36402aa30 comp rx=0 tx=0).stop 2024-09-17T05:24:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 -- 172.21.15.81:0/2508485515 shutdown_connections 2024-09-17T05:24:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 --2- 172.21.15.81:0/2508485515 >> v2:172.21.15.160:3300/0 conn(0x7fe374070340 0x7fe37406dc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 --2- 172.21.15.81:0/2508485515 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe374151c60 0x7fe37406fe00 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 -- 172.21.15.81:0/2508485515 >> 172.21.15.81:0/2508485515 conn(0x7fe3740d0be0 msgr2=0x7fe3740d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:59.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 -- 172.21.15.81:0/2508485515 shutdown_connections 2024-09-17T05:24:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.337+0000 7fe37af3d640 1 -- 172.21.15.81:0/2508485515 wait complete. 2024-09-17T05:24:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.338+0000 7fe37af3d640 1 Processor -- start 2024-09-17T05:24:59.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.338+0000 7fe37af3d640 1 -- start start 2024-09-17T05:24:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe37af3d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37406e190 0x7fe3740b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe37af3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe374070340 0x7fe37413e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe37af3d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3740c7e60 0x7fe3740b59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe37af3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe374073c60 con 0x7fe374070340 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe37af3d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe3740c7730 con 0x7fe3740c7e60 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe37af3d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe374073de0 con 0x7fe37406e190 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe374070340 0x7fe37413e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe374070340 0x7fe37413e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:39986/0 (socket says 172.21.15.81:39986) 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 -- 172.21.15.81:0/3732984316 learned_addr learned my addr 172.21.15.81:0/3732984316 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe378cd9640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37406e190 0x7fe3740b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe3794da640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3740c7e60 0x7fe3740b59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 -- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37406e190 msgr2=0x7fe3740b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37406e190 0x7fe3740b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 -- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3740c7e60 msgr2=0x7fe3740b59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3740c7e60 0x7fe3740b59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.339+0000 7fe373fff640 1 -- 172.21.15.81:0/3732984316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3740c8360 con 0x7fe374070340 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe378cd9640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37406e190 0x7fe3740b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe3794da640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3740c7e60 0x7fe3740b59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe373fff640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe374070340 0x7fe37413e020 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7fe35c00b4a0 tx=0x7fe35c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe3717fa640 1 -- 172.21.15.81:0/3732984316 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c014070 con 0x7fe374070340 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe3717fa640 1 -- 172.21.15.81:0/3732984316 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe35c010700 con 0x7fe374070340 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe37af3d640 1 -- 172.21.15.81:0/3732984316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe374158070 con 0x7fe374070340 2024-09-17T05:24:59.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe3717fa640 1 -- 172.21.15.81:0/3732984316 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe35c010b50 con 0x7fe374070340 2024-09-17T05:24:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.340+0000 7fe37af3d640 1 -- 172.21.15.81:0/3732984316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe374158630 con 0x7fe374070340 2024-09-17T05:24:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.341+0000 7fe37af3d640 1 -- 172.21.15.81:0/3732984316 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe374074280 con 0x7fe374070340 2024-09-17T05:24:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.341+0000 7fe3717fa640 1 -- 172.21.15.81:0/3732984316 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fe35c017070 con 0x7fe374070340 2024-09-17T05:24:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.342+0000 7fe3717fa640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe3540791c0 0x7fe35407b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.342+0000 7fe3717fa640 1 -- 172.21.15.81:0/3732984316 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fe35c09b490 con 0x7fe374070340 2024-09-17T05:24:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.342+0000 7fe378cd9640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe3540791c0 0x7fe35407b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.342+0000 7fe378cd9640 1 --2- 172.21.15.81:0/3732984316 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe3540791c0 0x7fe35407b680 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe364035000 tx=0x7fe364004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.346+0000 7fe3717fa640 1 -- 172.21.15.81:0/3732984316 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe35c062ec0 con 0x7fe374070340 2024-09-17T05:24:59.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.546+0000 7fe37af3d640 1 -- 172.21.15.81:0/3732984316 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7fe3740c85f0 con 0x7fe3540791c0 2024-09-17T05:24:59.548 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:59.548+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.548+0000 7fe3717fa640 1 -- 172.21.15.81:0/3732984316 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fe3740c85f0 con 0x7fe3540791c0 2024-09-17T05:24:59.549 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:59.554 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:59.554 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm non_existent_subvolume group_1 2024-09-17T05:24:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.657+0000 7f65d400f640 1 -- 172.21.15.81:0/3303826665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b8004d40 msgr2=0x7f65b80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.657+0000 7f65d400f640 1 --2- 172.21.15.81:0/3303826665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65b8004d40 0x7f65b80051c0 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7f65c4001dc0 tx=0x7f65b8005830 comp rx=0 tx=0).stop 2024-09-17T05:24:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.657+0000 7f65d25ac640 1 -- 172.21.15.81:0/3303826665 reap_dead start 2024-09-17T05:24:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.658+0000 7f65d400f640 1 -- 172.21.15.81:0/3303826665 shutdown_connections 2024-09-17T05:24:59.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.658+0000 7f65d400f640 1 -- 172.21.15.81:0/3303826665 >> 172.21.15.81:0/3303826665 conn(0x7f65cc0d1bb0 msgr2=0x7f65cc0d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.658+0000 7f65d400f640 1 -- 172.21.15.81:0/3303826665 shutdown_connections 2024-09-17T05:24:59.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.658+0000 7f65d400f640 1 -- 172.21.15.81:0/3303826665 wait complete. 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.659+0000 7f65d400f640 1 Processor -- start 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.659+0000 7f65d400f640 1 -- start start 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.659+0000 7f65d400f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65b8004d40 0x7f65cc15df10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d400f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65cc0b6500 0x7f65cc1f6a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d400f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65cc15a070 0x7f65cc15a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d400f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0b2b10 con 0x7f65cc0b6500 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d400f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc0cd7f0 con 0x7f65cc15a070 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d400f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc0b2c90 con 0x7f65b8004d40 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65cc0b6500 0x7f65cc1f6a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65cc0b6500 0x7f65cc1f6a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40008/0 (socket says 172.21.15.81:40008) 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 -- 172.21.15.81:0/1293662534 learned_addr learned my addr 172.21.15.81:0/1293662534 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d1dab640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65b8004d40 0x7f65cc15df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d25ac640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65cc15a070 0x7f65cc15a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 -- 172.21.15.81:0/1293662534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65b8004d40 msgr2=0x7f65cc15df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65b8004d40 0x7f65cc15df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 -- 172.21.15.81:0/1293662534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65cc15a070 msgr2=0x7f65cc15a500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65cc15a070 0x7f65cc15a500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 -- 172.21.15.81:0/1293662534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc15e4f0 con 0x7f65cc0b6500 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d25ac640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65cc15a070 0x7f65cc15a500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d15aa640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65cc0b6500 0x7f65cc1f6a50 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f65bc006680 tx=0x7f65bc0066b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65c27fc640 1 -- 172.21.15.81:0/1293662534 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc015070 con 0x7f65cc0b6500 2024-09-17T05:24:59.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65c27fc640 1 -- 172.21.15.81:0/1293662534 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f65bc011900 con 0x7f65cc0b6500 2024-09-17T05:24:59.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d400f640 1 -- 172.21.15.81:0/1293662534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65cc15e7d0 con 0x7f65cc0b6500 2024-09-17T05:24:59.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65c27fc640 1 -- 172.21.15.81:0/1293662534 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65bc011d50 con 0x7f65cc0b6500 2024-09-17T05:24:59.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.660+0000 7f65d400f640 1 -- 172.21.15.81:0/1293662534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65cc15ed90 con 0x7f65cc0b6500 2024-09-17T05:24:59.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.661+0000 7f65d400f640 1 -- 172.21.15.81:0/1293662534 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65cc15f0c0 con 0x7f65cc0b6500 2024-09-17T05:24:59.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.662+0000 7f65c27fc640 1 -- 172.21.15.81:0/1293662534 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f65bc018070 con 0x7f65cc0b6500 2024-09-17T05:24:59.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.663+0000 7f65c27fc640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f65b00791f0 0x7f65b007b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.663+0000 7f65d1dab640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f65b00791f0 0x7f65b007b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.663+0000 7f65c27fc640 1 -- 172.21.15.81:0/1293662534 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f65bc09c6b0 con 0x7f65cc0b6500 2024-09-17T05:24:59.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.663+0000 7f65d1dab640 1 --2- 172.21.15.81:0/1293662534 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f65b00791f0 0x7f65b007b6b0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f65c8009c50 tx=0x7f65c8005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.667+0000 7f65c27fc640 1 -- 172.21.15.81:0/1293662534 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f65bc064170 con 0x7f65cc0b6500 2024-09-17T05:24:59.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.867+0000 7f65d400f640 1 -- 172.21.15.81:0/1293662534 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f65cc0b3220 con 0x7f65b00791f0 2024-09-17T05:24:59.869 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:24:59.868+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:24:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.868+0000 7f65c27fc640 1 -- 172.21.15.81:0/1293662534 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f65cc0b3220 con 0x7f65b00791f0 2024-09-17T05:24:59.869 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:24:59.874 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:24:59.874 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup getpath non_existent_subvolume group_1 2024-09-17T05:24:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 -- 172.21.15.81:0/2660635993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f395c15af10 msgr2=0x7f395c15b350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 --2- 172.21.15.81:0/2660635993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f395c15af10 0x7f395c15b350 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f3950009830 tx=0x7f395002a500 comp rx=0 tx=0).stop 2024-09-17T05:24:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 -- 172.21.15.81:0/2660635993 shutdown_connections 2024-09-17T05:24:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 --2- 172.21.15.81:0/2660635993 >> v2:172.21.15.160:3300/0 conn(0x7f395c073550 0x7f395c073a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 --2- 172.21.15.81:0/2660635993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f395c15af10 0x7f395c15b350 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 -- 172.21.15.81:0/2660635993 >> 172.21.15.81:0/2660635993 conn(0x7f395c0d0b60 msgr2=0x7f395c0d0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:24:59.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 -- 172.21.15.81:0/2660635993 shutdown_connections 2024-09-17T05:24:59.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.978+0000 7f3962594640 1 -- 172.21.15.81:0/2660635993 wait complete. 2024-09-17T05:24:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 Processor -- start 2024-09-17T05:24:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 -- start start 2024-09-17T05:24:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c073550 0x7f395c13ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f395c0cd090 0x7f395c156030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f395c15af10 0x7f395c156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0b3ea0 con 0x7f395c073550 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f395c0b3d20 con 0x7f395c15af10 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.980+0000 7f3962594640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f395c0b4020 con 0x7f395c0cd090 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c073550 0x7f395c13ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c073550 0x7f395c13ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40022/0 (socket says 172.21.15.81:40022) 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 -- 172.21.15.81:0/334991690 learned_addr learned my addr 172.21.15.81:0/334991690 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395b7fe640 1 --2- 172.21.15.81:0/334991690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f395c0cd090 0x7f395c156030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 -- 172.21.15.81:0/334991690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f395c0cd090 msgr2=0x7f395c156030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 --2- 172.21.15.81:0/334991690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f395c0cd090 0x7f395c156030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 -- 172.21.15.81:0/334991690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f395c15af10 msgr2=0x7f395c156570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 --2- 172.21.15.81:0/334991690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f395c15af10 0x7f395c156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:24:59.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 -- 172.21.15.81:0/334991690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395c1f4890 con 0x7f395c073550 2024-09-17T05:24:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f395bfff640 1 --2- 172.21.15.81:0/334991690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f395c073550 0x7f395c13ce90 secure :-1 s=READY pgs=1456 cs=0 l=1 rev1=1 crypto rx=0x7f394c00c420 tx=0x7f394c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f3958ff9640 1 -- 172.21.15.81:0/334991690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c011790 con 0x7f395c073550 2024-09-17T05:24:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f3958ff9640 1 -- 172.21.15.81:0/334991690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f394c017070 con 0x7f395c073550 2024-09-17T05:24:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f3962594640 1 -- 172.21.15.81:0/334991690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395c1f4b70 con 0x7f395c073550 2024-09-17T05:24:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f3958ff9640 1 -- 172.21.15.81:0/334991690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f394c011d20 con 0x7f395c073550 2024-09-17T05:24:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.981+0000 7f3962594640 1 -- 172.21.15.81:0/334991690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f395c0ce7b0 con 0x7f395c073550 2024-09-17T05:24:59.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.982+0000 7f3962594640 1 -- 172.21.15.81:0/334991690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f395c0b45b0 con 0x7f395c073550 2024-09-17T05:24:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.983+0000 7f3958ff9640 1 -- 172.21.15.81:0/334991690 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f394c01c460 con 0x7f395c073550 2024-09-17T05:24:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.983+0000 7f3958ff9640 1 --2- 172.21.15.81:0/334991690 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39480791c0 0x7f394807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:24:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.983+0000 7f395b7fe640 1 --2- 172.21.15.81:0/334991690 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39480791c0 0x7f394807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:24:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.983+0000 7f3958ff9640 1 -- 172.21.15.81:0/334991690 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f394c09b640 con 0x7f395c073550 2024-09-17T05:24:59.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.984+0000 7f395b7fe640 1 --2- 172.21.15.81:0/334991690 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39480791c0 0x7f394807b680 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3950034000 tx=0x7f3950004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:24:59.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:24:59.987+0000 7f3958ff9640 1 -- 172.21.15.81:0/334991690 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f394c063200 con 0x7f395c073550 2024-09-17T05:25:00.190 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.189+0000 7f3962594640 1 -- 172.21.15.81:0/334991690 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup getpath", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7f395c156bf0 con 0x7f39480791c0 2024-09-17T05:25:00.191 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:00.191+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:25:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.191+0000 7f3958ff9640 1 -- 172.21.15.81:0/334991690 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f395c156bf0 con 0x7f39480791c0 2024-09-17T05:25:00.192 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:25:00.197 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:25:00.197 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup pin non_existent_subvolume group_1 export 0 2024-09-17T05:25:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 -- 172.21.15.81:0/4097636131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c15d610 msgr2=0x7fb25c070180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 --2- 172.21.15.81:0/4097636131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c15d610 0x7fb25c070180 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7fb25c074d60 tx=0x7fb24c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.304 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 -- 172.21.15.81:0/4097636131 shutdown_connections 2024-09-17T05:25:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 --2- 172.21.15.81:0/4097636131 >> v2:172.21.15.160:3300/0 conn(0x7fb25c073120 0x7fb25c0b2cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 --2- 172.21.15.81:0/4097636131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c15d610 0x7fb25c070180 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 -- 172.21.15.81:0/4097636131 >> 172.21.15.81:0/4097636131 conn(0x7fb25c0b1620 msgr2=0x7fb25c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 -- 172.21.15.81:0/4097636131 shutdown_connections 2024-09-17T05:25:00.305 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.303+0000 7fb2627df640 1 -- 172.21.15.81:0/4097636131 wait complete. 2024-09-17T05:25:00.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.304+0000 7fb2627df640 1 Processor -- start 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.304+0000 7fb2627df640 1 -- start start 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb2627df640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb25c073120 0x7fb25c151d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb2627df640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c0aec50 0x7fb25c159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb2627df640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb25c15d610 0x7fb25c145b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb2627df640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0b3210 con 0x7fb25c0aec50 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb2627df640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb25c0ae8a0 con 0x7fb25c15d610 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb2627df640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb25c0b3390 con 0x7fb25c073120 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c0aec50 0x7fb25c159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c0aec50 0x7fb25c159ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40038/0 (socket says 172.21.15.81:40038) 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 -- 172.21.15.81:0/1483064753 learned_addr learned my addr 172.21.15.81:0/1483064753 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:00.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25bfff640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb25c073120 0x7fb25c151d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb260d7c640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb25c15d610 0x7fb25c145b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 -- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb25c073120 msgr2=0x7fb25c151d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb25c073120 0x7fb25c151d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 -- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb25c15d610 msgr2=0x7fb25c145b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb25c15d610 0x7fb25c145b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 -- 172.21.15.81:0/1483064753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb25c152b40 con 0x7fb25c0aec50 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25bfff640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb25c073120 0x7fb25c151d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb260d7c640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb25c15d610 0x7fb25c145b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.305+0000 7fb25b7fe640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb25c0aec50 0x7fb25c159ad0 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7fb25000c460 tx=0x7fb25000c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.306+0000 7fb258ff9640 1 -- 172.21.15.81:0/1483064753 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250016020 con 0x7fb25c0aec50 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.306+0000 7fb258ff9640 1 -- 172.21.15.81:0/1483064753 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb250012960 con 0x7fb25c0aec50 2024-09-17T05:25:00.309 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.306+0000 7fb258ff9640 1 -- 172.21.15.81:0/1483064753 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb250012db0 con 0x7fb25c0aec50 2024-09-17T05:25:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.306+0000 7fb2627df640 1 -- 172.21.15.81:0/1483064753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb25c152e20 con 0x7fb25c0aec50 2024-09-17T05:25:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.306+0000 7fb2627df640 1 -- 172.21.15.81:0/1483064753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb25c145340 con 0x7fb25c0aec50 2024-09-17T05:25:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.307+0000 7fb2627df640 1 -- 172.21.15.81:0/1483064753 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb25c15cdb0 con 0x7fb25c0aec50 2024-09-17T05:25:00.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.307+0000 7fb258ff9640 1 -- 172.21.15.81:0/1483064753 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7fb250019020 con 0x7fb25c0aec50 2024-09-17T05:25:00.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.308+0000 7fb258ff9640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2480791c0 0x7fb24807b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.308+0000 7fb258ff9640 1 -- 172.21.15.81:0/1483064753 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fb25009b990 con 0x7fb25c0aec50 2024-09-17T05:25:00.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.308+0000 7fb25bfff640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2480791c0 0x7fb24807b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.308+0000 7fb25bfff640 1 --2- 172.21.15.81:0/1483064753 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2480791c0 0x7fb24807b680 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fb24c033000 tx=0x7fb24c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:00.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.312+0000 7fb258ff9640 1 -- 172.21.15.81:0/1483064753 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb250020020 con 0x7fb25c0aec50 2024-09-17T05:25:00.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.512+0000 7fb2627df640 1 -- 172.21.15.81:0/1483064753 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "non_existent_subvolume", "group_name": "group_1", "pin_type": "export", "pin_setting": "0", "target": ["mon-mgr", ""]}) -- 0x7fb25c159710 con 0x7fb2480791c0 2024-09-17T05:25:00.514 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:00.513+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:25:00.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.513+0000 7fb258ff9640 1 -- 172.21.15.81:0/1483064753 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fb25c159710 con 0x7fb2480791c0 2024-09-17T05:25:00.515 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:25:00.519 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:25:00.520 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup ls non_existent_subvolume 2024-09-17T05:25:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 -- 172.21.15.81:0/1117259987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14c4073090 msgr2=0x7f14c40cda10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 --2- 172.21.15.81:0/1117259987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14c4073090 0x7f14c40cda10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f14b8009830 tx=0x7f14b802a510 comp rx=0 tx=0).stop 2024-09-17T05:25:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 -- 172.21.15.81:0/1117259987 shutdown_connections 2024-09-17T05:25:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 --2- 172.21.15.81:0/1117259987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14c4073090 0x7f14c40cda10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 --2- 172.21.15.81:0/1117259987 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14c415b380 0x7f14c4072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 -- 172.21.15.81:0/1117259987 >> 172.21.15.81:0/1117259987 conn(0x7f14c40b1700 msgr2=0x7f14c40b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 -- 172.21.15.81:0/1117259987 shutdown_connections 2024-09-17T05:25:00.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.622+0000 7f14c92c5640 1 -- 172.21.15.81:0/1117259987 wait complete. 2024-09-17T05:25:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 Processor -- start 2024-09-17T05:25:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 -- start start 2024-09-17T05:25:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c4073090 0x7f14c40c94a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14c40cdf50 0x7f14c414fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14c415b380 0x7f14c415c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14c40cbd50 con 0x7f14c4073090 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14c40cbbd0 con 0x7f14c415b380 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.624+0000 7f14c92c5640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f14c40cbed0 con 0x7f14c40cdf50 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c4073090 0x7f14c40c94a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c4073090 0x7f14c40c94a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40044/0 (socket says 172.21.15.81:40044) 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 -- 172.21.15.81:0/4073133136 learned_addr learned my addr 172.21.15.81:0/4073133136 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c27fc640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14c40cdf50 0x7f14c414fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c37fe640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14c415b380 0x7f14c415c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 -- 172.21.15.81:0/4073133136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14c40cdf50 msgr2=0x7f14c414fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14c40cdf50 0x7f14c414fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 -- 172.21.15.81:0/4073133136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14c415b380 msgr2=0x7f14c415c1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14c415b380 0x7f14c415c1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 -- 172.21.15.81:0/4073133136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14c4155230 con 0x7f14c4073090 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c2ffd640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14c4073090 0x7f14c40c94a0 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7f14b4009a10 tx=0x7f14b4009ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b401c070 con 0x7f14c4073090 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c92c5640 1 -- 172.21.15.81:0/4073133136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14c4155510 con 0x7f14c4073090 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14b400bab0 con 0x7f14c4073090 2024-09-17T05:25:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b4017410 con 0x7f14c4073090 2024-09-17T05:25:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.625+0000 7f14c92c5640 1 -- 172.21.15.81:0/4073133136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14c4155ad0 con 0x7f14c4073090 2024-09-17T05:25:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.626+0000 7f14c92c5640 1 -- 172.21.15.81:0/4073133136 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14c4074020 con 0x7f14c4073090 2024-09-17T05:25:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.627+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 22) ==== 102002+0+0 (secure 0 0 0) 0x7f14b401f070 con 0x7f14c4073090 2024-09-17T05:25:00.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.627+0000 7f14ab7fe640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14b00791c0 0x7f14b007b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.628+0000 7f14c27fc640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14b00791c0 0x7f14b007b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.628+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f14b409dcd0 con 0x7f14c4073090 2024-09-17T05:25:00.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.628+0000 7f14c27fc640 1 --2- 172.21.15.81:0/4073133136 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14b00791c0 0x7f14b007b680 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f14b8034000 tx=0x7f14b8004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.631+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f14c4074020 con 0x7f14c4073090 2024-09-17T05:25:00.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.697+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f14b40613b0 con 0x7f14c4073090 2024-09-17T05:25:00.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.833+0000 7f14c92c5640 1 -- 172.21.15.81:0/4073133136 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup ls", "vol_name": "non_existent_subvolume", "target": ["mon-mgr", ""]}) -- 0x7f14c40b1d30 con 0x7f14b00791c0 2024-09-17T05:25:00.835 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:00.834+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:25:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.834+0000 7f14ab7fe640 1 -- 172.21.15.81:0/4073133136 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f14c40b1d30 con 0x7f14b00791c0 2024-09-17T05:25:00.836 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:25:00.841 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:25:00.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot create non_existent_subvolume group_1 snapshot_1 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 -- 172.21.15.81:0/504043480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687015be70 msgr2=0x7f68700ccc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 --2- 172.21.15.81:0/504043480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687015be70 0x7f68700ccc90 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7f68700c3a30 tx=0x7f686c02a440 comp rx=0 tx=0).stop 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 -- 172.21.15.81:0/504043480 shutdown_connections 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 --2- 172.21.15.81:0/504043480 >> v2:172.21.15.160:3300/0 conn(0x7f68700b0590 0x7f68700cd1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 --2- 172.21.15.81:0/504043480 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f687015be70 0x7f68700ccc90 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 -- 172.21.15.81:0/504043480 >> 172.21.15.81:0/504043480 conn(0x7f6870074160 msgr2=0x7f6870074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 -- 172.21.15.81:0/504043480 shutdown_connections 2024-09-17T05:25:00.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.949+0000 7f687828c640 1 -- 172.21.15.81:0/504043480 wait complete. 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 Processor -- start 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 -- start start 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68700b0590 0x7f68700c69f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68700cd710 0x7f68700c4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f687015be70 0x7f68700b5a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6870068dd0 con 0x7f68700cd710 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6870074ee0 con 0x7f687015be70 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f687828c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6870068f50 con 0x7f68700b0590 2024-09-17T05:25:00.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f6875827640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68700cd710 0x7f68700c4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f6875827640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68700cd710 0x7f68700c4e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40074/0 (socket says 172.21.15.81:40074) 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.951+0000 7f6875827640 1 -- 172.21.15.81:0/1180369901 learned_addr learned my addr 172.21.15.81:0/1180369901 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6876028640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68700b0590 0x7f68700c69f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6876829640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f687015be70 0x7f68700b5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6875827640 1 -- 172.21.15.81:0/1180369901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68700b0590 msgr2=0x7f68700c69f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6875827640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68700b0590 0x7f68700c69f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6875827640 1 -- 172.21.15.81:0/1180369901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f687015be70 msgr2=0x7f68700b5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6875827640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f687015be70 0x7f68700b5a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6875827640 1 -- 172.21.15.81:0/1180369901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68700c5340 con 0x7f68700cd710 2024-09-17T05:25:00.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6875827640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68700cd710 0x7f68700c4e00 secure :-1 s=READY pgs=1461 cs=0 l=1 rev1=1 crypto rx=0x7f686000c970 tx=0x7f686000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6866ffd640 1 -- 172.21.15.81:0/1180369901 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860007bb0 con 0x7f68700cd710 2024-09-17T05:25:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6866ffd640 1 -- 172.21.15.81:0/1180369901 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6860005020 con 0x7f68700cd710 2024-09-17T05:25:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f687828c640 1 -- 172.21.15.81:0/1180369901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68700c6780 con 0x7f68700cd710 2024-09-17T05:25:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f6866ffd640 1 -- 172.21.15.81:0/1180369901 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6860007e60 con 0x7f68700cd710 2024-09-17T05:25:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.952+0000 7f687828c640 1 -- 172.21.15.81:0/1180369901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68700b4210 con 0x7f68700cd710 2024-09-17T05:25:00.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.953+0000 7f687828c640 1 -- 172.21.15.81:0/1180369901 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68700b3430 con 0x7f68700cd710 2024-09-17T05:25:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.954+0000 7f6866ffd640 1 -- 172.21.15.81:0/1180369901 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f6860005470 con 0x7f68700cd710 2024-09-17T05:25:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.954+0000 7f6866ffd640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6854079250 0x7f685407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.954+0000 7f6876028640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6854079250 0x7f685407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.954+0000 7f6866ffd640 1 -- 172.21.15.81:0/1180369901 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f686009c060 con 0x7f68700cd710 2024-09-17T05:25:00.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.955+0000 7f6876028640 1 --2- 172.21.15.81:0/1180369901 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6854079250 0x7f685407b710 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f686c033000 tx=0x7f686c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:00.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:00.958+0000 7f6866ffd640 1 -- 172.21.15.81:0/1180369901 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6860014030 con 0x7f68700cd710 2024-09-17T05:25:01.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.159+0000 7f687828c640 1 -- 172.21.15.81:0/1180369901 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot create", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7f6870069f80 con 0x7f6854079250 2024-09-17T05:25:01.161 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:01.160+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:25:01.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.160+0000 7f6866ffd640 1 -- 172.21.15.81:0/1180369901 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7f6870069f80 con 0x7f6854079250 2024-09-17T05:25:01.162 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:25:01.166 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:25:01.167 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot rm non_existent_subvolume group_1 snapshot_1 2024-09-17T05:25:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.273+0000 7fd109a16640 1 -- 172.21.15.81:0/1330529872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0f0003a50 msgr2=0x7fd0f0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.273+0000 7fd109a16640 1 --2- 172.21.15.81:0/1330529872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0f0003a50 0x7fd0f0003e70 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4002230 tx=0x7fd0f0005830 comp rx=0 tx=0).stop 2024-09-17T05:25:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.273+0000 7fd109a16640 1 -- 172.21.15.81:0/1330529872 shutdown_connections 2024-09-17T05:25:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.273+0000 7fd109a16640 1 --2- 172.21.15.81:0/1330529872 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0f0003a50 0x7fd0f0003e70 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.273+0000 7fd109a16640 1 -- 172.21.15.81:0/1330529872 >> 172.21.15.81:0/1330529872 conn(0x7fd1040d3f20 msgr2=0x7fd1040d4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.273+0000 7fd109a16640 1 -- 172.21.15.81:0/1330529872 shutdown_connections 2024-09-17T05:25:01.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.273+0000 7fd109a16640 1 -- 172.21.15.81:0/1330529872 wait complete. 2024-09-17T05:25:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.274+0000 7fd109a16640 1 Processor -- start 2024-09-17T05:25:01.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.275+0000 7fd109a16640 1 -- start start 2024-09-17T05:25:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.275+0000 7fd109a16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f0003a50 0x7fd1040b26c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.275+0000 7fd109a16640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1040cb2d0 0x7fd1040b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.275+0000 7fd109a16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10415d820 0x7fd10415cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.275+0000 7fd109a16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040cf750 con 0x7fd10415d820 2024-09-17T05:25:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.275+0000 7fd109a16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd1040cf5d0 con 0x7fd0f0003a50 2024-09-17T05:25:01.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.275+0000 7fd109a16640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd1040cf8d0 con 0x7fd1040cb2d0 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10415d820 0x7fd10415cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10415d820 0x7fd10415cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40104/0 (socket says 172.21.15.81:40104) 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 -- 172.21.15.81:0/1868221519 learned_addr learned my addr 172.21.15.81:0/1868221519 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd102ffd640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f0003a50 0x7fd1040b26c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1027fc640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1040cb2d0 0x7fd1040b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 -- 172.21.15.81:0/1868221519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1040cb2d0 msgr2=0x7fd1040b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd1040cb2d0 0x7fd1040b1410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 -- 172.21.15.81:0/1868221519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f0003a50 msgr2=0x7fd1040b26c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f0003a50 0x7fd1040b26c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 -- 172.21.15.81:0/1868221519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1040ce110 con 0x7fd10415d820 2024-09-17T05:25:01.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd102ffd640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0f0003a50 0x7fd1040b26c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd1037fe640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd10415d820 0x7fd10415cc00 secure :-1 s=READY pgs=1464 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc011740 tx=0x7fd0fc011c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd0fbfff640 1 -- 172.21.15.81:0/1868221519 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc01e070 con 0x7fd10415d820 2024-09-17T05:25:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd0fbfff640 1 -- 172.21.15.81:0/1868221519 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0fc011e50 con 0x7fd10415d820 2024-09-17T05:25:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd109a16640 1 -- 172.21.15.81:0/1868221519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1040ce3d0 con 0x7fd10415d820 2024-09-17T05:25:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd0fbfff640 1 -- 172.21.15.81:0/1868221519 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0fc019430 con 0x7fd10415d820 2024-09-17T05:25:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.276+0000 7fd109a16640 1 -- 172.21.15.81:0/1868221519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1040cbec0 con 0x7fd10415d820 2024-09-17T05:25:01.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.277+0000 7fd109a16640 1 -- 172.21.15.81:0/1868221519 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1040d26f0 con 0x7fd10415d820 2024-09-17T05:25:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.278+0000 7fd0fbfff640 1 -- 172.21.15.81:0/1868221519 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fd0fc021070 con 0x7fd10415d820 2024-09-17T05:25:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.278+0000 7fd0fbfff640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0e4079250 0x7fd0e407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.278+0000 7fd102ffd640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0e4079250 0x7fd0e407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.278+0000 7fd0fbfff640 1 -- 172.21.15.81:0/1868221519 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fd0fc09c2b0 con 0x7fd10415d820 2024-09-17T05:25:01.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.279+0000 7fd102ffd640 1 --2- 172.21.15.81:0/1868221519 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0e4079250 0x7fd0e407b710 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4033000 tx=0x7fd0f4001d70 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:01.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.283+0000 7fd0fbfff640 1 -- 172.21.15.81:0/1868221519 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd0fc063c00 con 0x7fd10415d820 2024-09-17T05:25:01.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.485+0000 7fd109a16640 1 -- 172.21.15.81:0/1868221519 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot rm", "vol_name": "non_existent_subvolume", "group_name": "group_1", "snap_name": "snapshot_1", "target": ["mon-mgr", ""]}) -- 0x7fd104160980 con 0x7fd0e4079250 2024-09-17T05:25:01.487 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:01.486+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:25:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.486+0000 7fd0fbfff640 1 -- 172.21.15.81:0/1868221519 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fd104160980 con 0x7fd0e4079250 2024-09-17T05:25:01.487 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:25:01.492 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:25:01.493 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup snapshot ls non_existent_subvolume group_1 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.596+0000 7fd7e050e640 1 -- 172.21.15.81:0/575710875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d80703c0 msgr2=0x7fd7d815d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.596+0000 7fd7e050e640 1 --2- 172.21.15.81:0/575710875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d80703c0 0x7fd7d815d050 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7fd7d8069b40 tx=0x7fd7d002a820 comp rx=0 tx=0).stop 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.597+0000 7fd7e050e640 1 -- 172.21.15.81:0/575710875 shutdown_connections 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.597+0000 7fd7e050e640 1 --2- 172.21.15.81:0/575710875 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d80703c0 0x7fd7d815d050 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.597+0000 7fd7e050e640 1 --2- 172.21.15.81:0/575710875 >> v2:172.21.15.160:3300/0 conn(0x7fd7d8073880 0x7fd7d806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.597+0000 7fd7e050e640 1 -- 172.21.15.81:0/575710875 >> 172.21.15.81:0/575710875 conn(0x7fd7d80b1620 msgr2=0x7fd7d80b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.597+0000 7fd7e050e640 1 -- 172.21.15.81:0/575710875 shutdown_connections 2024-09-17T05:25:01.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.597+0000 7fd7e050e640 1 -- 172.21.15.81:0/575710875 wait complete. 2024-09-17T05:25:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 Processor -- start 2024-09-17T05:25:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 -- start start 2024-09-17T05:25:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7d80703c0 0x7fd7d8145060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d815aa20 0x7fd7d8152350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d8151260 0x7fd7d8153c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d815d920 con 0x7fd7d815aa20 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd7d815d7a0 con 0x7fd7d8151260 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.598+0000 7fd7e050e640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd7d815daa0 con 0x7fd7d80703c0 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d815aa20 0x7fd7d8152350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d815aa20 0x7fd7d8152350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40118/0 (socket says 172.21.15.81:40118) 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 -- 172.21.15.81:0/3472663578 learned_addr learned my addr 172.21.15.81:0/3472663578 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7deaab640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d8151260 0x7fd7d8153c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7de2aa640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7d80703c0 0x7fd7d8145060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 -- 172.21.15.81:0/3472663578 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7d80703c0 msgr2=0x7fd7d8145060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:01.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd7d80703c0 0x7fd7d8145060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 -- 172.21.15.81:0/3472663578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d8151260 msgr2=0x7fd7d8153c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd7d8151260 0x7fd7d8153c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 -- 172.21.15.81:0/3472663578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7d81516f0 con 0x7fd7d815aa20 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ddaa9640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd7d815aa20 0x7fd7d8152350 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7fd7c800c970 tx=0x7fd7c800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3472663578 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8004220 con 0x7fd7d815aa20 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3472663578 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd7c80044b0 con 0x7fd7d815aa20 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3472663578 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd7c8007c10 con 0x7fd7d815aa20 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7e050e640 1 -- 172.21.15.81:0/3472663578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7d8152a50 con 0x7fd7d815aa20 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.599+0000 7fd7e050e640 1 -- 172.21.15.81:0/3472663578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7d814e750 con 0x7fd7d815aa20 2024-09-17T05:25:01.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.600+0000 7fd7e050e640 1 -- 172.21.15.81:0/3472663578 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd7d815d050 con 0x7fd7d815aa20 2024-09-17T05:25:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.601+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3472663578 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fd7c8003610 con 0x7fd7d815aa20 2024-09-17T05:25:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.601+0000 7fd7ceffd640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7bc079280 0x7fd7bc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.601+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3472663578 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fd7c809bfc0 con 0x7fd7d815aa20 2024-09-17T05:25:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.601+0000 7fd7de2aa640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7bc079280 0x7fd7bc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:01.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.602+0000 7fd7de2aa640 1 --2- 172.21.15.81:0/3472663578 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7bc079280 0x7fd7bc07b740 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fd7d4001610 tx=0x7fd7d4009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:01.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.605+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3472663578 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd7d81516f0 con 0x7fd7d815aa20 2024-09-17T05:25:01.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.806+0000 7fd7e050e640 1 -- 172.21.15.81:0/3472663578 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup snapshot ls", "vol_name": "non_existent_subvolume", "group_name": "group_1", "target": ["mon-mgr", ""]}) -- 0x7fd7d806e700 con 0x7fd7bc079280 2024-09-17T05:25:01.808 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:01.808+0000 7fe39376f640 -1 mgr.server reply reply (2) No such file or directory FS 'non_existent_subvolume' not found 2024-09-17T05:25:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:01.808+0000 7fd7ceffd640 1 -- 172.21.15.81:0/3472663578 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: -2 FS 'non_existent_subvolume' not found) ==== 45+0+0 (secure 0 0 0) 0x7fd7d806e700 con 0x7fd7bc079280 2024-09-17T05:25:01.809 INFO:teuthology.orchestra.run.smithi081.stderr:Error ENOENT: FS 'non_existent_subvolume' not found 2024-09-17T05:25:01.813 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-17T05:25:01.814 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:25:01.814 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:01.865 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:01.910 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:25:01.911 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:01.911 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:01.911 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:01.928 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:01.928 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:01.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 -- 172.21.15.81:0/1195570053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 msgr2=0x7f89200cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 --2- 172.21.15.81:0/1195570053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f89200cf9b0 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f8910005fd0 tx=0x7f891002aa00 comp rx=0 tx=0).stop 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 -- 172.21.15.81:0/1195570053 shutdown_connections 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 --2- 172.21.15.81:0/1195570053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89200d0d40 0x7f89200b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 --2- 172.21.15.81:0/1195570053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f89200cf9b0 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 -- 172.21.15.81:0/1195570053 >> 172.21.15.81:0/1195570053 conn(0x7f89200d3ea0 msgr2=0x7f89200d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 -- 172.21.15.81:0/1195570053 shutdown_connections 2024-09-17T05:25:02.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.124+0000 7f89279ec640 1 -- 172.21.15.81:0/1195570053 wait complete. 2024-09-17T05:25:02.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 Processor -- start 2024-09-17T05:25:02.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 -- start start 2024-09-17T05:25:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89200d0d40 0x7f89200cde10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89200d49c0 0x7f8920160740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f8920160c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89200b3d40 con 0x7f892015df90 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8920162740 con 0x7f89200d0d40 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.126+0000 7f89279ec640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f89200b3ec0 con 0x7f89200d49c0 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f8920160c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f8920160c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40136/0 (socket says 172.21.15.81:40136) 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 -- 172.21.15.81:0/1749255785 learned_addr learned my addr 172.21.15.81:0/1749255785 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8924f87640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89200d49c0 0x7f8920160740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925788640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89200d0d40 0x7f89200cde10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 -- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89200d49c0 msgr2=0x7f8920160740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89200d49c0 0x7f8920160740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 -- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89200d0d40 msgr2=0x7f89200cde10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89200d0d40 0x7f89200cde10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 -- 172.21.15.81:0/1749255785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89200b4da0 con 0x7f892015df90 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8924f87640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89200d49c0 0x7f8920160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925788640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89200d0d40 0x7f89200cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f8925f89640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f8920160c80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f891800b420 tx=0x7f891800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f891dffb640 1 -- 172.21.15.81:0/1749255785 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918011830 con 0x7f892015df90 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f891dffb640 1 -- 172.21.15.81:0/1749255785 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8918016070 con 0x7f892015df90 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89200b5080 con 0x7f892015df90 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f891dffb640 1 -- 172.21.15.81:0/1749255785 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918011d60 con 0x7f892015df90 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.127+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89201f50a0 con 0x7f892015df90 2024-09-17T05:25:02.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.128+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89200b52c0 con 0x7f892015df90 2024-09-17T05:25:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.129+0000 7f891dffb640 1 -- 172.21.15.81:0/1749255785 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f891801b460 con 0x7f892015df90 2024-09-17T05:25:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.130+0000 7f891dffb640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f890c079250 0x7f890c07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.130+0000 7f891dffb640 1 -- 172.21.15.81:0/1749255785 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f891809b5f0 con 0x7f892015df90 2024-09-17T05:25:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.130+0000 7f8925788640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f890c079250 0x7f890c07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.130+0000 7f8925788640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f890c079250 0x7f890c07b710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8910035000 tx=0x7f8910004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:02.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.134+0000 7f891dffb640 1 -- 172.21.15.81:0/1749255785 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f89200b52c0 con 0x7f892015df90 2024-09-17T05:25:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.321+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f89200d47b0 con 0x7f892015df90 2024-09-17T05:25:02.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.321+0000 7f891dffb640 1 -- 172.21.15.81:0/1749255785 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7f89200d47b0 con 0x7f892015df90 2024-09-17T05:25:02.323 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:25:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f890c079250 msgr2=0x7f890c07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f890c079250 0x7f890c07b710 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f8910035000 tx=0x7f8910004ab0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 msgr2=0x7f8920160c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f8920160c80 secure :-1 s=READY pgs=1469 cs=0 l=1 rev1=1 crypto rx=0x7f891800b420 tx=0x7f891800b8e0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 shutdown_connections 2024-09-17T05:25:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f892015df90 0x7f8920160c80 unknown :-1 s=CLOSED pgs=1469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89200d49c0 0x7f8920160740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f890c079250 0x7f890c07b710 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 --2- 172.21.15.81:0/1749255785 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89200d0d40 0x7f89200cde10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 >> 172.21.15.81:0/1749255785 conn(0x7f89200d3ea0 msgr2=0x7f89200b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 shutdown_connections 2024-09-17T05:25:02.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.324+0000 7f89279ec640 1 -- 172.21.15.81:0/1749255785 wait complete. 2024-09-17T05:25:02.335 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:25:02.335 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:02.336 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:02.359 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[72738]: fuse finished with error 0 and tester_r 0 2024-09-17T05:25:02.360 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:25:02.361 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:02.361 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:25:02.528 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:02.528 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:02.528 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:02.549 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:02.549 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:02.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:25:02.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2464760435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac0d0d40 msgr2=0x7f66ac0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2464760435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac0d0d40 0x7f66ac0cf9b0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7f6694009830 tx=0x7f669402a480 comp rx=0 tx=0).stop 2024-09-17T05:25:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2464760435 shutdown_connections 2024-09-17T05:25:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2464760435 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66ac0d49c0 0x7f66ac0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2464760435 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac0d0d40 0x7f66ac0cf9b0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2464760435 >> 172.21.15.81:0/2464760435 conn(0x7f66ac0d3ea0 msgr2=0x7f66ac0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2464760435 shutdown_connections 2024-09-17T05:25:02.722 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.720+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2464760435 wait complete. 2024-09-17T05:25:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 Processor -- start 2024-09-17T05:25:02.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 -- start start 2024-09-17T05:25:02.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66ac0d0d40 0x7f66ac160710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66ac0d49c0 0x7f66ac0c8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac15df90 0x7f66ac0cc140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac0b3d40 con 0x7f66ac15df90 2024-09-17T05:25:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f66ac162710 con 0x7f66ac0d0d40 2024-09-17T05:25:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.722+0000 7f66b0dbb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f66ac0b3ec0 con 0x7f66ac0d49c0 2024-09-17T05:25:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac15df90 0x7f66ac0cc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac15df90 0x7f66ac0cc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:40164/0 (socket says 172.21.15.81:40164) 2024-09-17T05:25:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 -- 172.21.15.81:0/2861539146 learned_addr learned my addr 172.21.15.81:0/2861539146 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:02.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66a3fff640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66ac0d49c0 0x7f66ac0c8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aa59c640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66ac0d0d40 0x7f66ac160710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 -- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66ac0d49c0 msgr2=0x7f66ac0c8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66ac0d49c0 0x7f66ac0c8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 -- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66ac0d0d40 msgr2=0x7f66ac160710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66ac0d0d40 0x7f66ac160710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 -- 172.21.15.81:0/2861539146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ac0cb0a0 con 0x7f66ac15df90 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66aad9d640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac15df90 0x7f66ac0cc140 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f66a400ead0 tx=0x7f66a400ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66a2ffd640 1 -- 172.21.15.81:0/2861539146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a400cde0 con 0x7f66ac15df90 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66a2ffd640 1 -- 172.21.15.81:0/2861539146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f66a4004c10 con 0x7f66ac15df90 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ac0cb380 con 0x7f66ac15df90 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66a2ffd640 1 -- 172.21.15.81:0/2861539146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66a4005020 con 0x7f66ac15df90 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.723+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ac0cb940 con 0x7f66ac15df90 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.724+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ac074640 con 0x7f66ac15df90 2024-09-17T05:25:02.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.725+0000 7f66a2ffd640 1 -- 172.21.15.81:0/2861539146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f66a40051c0 con 0x7f66ac15df90 2024-09-17T05:25:02.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.725+0000 7f66a2ffd640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c079250 0x7f668c07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:02.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.726+0000 7f66aa59c640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c079250 0x7f668c07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:02.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.726+0000 7f66a2ffd640 1 -- 172.21.15.81:0/2861539146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f66a409c3a0 con 0x7f66ac15df90 2024-09-17T05:25:02.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.726+0000 7f66aa59c640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c079250 0x7f668c07b710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f669c000f60 tx=0x7f669c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:02.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.730+0000 7f66a2ffd640 1 -- 172.21.15.81:0/2861539146 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f66ac074640 con 0x7f66ac15df90 2024-09-17T05:25:02.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.915+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f66ac0b43b0 con 0x7f66ac15df90 2024-09-17T05:25:02.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.916+0000 7f66a2ffd640 1 -- 172.21.15.81:0/2861539146 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v129) ==== 80+0+0 (secure 0 0 0) 0x7f66a4016030 con 0x7f66ac15df90 2024-09-17T05:25:02.917 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:25:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c079250 msgr2=0x7f668c07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c079250 0x7f668c07b710 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f669c000f60 tx=0x7f669c009040 comp rx=0 tx=0).stop 2024-09-17T05:25:02.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac15df90 msgr2=0x7f66ac0cc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac15df90 0x7f66ac0cc140 secure :-1 s=READY pgs=1472 cs=0 l=1 rev1=1 crypto rx=0x7f66a400ead0 tx=0x7f66a400ef90 comp rx=0 tx=0).stop 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 shutdown_connections 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f66ac15df90 0x7f66ac0cc140 unknown :-1 s=CLOSED pgs=1472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f66ac0d49c0 0x7f66ac0c8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f668c079250 0x7f668c07b710 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 --2- 172.21.15.81:0/2861539146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f66ac0d0d40 0x7f66ac160710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 >> 172.21.15.81:0/2861539146 conn(0x7f66ac0d3ea0 msgr2=0x7f66ac0b45c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 shutdown_connections 2024-09-17T05:25:02.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:02.918+0000 7f66b0dbb640 1 -- 172.21.15.81:0/2861539146 wait complete. 2024-09-17T05:25:02.930 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:25:02.930 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:02.930 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:02.958 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[48692]: fuse finished with error 0 and tester_r 0 2024-09-17T05:25:02.960 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:25:02.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:02.961 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:25:03.093 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:03.093 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:03.093 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:03.109 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:25:03.109 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:03.110 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:03.110 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:03.127 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:25:03.128 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.250+0000 7f3a03ec5640 1 -- 172.21.15.81:0/1247794478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8003a30 msgr2=0x7f39e8003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.250+0000 7f3a03ec5640 1 --2- 172.21.15.81:0/1247794478 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39e8003a30 0x7f39e8003e50 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f39f800c260 tx=0x7f39e8005830 comp rx=0 tx=0).stop 2024-09-17T05:25:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.250+0000 7f3a02462640 1 -- 172.21.15.81:0/1247794478 reap_dead start 2024-09-17T05:25:03.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.250+0000 7f3a03ec5640 1 -- 172.21.15.81:0/1247794478 shutdown_connections 2024-09-17T05:25:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.250+0000 7f3a03ec5640 1 -- 172.21.15.81:0/1247794478 >> 172.21.15.81:0/1247794478 conn(0x7f39fc0b1690 msgr2=0x7f39fc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.250+0000 7f3a03ec5640 1 -- 172.21.15.81:0/1247794478 shutdown_connections 2024-09-17T05:25:03.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.250+0000 7f3a03ec5640 1 -- 172.21.15.81:0/1247794478 wait complete. 2024-09-17T05:25:03.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.251+0000 7f3a03ec5640 1 Processor -- start 2024-09-17T05:25:03.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.251+0000 7f3a03ec5640 1 -- start start 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a03ec5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8003a30 0x7f39fc0cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a03ec5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc1f39a0 0x7f39fc0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a03ec5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39fc0ca160 0x7f39fc159100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a03ec5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0739a0 con 0x7f39fc0ca160 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a03ec5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f39fc0707f0 con 0x7f39e8003a30 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a03ec5640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f39fc073b20 con 0x7f39fc1f39a0 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39fc0ca160 0x7f39fc159100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39fc0ca160 0x7f39fc159100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48958/0 (socket says 172.21.15.81:48958) 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 -- 172.21.15.81:0/8372599 learned_addr learned my addr 172.21.15.81:0/8372599 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a01c61640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8003a30 0x7f39fc0cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a01460640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc1f39a0 0x7f39fc0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 -- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc1f39a0 msgr2=0x7f39fc0c9c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc1f39a0 0x7f39fc0c9c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 -- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8003a30 msgr2=0x7f39fc0cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8003a30 0x7f39fc0cb6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 -- 172.21.15.81:0/8372599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f39fc0ca600 con 0x7f39fc0ca160 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.252+0000 7f3a02462640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39fc0ca160 0x7f39fc159100 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f39fc074a50 tx=0x7f39f40019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.253+0000 7f39ee7fc640 1 -- 172.21.15.81:0/8372599 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4011870 con 0x7f39fc0ca160 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.253+0000 7f39ee7fc640 1 -- 172.21.15.81:0/8372599 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f39f4017070 con 0x7f39fc0ca160 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.253+0000 7f39ee7fc640 1 -- 172.21.15.81:0/8372599 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39f4011dc0 con 0x7f39fc0ca160 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.253+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39fc0ca8e0 con 0x7f39fc0ca160 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.253+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39fc0caea0 con 0x7f39fc0ca160 2024-09-17T05:25:03.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.254+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39fc0b4690 con 0x7f39fc0ca160 2024-09-17T05:25:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.254+0000 7f39ee7fc640 1 -- 172.21.15.81:0/8372599 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f39f401c460 con 0x7f39fc0ca160 2024-09-17T05:25:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.255+0000 7f39ee7fc640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39e0079250 0x7f39e007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.255+0000 7f39ee7fc640 1 -- 172.21.15.81:0/8372599 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f39f409bef0 con 0x7f39fc0ca160 2024-09-17T05:25:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.255+0000 7f3a01c61640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39e0079250 0x7f39e007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.255+0000 7f3a01c61640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39e0079250 0x7f39e007b710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39f8033000 tx=0x7f39f8038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:03.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.259+0000 7f39ee7fc640 1 -- 172.21.15.81:0/8372599 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f39f4063380 con 0x7f39fc0ca160 2024-09-17T05:25:03.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.471+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f39fc0d0440 con 0x7f39fc0ca160 2024-09-17T05:25:03.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.472+0000 7f39ee7fc640 1 -- 172.21.15.81:0/8372599 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7f39f4067db0 con 0x7f39fc0ca160 2024-09-17T05:25:03.473 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:03.473 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-17T05:24:53:652321+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6958,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/79515014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":79515014},{"type":"v1","addr":"172.21.15.160:6801","nonce":79515014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6961,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3823420234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3823420234},{"type":"v1","addr":"172.21.15.160:6835","nonce":3823420234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3648115084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3648115084},{"type":"v1","addr":"172.21.15.81:6834","nonce":3648115084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:40.594653+0000","modified":"2024-09-17T05:24:42.594562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1714561444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1714561444},{"type":"v1","addr":"172.21.15.81:6835","nonce":1714561444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7917,"qdb_cluster":[7917]},"id":10}]} 2024-09-17T05:25:03.474 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-17T05:25:03.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39e0079250 msgr2=0x7f39e007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39e0079250 0x7f39e007b710 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f39f8033000 tx=0x7f39f8038040 comp rx=0 tx=0).stop 2024-09-17T05:25:03.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39fc0ca160 msgr2=0x7f39fc159100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39fc0ca160 0x7f39fc159100 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f39fc074a50 tx=0x7f39f40019b0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 shutdown_connections 2024-09-17T05:25:03.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39fc0ca160 0x7f39fc159100 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f39fc1f39a0 0x7f39fc0c9c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f39e0079250 0x7f39e007b710 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 --2- 172.21.15.81:0/8372599 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f39e8003a30 0x7f39fc0cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 >> 172.21.15.81:0/8372599 conn(0x7f39fc0b1690 msgr2=0x7f39fc15b540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 shutdown_connections 2024-09-17T05:25:03.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.474+0000 7f3a03ec5640 1 -- 172.21.15.81:0/8372599 wait complete. 2024-09-17T05:25:03.486 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.586+0000 7f8e7365a640 1 -- 172.21.15.81:0/3624243887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c13ce00 msgr2=0x7f8e6c13f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.586+0000 7f8e7365a640 1 --2- 172.21.15.81:0/3624243887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c13ce00 0x7f8e6c13f9a0 secure :-1 s=READY pgs=1477 cs=0 l=1 rev1=1 crypto rx=0x7f8e60009830 tx=0x7f8e6002a510 comp rx=0 tx=0).stop 2024-09-17T05:25:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.586+0000 7f8e7365a640 1 -- 172.21.15.81:0/3624243887 shutdown_connections 2024-09-17T05:25:03.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.586+0000 7f8e7365a640 1 --2- 172.21.15.81:0/3624243887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c13ce00 0x7f8e6c13f9a0 unknown :-1 s=CLOSED pgs=1477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.586+0000 7f8e7365a640 1 -- 172.21.15.81:0/3624243887 >> 172.21.15.81:0/3624243887 conn(0x7f8e6c0b1690 msgr2=0x7f8e6c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.586+0000 7f8e7365a640 1 -- 172.21.15.81:0/3624243887 shutdown_connections 2024-09-17T05:25:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.586+0000 7f8e7365a640 1 -- 172.21.15.81:0/3624243887 wait complete. 2024-09-17T05:25:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.587+0000 7f8e7365a640 1 Processor -- start 2024-09-17T05:25:03.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.587+0000 7f8e7365a640 1 -- start start 2024-09-17T05:25:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e7365a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c06f0f0 0x7f8e6c1570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e7365a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e6c070690 0x7f8e6c157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e7365a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e6c13ce00 0x7f8e6c158420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e7365a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c06fd90 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e7365a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8e6c06fc10 con 0x7f8e6c070690 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e7365a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8e6c06ff10 con 0x7f8e6c13ce00 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c06f0f0 0x7f8e6c1570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c06f0f0 0x7f8e6c1570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:48980/0 (socket says 172.21.15.81:48980) 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 -- 172.21.15.81:0/1895692757 learned_addr learned my addr 172.21.15.81:0/1895692757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 -- 172.21.15.81:0/1895692757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e6c13ce00 msgr2=0x7f8e6c158420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e6c13ce00 0x7f8e6c158420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 -- 172.21.15.81:0/1895692757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e6c070690 msgr2=0x7f8e6c157ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e6c070690 0x7f8e6c157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.588+0000 7f8e713f6640 1 -- 172.21.15.81:0/1895692757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e6c1579e0 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.589+0000 7f8e713f6640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c06f0f0 0x7f8e6c1570e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c7d0 tx=0x7f8e5c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.589+0000 7f8e69ffb640 1 -- 172.21.15.81:0/1895692757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c017070 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.589+0000 7f8e69ffb640 1 -- 172.21.15.81:0/1895692757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8e5c005070 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.589+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e6c1f5a90 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.589+0000 7f8e69ffb640 1 -- 172.21.15.81:0/1895692757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8e5c0054c0 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.589+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e6c1f6050 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.590+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e6c06f500 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.590+0000 7f8e69ffb640 1 -- 172.21.15.81:0/1895692757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f8e5c01a070 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.591+0000 7f8e69ffb640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8e58079250 0x7f8e5807b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.591+0000 7f8e69ffb640 1 -- 172.21.15.81:0/1895692757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f8e5c09b150 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.591+0000 7f8e70bf5640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8e58079250 0x7f8e5807b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.591+0000 7f8e70bf5640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8e58079250 0x7f8e5807b710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8e60034000 tx=0x7f8e600046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:03.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.595+0000 7f8e69ffb640 1 -- 172.21.15.81:0/1895692757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8e5c062b30 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.809+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8e6c0d09b0 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.809+0000 7f8e69ffb640 1 -- 172.21.15.81:0/1895692757 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7f8e5c062430 con 0x7f8e6c06f0f0 2024-09-17T05:25:03.810 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:03.811 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-17T05:24:53:652321+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6958,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/79515014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":79515014},{"type":"v1","addr":"172.21.15.160:6801","nonce":79515014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6961,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3823420234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3823420234},{"type":"v1","addr":"172.21.15.160:6835","nonce":3823420234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3648115084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3648115084},{"type":"v1","addr":"172.21.15.81:6834","nonce":3648115084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:40.594653+0000","modified":"2024-09-17T05:24:42.594562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1714561444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1714561444},{"type":"v1","addr":"172.21.15.81:6835","nonce":1714561444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7917,"qdb_cluster":[7917]},"id":10}]} 2024-09-17T05:25:03.811 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-17T05:25:03.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8e58079250 msgr2=0x7f8e5807b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8e58079250 0x7f8e5807b710 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f8e60034000 tx=0x7f8e600046c0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c06f0f0 msgr2=0x7f8e6c1570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c06f0f0 0x7f8e6c1570e0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f8e5c00c7d0 tx=0x7f8e5c00cc90 comp rx=0 tx=0).stop 2024-09-17T05:25:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 shutdown_connections 2024-09-17T05:25:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8e6c13ce00 0x7f8e6c158420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8e58079250 0x7f8e5807b710 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8e6c070690 0x7f8e6c157ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 --2- 172.21.15.81:0/1895692757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8e6c06f0f0 0x7f8e6c1570e0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.811+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 >> 172.21.15.81:0/1895692757 conn(0x7f8e6c0b1690 msgr2=0x7f8e6c0b39b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.812+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 shutdown_connections 2024-09-17T05:25:03.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.812+0000 7f8e7365a640 1 -- 172.21.15.81:0/1895692757 wait complete. 2024-09-17T05:25:03.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:03.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.924+0000 7fe2c8b65640 1 -- 172.21.15.81:0/972497115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 msgr2=0x7fe2ac00b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.924+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/972497115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2ac00b9c0 secure :-1 s=READY pgs=1480 cs=0 l=1 rev1=1 crypto rx=0x7fe2bc009b50 tx=0x7fe2ac005830 comp rx=0 tx=0).stop 2024-09-17T05:25:03.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.924+0000 7fe2c8b65640 1 -- 172.21.15.81:0/972497115 shutdown_connections 2024-09-17T05:25:03.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.924+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/972497115 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2ac00b9c0 unknown :-1 s=CLOSED pgs=1480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.924+0000 7fe2c8b65640 1 -- 172.21.15.81:0/972497115 >> 172.21.15.81:0/972497115 conn(0x7fe2c40d3ea0 msgr2=0x7fe2c40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:03.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.924+0000 7fe2c8b65640 1 -- 172.21.15.81:0/972497115 shutdown_connections 2024-09-17T05:25:03.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.924+0000 7fe2c8b65640 1 -- 172.21.15.81:0/972497115 wait complete. 2024-09-17T05:25:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.925+0000 7fe2c8b65640 1 Processor -- start 2024-09-17T05:25:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.925+0000 7fe2c8b65640 1 -- start start 2024-09-17T05:25:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c8b65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2c415c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c8b65640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c40b5260 0x7fe2c41f4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c8b65640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40b56e0 0x7fe2c415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.928 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c8b65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c40cf9b0 con 0x7fe2ac0051c0 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c8b65640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe2c41626e0 con 0x7fe2c40b56e0 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c8b65640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe2c40cfb30 con 0x7fe2c40b5260 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2c415c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2c415c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49000/0 (socket says 172.21.15.81:49000) 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 -- 172.21.15.81:0/2866548736 learned_addr learned my addr 172.21.15.81:0/2866548736 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c1d9b640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c40b5260 0x7fe2c41f4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c2d9d640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40b56e0 0x7fe2c415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 -- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c40b5260 msgr2=0x7fe2c41f4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c40b5260 0x7fe2c41f4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 -- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40b56e0 msgr2=0x7fe2c415e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40b56e0 0x7fe2c415e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 -- 172.21.15.81:0/2866548736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2c41f5270 con 0x7fe2ac0051c0 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.926+0000 7fe2c259c640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2c415c370 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400e980 tx=0x7fe2b400ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.927+0000 7fe2b2ffd640 1 -- 172.21.15.81:0/2866548736 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b4015070 con 0x7fe2ac0051c0 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.927+0000 7fe2b2ffd640 1 -- 172.21.15.81:0/2866548736 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe2b400cd40 con 0x7fe2ac0051c0 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.927+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2c41f5550 con 0x7fe2ac0051c0 2024-09-17T05:25:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.927+0000 7fe2b2ffd640 1 -- 172.21.15.81:0/2866548736 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2b40116c0 con 0x7fe2ac0051c0 2024-09-17T05:25:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.927+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2c40b6280 con 0x7fe2ac0051c0 2024-09-17T05:25:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.928+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2c40b4850 con 0x7fe2ac0051c0 2024-09-17T05:25:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.928+0000 7fe2b2ffd640 1 -- 172.21.15.81:0/2866548736 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fe2b4018070 con 0x7fe2ac0051c0 2024-09-17T05:25:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.929+0000 7fe2b2ffd640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079250 0x7fe2a407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.929+0000 7fe2b2ffd640 1 -- 172.21.15.81:0/2866548736 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fe2b409c060 con 0x7fe2ac0051c0 2024-09-17T05:25:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.929+0000 7fe2c1d9b640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079250 0x7fe2a407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.929+0000 7fe2c1d9b640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079250 0x7fe2a407b710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40a1d50 tx=0x7fe2b8006d00 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:03.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:03.933+0000 7fe2b2ffd640 1 -- 172.21.15.81:0/2866548736 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe2c40ce970 con 0x7fe2ac0051c0 2024-09-17T05:25:04.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.109+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2c40d0710 con 0x7fe2ac0051c0 2024-09-17T05:25:04.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.110+0000 7fe2b2ffd640 1 -- 172.21.15.81:0/2866548736 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16851 (secure 0 0 0) 0x7fe2b40633f0 con 0x7fe2ac0051c0 2024-09-17T05:25:04.111 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:04.112 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":129,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:42.226355+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:39.221468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:39.555911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:04.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079250 msgr2=0x7fe2a407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079250 0x7fe2a407b710 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fe2c40a1d50 tx=0x7fe2b8006d00 comp rx=0 tx=0).stop 2024-09-17T05:25:04.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 msgr2=0x7fe2c415c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2c415c370 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7fe2b400e980 tx=0x7fe2b400ed80 comp rx=0 tx=0).stop 2024-09-17T05:25:04.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 shutdown_connections 2024-09-17T05:25:04.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe2a4079250 0x7fe2a407b710 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe2c40b56e0 0x7fe2c415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe2c40b5260 0x7fe2c41f4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 --2- 172.21.15.81:0/2866548736 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe2ac0051c0 0x7fe2c415c370 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 >> 172.21.15.81:0/2866548736 conn(0x7fe2c40d3ea0 msgr2=0x7fe2c40b6cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:04.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 shutdown_connections 2024-09-17T05:25:04.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.113+0000 7fe2c8b65640 1 -- 172.21.15.81:0/2866548736 wait complete. 2024-09-17T05:25:04.125 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:25:04.125 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 -- 172.21.15.81:0/59091218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 msgr2=0x7f165c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 --2- 172.21.15.81:0/59091218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c0cf9b0 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7f165c0b9f50 tx=0x7f164c02aac0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 -- 172.21.15.81:0/59091218 shutdown_connections 2024-09-17T05:25:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 --2- 172.21.15.81:0/59091218 >> v2:172.21.15.160:3300/0 conn(0x7f165c0d49c0 0x7f165c0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 --2- 172.21.15.81:0/59091218 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c0cf9b0 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 -- 172.21.15.81:0/59091218 >> 172.21.15.81:0/59091218 conn(0x7f165c0d3ea0 msgr2=0x7f165c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:04.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 -- 172.21.15.81:0/59091218 shutdown_connections 2024-09-17T05:25:04.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.225+0000 7f1662bf3640 1 -- 172.21.15.81:0/59091218 wait complete. 2024-09-17T05:25:04.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 Processor -- start 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 -- start start 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c160f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f165c0d49c0 0x7f165c1f9000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f165c15df90 0x7f165c154340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f165c162690 con 0x7f165c0d0d40 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f165c0b3d40 con 0x7f165c0d49c0 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.227+0000 7f1662bf3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f165c160af0 con 0x7f165c15df90 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c160f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c160f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49016/0 (socket says 172.21.15.81:49016) 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 -- 172.21.15.81:0/1940564525 learned_addr learned my addr 172.21.15.81:0/1940564525 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f165bfff640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f165c0d49c0 0x7f165c1f9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f1661190640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f165c15df90 0x7f165c154340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 -- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f165c15df90 msgr2=0x7f165c154340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f165c15df90 0x7f165c154340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 -- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f165c0d49c0 msgr2=0x7f165c1f9000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f165c0d49c0 0x7f165c1f9000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 -- 172.21.15.81:0/1940564525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f165c154880 con 0x7f165c0d0d40 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f165bfff640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f165c0d49c0 0x7f165c1f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f166098f640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c160f80 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f165400c3a0 tx=0x7f165400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f16597fa640 1 -- 172.21.15.81:0/1940564525 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654017070 con 0x7f165c0d0d40 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f16597fa640 1 -- 172.21.15.81:0/1940564525 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f16540053c0 con 0x7f165c0d0d40 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f165c15d680 con 0x7f165c0d0d40 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f16597fa640 1 -- 172.21.15.81:0/1940564525 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1654003850 con 0x7f165c0d0d40 2024-09-17T05:25:04.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.228+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165c1601c0 con 0x7f165c0d0d40 2024-09-17T05:25:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.229+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165c0b4260 con 0x7f165c0d0d40 2024-09-17T05:25:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.230+0000 7f16597fa640 1 -- 172.21.15.81:0/1940564525 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f165401a070 con 0x7f165c0d0d40 2024-09-17T05:25:04.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.230+0000 7f16597fa640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f163c079280 0x7f163c07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.230+0000 7f16597fa640 1 -- 172.21.15.81:0/1940564525 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f165409ae00 con 0x7f165c0d0d40 2024-09-17T05:25:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.230+0000 7f165bfff640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f163c079280 0x7f163c07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.231+0000 7f165bfff640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f163c079280 0x7f163c07b740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f164c035000 tx=0x7f164c004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:04.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.234+0000 7f16597fa640 1 -- 172.21.15.81:0/1940564525 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f165c154880 con 0x7f165c0d0d40 2024-09-17T05:25:04.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.448+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f165c08d590 con 0x7f165c0d0d40 2024-09-17T05:25:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.449+0000 7f16597fa640 1 -- 172.21.15.81:0/1940564525 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7f165c0ce970 con 0x7f165c0d0d40 2024-09-17T05:25:04.450 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:04.450 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-17T05:24:53:652321+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6958,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/79515014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":79515014},{"type":"v1","addr":"172.21.15.160:6801","nonce":79515014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6961,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3823420234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3823420234},{"type":"v1","addr":"172.21.15.160:6835","nonce":3823420234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3648115084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3648115084},{"type":"v1","addr":"172.21.15.81:6834","nonce":3648115084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:40.594653+0000","modified":"2024-09-17T05:24:42.594562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1714561444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1714561444},{"type":"v1","addr":"172.21.15.81:6835","nonce":1714561444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7917,"qdb_cluster":[7917]},"id":10}]} 2024-09-17T05:25:04.450 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-17T05:25:04.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f163c079280 msgr2=0x7f163c07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f163c079280 0x7f163c07b740 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f164c035000 tx=0x7f164c004ab0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 msgr2=0x7f165c160f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c160f80 secure :-1 s=READY pgs=1483 cs=0 l=1 rev1=1 crypto rx=0x7f165400c3a0 tx=0x7f165400c860 comp rx=0 tx=0).stop 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 shutdown_connections 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f165c15df90 0x7f165c154340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f163c079280 0x7f163c07b740 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f165c0d49c0 0x7f165c1f9000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 --2- 172.21.15.81:0/1940564525 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f165c0d0d40 0x7f165c160f80 unknown :-1 s=CLOSED pgs=1483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 >> 172.21.15.81:0/1940564525 conn(0x7f165c0d3ea0 msgr2=0x7f165c0b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 shutdown_connections 2024-09-17T05:25:04.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.451+0000 7f1662bf3640 1 -- 172.21.15.81:0/1940564525 wait complete. 2024-09-17T05:25:04.463 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 -- 172.21.15.81:0/4012039351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91440b1920 msgr2=0x7f91440d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 --2- 172.21.15.81:0/4012039351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91440b1920 0x7f91440d1d10 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f912c005fd0 tx=0x7f912c02a540 comp rx=0 tx=0).stop 2024-09-17T05:25:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 -- 172.21.15.81:0/4012039351 shutdown_connections 2024-09-17T05:25:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 --2- 172.21.15.81:0/4012039351 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f91440b1920 0x7f91440d1d10 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 --2- 172.21.15.81:0/4012039351 >> v2:172.21.15.160:3300/0 conn(0x7f914415bdc0 0x7f91440b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 -- 172.21.15.81:0/4012039351 >> 172.21.15.81:0/4012039351 conn(0x7f9144074cb0 msgr2=0x7f914409b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 -- 172.21.15.81:0/4012039351 shutdown_connections 2024-09-17T05:25:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.564+0000 7f9149975640 1 -- 172.21.15.81:0/4012039351 wait complete. 2024-09-17T05:25:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.565+0000 7f9149975640 1 Processor -- start 2024-09-17T05:25:04.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.565+0000 7f9149975640 1 -- start start 2024-09-17T05:25:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9149975640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91440b1920 0x7f91440cbb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9149975640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91440d2250 0x7f91441f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9149975640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f914415bdc0 0x7f914415a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9149975640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f91440cdac0 con 0x7f91440d2250 2024-09-17T05:25:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9149975640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f91440cf850 con 0x7f91440b1920 2024-09-17T05:25:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9149975640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f91440cdc40 con 0x7f914415bdc0 2024-09-17T05:25:04.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91440d2250 0x7f91441f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91440d2250 0x7f91441f23b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49030/0 (socket says 172.21.15.81:49030) 2024-09-17T05:25:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 -- 172.21.15.81:0/819956188 learned_addr learned my addr 172.21.15.81:0/819956188 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91437fe640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f914415bdc0 0x7f914415a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9142ffd640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91440b1920 0x7f91440cbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 -- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f914415bdc0 msgr2=0x7f914415a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f914415bdc0 0x7f914415a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 -- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91440b1920 msgr2=0x7f91440cbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91440b1920 0x7f91440cbb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 -- 172.21.15.81:0/819956188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f914415c4c0 con 0x7f91440d2250 2024-09-17T05:25:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f9142ffd640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91440b1920 0x7f91440cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:04.571 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.566+0000 7f91427fc640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91440d2250 0x7f91441f23b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f912c034040 tx=0x7f912c0038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.567+0000 7f913bfff640 1 -- 172.21.15.81:0/819956188 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c03e030 con 0x7f91440d2250 2024-09-17T05:25:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.567+0000 7f913bfff640 1 -- 172.21.15.81:0/819956188 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f912c003db0 con 0x7f91440d2250 2024-09-17T05:25:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.567+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91441f2f50 con 0x7f91440d2250 2024-09-17T05:25:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.567+0000 7f913bfff640 1 -- 172.21.15.81:0/819956188 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f912c035040 con 0x7f91440d2250 2024-09-17T05:25:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.567+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f914415c760 con 0x7f91440d2250 2024-09-17T05:25:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.568+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91440b2750 con 0x7f91440d2250 2024-09-17T05:25:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.568+0000 7f913bfff640 1 -- 172.21.15.81:0/819956188 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f912c041030 con 0x7f91440d2250 2024-09-17T05:25:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.569+0000 7f913bfff640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9124079280 0x7f912407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.569+0000 7f9142ffd640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9124079280 0x7f912407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.569+0000 7f913bfff640 1 -- 172.21.15.81:0/819956188 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f912c0bbfe0 con 0x7f91440d2250 2024-09-17T05:25:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.569+0000 7f9142ffd640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9124079280 0x7f912407b740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9134005fd0 tx=0x7f9134009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.573+0000 7f913bfff640 1 -- 172.21.15.81:0/819956188 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f912c0832f0 con 0x7f91440d2250 2024-09-17T05:25:04.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.786+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f914415c930 con 0x7f91440d2250 2024-09-17T05:25:04.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.786+0000 7f913bfff640 1 -- 172.21.15.81:0/819956188 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 77 v77) ==== 94+0+5227 (secure 0 0 0) 0x7f912c087d20 con 0x7f91440d2250 2024-09-17T05:25:04.787 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:04.787 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":77,"btime":"2024-09-17T05:24:53:652321+0000","default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6958,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/79515014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":79515014},{"type":"v1","addr":"172.21.15.160:6801","nonce":79515014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6961,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3823420234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3823420234},{"type":"v1","addr":"172.21.15.160:6835","nonce":3823420234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3648115084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3648115084},{"type":"v1","addr":"172.21.15.81:6834","nonce":3648115084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72}],"filesystems":[{"mdsmap":{"epoch":76,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:24:40.594653+0000","modified":"2024-09-17T05:24:42.594562+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":7917},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7917":{"gid":7917,"name":"c","rank":0,"incarnation":74,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/1714561444","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":1714561444},{"type":"v1","addr":"172.21.15.81:6835","nonce":1714561444}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":7917,"qdb_cluster":[7917]},"id":10}]} 2024-09-17T05:25:04.788 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 77 2024-09-17T05:25:04.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9124079280 msgr2=0x7f912407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9124079280 0x7f912407b740 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f9134005fd0 tx=0x7f9134009500 comp rx=0 tx=0).stop 2024-09-17T05:25:04.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91440d2250 msgr2=0x7f91441f23b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91440d2250 0x7f91441f23b0 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7f912c034040 tx=0x7f912c0038a0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 shutdown_connections 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f914415bdc0 0x7f914415a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f91440d2250 0x7f91441f23b0 unknown :-1 s=CLOSED pgs=1484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9124079280 0x7f912407b740 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 --2- 172.21.15.81:0/819956188 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f91440b1920 0x7f91440cbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 >> 172.21.15.81:0/819956188 conn(0x7f9144074cb0 msgr2=0x7f9144071c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 shutdown_connections 2024-09-17T05:25:04.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.788+0000 7f9149975640 1 -- 172.21.15.81:0/819956188 wait complete. 2024-09-17T05:25:04.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:04.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.901+0000 7f9487a5a640 1 -- 172.21.15.81:0/1888347716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c004800 msgr2=0x7f946c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.901+0000 7f9487a5a640 1 --2- 172.21.15.81:0/1888347716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c004800 0x7f946c004c80 secure :-1 s=READY pgs=1486 cs=0 l=1 rev1=1 crypto rx=0x7f9474006fd0 tx=0x7f946c005830 comp rx=0 tx=0).stop 2024-09-17T05:25:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.901+0000 7f9487a5a640 1 -- 172.21.15.81:0/1888347716 shutdown_connections 2024-09-17T05:25:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.901+0000 7f9487a5a640 1 --2- 172.21.15.81:0/1888347716 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f946c004800 0x7f946c004c80 unknown :-1 s=CLOSED pgs=1486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.901+0000 7f9487a5a640 1 -- 172.21.15.81:0/1888347716 >> 172.21.15.81:0/1888347716 conn(0x7f94800b1690 msgr2=0x7f94800b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.901+0000 7f9487a5a640 1 -- 172.21.15.81:0/1888347716 shutdown_connections 2024-09-17T05:25:04.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.901+0000 7f9487a5a640 1 -- 172.21.15.81:0/1888347716 wait complete. 2024-09-17T05:25:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.902+0000 7f9487a5a640 1 Processor -- start 2024-09-17T05:25:04.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.902+0000 7f9487a5a640 1 -- start start 2024-09-17T05:25:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9487a5a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f946c004800 0x7f94801f2840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9487a5a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94801f6840 0x7f9480150a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9487a5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9480150fb0 0x7f948014dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9487a5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9480073f20 con 0x7f9480150fb0 2024-09-17T05:25:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9487a5a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9480073da0 con 0x7f946c004800 2024-09-17T05:25:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9487a5a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f948006ff80 con 0x7f94801f6840 2024-09-17T05:25:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9480150fb0 0x7f948014dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9480150fb0 0x7f948014dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49042/0 (socket says 172.21.15.81:49042) 2024-09-17T05:25:04.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 -- 172.21.15.81:0/3715782531 learned_addr learned my addr 172.21.15.81:0/3715782531 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9484ff5640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94801f6840 0x7f9480150a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f94857f6640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f946c004800 0x7f94801f2840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 -- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94801f6840 msgr2=0x7f9480150a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94801f6840 0x7f9480150a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 -- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f946c004800 msgr2=0x7f94801f2840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:04.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f946c004800 0x7f94801f2840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f9485ff7640 1 -- 172.21.15.81:0/3715782531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94801f3aa0 con 0x7f9480150fb0 2024-09-17T05:25:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.903+0000 7f94857f6640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f946c004800 0x7f94801f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.904+0000 7f9485ff7640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9480150fb0 0x7f948014dca0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f94800cc770 tx=0x7f94780019b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.904+0000 7f9471ffb640 1 -- 172.21.15.81:0/3715782531 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478011870 con 0x7f9480150fb0 2024-09-17T05:25:04.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.904+0000 7f9471ffb640 1 -- 172.21.15.81:0/3715782531 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9478017070 con 0x7f9480150fb0 2024-09-17T05:25:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.904+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94801f2e90 con 0x7f9480150fb0 2024-09-17T05:25:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.904+0000 7f9471ffb640 1 -- 172.21.15.81:0/3715782531 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9478011d80 con 0x7f9480150fb0 2024-09-17T05:25:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.904+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94801f3450 con 0x7f9480150fb0 2024-09-17T05:25:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.905+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94800b4690 con 0x7f9480150fb0 2024-09-17T05:25:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.905+0000 7f9471ffb640 1 -- 172.21.15.81:0/3715782531 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f947801c460 con 0x7f9480150fb0 2024-09-17T05:25:04.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.906+0000 7f9471ffb640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9464079250 0x7f946407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.906+0000 7f94857f6640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9464079250 0x7f946407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.906+0000 7f9471ffb640 1 -- 172.21.15.81:0/3715782531 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7f947809c0b0 con 0x7f9480150fb0 2024-09-17T05:25:04.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.907+0000 7f94857f6640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9464079250 0x7f946407b710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f94801518f0 tx=0x7f947c005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:04.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:04.910+0000 7f9471ffb640 1 -- 172.21.15.81:0/3715782531 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9478063b90 con 0x7f9480150fb0 2024-09-17T05:25:05.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.087+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f94800b0960 con 0x7f9480150fb0 2024-09-17T05:25:05.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.088+0000 7f9471ffb640 1 -- 172.21.15.81:0/3715782531 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v129) ==== 74+0+16851 (secure 0 0 0) 0x7f9478063490 con 0x7f9480150fb0 2024-09-17T05:25:05.089 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:05.090 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":129,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:24:42.226355+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:24:39.221468+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"128","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2024-09-17T05:24:39.555911+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"129","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9464079250 msgr2=0x7f946407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9464079250 0x7f946407b710 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f94801518f0 tx=0x7f947c005f90 comp rx=0 tx=0).stop 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9480150fb0 msgr2=0x7f948014dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9480150fb0 0x7f948014dca0 secure :-1 s=READY pgs=1487 cs=0 l=1 rev1=1 crypto rx=0x7f94800cc770 tx=0x7f94780019b0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 shutdown_connections 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9480150fb0 0x7f948014dca0 unknown :-1 s=CLOSED pgs=1487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f94801f6840 0x7f9480150a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9464079250 0x7f946407b710 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 --2- 172.21.15.81:0/3715782531 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f946c004800 0x7f94801f2840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.090+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 >> 172.21.15.81:0/3715782531 conn(0x7f94800b1690 msgr2=0x7f94800b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.091+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 shutdown_connections 2024-09-17T05:25:05.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.091+0000 7f9487a5a640 1 -- 172.21.15.81:0/3715782531 wait complete. 2024-09-17T05:25:05.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:25:05.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.203+0000 7fea4e1da640 1 -- 172.21.15.81:0/647987092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea480cc490 msgr2=0x7fea4815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.203+0000 7fea4e1da640 1 --2- 172.21.15.81:0/647987092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea480cc490 0x7fea4815f750 secure :-1 s=READY pgs=1488 cs=0 l=1 rev1=1 crypto rx=0x7fea3c009900 tx=0x7fea3c02a560 comp rx=0 tx=0).stop 2024-09-17T05:25:05.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.204+0000 7fea4e1da640 1 -- 172.21.15.81:0/647987092 shutdown_connections 2024-09-17T05:25:05.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.204+0000 7fea4e1da640 1 --2- 172.21.15.81:0/647987092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea480cc900 0x7fea4815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.204+0000 7fea4e1da640 1 --2- 172.21.15.81:0/647987092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea480cc490 0x7fea4815f750 unknown :-1 s=CLOSED pgs=1488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.204+0000 7fea4e1da640 1 -- 172.21.15.81:0/647987092 >> 172.21.15.81:0/647987092 conn(0x7fea480b1690 msgr2=0x7fea480b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:05.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.204+0000 7fea4e1da640 1 -- 172.21.15.81:0/647987092 shutdown_connections 2024-09-17T05:25:05.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.204+0000 7fea4e1da640 1 -- 172.21.15.81:0/647987092 wait complete. 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.205+0000 7fea4e1da640 1 Processor -- start 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.205+0000 7fea4e1da640 1 -- start start 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea480cc490 0x7fea4813f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea480cc900 0x7fea48154c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea48159680 0x7fea48152d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fea480cec40 con 0x7fea48159680 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fea480ceac0 con 0x7fea480cc900 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fea480cedc0 con 0x7fea480cc490 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea48159680 0x7fea48152d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.210 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea48159680 0x7fea48152d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49068/0 (socket says 172.21.15.81:49068) 2024-09-17T05:25:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 -- 172.21.15.81:0/1301403974 learned_addr learned my addr 172.21.15.81:0/1301403974 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea46ffd640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea480cc900 0x7fea48154c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 -- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea480cc490 msgr2=0x7fea4813f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea477fe640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea480cc490 0x7fea4813f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea480cc490 0x7fea4813f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 -- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea480cc900 msgr2=0x7fea48154c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea480cc900 0x7fea48154c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 -- 172.21.15.81:0/1301403974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea48155630 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea47fff640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea48159680 0x7fea48152d60 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fea4000b970 tx=0x7fea4000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea2ffff640 1 -- 172.21.15.81:0/1301403974 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea40019070 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea2ffff640 1 -- 172.21.15.81:0/1301403974 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fea4000cc50 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea48155910 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea2ffff640 1 -- 172.21.15.81:0/1301403974 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea400146a0 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.206+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea48155ed0 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.207+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea480cf290 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.208+0000 7fea2ffff640 1 -- 172.21.15.81:0/1301403974 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fea4001c070 con 0x7fea48159680 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.208+0000 7fea2ffff640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fea34079250 0x7fea3407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.209+0000 7fea477fe640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fea34079250 0x7fea3407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.209+0000 7fea2ffff640 1 -- 172.21.15.81:0/1301403974 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(129..129 src has 1..129) ==== 5781+0+0 (secure 0 0 0) 0x7fea4009b600 con 0x7fea48159680 2024-09-17T05:25:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.209+0000 7fea477fe640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fea34079250 0x7fea3407b710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fea3800a730 tx=0x7fea38008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:05.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.213+0000 7fea2ffff640 1 -- 172.21.15.81:0/1301403974 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fea400631e0 con 0x7fea48159680 2024-09-17T05:25:05.428 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.428+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7fea4815b920 con 0x7fea48159680 2024-09-17T05:25:05.429 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:25:05.428+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:25:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.430+0000 7fea2ffff640 1 -- 172.21.15.81:0/1301403974 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v78) ==== 161+0+0 (secure 0 0 0) 0x7fea40062ae0 con 0x7fea48159680 2024-09-17T05:25:05.431 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:25:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fea34079250 msgr2=0x7fea3407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fea34079250 0x7fea3407b710 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fea3800a730 tx=0x7fea38008040 comp rx=0 tx=0).stop 2024-09-17T05:25:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea48159680 msgr2=0x7fea48152d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea48159680 0x7fea48152d60 secure :-1 s=READY pgs=1489 cs=0 l=1 rev1=1 crypto rx=0x7fea4000b970 tx=0x7fea4000be30 comp rx=0 tx=0).stop 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 shutdown_connections 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fea48159680 0x7fea48152d60 unknown :-1 s=CLOSED pgs=1489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fea34079250 0x7fea3407b710 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fea480cc900 0x7fea48154c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 --2- 172.21.15.81:0/1301403974 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fea480cc490 0x7fea4813f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 >> 172.21.15.81:0/1301403974 conn(0x7fea480b1690 msgr2=0x7fea4815b210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 shutdown_connections 2024-09-17T05:25:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.433+0000 7fea4e1da640 1 -- 172.21.15.81:0/1301403974 wait complete. 2024-09-17T05:25:05.436 INFO:tasks.ceph.mds.c.smithi081.stderr: -1610> 2024-09-17T05:24:44.233+0000 7f85ba524640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:25:05.446 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:25:05.461 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:25:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 -- 172.21.15.81:0/3213342106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04415b3d0 msgr2=0x7ff04415b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 --2- 172.21.15.81:0/3213342106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04415b3d0 0x7ff04415b840 secure :-1 s=READY pgs=1491 cs=0 l=1 rev1=1 crypto rx=0x7ff0440cf960 tx=0x7ff03c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:25:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 -- 172.21.15.81:0/3213342106 shutdown_connections 2024-09-17T05:25:05.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 --2- 172.21.15.81:0/3213342106 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff04415b3d0 0x7ff04415b840 unknown :-1 s=CLOSED pgs=1491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 --2- 172.21.15.81:0/3213342106 >> v2:172.21.15.160:3300/0 conn(0x7ff0440cc540 0x7ff0440cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 --2- 172.21.15.81:0/3213342106 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff044151e30 0x7ff04406fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 -- 172.21.15.81:0/3213342106 >> 172.21.15.81:0/3213342106 conn(0x7ff0440b1700 msgr2=0x7ff0440b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 -- 172.21.15.81:0/3213342106 shutdown_connections 2024-09-17T05:25:05.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.549+0000 7ff04be7f640 1 -- 172.21.15.81:0/3213342106 wait complete. 2024-09-17T05:25:05.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.550+0000 7ff04be7f640 1 Processor -- start 2024-09-17T05:25:05.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.550+0000 7ff04be7f640 1 -- start start 2024-09-17T05:25:05.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04be7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0440cc540 0x7ff044154730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04be7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff044151e30 0x7ff0440c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04be7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff04415b3d0 0x7ff0440c86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04be7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0440cafd0 con 0x7ff044151e30 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04be7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff0440cae50 con 0x7ff0440cc540 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04be7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff0440cb150 con 0x7ff04415b3d0 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff044151e30 0x7ff0440c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff044151e30 0x7ff0440c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49096/0 (socket says 172.21.15.81:49096) 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 -- 172.21.15.81:0/1751887041 learned_addr learned my addr 172.21.15.81:0/1751887041 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff049c1b640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0440cc540 0x7ff044154730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04a41c640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff04415b3d0 0x7ff0440c86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 -- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff04415b3d0 msgr2=0x7ff0440c86d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff04415b3d0 0x7ff0440c86d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 -- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0440cc540 msgr2=0x7ff044154730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0440cc540 0x7ff044154730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 -- 172.21.15.81:0/1751887041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0441f62c0 con 0x7ff044151e30 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.551+0000 7ff04941a640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff044151e30 0x7ff0440c8190 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d770 tx=0x7ff03400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.552+0000 7ff03a7fc640 1 -- 172.21.15.81:0/1751887041 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034017070 con 0x7ff044151e30 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.552+0000 7ff03a7fc640 1 -- 172.21.15.81:0/1751887041 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff034009d20 con 0x7ff044151e30 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.552+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0441f65a0 con 0x7ff044151e30 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.552+0000 7ff03a7fc640 1 -- 172.21.15.81:0/1751887041 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0340106c0 con 0x7ff044151e30 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.552+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0440c6c00 con 0x7ff044151e30 2024-09-17T05:25:05.555 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.552+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0440cb670 con 0x7ff044151e30 2024-09-17T05:25:05.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.553+0000 7ff03a7fc640 1 -- 172.21.15.81:0/1751887041 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7ff03401a070 con 0x7ff044151e30 2024-09-17T05:25:05.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.554+0000 7ff03a7fc640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079250 0x7ff02807b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:05.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.554+0000 7ff03a7fc640 1 -- 172.21.15.81:0/1751887041 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5867+0+0 (secure 0 0 0) 0x7ff03409bc20 con 0x7ff044151e30 2024-09-17T05:25:05.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.554+0000 7ff049c1b640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079250 0x7ff02807b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:05.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.554+0000 7ff049c1b640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079250 0x7ff02807b710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0440b1d70 tx=0x7ff04000b390 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:05.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.558+0000 7ff03a7fc640 1 -- 172.21.15.81:0/1751887041 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff034062f60 con 0x7ff044151e30 2024-09-17T05:25:05.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:05.773+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff0440c3440 con 0x7ff044151e30 2024-09-17T05:25:06.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.431+0000 7ff03a7fc640 1 -- 172.21.15.81:0/1751887041 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v79) ==== 104+0+0 (secure 0 0 0) 0x7ff034067990 con 0x7ff044151e30 2024-09-17T05:25:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079250 msgr2=0x7ff02807b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079250 0x7ff02807b710 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7ff0440b1d70 tx=0x7ff04000b390 comp rx=0 tx=0).stop 2024-09-17T05:25:06.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff044151e30 msgr2=0x7ff0440c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff044151e30 0x7ff0440c8190 secure :-1 s=READY pgs=1492 cs=0 l=1 rev1=1 crypto rx=0x7ff03400d770 tx=0x7ff03400dc30 comp rx=0 tx=0).stop 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 shutdown_connections 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff04415b3d0 0x7ff0440c86d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff044151e30 0x7ff0440c8190 unknown :-1 s=CLOSED pgs=1492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079250 0x7ff02807b710 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 --2- 172.21.15.81:0/1751887041 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0440cc540 0x7ff044154730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 >> 172.21.15.81:0/1751887041 conn(0x7ff0440b1700 msgr2=0x7ff0440b0c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 shutdown_connections 2024-09-17T05:25:06.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.435+0000 7ff04be7f640 1 -- 172.21.15.81:0/1751887041 wait complete. 2024-09-17T05:25:06.450 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:25:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 -- 172.21.15.81:0/3715724753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a0161300 msgr2=0x7f38a00d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 --2- 172.21.15.81:0/3715724753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a0161300 0x7f38a00d4940 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f3890005fd0 tx=0x7f389002a670 comp rx=0 tx=0).stop 2024-09-17T05:25:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 -- 172.21.15.81:0/3715724753 shutdown_connections 2024-09-17T05:25:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 --2- 172.21.15.81:0/3715724753 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a01616e0 0x7f38a00d1ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 --2- 172.21.15.81:0/3715724753 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a0161300 0x7f38a00d4940 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 -- 172.21.15.81:0/3715724753 >> 172.21.15.81:0/3715724753 conn(0x7f38a00d3e20 msgr2=0x7f38a00d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 -- 172.21.15.81:0/3715724753 shutdown_connections 2024-09-17T05:25:06.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.603+0000 7f38a5590640 1 -- 172.21.15.81:0/3715724753 wait complete. 2024-09-17T05:25:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.604+0000 7f38a5590640 1 Processor -- start 2024-09-17T05:25:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.604+0000 7f38a5590640 1 -- start start 2024-09-17T05:25:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a00d23e0 0x7f38a015b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0161300 0x7f38a00b8f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:06.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a01616e0 0x7f38a00b94d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d2c20 con 0x7f38a01616e0 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38a00d2aa0 con 0x7f38a0161300 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f38a00d0cc0 con 0x7f38a00d23e0 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a01616e0 0x7f38a00b94d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a01616e0 0x7f38a00b94d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49124/0 (socket says 172.21.15.81:49124) 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 -- 172.21.15.81:0/3436297565 learned_addr learned my addr 172.21.15.81:0/3436297565 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389effd640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a00d23e0 0x7f38a015b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f3897fff640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0161300 0x7f38a00b8f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 -- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a00d23e0 msgr2=0x7f38a015b2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a00d23e0 0x7f38a015b2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 -- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0161300 msgr2=0x7f38a00b8f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:06.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0161300 0x7f38a00b8f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 -- 172.21.15.81:0/3436297565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38a015f0e0 con 0x7f38a01616e0 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389effd640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a00d23e0 0x7f38a015b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f389f7fe640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a01616e0 0x7f38a00b94d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f389800c7a0 tx=0x7f389800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38977fe640 1 -- 172.21.15.81:0/3436297565 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3898003da0 con 0x7f38a01616e0 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38977fe640 1 -- 172.21.15.81:0/3436297565 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3898005070 con 0x7f38a01616e0 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38a01f4560 con 0x7f38a01616e0 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38977fe640 1 -- 172.21.15.81:0/3436297565 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38980054c0 con 0x7f38a01616e0 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.605+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38a015bba0 con 0x7f38a01616e0 2024-09-17T05:25:06.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.606+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38a00d11e0 con 0x7f38a01616e0 2024-09-17T05:25:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.607+0000 7f38977fe640 1 -- 172.21.15.81:0/3436297565 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f3898005660 con 0x7f38a01616e0 2024-09-17T05:25:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.607+0000 7f38977fe640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3880079250 0x7f388007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.607+0000 7f38977fe640 1 -- 172.21.15.81:0/3436297565 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(130..130 src has 1..130) ==== 5867+0+0 (secure 0 0 0) 0x7f389809b720 con 0x7f38a01616e0 2024-09-17T05:25:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.607+0000 7f389effd640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3880079250 0x7f388007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:06.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.608+0000 7f389effd640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3880079250 0x7f388007b710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3890033000 tx=0x7f3890004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:06.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.612+0000 7f38977fe640 1 -- 172.21.15.81:0/3436297565 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f38980632b0 con 0x7f38a01616e0 2024-09-17T05:25:06.792 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:06.791+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f38a00b8a70 con 0x7f38a01616e0 2024-09-17T05:25:07.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.725+0000 7f38977fe640 1 -- 172.21.15.81:0/3436297565 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v131) ==== 181+0+0 (secure 0 0 0) 0x7f3898062bb0 con 0x7f38a01616e0 2024-09-17T05:25:07.726 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.728+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3880079250 msgr2=0x7f388007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.728+0000 7f38a5590640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3880079250 0x7f388007b710 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3890033000 tx=0x7f3890004730 comp rx=0 tx=0).stop 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a01616e0 msgr2=0x7f38a00b94d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a01616e0 0x7f38a00b94d0 secure :-1 s=READY pgs=1495 cs=0 l=1 rev1=1 crypto rx=0x7f389800c7a0 tx=0x7f389800cc60 comp rx=0 tx=0).stop 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 shutdown_connections 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38a01616e0 0x7f38a00b94d0 unknown :-1 s=CLOSED pgs=1495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3880079250 0x7f388007b710 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f38a0161300 0x7f38a00b8f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 --2- 172.21.15.81:0/3436297565 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38a00d23e0 0x7f38a015b2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 >> 172.21.15.81:0/3436297565 conn(0x7f38a00d3e20 msgr2=0x7f38a00d4200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 shutdown_connections 2024-09-17T05:25:07.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.729+0000 7f38a5590640 1 -- 172.21.15.81:0/3436297565 wait complete. 2024-09-17T05:25:07.744 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:25:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 -- 172.21.15.81:0/592861191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 msgr2=0x7f9ea815b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 --2- 172.21.15.81:0/592861191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815b970 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f9e98005fd0 tx=0x7f9e9802a530 comp rx=0 tx=0).stop 2024-09-17T05:25:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 -- 172.21.15.81:0/592861191 shutdown_connections 2024-09-17T05:25:07.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 --2- 172.21.15.81:0/592861191 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ea806e940 0x7f9ea806fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 --2- 172.21.15.81:0/592861191 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815b970 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 -- 172.21.15.81:0/592861191 >> 172.21.15.81:0/592861191 conn(0x7f9ea80b1620 msgr2=0x7f9ea80b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:07.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 -- 172.21.15.81:0/592861191 shutdown_connections 2024-09-17T05:25:07.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.854+0000 7f9eae36b640 1 -- 172.21.15.81:0/592861191 wait complete. 2024-09-17T05:25:07.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.855+0000 7f9eae36b640 1 Processor -- start 2024-09-17T05:25:07.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.855+0000 7f9eae36b640 1 -- start start 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eae36b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ea806e940 0x7f9ea8147bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eae36b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ea80703c0 0x7f9ea815c980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eae36b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eae36b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8158790 con 0x7f9ea80aee40 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eae36b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9ea8158610 con 0x7f9ea80703c0 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eae36b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9ea8158910 con 0x7f9ea806e940 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49134/0 (socket says 172.21.15.81:49134) 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 -- 172.21.15.81:0/1160572167 learned_addr learned my addr 172.21.15.81:0/1160572167 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9ea7fff640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ea806e940 0x7f9ea8147bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:07.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 -- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ea806e940 msgr2=0x7f9ea8147bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ea806e940 0x7f9ea8147bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 -- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ea80703c0 msgr2=0x7f9ea815c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9ea77fe640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ea80703c0 0x7f9ea815c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ea80703c0 0x7f9ea815c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 -- 172.21.15.81:0/1160572167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9ea81f6fa0 con 0x7f9ea80aee40 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9ea77fe640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ea80703c0 0x7f9ea815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.856+0000 7f9eac908640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815d5f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c780 tx=0x7f9ea000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.857+0000 7f9ea4ff9640 1 -- 172.21.15.81:0/1160572167 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0017070 con 0x7f9ea80aee40 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.857+0000 7f9ea4ff9640 1 -- 172.21.15.81:0/1160572167 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9ea0005070 con 0x7f9ea80aee40 2024-09-17T05:25:07.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.857+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9ea81f6480 con 0x7f9ea80aee40 2024-09-17T05:25:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.857+0000 7f9ea4ff9640 1 -- 172.21.15.81:0/1160572167 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ea0005500 con 0x7f9ea80aee40 2024-09-17T05:25:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.857+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9ea81f6cc0 con 0x7f9ea80aee40 2024-09-17T05:25:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.858+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9ea806fe80 con 0x7f9ea80aee40 2024-09-17T05:25:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.858+0000 7f9ea4ff9640 1 -- 172.21.15.81:0/1160572167 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f9ea001a070 con 0x7f9ea80aee40 2024-09-17T05:25:07.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.859+0000 7f9ea4ff9640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9e94079250 0x7f9e9407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.859+0000 7f9ea4ff9640 1 -- 172.21.15.81:0/1160572167 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(131..131 src has 1..131) ==== 5429+0+0 (secure 0 0 0) 0x7f9ea009b070 con 0x7f9ea80aee40 2024-09-17T05:25:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.859+0000 7f9ea7fff640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9e94079250 0x7f9e9407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:07.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.859+0000 7f9ea7fff640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9e94079250 0x7f9e9407b710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e98033000 tx=0x7f9e98004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:07.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:07.863+0000 7f9ea4ff9640 1 -- 172.21.15.81:0/1160572167 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9ea81f6480 con 0x7f9ea80aee40 2024-09-17T05:25:08.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.037+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9ea80cf7a0 con 0x7f9ea80aee40 2024-09-17T05:25:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.732+0000 7f9ea4ff9640 1 -- 172.21.15.81:0/1160572167 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v132) ==== 169+0+0 (secure 0 0 0) 0x7f9ea0062b20 con 0x7f9ea80aee40 2024-09-17T05:25:08.733 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:25:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9e94079250 msgr2=0x7f9e9407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:08.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9e94079250 0x7f9e9407b710 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f9e98033000 tx=0x7f9e98004730 comp rx=0 tx=0).stop 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 msgr2=0x7f9ea815d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815d5f0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f9ea000c780 tx=0x7f9ea000cc40 comp rx=0 tx=0).stop 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 shutdown_connections 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9ea80aee40 0x7f9ea815d5f0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9e94079250 0x7f9e9407b710 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9ea80703c0 0x7f9ea815c980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 --2- 172.21.15.81:0/1160572167 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9ea806e940 0x7f9ea8147bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 >> 172.21.15.81:0/1160572167 conn(0x7f9ea80b1620 msgr2=0x7f9ea8157430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 shutdown_connections 2024-09-17T05:25:08.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.735+0000 7f9eae36b640 1 -- 172.21.15.81:0/1160572167 wait complete. 2024-09-17T05:25:08.755 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:25:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.859+0000 7fe056a47640 1 -- 172.21.15.81:0/2981482151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 msgr2=0x7fe038003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.859+0000 7fe056a47640 1 --2- 172.21.15.81:0/2981482151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe038003e70 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fe040001690 tx=0x7fe038005830 comp rx=0 tx=0).stop 2024-09-17T05:25:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.859+0000 7fe056a47640 1 -- 172.21.15.81:0/2981482151 shutdown_connections 2024-09-17T05:25:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.859+0000 7fe056a47640 1 --2- 172.21.15.81:0/2981482151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe038003e70 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.859+0000 7fe056a47640 1 -- 172.21.15.81:0/2981482151 >> 172.21.15.81:0/2981482151 conn(0x7fe0500b1690 msgr2=0x7fe0500b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.860+0000 7fe056a47640 1 -- 172.21.15.81:0/2981482151 shutdown_connections 2024-09-17T05:25:08.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.860+0000 7fe056a47640 1 -- 172.21.15.81:0/2981482151 wait complete. 2024-09-17T05:25:08.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.861+0000 7fe056a47640 1 Processor -- start 2024-09-17T05:25:08.862 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.861+0000 7fe056a47640 1 -- start start 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe050147a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe050147fb0 0x7fe0500b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0500b0cc0 0x7fe0500ae650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe05015d3f0 con 0x7fe038003a50 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe05015d270 con 0x7fe050147fb0 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe05015d570 con 0x7fe0500b0cc0 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe050147a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe050147a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49142/0 (socket says 172.21.15.81:49142) 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 -- 172.21.15.81:0/28856098 learned_addr learned my addr 172.21.15.81:0/28856098 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:08.864 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe054fe4640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0500b0cc0 0x7fe0500ae650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04f7fe640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe050147fb0 0x7fe0500b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 -- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0500b0cc0 msgr2=0x7fe0500ae650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0500b0cc0 0x7fe0500ae650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 -- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe050147fb0 msgr2=0x7fe0500b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe050147fb0 0x7fe0500b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 -- 172.21.15.81:0/28856098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0500af260 con 0x7fe038003a50 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe054fe4640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0500b0cc0 0x7fe0500ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04ffff640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe050147a70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe0400017b0 tx=0x7fe0400063a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04cff9640 1 -- 172.21.15.81:0/28856098 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe040042070 con 0x7fe038003a50 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04cff9640 1 -- 172.21.15.81:0/28856098 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe040039070 con 0x7fe038003a50 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0501484c0 con 0x7fe038003a50 2024-09-17T05:25:08.865 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe04cff9640 1 -- 172.21.15.81:0/28856098 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe040003d70 con 0x7fe038003a50 2024-09-17T05:25:08.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.862+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe050155a30 con 0x7fe038003a50 2024-09-17T05:25:08.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.863+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe0500b10d0 con 0x7fe038003a50 2024-09-17T05:25:08.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.864+0000 7fe04cff9640 1 -- 172.21.15.81:0/28856098 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fe04003b070 con 0x7fe038003a50 2024-09-17T05:25:08.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.864+0000 7fe04cff9640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe03c079250 0x7fe03c07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:08.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.864+0000 7fe04f7fe640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe03c079250 0x7fe03c07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:08.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.864+0000 7fe04cff9640 1 -- 172.21.15.81:0/28856098 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7fe0400baca0 con 0x7fe038003a50 2024-09-17T05:25:08.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.865+0000 7fe04f7fe640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe03c079250 0x7fe03c07b710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe0440058c0 tx=0x7fe044005850 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:08.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:08.869+0000 7fe04cff9640 1 -- 172.21.15.81:0/28856098 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe0500b10d0 con 0x7fe038003a50 2024-09-17T05:25:09.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.044+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7fe05015b320 con 0x7fe038003a50 2024-09-17T05:25:09.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.047+0000 7fe04cff9640 1 -- 172.21.15.81:0/28856098 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v43) ==== 71+0+0 (secure 0 0 0) 0x7fe040082900 con 0x7fe038003a50 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe03c079250 msgr2=0x7fe03c07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe03c079250 0x7fe03c07b710 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fe0440058c0 tx=0x7fe044005850 comp rx=0 tx=0).stop 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 msgr2=0x7fe050147a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe050147a70 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fe0400017b0 tx=0x7fe0400063a0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 shutdown_connections 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe0500b0cc0 0x7fe0500ae650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe03c079250 0x7fe03c07b710 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe050147fb0 0x7fe0500b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 --2- 172.21.15.81:0/28856098 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe038003a50 0x7fe050147a70 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.049+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 >> 172.21.15.81:0/28856098 conn(0x7fe0500b1690 msgr2=0x7fe05015db00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:09.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.050+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 shutdown_connections 2024-09-17T05:25:09.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.050+0000 7fe056a47640 1 -- 172.21.15.81:0/28856098 wait complete. 2024-09-17T05:25:09.062 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol' 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 -- 172.21.15.81:0/2095982986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0015aa70 msgr2=0x7f3b000b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 --2- 172.21.15.81:0/2095982986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0015aa70 0x7f3b000b4690 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7f3af0005fd0 tx=0x7f3af002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 -- 172.21.15.81:0/2095982986 shutdown_connections 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 --2- 172.21.15.81:0/2095982986 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b00070690 0x7f3b000739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 --2- 172.21.15.81:0/2095982986 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b0015aa70 0x7f3b000b4690 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 -- 172.21.15.81:0/2095982986 >> 172.21.15.81:0/2095982986 conn(0x7f3b000b1690 msgr2=0x7f3b000b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 -- 172.21.15.81:0/2095982986 shutdown_connections 2024-09-17T05:25:09.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.162+0000 7f3b07324640 1 -- 172.21.15.81:0/2095982986 wait complete. 2024-09-17T05:25:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.163+0000 7f3b07324640 1 Processor -- start 2024-09-17T05:25:09.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.163+0000 7f3b07324640 1 -- start start 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b07324640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b00070690 0x7f3b001540a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b07324640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000735a0 0x7f3b00151f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b07324640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0015aa70 0x7f3b0006ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b07324640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b000cd270 con 0x7f3b000735a0 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b07324640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3b000cd0f0 con 0x7f3b0015aa70 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b07324640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3b000cd3f0 con 0x7f3b00070690 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000735a0 0x7f3b00151f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000735a0 0x7f3b00151f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49154/0 (socket says 172.21.15.81:49154) 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 -- 172.21.15.81:0/2544815055 learned_addr learned my addr 172.21.15.81:0/2544815055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b058c1640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0015aa70 0x7f3b0006ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b050c0640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b00070690 0x7f3b001540a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 -- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b00070690 msgr2=0x7f3b001540a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b00070690 0x7f3b001540a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 -- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0015aa70 msgr2=0x7f3b0006ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0015aa70 0x7f3b0006ee70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 -- 172.21.15.81:0/2544815055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b00152770 con 0x7f3b000735a0 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b058c1640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0015aa70 0x7f3b0006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b050c0640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b00070690 0x7f3b001540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b048bf640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000735a0 0x7f3b00151f40 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3af400c500 tx=0x7f3af400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3afdffb640 1 -- 172.21.15.81:0/2544815055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af40052d0 con 0x7f3b000735a0 2024-09-17T05:25:09.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3afdffb640 1 -- 172.21.15.81:0/2544815055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3af4005470 con 0x7f3b000735a0 2024-09-17T05:25:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b001f8010 con 0x7f3b000735a0 2024-09-17T05:25:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.164+0000 7f3afdffb640 1 -- 172.21.15.81:0/2544815055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af4012870 con 0x7f3b000735a0 2024-09-17T05:25:09.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.165+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b001f85d0 con 0x7f3b000735a0 2024-09-17T05:25:09.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.166+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b001524e0 con 0x7f3b000735a0 2024-09-17T05:25:09.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.166+0000 7f3afdffb640 1 -- 172.21.15.81:0/2544815055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f3af4012a10 con 0x7f3b000735a0 2024-09-17T05:25:09.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.166+0000 7f3afdffb640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aec079250 0x7f3aec07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.167+0000 7f3b050c0640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aec079250 0x7f3aec07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.167+0000 7f3afdffb640 1 -- 172.21.15.81:0/2544815055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7f3af409b1a0 con 0x7f3b000735a0 2024-09-17T05:25:09.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.167+0000 7f3b050c0640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aec079250 0x7f3aec07b710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3af0033000 tx=0x7f3af0004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:09.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.171+0000 7f3afdffb640 1 -- 172.21.15.81:0/2544815055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3af4062f90 con 0x7f3b000735a0 2024-09-17T05:25:09.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.413+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]} v 0) -- 0x7f3b000ce0d0 con 0x7f3b000735a0 2024-09-17T05:25:09.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.734+0000 7f3afdffb640 1 -- 172.21.15.81:0/2544815055 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_ops_on_nonexistent_vol"]}]=0 v354) ==== 151+0+0 (secure 0 0 0) 0x7f3af4062890 con 0x7f3b000735a0 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aec079250 msgr2=0x7f3aec07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aec079250 0x7f3aec07b710 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f3af0033000 tx=0x7f3af0004730 comp rx=0 tx=0).stop 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000735a0 msgr2=0x7f3b00151f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000735a0 0x7f3b00151f40 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7f3af400c500 tx=0x7f3af400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 shutdown_connections 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3aec079250 0x7f3aec07b710 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0015aa70 0x7f3b0006ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b000735a0 0x7f3b00151f40 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 --2- 172.21.15.81:0/2544815055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b00070690 0x7f3b001540a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 >> 172.21.15.81:0/2544815055 conn(0x7f3b000b1690 msgr2=0x7f3b0015da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 shutdown_connections 2024-09-17T05:25:09.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.737+0000 7f3b07324640 1 -- 172.21.15.81:0/2544815055 wait complete. 2024-09-17T05:25:09.748 INFO:tasks.cephfs_test_runner:test_subvolume_ops_on_nonexistent_vol (tasks.cephfs.test_volumes.TestMisc) ... ok 2024-09-17T05:25:09.748 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- rather than going through a full upgrade cycle, 2024-09-17T05:25:09.748 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_legacy_to_v1 (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:25:09.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 -- 172.21.15.81:0/2431473275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898815df90 msgr2=0x7f89880cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 --2- 172.21.15.81:0/2431473275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898815df90 0x7f89880cf9b0 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7f89880d1c90 tx=0x7f898002aa30 comp rx=0 tx=0).stop 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 -- 172.21.15.81:0/2431473275 shutdown_connections 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 --2- 172.21.15.81:0/2431473275 >> v2:172.21.15.160:3300/0 conn(0x7f89880d49c0 0x7f89880d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 --2- 172.21.15.81:0/2431473275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f898815df90 0x7f89880cf9b0 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 -- 172.21.15.81:0/2431473275 >> 172.21.15.81:0/2431473275 conn(0x7f89880d3ea0 msgr2=0x7f89880d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 -- 172.21.15.81:0/2431473275 shutdown_connections 2024-09-17T05:25:09.850 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.849+0000 7f898f09b640 1 -- 172.21.15.81:0/2431473275 wait complete. 2024-09-17T05:25:09.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.851+0000 7f898f09b640 1 Processor -- start 2024-09-17T05:25:09.851 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.851+0000 7f898f09b640 1 -- start start 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.851+0000 7f898f09b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89880d49c0 0x7f898815ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.851+0000 7f898f09b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898815df90 0x7f89880cd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.851+0000 7f898f09b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988162480 0x7f89880cdee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.851+0000 7f898f09b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89880d0f00 con 0x7f8988162480 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.851+0000 7f898f09b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f89880d0d80 con 0x7f89880d49c0 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898f09b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f89880b3f10 con 0x7f898815df90 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988162480 0x7f89880cdee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.853 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988162480 0x7f89880cdee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49166/0 (socket says 172.21.15.81:49166) 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 -- 172.21.15.81:0/210822050 learned_addr learned my addr 172.21.15.81:0/210822050 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f8987fff640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898815df90 0x7f89880cd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898ce37640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89880d49c0 0x7f898815ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 -- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898815df90 msgr2=0x7f89880cd9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898815df90 0x7f89880cd9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 -- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89880d49c0 msgr2=0x7f898815ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89880d49c0 0x7f898815ff30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 -- 172.21.15.81:0/210822050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89881f48c0 con 0x7f8988162480 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898d638640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988162480 0x7f89880cdee0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f897000b410 tx=0x7f897000b810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f89857fa640 1 -- 172.21.15.81:0/210822050 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970015030 con 0x7f8988162480 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f89857fa640 1 -- 172.21.15.81:0/210822050 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8970004020 con 0x7f8988162480 2024-09-17T05:25:09.854 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89881f4ba0 con 0x7f8988162480 2024-09-17T05:25:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f89857fa640 1 -- 172.21.15.81:0/210822050 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8970004470 con 0x7f8988162480 2024-09-17T05:25:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.852+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89881f5160 con 0x7f8988162480 2024-09-17T05:25:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.853+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89880b55b0 con 0x7f8988162480 2024-09-17T05:25:09.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.854+0000 7f89857fa640 1 -- 172.21.15.81:0/210822050 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f8970018070 con 0x7f8988162480 2024-09-17T05:25:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.855+0000 7f89857fa640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8968079250 0x7f896807b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.855+0000 7f898ce37640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8968079250 0x7f896807b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.855+0000 7f89857fa640 1 -- 172.21.15.81:0/210822050 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7f897009b080 con 0x7f8988162480 2024-09-17T05:25:09.856 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.855+0000 7f898ce37640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8968079250 0x7f896807b710 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8980035000 tx=0x7f898003a040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:09.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:09.859+0000 7f89857fa640 1 -- 172.21.15.81:0/210822050 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8970062d60 con 0x7f8988162480 2024-09-17T05:25:10.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.036+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f898808d590 con 0x7f8988162480 2024-09-17T05:25:10.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.037+0000 7f89857fa640 1 -- 172.21.15.81:0/210822050 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v132) ==== 74+0+13154 (secure 0 0 0) 0x7f8970062660 con 0x7f8988162480 2024-09-17T05:25:10.037 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:10.037 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":132,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:08.726286+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":127,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/1714561444":"2024-09-18T05:25:05.429522+0000","172.21.15.81:6833/1714561444":"2024-09-18T05:25:05.429522+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8968079250 msgr2=0x7f896807b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8968079250 0x7f896807b710 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8980035000 tx=0x7f898003a040 comp rx=0 tx=0).stop 2024-09-17T05:25:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988162480 msgr2=0x7f89880cdee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988162480 0x7f89880cdee0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7f897000b410 tx=0x7f897000b810 comp rx=0 tx=0).stop 2024-09-17T05:25:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 shutdown_connections 2024-09-17T05:25:10.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8988162480 0x7f89880cdee0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f898815df90 0x7f89880cd9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8968079250 0x7f896807b710 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 --2- 172.21.15.81:0/210822050 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89880d49c0 0x7f898815ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 >> 172.21.15.81:0/210822050 conn(0x7f89880d3ea0 msgr2=0x7f89880b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 shutdown_connections 2024-09-17T05:25:10.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.039+0000 7f898f09b640 1 -- 172.21.15.81:0/210822050 wait complete. 2024-09-17T05:25:10.050 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:25:10.050 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:25:10.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.154+0000 7f442fbc2640 1 -- 172.21.15.81:0/3709656338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4414003a00 msgr2=0x7f4414003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.154+0000 7f442fbc2640 1 --2- 172.21.15.81:0/3709656338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4414003a00 0x7f4414003e20 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f4424009b80 tx=0x7f4414005830 comp rx=0 tx=0).stop 2024-09-17T05:25:10.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.154+0000 7f442e15f640 1 -- 172.21.15.81:0/3709656338 reap_dead start 2024-09-17T05:25:10.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.154+0000 7f442fbc2640 1 -- 172.21.15.81:0/3709656338 shutdown_connections 2024-09-17T05:25:10.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.154+0000 7f442fbc2640 1 -- 172.21.15.81:0/3709656338 >> 172.21.15.81:0/3709656338 conn(0x7f44280cfdc0 msgr2=0x7f44280d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:10.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.154+0000 7f442fbc2640 1 -- 172.21.15.81:0/3709656338 shutdown_connections 2024-09-17T05:25:10.155 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.154+0000 7f442fbc2640 1 -- 172.21.15.81:0/3709656338 wait complete. 2024-09-17T05:25:10.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 Processor -- start 2024-09-17T05:25:10.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 -- start start 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4414003a00 0x7f44280c55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442815b1d0 0x7f44281f8570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44281528e0 0x7f4428160210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f44281619c0 con 0x7f442815b1d0 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4428161840 con 0x7f4414003a00 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.156+0000 7f442fbc2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4428161b40 con 0x7f44281528e0 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442815b1d0 0x7f44281f8570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442815b1d0 0x7f44281f8570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49174/0 (socket says 172.21.15.81:49174) 2024-09-17T05:25:10.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 -- 172.21.15.81:0/3332030086 learned_addr learned my addr 172.21.15.81:0/3332030086 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d95e640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4414003a00 0x7f44280c55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442e15f640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44281528e0 0x7f4428160210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 -- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44281528e0 msgr2=0x7f4428160210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44281528e0 0x7f4428160210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 -- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4414003a00 msgr2=0x7f44280c55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4414003a00 0x7f44280c55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 -- 172.21.15.81:0/3332030086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f44281f8ab0 con 0x7f442815b1d0 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442e15f640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44281528e0 0x7f4428160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442d15d640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442815b1d0 0x7f44281f8570 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f44180109a0 tx=0x7f4418010e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f441e7fc640 1 -- 172.21.15.81:0/3332030086 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f441800eda0 con 0x7f442815b1d0 2024-09-17T05:25:10.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f441e7fc640 1 -- 172.21.15.81:0/3332030086 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4418005020 con 0x7f442815b1d0 2024-09-17T05:25:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f442815b6d0 con 0x7f442815b1d0 2024-09-17T05:25:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f441e7fc640 1 -- 172.21.15.81:0/3332030086 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4418005470 con 0x7f442815b1d0 2024-09-17T05:25:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.157+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f44280c4de0 con 0x7f442815b1d0 2024-09-17T05:25:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.158+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f44281620a0 con 0x7f442815b1d0 2024-09-17T05:25:10.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.159+0000 7f441e7fc640 1 -- 172.21.15.81:0/3332030086 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f44180047a0 con 0x7f442815b1d0 2024-09-17T05:25:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.159+0000 7f441e7fc640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f440c079250 0x7f440c07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.160+0000 7f441e7fc640 1 -- 172.21.15.81:0/3332030086 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7f441809c290 con 0x7f442815b1d0 2024-09-17T05:25:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.160+0000 7f442d95e640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f440c079250 0x7f440c07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.160+0000 7f442d95e640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f440c079250 0x7f440c07b710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4424035000 tx=0x7f442402d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:10.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.164+0000 7f441e7fc640 1 -- 172.21.15.81:0/3332030086 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f44281f8ab0 con 0x7f442815b1d0 2024-09-17T05:25:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.339+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f442806fb60 con 0x7f442815b1d0 2024-09-17T05:25:10.339 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.339+0000 7f441e7fc640 1 -- 172.21.15.81:0/3332030086 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v132) ==== 93+0+10 (secure 0 0 0) 0x7f4418064100 con 0x7f442815b1d0 2024-09-17T05:25:10.339 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:25:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f440c079250 msgr2=0x7f440c07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f440c079250 0x7f440c07b710 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f4424035000 tx=0x7f442402d040 comp rx=0 tx=0).stop 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442815b1d0 msgr2=0x7f44281f8570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442815b1d0 0x7f44281f8570 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f44180109a0 tx=0x7f4418010e60 comp rx=0 tx=0).stop 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 shutdown_connections 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f44281528e0 0x7f4428160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f442815b1d0 0x7f44281f8570 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f440c079250 0x7f440c07b710 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 --2- 172.21.15.81:0/3332030086 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4414003a00 0x7f44280c55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 >> 172.21.15.81:0/3332030086 conn(0x7f44280cfdc0 msgr2=0x7f4428153f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 shutdown_connections 2024-09-17T05:25:10.342 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.341+0000 7f442fbc2640 1 -- 172.21.15.81:0/3332030086 wait complete. 2024-09-17T05:25:10.352 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-17T05:25:10.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 -- 172.21.15.81:0/2675232148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18015aa70 msgr2=0x7fb1800b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 --2- 172.21.15.81:0/2675232148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18015aa70 0x7fb1800b4690 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fb174009830 tx=0x7fb17402a510 comp rx=0 tx=0).stop 2024-09-17T05:25:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 -- 172.21.15.81:0/2675232148 shutdown_connections 2024-09-17T05:25:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 --2- 172.21.15.81:0/2675232148 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1800735a0 0x7fb1800739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 --2- 172.21.15.81:0/2675232148 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18015aa70 0x7fb1800b4690 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 -- 172.21.15.81:0/2675232148 >> 172.21.15.81:0/2675232148 conn(0x7fb1800b1690 msgr2=0x7fb1800b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 -- 172.21.15.81:0/2675232148 shutdown_connections 2024-09-17T05:25:10.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.454+0000 7fb186c08640 1 -- 172.21.15.81:0/2675232148 wait complete. 2024-09-17T05:25:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.455+0000 7fb186c08640 1 Processor -- start 2024-09-17T05:25:10.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.455+0000 7fb186c08640 1 -- start start 2024-09-17T05:25:10.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb186c08640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18006ff80 0x7fb1800c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb186c08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1800735a0 0x7fb1801477f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb186c08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb18015aa70 0x7fb1801470d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb186c08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb1800707a0 con 0x7fb18015aa70 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb186c08640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb180070620 con 0x7fb18006ff80 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb186c08640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb1800c9750 con 0x7fb1800735a0 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb1851a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb18015aa70 0x7fb1801470d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb1849a4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18006ff80 0x7fb1800c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb1851a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb18015aa70 0x7fb1801470d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49180/0 (socket says 172.21.15.81:49180) 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb17ffff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1800735a0 0x7fb1801477f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.456+0000 7fb1851a5640 1 -- 172.21.15.81:0/1341834056 learned_addr learned my addr 172.21.15.81:0/1341834056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:10.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb1851a5640 1 -- 172.21.15.81:0/1341834056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1800735a0 msgr2=0x7fb1801477f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb1851a5640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1800735a0 0x7fb1801477f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb1851a5640 1 -- 172.21.15.81:0/1341834056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18006ff80 msgr2=0x7fb1800c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb1851a5640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18006ff80 0x7fb1800c9100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb1851a5640 1 -- 172.21.15.81:0/1341834056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1800cbbc0 con 0x7fb18015aa70 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb1851a5640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb18015aa70 0x7fb1801470d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fb17800cbc0 tx=0x7fb17800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb17d7fa640 1 -- 172.21.15.81:0/1341834056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178016020 con 0x7fb18015aa70 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb17d7fa640 1 -- 172.21.15.81:0/1341834056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb17800ae30 con 0x7fb18015aa70 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1800cbea0 con 0x7fb18015aa70 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb17d7fa640 1 -- 172.21.15.81:0/1341834056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb178012660 con 0x7fb18015aa70 2024-09-17T05:25:10.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.457+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb18015bc10 con 0x7fb18015aa70 2024-09-17T05:25:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.458+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb18015e3e0 con 0x7fb18015aa70 2024-09-17T05:25:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.459+0000 7fb17d7fa640 1 -- 172.21.15.81:0/1341834056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fb178019020 con 0x7fb18015aa70 2024-09-17T05:25:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.459+0000 7fb17d7fa640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb164079250 0x7fb16407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.459+0000 7fb1849a4640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb164079250 0x7fb16407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.459+0000 7fb17d7fa640 1 -- 172.21.15.81:0/1341834056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7fb17809ba60 con 0x7fb18015aa70 2024-09-17T05:25:10.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.460+0000 7fb1849a4640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb164079250 0x7fb16407b710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb174034000 tx=0x7fb174004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:10.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.463+0000 7fb17d7fa640 1 -- 172.21.15.81:0/1341834056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb18015e3e0 con 0x7fb18015aa70 2024-09-17T05:25:10.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.706+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7fb1800cd8a0 con 0x7fb18015aa70 2024-09-17T05:25:10.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.739+0000 7fb17d7fa640 1 -- 172.21.15.81:0/1341834056 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v355) ==== 152+0+0 (secure 0 0 0) 0x7fb178020030 con 0x7fb18015aa70 2024-09-17T05:25:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb164079250 msgr2=0x7fb16407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb164079250 0x7fb16407b710 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fb174034000 tx=0x7fb174004730 comp rx=0 tx=0).stop 2024-09-17T05:25:10.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb18015aa70 msgr2=0x7fb1801470d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb18015aa70 0x7fb1801470d0 secure :-1 s=READY pgs=1509 cs=0 l=1 rev1=1 crypto rx=0x7fb17800cbc0 tx=0x7fb17800a430 comp rx=0 tx=0).stop 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 shutdown_connections 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb18015aa70 0x7fb1801470d0 unknown :-1 s=CLOSED pgs=1509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb1800735a0 0x7fb1801477f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb164079250 0x7fb16407b710 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 --2- 172.21.15.81:0/1341834056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb18006ff80 0x7fb1800c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 >> 172.21.15.81:0/1341834056 conn(0x7fb1800b1690 msgr2=0x7fb1800cdab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 shutdown_connections 2024-09-17T05:25:10.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.742+0000 7fb186c08640 1 -- 172.21.15.81:0/1341834056 wait complete. 2024-09-17T05:25:10.753 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:25:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.854+0000 7f8a6367f640 1 -- 172.21.15.81:0/1503538711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 msgr2=0x7f8a44004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.854+0000 7f8a6367f640 1 --2- 172.21.15.81:0/1503538711 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 0x7f8a44004c80 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f8a500016c0 tx=0x7f8a44005830 comp rx=0 tx=0).stop 2024-09-17T05:25:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.854+0000 7f8a61c1c640 1 -- 172.21.15.81:0/1503538711 reap_dead start 2024-09-17T05:25:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.855+0000 7f8a6367f640 1 -- 172.21.15.81:0/1503538711 shutdown_connections 2024-09-17T05:25:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.855+0000 7f8a6367f640 1 -- 172.21.15.81:0/1503538711 >> 172.21.15.81:0/1503538711 conn(0x7f8a5c0741f0 msgr2=0x7f8a5c074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.855+0000 7f8a6367f640 1 -- 172.21.15.81:0/1503538711 shutdown_connections 2024-09-17T05:25:10.855 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.855+0000 7f8a6367f640 1 -- 172.21.15.81:0/1503538711 wait complete. 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.856+0000 7f8a6367f640 1 Processor -- start 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.856+0000 7f8a6367f640 1 -- start start 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6367f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 0x7f8a5c0c5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6367f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a5c15a410 0x7f8a5c1f44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6367f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a5c0c6940 0x7f8a5c0b14a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6367f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0cbd00 con 0x7f8a44004800 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6367f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8a5c0cbb80 con 0x7f8a5c15a410 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6367f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8a5c0cbe80 con 0x7f8a5c0c6940 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 0x7f8a5c0c5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 0x7f8a5c0c5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49194/0 (socket says 172.21.15.81:49194) 2024-09-17T05:25:10.858 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 -- 172.21.15.81:0/440492850 learned_addr learned my addr 172.21.15.81:0/440492850 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a60c1a640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a5c15a410 0x7f8a5c1f44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a61c1c640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a5c0c6940 0x7f8a5c0b14a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 -- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a5c0c6940 msgr2=0x7f8a5c0b14a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a5c0c6940 0x7f8a5c0b14a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 -- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a5c15a410 msgr2=0x7f8a5c1f44c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a5c15a410 0x7f8a5c1f44c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 -- 172.21.15.81:0/440492850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a5c0c4e00 con 0x7f8a44004800 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a61c1c640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a5c0c6940 0x7f8a5c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a60c1a640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a5c15a410 0x7f8a5c1f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6141b640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 0x7f8a5c0c5bc0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006290 tx=0x7f8a4c006750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a59ffb640 1 -- 172.21.15.81:0/440492850 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c015070 con 0x7f8a44004800 2024-09-17T05:25:10.859 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a59ffb640 1 -- 172.21.15.81:0/440492850 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8a4c00fd40 con 0x7f8a44004800 2024-09-17T05:25:10.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a59ffb640 1 -- 172.21.15.81:0/440492850 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a4c011690 con 0x7f8a44004800 2024-09-17T05:25:10.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.857+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a5c0c50e0 con 0x7f8a44004800 2024-09-17T05:25:10.860 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.858+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a5c0c56a0 con 0x7f8a44004800 2024-09-17T05:25:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.858+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a5c0c7240 con 0x7f8a44004800 2024-09-17T05:25:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.859+0000 7f8a59ffb640 1 -- 172.21.15.81:0/440492850 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f8a4c011830 con 0x7f8a44004800 2024-09-17T05:25:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.859+0000 7f8a59ffb640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a48079280 0x7f8a4807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.859+0000 7f8a59ffb640 1 -- 172.21.15.81:0/440492850 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7f8a4c09c700 con 0x7f8a44004800 2024-09-17T05:25:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.859+0000 7f8a60c1a640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a48079280 0x7f8a4807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:10.861 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.860+0000 7f8a60c1a640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a48079280 0x7f8a4807b740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8a50032000 tx=0x7f8a50001190 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:10.863 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:10.864+0000 7f8a59ffb640 1 -- 172.21.15.81:0/440492850 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8a4c0643e0 con 0x7f8a44004800 2024-09-17T05:25:11.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.040+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7f8a5c075070 con 0x7f8a44004800 2024-09-17T05:25:11.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.041+0000 7f8a59ffb640 1 -- 172.21.15.81:0/440492850 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v43) ==== 59+0+1998 (secure 0 0 0) 0x7f8a4c063ce0 con 0x7f8a44004800 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:25:11.041 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:25:11.042 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:25:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:25:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:25:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:25:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:25:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:25:11.043 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:25:11.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a48079280 msgr2=0x7f8a4807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a48079280 0x7f8a4807b740 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f8a50032000 tx=0x7f8a50001190 comp rx=0 tx=0).stop 2024-09-17T05:25:11.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 msgr2=0x7f8a5c0c5bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 0x7f8a5c0c5bc0 secure :-1 s=READY pgs=1512 cs=0 l=1 rev1=1 crypto rx=0x7f8a4c006290 tx=0x7f8a4c006750 comp rx=0 tx=0).stop 2024-09-17T05:25:11.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 shutdown_connections 2024-09-17T05:25:11.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8a5c0c6940 0x7f8a5c0b14a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8a48079280 0x7f8a4807b740 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8a5c15a410 0x7f8a5c1f44c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 --2- 172.21.15.81:0/440492850 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8a44004800 0x7f8a5c0c5bc0 unknown :-1 s=CLOSED pgs=1512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 >> 172.21.15.81:0/440492850 conn(0x7f8a5c0741f0 msgr2=0x7f8a5c0c9d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:11.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 shutdown_connections 2024-09-17T05:25:11.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.043+0000 7f8a6367f640 1 -- 172.21.15.81:0/440492850 wait complete. 2024-09-17T05:25:11.054 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:25:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.157+0000 7fb321cbd640 1 -- 172.21.15.81:0/1583733440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 msgr2=0x7fb31c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.157+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1583733440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c0cb7c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7fb310009830 tx=0x7fb31002a510 comp rx=0 tx=0).stop 2024-09-17T05:25:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.157+0000 7fb321cbd640 1 -- 172.21.15.81:0/1583733440 shutdown_connections 2024-09-17T05:25:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.157+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1583733440 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c0cb7c0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.157+0000 7fb321cbd640 1 -- 172.21.15.81:0/1583733440 >> 172.21.15.81:0/1583733440 conn(0x7fb31c074160 msgr2=0x7fb31c074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.157+0000 7fb321cbd640 1 -- 172.21.15.81:0/1583733440 shutdown_connections 2024-09-17T05:25:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.157+0000 7fb321cbd640 1 -- 172.21.15.81:0/1583733440 wait complete. 2024-09-17T05:25:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.158+0000 7fb321cbd640 1 Processor -- start 2024-09-17T05:25:11.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.158+0000 7fb321cbd640 1 -- start start 2024-09-17T05:25:11.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb321cbd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c0cbd00 0x7fb31c1f3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb321cbd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c09d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb321cbd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c15adb0 0x7fb31c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb321cbd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c0b0e20 con 0x7fb31c0cd430 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb321cbd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c0b0ca0 con 0x7fb31c0cbd00 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb321cbd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb31c0b0fa0 con 0x7fb31c15adb0 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb31affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c09d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb31affd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c09d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49218/0 (socket says 172.21.15.81:49218) 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.159+0000 7fb31affd640 1 -- 172.21.15.81:0/1567048972 learned_addr learned my addr 172.21.15.81:0/1567048972 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31b7fe640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c0cbd00 0x7fb31c1f3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31bfff640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c15adb0 0x7fb31c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31affd640 1 -- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c15adb0 msgr2=0x7fb31c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31affd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c15adb0 0x7fb31c15d890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31affd640 1 -- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c0cbd00 msgr2=0x7fb31c1f3610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31affd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c0cbd00 0x7fb31c1f3610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31affd640 1 -- 172.21.15.81:0/1567048972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31c1f3b50 con 0x7fb31c0cd430 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31b7fe640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c0cbd00 0x7fb31c1f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb31affd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c09d800 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb310000c00 tx=0x7fb310032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb303fff640 1 -- 172.21.15.81:0/1567048972 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310040070 con 0x7fb31c0cd430 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb303fff640 1 -- 172.21.15.81:0/1567048972 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb310003af0 con 0x7fb31c0cd430 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb303fff640 1 -- 172.21.15.81:0/1567048972 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb310045460 con 0x7fb31c0cd430 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31c0c7850 con 0x7fb31c0cd430 2024-09-17T05:25:11.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.160+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb31c0c80f0 con 0x7fb31c0cd430 2024-09-17T05:25:11.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.161+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb31c0c7c40 con 0x7fb31c0cd430 2024-09-17T05:25:11.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.162+0000 7fb303fff640 1 -- 172.21.15.81:0/1567048972 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fb310039040 con 0x7fb31c0cd430 2024-09-17T05:25:11.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.162+0000 7fb303fff640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb308079280 0x7fb30807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.162+0000 7fb303fff640 1 -- 172.21.15.81:0/1567048972 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7fb3100bcc40 con 0x7fb31c0cd430 2024-09-17T05:25:11.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.162+0000 7fb31b7fe640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb308079280 0x7fb30807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.163+0000 7fb31b7fe640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb308079280 0x7fb30807b740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb30c006fd0 tx=0x7fb30c008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:11.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.167+0000 7fb303fff640 1 -- 172.21.15.81:0/1567048972 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb31c1f3b50 con 0x7fb31c0cd430 2024-09-17T05:25:11.343 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.343+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fb31c0b1410 con 0x7fb31c0cd430 2024-09-17T05:25:11.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.347+0000 7fb303fff640 1 -- 172.21.15.81:0/1567048972 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7fb310084ab0 con 0x7fb31c0cd430 2024-09-17T05:25:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb308079280 msgr2=0x7fb30807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb308079280 0x7fb30807b740 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb30c006fd0 tx=0x7fb30c008040 comp rx=0 tx=0).stop 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 msgr2=0x7fb31c09d800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c09d800 secure :-1 s=READY pgs=1515 cs=0 l=1 rev1=1 crypto rx=0x7fb310000c00 tx=0x7fb310032d50 comp rx=0 tx=0).stop 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 shutdown_connections 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c15adb0 0x7fb31c15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0cd430 0x7fb31c09d800 unknown :-1 s=CLOSED pgs=1515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb308079280 0x7fb30807b740 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 --2- 172.21.15.81:0/1567048972 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c0cbd00 0x7fb31c1f3610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 >> 172.21.15.81:0/1567048972 conn(0x7fb31c074160 msgr2=0x7fb31c074540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 shutdown_connections 2024-09-17T05:25:11.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.349+0000 7fb321cbd640 1 -- 172.21.15.81:0/1567048972 wait complete. 2024-09-17T05:25:11.361 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:25:11.361 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:11.401 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:11.442 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:25:11.442 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:11.443 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:11.459 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:25:11.459 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:11.459 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:11.500 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:25:11.500 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:11.500 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:11.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:25:11.517 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:11.517 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:11.557 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:25:11.558 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:25:11.558 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.659+0000 7f315ba08640 1 -- 172.21.15.81:0/3634608580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31540d0d40 msgr2=0x7f31540cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.659+0000 7f315ba08640 1 --2- 172.21.15.81:0/3634608580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31540d0d40 0x7f31540cf9b0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f31540d1eb0 tx=0x7f314802aa70 comp rx=0 tx=0).stop 2024-09-17T05:25:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.659+0000 7f315ba08640 1 -- 172.21.15.81:0/3634608580 shutdown_connections 2024-09-17T05:25:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.659+0000 7f315ba08640 1 --2- 172.21.15.81:0/3634608580 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31540d0d40 0x7f31540cf9b0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.659+0000 7f315ba08640 1 -- 172.21.15.81:0/3634608580 >> 172.21.15.81:0/3634608580 conn(0x7f31540d3ea0 msgr2=0x7f31540d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.659+0000 7f315ba08640 1 -- 172.21.15.81:0/3634608580 shutdown_connections 2024-09-17T05:25:11.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.659+0000 7f315ba08640 1 -- 172.21.15.81:0/3634608580 wait complete. 2024-09-17T05:25:11.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 Processor -- start 2024-09-17T05:25:11.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 -- start start 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31540d0d40 0x7f31540cdc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31540d49c0 0x7f31541f4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f315415df90 0x7f31541f8380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3154162690 con 0x7f315415df90 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f31540b3f10 con 0x7f31540d49c0 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f315ba08640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f31540b7ed0 con 0x7f31540d0d40 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f3159fa5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f315415df90 0x7f31541f8380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f3159fa5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f315415df90 0x7f31541f8380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49238/0 (socket says 172.21.15.81:49238) 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.661+0000 7f3159fa5640 1 -- 172.21.15.81:0/4030646922 learned_addr learned my addr 172.21.15.81:0/4030646922 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3158fa3640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31540d49c0 0x7f31541f4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f31597a4640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31540d0d40 0x7f31540cdc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3159fa5640 1 -- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31540d0d40 msgr2=0x7f31540cdc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3159fa5640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31540d0d40 0x7f31540cdc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3159fa5640 1 -- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31540d49c0 msgr2=0x7f31541f4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3159fa5640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31540d49c0 0x7f31541f4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3159fa5640 1 -- 172.21.15.81:0/4030646922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31540ce150 con 0x7f315415df90 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3159fa5640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f315415df90 0x7f31541f8380 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f314400c730 tx=0x7f314400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3151ffb640 1 -- 172.21.15.81:0/4030646922 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3144017070 con 0x7f315415df90 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3151ffb640 1 -- 172.21.15.81:0/4030646922 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3144005070 con 0x7f315415df90 2024-09-17T05:25:11.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31540b8ee0 con 0x7f315415df90 2024-09-17T05:25:11.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f3151ffb640 1 -- 172.21.15.81:0/4030646922 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f314400a640 con 0x7f315415df90 2024-09-17T05:25:11.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.662+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31540b8400 con 0x7f315415df90 2024-09-17T05:25:11.665 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.663+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31540b4440 con 0x7f315415df90 2024-09-17T05:25:11.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.664+0000 7f3151ffb640 1 -- 172.21.15.81:0/4030646922 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f314401a070 con 0x7f315415df90 2024-09-17T05:25:11.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.664+0000 7f3151ffb640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3140079250 0x7f314007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:11.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.664+0000 7f3151ffb640 1 -- 172.21.15.81:0/4030646922 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7f314409a960 con 0x7f315415df90 2024-09-17T05:25:11.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.664+0000 7f31597a4640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3140079250 0x7f314007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:11.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.665+0000 7f31597a4640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3140079250 0x7f314007b710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f314c006fd0 tx=0x7f314c008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:11.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.669+0000 7f3151ffb640 1 -- 172.21.15.81:0/4030646922 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f31540ce150 con 0x7f315415df90 2024-09-17T05:25:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.883+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f315408d590 con 0x7f315415df90 2024-09-17T05:25:11.883 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.883+0000 7f3151ffb640 1 -- 172.21.15.81:0/4030646922 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 79 v79) ==== 94+0+3905 (secure 0 0 0) 0x7f31540ce970 con 0x7f315415df90 2024-09-17T05:25:11.884 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:11.884 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":79,"btime":"2024-09-17T05:25:06:431318+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6958,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/79515014","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":79515014},{"type":"v1","addr":"172.21.15.160:6801","nonce":79515014}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":6961,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3823420234","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":3823420234},{"type":"v1","addr":"172.21.15.160:6835","nonce":3823420234}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":73},{"gid":7914,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3648115084","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3648115084},{"type":"v1","addr":"172.21.15.81:6834","nonce":3648115084}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":72},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/24748807","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":24748807},{"type":"v1","addr":"172.21.15.81:6835","nonce":24748807}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":79}],"filesystems":[]} 2024-09-17T05:25:11.884 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 79 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3140079250 msgr2=0x7f314007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3140079250 0x7f314007b710 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f314c006fd0 tx=0x7f314c008040 comp rx=0 tx=0).stop 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f315415df90 msgr2=0x7f31541f8380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f315415df90 0x7f31541f8380 secure :-1 s=READY pgs=1518 cs=0 l=1 rev1=1 crypto rx=0x7f314400c730 tx=0x7f314400cbf0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 shutdown_connections 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f315415df90 0x7f31541f8380 unknown :-1 s=CLOSED pgs=1518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3140079250 0x7f314007b710 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f31540d49c0 0x7f31541f4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 --2- 172.21.15.81:0/4030646922 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f31540d0d40 0x7f31540cdc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:11.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.885+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 >> 172.21.15.81:0/4030646922 conn(0x7f31540d3ea0 msgr2=0x7f3154160550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.886+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 shutdown_connections 2024-09-17T05:25:11.887 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:11.886+0000 7f315ba08640 1 -- 172.21.15.81:0/4030646922 wait complete. 2024-09-17T05:25:11.896 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:25:11.897 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:25:11.897 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:25:11.897 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:11.897 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:25:11.897 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:25:11.897 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:25:11.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:11.898 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:25:11.898 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:25:11.898 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:25:11.898 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:11.898 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:25:11.898 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:25:11.899 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:25:11.899 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:11.906 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:25:11.907 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:25:11.908 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:25:11.908 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:25:11.910 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:25:11.910 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:25:11.911 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:25:11.912 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:25:11.949 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:25:11.950 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:11.950 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:25:11.950 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:11.953 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:25:11.953 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:11.953 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:25:11.954 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:11.954 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:25:12.023 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:25:12.023 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:25:12.034 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:25:12.034 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.060+0000 7f850b5f8640 1 -- 172.21.15.81:0/1627118817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f850415df90 msgr2=0x7f85040cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.060+0000 7f850b5f8640 1 --2- 172.21.15.81:0/1627118817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f850415df90 0x7f85040cf9b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8500009830 tx=0x7f850002a4a0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.061+0000 7f850b5f8640 1 -- 172.21.15.81:0/1627118817 shutdown_connections 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.061+0000 7f850b5f8640 1 --2- 172.21.15.81:0/1627118817 >> v2:172.21.15.160:3300/0 conn(0x7f85040d0d40 0x7f85040b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.061+0000 7f850b5f8640 1 --2- 172.21.15.81:0/1627118817 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f850415df90 0x7f85040cf9b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.061+0000 7f850b5f8640 1 -- 172.21.15.81:0/1627118817 >> 172.21.15.81:0/1627118817 conn(0x7f85040d3ea0 msgr2=0x7f85040d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.061+0000 7f850b5f8640 1 -- 172.21.15.81:0/1627118817 shutdown_connections 2024-09-17T05:25:12.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.061+0000 7f850b5f8640 1 -- 172.21.15.81:0/1627118817 wait complete. 2024-09-17T05:25:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.062+0000 7f850b5f8640 1 Processor -- start 2024-09-17T05:25:12.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.062+0000 7f850b5f8640 1 -- start start 2024-09-17T05:25:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f850b5f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85040d0d40 0x7f85041f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f850b5f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85040d49c0 0x7f85040caf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f850b5f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f850415df90 0x7f85040cce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85040d0d40 0x7f85041f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f850b5f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f85040b3d40 con 0x7f85040d0d40 2024-09-17T05:25:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f850b5f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8504162710 con 0x7f850415df90 2024-09-17T05:25:12.064 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f850b5f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f85040b3ec0 con 0x7f85040d49c0 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85040d0d40 0x7f85041f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49276/0 (socket says 172.21.15.81:49276) 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 -- 172.21.15.81:0/2985886600 learned_addr learned my addr 172.21.15.81:0/2985886600 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 -- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85040d49c0 msgr2=0x7f85040caf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8508b93640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85040d49c0 0x7f85040caf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85040d49c0 0x7f85040caf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509b95640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f850415df90 0x7f85040cce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 -- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f850415df90 msgr2=0x7f85040cce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f850415df90 0x7f85040cce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 -- 172.21.15.81:0/2985886600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85040cb950 con 0x7f85040d0d40 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8508b93640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85040d49c0 0x7f85040caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:12.065 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f8509394640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85040d0d40 0x7f85041f3fa0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f8500009950 tx=0x7f8500003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f84f9ffb640 1 -- 172.21.15.81:0/2985886600 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500005c90 con 0x7f85040d0d40 2024-09-17T05:25:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f84f9ffb640 1 -- 172.21.15.81:0/2985886600 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8500005020 con 0x7f85040d0d40 2024-09-17T05:25:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f84f9ffb640 1 -- 172.21.15.81:0/2985886600 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8500005450 con 0x7f85040d0d40 2024-09-17T05:25:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.063+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85040cbc90 con 0x7f85040d0d40 2024-09-17T05:25:12.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.064+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85040cc4d0 con 0x7f85040d0d40 2024-09-17T05:25:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.065+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85040b43f0 con 0x7f85040d0d40 2024-09-17T05:25:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.065+0000 7f84f9ffb640 1 -- 172.21.15.81:0/2985886600 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f85000317c0 con 0x7f85040d0d40 2024-09-17T05:25:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.065+0000 7f84f9ffb640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f84e8079250 0x7f84e807b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.066+0000 7f84f9ffb640 1 -- 172.21.15.81:0/2985886600 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(132..132 src has 1..132) ==== 5015+0+0 (secure 0 0 0) 0x7f85000bc730 con 0x7f85040d0d40 2024-09-17T05:25:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.066+0000 7f8508b93640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f84e8079250 0x7f84e807b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.066+0000 7f8508b93640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f84e8079250 0x7f84e807b710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8504153580 tx=0x7f84f4009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:12.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.070+0000 7f84f9ffb640 1 -- 172.21.15.81:0/2985886600 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f85040cbc90 con 0x7f85040d0d40 2024-09-17T05:25:12.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.256+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f850408d590 con 0x7f85040d0d40 2024-09-17T05:25:12.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.754+0000 7f84f9ffb640 1 -- 172.21.15.81:0/2985886600 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v134) ==== 97+0+0 (secure 0 0 0) 0x7f850003f030 con 0x7f85040d0d40 2024-09-17T05:25:12.754 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:25:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f84e8079250 msgr2=0x7f84e807b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f84e8079250 0x7f84e807b710 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f8504153580 tx=0x7f84f4009040 comp rx=0 tx=0).stop 2024-09-17T05:25:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85040d0d40 msgr2=0x7f85041f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85040d0d40 0x7f85041f3fa0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7f8500009950 tx=0x7f8500003c10 comp rx=0 tx=0).stop 2024-09-17T05:25:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 shutdown_connections 2024-09-17T05:25:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f84e8079250 0x7f84e807b710 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f850415df90 0x7f85040cce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85040d49c0 0x7f85040caf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 --2- 172.21.15.81:0/2985886600 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85040d0d40 0x7f85041f3fa0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 >> 172.21.15.81:0/2985886600 conn(0x7f85040d3ea0 msgr2=0x7f850406d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 shutdown_connections 2024-09-17T05:25:12.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.757+0000 7f850b5f8640 1 -- 172.21.15.81:0/2985886600 wait complete. 2024-09-17T05:25:12.769 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:25:12.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.872+0000 7f97f6da3640 1 -- 172.21.15.81:0/75678008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d49c0 msgr2=0x7f97f00cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.872+0000 7f97f6da3640 1 --2- 172.21.15.81:0/75678008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d49c0 0x7f97f00cf9b0 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f97e8005fd0 tx=0x7f97e802a670 comp rx=0 tx=0).stop 2024-09-17T05:25:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.872+0000 7f97f6da3640 1 -- 172.21.15.81:0/75678008 shutdown_connections 2024-09-17T05:25:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.872+0000 7f97f6da3640 1 --2- 172.21.15.81:0/75678008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d49c0 0x7f97f00cf9b0 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.872+0000 7f97f6da3640 1 -- 172.21.15.81:0/75678008 >> 172.21.15.81:0/75678008 conn(0x7f97f00d3ea0 msgr2=0x7f97f00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.872+0000 7f97f6da3640 1 -- 172.21.15.81:0/75678008 shutdown_connections 2024-09-17T05:25:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.872+0000 7f97f6da3640 1 -- 172.21.15.81:0/75678008 wait complete. 2024-09-17T05:25:12.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.873+0000 7f97f6da3640 1 Processor -- start 2024-09-17T05:25:12.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.873+0000 7f97f6da3640 1 -- start start 2024-09-17T05:25:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.874+0000 7f97f6da3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d0d40 0x7f97f015eff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.875 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.874+0000 7f97f6da3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f00d49c0 0x7f97f015f530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.874+0000 7f97f6da3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f015df90 0x7f97f0150130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.874+0000 7f97f6da3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97f0162690 con 0x7f97f00d0d40 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.874+0000 7f97f6da3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f97f00b3f10 con 0x7f97f015df90 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.874+0000 7f97f6da3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f97f0160750 con 0x7f97f00d49c0 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.874+0000 7f97f4b3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d0d40 0x7f97f015eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d0d40 0x7f97f015eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:49302/0 (socket says 172.21.15.81:49302) 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 -- 172.21.15.81:0/125440150 learned_addr learned my addr 172.21.15.81:0/125440150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f5340640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f015df90 0x7f97f0150130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97effff640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f00d49c0 0x7f97f015f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 -- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f00d49c0 msgr2=0x7f97f015f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f00d49c0 0x7f97f015f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 -- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f015df90 msgr2=0x7f97f0150130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f015df90 0x7f97f0150130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 -- 172.21.15.81:0/125440150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97f015fb40 con 0x7f97f00d0d40 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f4b3f640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d0d40 0x7f97f015eff0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f97e000c780 tx=0x7f97e000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97ed7fa640 1 -- 172.21.15.81:0/125440150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e0003b70 con 0x7f97f00d0d40 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97ed7fa640 1 -- 172.21.15.81:0/125440150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97e0003d10 con 0x7f97f00d0d40 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97f015fe20 con 0x7f97f00d0d40 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97ed7fa640 1 -- 172.21.15.81:0/125440150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97e000aab0 con 0x7f97f00d0d40 2024-09-17T05:25:12.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.875+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97f01603e0 con 0x7f97f00d0d40 2024-09-17T05:25:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.876+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97f00b4430 con 0x7f97f00d0d40 2024-09-17T05:25:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.877+0000 7f97ed7fa640 1 -- 172.21.15.81:0/125440150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f97e000ac50 con 0x7f97f00d0d40 2024-09-17T05:25:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.877+0000 7f97ed7fa640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97d0079250 0x7f97d007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:12.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.877+0000 7f97ed7fa640 1 -- 172.21.15.81:0/125440150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 4929+0+0 (secure 0 0 0) 0x7f97e009b300 con 0x7f97f00d0d40 2024-09-17T05:25:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.878+0000 7f97effff640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97d0079250 0x7f97d007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:12.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.878+0000 7f97effff640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97d0079250 0x7f97d007b710 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f97f00a1d20 tx=0x7f97d8009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:12.882 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:12.882+0000 7f97ed7fa640 1 -- 172.21.15.81:0/125440150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f97f00ce970 con 0x7f97f00d0d40 2024-09-17T05:25:13.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.127+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f97f008d590 con 0x7f97f00d0d40 2024-09-17T05:25:13.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.128+0000 7f97ed7fa640 1 -- 172.21.15.81:0/125440150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v24) ==== 80+0+5304 (secure 0 0 0) 0x7f97e0062ae0 con 0x7f97f00d0d40 2024-09-17T05:25:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:13.128 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:25:13.128 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.129 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.130 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.131 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:25:13.132 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.133 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.134 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.135 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:25:13.136 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.137 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.138 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.139 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.140 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:25:13.141 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.142 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:13.143 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:25:13.144 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:25:13.144 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:13.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.144 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.144 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:25:13.144 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:25:13.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97d0079250 msgr2=0x7f97d007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97d0079250 0x7f97d007b710 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f97f00a1d20 tx=0x7f97d8009040 comp rx=0 tx=0).stop 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d0d40 msgr2=0x7f97f015eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d0d40 0x7f97f015eff0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f97e000c780 tx=0x7f97e000cc40 comp rx=0 tx=0).stop 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 shutdown_connections 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97d0079250 0x7f97d007b710 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97f015df90 0x7f97f0150130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97f00d49c0 0x7f97f015f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 --2- 172.21.15.81:0/125440150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97f00d0d40 0x7f97f015eff0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.130+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 >> 172.21.15.81:0/125440150 conn(0x7f97f00d3ea0 msgr2=0x7f97f0161980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.131+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 shutdown_connections 2024-09-17T05:25:13.146 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.131+0000 7f97f6da3640 1 -- 172.21.15.81:0/125440150 wait complete. 2024-09-17T05:25:13.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:25:13.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.248+0000 7f31868fe640 1 -- 172.21.15.81:0/3230918693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3168003a00 msgr2=0x7f3168003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.248+0000 7f31868fe640 1 --2- 172.21.15.81:0/3230918693 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3168003a00 0x7f3168003e20 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7f317000baf0 tx=0x7f3168005830 comp rx=0 tx=0).stop 2024-09-17T05:25:13.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.248+0000 7f3184e9b640 1 -- 172.21.15.81:0/3230918693 reap_dead start 2024-09-17T05:25:13.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.248+0000 7f31868fe640 1 -- 172.21.15.81:0/3230918693 shutdown_connections 2024-09-17T05:25:13.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.248+0000 7f31868fe640 1 -- 172.21.15.81:0/3230918693 >> 172.21.15.81:0/3230918693 conn(0x7f31800d3ea0 msgr2=0x7f31800d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:13.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.248+0000 7f31868fe640 1 -- 172.21.15.81:0/3230918693 shutdown_connections 2024-09-17T05:25:13.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.248+0000 7f31868fe640 1 -- 172.21.15.81:0/3230918693 wait complete. 2024-09-17T05:25:13.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.249+0000 7f31868fe640 1 Processor -- start 2024-09-17T05:25:13.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.249+0000 7f31868fe640 1 -- start start 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f31868fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3168003a00 0x7f31800ccc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f31868fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31800cd170 0x7f318014fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f31868fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180150320 0x7f31801507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f31868fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f31800cfd40 con 0x7f31800cd170 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f31868fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f31800cfbc0 con 0x7f3168003a00 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f31868fe640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f31800d0b70 con 0x7f3180150320 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f317f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31800cd170 0x7f318014fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f317f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31800cd170 0x7f318014fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53924/0 (socket says 172.21.15.81:53924) 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f317f7fe640 1 -- 172.21.15.81:0/3599484989 learned_addr learned my addr 172.21.15.81:0/3599484989 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f317ffff640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3168003a00 0x7f31800ccc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.250+0000 7f3184e9b640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180150320 0x7f31801507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317f7fe640 1 -- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180150320 msgr2=0x7f31801507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317f7fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180150320 0x7f31801507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317f7fe640 1 -- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3168003a00 msgr2=0x7f31800ccc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317f7fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3168003a00 0x7f31800ccc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317f7fe640 1 -- 172.21.15.81:0/3599484989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31800cd5f0 con 0x7f31800cd170 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f3184e9b640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180150320 0x7f31801507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317ffff640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3168003a00 0x7f31800ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317f7fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31800cd170 0x7f318014fde0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f317400fa00 tx=0x7f317400fec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:13.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317cff9640 1 -- 172.21.15.81:0/3599484989 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f317400bcb0 con 0x7f31800cd170 2024-09-17T05:25:13.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317cff9640 1 -- 172.21.15.81:0/3599484989 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3174004030 con 0x7f31800cd170 2024-09-17T05:25:13.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31800cd8d0 con 0x7f31800cd170 2024-09-17T05:25:13.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f317cff9640 1 -- 172.21.15.81:0/3599484989 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3174004460 con 0x7f31800cd170 2024-09-17T05:25:13.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.251+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f318014de50 con 0x7f31800cd170 2024-09-17T05:25:13.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.252+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31800d0630 con 0x7f31800cd170 2024-09-17T05:25:13.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.252+0000 7f317cff9640 1 -- 172.21.15.81:0/3599484989 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f31740035f0 con 0x7f31800cd170 2024-09-17T05:25:13.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.253+0000 7f317cff9640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f316c079250 0x7f316c07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.253+0000 7f317ffff640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f316c079250 0x7f316c07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.253+0000 7f317cff9640 1 -- 172.21.15.81:0/3599484989 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 4929+0+0 (secure 0 0 0) 0x7f317409c0e0 con 0x7f31800cd170 2024-09-17T05:25:13.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.253+0000 7f317ffff640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f316c079250 0x7f316c07b710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3170036000 tx=0x7f31700046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:13.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.257+0000 7f317cff9640 1 -- 172.21.15.81:0/3599484989 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3174063730 con 0x7f31800cd170 2024-09-17T05:25:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.435+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f318008d590 con 0x7f31800cd170 2024-09-17T05:25:13.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.435+0000 7f317cff9640 1 -- 172.21.15.81:0/3599484989 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v136) ==== 84+0+65 (secure 0 0 0) 0x7f3174068160 con 0x7f31800cd170 2024-09-17T05:25:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:13.436 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:25:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:25:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:25:13.436 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:13.436 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.437+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f316c079250 msgr2=0x7f316c07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.437+0000 7f31868fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f316c079250 0x7f316c07b710 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3170036000 tx=0x7f31700046c0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.437+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31800cd170 msgr2=0x7f318014fde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.437+0000 7f31868fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31800cd170 0x7f318014fde0 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f317400fa00 tx=0x7f317400fec0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 shutdown_connections 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3180150320 0x7f31801507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f31800cd170 0x7f318014fde0 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f316c079250 0x7f316c07b710 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 --2- 172.21.15.81:0/3599484989 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3168003a00 0x7f31800ccc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 >> 172.21.15.81:0/3599484989 conn(0x7f31800d3ea0 msgr2=0x7f31800b0c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 shutdown_connections 2024-09-17T05:25:13.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.438+0000 7f31868fe640 1 -- 172.21.15.81:0/3599484989 wait complete. 2024-09-17T05:25:13.448 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:25:13.449 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:25:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.552+0000 7fb73368c640 1 -- 172.21.15.81:0/763584015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 msgr2=0x7fb72c072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.552+0000 7fb73368c640 1 --2- 172.21.15.81:0/763584015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c072a10 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7fb72c070a10 tx=0x7fb71c02a510 comp rx=0 tx=0).stop 2024-09-17T05:25:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.553+0000 7fb73368c640 1 -- 172.21.15.81:0/763584015 shutdown_connections 2024-09-17T05:25:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.553+0000 7fb73368c640 1 --2- 172.21.15.81:0/763584015 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c072a10 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.553+0000 7fb73368c640 1 -- 172.21.15.81:0/763584015 >> 172.21.15.81:0/763584015 conn(0x7fb72c0b1620 msgr2=0x7fb72c0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.553+0000 7fb73368c640 1 -- 172.21.15.81:0/763584015 shutdown_connections 2024-09-17T05:25:13.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.553+0000 7fb73368c640 1 -- 172.21.15.81:0/763584015 wait complete. 2024-09-17T05:25:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.554+0000 7fb73368c640 1 Processor -- start 2024-09-17T05:25:13.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.554+0000 7fb73368c640 1 -- start start 2024-09-17T05:25:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.554+0000 7fb73368c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb72c0ae690 0x7fb72c14d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.554+0000 7fb73368c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c1f6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb73368c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb72c15d610 0x7fb72c0b01b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb73368c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c072f50 con 0x7fb72c0aec50 2024-09-17T05:25:13.556 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb73368c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb72c0b36a0 con 0x7fb72c0ae690 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb73368c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb72c0730d0 con 0x7fb72c15d610 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c1f6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c1f6d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53942/0 (socket says 172.21.15.81:53942) 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 -- 172.21.15.81:0/1834343812 learned_addr learned my addr 172.21.15.81:0/1834343812 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb731428640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb72c0ae690 0x7fb72c14d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb731c29640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb72c15d610 0x7fb72c0b01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 -- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb72c15d610 msgr2=0x7fb72c0b01b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb72c15d610 0x7fb72c0b01b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 -- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb72c0ae690 msgr2=0x7fb72c14d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb72c0ae690 0x7fb72c14d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 -- 172.21.15.81:0/1834343812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb72c158410 con 0x7fb72c0aec50 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb731428640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb72c0ae690 0x7fb72c14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb731c29640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb72c15d610 0x7fb72c0b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb730c27640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c1f6d50 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02ab00 tx=0x7fb71c032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb721ffb640 1 -- 172.21.15.81:0/1834343812 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c040070 con 0x7fb72c0aec50 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb721ffb640 1 -- 172.21.15.81:0/1834343812 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb71c005310 con 0x7fb72c0aec50 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb72c1586f0 con 0x7fb72c0aec50 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb721ffb640 1 -- 172.21.15.81:0/1834343812 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb71c003800 con 0x7fb72c0aec50 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.555+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb72c158cb0 con 0x7fb72c0aec50 2024-09-17T05:25:13.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.556+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb72c072a10 con 0x7fb72c0aec50 2024-09-17T05:25:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.557+0000 7fb721ffb640 1 -- 172.21.15.81:0/1834343812 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fb71c039040 con 0x7fb72c0aec50 2024-09-17T05:25:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.558+0000 7fb721ffb640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb710079250 0x7fb71007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.558+0000 7fb731428640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb710079250 0x7fb71007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.558+0000 7fb721ffb640 1 -- 172.21.15.81:0/1834343812 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(136..136 src has 1..136) ==== 4929+0+0 (secure 0 0 0) 0x7fb71c0bc970 con 0x7fb72c0aec50 2024-09-17T05:25:13.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.558+0000 7fb731428640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb710079250 0x7fb71007b710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb728007fd0 tx=0x7fb728009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:13.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.562+0000 7fb721ffb640 1 -- 172.21.15.81:0/1834343812 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb71c0846a0 con 0x7fb72c0aec50 2024-09-17T05:25:13.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.737+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fb72c0b2ab0 con 0x7fb72c0aec50 2024-09-17T05:25:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.771+0000 7fb721ffb640 1 -- 172.21.15.81:0/1834343812 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v137) ==== 138+0+0 (secure 0 0 0) 0x7fb71c083fa0 con 0x7fb72c0aec50 2024-09-17T05:25:13.771 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:25:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb710079250 msgr2=0x7fb71007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb710079250 0x7fb71007b710 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb728007fd0 tx=0x7fb728009040 comp rx=0 tx=0).stop 2024-09-17T05:25:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 msgr2=0x7fb72c1f6d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c1f6d50 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7fb71c02ab00 tx=0x7fb71c032d50 comp rx=0 tx=0).stop 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 shutdown_connections 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb72c15d610 0x7fb72c0b01b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb72c0aec50 0x7fb72c1f6d50 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb710079250 0x7fb71007b710 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 --2- 172.21.15.81:0/1834343812 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb72c0ae690 0x7fb72c14d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 >> 172.21.15.81:0/1834343812 conn(0x7fb72c0b1620 msgr2=0x7fb72c0b40d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 shutdown_connections 2024-09-17T05:25:13.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.773+0000 7fb73368c640 1 -- 172.21.15.81:0/1834343812 wait complete. 2024-09-17T05:25:13.787 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:25:13.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 -- 172.21.15.81:0/743432621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cede0 msgr2=0x7f68e80cf200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 --2- 172.21.15.81:0/743432621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cede0 0x7f68e80cf200 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005fd0 tx=0x7f68e002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 -- 172.21.15.81:0/743432621 shutdown_connections 2024-09-17T05:25:13.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 --2- 172.21.15.81:0/743432621 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cede0 0x7f68e80cf200 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 --2- 172.21.15.81:0/743432621 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e80cdb90 0x7f68e80ce000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 -- 172.21.15.81:0/743432621 >> 172.21.15.81:0/743432621 conn(0x7f68e80b1700 msgr2=0x7f68e80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:13.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 -- 172.21.15.81:0/743432621 shutdown_connections 2024-09-17T05:25:13.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.896+0000 7f68ef46b640 1 -- 172.21.15.81:0/743432621 wait complete. 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.897+0000 7f68ef46b640 1 Processor -- start 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.897+0000 7f68ef46b640 1 -- start start 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ef46b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cdb90 0x7f68e80aedc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ef46b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e80cede0 0x7f68e8155670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ef46b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e815bab0 0x7f68e80c7c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ef46b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f68e806fde0 con 0x7f68e80cede0 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ef46b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f68e806fc60 con 0x7f68e80cdb90 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ef46b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f68e806ff60 con 0x7f68e815bab0 2024-09-17T05:25:13.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e80cede0 0x7f68e8155670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e80cede0 0x7f68e8155670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53950/0 (socket says 172.21.15.81:53950) 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 -- 172.21.15.81:0/1309519173 learned_addr learned my addr 172.21.15.81:0/1309519173 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eda08640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e815bab0 0x7f68e80c7c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ed207640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cdb90 0x7f68e80aedc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 -- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e815bab0 msgr2=0x7f68e80c7c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e815bab0 0x7f68e80c7c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 -- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cdb90 msgr2=0x7f68e80aedc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cdb90 0x7f68e80aedc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 -- 172.21.15.81:0/1309519173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e80add20 con 0x7f68e80cede0 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68eca06640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e80cede0 0x7f68e8155670 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f68d800ea60 tx=0x7f68d800ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ddffb640 1 -- 172.21.15.81:0/1309519173 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d800cde0 con 0x7f68e80cede0 2024-09-17T05:25:13.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e80ae000 con 0x7f68e80cede0 2024-09-17T05:25:13.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ddffb640 1 -- 172.21.15.81:0/1309519173 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f68d8004020 con 0x7f68e80cede0 2024-09-17T05:25:13.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.898+0000 7f68ddffb640 1 -- 172.21.15.81:0/1309519173 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8004450 con 0x7f68e80cede0 2024-09-17T05:25:13.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.899+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e80ae5c0 con 0x7f68e80cede0 2024-09-17T05:25:13.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.900+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68e80734e0 con 0x7f68e80cede0 2024-09-17T05:25:13.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.900+0000 7f68ddffb640 1 -- 172.21.15.81:0/1309519173 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f68d80035f0 con 0x7f68e80cede0 2024-09-17T05:25:13.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.901+0000 7f68ddffb640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f68cc079250 0x7f68cc07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:13.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.901+0000 7f68ed207640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f68cc079250 0x7f68cc07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:13.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.901+0000 7f68ddffb640 1 -- 172.21.15.81:0/1309519173 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(137..137 src has 1..137) ==== 5299+0+0 (secure 0 0 0) 0x7f68d809c0d0 con 0x7f68e80cede0 2024-09-17T05:25:13.902 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.901+0000 7f68ed207640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f68cc079250 0x7f68cc07b710 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f68e4001720 tx=0x7f68e4007e90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:13.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:13.905+0000 7f68ddffb640 1 -- 172.21.15.81:0/1309519173 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f68e80734e0 con 0x7f68e80cede0 2024-09-17T05:25:14.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.085+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f68e80703d0 con 0x7f68e80cede0 2024-09-17T05:25:14.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.777+0000 7f68ddffb640 1 -- 172.21.15.81:0/1309519173 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v138) ==== 170+0+0 (secure 0 0 0) 0x7f68d80636c0 con 0x7f68e80cede0 2024-09-17T05:25:14.777 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:25:14.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.782+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f68cc079250 msgr2=0x7f68cc07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:14.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.782+0000 7f68ef46b640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f68cc079250 0x7f68cc07b710 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f68e4001720 tx=0x7f68e4007e90 comp rx=0 tx=0).stop 2024-09-17T05:25:14.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.782+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e80cede0 msgr2=0x7f68e8155670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:14.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.782+0000 7f68ef46b640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e80cede0 0x7f68e8155670 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x7f68d800ea60 tx=0x7f68d800ef20 comp rx=0 tx=0).stop 2024-09-17T05:25:14.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.785+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 shutdown_connections 2024-09-17T05:25:14.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.785+0000 7f68ef46b640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f68e815bab0 0x7f68e80c7c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:14.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.786+0000 7f68ef46b640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f68e80cede0 0x7f68e8155670 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:14.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.786+0000 7f68ef46b640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f68cc079250 0x7f68cc07b710 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:14.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.786+0000 7f68ef46b640 1 --2- 172.21.15.81:0/1309519173 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f68e80cdb90 0x7f68e80aedc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:14.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.786+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 >> 172.21.15.81:0/1309519173 conn(0x7f68e80b1700 msgr2=0x7f68e80b4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:14.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.789+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 shutdown_connections 2024-09-17T05:25:14.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.789+0000 7f68ef46b640 1 -- 172.21.15.81:0/1309519173 wait complete. 2024-09-17T05:25:14.805 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:25:14.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.912+0000 7f97c007f640 1 -- 172.21.15.81:0/4089188427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a0004000 msgr2=0x7f97a0004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:14.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.912+0000 7f97c007f640 1 --2- 172.21.15.81:0/4089188427 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97a0004000 0x7f97a0004800 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f97ac009b50 tx=0x7f97a0005830 comp rx=0 tx=0).stop 2024-09-17T05:25:14.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.912+0000 7f97be61c640 1 -- 172.21.15.81:0/4089188427 reap_dead start 2024-09-17T05:25:14.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.912+0000 7f97c007f640 1 -- 172.21.15.81:0/4089188427 shutdown_connections 2024-09-17T05:25:14.912 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.912+0000 7f97c007f640 1 -- 172.21.15.81:0/4089188427 >> 172.21.15.81:0/4089188427 conn(0x7f97b80d1bb0 msgr2=0x7f97b80d1fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:14.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.912+0000 7f97c007f640 1 -- 172.21.15.81:0/4089188427 shutdown_connections 2024-09-17T05:25:14.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.912+0000 7f97c007f640 1 -- 172.21.15.81:0/4089188427 wait complete. 2024-09-17T05:25:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.913+0000 7f97c007f640 1 Processor -- start 2024-09-17T05:25:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.913+0000 7f97c007f640 1 -- start start 2024-09-17T05:25:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a0004000 0x7f97b815dcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97b806f6c0 0x7f97b80b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8149bc0 0x7f97b814a040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:14.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97b80b2b10 con 0x7f97b8149bc0 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f97b80ce850 con 0x7f97a0004000 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f97b80b2c90 con 0x7f97b806f6c0 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8149bc0 0x7f97b814a040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8149bc0 0x7f97b814a040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53974/0 (socket says 172.21.15.81:53974) 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 -- 172.21.15.81:0/4265606924 learned_addr learned my addr 172.21.15.81:0/4265606924 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 -- 172.21.15.81:0/4265606924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97b806f6c0 msgr2=0x7f97b80b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97b806f6c0 0x7f97b80b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 -- 172.21.15.81:0/4265606924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a0004000 msgr2=0x7f97b815dcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a0004000 0x7f97b815dcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 -- 172.21.15.81:0/4265606924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b815e2a0 con 0x7f97b8149bc0 2024-09-17T05:25:14.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97be61c640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8149bc0 0x7f97b814a040 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f97b8074070 tx=0x7f97b0001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97b67fc640 1 -- 172.21.15.81:0/4265606924 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011660 con 0x7f97b8149bc0 2024-09-17T05:25:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97b67fc640 1 -- 172.21.15.81:0/4265606924 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f97b0017070 con 0x7f97b8149bc0 2024-09-17T05:25:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b815e580 con 0x7f97b8149bc0 2024-09-17T05:25:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97b67fc640 1 -- 172.21.15.81:0/4265606924 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97b0011bd0 con 0x7f97b8149bc0 2024-09-17T05:25:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.914+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b815eb40 con 0x7f97b8149bc0 2024-09-17T05:25:14.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.915+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b80b31f0 con 0x7f97b8149bc0 2024-09-17T05:25:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.916+0000 7f97b67fc640 1 -- 172.21.15.81:0/4265606924 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f97b001c460 con 0x7f97b8149bc0 2024-09-17T05:25:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.916+0000 7f97b67fc640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97a4079280 0x7f97a407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:14.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.917+0000 7f97bde1b640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97a4079280 0x7f97a407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:14.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.917+0000 7f97b67fc640 1 -- 172.21.15.81:0/4265606924 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(138..138 src has 1..138) ==== 5681+0+0 (secure 0 0 0) 0x7f97b009be60 con 0x7f97b8149bc0 2024-09-17T05:25:14.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.917+0000 7f97bde1b640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97a4079280 0x7f97a407b740 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f97a80013d0 tx=0x7f97a80021c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:14.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:14.921+0000 7f97b67fc640 1 -- 172.21.15.81:0/4265606924 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f97b0063920 con 0x7f97b8149bc0 2024-09-17T05:25:15.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.136+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f97b80cdf70 con 0x7f97b8149bc0 2024-09-17T05:25:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.782+0000 7f97b67fc640 1 -- 172.21.15.81:0/4265606924 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v82) ==== 174+0+0 (secure 0 0 0) 0x7f97b0063220 con 0x7f97b8149bc0 2024-09-17T05:25:15.782 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 22 and data pool 23 2024-09-17T05:25:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97a4079280 msgr2=0x7f97a407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97a4079280 0x7f97a407b740 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f97a80013d0 tx=0x7f97a80021c0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8149bc0 msgr2=0x7f97b814a040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8149bc0 0x7f97b814a040 secure :-1 s=READY pgs=1542 cs=0 l=1 rev1=1 crypto rx=0x7f97b8074070 tx=0x7f97b0001630 comp rx=0 tx=0).stop 2024-09-17T05:25:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 shutdown_connections 2024-09-17T05:25:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f97b8149bc0 0x7f97b814a040 unknown :-1 s=CLOSED pgs=1542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97b806f6c0 0x7f97b80b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97a4079280 0x7f97a407b740 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 --2- 172.21.15.81:0/4265606924 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97a0004000 0x7f97b815dcc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 >> 172.21.15.81:0/4265606924 conn(0x7f97b80d1bb0 msgr2=0x7f97b80aeb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:15.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 shutdown_connections 2024-09-17T05:25:15.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.786+0000 7f97c007f640 1 -- 172.21.15.81:0/4265606924 wait complete. 2024-09-17T05:25:15.800 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:15.823 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:25:15.845 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:25:15.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 -- 172.21.15.81:0/1155788017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 msgr2=0x7fe3700cbb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 --2- 172.21.15.81:0/1155788017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700cbb80 secure :-1 s=READY pgs=1543 cs=0 l=1 rev1=1 crypto rx=0x7fe368009900 tx=0x7fe36802a560 comp rx=0 tx=0).stop 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 -- 172.21.15.81:0/1155788017 shutdown_connections 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 --2- 172.21.15.81:0/1155788017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700cbb80 unknown :-1 s=CLOSED pgs=1543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 --2- 172.21.15.81:0/1155788017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe3700cd3e0 0x7fe3700ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 -- 172.21.15.81:0/1155788017 >> 172.21.15.81:0/1155788017 conn(0x7fe3700741f0 msgr2=0x7fe370074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 -- 172.21.15.81:0/1155788017 shutdown_connections 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.904+0000 7fe375d7d640 1 -- 172.21.15.81:0/1155788017 wait complete. 2024-09-17T05:25:15.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.905+0000 7fe375d7d640 1 Processor -- start 2024-09-17T05:25:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.905+0000 7fe375d7d640 1 -- start start 2024-09-17T05:25:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe375d7d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37006f0b0 0x7fe3700c9930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:15.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe375d7d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3700cd3e0 0x7fe3700c4290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe375d7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700b4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe375d7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe3700cc0c0 con 0x7fe3700ce780 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe375d7d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe37015e670 con 0x7fe3700cd3e0 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe375d7d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe3700cc240 con 0x7fe37006f0b0 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700b4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700b4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53982/0 (socket says 172.21.15.81:53982) 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 -- 172.21.15.81:0/3142268725 learned_addr learned my addr 172.21.15.81:0/3142268725 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36effd640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3700cd3e0 0x7fe3700c4290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36f7fe640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37006f0b0 0x7fe3700c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 -- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37006f0b0 msgr2=0x7fe3700c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37006f0b0 0x7fe3700c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 -- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3700cd3e0 msgr2=0x7fe3700c4290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3700cd3e0 0x7fe3700c4290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 -- 172.21.15.81:0/3142268725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3700c47d0 con 0x7fe3700ce780 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe36ffff640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700b4220 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe368006010 tx=0x7fe3680039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe357fff640 1 -- 172.21.15.81:0/3142268725 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe36803e030 con 0x7fe3700ce780 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe357fff640 1 -- 172.21.15.81:0/3142268725 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3680047a0 con 0x7fe3700ce780 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.906+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3701f6e30 con 0x7fe3700ce780 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.907+0000 7fe357fff640 1 -- 172.21.15.81:0/3142268725 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe368035040 con 0x7fe3700ce780 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.907+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3700c9130 con 0x7fe3700ce780 2024-09-17T05:25:15.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.908+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3700ce240 con 0x7fe3700ce780 2024-09-17T05:25:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.908+0000 7fe357fff640 1 -- 172.21.15.81:0/3142268725 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fe368041030 con 0x7fe3700ce780 2024-09-17T05:25:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.909+0000 7fe357fff640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe35c079250 0x7fe35c07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.909+0000 7fe36f7fe640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe35c079250 0x7fe35c07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.909+0000 7fe357fff640 1 -- 172.21.15.81:0/3142268725 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5781+0+0 (secure 0 0 0) 0x7fe3680bbff0 con 0x7fe3700ce780 2024-09-17T05:25:15.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.909+0000 7fe36f7fe640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe35c079250 0x7fe35c07b710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe3700d02a0 tx=0x7fe360003d90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:15.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:15.913+0000 7fe357fff640 1 -- 172.21.15.81:0/3142268725 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe3700c47d0 con 0x7fe3700ce780 2024-09-17T05:25:16.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.091+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe3700ca650 con 0x7fe3700ce780 2024-09-17T05:25:16.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.092+0000 7fe357fff640 1 -- 172.21.15.81:0/3142268725 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16856 (secure 0 0 0) 0x7fe368083480 con 0x7fe3700ce780 2024-09-17T05:25:16.093 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:16.093 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":139,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:15.136692+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:13.741069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:14.089486+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe35c079250 msgr2=0x7fe35c07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe35c079250 0x7fe35c07b710 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fe3700d02a0 tx=0x7fe360003d90 comp rx=0 tx=0).stop 2024-09-17T05:25:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 msgr2=0x7fe3700b4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700b4220 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe368006010 tx=0x7fe3680039e0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.095 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 shutdown_connections 2024-09-17T05:25:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe3700ce780 0x7fe3700b4220 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe35c079250 0x7fe35c07b710 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe3700cd3e0 0x7fe3700c4290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 --2- 172.21.15.81:0/3142268725 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe37006f0b0 0x7fe3700c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 >> 172.21.15.81:0/3142268725 conn(0x7fe3700741f0 msgr2=0x7fe3700b51a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 shutdown_connections 2024-09-17T05:25:16.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.094+0000 7fe375d7d640 1 -- 172.21.15.81:0/3142268725 wait complete. 2024-09-17T05:25:16.107 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:16.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 -- 172.21.15.81:0/253603854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d49c0 msgr2=0x7f4abc0b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 --2- 172.21.15.81:0/253603854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d49c0 0x7f4abc0b3800 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7f4ab4005fd0 tx=0x7f4ab402a8b0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 -- 172.21.15.81:0/253603854 shutdown_connections 2024-09-17T05:25:16.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 --2- 172.21.15.81:0/253603854 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d49c0 0x7f4abc0b3800 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 --2- 172.21.15.81:0/253603854 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4abc0d0d40 0x7f4abc0cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 -- 172.21.15.81:0/253603854 >> 172.21.15.81:0/253603854 conn(0x7f4abc0d3ea0 msgr2=0x7f4abc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:16.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 -- 172.21.15.81:0/253603854 shutdown_connections 2024-09-17T05:25:16.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.206+0000 7f4ac2924640 1 -- 172.21.15.81:0/253603854 wait complete. 2024-09-17T05:25:16.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.207+0000 7f4ac2924640 1 Processor -- start 2024-09-17T05:25:16.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac2924640 1 -- start start 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac2924640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d0d40 0x7f4abc1f4300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac2924640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4abc0d49c0 0x7f4abc15ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac2924640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4abc15df90 0x7f4abc160510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac2924640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc0b3d40 con 0x7f4abc0d0d40 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac2924640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4abc162710 con 0x7f4abc0d49c0 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac2924640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4abc0b3ec0 con 0x7f4abc15df90 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4abbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d0d40 0x7f4abc1f4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4abbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d0d40 0x7f4abc1f4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54012/0 (socket says 172.21.15.81:54012) 2024-09-17T05:25:16.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4abbfff640 1 -- 172.21.15.81:0/2219522180 learned_addr learned my addr 172.21.15.81:0/2219522180 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4ac0ec1640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4abc15df90 0x7f4abc160510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.208+0000 7f4abb7fe640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4abc0d49c0 0x7f4abc15ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4abbfff640 1 -- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4abc15df90 msgr2=0x7f4abc160510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4abbfff640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4abc15df90 0x7f4abc160510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4abbfff640 1 -- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4abc0d49c0 msgr2=0x7f4abc15ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4abbfff640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4abc0d49c0 0x7f4abc15ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4abbfff640 1 -- 172.21.15.81:0/2219522180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4abc160bb0 con 0x7f4abc0d0d40 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4abbfff640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d0d40 0x7f4abc1f4300 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00c3c0 tx=0x7f4aac00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4ab8ff9640 1 -- 172.21.15.81:0/2219522180 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac017070 con 0x7f4abc0d0d40 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4ab8ff9640 1 -- 172.21.15.81:0/2219522180 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4aac0035f0 con 0x7f4abc0d0d40 2024-09-17T05:25:16.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4abc160e90 con 0x7f4abc0d0d40 2024-09-17T05:25:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4ab8ff9640 1 -- 172.21.15.81:0/2219522180 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aac003a40 con 0x7f4abc0d0d40 2024-09-17T05:25:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.209+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4abc14b750 con 0x7f4abc0d0d40 2024-09-17T05:25:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.210+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4abc0b4310 con 0x7f4abc0d0d40 2024-09-17T05:25:16.213 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.210+0000 7f4ab8ff9640 1 -- 172.21.15.81:0/2219522180 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f4aac01a070 con 0x7f4abc0d0d40 2024-09-17T05:25:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.211+0000 7f4ab8ff9640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4aa8079280 0x7f4aa807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.211+0000 7f4ab8ff9640 1 -- 172.21.15.81:0/2219522180 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5781+0+0 (secure 0 0 0) 0x7f4aac09ad30 con 0x7f4abc0d0d40 2024-09-17T05:25:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.211+0000 7f4abb7fe640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4aa8079280 0x7f4aa807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.214 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.211+0000 7f4abb7fe640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4aa8079280 0x7f4aa807b740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4abc15dac0 tx=0x7f4ab000a4c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:16.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.215+0000 7f4ab8ff9640 1 -- 172.21.15.81:0/2219522180 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4abc0ce970 con 0x7f4abc0d0d40 2024-09-17T05:25:16.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.391+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4abc0b6460 con 0x7f4abc0d0d40 2024-09-17T05:25:16.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.392+0000 7f4ab8ff9640 1 -- 172.21.15.81:0/2219522180 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v139) ==== 74+0+16856 (secure 0 0 0) 0x7f4aac062690 con 0x7f4abc0d0d40 2024-09-17T05:25:16.393 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:16.394 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":139,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:15.136692+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:13.741069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:14.089486+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4aa8079280 msgr2=0x7f4aa807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4aa8079280 0x7f4aa807b740 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4abc15dac0 tx=0x7f4ab000a4c0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d0d40 msgr2=0x7f4abc1f4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d0d40 0x7f4abc1f4300 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7f4aac00c3c0 tx=0x7f4aac00c880 comp rx=0 tx=0).stop 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 shutdown_connections 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4abc15df90 0x7f4abc160510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4aa8079280 0x7f4aa807b740 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4abc0d49c0 0x7f4abc15ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 --2- 172.21.15.81:0/2219522180 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4abc0d0d40 0x7f4abc1f4300 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.394+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 >> 172.21.15.81:0/2219522180 conn(0x7f4abc0d3ea0 msgr2=0x7f4abc0b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:16.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.395+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 shutdown_connections 2024-09-17T05:25:16.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.395+0000 7f4ac2924640 1 -- 172.21.15.81:0/2219522180 wait complete. 2024-09-17T05:25:16.407 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:25:16.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.510+0000 7f3e197c6640 1 -- 172.21.15.81:0/2712755401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e00003a50 msgr2=0x7f3e00003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.510+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2712755401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e00003a50 0x7f3e00003e70 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7f3e04001eb0 tx=0x7f3e00005830 comp rx=0 tx=0).stop 2024-09-17T05:25:16.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.510+0000 7f3e197c6640 1 -- 172.21.15.81:0/2712755401 shutdown_connections 2024-09-17T05:25:16.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.510+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2712755401 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e00003a50 0x7f3e00003e70 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.510+0000 7f3e197c6640 1 -- 172.21.15.81:0/2712755401 >> 172.21.15.81:0/2712755401 conn(0x7f3e1409d1c0 msgr2=0x7f3e140d3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:16.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.510+0000 7f3e197c6640 1 -- 172.21.15.81:0/2712755401 shutdown_connections 2024-09-17T05:25:16.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.510+0000 7f3e197c6640 1 -- 172.21.15.81:0/2712755401 wait complete. 2024-09-17T05:25:16.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.511+0000 7f3e197c6640 1 Processor -- start 2024-09-17T05:25:16.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.511+0000 7f3e197c6640 1 -- start start 2024-09-17T05:25:16.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e197c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e00003a50 0x7f3e1415e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e197c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e140b5cf0 0x7f3e140b97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e197c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e140b6cf0 0x7f3e140b7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e197c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e14161f40 con 0x7f3e140b5cf0 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e197c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3e141620c0 con 0x7f3e00003a50 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e197c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3e14162240 con 0x7f3e140b6cf0 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e140b5cf0 0x7f3e140b97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e140b5cf0 0x7f3e140b97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54026/0 (socket says 172.21.15.81:54026) 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 -- 172.21.15.81:0/2225524611 learned_addr learned my addr 172.21.15.81:0/2225524611 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e12ffd640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e00003a50 0x7f3e1415e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e137fe640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e140b6cf0 0x7f3e140b7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 -- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e140b6cf0 msgr2=0x7f3e140b7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e140b6cf0 0x7f3e140b7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 -- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e00003a50 msgr2=0x7f3e1415e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e00003a50 0x7f3e1415e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 -- 172.21.15.81:0/2225524611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e1415e920 con 0x7f3e140b5cf0 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e137fe640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e140b6cf0 0x7f3e140b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.512+0000 7f3e0bfff640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e140b5cf0 0x7f3e140b97b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc011780 tx=0x7f3dfc011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.513+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/2225524611 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc004460 con 0x7f3e140b5cf0 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.513+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/2225524611 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3dfc016070 con 0x7f3e140b5cf0 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.513+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e140b4970 con 0x7f3e140b5cf0 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.513+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/2225524611 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dfc00fba0 con 0x7f3e140b5cf0 2024-09-17T05:25:16.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.513+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e140b4f30 con 0x7f3e140b5cf0 2024-09-17T05:25:16.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.514+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e141627a0 con 0x7f3e140b5cf0 2024-09-17T05:25:16.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.514+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/2225524611 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f3dfc018030 con 0x7f3e140b5cf0 2024-09-17T05:25:16.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.515+0000 7f3e0b7fe640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3df4079250 0x7f3df407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.515+0000 7f3e12ffd640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3df4079250 0x7f3df407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.515+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/2225524611 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(139..139 src has 1..139) ==== 5781+0+0 (secure 0 0 0) 0x7f3dfc09c020 con 0x7f3e140b5cf0 2024-09-17T05:25:16.518 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.515+0000 7f3e12ffd640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3df4079250 0x7f3df407b710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e04033000 tx=0x7f3e04038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:16.520 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.519+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/2225524611 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3e1415e920 con 0x7f3e140b5cf0 2024-09-17T05:25:16.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.730+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f3e140cc7b0 con 0x7f3e140b5cf0 2024-09-17T05:25:16.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.784+0000 7f3e0b7fe640 1 -- 172.21.15.81:0/2225524611 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v83) ==== 118+0+0 (secure 0 0 0) 0x7f3dfc063b00 con 0x7f3e140b5cf0 2024-09-17T05:25:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3df4079250 msgr2=0x7f3df407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3df4079250 0x7f3df407b710 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f3e04033000 tx=0x7f3e04038040 comp rx=0 tx=0).stop 2024-09-17T05:25:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e140b5cf0 msgr2=0x7f3e140b97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e140b5cf0 0x7f3e140b97b0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7f3dfc011780 tx=0x7f3dfc011c40 comp rx=0 tx=0).stop 2024-09-17T05:25:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 shutdown_connections 2024-09-17T05:25:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e140b6cf0 0x7f3e140b7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e140b5cf0 0x7f3e140b97b0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3df4079250 0x7f3df407b710 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 --2- 172.21.15.81:0/2225524611 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e00003a50 0x7f3e1415e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 >> 172.21.15.81:0/2225524611 conn(0x7f3e1409d1c0 msgr2=0x7f3e140cb5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 shutdown_connections 2024-09-17T05:25:16.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.787+0000 7f3e197c6640 1 -- 172.21.15.81:0/2225524611 wait complete. 2024-09-17T05:25:16.799 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:25:16.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 -- 172.21.15.81:0/1753184800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99015adb0 msgr2=0x7fb9900ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 --2- 172.21.15.81:0/1753184800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99015adb0 0x7fb9900ccd20 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb98c005fd0 tx=0x7fb98c02aa90 comp rx=0 tx=0).stop 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 -- 172.21.15.81:0/1753184800 shutdown_connections 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 --2- 172.21.15.81:0/1753184800 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb9900cbed0 0x7fb9900b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 --2- 172.21.15.81:0/1753184800 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb99015adb0 0x7fb9900ccd20 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 -- 172.21.15.81:0/1753184800 >> 172.21.15.81:0/1753184800 conn(0x7fb990074160 msgr2=0x7fb990074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 -- 172.21.15.81:0/1753184800 shutdown_connections 2024-09-17T05:25:16.905 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.903+0000 7fb9986dd640 1 -- 172.21.15.81:0/1753184800 wait complete. 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 Processor -- start 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 -- start start 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9900cbed0 0x7fb9901f48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9900cd260 0x7fb9901f5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb99015adb0 0x7fb9900b3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb9900b0c50 con 0x7fb9900cd260 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb9900b0ad0 con 0x7fb9900cbed0 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb9986dd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb9900b0dd0 con 0x7fb99015adb0 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb995c78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9900cd260 0x7fb9901f5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb995c78640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9900cd260 0x7fb9901f5390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54042/0 (socket says 172.21.15.81:54042) 2024-09-17T05:25:16.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb995c78640 1 -- 172.21.15.81:0/2347114550 learned_addr learned my addr 172.21.15.81:0/2347114550 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb996479640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9900cbed0 0x7fb9901f48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.905+0000 7fb996c7a640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb99015adb0 0x7fb9900b3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb995c78640 1 -- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb99015adb0 msgr2=0x7fb9900b3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb995c78640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb99015adb0 0x7fb9900b3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb995c78640 1 -- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9900cbed0 msgr2=0x7fb9901f48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb995c78640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9900cbed0 0x7fb9901f48e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb995c78640 1 -- 172.21.15.81:0/2347114550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9900b39d0 con 0x7fb9900cd260 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb995c78640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9900cd260 0x7fb9901f5390 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb98000c420 tx=0x7fb98000c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb986ffd640 1 -- 172.21.15.81:0/2347114550 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9800052d0 con 0x7fb9900cd260 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb986ffd640 1 -- 172.21.15.81:0/2347114550 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb980007020 con 0x7fb9900cd260 2024-09-17T05:25:16.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9900b3cb0 con 0x7fb9900cd260 2024-09-17T05:25:16.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb986ffd640 1 -- 172.21.15.81:0/2347114550 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb980007470 con 0x7fb9900cd260 2024-09-17T05:25:16.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.906+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9900b4270 con 0x7fb9900cd260 2024-09-17T05:25:16.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.907+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb990069d50 con 0x7fb9900cd260 2024-09-17T05:25:16.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.908+0000 7fb986ffd640 1 -- 172.21.15.81:0/2347114550 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fb9800067d0 con 0x7fb9900cd260 2024-09-17T05:25:16.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.908+0000 7fb986ffd640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb974079280 0x7fb97407b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:16.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.908+0000 7fb986ffd640 1 -- 172.21.15.81:0/2347114550 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fb98009ae00 con 0x7fb9900cd260 2024-09-17T05:25:16.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.908+0000 7fb996479640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb974079280 0x7fb97407b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:16.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.909+0000 7fb996479640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb974079280 0x7fb97407b740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb98c035000 tx=0x7fb98c038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:16.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:16.913+0000 7fb986ffd640 1 -- 172.21.15.81:0/2347114550 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb980062190 con 0x7fb9900cd260 2024-09-17T05:25:17.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.127+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7fb9900b0360 con 0x7fb9900cd260 2024-09-17T05:25:17.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.786+0000 7fb986ffd640 1 -- 172.21.15.81:0/2347114550 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v84) ==== 122+0+0 (secure 0 0 0) 0x7fb980066bc0 con 0x7fb9900cd260 2024-09-17T05:25:17.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb974079280 msgr2=0x7fb97407b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb974079280 0x7fb97407b740 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fb98c035000 tx=0x7fb98c038040 comp rx=0 tx=0).stop 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9900cd260 msgr2=0x7fb9901f5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9900cd260 0x7fb9901f5390 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7fb98000c420 tx=0x7fb98000c820 comp rx=0 tx=0).stop 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 shutdown_connections 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb99015adb0 0x7fb9900b3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb9900cd260 0x7fb9901f5390 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb974079280 0x7fb97407b740 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 --2- 172.21.15.81:0/2347114550 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb9900cbed0 0x7fb9901f48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 >> 172.21.15.81:0/2347114550 conn(0x7fb990074160 msgr2=0x7fb99006fa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 shutdown_connections 2024-09-17T05:25:17.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.789+0000 7fb9986dd640 1 -- 172.21.15.81:0/2347114550 wait complete. 2024-09-17T05:25:17.802 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:25:17.802 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.905+0000 7ff701eef640 1 -- 172.21.15.81:0/1599866327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 msgr2=0x7ff6e8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.905+0000 7ff701eef640 1 --2- 172.21.15.81:0/1599866327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6e8004c80 secure :-1 s=READY pgs=1553 cs=0 l=1 rev1=1 crypto rx=0x7ff6e40016c0 tx=0x7ff6e8005830 comp rx=0 tx=0).stop 2024-09-17T05:25:17.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.905+0000 7ff701eef640 1 -- 172.21.15.81:0/1599866327 shutdown_connections 2024-09-17T05:25:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.905+0000 7ff701eef640 1 --2- 172.21.15.81:0/1599866327 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6e8004c80 unknown :-1 s=CLOSED pgs=1553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.905+0000 7ff701eef640 1 -- 172.21.15.81:0/1599866327 >> 172.21.15.81:0/1599866327 conn(0x7ff6fc0d3ea0 msgr2=0x7ff6fc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.905+0000 7ff701eef640 1 -- 172.21.15.81:0/1599866327 shutdown_connections 2024-09-17T05:25:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.905+0000 7ff701eef640 1 -- 172.21.15.81:0/1599866327 wait complete. 2024-09-17T05:25:17.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.906+0000 7ff701eef640 1 Processor -- start 2024-09-17T05:25:17.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.906+0000 7ff701eef640 1 -- start start 2024-09-17T05:25:17.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff701eef640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6fc14f860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff701eef640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6fc0b4850 0x7ff6fc1611c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff701eef640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6fc0ca350 0x7ff6fc0ca7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff701eef640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc0cf9b0 con 0x7ff6e8004800 2024-09-17T05:25:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff701eef640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff6fc1627a0 con 0x7ff6fc0b4850 2024-09-17T05:25:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff701eef640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff6fc0cfb30 con 0x7ff6fc0ca350 2024-09-17T05:25:17.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6fc14f860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6fc14f860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54074/0 (socket says 172.21.15.81:54074) 2024-09-17T05:25:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 -- 172.21.15.81:0/2874557350 learned_addr learned my addr 172.21.15.81:0/2874557350 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fbfff640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6fc0ca350 0x7ff6fc0ca7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6f2ffd640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6fc0b4850 0x7ff6fc1611c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 -- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6fc0ca350 msgr2=0x7ff6fc0ca7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:17.915 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6fc0ca350 0x7ff6fc0ca7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 -- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6fc0b4850 msgr2=0x7ff6fc1611c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6fc0b4850 0x7ff6fc1611c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:17.916 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 -- 172.21.15.81:0/2874557350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6fc0b4fc0 con 0x7ff6e8004800 2024-09-17T05:25:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.907+0000 7ff6fb7fe640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6fc14f860 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec011ae0 tx=0x7ff6ec009f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.908+0000 7ff6f8ff9640 1 -- 172.21.15.81:0/2874557350 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec00fcb0 con 0x7ff6e8004800 2024-09-17T05:25:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.908+0000 7ff6f8ff9640 1 -- 172.21.15.81:0/2874557350 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff6ec00fe50 con 0x7ff6e8004800 2024-09-17T05:25:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.908+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6fc0b52a0 con 0x7ff6e8004800 2024-09-17T05:25:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.908+0000 7ff6f8ff9640 1 -- 172.21.15.81:0/2874557350 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6ec004280 con 0x7ff6e8004800 2024-09-17T05:25:17.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.908+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6fc0b5860 con 0x7ff6e8004800 2024-09-17T05:25:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.909+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6fc0d07a0 con 0x7ff6e8004800 2024-09-17T05:25:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.909+0000 7ff6f8ff9640 1 -- 172.21.15.81:0/2874557350 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7ff6ec0035f0 con 0x7ff6e8004800 2024-09-17T05:25:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.910+0000 7ff6f8ff9640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff6dc079280 0x7ff6dc07b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.910+0000 7ff6f8ff9640 1 -- 172.21.15.81:0/2874557350 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7ff6ec09c5b0 con 0x7ff6e8004800 2024-09-17T05:25:17.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.910+0000 7ff6f2ffd640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff6dc079280 0x7ff6dc07b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.910+0000 7ff6f2ffd640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff6dc079280 0x7ff6dc07b740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4032000 tx=0x7ff6e4001190 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:17.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:17.914+0000 7ff6f8ff9640 1 -- 172.21.15.81:0/2874557350 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff6ec063f00 con 0x7ff6e8004800 2024-09-17T05:25:18.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.126+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff6fc0cacf0 con 0x7ff6e8004800 2024-09-17T05:25:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.127+0000 7ff6f8ff9640 1 -- 172.21.15.81:0/2874557350 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5230 (secure 0 0 0) 0x7ff6ec063800 con 0x7ff6e8004800 2024-09-17T05:25:18.128 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:18.128 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"btime":"2024-09-17T05:25:17:786037+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2171494728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2171494728},{"type":"v1","addr":"172.21.15.160:6835","nonce":2171494728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/428822375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":428822375},{"type":"v1","addr":"172.21.15.81:6834","nonce":428822375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4108203098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4108203098},{"type":"v1","addr":"172.21.15.81:6835","nonce":4108203098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:15.136657+0000","modified":"2024-09-17T05:25:17.128529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6801/2976390052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2976390052},{"type":"v1","addr":"172.21.15.160:6801","nonce":2976390052}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":11}]} 2024-09-17T05:25:18.128 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 84 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff6dc079280 msgr2=0x7ff6dc07b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff6dc079280 0x7ff6dc07b740 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7ff6e4032000 tx=0x7ff6e4001190 comp rx=0 tx=0).stop 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 msgr2=0x7ff6fc14f860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6fc14f860 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7ff6ec011ae0 tx=0x7ff6ec009f10 comp rx=0 tx=0).stop 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 shutdown_connections 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff6fc0ca350 0x7ff6fc0ca7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff6dc079280 0x7ff6dc07b740 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff6fc0b4850 0x7ff6fc1611c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 --2- 172.21.15.81:0/2874557350 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff6e8004800 0x7ff6fc14f860 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 >> 172.21.15.81:0/2874557350 conn(0x7ff6fc0d3ea0 msgr2=0x7ff6fc06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 shutdown_connections 2024-09-17T05:25:18.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.129+0000 7ff701eef640 1 -- 172.21.15.81:0/2874557350 wait complete. 2024-09-17T05:25:18.141 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:18.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1867301092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 msgr2=0x7f8ce40d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1867301092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40d0750 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f8ce40cfb40 tx=0x7f8cd402aa30 comp rx=0 tx=0).stop 2024-09-17T05:25:18.243 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1867301092 shutdown_connections 2024-09-17T05:25:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1867301092 >> v2:172.21.15.160:3300/0 conn(0x7f8ce40cfbb0 0x7f8ce40d0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1867301092 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ce415f510 0x7f8ce40d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1867301092 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40d0750 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1867301092 >> 172.21.15.81:0/1867301092 conn(0x7f8ce40d1b30 msgr2=0x7f8ce40d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1867301092 shutdown_connections 2024-09-17T05:25:18.244 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.242+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1867301092 wait complete. 2024-09-17T05:25:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.243+0000 7f8ce8f9f640 1 Processor -- start 2024-09-17T05:25:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.243+0000 7f8ce8f9f640 1 -- start start 2024-09-17T05:25:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce8f9f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ce40cfbb0 0x7f8ce415a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce8f9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce8f9f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ce415f510 0x7f8ce4070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce8f9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce40ce7f0 con 0x7f8ce415f130 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce8f9f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8ce40ce670 con 0x7f8ce40cfbb0 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce8f9f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8ce40ce970 con 0x7f8ce415f510 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54084/0 (socket says 172.21.15.81:54084) 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce2ffd640 1 -- 172.21.15.81:0/1598987857 learned_addr learned my addr 172.21.15.81:0/1598987857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce37fe640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ce40cfbb0 0x7f8ce415a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.244+0000 7f8ce3fff640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ce415f510 0x7f8ce4070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce2ffd640 1 -- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ce415f510 msgr2=0x7f8ce4070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce2ffd640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ce415f510 0x7f8ce4070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce2ffd640 1 -- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ce40cfbb0 msgr2=0x7f8ce415a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce2ffd640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ce40cfbb0 0x7f8ce415a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce2ffd640 1 -- 172.21.15.81:0/1598987857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ce41f28b0 con 0x7f8ce415f130 2024-09-17T05:25:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce3fff640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ce415f510 0x7f8ce4070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce2ffd640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40af390 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800d6d0 tx=0x7f8cd800db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ccbfff640 1 -- 172.21.15.81:0/1598987857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8017070 con 0x7f8ce415f130 2024-09-17T05:25:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ccbfff640 1 -- 172.21.15.81:0/1598987857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8cd8009b10 con 0x7f8ce415f130 2024-09-17T05:25:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ce40afde0 con 0x7f8ce415f130 2024-09-17T05:25:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ccbfff640 1 -- 172.21.15.81:0/1598987857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd8010460 con 0x7f8ce415f130 2024-09-17T05:25:18.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.245+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ce415af20 con 0x7f8ce415f130 2024-09-17T05:25:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.246+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ce41f26c0 con 0x7f8ce415f130 2024-09-17T05:25:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.247+0000 7f8ccbfff640 1 -- 172.21.15.81:0/1598987857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f8cd801a070 con 0x7f8ce415f130 2024-09-17T05:25:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.247+0000 7f8ccbfff640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8cd0079250 0x7f8cd007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.247+0000 7f8ccbfff640 1 -- 172.21.15.81:0/1598987857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f8cd809bce0 con 0x7f8ce415f130 2024-09-17T05:25:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.247+0000 7f8ce37fe640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8cd0079250 0x7f8cd007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.248+0000 7f8ce37fe640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8cd0079250 0x7f8cd007b710 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4035000 tx=0x7f8cd403a040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:18.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.251+0000 7f8ccbfff640 1 -- 172.21.15.81:0/1598987857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8cd8063070 con 0x7f8ce415f130 2024-09-17T05:25:18.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.428+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8ce40cee90 con 0x7f8ce415f130 2024-09-17T05:25:18.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.429+0000 7f8ccbfff640 1 -- 172.21.15.81:0/1598987857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16843 (secure 0 0 0) 0x7f8cd8067aa0 con 0x7f8ce415f130 2024-09-17T05:25:18.433 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:18.434 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":140,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:16.760240+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:13.741069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:14.089486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8cd0079250 msgr2=0x7f8cd007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8cd0079250 0x7f8cd007b710 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f8cd4035000 tx=0x7f8cd403a040 comp rx=0 tx=0).stop 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 msgr2=0x7f8ce40af390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40af390 secure :-1 s=READY pgs=1556 cs=0 l=1 rev1=1 crypto rx=0x7f8cd800d6d0 tx=0x7f8cd800db90 comp rx=0 tx=0).stop 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 shutdown_connections 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8ce415f510 0x7f8ce4070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8ce415f130 0x7f8ce40af390 unknown :-1 s=CLOSED pgs=1556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8cd0079250 0x7f8cd007b710 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 --2- 172.21.15.81:0/1598987857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8ce40cfbb0 0x7f8ce415a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.431+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 >> 172.21.15.81:0/1598987857 conn(0x7f8ce40d1b30 msgr2=0x7f8ce4070590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.432+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 shutdown_connections 2024-09-17T05:25:18.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.432+0000 7f8ce8f9f640 1 -- 172.21.15.81:0/1598987857 wait complete. 2024-09-17T05:25:18.444 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:25:18.444 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:25:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.544+0000 7f2d732f7640 1 -- 172.21.15.81:0/3160350931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15aa70 msgr2=0x7f2d6c0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 --2- 172.21.15.81:0/3160350931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15aa70 0x7f2d6c0b4690 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7f2d6c0cf960 tx=0x7f2d6802a560 comp rx=0 tx=0).stop 2024-09-17T05:25:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 -- 172.21.15.81:0/3160350931 shutdown_connections 2024-09-17T05:25:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 --2- 172.21.15.81:0/3160350931 >> v2:172.21.15.160:3300/0 conn(0x7f2d6c06ff80 0x7f2d6c070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 --2- 172.21.15.81:0/3160350931 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d6c0735a0 0x7f2d6c0739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 --2- 172.21.15.81:0/3160350931 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c15aa70 0x7f2d6c0b4690 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 -- 172.21.15.81:0/3160350931 >> 172.21.15.81:0/3160350931 conn(0x7f2d6c0b1690 msgr2=0x7f2d6c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 -- 172.21.15.81:0/3160350931 shutdown_connections 2024-09-17T05:25:18.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.545+0000 7f2d732f7640 1 -- 172.21.15.81:0/3160350931 wait complete. 2024-09-17T05:25:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.546+0000 7f2d732f7640 1 Processor -- start 2024-09-17T05:25:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.546+0000 7f2d732f7640 1 -- start start 2024-09-17T05:25:18.549 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d732f7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c06ff80 0x7f2d6c148b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d732f7640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d6c0735a0 0x7f2d6c1f1980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d732f7640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d6c15aa70 0x7f2d6c0cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d732f7640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0cd060 con 0x7f2d6c06ff80 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d732f7640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2d6c0ccee0 con 0x7f2d6c15aa70 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d732f7640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2d6c0cd1e0 con 0x7f2d6c0735a0 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c06ff80 0x7f2d6c148b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c06ff80 0x7f2d6c148b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54108/0 (socket says 172.21.15.81:54108) 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 -- 172.21.15.81:0/4056926708 learned_addr learned my addr 172.21.15.81:0/4056926708 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d70892640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d6c0735a0 0x7f2d6c1f1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71894640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d6c15aa70 0x7f2d6c0cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 -- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d6c0735a0 msgr2=0x7f2d6c1f1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.550 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d6c0735a0 0x7f2d6c1f1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 -- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d6c15aa70 msgr2=0x7f2d6c0cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d6c15aa70 0x7f2d6c0cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 -- 172.21.15.81:0/4056926708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d6c1f62b0 con 0x7f2d6c06ff80 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d70892640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d6c0735a0 0x7f2d6c1f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71894640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d6c15aa70 0x7f2d6c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d71093640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c06ff80 0x7f2d6c148b60 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f2d68034040 tx=0x7f2d68003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d61ffb640 1 -- 172.21.15.81:0/4056926708 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d6803e030 con 0x7f2d6c06ff80 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d61ffb640 1 -- 172.21.15.81:0/4056926708 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2d68003e00 con 0x7f2d6c06ff80 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d6c1f6590 con 0x7f2d6c06ff80 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.547+0000 7f2d61ffb640 1 -- 172.21.15.81:0/4056926708 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d68035040 con 0x7f2d6c06ff80 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.548+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d6c148360 con 0x7f2d6c06ff80 2024-09-17T05:25:18.551 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.548+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d6c0739a0 con 0x7f2d6c06ff80 2024-09-17T05:25:18.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.549+0000 7f2d61ffb640 1 -- 172.21.15.81:0/4056926708 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f2d68041030 con 0x7f2d6c06ff80 2024-09-17T05:25:18.552 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.549+0000 7f2d61ffb640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2d50079250 0x7f2d5007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.550+0000 7f2d61ffb640 1 -- 172.21.15.81:0/4056926708 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f2d680bc190 con 0x7f2d6c06ff80 2024-09-17T05:25:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.550+0000 7f2d70892640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2d50079250 0x7f2d5007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.553 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.550+0000 7f2d70892640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2d50079250 0x7f2d5007b710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005fd0 tx=0x7f2d5c0094d0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:18.554 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.554+0000 7f2d61ffb640 1 -- 172.21.15.81:0/4056926708 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2d68083af0 con 0x7f2d6c06ff80 2024-09-17T05:25:18.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.725+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2d6c070590 con 0x7f2d50079250 2024-09-17T05:25:18.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.729+0000 7f2d61ffb640 1 -- 172.21.15.81:0/4056926708 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247114 (secure 0 0 0) 0x7f2d6c070590 con 0x7f2d50079250 2024-09-17T05:25:18.733 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:18.735 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2d50079250 msgr2=0x7f2d5007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2d50079250 0x7f2d5007b710 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f2d5c005fd0 tx=0x7f2d5c0094d0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c06ff80 msgr2=0x7f2d6c148b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c06ff80 0x7f2d6c148b60 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7f2d68034040 tx=0x7f2d68003910 comp rx=0 tx=0).stop 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 shutdown_connections 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2d50079250 0x7f2d5007b710 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2d6c15aa70 0x7f2d6c0cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2d6c0735a0 0x7f2d6c1f1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 --2- 172.21.15.81:0/4056926708 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2d6c06ff80 0x7f2d6c148b60 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 >> 172.21.15.81:0/4056926708 conn(0x7f2d6c0b1690 msgr2=0x7f2d6c155be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 shutdown_connections 2024-09-17T05:25:18.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.732+0000 7f2d732f7640 1 -- 172.21.15.81:0/4056926708 wait complete. 2024-09-17T05:25:18.744 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-17T05:25:18.052665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264168,"kb_used_data":14604,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710552,"statfs":{"total":773094113280,"available":772823605248,"internally_reserved":0,"allocated":14954496,"data_stored":7228785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.279063"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.789798+0000","last_change":"2024-09-17T05:25:14.789798+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.789798+0000","last_undegraded":"2024-09-17T05:25:14.789798+0000","last_fullsized":"2024-09-17T05:25:14.789798+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787155+0000","last_change":"2024-09-17T05:25:14.787155+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787155+0000","last_undegraded":"2024-09-17T05:25:14.787155+0000","last_fullsized":"2024-09-17T05:25:14.787155+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786712+0000","last_change":"2024-09-17T05:25:14.786712+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786712+0000","last_undegraded":"2024-09-17T05:25:14.786712+0000","last_fullsized":"2024-09-17T05:25:14.786712+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785289+0000","last_change":"2024-09-17T05:25:14.785289+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785289+0000","last_undegraded":"2024-09-17T05:25:14.785289+0000","last_fullsized":"2024-09-17T05:25:14.785289+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787383+0000","last_change":"2024-09-17T05:25:14.787383+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787383+0000","last_undegraded":"2024-09-17T05:25:14.787383+0000","last_fullsized":"2024-09-17T05:25:14.787383+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784597+0000","last_change":"2024-09-17T05:25:14.784597+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784597+0000","last_undegraded":"2024-09-17T05:25:14.784597+0000","last_fullsized":"2024-09-17T05:25:14.784597+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.788310+0000","last_change":"2024-09-17T05:25:14.788310+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.788310+0000","last_undegraded":"2024-09-17T05:25:14.788310+0000","last_fullsized":"2024-09-17T05:25:14.788310+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785064+0000","last_change":"2024-09-17T05:25:14.785064+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785064+0000","last_undegraded":"2024-09-17T05:25:14.785064+0000","last_fullsized":"2024-09-17T05:25:14.785064+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786990+0000","last_change":"2024-09-17T05:25:14.786990+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786990+0000","last_undegraded":"2024-09-17T05:25:14.786990+0000","last_fullsized":"2024-09-17T05:25:14.786990+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784493+0000","last_change":"2024-09-17T05:25:14.784493+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784493+0000","last_undegraded":"2024-09-17T05:25:14.784493+0000","last_fullsized":"2024-09-17T05:25:14.784493+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.789107+0000","last_change":"2024-09-17T05:25:14.789107+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.789107+0000","last_undegraded":"2024-09-17T05:25:14.789107+0000","last_fullsized":"2024-09-17T05:25:14.789107+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787653+0000","last_change":"2024-09-17T05:25:14.787653+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787653+0000","last_undegraded":"2024-09-17T05:25:14.787653+0000","last_fullsized":"2024-09-17T05:25:14.787653+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784806+0000","last_change":"2024-09-17T05:25:14.784806+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784806+0000","last_undegraded":"2024-09-17T05:25:14.784806+0000","last_fullsized":"2024-09-17T05:25:14.784806+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785755+0000","last_change":"2024-09-17T05:25:14.785755+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785755+0000","last_undegraded":"2024-09-17T05:25:14.785755+0000","last_fullsized":"2024-09-17T05:25:14.785755+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.788503+0000","last_change":"2024-09-17T05:25:14.788503+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.788503+0000","last_undegraded":"2024-09-17T05:25:14.788503+0000","last_fullsized":"2024-09-17T05:25:14.788503+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787455+0000","last_change":"2024-09-17T05:25:14.787455+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787455+0000","last_undegraded":"2024-09-17T05:25:14.787455+0000","last_fullsized":"2024-09-17T05:25:14.787455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783802+0000","last_change":"2024-09-17T05:25:14.783802+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783802+0000","last_undegraded":"2024-09-17T05:25:14.783802+0000","last_fullsized":"2024-09-17T05:25:14.783802+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787359+0000","last_change":"2024-09-17T05:25:14.787359+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787359+0000","last_undegraded":"2024-09-17T05:25:14.787359+0000","last_fullsized":"2024-09-17T05:25:14.787359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783749+0000","last_change":"2024-09-17T05:25:14.783749+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783749+0000","last_undegraded":"2024-09-17T05:25:14.783749+0000","last_fullsized":"2024-09-17T05:25:14.783749+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783705+0000","last_change":"2024-09-17T05:25:14.783705+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783705+0000","last_undegraded":"2024-09-17T05:25:14.783705+0000","last_fullsized":"2024-09-17T05:25:14.783705+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784281+0000","last_change":"2024-09-17T05:25:14.784281+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784281+0000","last_undegraded":"2024-09-17T05:25:14.784281+0000","last_fullsized":"2024-09-17T05:25:14.784281+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784726+0000","last_change":"2024-09-17T05:25:14.784726+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784726+0000","last_undegraded":"2024-09-17T05:25:14.784726+0000","last_fullsized":"2024-09-17T05:25:14.784726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784154+0000","last_change":"2024-09-17T05:25:14.784154+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784154+0000","last_undegraded":"2024-09-17T05:25:14.784154+0000","last_fullsized":"2024-09-17T05:25:14.784154+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784291+0000","last_change":"2024-09-17T05:25:14.784291+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784291+0000","last_undegraded":"2024-09-17T05:25:14.784291+0000","last_fullsized":"2024-09-17T05:25:14.784291+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785930+0000","last_change":"2024-09-17T05:25:14.785930+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785930+0000","last_undegraded":"2024-09-17T05:25:14.785930+0000","last_fullsized":"2024-09-17T05:25:14.785930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787157+0000","last_change":"2024-09-17T05:25:14.787157+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787157+0000","last_undegraded":"2024-09-17T05:25:14.787157+0000","last_fullsized":"2024-09-17T05:25:14.787157+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786160+0000","last_change":"2024-09-17T05:25:14.786160+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786160+0000","last_undegraded":"2024-09-17T05:25:14.786160+0000","last_fullsized":"2024-09-17T05:25:14.786160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784796+0000","last_change":"2024-09-17T05:25:14.784796+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784796+0000","last_undegraded":"2024-09-17T05:25:14.784796+0000","last_fullsized":"2024-09-17T05:25:14.784796+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784361+0000","last_change":"2024-09-17T05:25:14.784361+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784361+0000","last_undegraded":"2024-09-17T05:25:14.784361+0000","last_fullsized":"2024-09-17T05:25:14.784361+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783316+0000","last_change":"2024-09-17T05:25:14.783316+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783316+0000","last_undegraded":"2024-09-17T05:25:14.783316+0000","last_fullsized":"2024-09-17T05:25:14.783316+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783417+0000","last_change":"2024-09-17T05:25:14.783417+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783417+0000","last_undegraded":"2024-09-17T05:25:14.783417+0000","last_fullsized":"2024-09-17T05:25:14.783417+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786901+0000","last_change":"2024-09-17T05:25:14.786901+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786901+0000","last_undegraded":"2024-09-17T05:25:14.786901+0000","last_fullsized":"2024-09-17T05:25:14.786901+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786688+0000","last_change":"2024-09-17T05:25:14.786688+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786688+0000","last_undegraded":"2024-09-17T05:25:14.786688+0000","last_fullsized":"2024-09-17T05:25:14.786688+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798292+0000","last_change":"2024-09-17T05:25:14.796665+0000","last_active":"2024-09-17T05:25:14.798292+0000","last_peered":"2024-09-17T05:25:14.798292+0000","last_clean":"2024-09-17T05:25:14.798292+0000","last_became_active":"2024-09-17T05:25:14.796385+0000","last_became_peered":"2024-09-17T05:25:14.796385+0000","last_unstale":"2024-09-17T05:25:14.798292+0000","last_undegraded":"2024-09-17T05:25:14.798292+0000","last_fullsized":"2024-09-17T05:25:14.798292+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:58.490830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784475+0000","last_change":"2024-09-17T05:25:14.784475+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784475+0000","last_undegraded":"2024-09-17T05:25:14.784475+0000","last_fullsized":"2024-09-17T05:25:14.784475+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795615+0000","last_change":"2024-09-17T05:25:14.794435+0000","last_active":"2024-09-17T05:25:14.795615+0000","last_peered":"2024-09-17T05:25:14.795615+0000","last_clean":"2024-09-17T05:25:14.795615+0000","last_became_active":"2024-09-17T05:25:14.794186+0000","last_became_peered":"2024-09-17T05:25:14.794186+0000","last_unstale":"2024-09-17T05:25:14.795615+0000","last_undegraded":"2024-09-17T05:25:14.795615+0000","last_fullsized":"2024-09-17T05:25:14.795615+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:46.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783103+0000","last_change":"2024-09-17T05:25:14.783103+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783103+0000","last_undegraded":"2024-09-17T05:25:14.783103+0000","last_fullsized":"2024-09-17T05:25:14.783103+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797977+0000","last_change":"2024-09-17T05:25:14.794639+0000","last_active":"2024-09-17T05:25:14.797977+0000","last_peered":"2024-09-17T05:25:14.797977+0000","last_clean":"2024-09-17T05:25:14.797977+0000","last_became_active":"2024-09-17T05:25:14.794396+0000","last_became_peered":"2024-09-17T05:25:14.794396+0000","last_unstale":"2024-09-17T05:25:14.797977+0000","last_undegraded":"2024-09-17T05:25:14.797977+0000","last_fullsized":"2024-09-17T05:25:14.797977+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:12.802682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785398+0000","last_change":"2024-09-17T05:25:14.785398+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785398+0000","last_undegraded":"2024-09-17T05:25:14.785398+0000","last_fullsized":"2024-09-17T05:25:14.785398+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797913+0000","last_change":"2024-09-17T05:25:14.793110+0000","last_active":"2024-09-17T05:25:14.797913+0000","last_peered":"2024-09-17T05:25:14.797913+0000","last_clean":"2024-09-17T05:25:14.797913+0000","last_became_active":"2024-09-17T05:25:14.792837+0000","last_became_peered":"2024-09-17T05:25:14.792837+0000","last_unstale":"2024-09-17T05:25:14.797913+0000","last_undegraded":"2024-09-17T05:25:14.797913+0000","last_fullsized":"2024-09-17T05:25:14.797913+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:07.496562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786489+0000","last_change":"2024-09-17T05:25:14.786489+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786489+0000","last_undegraded":"2024-09-17T05:25:14.786489+0000","last_fullsized":"2024-09-17T05:25:14.786489+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798677+0000","last_change":"2024-09-17T05:25:14.797188+0000","last_active":"2024-09-17T05:25:14.798677+0000","last_peered":"2024-09-17T05:25:14.798677+0000","last_clean":"2024-09-17T05:25:14.798677+0000","last_became_active":"2024-09-17T05:25:14.794128+0000","last_became_peered":"2024-09-17T05:25:14.794128+0000","last_unstale":"2024-09-17T05:25:14.798677+0000","last_undegraded":"2024-09-17T05:25:14.798677+0000","last_fullsized":"2024-09-17T05:25:14.798677+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:42.308969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.781301+0000","last_change":"2024-09-17T05:25:14.781301+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.781301+0000","last_undegraded":"2024-09-17T05:25:14.781301+0000","last_fullsized":"2024-09-17T05:25:14.781301+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.789566+0000","last_change":"2024-09-17T05:25:14.786746+0000","last_active":"2024-09-17T05:25:14.789566+0000","last_peered":"2024-09-17T05:25:14.789566+0000","last_clean":"2024-09-17T05:25:14.789566+0000","last_became_active":"2024-09-17T05:25:14.786464+0000","last_became_peered":"2024-09-17T05:25:14.786464+0000","last_unstale":"2024-09-17T05:25:14.789566+0000","last_undegraded":"2024-09-17T05:25:14.789566+0000","last_fullsized":"2024-09-17T05:25:14.789566+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:28.599025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.781667+0000","last_change":"2024-09-17T05:25:14.781667+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.781667+0000","last_undegraded":"2024-09-17T05:25:14.781667+0000","last_fullsized":"2024-09-17T05:25:14.781667+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801294+0000","last_change":"2024-09-17T05:25:14.796913+0000","last_active":"2024-09-17T05:25:14.801294+0000","last_peered":"2024-09-17T05:25:14.801294+0000","last_clean":"2024-09-17T05:25:14.801294+0000","last_became_active":"2024-09-17T05:25:14.796389+0000","last_became_peered":"2024-09-17T05:25:14.796389+0000","last_unstale":"2024-09-17T05:25:14.801294+0000","last_undegraded":"2024-09-17T05:25:14.801294+0000","last_fullsized":"2024-09-17T05:25:14.801294+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:23.877345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783726+0000","last_change":"2024-09-17T05:25:14.783726+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783726+0000","last_undegraded":"2024-09-17T05:25:14.783726+0000","last_fullsized":"2024-09-17T05:25:14.783726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797549+0000","last_change":"2024-09-17T05:25:14.793890+0000","last_active":"2024-09-17T05:25:14.797549+0000","last_peered":"2024-09-17T05:25:14.797549+0000","last_clean":"2024-09-17T05:25:14.797549+0000","last_became_active":"2024-09-17T05:25:14.793633+0000","last_became_peered":"2024-09-17T05:25:14.793633+0000","last_unstale":"2024-09-17T05:25:14.797549+0000","last_undegraded":"2024-09-17T05:25:14.797549+0000","last_fullsized":"2024-09-17T05:25:14.797549+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:52.405845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786430+0000","last_change":"2024-09-17T05:25:14.786430+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786430+0000","last_undegraded":"2024-09-17T05:25:14.786430+0000","last_fullsized":"2024-09-17T05:25:14.786430+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795474+0000","last_change":"2024-09-17T05:25:14.792239+0000","last_active":"2024-09-17T05:25:14.795474+0000","last_peered":"2024-09-17T05:25:14.795474+0000","last_clean":"2024-09-17T05:25:14.795474+0000","last_became_active":"2024-09-17T05:25:14.791912+0000","last_became_peered":"2024-09-17T05:25:14.791912+0000","last_unstale":"2024-09-17T05:25:14.795474+0000","last_undegraded":"2024-09-17T05:25:14.795474+0000","last_fullsized":"2024-09-17T05:25:14.795474+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:19.554012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785343+0000","last_change":"2024-09-17T05:25:14.785343+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785343+0000","last_undegraded":"2024-09-17T05:25:14.785343+0000","last_fullsized":"2024-09-17T05:25:14.785343+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797783+0000","last_change":"2024-09-17T05:25:14.793250+0000","last_active":"2024-09-17T05:25:14.797783+0000","last_peered":"2024-09-17T05:25:14.797783+0000","last_clean":"2024-09-17T05:25:14.797783+0000","last_became_active":"2024-09-17T05:25:14.792972+0000","last_became_peered":"2024-09-17T05:25:14.792972+0000","last_unstale":"2024-09-17T05:25:14.797783+0000","last_undegraded":"2024-09-17T05:25:14.797783+0000","last_fullsized":"2024-09-17T05:25:14.797783+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:07.962050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782704+0000","last_change":"2024-09-17T05:25:14.782704+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782704+0000","last_undegraded":"2024-09-17T05:25:14.782704+0000","last_fullsized":"2024-09-17T05:25:14.782704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803686+0000","last_change":"2024-09-17T05:25:14.796088+0000","last_active":"2024-09-17T05:25:14.803686+0000","last_peered":"2024-09-17T05:25:14.803686+0000","last_clean":"2024-09-17T05:25:14.803686+0000","last_became_active":"2024-09-17T05:25:14.795601+0000","last_became_peered":"2024-09-17T05:25:14.795601+0000","last_unstale":"2024-09-17T05:25:14.803686+0000","last_undegraded":"2024-09-17T05:25:14.803686+0000","last_fullsized":"2024-09-17T05:25:14.803686+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:15.489523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785777+0000","last_change":"2024-09-17T05:25:14.785777+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785777+0000","last_undegraded":"2024-09-17T05:25:14.785777+0000","last_fullsized":"2024-09-17T05:25:14.785777+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.790068+0000","last_change":"2024-09-17T05:25:14.789024+0000","last_active":"2024-09-17T05:25:14.790068+0000","last_peered":"2024-09-17T05:25:14.790068+0000","last_clean":"2024-09-17T05:25:14.790068+0000","last_became_active":"2024-09-17T05:25:14.788769+0000","last_became_peered":"2024-09-17T05:25:14.788769+0000","last_unstale":"2024-09-17T05:25:14.790068+0000","last_undegraded":"2024-09-17T05:25:14.790068+0000","last_fullsized":"2024-09-17T05:25:14.790068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:06.577007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786026+0000","last_change":"2024-09-17T05:25:14.786026+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786026+0000","last_undegraded":"2024-09-17T05:25:14.786026+0000","last_fullsized":"2024-09-17T05:25:14.786026+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797980+0000","last_change":"2024-09-17T05:25:14.794322+0000","last_active":"2024-09-17T05:25:14.797980+0000","last_peered":"2024-09-17T05:25:14.797980+0000","last_clean":"2024-09-17T05:25:14.797980+0000","last_became_active":"2024-09-17T05:25:14.793988+0000","last_became_peered":"2024-09-17T05:25:14.793988+0000","last_unstale":"2024-09-17T05:25:14.797980+0000","last_undegraded":"2024-09-17T05:25:14.797980+0000","last_fullsized":"2024-09-17T05:25:14.797980+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.043643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.780573+0000","last_change":"2024-09-17T05:25:14.780573+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.780573+0000","last_undegraded":"2024-09-17T05:25:14.780573+0000","last_fullsized":"2024-09-17T05:25:14.780573+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.800259+0000","last_change":"2024-09-17T05:25:14.795615+0000","last_active":"2024-09-17T05:25:14.800259+0000","last_peered":"2024-09-17T05:25:14.800259+0000","last_clean":"2024-09-17T05:25:14.800259+0000","last_became_active":"2024-09-17T05:25:14.795338+0000","last_became_peered":"2024-09-17T05:25:14.795338+0000","last_unstale":"2024-09-17T05:25:14.800259+0000","last_undegraded":"2024-09-17T05:25:14.800259+0000","last_fullsized":"2024-09-17T05:25:14.800259+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:22.855592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784817+0000","last_change":"2024-09-17T05:25:14.784817+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784817+0000","last_undegraded":"2024-09-17T05:25:14.784817+0000","last_fullsized":"2024-09-17T05:25:14.784817+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803743+0000","last_change":"2024-09-17T05:25:14.797300+0000","last_active":"2024-09-17T05:25:14.803743+0000","last_peered":"2024-09-17T05:25:14.803743+0000","last_clean":"2024-09-17T05:25:14.803743+0000","last_became_active":"2024-09-17T05:25:14.797009+0000","last_became_peered":"2024-09-17T05:25:14.797009+0000","last_unstale":"2024-09-17T05:25:14.803743+0000","last_undegraded":"2024-09-17T05:25:14.803743+0000","last_fullsized":"2024-09-17T05:25:14.803743+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:48.545193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.780926+0000","last_change":"2024-09-17T05:25:14.780926+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.780926+0000","last_undegraded":"2024-09-17T05:25:14.780926+0000","last_fullsized":"2024-09-17T05:25:14.780926+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798880+0000","last_change":"2024-09-17T05:25:14.795978+0000","last_active":"2024-09-17T05:25:14.798880+0000","last_peered":"2024-09-17T05:25:14.798880+0000","last_clean":"2024-09-17T05:25:14.798880+0000","last_became_active":"2024-09-17T05:25:14.795145+0000","last_became_peered":"2024-09-17T05:25:14.795145+0000","last_unstale":"2024-09-17T05:25:14.798880+0000","last_undegraded":"2024-09-17T05:25:14.798880+0000","last_fullsized":"2024-09-17T05:25:14.798880+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:04.132410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784898+0000","last_change":"2024-09-17T05:25:14.784898+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784898+0000","last_undegraded":"2024-09-17T05:25:14.784898+0000","last_fullsized":"2024-09-17T05:25:14.784898+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.800959+0000","last_change":"2024-09-17T05:25:14.798054+0000","last_active":"2024-09-17T05:25:14.800959+0000","last_peered":"2024-09-17T05:25:14.800959+0000","last_clean":"2024-09-17T05:25:14.800959+0000","last_became_active":"2024-09-17T05:25:14.797432+0000","last_became_peered":"2024-09-17T05:25:14.797432+0000","last_unstale":"2024-09-17T05:25:14.800959+0000","last_undegraded":"2024-09-17T05:25:14.800959+0000","last_fullsized":"2024-09-17T05:25:14.800959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:12.183730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782058+0000","last_change":"2024-09-17T05:25:14.782058+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782058+0000","last_undegraded":"2024-09-17T05:25:14.782058+0000","last_fullsized":"2024-09-17T05:25:14.782058+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.804074+0000","last_change":"2024-09-17T05:25:14.801709+0000","last_active":"2024-09-17T05:25:14.804074+0000","last_peered":"2024-09-17T05:25:14.804074+0000","last_clean":"2024-09-17T05:25:14.804074+0000","last_became_active":"2024-09-17T05:25:14.801400+0000","last_became_peered":"2024-09-17T05:25:14.801400+0000","last_unstale":"2024-09-17T05:25:14.804074+0000","last_undegraded":"2024-09-17T05:25:14.804074+0000","last_fullsized":"2024-09-17T05:25:14.804074+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:26.294285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785555+0000","last_change":"2024-09-17T05:25:14.785555+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785555+0000","last_undegraded":"2024-09-17T05:25:14.785555+0000","last_fullsized":"2024-09-17T05:25:14.785555+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801025+0000","last_change":"2024-09-17T05:25:14.797861+0000","last_active":"2024-09-17T05:25:14.801025+0000","last_peered":"2024-09-17T05:25:14.801025+0000","last_clean":"2024-09-17T05:25:14.801025+0000","last_became_active":"2024-09-17T05:25:14.797490+0000","last_became_peered":"2024-09-17T05:25:14.797490+0000","last_unstale":"2024-09-17T05:25:14.801025+0000","last_undegraded":"2024-09-17T05:25:14.801025+0000","last_fullsized":"2024-09-17T05:25:14.801025+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:23.396355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785302+0000","last_change":"2024-09-17T05:25:14.785302+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785302+0000","last_undegraded":"2024-09-17T05:25:14.785302+0000","last_fullsized":"2024-09-17T05:25:14.785302+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797764+0000","last_change":"2024-09-17T05:25:14.793137+0000","last_active":"2024-09-17T05:25:14.797764+0000","last_peered":"2024-09-17T05:25:14.797764+0000","last_clean":"2024-09-17T05:25:14.797764+0000","last_became_active":"2024-09-17T05:25:14.792865+0000","last_became_peered":"2024-09-17T05:25:14.792865+0000","last_unstale":"2024-09-17T05:25:14.797764+0000","last_undegraded":"2024-09-17T05:25:14.797764+0000","last_fullsized":"2024-09-17T05:25:14.797764+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:14.245660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785052+0000","last_change":"2024-09-17T05:25:14.785052+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785052+0000","last_undegraded":"2024-09-17T05:25:14.785052+0000","last_fullsized":"2024-09-17T05:25:14.785052+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801232+0000","last_change":"2024-09-17T05:25:14.798585+0000","last_active":"2024-09-17T05:25:14.801232+0000","last_peered":"2024-09-17T05:25:14.801232+0000","last_clean":"2024-09-17T05:25:14.801232+0000","last_became_active":"2024-09-17T05:25:14.798315+0000","last_became_peered":"2024-09-17T05:25:14.798315+0000","last_unstale":"2024-09-17T05:25:14.801232+0000","last_undegraded":"2024-09-17T05:25:14.801232+0000","last_fullsized":"2024-09-17T05:25:14.801232+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:19.009536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.791159+0000","last_change":"2024-09-17T05:25:14.791159+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.791159+0000","last_undegraded":"2024-09-17T05:25:14.791159+0000","last_fullsized":"2024-09-17T05:25:14.791159+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.789281+0000","last_change":"2024-09-17T05:25:14.786737+0000","last_active":"2024-09-17T05:25:14.789281+0000","last_peered":"2024-09-17T05:25:14.789281+0000","last_clean":"2024-09-17T05:25:14.789281+0000","last_became_active":"2024-09-17T05:25:14.786430+0000","last_became_peered":"2024-09-17T05:25:14.786430+0000","last_unstale":"2024-09-17T05:25:14.789281+0000","last_undegraded":"2024-09-17T05:25:14.789281+0000","last_fullsized":"2024-09-17T05:25:14.789281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:30.752015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783271+0000","last_change":"2024-09-17T05:25:14.783271+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783271+0000","last_undegraded":"2024-09-17T05:25:14.783271+0000","last_fullsized":"2024-09-17T05:25:14.783271+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.806501+0000","last_change":"2024-09-17T05:25:14.804390+0000","last_active":"2024-09-17T05:25:14.806501+0000","last_peered":"2024-09-17T05:25:14.806501+0000","last_clean":"2024-09-17T05:25:14.806501+0000","last_became_active":"2024-09-17T05:25:14.804104+0000","last_became_peered":"2024-09-17T05:25:14.804104+0000","last_unstale":"2024-09-17T05:25:14.806501+0000","last_undegraded":"2024-09-17T05:25:14.806501+0000","last_fullsized":"2024-09-17T05:25:14.806501+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:43.762039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784455+0000","last_change":"2024-09-17T05:25:14.784455+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784455+0000","last_undegraded":"2024-09-17T05:25:14.784455+0000","last_fullsized":"2024-09-17T05:25:14.784455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797999+0000","last_change":"2024-09-17T05:25:14.795475+0000","last_active":"2024-09-17T05:25:14.797999+0000","last_peered":"2024-09-17T05:25:14.797999+0000","last_clean":"2024-09-17T05:25:14.797999+0000","last_became_active":"2024-09-17T05:25:14.795056+0000","last_became_peered":"2024-09-17T05:25:14.795056+0000","last_unstale":"2024-09-17T05:25:14.797999+0000","last_undegraded":"2024-09-17T05:25:14.797999+0000","last_fullsized":"2024-09-17T05:25:14.797999+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:34.520059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784762+0000","last_change":"2024-09-17T05:25:14.784762+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784762+0000","last_undegraded":"2024-09-17T05:25:14.784762+0000","last_fullsized":"2024-09-17T05:25:14.784762+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801430+0000","last_change":"2024-09-17T05:25:14.799199+0000","last_active":"2024-09-17T05:25:14.801430+0000","last_peered":"2024-09-17T05:25:14.801430+0000","last_clean":"2024-09-17T05:25:14.801430+0000","last_became_active":"2024-09-17T05:25:14.798912+0000","last_became_peered":"2024-09-17T05:25:14.798912+0000","last_unstale":"2024-09-17T05:25:14.801430+0000","last_undegraded":"2024-09-17T05:25:14.801430+0000","last_fullsized":"2024-09-17T05:25:14.801430+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:43.075420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782477+0000","last_change":"2024-09-17T05:25:14.782477+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782477+0000","last_undegraded":"2024-09-17T05:25:14.782477+0000","last_fullsized":"2024-09-17T05:25:14.782477+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803817+0000","last_change":"2024-09-17T05:25:14.799256+0000","last_active":"2024-09-17T05:25:14.803817+0000","last_peered":"2024-09-17T05:25:14.803817+0000","last_clean":"2024-09-17T05:25:14.803817+0000","last_became_active":"2024-09-17T05:25:14.798928+0000","last_became_peered":"2024-09-17T05:25:14.798928+0000","last_unstale":"2024-09-17T05:25:14.803817+0000","last_undegraded":"2024-09-17T05:25:14.803817+0000","last_fullsized":"2024-09-17T05:25:14.803817+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:15.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783219+0000","last_change":"2024-09-17T05:25:14.783219+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783219+0000","last_undegraded":"2024-09-17T05:25:14.783219+0000","last_fullsized":"2024-09-17T05:25:14.783219+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795029+0000","last_change":"2024-09-17T05:25:14.792783+0000","last_active":"2024-09-17T05:25:14.795029+0000","last_peered":"2024-09-17T05:25:14.795029+0000","last_clean":"2024-09-17T05:25:14.795029+0000","last_became_active":"2024-09-17T05:25:14.792499+0000","last_became_peered":"2024-09-17T05:25:14.792499+0000","last_unstale":"2024-09-17T05:25:14.795029+0000","last_undegraded":"2024-09-17T05:25:14.795029+0000","last_fullsized":"2024-09-17T05:25:14.795029+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.986046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783896+0000","last_change":"2024-09-17T05:25:14.783896+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783896+0000","last_undegraded":"2024-09-17T05:25:14.783896+0000","last_fullsized":"2024-09-17T05:25:14.783896+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803679+0000","last_change":"2024-09-17T05:25:14.795833+0000","last_active":"2024-09-17T05:25:14.803679+0000","last_peered":"2024-09-17T05:25:14.803679+0000","last_clean":"2024-09-17T05:25:14.803679+0000","last_became_active":"2024-09-17T05:25:14.795529+0000","last_became_peered":"2024-09-17T05:25:14.795529+0000","last_unstale":"2024-09-17T05:25:14.803679+0000","last_undegraded":"2024-09-17T05:25:14.803679+0000","last_fullsized":"2024-09-17T05:25:14.803679+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:52.856520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785961+0000","last_change":"2024-09-17T05:25:14.785961+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785961+0000","last_undegraded":"2024-09-17T05:25:14.785961+0000","last_fullsized":"2024-09-17T05:25:14.785961+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797664+0000","last_change":"2024-09-17T05:25:14.790605+0000","last_active":"2024-09-17T05:25:14.797664+0000","last_peered":"2024-09-17T05:25:14.797664+0000","last_clean":"2024-09-17T05:25:14.797664+0000","last_became_active":"2024-09-17T05:25:14.790285+0000","last_became_peered":"2024-09-17T05:25:14.790285+0000","last_unstale":"2024-09-17T05:25:14.797664+0000","last_undegraded":"2024-09-17T05:25:14.797664+0000","last_fullsized":"2024-09-17T05:25:14.797664+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:38.509048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784285+0000","last_change":"2024-09-17T05:25:14.784285+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784285+0000","last_undegraded":"2024-09-17T05:25:14.784285+0000","last_fullsized":"2024-09-17T05:25:14.784285+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803766+0000","last_change":"2024-09-17T05:25:14.799017+0000","last_active":"2024-09-17T05:25:14.803766+0000","last_peered":"2024-09-17T05:25:14.803766+0000","last_clean":"2024-09-17T05:25:14.803766+0000","last_became_active":"2024-09-17T05:25:14.798741+0000","last_became_peered":"2024-09-17T05:25:14.798741+0000","last_unstale":"2024-09-17T05:25:14.803766+0000","last_undegraded":"2024-09-17T05:25:14.803766+0000","last_fullsized":"2024-09-17T05:25:14.803766+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:10.566412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784380+0000","last_change":"2024-09-17T05:25:14.784380+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784380+0000","last_undegraded":"2024-09-17T05:25:14.784380+0000","last_fullsized":"2024-09-17T05:25:14.784380+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.791849+0000","last_change":"2024-09-17T05:25:14.788995+0000","last_active":"2024-09-17T05:25:14.791849+0000","last_peered":"2024-09-17T05:25:14.791849+0000","last_clean":"2024-09-17T05:25:14.791849+0000","last_became_active":"2024-09-17T05:25:14.788708+0000","last_became_peered":"2024-09-17T05:25:14.788708+0000","last_unstale":"2024-09-17T05:25:14.791849+0000","last_undegraded":"2024-09-17T05:25:14.791849+0000","last_fullsized":"2024-09-17T05:25:14.791849+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:50.260359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785828+0000","last_change":"2024-09-17T05:25:14.785828+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785828+0000","last_undegraded":"2024-09-17T05:25:14.785828+0000","last_fullsized":"2024-09-17T05:25:14.785828+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795740+0000","last_change":"2024-09-17T05:25:14.793360+0000","last_active":"2024-09-17T05:25:14.795740+0000","last_peered":"2024-09-17T05:25:14.795740+0000","last_clean":"2024-09-17T05:25:14.795740+0000","last_became_active":"2024-09-17T05:25:14.793062+0000","last_became_peered":"2024-09-17T05:25:14.793062+0000","last_unstale":"2024-09-17T05:25:14.795740+0000","last_undegraded":"2024-09-17T05:25:14.795740+0000","last_fullsized":"2024-09-17T05:25:14.795740+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:03.046454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":346,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.791836+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:25:14.791836+0000","last_peered":"2024-09-17T05:25:14.791836+0000","last_clean":"2024-09-17T05:25:14.791836+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:25:14.791836+0000","last_undegraded":"2024-09-17T05:25:14.791836+0000","last_fullsized":"2024-09-17T05:25:14.791836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33444,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338396,"statfs":{"total":96636764160,"available":96602517504,"internally_reserved":0,"allocated":2310144,"data_stored":1343994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1728512,"data_stored":759973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509523,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1728512,"data_stored":759973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2322432,"data_stored":1350341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:25:18.748 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:25:18.757 INFO:tasks.ceph.mds.b.smithi160.stderr:2024-09-17T05:25:18.757+0000 7fd74552f640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:25:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.883+0000 7f135d100640 1 -- 172.21.15.81:0/2272496809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1344003a50 msgr2=0x7f1344003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.883+0000 7f135d100640 1 --2- 172.21.15.81:0/2272496809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1344003a50 0x7f1344003e70 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f135815e540 tx=0x7f1344005830 comp rx=0 tx=0).stop 2024-09-17T05:25:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.884+0000 7f135d100640 1 -- 172.21.15.81:0/2272496809 shutdown_connections 2024-09-17T05:25:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.884+0000 7f135d100640 1 --2- 172.21.15.81:0/2272496809 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1344003a50 0x7f1344003e70 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.884+0000 7f135d100640 1 -- 172.21.15.81:0/2272496809 >> 172.21.15.81:0/2272496809 conn(0x7f13580d3ea0 msgr2=0x7f13580d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.884+0000 7f135d100640 1 -- 172.21.15.81:0/2272496809 shutdown_connections 2024-09-17T05:25:18.885 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.884+0000 7f135d100640 1 -- 172.21.15.81:0/2272496809 wait complete. 2024-09-17T05:25:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.885+0000 7f135d100640 1 Processor -- start 2024-09-17T05:25:18.886 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.885+0000 7f135d100640 1 -- start start 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135d100640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1344003a50 0x7f13580cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135d100640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135815a040 0x7f135814d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135d100640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135814d780 0x7f135815e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135d100640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f13580cf9b0 con 0x7f135815a040 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135d100640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f13581627a0 con 0x7f135814d780 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135d100640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f13580cfb30 con 0x7f1344003a50 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135815a040 0x7f135814d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.888 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135815a040 0x7f135814d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54124/0 (socket says 172.21.15.81:54124) 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 -- 172.21.15.81:0/86799659 learned_addr learned my addr 172.21.15.81:0/86799659 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135759e640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135814d780 0x7f135815e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 -- 172.21.15.81:0/86799659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1344003a50 msgr2=0x7f13580cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1344003a50 0x7f13580cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 -- 172.21.15.81:0/86799659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135814d780 msgr2=0x7f135815e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135814d780 0x7f135815e540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 -- 172.21.15.81:0/86799659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f135814dcc0 con 0x7f135815a040 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f135659c640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135815a040 0x7f135814d240 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f134000f7d0 tx=0x7f134000fc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.886+0000 7f134f7fe640 1 -- 172.21.15.81:0/86799659 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f134000bcb0 con 0x7f135815a040 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.887+0000 7f134f7fe640 1 -- 172.21.15.81:0/86799659 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1340011440 con 0x7f135815a040 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.887+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f135814dfa0 con 0x7f135815a040 2024-09-17T05:25:18.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.887+0000 7f134f7fe640 1 -- 172.21.15.81:0/86799659 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1340011890 con 0x7f135815a040 2024-09-17T05:25:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.887+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f135815a4c0 con 0x7f135815a040 2024-09-17T05:25:18.890 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.888+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13580d07a0 con 0x7f135815a040 2024-09-17T05:25:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.888+0000 7f134f7fe640 1 -- 172.21.15.81:0/86799659 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f1340019020 con 0x7f135815a040 2024-09-17T05:25:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.889+0000 7f134f7fe640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1338079250 0x7f133807b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.889+0000 7f1356d9d640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1338079250 0x7f133807b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.889+0000 7f134f7fe640 1 -- 172.21.15.81:0/86799659 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f134009c2d0 con 0x7f135815a040 2024-09-17T05:25:18.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.889+0000 7f1356d9d640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1338079250 0x7f133807b710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1348032000 tx=0x7f13480014e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:18.894 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:18.893+0000 7f134f7fe640 1 -- 172.21.15.81:0/86799659 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1340063c20 con 0x7f135815a040 2024-09-17T05:25:19.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.066+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f135808d590 con 0x7f1338079250 2024-09-17T05:25:19.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.070+0000 7f134f7fe640 1 -- 172.21.15.81:0/86799659 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247114 (secure 0 0 0) 0x7f134807e560 con 0x7f1338079250 2024-09-17T05:25:19.076 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:19.077 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1338079250 msgr2=0x7f133807b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1338079250 0x7f133807b710 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f1348032000 tx=0x7f13480014e0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135815a040 msgr2=0x7f135814d240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135815a040 0x7f135814d240 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f134000f7d0 tx=0x7f134000fc90 comp rx=0 tx=0).stop 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 shutdown_connections 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1338079250 0x7f133807b710 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f135814d780 0x7f135815e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f135815a040 0x7f135814d240 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 --2- 172.21.15.81:0/86799659 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1344003a50 0x7f13580cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.079 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 >> 172.21.15.81:0/86799659 conn(0x7f13580d3ea0 msgr2=0x7f13580b23c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 shutdown_connections 2024-09-17T05:25:19.080 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.073+0000 7f135d100640 1 -- 172.21.15.81:0/86799659 wait complete. 2024-09-17T05:25:19.085 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-17T05:25:18.052665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264168,"kb_used_data":14604,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710552,"statfs":{"total":773094113280,"available":772823605248,"internally_reserved":0,"allocated":14954496,"data_stored":7228785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.279063"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.789798+0000","last_change":"2024-09-17T05:25:14.789798+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.789798+0000","last_undegraded":"2024-09-17T05:25:14.789798+0000","last_fullsized":"2024-09-17T05:25:14.789798+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787155+0000","last_change":"2024-09-17T05:25:14.787155+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787155+0000","last_undegraded":"2024-09-17T05:25:14.787155+0000","last_fullsized":"2024-09-17T05:25:14.787155+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786712+0000","last_change":"2024-09-17T05:25:14.786712+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786712+0000","last_undegraded":"2024-09-17T05:25:14.786712+0000","last_fullsized":"2024-09-17T05:25:14.786712+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785289+0000","last_change":"2024-09-17T05:25:14.785289+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785289+0000","last_undegraded":"2024-09-17T05:25:14.785289+0000","last_fullsized":"2024-09-17T05:25:14.785289+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787383+0000","last_change":"2024-09-17T05:25:14.787383+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787383+0000","last_undegraded":"2024-09-17T05:25:14.787383+0000","last_fullsized":"2024-09-17T05:25:14.787383+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784597+0000","last_change":"2024-09-17T05:25:14.784597+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784597+0000","last_undegraded":"2024-09-17T05:25:14.784597+0000","last_fullsized":"2024-09-17T05:25:14.784597+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.788310+0000","last_change":"2024-09-17T05:25:14.788310+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.788310+0000","last_undegraded":"2024-09-17T05:25:14.788310+0000","last_fullsized":"2024-09-17T05:25:14.788310+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785064+0000","last_change":"2024-09-17T05:25:14.785064+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785064+0000","last_undegraded":"2024-09-17T05:25:14.785064+0000","last_fullsized":"2024-09-17T05:25:14.785064+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786990+0000","last_change":"2024-09-17T05:25:14.786990+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786990+0000","last_undegraded":"2024-09-17T05:25:14.786990+0000","last_fullsized":"2024-09-17T05:25:14.786990+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784493+0000","last_change":"2024-09-17T05:25:14.784493+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784493+0000","last_undegraded":"2024-09-17T05:25:14.784493+0000","last_fullsized":"2024-09-17T05:25:14.784493+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.789107+0000","last_change":"2024-09-17T05:25:14.789107+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.789107+0000","last_undegraded":"2024-09-17T05:25:14.789107+0000","last_fullsized":"2024-09-17T05:25:14.789107+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787653+0000","last_change":"2024-09-17T05:25:14.787653+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787653+0000","last_undegraded":"2024-09-17T05:25:14.787653+0000","last_fullsized":"2024-09-17T05:25:14.787653+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784806+0000","last_change":"2024-09-17T05:25:14.784806+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784806+0000","last_undegraded":"2024-09-17T05:25:14.784806+0000","last_fullsized":"2024-09-17T05:25:14.784806+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785755+0000","last_change":"2024-09-17T05:25:14.785755+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785755+0000","last_undegraded":"2024-09-17T05:25:14.785755+0000","last_fullsized":"2024-09-17T05:25:14.785755+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.788503+0000","last_change":"2024-09-17T05:25:14.788503+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.788503+0000","last_undegraded":"2024-09-17T05:25:14.788503+0000","last_fullsized":"2024-09-17T05:25:14.788503+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787455+0000","last_change":"2024-09-17T05:25:14.787455+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787455+0000","last_undegraded":"2024-09-17T05:25:14.787455+0000","last_fullsized":"2024-09-17T05:25:14.787455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783802+0000","last_change":"2024-09-17T05:25:14.783802+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783802+0000","last_undegraded":"2024-09-17T05:25:14.783802+0000","last_fullsized":"2024-09-17T05:25:14.783802+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787359+0000","last_change":"2024-09-17T05:25:14.787359+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787359+0000","last_undegraded":"2024-09-17T05:25:14.787359+0000","last_fullsized":"2024-09-17T05:25:14.787359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783749+0000","last_change":"2024-09-17T05:25:14.783749+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783749+0000","last_undegraded":"2024-09-17T05:25:14.783749+0000","last_fullsized":"2024-09-17T05:25:14.783749+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783705+0000","last_change":"2024-09-17T05:25:14.783705+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783705+0000","last_undegraded":"2024-09-17T05:25:14.783705+0000","last_fullsized":"2024-09-17T05:25:14.783705+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784281+0000","last_change":"2024-09-17T05:25:14.784281+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784281+0000","last_undegraded":"2024-09-17T05:25:14.784281+0000","last_fullsized":"2024-09-17T05:25:14.784281+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784726+0000","last_change":"2024-09-17T05:25:14.784726+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784726+0000","last_undegraded":"2024-09-17T05:25:14.784726+0000","last_fullsized":"2024-09-17T05:25:14.784726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784154+0000","last_change":"2024-09-17T05:25:14.784154+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784154+0000","last_undegraded":"2024-09-17T05:25:14.784154+0000","last_fullsized":"2024-09-17T05:25:14.784154+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784291+0000","last_change":"2024-09-17T05:25:14.784291+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784291+0000","last_undegraded":"2024-09-17T05:25:14.784291+0000","last_fullsized":"2024-09-17T05:25:14.784291+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785930+0000","last_change":"2024-09-17T05:25:14.785930+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785930+0000","last_undegraded":"2024-09-17T05:25:14.785930+0000","last_fullsized":"2024-09-17T05:25:14.785930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787157+0000","last_change":"2024-09-17T05:25:14.787157+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787157+0000","last_undegraded":"2024-09-17T05:25:14.787157+0000","last_fullsized":"2024-09-17T05:25:14.787157+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786160+0000","last_change":"2024-09-17T05:25:14.786160+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786160+0000","last_undegraded":"2024-09-17T05:25:14.786160+0000","last_fullsized":"2024-09-17T05:25:14.786160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784796+0000","last_change":"2024-09-17T05:25:14.784796+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784796+0000","last_undegraded":"2024-09-17T05:25:14.784796+0000","last_fullsized":"2024-09-17T05:25:14.784796+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784361+0000","last_change":"2024-09-17T05:25:14.784361+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784361+0000","last_undegraded":"2024-09-17T05:25:14.784361+0000","last_fullsized":"2024-09-17T05:25:14.784361+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783316+0000","last_change":"2024-09-17T05:25:14.783316+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783316+0000","last_undegraded":"2024-09-17T05:25:14.783316+0000","last_fullsized":"2024-09-17T05:25:14.783316+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783417+0000","last_change":"2024-09-17T05:25:14.783417+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783417+0000","last_undegraded":"2024-09-17T05:25:14.783417+0000","last_fullsized":"2024-09-17T05:25:14.783417+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786901+0000","last_change":"2024-09-17T05:25:14.786901+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786901+0000","last_undegraded":"2024-09-17T05:25:14.786901+0000","last_fullsized":"2024-09-17T05:25:14.786901+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786688+0000","last_change":"2024-09-17T05:25:14.786688+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786688+0000","last_undegraded":"2024-09-17T05:25:14.786688+0000","last_fullsized":"2024-09-17T05:25:14.786688+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798292+0000","last_change":"2024-09-17T05:25:14.796665+0000","last_active":"2024-09-17T05:25:14.798292+0000","last_peered":"2024-09-17T05:25:14.798292+0000","last_clean":"2024-09-17T05:25:14.798292+0000","last_became_active":"2024-09-17T05:25:14.796385+0000","last_became_peered":"2024-09-17T05:25:14.796385+0000","last_unstale":"2024-09-17T05:25:14.798292+0000","last_undegraded":"2024-09-17T05:25:14.798292+0000","last_fullsized":"2024-09-17T05:25:14.798292+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:58.490830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784475+0000","last_change":"2024-09-17T05:25:14.784475+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784475+0000","last_undegraded":"2024-09-17T05:25:14.784475+0000","last_fullsized":"2024-09-17T05:25:14.784475+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795615+0000","last_change":"2024-09-17T05:25:14.794435+0000","last_active":"2024-09-17T05:25:14.795615+0000","last_peered":"2024-09-17T05:25:14.795615+0000","last_clean":"2024-09-17T05:25:14.795615+0000","last_became_active":"2024-09-17T05:25:14.794186+0000","last_became_peered":"2024-09-17T05:25:14.794186+0000","last_unstale":"2024-09-17T05:25:14.795615+0000","last_undegraded":"2024-09-17T05:25:14.795615+0000","last_fullsized":"2024-09-17T05:25:14.795615+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:46.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783103+0000","last_change":"2024-09-17T05:25:14.783103+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783103+0000","last_undegraded":"2024-09-17T05:25:14.783103+0000","last_fullsized":"2024-09-17T05:25:14.783103+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797977+0000","last_change":"2024-09-17T05:25:14.794639+0000","last_active":"2024-09-17T05:25:14.797977+0000","last_peered":"2024-09-17T05:25:14.797977+0000","last_clean":"2024-09-17T05:25:14.797977+0000","last_became_active":"2024-09-17T05:25:14.794396+0000","last_became_peered":"2024-09-17T05:25:14.794396+0000","last_unstale":"2024-09-17T05:25:14.797977+0000","last_undegraded":"2024-09-17T05:25:14.797977+0000","last_fullsized":"2024-09-17T05:25:14.797977+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:12.802682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785398+0000","last_change":"2024-09-17T05:25:14.785398+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785398+0000","last_undegraded":"2024-09-17T05:25:14.785398+0000","last_fullsized":"2024-09-17T05:25:14.785398+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797913+0000","last_change":"2024-09-17T05:25:14.793110+0000","last_active":"2024-09-17T05:25:14.797913+0000","last_peered":"2024-09-17T05:25:14.797913+0000","last_clean":"2024-09-17T05:25:14.797913+0000","last_became_active":"2024-09-17T05:25:14.792837+0000","last_became_peered":"2024-09-17T05:25:14.792837+0000","last_unstale":"2024-09-17T05:25:14.797913+0000","last_undegraded":"2024-09-17T05:25:14.797913+0000","last_fullsized":"2024-09-17T05:25:14.797913+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:07.496562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786489+0000","last_change":"2024-09-17T05:25:14.786489+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786489+0000","last_undegraded":"2024-09-17T05:25:14.786489+0000","last_fullsized":"2024-09-17T05:25:14.786489+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798677+0000","last_change":"2024-09-17T05:25:14.797188+0000","last_active":"2024-09-17T05:25:14.798677+0000","last_peered":"2024-09-17T05:25:14.798677+0000","last_clean":"2024-09-17T05:25:14.798677+0000","last_became_active":"2024-09-17T05:25:14.794128+0000","last_became_peered":"2024-09-17T05:25:14.794128+0000","last_unstale":"2024-09-17T05:25:14.798677+0000","last_undegraded":"2024-09-17T05:25:14.798677+0000","last_fullsized":"2024-09-17T05:25:14.798677+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:42.308969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.781301+0000","last_change":"2024-09-17T05:25:14.781301+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.781301+0000","last_undegraded":"2024-09-17T05:25:14.781301+0000","last_fullsized":"2024-09-17T05:25:14.781301+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.789566+0000","last_change":"2024-09-17T05:25:14.786746+0000","last_active":"2024-09-17T05:25:14.789566+0000","last_peered":"2024-09-17T05:25:14.789566+0000","last_clean":"2024-09-17T05:25:14.789566+0000","last_became_active":"2024-09-17T05:25:14.786464+0000","last_became_peered":"2024-09-17T05:25:14.786464+0000","last_unstale":"2024-09-17T05:25:14.789566+0000","last_undegraded":"2024-09-17T05:25:14.789566+0000","last_fullsized":"2024-09-17T05:25:14.789566+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:28.599025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.781667+0000","last_change":"2024-09-17T05:25:14.781667+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.781667+0000","last_undegraded":"2024-09-17T05:25:14.781667+0000","last_fullsized":"2024-09-17T05:25:14.781667+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801294+0000","last_change":"2024-09-17T05:25:14.796913+0000","last_active":"2024-09-17T05:25:14.801294+0000","last_peered":"2024-09-17T05:25:14.801294+0000","last_clean":"2024-09-17T05:25:14.801294+0000","last_became_active":"2024-09-17T05:25:14.796389+0000","last_became_peered":"2024-09-17T05:25:14.796389+0000","last_unstale":"2024-09-17T05:25:14.801294+0000","last_undegraded":"2024-09-17T05:25:14.801294+0000","last_fullsized":"2024-09-17T05:25:14.801294+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:23.877345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783726+0000","last_change":"2024-09-17T05:25:14.783726+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783726+0000","last_undegraded":"2024-09-17T05:25:14.783726+0000","last_fullsized":"2024-09-17T05:25:14.783726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797549+0000","last_change":"2024-09-17T05:25:14.793890+0000","last_active":"2024-09-17T05:25:14.797549+0000","last_peered":"2024-09-17T05:25:14.797549+0000","last_clean":"2024-09-17T05:25:14.797549+0000","last_became_active":"2024-09-17T05:25:14.793633+0000","last_became_peered":"2024-09-17T05:25:14.793633+0000","last_unstale":"2024-09-17T05:25:14.797549+0000","last_undegraded":"2024-09-17T05:25:14.797549+0000","last_fullsized":"2024-09-17T05:25:14.797549+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:52.405845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786430+0000","last_change":"2024-09-17T05:25:14.786430+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786430+0000","last_undegraded":"2024-09-17T05:25:14.786430+0000","last_fullsized":"2024-09-17T05:25:14.786430+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795474+0000","last_change":"2024-09-17T05:25:14.792239+0000","last_active":"2024-09-17T05:25:14.795474+0000","last_peered":"2024-09-17T05:25:14.795474+0000","last_clean":"2024-09-17T05:25:14.795474+0000","last_became_active":"2024-09-17T05:25:14.791912+0000","last_became_peered":"2024-09-17T05:25:14.791912+0000","last_unstale":"2024-09-17T05:25:14.795474+0000","last_undegraded":"2024-09-17T05:25:14.795474+0000","last_fullsized":"2024-09-17T05:25:14.795474+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:19.554012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785343+0000","last_change":"2024-09-17T05:25:14.785343+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785343+0000","last_undegraded":"2024-09-17T05:25:14.785343+0000","last_fullsized":"2024-09-17T05:25:14.785343+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797783+0000","last_change":"2024-09-17T05:25:14.793250+0000","last_active":"2024-09-17T05:25:14.797783+0000","last_peered":"2024-09-17T05:25:14.797783+0000","last_clean":"2024-09-17T05:25:14.797783+0000","last_became_active":"2024-09-17T05:25:14.792972+0000","last_became_peered":"2024-09-17T05:25:14.792972+0000","last_unstale":"2024-09-17T05:25:14.797783+0000","last_undegraded":"2024-09-17T05:25:14.797783+0000","last_fullsized":"2024-09-17T05:25:14.797783+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:07.962050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782704+0000","last_change":"2024-09-17T05:25:14.782704+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782704+0000","last_undegraded":"2024-09-17T05:25:14.782704+0000","last_fullsized":"2024-09-17T05:25:14.782704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803686+0000","last_change":"2024-09-17T05:25:14.796088+0000","last_active":"2024-09-17T05:25:14.803686+0000","last_peered":"2024-09-17T05:25:14.803686+0000","last_clean":"2024-09-17T05:25:14.803686+0000","last_became_active":"2024-09-17T05:25:14.795601+0000","last_became_peered":"2024-09-17T05:25:14.795601+0000","last_unstale":"2024-09-17T05:25:14.803686+0000","last_undegraded":"2024-09-17T05:25:14.803686+0000","last_fullsized":"2024-09-17T05:25:14.803686+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:15.489523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785777+0000","last_change":"2024-09-17T05:25:14.785777+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785777+0000","last_undegraded":"2024-09-17T05:25:14.785777+0000","last_fullsized":"2024-09-17T05:25:14.785777+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.790068+0000","last_change":"2024-09-17T05:25:14.789024+0000","last_active":"2024-09-17T05:25:14.790068+0000","last_peered":"2024-09-17T05:25:14.790068+0000","last_clean":"2024-09-17T05:25:14.790068+0000","last_became_active":"2024-09-17T05:25:14.788769+0000","last_became_peered":"2024-09-17T05:25:14.788769+0000","last_unstale":"2024-09-17T05:25:14.790068+0000","last_undegraded":"2024-09-17T05:25:14.790068+0000","last_fullsized":"2024-09-17T05:25:14.790068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:06.577007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786026+0000","last_change":"2024-09-17T05:25:14.786026+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786026+0000","last_undegraded":"2024-09-17T05:25:14.786026+0000","last_fullsized":"2024-09-17T05:25:14.786026+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797980+0000","last_change":"2024-09-17T05:25:14.794322+0000","last_active":"2024-09-17T05:25:14.797980+0000","last_peered":"2024-09-17T05:25:14.797980+0000","last_clean":"2024-09-17T05:25:14.797980+0000","last_became_active":"2024-09-17T05:25:14.793988+0000","last_became_peered":"2024-09-17T05:25:14.793988+0000","last_unstale":"2024-09-17T05:25:14.797980+0000","last_undegraded":"2024-09-17T05:25:14.797980+0000","last_fullsized":"2024-09-17T05:25:14.797980+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.043643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.780573+0000","last_change":"2024-09-17T05:25:14.780573+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.780573+0000","last_undegraded":"2024-09-17T05:25:14.780573+0000","last_fullsized":"2024-09-17T05:25:14.780573+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.800259+0000","last_change":"2024-09-17T05:25:14.795615+0000","last_active":"2024-09-17T05:25:14.800259+0000","last_peered":"2024-09-17T05:25:14.800259+0000","last_clean":"2024-09-17T05:25:14.800259+0000","last_became_active":"2024-09-17T05:25:14.795338+0000","last_became_peered":"2024-09-17T05:25:14.795338+0000","last_unstale":"2024-09-17T05:25:14.800259+0000","last_undegraded":"2024-09-17T05:25:14.800259+0000","last_fullsized":"2024-09-17T05:25:14.800259+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:22.855592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784817+0000","last_change":"2024-09-17T05:25:14.784817+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784817+0000","last_undegraded":"2024-09-17T05:25:14.784817+0000","last_fullsized":"2024-09-17T05:25:14.784817+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803743+0000","last_change":"2024-09-17T05:25:14.797300+0000","last_active":"2024-09-17T05:25:14.803743+0000","last_peered":"2024-09-17T05:25:14.803743+0000","last_clean":"2024-09-17T05:25:14.803743+0000","last_became_active":"2024-09-17T05:25:14.797009+0000","last_became_peered":"2024-09-17T05:25:14.797009+0000","last_unstale":"2024-09-17T05:25:14.803743+0000","last_undegraded":"2024-09-17T05:25:14.803743+0000","last_fullsized":"2024-09-17T05:25:14.803743+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:48.545193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.780926+0000","last_change":"2024-09-17T05:25:14.780926+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.780926+0000","last_undegraded":"2024-09-17T05:25:14.780926+0000","last_fullsized":"2024-09-17T05:25:14.780926+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798880+0000","last_change":"2024-09-17T05:25:14.795978+0000","last_active":"2024-09-17T05:25:14.798880+0000","last_peered":"2024-09-17T05:25:14.798880+0000","last_clean":"2024-09-17T05:25:14.798880+0000","last_became_active":"2024-09-17T05:25:14.795145+0000","last_became_peered":"2024-09-17T05:25:14.795145+0000","last_unstale":"2024-09-17T05:25:14.798880+0000","last_undegraded":"2024-09-17T05:25:14.798880+0000","last_fullsized":"2024-09-17T05:25:14.798880+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:04.132410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784898+0000","last_change":"2024-09-17T05:25:14.784898+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784898+0000","last_undegraded":"2024-09-17T05:25:14.784898+0000","last_fullsized":"2024-09-17T05:25:14.784898+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.800959+0000","last_change":"2024-09-17T05:25:14.798054+0000","last_active":"2024-09-17T05:25:14.800959+0000","last_peered":"2024-09-17T05:25:14.800959+0000","last_clean":"2024-09-17T05:25:14.800959+0000","last_became_active":"2024-09-17T05:25:14.797432+0000","last_became_peered":"2024-09-17T05:25:14.797432+0000","last_unstale":"2024-09-17T05:25:14.800959+0000","last_undegraded":"2024-09-17T05:25:14.800959+0000","last_fullsized":"2024-09-17T05:25:14.800959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:12.183730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782058+0000","last_change":"2024-09-17T05:25:14.782058+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782058+0000","last_undegraded":"2024-09-17T05:25:14.782058+0000","last_fullsized":"2024-09-17T05:25:14.782058+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.804074+0000","last_change":"2024-09-17T05:25:14.801709+0000","last_active":"2024-09-17T05:25:14.804074+0000","last_peered":"2024-09-17T05:25:14.804074+0000","last_clean":"2024-09-17T05:25:14.804074+0000","last_became_active":"2024-09-17T05:25:14.801400+0000","last_became_peered":"2024-09-17T05:25:14.801400+0000","last_unstale":"2024-09-17T05:25:14.804074+0000","last_undegraded":"2024-09-17T05:25:14.804074+0000","last_fullsized":"2024-09-17T05:25:14.804074+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:26.294285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785555+0000","last_change":"2024-09-17T05:25:14.785555+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785555+0000","last_undegraded":"2024-09-17T05:25:14.785555+0000","last_fullsized":"2024-09-17T05:25:14.785555+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801025+0000","last_change":"2024-09-17T05:25:14.797861+0000","last_active":"2024-09-17T05:25:14.801025+0000","last_peered":"2024-09-17T05:25:14.801025+0000","last_clean":"2024-09-17T05:25:14.801025+0000","last_became_active":"2024-09-17T05:25:14.797490+0000","last_became_peered":"2024-09-17T05:25:14.797490+0000","last_unstale":"2024-09-17T05:25:14.801025+0000","last_undegraded":"2024-09-17T05:25:14.801025+0000","last_fullsized":"2024-09-17T05:25:14.801025+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:23.396355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785302+0000","last_change":"2024-09-17T05:25:14.785302+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785302+0000","last_undegraded":"2024-09-17T05:25:14.785302+0000","last_fullsized":"2024-09-17T05:25:14.785302+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797764+0000","last_change":"2024-09-17T05:25:14.793137+0000","last_active":"2024-09-17T05:25:14.797764+0000","last_peered":"2024-09-17T05:25:14.797764+0000","last_clean":"2024-09-17T05:25:14.797764+0000","last_became_active":"2024-09-17T05:25:14.792865+0000","last_became_peered":"2024-09-17T05:25:14.792865+0000","last_unstale":"2024-09-17T05:25:14.797764+0000","last_undegraded":"2024-09-17T05:25:14.797764+0000","last_fullsized":"2024-09-17T05:25:14.797764+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:14.245660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785052+0000","last_change":"2024-09-17T05:25:14.785052+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785052+0000","last_undegraded":"2024-09-17T05:25:14.785052+0000","last_fullsized":"2024-09-17T05:25:14.785052+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801232+0000","last_change":"2024-09-17T05:25:14.798585+0000","last_active":"2024-09-17T05:25:14.801232+0000","last_peered":"2024-09-17T05:25:14.801232+0000","last_clean":"2024-09-17T05:25:14.801232+0000","last_became_active":"2024-09-17T05:25:14.798315+0000","last_became_peered":"2024-09-17T05:25:14.798315+0000","last_unstale":"2024-09-17T05:25:14.801232+0000","last_undegraded":"2024-09-17T05:25:14.801232+0000","last_fullsized":"2024-09-17T05:25:14.801232+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:19.009536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.791159+0000","last_change":"2024-09-17T05:25:14.791159+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.791159+0000","last_undegraded":"2024-09-17T05:25:14.791159+0000","last_fullsized":"2024-09-17T05:25:14.791159+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.789281+0000","last_change":"2024-09-17T05:25:14.786737+0000","last_active":"2024-09-17T05:25:14.789281+0000","last_peered":"2024-09-17T05:25:14.789281+0000","last_clean":"2024-09-17T05:25:14.789281+0000","last_became_active":"2024-09-17T05:25:14.786430+0000","last_became_peered":"2024-09-17T05:25:14.786430+0000","last_unstale":"2024-09-17T05:25:14.789281+0000","last_undegraded":"2024-09-17T05:25:14.789281+0000","last_fullsized":"2024-09-17T05:25:14.789281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:30.752015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783271+0000","last_change":"2024-09-17T05:25:14.783271+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783271+0000","last_undegraded":"2024-09-17T05:25:14.783271+0000","last_fullsized":"2024-09-17T05:25:14.783271+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.806501+0000","last_change":"2024-09-17T05:25:14.804390+0000","last_active":"2024-09-17T05:25:14.806501+0000","last_peered":"2024-09-17T05:25:14.806501+0000","last_clean":"2024-09-17T05:25:14.806501+0000","last_became_active":"2024-09-17T05:25:14.804104+0000","last_became_peered":"2024-09-17T05:25:14.804104+0000","last_unstale":"2024-09-17T05:25:14.806501+0000","last_undegraded":"2024-09-17T05:25:14.806501+0000","last_fullsized":"2024-09-17T05:25:14.806501+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:43.762039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784455+0000","last_change":"2024-09-17T05:25:14.784455+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784455+0000","last_undegraded":"2024-09-17T05:25:14.784455+0000","last_fullsized":"2024-09-17T05:25:14.784455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797999+0000","last_change":"2024-09-17T05:25:14.795475+0000","last_active":"2024-09-17T05:25:14.797999+0000","last_peered":"2024-09-17T05:25:14.797999+0000","last_clean":"2024-09-17T05:25:14.797999+0000","last_became_active":"2024-09-17T05:25:14.795056+0000","last_became_peered":"2024-09-17T05:25:14.795056+0000","last_unstale":"2024-09-17T05:25:14.797999+0000","last_undegraded":"2024-09-17T05:25:14.797999+0000","last_fullsized":"2024-09-17T05:25:14.797999+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:34.520059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784762+0000","last_change":"2024-09-17T05:25:14.784762+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784762+0000","last_undegraded":"2024-09-17T05:25:14.784762+0000","last_fullsized":"2024-09-17T05:25:14.784762+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801430+0000","last_change":"2024-09-17T05:25:14.799199+0000","last_active":"2024-09-17T05:25:14.801430+0000","last_peered":"2024-09-17T05:25:14.801430+0000","last_clean":"2024-09-17T05:25:14.801430+0000","last_became_active":"2024-09-17T05:25:14.798912+0000","last_became_peered":"2024-09-17T05:25:14.798912+0000","last_unstale":"2024-09-17T05:25:14.801430+0000","last_undegraded":"2024-09-17T05:25:14.801430+0000","last_fullsized":"2024-09-17T05:25:14.801430+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:43.075420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782477+0000","last_change":"2024-09-17T05:25:14.782477+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782477+0000","last_undegraded":"2024-09-17T05:25:14.782477+0000","last_fullsized":"2024-09-17T05:25:14.782477+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803817+0000","last_change":"2024-09-17T05:25:14.799256+0000","last_active":"2024-09-17T05:25:14.803817+0000","last_peered":"2024-09-17T05:25:14.803817+0000","last_clean":"2024-09-17T05:25:14.803817+0000","last_became_active":"2024-09-17T05:25:14.798928+0000","last_became_peered":"2024-09-17T05:25:14.798928+0000","last_unstale":"2024-09-17T05:25:14.803817+0000","last_undegraded":"2024-09-17T05:25:14.803817+0000","last_fullsized":"2024-09-17T05:25:14.803817+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:15.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783219+0000","last_change":"2024-09-17T05:25:14.783219+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783219+0000","last_undegraded":"2024-09-17T05:25:14.783219+0000","last_fullsized":"2024-09-17T05:25:14.783219+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795029+0000","last_change":"2024-09-17T05:25:14.792783+0000","last_active":"2024-09-17T05:25:14.795029+0000","last_peered":"2024-09-17T05:25:14.795029+0000","last_clean":"2024-09-17T05:25:14.795029+0000","last_became_active":"2024-09-17T05:25:14.792499+0000","last_became_peered":"2024-09-17T05:25:14.792499+0000","last_unstale":"2024-09-17T05:25:14.795029+0000","last_undegraded":"2024-09-17T05:25:14.795029+0000","last_fullsized":"2024-09-17T05:25:14.795029+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.986046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783896+0000","last_change":"2024-09-17T05:25:14.783896+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783896+0000","last_undegraded":"2024-09-17T05:25:14.783896+0000","last_fullsized":"2024-09-17T05:25:14.783896+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803679+0000","last_change":"2024-09-17T05:25:14.795833+0000","last_active":"2024-09-17T05:25:14.803679+0000","last_peered":"2024-09-17T05:25:14.803679+0000","last_clean":"2024-09-17T05:25:14.803679+0000","last_became_active":"2024-09-17T05:25:14.795529+0000","last_became_peered":"2024-09-17T05:25:14.795529+0000","last_unstale":"2024-09-17T05:25:14.803679+0000","last_undegraded":"2024-09-17T05:25:14.803679+0000","last_fullsized":"2024-09-17T05:25:14.803679+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:52.856520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785961+0000","last_change":"2024-09-17T05:25:14.785961+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785961+0000","last_undegraded":"2024-09-17T05:25:14.785961+0000","last_fullsized":"2024-09-17T05:25:14.785961+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797664+0000","last_change":"2024-09-17T05:25:14.790605+0000","last_active":"2024-09-17T05:25:14.797664+0000","last_peered":"2024-09-17T05:25:14.797664+0000","last_clean":"2024-09-17T05:25:14.797664+0000","last_became_active":"2024-09-17T05:25:14.790285+0000","last_became_peered":"2024-09-17T05:25:14.790285+0000","last_unstale":"2024-09-17T05:25:14.797664+0000","last_undegraded":"2024-09-17T05:25:14.797664+0000","last_fullsized":"2024-09-17T05:25:14.797664+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:38.509048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784285+0000","last_change":"2024-09-17T05:25:14.784285+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784285+0000","last_undegraded":"2024-09-17T05:25:14.784285+0000","last_fullsized":"2024-09-17T05:25:14.784285+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803766+0000","last_change":"2024-09-17T05:25:14.799017+0000","last_active":"2024-09-17T05:25:14.803766+0000","last_peered":"2024-09-17T05:25:14.803766+0000","last_clean":"2024-09-17T05:25:14.803766+0000","last_became_active":"2024-09-17T05:25:14.798741+0000","last_became_peered":"2024-09-17T05:25:14.798741+0000","last_unstale":"2024-09-17T05:25:14.803766+0000","last_undegraded":"2024-09-17T05:25:14.803766+0000","last_fullsized":"2024-09-17T05:25:14.803766+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:10.566412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784380+0000","last_change":"2024-09-17T05:25:14.784380+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784380+0000","last_undegraded":"2024-09-17T05:25:14.784380+0000","last_fullsized":"2024-09-17T05:25:14.784380+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.791849+0000","last_change":"2024-09-17T05:25:14.788995+0000","last_active":"2024-09-17T05:25:14.791849+0000","last_peered":"2024-09-17T05:25:14.791849+0000","last_clean":"2024-09-17T05:25:14.791849+0000","last_became_active":"2024-09-17T05:25:14.788708+0000","last_became_peered":"2024-09-17T05:25:14.788708+0000","last_unstale":"2024-09-17T05:25:14.791849+0000","last_undegraded":"2024-09-17T05:25:14.791849+0000","last_fullsized":"2024-09-17T05:25:14.791849+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:50.260359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785828+0000","last_change":"2024-09-17T05:25:14.785828+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785828+0000","last_undegraded":"2024-09-17T05:25:14.785828+0000","last_fullsized":"2024-09-17T05:25:14.785828+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795740+0000","last_change":"2024-09-17T05:25:14.793360+0000","last_active":"2024-09-17T05:25:14.795740+0000","last_peered":"2024-09-17T05:25:14.795740+0000","last_clean":"2024-09-17T05:25:14.795740+0000","last_became_active":"2024-09-17T05:25:14.793062+0000","last_became_peered":"2024-09-17T05:25:14.793062+0000","last_unstale":"2024-09-17T05:25:14.795740+0000","last_undegraded":"2024-09-17T05:25:14.795740+0000","last_fullsized":"2024-09-17T05:25:14.795740+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:03.046454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":346,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.791836+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:25:14.791836+0000","last_peered":"2024-09-17T05:25:14.791836+0000","last_clean":"2024-09-17T05:25:14.791836+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:25:14.791836+0000","last_undegraded":"2024-09-17T05:25:14.791836+0000","last_fullsized":"2024-09-17T05:25:14.791836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33444,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338396,"statfs":{"total":96636764160,"available":96602517504,"internally_reserved":0,"allocated":2310144,"data_stored":1343994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1728512,"data_stored":759973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509523,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1728512,"data_stored":759973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2322432,"data_stored":1350341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:25:19.089 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:25:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 -- 172.21.15.81:0/743516801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0884159680 msgr2=0x7f088415d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 --2- 172.21.15.81:0/743516801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0884159680 0x7f088415d270 secure :-1 s=READY pgs=1563 cs=0 l=1 rev1=1 crypto rx=0x7f0874009830 tx=0x7f087402a510 comp rx=0 tx=0).stop 2024-09-17T05:25:19.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 -- 172.21.15.81:0/743516801 shutdown_connections 2024-09-17T05:25:19.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 --2- 172.21.15.81:0/743516801 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f088415fe60 0x7f08840ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 --2- 172.21.15.81:0/743516801 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0884159680 0x7f088415d270 unknown :-1 s=CLOSED pgs=1563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 -- 172.21.15.81:0/743516801 >> 172.21.15.81:0/743516801 conn(0x7f08840b1690 msgr2=0x7f08840b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:19.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 -- 172.21.15.81:0/743516801 shutdown_connections 2024-09-17T05:25:19.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.226+0000 7f088a552640 1 -- 172.21.15.81:0/743516801 wait complete. 2024-09-17T05:25:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.227+0000 7f088a552640 1 Processor -- start 2024-09-17T05:25:19.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.227+0000 7f088a552640 1 -- start start 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f088a552640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08840cc490 0x7f08841f28e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f088a552640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0884159680 0x7f08841f68a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f088a552640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f088415fe60 0x7f08840ad460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f088a552640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f08840cca80 con 0x7f08840cc490 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f088a552640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f08840cc900 con 0x7f0884159680 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f088a552640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f08840ccc00 con 0x7f088415fe60 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08840cc490 0x7f08841f28e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08840cc490 0x7f08841f28e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54138/0 (socket says 172.21.15.81:54138) 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 -- 172.21.15.81:0/1085631038 learned_addr learned my addr 172.21.15.81:0/1085631038 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:19.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0888aef640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f088415fe60 0x7f08840ad460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f08837fe640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0884159680 0x7f08841f68a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 -- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f088415fe60 msgr2=0x7f08840ad460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f088415fe60 0x7f08840ad460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 -- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0884159680 msgr2=0x7f08841f68a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0884159680 0x7f08841f68a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 -- 172.21.15.81:0/1085631038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0884072720 con 0x7f08840cc490 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.228+0000 7f0883fff640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08840cc490 0x7f08841f28e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0874000c00 tx=0x7f0874032c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.229+0000 7f0880ff9640 1 -- 172.21.15.81:0/1085631038 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874040070 con 0x7f08840cc490 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.229+0000 7f0880ff9640 1 -- 172.21.15.81:0/1085631038 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0874032e70 con 0x7f08840cc490 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.229+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08841f3030 con 0x7f08840cc490 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.229+0000 7f0880ff9640 1 -- 172.21.15.81:0/1085631038 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0874003d90 con 0x7f08840cc490 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.229+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08841f35f0 con 0x7f08840cc490 2024-09-17T05:25:19.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.230+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08840728f0 con 0x7f08840cc490 2024-09-17T05:25:19.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.230+0000 7f0880ff9640 1 -- 172.21.15.81:0/1085631038 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f0874039040 con 0x7f08840cc490 2024-09-17T05:25:19.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.231+0000 7f0880ff9640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0870079250 0x7f087007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.233 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.231+0000 7f0880ff9640 1 -- 172.21.15.81:0/1085631038 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f08740bcfc0 con 0x7f08840cc490 2024-09-17T05:25:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.231+0000 7f08837fe640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0870079250 0x7f087007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.231+0000 7f08837fe640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0870079250 0x7f087007b710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08841e9940 tx=0x7f0878009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:19.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.235+0000 7f0880ff9640 1 -- 172.21.15.81:0/1085631038 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f08740849a0 con 0x7f08840cc490 2024-09-17T05:25:19.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.410+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f08840ceac0 con 0x7f0870079250 2024-09-17T05:25:19.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.413+0000 7f0880ff9640 1 -- 172.21.15.81:0/1085631038 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+247114 (secure 0 0 0) 0x7f08840ceac0 con 0x7f0870079250 2024-09-17T05:25:19.417 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:19.418 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0870079250 msgr2=0x7f087007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0870079250 0x7f087007b710 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f08841e9940 tx=0x7f0878009040 comp rx=0 tx=0).stop 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08840cc490 msgr2=0x7f08841f28e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08840cc490 0x7f08841f28e0 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f0874000c00 tx=0x7f0874032c80 comp rx=0 tx=0).stop 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 shutdown_connections 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f088415fe60 0x7f08840ad460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0870079250 0x7f087007b710 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0884159680 0x7f08841f68a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 --2- 172.21.15.81:0/1085631038 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f08840cc490 0x7f08841f28e0 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 >> 172.21.15.81:0/1085631038 conn(0x7f08840b1690 msgr2=0x7f088415af30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 shutdown_connections 2024-09-17T05:25:19.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.417+0000 7f088a552640 1 -- 172.21.15.81:0/1085631038 wait complete. 2024-09-17T05:25:19.429 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":149,"stamp":"2024-09-17T05:25:18.052665+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":22,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264168,"kb_used_data":14604,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710552,"statfs":{"total":773094113280,"available":772823605248,"internally_reserved":0,"allocated":14954496,"data_stored":7228785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.279063"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.789798+0000","last_change":"2024-09-17T05:25:14.789798+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.789798+0000","last_undegraded":"2024-09-17T05:25:14.789798+0000","last_fullsized":"2024-09-17T05:25:14.789798+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787155+0000","last_change":"2024-09-17T05:25:14.787155+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787155+0000","last_undegraded":"2024-09-17T05:25:14.787155+0000","last_fullsized":"2024-09-17T05:25:14.787155+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786712+0000","last_change":"2024-09-17T05:25:14.786712+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786712+0000","last_undegraded":"2024-09-17T05:25:14.786712+0000","last_fullsized":"2024-09-17T05:25:14.786712+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785289+0000","last_change":"2024-09-17T05:25:14.785289+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785289+0000","last_undegraded":"2024-09-17T05:25:14.785289+0000","last_fullsized":"2024-09-17T05:25:14.785289+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787383+0000","last_change":"2024-09-17T05:25:14.787383+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787383+0000","last_undegraded":"2024-09-17T05:25:14.787383+0000","last_fullsized":"2024-09-17T05:25:14.787383+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784597+0000","last_change":"2024-09-17T05:25:14.784597+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784597+0000","last_undegraded":"2024-09-17T05:25:14.784597+0000","last_fullsized":"2024-09-17T05:25:14.784597+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.788310+0000","last_change":"2024-09-17T05:25:14.788310+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.788310+0000","last_undegraded":"2024-09-17T05:25:14.788310+0000","last_fullsized":"2024-09-17T05:25:14.788310+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785064+0000","last_change":"2024-09-17T05:25:14.785064+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785064+0000","last_undegraded":"2024-09-17T05:25:14.785064+0000","last_fullsized":"2024-09-17T05:25:14.785064+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786990+0000","last_change":"2024-09-17T05:25:14.786990+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786990+0000","last_undegraded":"2024-09-17T05:25:14.786990+0000","last_fullsized":"2024-09-17T05:25:14.786990+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784493+0000","last_change":"2024-09-17T05:25:14.784493+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784493+0000","last_undegraded":"2024-09-17T05:25:14.784493+0000","last_fullsized":"2024-09-17T05:25:14.784493+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.789107+0000","last_change":"2024-09-17T05:25:14.789107+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.789107+0000","last_undegraded":"2024-09-17T05:25:14.789107+0000","last_fullsized":"2024-09-17T05:25:14.789107+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787653+0000","last_change":"2024-09-17T05:25:14.787653+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787653+0000","last_undegraded":"2024-09-17T05:25:14.787653+0000","last_fullsized":"2024-09-17T05:25:14.787653+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784806+0000","last_change":"2024-09-17T05:25:14.784806+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784806+0000","last_undegraded":"2024-09-17T05:25:14.784806+0000","last_fullsized":"2024-09-17T05:25:14.784806+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785755+0000","last_change":"2024-09-17T05:25:14.785755+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785755+0000","last_undegraded":"2024-09-17T05:25:14.785755+0000","last_fullsized":"2024-09-17T05:25:14.785755+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.788503+0000","last_change":"2024-09-17T05:25:14.788503+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.788503+0000","last_undegraded":"2024-09-17T05:25:14.788503+0000","last_fullsized":"2024-09-17T05:25:14.788503+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787455+0000","last_change":"2024-09-17T05:25:14.787455+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787455+0000","last_undegraded":"2024-09-17T05:25:14.787455+0000","last_fullsized":"2024-09-17T05:25:14.787455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783802+0000","last_change":"2024-09-17T05:25:14.783802+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783802+0000","last_undegraded":"2024-09-17T05:25:14.783802+0000","last_fullsized":"2024-09-17T05:25:14.783802+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787359+0000","last_change":"2024-09-17T05:25:14.787359+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787359+0000","last_undegraded":"2024-09-17T05:25:14.787359+0000","last_fullsized":"2024-09-17T05:25:14.787359+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783749+0000","last_change":"2024-09-17T05:25:14.783749+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783749+0000","last_undegraded":"2024-09-17T05:25:14.783749+0000","last_fullsized":"2024-09-17T05:25:14.783749+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783705+0000","last_change":"2024-09-17T05:25:14.783705+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783705+0000","last_undegraded":"2024-09-17T05:25:14.783705+0000","last_fullsized":"2024-09-17T05:25:14.783705+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784281+0000","last_change":"2024-09-17T05:25:14.784281+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784281+0000","last_undegraded":"2024-09-17T05:25:14.784281+0000","last_fullsized":"2024-09-17T05:25:14.784281+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784726+0000","last_change":"2024-09-17T05:25:14.784726+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784726+0000","last_undegraded":"2024-09-17T05:25:14.784726+0000","last_fullsized":"2024-09-17T05:25:14.784726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784154+0000","last_change":"2024-09-17T05:25:14.784154+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784154+0000","last_undegraded":"2024-09-17T05:25:14.784154+0000","last_fullsized":"2024-09-17T05:25:14.784154+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784291+0000","last_change":"2024-09-17T05:25:14.784291+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784291+0000","last_undegraded":"2024-09-17T05:25:14.784291+0000","last_fullsized":"2024-09-17T05:25:14.784291+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785930+0000","last_change":"2024-09-17T05:25:14.785930+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785930+0000","last_undegraded":"2024-09-17T05:25:14.785930+0000","last_fullsized":"2024-09-17T05:25:14.785930+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.787157+0000","last_change":"2024-09-17T05:25:14.787157+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.787157+0000","last_undegraded":"2024-09-17T05:25:14.787157+0000","last_fullsized":"2024-09-17T05:25:14.787157+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786160+0000","last_change":"2024-09-17T05:25:14.786160+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786160+0000","last_undegraded":"2024-09-17T05:25:14.786160+0000","last_fullsized":"2024-09-17T05:25:14.786160+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784796+0000","last_change":"2024-09-17T05:25:14.784796+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784796+0000","last_undegraded":"2024-09-17T05:25:14.784796+0000","last_fullsized":"2024-09-17T05:25:14.784796+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784361+0000","last_change":"2024-09-17T05:25:14.784361+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784361+0000","last_undegraded":"2024-09-17T05:25:14.784361+0000","last_fullsized":"2024-09-17T05:25:14.784361+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783316+0000","last_change":"2024-09-17T05:25:14.783316+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783316+0000","last_undegraded":"2024-09-17T05:25:14.783316+0000","last_fullsized":"2024-09-17T05:25:14.783316+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783417+0000","last_change":"2024-09-17T05:25:14.783417+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783417+0000","last_undegraded":"2024-09-17T05:25:14.783417+0000","last_fullsized":"2024-09-17T05:25:14.783417+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786901+0000","last_change":"2024-09-17T05:25:14.786901+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786901+0000","last_undegraded":"2024-09-17T05:25:14.786901+0000","last_fullsized":"2024-09-17T05:25:14.786901+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786688+0000","last_change":"2024-09-17T05:25:14.786688+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786688+0000","last_undegraded":"2024-09-17T05:25:14.786688+0000","last_fullsized":"2024-09-17T05:25:14.786688+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798292+0000","last_change":"2024-09-17T05:25:14.796665+0000","last_active":"2024-09-17T05:25:14.798292+0000","last_peered":"2024-09-17T05:25:14.798292+0000","last_clean":"2024-09-17T05:25:14.798292+0000","last_became_active":"2024-09-17T05:25:14.796385+0000","last_became_peered":"2024-09-17T05:25:14.796385+0000","last_unstale":"2024-09-17T05:25:14.798292+0000","last_undegraded":"2024-09-17T05:25:14.798292+0000","last_fullsized":"2024-09-17T05:25:14.798292+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:42:58.490830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784475+0000","last_change":"2024-09-17T05:25:14.784475+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784475+0000","last_undegraded":"2024-09-17T05:25:14.784475+0000","last_fullsized":"2024-09-17T05:25:14.784475+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795615+0000","last_change":"2024-09-17T05:25:14.794435+0000","last_active":"2024-09-17T05:25:14.795615+0000","last_peered":"2024-09-17T05:25:14.795615+0000","last_clean":"2024-09-17T05:25:14.795615+0000","last_became_active":"2024-09-17T05:25:14.794186+0000","last_became_peered":"2024-09-17T05:25:14.794186+0000","last_unstale":"2024-09-17T05:25:14.795615+0000","last_undegraded":"2024-09-17T05:25:14.795615+0000","last_fullsized":"2024-09-17T05:25:14.795615+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:46.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783103+0000","last_change":"2024-09-17T05:25:14.783103+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783103+0000","last_undegraded":"2024-09-17T05:25:14.783103+0000","last_fullsized":"2024-09-17T05:25:14.783103+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797977+0000","last_change":"2024-09-17T05:25:14.794639+0000","last_active":"2024-09-17T05:25:14.797977+0000","last_peered":"2024-09-17T05:25:14.797977+0000","last_clean":"2024-09-17T05:25:14.797977+0000","last_became_active":"2024-09-17T05:25:14.794396+0000","last_became_peered":"2024-09-17T05:25:14.794396+0000","last_unstale":"2024-09-17T05:25:14.797977+0000","last_undegraded":"2024-09-17T05:25:14.797977+0000","last_fullsized":"2024-09-17T05:25:14.797977+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:46:12.802682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785398+0000","last_change":"2024-09-17T05:25:14.785398+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785398+0000","last_undegraded":"2024-09-17T05:25:14.785398+0000","last_fullsized":"2024-09-17T05:25:14.785398+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797913+0000","last_change":"2024-09-17T05:25:14.793110+0000","last_active":"2024-09-17T05:25:14.797913+0000","last_peered":"2024-09-17T05:25:14.797913+0000","last_clean":"2024-09-17T05:25:14.797913+0000","last_became_active":"2024-09-17T05:25:14.792837+0000","last_became_peered":"2024-09-17T05:25:14.792837+0000","last_unstale":"2024-09-17T05:25:14.797913+0000","last_undegraded":"2024-09-17T05:25:14.797913+0000","last_fullsized":"2024-09-17T05:25:14.797913+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:07.496562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786489+0000","last_change":"2024-09-17T05:25:14.786489+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786489+0000","last_undegraded":"2024-09-17T05:25:14.786489+0000","last_fullsized":"2024-09-17T05:25:14.786489+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798677+0000","last_change":"2024-09-17T05:25:14.797188+0000","last_active":"2024-09-17T05:25:14.798677+0000","last_peered":"2024-09-17T05:25:14.798677+0000","last_clean":"2024-09-17T05:25:14.798677+0000","last_became_active":"2024-09-17T05:25:14.794128+0000","last_became_peered":"2024-09-17T05:25:14.794128+0000","last_unstale":"2024-09-17T05:25:14.798677+0000","last_undegraded":"2024-09-17T05:25:14.798677+0000","last_fullsized":"2024-09-17T05:25:14.798677+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:56:42.308969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.781301+0000","last_change":"2024-09-17T05:25:14.781301+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.781301+0000","last_undegraded":"2024-09-17T05:25:14.781301+0000","last_fullsized":"2024-09-17T05:25:14.781301+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.789566+0000","last_change":"2024-09-17T05:25:14.786746+0000","last_active":"2024-09-17T05:25:14.789566+0000","last_peered":"2024-09-17T05:25:14.789566+0000","last_clean":"2024-09-17T05:25:14.789566+0000","last_became_active":"2024-09-17T05:25:14.786464+0000","last_became_peered":"2024-09-17T05:25:14.786464+0000","last_unstale":"2024-09-17T05:25:14.789566+0000","last_undegraded":"2024-09-17T05:25:14.789566+0000","last_fullsized":"2024-09-17T05:25:14.789566+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:44:28.599025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.781667+0000","last_change":"2024-09-17T05:25:14.781667+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.781667+0000","last_undegraded":"2024-09-17T05:25:14.781667+0000","last_fullsized":"2024-09-17T05:25:14.781667+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801294+0000","last_change":"2024-09-17T05:25:14.796913+0000","last_active":"2024-09-17T05:25:14.801294+0000","last_peered":"2024-09-17T05:25:14.801294+0000","last_clean":"2024-09-17T05:25:14.801294+0000","last_became_active":"2024-09-17T05:25:14.796389+0000","last_became_peered":"2024-09-17T05:25:14.796389+0000","last_unstale":"2024-09-17T05:25:14.801294+0000","last_undegraded":"2024-09-17T05:25:14.801294+0000","last_fullsized":"2024-09-17T05:25:14.801294+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:16:23.877345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783726+0000","last_change":"2024-09-17T05:25:14.783726+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783726+0000","last_undegraded":"2024-09-17T05:25:14.783726+0000","last_fullsized":"2024-09-17T05:25:14.783726+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797549+0000","last_change":"2024-09-17T05:25:14.793890+0000","last_active":"2024-09-17T05:25:14.797549+0000","last_peered":"2024-09-17T05:25:14.797549+0000","last_clean":"2024-09-17T05:25:14.797549+0000","last_became_active":"2024-09-17T05:25:14.793633+0000","last_became_peered":"2024-09-17T05:25:14.793633+0000","last_unstale":"2024-09-17T05:25:14.797549+0000","last_undegraded":"2024-09-17T05:25:14.797549+0000","last_fullsized":"2024-09-17T05:25:14.797549+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:29:52.405845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786430+0000","last_change":"2024-09-17T05:25:14.786430+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786430+0000","last_undegraded":"2024-09-17T05:25:14.786430+0000","last_fullsized":"2024-09-17T05:25:14.786430+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795474+0000","last_change":"2024-09-17T05:25:14.792239+0000","last_active":"2024-09-17T05:25:14.795474+0000","last_peered":"2024-09-17T05:25:14.795474+0000","last_clean":"2024-09-17T05:25:14.795474+0000","last_became_active":"2024-09-17T05:25:14.791912+0000","last_became_peered":"2024-09-17T05:25:14.791912+0000","last_unstale":"2024-09-17T05:25:14.795474+0000","last_undegraded":"2024-09-17T05:25:14.795474+0000","last_fullsized":"2024-09-17T05:25:14.795474+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:13:19.554012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785343+0000","last_change":"2024-09-17T05:25:14.785343+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785343+0000","last_undegraded":"2024-09-17T05:25:14.785343+0000","last_fullsized":"2024-09-17T05:25:14.785343+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797783+0000","last_change":"2024-09-17T05:25:14.793250+0000","last_active":"2024-09-17T05:25:14.797783+0000","last_peered":"2024-09-17T05:25:14.797783+0000","last_clean":"2024-09-17T05:25:14.797783+0000","last_became_active":"2024-09-17T05:25:14.792972+0000","last_became_peered":"2024-09-17T05:25:14.792972+0000","last_unstale":"2024-09-17T05:25:14.797783+0000","last_undegraded":"2024-09-17T05:25:14.797783+0000","last_fullsized":"2024-09-17T05:25:14.797783+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:42:07.962050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782704+0000","last_change":"2024-09-17T05:25:14.782704+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782704+0000","last_undegraded":"2024-09-17T05:25:14.782704+0000","last_fullsized":"2024-09-17T05:25:14.782704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803686+0000","last_change":"2024-09-17T05:25:14.796088+0000","last_active":"2024-09-17T05:25:14.803686+0000","last_peered":"2024-09-17T05:25:14.803686+0000","last_clean":"2024-09-17T05:25:14.803686+0000","last_became_active":"2024-09-17T05:25:14.795601+0000","last_became_peered":"2024-09-17T05:25:14.795601+0000","last_unstale":"2024-09-17T05:25:14.803686+0000","last_undegraded":"2024-09-17T05:25:14.803686+0000","last_fullsized":"2024-09-17T05:25:14.803686+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:15.489523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785777+0000","last_change":"2024-09-17T05:25:14.785777+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785777+0000","last_undegraded":"2024-09-17T05:25:14.785777+0000","last_fullsized":"2024-09-17T05:25:14.785777+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.790068+0000","last_change":"2024-09-17T05:25:14.789024+0000","last_active":"2024-09-17T05:25:14.790068+0000","last_peered":"2024-09-17T05:25:14.790068+0000","last_clean":"2024-09-17T05:25:14.790068+0000","last_became_active":"2024-09-17T05:25:14.788769+0000","last_became_peered":"2024-09-17T05:25:14.788769+0000","last_unstale":"2024-09-17T05:25:14.790068+0000","last_undegraded":"2024-09-17T05:25:14.790068+0000","last_fullsized":"2024-09-17T05:25:14.790068+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:17:06.577007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.786026+0000","last_change":"2024-09-17T05:25:14.786026+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.786026+0000","last_undegraded":"2024-09-17T05:25:14.786026+0000","last_fullsized":"2024-09-17T05:25:14.786026+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797980+0000","last_change":"2024-09-17T05:25:14.794322+0000","last_active":"2024-09-17T05:25:14.797980+0000","last_peered":"2024-09-17T05:25:14.797980+0000","last_clean":"2024-09-17T05:25:14.797980+0000","last_became_active":"2024-09-17T05:25:14.793988+0000","last_became_peered":"2024-09-17T05:25:14.793988+0000","last_unstale":"2024-09-17T05:25:14.797980+0000","last_undegraded":"2024-09-17T05:25:14.797980+0000","last_fullsized":"2024-09-17T05:25:14.797980+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:24.043643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.780573+0000","last_change":"2024-09-17T05:25:14.780573+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.780573+0000","last_undegraded":"2024-09-17T05:25:14.780573+0000","last_fullsized":"2024-09-17T05:25:14.780573+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.800259+0000","last_change":"2024-09-17T05:25:14.795615+0000","last_active":"2024-09-17T05:25:14.800259+0000","last_peered":"2024-09-17T05:25:14.800259+0000","last_clean":"2024-09-17T05:25:14.800259+0000","last_became_active":"2024-09-17T05:25:14.795338+0000","last_became_peered":"2024-09-17T05:25:14.795338+0000","last_unstale":"2024-09-17T05:25:14.800259+0000","last_undegraded":"2024-09-17T05:25:14.800259+0000","last_fullsized":"2024-09-17T05:25:14.800259+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:26:22.855592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784817+0000","last_change":"2024-09-17T05:25:14.784817+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784817+0000","last_undegraded":"2024-09-17T05:25:14.784817+0000","last_fullsized":"2024-09-17T05:25:14.784817+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803743+0000","last_change":"2024-09-17T05:25:14.797300+0000","last_active":"2024-09-17T05:25:14.803743+0000","last_peered":"2024-09-17T05:25:14.803743+0000","last_clean":"2024-09-17T05:25:14.803743+0000","last_became_active":"2024-09-17T05:25:14.797009+0000","last_became_peered":"2024-09-17T05:25:14.797009+0000","last_unstale":"2024-09-17T05:25:14.803743+0000","last_undegraded":"2024-09-17T05:25:14.803743+0000","last_fullsized":"2024-09-17T05:25:14.803743+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:48.545193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.780926+0000","last_change":"2024-09-17T05:25:14.780926+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.780926+0000","last_undegraded":"2024-09-17T05:25:14.780926+0000","last_fullsized":"2024-09-17T05:25:14.780926+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.798880+0000","last_change":"2024-09-17T05:25:14.795978+0000","last_active":"2024-09-17T05:25:14.798880+0000","last_peered":"2024-09-17T05:25:14.798880+0000","last_clean":"2024-09-17T05:25:14.798880+0000","last_became_active":"2024-09-17T05:25:14.795145+0000","last_became_peered":"2024-09-17T05:25:14.795145+0000","last_unstale":"2024-09-17T05:25:14.798880+0000","last_undegraded":"2024-09-17T05:25:14.798880+0000","last_fullsized":"2024-09-17T05:25:14.798880+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:10:04.132410+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784898+0000","last_change":"2024-09-17T05:25:14.784898+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784898+0000","last_undegraded":"2024-09-17T05:25:14.784898+0000","last_fullsized":"2024-09-17T05:25:14.784898+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.800959+0000","last_change":"2024-09-17T05:25:14.798054+0000","last_active":"2024-09-17T05:25:14.800959+0000","last_peered":"2024-09-17T05:25:14.800959+0000","last_clean":"2024-09-17T05:25:14.800959+0000","last_became_active":"2024-09-17T05:25:14.797432+0000","last_became_peered":"2024-09-17T05:25:14.797432+0000","last_unstale":"2024-09-17T05:25:14.800959+0000","last_undegraded":"2024-09-17T05:25:14.800959+0000","last_fullsized":"2024-09-17T05:25:14.800959+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:12.183730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782058+0000","last_change":"2024-09-17T05:25:14.782058+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782058+0000","last_undegraded":"2024-09-17T05:25:14.782058+0000","last_fullsized":"2024-09-17T05:25:14.782058+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.804074+0000","last_change":"2024-09-17T05:25:14.801709+0000","last_active":"2024-09-17T05:25:14.804074+0000","last_peered":"2024-09-17T05:25:14.804074+0000","last_clean":"2024-09-17T05:25:14.804074+0000","last_became_active":"2024-09-17T05:25:14.801400+0000","last_became_peered":"2024-09-17T05:25:14.801400+0000","last_unstale":"2024-09-17T05:25:14.804074+0000","last_undegraded":"2024-09-17T05:25:14.804074+0000","last_fullsized":"2024-09-17T05:25:14.804074+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:35:26.294285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785555+0000","last_change":"2024-09-17T05:25:14.785555+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785555+0000","last_undegraded":"2024-09-17T05:25:14.785555+0000","last_fullsized":"2024-09-17T05:25:14.785555+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801025+0000","last_change":"2024-09-17T05:25:14.797861+0000","last_active":"2024-09-17T05:25:14.801025+0000","last_peered":"2024-09-17T05:25:14.801025+0000","last_clean":"2024-09-17T05:25:14.801025+0000","last_became_active":"2024-09-17T05:25:14.797490+0000","last_became_peered":"2024-09-17T05:25:14.797490+0000","last_unstale":"2024-09-17T05:25:14.801025+0000","last_undegraded":"2024-09-17T05:25:14.801025+0000","last_fullsized":"2024-09-17T05:25:14.801025+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:31:23.396355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785302+0000","last_change":"2024-09-17T05:25:14.785302+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785302+0000","last_undegraded":"2024-09-17T05:25:14.785302+0000","last_fullsized":"2024-09-17T05:25:14.785302+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797764+0000","last_change":"2024-09-17T05:25:14.793137+0000","last_active":"2024-09-17T05:25:14.797764+0000","last_peered":"2024-09-17T05:25:14.797764+0000","last_clean":"2024-09-17T05:25:14.797764+0000","last_became_active":"2024-09-17T05:25:14.792865+0000","last_became_peered":"2024-09-17T05:25:14.792865+0000","last_unstale":"2024-09-17T05:25:14.797764+0000","last_undegraded":"2024-09-17T05:25:14.797764+0000","last_fullsized":"2024-09-17T05:25:14.797764+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:57:14.245660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785052+0000","last_change":"2024-09-17T05:25:14.785052+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785052+0000","last_undegraded":"2024-09-17T05:25:14.785052+0000","last_fullsized":"2024-09-17T05:25:14.785052+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801232+0000","last_change":"2024-09-17T05:25:14.798585+0000","last_active":"2024-09-17T05:25:14.801232+0000","last_peered":"2024-09-17T05:25:14.801232+0000","last_clean":"2024-09-17T05:25:14.801232+0000","last_became_active":"2024-09-17T05:25:14.798315+0000","last_became_peered":"2024-09-17T05:25:14.798315+0000","last_unstale":"2024-09-17T05:25:14.801232+0000","last_undegraded":"2024-09-17T05:25:14.801232+0000","last_fullsized":"2024-09-17T05:25:14.801232+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:19.009536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.791159+0000","last_change":"2024-09-17T05:25:14.791159+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.791159+0000","last_undegraded":"2024-09-17T05:25:14.791159+0000","last_fullsized":"2024-09-17T05:25:14.791159+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.789281+0000","last_change":"2024-09-17T05:25:14.786737+0000","last_active":"2024-09-17T05:25:14.789281+0000","last_peered":"2024-09-17T05:25:14.789281+0000","last_clean":"2024-09-17T05:25:14.789281+0000","last_became_active":"2024-09-17T05:25:14.786430+0000","last_became_peered":"2024-09-17T05:25:14.786430+0000","last_unstale":"2024-09-17T05:25:14.789281+0000","last_undegraded":"2024-09-17T05:25:14.789281+0000","last_fullsized":"2024-09-17T05:25:14.789281+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:45:30.752015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783271+0000","last_change":"2024-09-17T05:25:14.783271+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783271+0000","last_undegraded":"2024-09-17T05:25:14.783271+0000","last_fullsized":"2024-09-17T05:25:14.783271+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.806501+0000","last_change":"2024-09-17T05:25:14.804390+0000","last_active":"2024-09-17T05:25:14.806501+0000","last_peered":"2024-09-17T05:25:14.806501+0000","last_clean":"2024-09-17T05:25:14.806501+0000","last_became_active":"2024-09-17T05:25:14.804104+0000","last_became_peered":"2024-09-17T05:25:14.804104+0000","last_unstale":"2024-09-17T05:25:14.806501+0000","last_undegraded":"2024-09-17T05:25:14.806501+0000","last_fullsized":"2024-09-17T05:25:14.806501+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:57:43.762039+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784455+0000","last_change":"2024-09-17T05:25:14.784455+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784455+0000","last_undegraded":"2024-09-17T05:25:14.784455+0000","last_fullsized":"2024-09-17T05:25:14.784455+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797999+0000","last_change":"2024-09-17T05:25:14.795475+0000","last_active":"2024-09-17T05:25:14.797999+0000","last_peered":"2024-09-17T05:25:14.797999+0000","last_clean":"2024-09-17T05:25:14.797999+0000","last_became_active":"2024-09-17T05:25:14.795056+0000","last_became_peered":"2024-09-17T05:25:14.795056+0000","last_unstale":"2024-09-17T05:25:14.797999+0000","last_undegraded":"2024-09-17T05:25:14.797999+0000","last_fullsized":"2024-09-17T05:25:14.797999+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:34.520059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784762+0000","last_change":"2024-09-17T05:25:14.784762+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784762+0000","last_undegraded":"2024-09-17T05:25:14.784762+0000","last_fullsized":"2024-09-17T05:25:14.784762+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.801430+0000","last_change":"2024-09-17T05:25:14.799199+0000","last_active":"2024-09-17T05:25:14.801430+0000","last_peered":"2024-09-17T05:25:14.801430+0000","last_clean":"2024-09-17T05:25:14.801430+0000","last_became_active":"2024-09-17T05:25:14.798912+0000","last_became_peered":"2024-09-17T05:25:14.798912+0000","last_unstale":"2024-09-17T05:25:14.801430+0000","last_undegraded":"2024-09-17T05:25:14.801430+0000","last_fullsized":"2024-09-17T05:25:14.801430+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:43.075420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.782477+0000","last_change":"2024-09-17T05:25:14.782477+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.782477+0000","last_undegraded":"2024-09-17T05:25:14.782477+0000","last_fullsized":"2024-09-17T05:25:14.782477+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803817+0000","last_change":"2024-09-17T05:25:14.799256+0000","last_active":"2024-09-17T05:25:14.803817+0000","last_peered":"2024-09-17T05:25:14.803817+0000","last_clean":"2024-09-17T05:25:14.803817+0000","last_became_active":"2024-09-17T05:25:14.798928+0000","last_became_peered":"2024-09-17T05:25:14.798928+0000","last_unstale":"2024-09-17T05:25:14.803817+0000","last_undegraded":"2024-09-17T05:25:14.803817+0000","last_fullsized":"2024-09-17T05:25:14.803817+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:15.171449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783219+0000","last_change":"2024-09-17T05:25:14.783219+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783219+0000","last_undegraded":"2024-09-17T05:25:14.783219+0000","last_fullsized":"2024-09-17T05:25:14.783219+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795029+0000","last_change":"2024-09-17T05:25:14.792783+0000","last_active":"2024-09-17T05:25:14.795029+0000","last_peered":"2024-09-17T05:25:14.795029+0000","last_clean":"2024-09-17T05:25:14.795029+0000","last_became_active":"2024-09-17T05:25:14.792499+0000","last_became_peered":"2024-09-17T05:25:14.792499+0000","last_unstale":"2024-09-17T05:25:14.795029+0000","last_undegraded":"2024-09-17T05:25:14.795029+0000","last_fullsized":"2024-09-17T05:25:14.795029+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:18.986046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.783896+0000","last_change":"2024-09-17T05:25:14.783896+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.783896+0000","last_undegraded":"2024-09-17T05:25:14.783896+0000","last_fullsized":"2024-09-17T05:25:14.783896+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803679+0000","last_change":"2024-09-17T05:25:14.795833+0000","last_active":"2024-09-17T05:25:14.803679+0000","last_peered":"2024-09-17T05:25:14.803679+0000","last_clean":"2024-09-17T05:25:14.803679+0000","last_became_active":"2024-09-17T05:25:14.795529+0000","last_became_peered":"2024-09-17T05:25:14.795529+0000","last_unstale":"2024-09-17T05:25:14.803679+0000","last_undegraded":"2024-09-17T05:25:14.803679+0000","last_fullsized":"2024-09-17T05:25:14.803679+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:52.856520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785961+0000","last_change":"2024-09-17T05:25:14.785961+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785961+0000","last_undegraded":"2024-09-17T05:25:14.785961+0000","last_fullsized":"2024-09-17T05:25:14.785961+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.797664+0000","last_change":"2024-09-17T05:25:14.790605+0000","last_active":"2024-09-17T05:25:14.797664+0000","last_peered":"2024-09-17T05:25:14.797664+0000","last_clean":"2024-09-17T05:25:14.797664+0000","last_became_active":"2024-09-17T05:25:14.790285+0000","last_became_peered":"2024-09-17T05:25:14.790285+0000","last_unstale":"2024-09-17T05:25:14.797664+0000","last_undegraded":"2024-09-17T05:25:14.797664+0000","last_fullsized":"2024-09-17T05:25:14.797664+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:43:38.509048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784285+0000","last_change":"2024-09-17T05:25:14.784285+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784285+0000","last_undegraded":"2024-09-17T05:25:14.784285+0000","last_fullsized":"2024-09-17T05:25:14.784285+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.803766+0000","last_change":"2024-09-17T05:25:14.799017+0000","last_active":"2024-09-17T05:25:14.803766+0000","last_peered":"2024-09-17T05:25:14.803766+0000","last_clean":"2024-09-17T05:25:14.803766+0000","last_became_active":"2024-09-17T05:25:14.798741+0000","last_became_peered":"2024-09-17T05:25:14.798741+0000","last_unstale":"2024-09-17T05:25:14.803766+0000","last_undegraded":"2024-09-17T05:25:14.803766+0000","last_fullsized":"2024-09-17T05:25:14.803766+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:56:10.566412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.784380+0000","last_change":"2024-09-17T05:25:14.784380+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.784380+0000","last_undegraded":"2024-09-17T05:25:14.784380+0000","last_fullsized":"2024-09-17T05:25:14.784380+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.791849+0000","last_change":"2024-09-17T05:25:14.788995+0000","last_active":"2024-09-17T05:25:14.791849+0000","last_peered":"2024-09-17T05:25:14.791849+0000","last_clean":"2024-09-17T05:25:14.791849+0000","last_became_active":"2024-09-17T05:25:14.788708+0000","last_became_peered":"2024-09-17T05:25:14.788708+0000","last_unstale":"2024-09-17T05:25:14.791849+0000","last_undegraded":"2024-09-17T05:25:14.791849+0000","last_fullsized":"2024-09-17T05:25:14.791849+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:50.260359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":1,"reported_epoch":138,"state":"creating+peering","last_fresh":"2024-09-17T05:25:14.785828+0000","last_change":"2024-09-17T05:25:14.785828+0000","last_active":"2024-09-17T05:25:14.771353+0000","last_peered":"2024-09-17T05:25:14.771353+0000","last_clean":"2024-09-17T05:25:14.771353+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:14.785828+0000","last_undegraded":"2024-09-17T05:25:14.785828+0000","last_fullsized":"2024-09-17T05:25:14.785828+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"no scrub is scheduled","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":10,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.795740+0000","last_change":"2024-09-17T05:25:14.793360+0000","last_active":"2024-09-17T05:25:14.795740+0000","last_peered":"2024-09-17T05:25:14.795740+0000","last_clean":"2024-09-17T05:25:14.795740+0000","last_became_active":"2024-09-17T05:25:14.793062+0000","last_became_peered":"2024-09-17T05:25:14.793062+0000","last_unstale":"2024-09-17T05:25:14.795740+0000","last_undegraded":"2024-09-17T05:25:14.795740+0000","last_fullsized":"2024-09-17T05:25:14.795740+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:03.046454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":346,"reported_epoch":138,"state":"active+clean","last_fresh":"2024-09-17T05:25:14.791836+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:25:14.791836+0000","last_peered":"2024-09-17T05:25:14.791836+0000","last_clean":"2024-09-17T05:25:14.791836+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:25:14.791836+0000","last_undegraded":"2024-09-17T05:25:14.791836+0000","last_fullsized":"2024-09-17T05:25:14.791836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509524,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33444,"kb_used_data":2256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338396,"statfs":{"total":96636764160,"available":96602517504,"internally_reserved":0,"allocated":2310144,"data_stored":1343994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32872,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338968,"statfs":{"total":96636764160,"available":96603103232,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509523,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32888,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338952,"statfs":{"total":96636764160,"available":96603086848,"internally_reserved":0,"allocated":1728512,"data_stored":759973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509523,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32880,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338960,"statfs":{"total":96636764160,"available":96603095040,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509524,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32864,"kb_used_data":1676,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338976,"statfs":{"total":96636764160,"available":96603111424,"internally_reserved":0,"allocated":1716224,"data_stored":753626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509523,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32876,"kb_used_data":1688,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338964,"statfs":{"total":96636764160,"available":96603099136,"internally_reserved":0,"allocated":1728512,"data_stored":759973,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574932,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33468,"kb_used_data":2268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338372,"statfs":{"total":96636764160,"available":96602492928,"internally_reserved":0,"allocated":2322432,"data_stored":1350341,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:25:19.432 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3f is not active+clean 2024-09-17T05:25:19.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.789798+0000', 'last_change': '2024-09-17T05:25:14.789798+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.789798+0000', 'last_undegraded': '2024-09-17T05:25:14.789798+0000', 'last_fullsized': '2024-09-17T05:25:14.789798+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:25:19.432 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3e is not active+clean 2024-09-17T05:25:19.432 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.787155+0000', 'last_change': '2024-09-17T05:25:14.787155+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.787155+0000', 'last_undegraded': '2024-09-17T05:25:14.787155+0000', 'last_fullsized': '2024-09-17T05:25:14.787155+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.432 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3d is not active+clean 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786712+0000', 'last_change': '2024-09-17T05:25:14.786712+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786712+0000', 'last_undegraded': '2024-09-17T05:25:14.786712+0000', 'last_fullsized': '2024-09-17T05:25:14.786712+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3c is not active+clean 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785289+0000', 'last_change': '2024-09-17T05:25:14.785289+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785289+0000', 'last_undegraded': '2024-09-17T05:25:14.785289+0000', 'last_fullsized': '2024-09-17T05:25:14.785289+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3b is not active+clean 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.787383+0000', 'last_change': '2024-09-17T05:25:14.787383+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.787383+0000', 'last_undegraded': '2024-09-17T05:25:14.787383+0000', 'last_fullsized': '2024-09-17T05:25:14.787383+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3a is not active+clean 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784597+0000', 'last_change': '2024-09-17T05:25:14.784597+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784597+0000', 'last_undegraded': '2024-09-17T05:25:14.784597+0000', 'last_fullsized': '2024-09-17T05:25:14.784597+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:PG 23.39 is not active+clean 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.39', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.788310+0000', 'last_change': '2024-09-17T05:25:14.788310+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.788310+0000', 'last_undegraded': '2024-09-17T05:25:14.788310+0000', 'last_fullsized': '2024-09-17T05:25:14.788310+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:PG 23.38 is not active+clean 2024-09-17T05:25:19.433 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.38', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785064+0000', 'last_change': '2024-09-17T05:25:14.785064+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785064+0000', 'last_undegraded': '2024-09-17T05:25:14.785064+0000', 'last_fullsized': '2024-09-17T05:25:14.785064+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:PG 23.37 is not active+clean 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.37', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786990+0000', 'last_change': '2024-09-17T05:25:14.786990+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786990+0000', 'last_undegraded': '2024-09-17T05:25:14.786990+0000', 'last_fullsized': '2024-09-17T05:25:14.786990+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:PG 23.36 is not active+clean 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.36', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784493+0000', 'last_change': '2024-09-17T05:25:14.784493+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784493+0000', 'last_undegraded': '2024-09-17T05:25:14.784493+0000', 'last_fullsized': '2024-09-17T05:25:14.784493+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:PG 23.35 is not active+clean 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.35', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.789107+0000', 'last_change': '2024-09-17T05:25:14.789107+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.789107+0000', 'last_undegraded': '2024-09-17T05:25:14.789107+0000', 'last_fullsized': '2024-09-17T05:25:14.789107+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:PG 23.34 is not active+clean 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.34', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.787653+0000', 'last_change': '2024-09-17T05:25:14.787653+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.787653+0000', 'last_undegraded': '2024-09-17T05:25:14.787653+0000', 'last_fullsized': '2024-09-17T05:25:14.787653+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:PG 23.33 is not active+clean 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.33', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784806+0000', 'last_change': '2024-09-17T05:25:14.784806+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784806+0000', 'last_undegraded': '2024-09-17T05:25:14.784806+0000', 'last_fullsized': '2024-09-17T05:25:14.784806+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.434 INFO:tasks.ceph.ceph_manager.ceph:PG 23.32 is not active+clean 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.32', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785755+0000', 'last_change': '2024-09-17T05:25:14.785755+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785755+0000', 'last_undegraded': '2024-09-17T05:25:14.785755+0000', 'last_fullsized': '2024-09-17T05:25:14.785755+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:PG 23.31 is not active+clean 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.31', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.788503+0000', 'last_change': '2024-09-17T05:25:14.788503+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.788503+0000', 'last_undegraded': '2024-09-17T05:25:14.788503+0000', 'last_fullsized': '2024-09-17T05:25:14.788503+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:PG 23.30 is not active+clean 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.30', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.787455+0000', 'last_change': '2024-09-17T05:25:14.787455+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.787455+0000', 'last_undegraded': '2024-09-17T05:25:14.787455+0000', 'last_fullsized': '2024-09-17T05:25:14.787455+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2f is not active+clean 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783802+0000', 'last_change': '2024-09-17T05:25:14.783802+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783802+0000', 'last_undegraded': '2024-09-17T05:25:14.783802+0000', 'last_fullsized': '2024-09-17T05:25:14.783802+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2e is not active+clean 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.787359+0000', 'last_change': '2024-09-17T05:25:14.787359+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.787359+0000', 'last_undegraded': '2024-09-17T05:25:14.787359+0000', 'last_fullsized': '2024-09-17T05:25:14.787359+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2d is not active+clean 2024-09-17T05:25:19.435 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783749+0000', 'last_change': '2024-09-17T05:25:14.783749+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783749+0000', 'last_undegraded': '2024-09-17T05:25:14.783749+0000', 'last_fullsized': '2024-09-17T05:25:14.783749+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2c is not active+clean 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783705+0000', 'last_change': '2024-09-17T05:25:14.783705+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783705+0000', 'last_undegraded': '2024-09-17T05:25:14.783705+0000', 'last_fullsized': '2024-09-17T05:25:14.783705+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2b is not active+clean 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784281+0000', 'last_change': '2024-09-17T05:25:14.784281+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784281+0000', 'last_undegraded': '2024-09-17T05:25:14.784281+0000', 'last_fullsized': '2024-09-17T05:25:14.784281+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2a is not active+clean 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784726+0000', 'last_change': '2024-09-17T05:25:14.784726+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784726+0000', 'last_undegraded': '2024-09-17T05:25:14.784726+0000', 'last_fullsized': '2024-09-17T05:25:14.784726+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:PG 23.29 is not active+clean 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.29', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784154+0000', 'last_change': '2024-09-17T05:25:14.784154+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784154+0000', 'last_undegraded': '2024-09-17T05:25:14.784154+0000', 'last_fullsized': '2024-09-17T05:25:14.784154+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:PG 23.28 is not active+clean 2024-09-17T05:25:19.436 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.28', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784291+0000', 'last_change': '2024-09-17T05:25:14.784291+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784291+0000', 'last_undegraded': '2024-09-17T05:25:14.784291+0000', 'last_fullsized': '2024-09-17T05:25:14.784291+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:PG 23.27 is not active+clean 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.27', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785930+0000', 'last_change': '2024-09-17T05:25:14.785930+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785930+0000', 'last_undegraded': '2024-09-17T05:25:14.785930+0000', 'last_fullsized': '2024-09-17T05:25:14.785930+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:PG 23.26 is not active+clean 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.26', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.787157+0000', 'last_change': '2024-09-17T05:25:14.787157+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.787157+0000', 'last_undegraded': '2024-09-17T05:25:14.787157+0000', 'last_fullsized': '2024-09-17T05:25:14.787157+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:PG 23.25 is not active+clean 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.25', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786160+0000', 'last_change': '2024-09-17T05:25:14.786160+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786160+0000', 'last_undegraded': '2024-09-17T05:25:14.786160+0000', 'last_fullsized': '2024-09-17T05:25:14.786160+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:PG 23.24 is not active+clean 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.24', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784796+0000', 'last_change': '2024-09-17T05:25:14.784796+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784796+0000', 'last_undegraded': '2024-09-17T05:25:14.784796+0000', 'last_fullsized': '2024-09-17T05:25:14.784796+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:PG 23.23 is not active+clean 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.23', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784361+0000', 'last_change': '2024-09-17T05:25:14.784361+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784361+0000', 'last_undegraded': '2024-09-17T05:25:14.784361+0000', 'last_fullsized': '2024-09-17T05:25:14.784361+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.437 INFO:tasks.ceph.ceph_manager.ceph:PG 23.22 is not active+clean 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.22', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783316+0000', 'last_change': '2024-09-17T05:25:14.783316+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783316+0000', 'last_undegraded': '2024-09-17T05:25:14.783316+0000', 'last_fullsized': '2024-09-17T05:25:14.783316+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:PG 23.21 is not active+clean 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.21', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783417+0000', 'last_change': '2024-09-17T05:25:14.783417+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783417+0000', 'last_undegraded': '2024-09-17T05:25:14.783417+0000', 'last_fullsized': '2024-09-17T05:25:14.783417+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:PG 23.20 is not active+clean 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.20', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786901+0000', 'last_change': '2024-09-17T05:25:14.786901+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786901+0000', 'last_undegraded': '2024-09-17T05:25:14.786901+0000', 'last_fullsized': '2024-09-17T05:25:14.786901+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1e is not active+clean 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786688+0000', 'last_change': '2024-09-17T05:25:14.786688+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786688+0000', 'last_undegraded': '2024-09-17T05:25:14.786688+0000', 'last_fullsized': '2024-09-17T05:25:14.786688+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1f is not active+clean 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784475+0000', 'last_change': '2024-09-17T05:25:14.784475+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784475+0000', 'last_undegraded': '2024-09-17T05:25:14.784475+0000', 'last_fullsized': '2024-09-17T05:25:14.784475+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:25:19.438 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1c is not active+clean 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783103+0000', 'last_change': '2024-09-17T05:25:14.783103+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783103+0000', 'last_undegraded': '2024-09-17T05:25:14.783103+0000', 'last_fullsized': '2024-09-17T05:25:14.783103+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1d is not active+clean 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785398+0000', 'last_change': '2024-09-17T05:25:14.785398+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785398+0000', 'last_undegraded': '2024-09-17T05:25:14.785398+0000', 'last_fullsized': '2024-09-17T05:25:14.785398+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1a is not active+clean 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786489+0000', 'last_change': '2024-09-17T05:25:14.786489+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786489+0000', 'last_undegraded': '2024-09-17T05:25:14.786489+0000', 'last_fullsized': '2024-09-17T05:25:14.786489+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1b is not active+clean 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.781301+0000', 'last_change': '2024-09-17T05:25:14.781301+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.781301+0000', 'last_undegraded': '2024-09-17T05:25:14.781301+0000', 'last_fullsized': '2024-09-17T05:25:14.781301+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:PG 23.18 is not active+clean 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.781667+0000', 'last_change': '2024-09-17T05:25:14.781667+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.781667+0000', 'last_undegraded': '2024-09-17T05:25:14.781667+0000', 'last_fullsized': '2024-09-17T05:25:14.781667+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:PG 23.19 is not active+clean 2024-09-17T05:25:19.439 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783726+0000', 'last_change': '2024-09-17T05:25:14.783726+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783726+0000', 'last_undegraded': '2024-09-17T05:25:14.783726+0000', 'last_fullsized': '2024-09-17T05:25:14.783726+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:PG 23.17 is not active+clean 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786430+0000', 'last_change': '2024-09-17T05:25:14.786430+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786430+0000', 'last_undegraded': '2024-09-17T05:25:14.786430+0000', 'last_fullsized': '2024-09-17T05:25:14.786430+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:PG 23.14 is not active+clean 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785343+0000', 'last_change': '2024-09-17T05:25:14.785343+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785343+0000', 'last_undegraded': '2024-09-17T05:25:14.785343+0000', 'last_fullsized': '2024-09-17T05:25:14.785343+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:PG 23.15 is not active+clean 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.782704+0000', 'last_change': '2024-09-17T05:25:14.782704+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.782704+0000', 'last_undegraded': '2024-09-17T05:25:14.782704+0000', 'last_fullsized': '2024-09-17T05:25:14.782704+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:PG 23.12 is not active+clean 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785777+0000', 'last_change': '2024-09-17T05:25:14.785777+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785777+0000', 'last_undegraded': '2024-09-17T05:25:14.785777+0000', 'last_fullsized': '2024-09-17T05:25:14.785777+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:PG 23.13 is not active+clean 2024-09-17T05:25:19.440 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.786026+0000', 'last_change': '2024-09-17T05:25:14.786026+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.786026+0000', 'last_undegraded': '2024-09-17T05:25:14.786026+0000', 'last_fullsized': '2024-09-17T05:25:14.786026+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:PG 23.10 is not active+clean 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.780573+0000', 'last_change': '2024-09-17T05:25:14.780573+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.780573+0000', 'last_undegraded': '2024-09-17T05:25:14.780573+0000', 'last_fullsized': '2024-09-17T05:25:14.780573+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:PG 23.11 is not active+clean 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784817+0000', 'last_change': '2024-09-17T05:25:14.784817+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784817+0000', 'last_undegraded': '2024-09-17T05:25:14.784817+0000', 'last_fullsized': '2024-09-17T05:25:14.784817+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:PG 23.e is not active+clean 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.780926+0000', 'last_change': '2024-09-17T05:25:14.780926+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.780926+0000', 'last_undegraded': '2024-09-17T05:25:14.780926+0000', 'last_fullsized': '2024-09-17T05:25:14.780926+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:PG 23.f is not active+clean 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784898+0000', 'last_change': '2024-09-17T05:25:14.784898+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784898+0000', 'last_undegraded': '2024-09-17T05:25:14.784898+0000', 'last_fullsized': '2024-09-17T05:25:14.784898+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:PG 23.c is not active+clean 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.782058+0000', 'last_change': '2024-09-17T05:25:14.782058+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.782058+0000', 'last_undegraded': '2024-09-17T05:25:14.782058+0000', 'last_fullsized': '2024-09-17T05:25:14.782058+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2024-09-17T05:25:19.441 INFO:tasks.ceph.ceph_manager.ceph:PG 23.d is not active+clean 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785555+0000', 'last_change': '2024-09-17T05:25:14.785555+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785555+0000', 'last_undegraded': '2024-09-17T05:25:14.785555+0000', 'last_fullsized': '2024-09-17T05:25:14.785555+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:PG 23.a is not active+clean 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785302+0000', 'last_change': '2024-09-17T05:25:14.785302+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785302+0000', 'last_undegraded': '2024-09-17T05:25:14.785302+0000', 'last_fullsized': '2024-09-17T05:25:14.785302+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:PG 23.b is not active+clean 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785052+0000', 'last_change': '2024-09-17T05:25:14.785052+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785052+0000', 'last_undegraded': '2024-09-17T05:25:14.785052+0000', 'last_fullsized': '2024-09-17T05:25:14.785052+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:PG 23.8 is not active+clean 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.791159+0000', 'last_change': '2024-09-17T05:25:14.791159+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.791159+0000', 'last_undegraded': '2024-09-17T05:25:14.791159+0000', 'last_fullsized': '2024-09-17T05:25:14.791159+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:PG 23.9 is not active+clean 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783271+0000', 'last_change': '2024-09-17T05:25:14.783271+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783271+0000', 'last_undegraded': '2024-09-17T05:25:14.783271+0000', 'last_fullsized': '2024-09-17T05:25:14.783271+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:PG 23.6 is not active+clean 2024-09-17T05:25:19.442 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784455+0000', 'last_change': '2024-09-17T05:25:14.784455+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784455+0000', 'last_undegraded': '2024-09-17T05:25:14.784455+0000', 'last_fullsized': '2024-09-17T05:25:14.784455+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:PG 23.7 is not active+clean 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784762+0000', 'last_change': '2024-09-17T05:25:14.784762+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784762+0000', 'last_undegraded': '2024-09-17T05:25:14.784762+0000', 'last_fullsized': '2024-09-17T05:25:14.784762+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:PG 23.4 is not active+clean 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.782477+0000', 'last_change': '2024-09-17T05:25:14.782477+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.782477+0000', 'last_undegraded': '2024-09-17T05:25:14.782477+0000', 'last_fullsized': '2024-09-17T05:25:14.782477+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:PG 23.5 is not active+clean 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783219+0000', 'last_change': '2024-09-17T05:25:14.783219+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783219+0000', 'last_undegraded': '2024-09-17T05:25:14.783219+0000', 'last_fullsized': '2024-09-17T05:25:14.783219+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:PG 23.2 is not active+clean 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.783896+0000', 'last_change': '2024-09-17T05:25:14.783896+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.783896+0000', 'last_undegraded': '2024-09-17T05:25:14.783896+0000', 'last_fullsized': '2024-09-17T05:25:14.783896+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:PG 23.3 is not active+clean 2024-09-17T05:25:19.443 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785961+0000', 'last_change': '2024-09-17T05:25:14.785961+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785961+0000', 'last_undegraded': '2024-09-17T05:25:14.785961+0000', 'last_fullsized': '2024-09-17T05:25:14.785961+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2024-09-17T05:25:19.444 INFO:tasks.ceph.ceph_manager.ceph:PG 23.0 is not active+clean 2024-09-17T05:25:19.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784285+0000', 'last_change': '2024-09-17T05:25:14.784285+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784285+0000', 'last_undegraded': '2024-09-17T05:25:14.784285+0000', 'last_fullsized': '2024-09-17T05:25:14.784285+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2024-09-17T05:25:19.444 INFO:tasks.ceph.ceph_manager.ceph:PG 23.1 is not active+clean 2024-09-17T05:25:19.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.784380+0000', 'last_change': '2024-09-17T05:25:14.784380+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.784380+0000', 'last_undegraded': '2024-09-17T05:25:14.784380+0000', 'last_fullsized': '2024-09-17T05:25:14.784380+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2024-09-17T05:25:19.444 INFO:tasks.ceph.ceph_manager.ceph:PG 23.16 is not active+clean 2024-09-17T05:25:19.444 INFO:tasks.ceph.ceph_manager.ceph:{'pgid': '23.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 138, 'state': 'creating+peering', 'last_fresh': '2024-09-17T05:25:14.785828+0000', 'last_change': '2024-09-17T05:25:14.785828+0000', 'last_active': '2024-09-17T05:25:14.771353+0000', 'last_peered': '2024-09-17T05:25:14.771353+0000', 'last_clean': '2024-09-17T05:25:14.771353+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2024-09-17T05:25:14.785828+0000', 'last_undegraded': '2024-09-17T05:25:14.785828+0000', 'last_fullsized': '2024-09-17T05:25:14.785828+0000', 'mapping_epoch': 138, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 138, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'last_clean_scrub_stamp': '2024-09-17T05:25:14.771353+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'no scrub is scheduled', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2024-09-17T05:25:19.445 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2024-09-17T05:25:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.567+0000 7febd1b7d640 1 -- 172.21.15.81:0/3635066096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb80062d0 msgr2=0x7febb800cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.567+0000 7febd1b7d640 1 --2- 172.21.15.81:0/3635066096 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febb80062d0 0x7febb800cad0 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7febc400c610 tx=0x7febb8006940 comp rx=0 tx=0).stop 2024-09-17T05:25:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.567+0000 7febcbfff640 1 -- 172.21.15.81:0/3635066096 reap_dead start 2024-09-17T05:25:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.567+0000 7febd1b7d640 1 -- 172.21.15.81:0/3635066096 shutdown_connections 2024-09-17T05:25:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.567+0000 7febd1b7d640 1 -- 172.21.15.81:0/3635066096 >> 172.21.15.81:0/3635066096 conn(0x7febcc06cf60 msgr2=0x7febcc06d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.568+0000 7febd1b7d640 1 -- 172.21.15.81:0/3635066096 shutdown_connections 2024-09-17T05:25:19.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.568+0000 7febd1b7d640 1 -- 172.21.15.81:0/3635066096 wait complete. 2024-09-17T05:25:19.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.569+0000 7febd1b7d640 1 Processor -- start 2024-09-17T05:25:19.570 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.569+0000 7febd1b7d640 1 -- start start 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febb80062d0 0x7febcc1f4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febcc153fc0 0x7febcc154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7febcc1f0620 0x7febcc1f0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7febcc072930 con 0x7febcc153fc0 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7febcc0727b0 con 0x7febb80062d0 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7febcc06f3c0 con 0x7febcc1f0620 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febcc153fc0 0x7febcc154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febcc153fc0 0x7febcc154440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54156/0 (socket says 172.21.15.81:54156) 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 -- 172.21.15.81:0/1526913783 learned_addr learned my addr 172.21.15.81:0/1526913783 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcb7fe640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febb80062d0 0x7febcc1f4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcbfff640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7febcc1f0620 0x7febcc1f0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 -- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7febcc1f0620 msgr2=0x7febcc1f0aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7febcc1f0620 0x7febcc1f0aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 -- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febb80062d0 msgr2=0x7febcc1f4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febb80062d0 0x7febcc1f4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 -- 172.21.15.81:0/1526913783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7febcc1f1350 con 0x7febcc153fc0 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcb7fe640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febb80062d0 0x7febcc1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febcaffd640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febcc153fc0 0x7febcc154440 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7febbc00fa30 tx=0x7febbc00fef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febc3fff640 1 -- 172.21.15.81:0/1526913783 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc00bcb0 con 0x7febcc153fc0 2024-09-17T05:25:19.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febc3fff640 1 -- 172.21.15.81:0/1526913783 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7febbc011440 con 0x7febcc153fc0 2024-09-17T05:25:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7febcc1f1980 con 0x7febcc153fc0 2024-09-17T05:25:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febc3fff640 1 -- 172.21.15.81:0/1526913783 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7febbc011890 con 0x7febcc153fc0 2024-09-17T05:25:19.574 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.570+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7febcc1f1f40 con 0x7febcc153fc0 2024-09-17T05:25:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.571+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7febcc0b32c0 con 0x7febcc153fc0 2024-09-17T05:25:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.572+0000 7febc3fff640 1 -- 172.21.15.81:0/1526913783 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7febbc019020 con 0x7febcc153fc0 2024-09-17T05:25:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.573+0000 7febc3fff640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7febac079250 0x7febac07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.573+0000 7febcb7fe640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7febac079250 0x7febac07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.573+0000 7febc3fff640 1 -- 172.21.15.81:0/1526913783 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7febbc09c4e0 con 0x7febcc153fc0 2024-09-17T05:25:19.575 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.573+0000 7febcb7fe640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7febac079250 0x7febac07b710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7febb4000c00 tx=0x7febb4006c90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:19.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.577+0000 7febc3fff640 1 -- 172.21.15.81:0/1526913783 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7febcc0b32c0 con 0x7febcc153fc0 2024-09-17T05:25:19.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.821+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) -- 0x7febcc0740d0 con 0x7febcc153fc0 2024-09-17T05:25:19.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.821+0000 7febc3fff640 1 -- 172.21.15.81:0/1526913783 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) ==== 72+0+1499 (secure 0 0 0) 0x7febbc063e30 con 0x7febcc153fc0 2024-09-17T05:25:19.822 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:19.822 INFO:teuthology.orchestra.run.smithi081.stdout:{"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":416,"monmap":{"epoch":1,"min_mon_release_name":"squid","num_mons":3},"osdmap":{"epoch":140,"num_osds":8,"num_up_osds":8,"osd_up_since":1726550316,"num_in_osds":8,"osd_in_since":1726550306,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"creating+peering","count":64},{"state_name":"active+clean","count":33}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":270508032,"bytes_avail":772823605248,"bytes_total":773094113280,"inactive_pgs_ratio":0.65979379415512085},"fsmap":{"epoch":84,"btime":"2024-09-17T05:25:17:786037+0000","id":11,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":11,"rank":0,"name":"b","status":"up:active","gid":8439}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":14,"modified":"2024-09-17T05:25:06.050655+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2024-09-17T05:25:19.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7febac079250 msgr2=0x7febac07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7febac079250 0x7febac07b710 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7febb4000c00 tx=0x7febb4006c90 comp rx=0 tx=0).stop 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febcc153fc0 msgr2=0x7febcc154440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febcc153fc0 0x7febcc154440 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7febbc00fa30 tx=0x7febbc00fef0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 shutdown_connections 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7febcc1f0620 0x7febcc1f0aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7febcc153fc0 0x7febcc154440 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7febac079250 0x7febac07b710 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 --2- 172.21.15.81:0/1526913783 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7febb80062d0 0x7febcc1f4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 >> 172.21.15.81:0/1526913783 conn(0x7febcc06cf60 msgr2=0x7febcc0cff20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 shutdown_connections 2024-09-17T05:25:19.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.823+0000 7febd1b7d640 1 -- 172.21.15.81:0/1526913783 wait complete. 2024-09-17T05:25:19.835 INFO:tasks.ceph.ceph_manager.ceph:no progress seen, keeping timeout for now 2024-09-17T05:25:19.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:25:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.936+0000 7fbe79752640 1 -- 172.21.15.81:0/2917260582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe60003a50 msgr2=0x7fbe60003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.936+0000 7fbe79752640 1 --2- 172.21.15.81:0/2917260582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe60003a50 0x7fbe60003e70 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c770 tx=0x7fbe60005830 comp rx=0 tx=0).stop 2024-09-17T05:25:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.936+0000 7fbe79752640 1 -- 172.21.15.81:0/2917260582 shutdown_connections 2024-09-17T05:25:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.936+0000 7fbe79752640 1 --2- 172.21.15.81:0/2917260582 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe60003a50 0x7fbe60003e70 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.936+0000 7fbe79752640 1 -- 172.21.15.81:0/2917260582 >> 172.21.15.81:0/2917260582 conn(0x7fbe740d3ea0 msgr2=0x7fbe740d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.936+0000 7fbe79752640 1 -- 172.21.15.81:0/2917260582 shutdown_connections 2024-09-17T05:25:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.936+0000 7fbe79752640 1 -- 172.21.15.81:0/2917260582 wait complete. 2024-09-17T05:25:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.937+0000 7fbe79752640 1 Processor -- start 2024-09-17T05:25:19.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.937+0000 7fbe79752640 1 -- start start 2024-09-17T05:25:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe79752640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe60003a50 0x7fbe7415e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe79752640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe741f8cd0 0x7fbe741610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe79752640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe741f80c0 0x7fbe741f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe79752640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe740cf9b0 con 0x7fbe741f8cd0 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe79752640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe741627a0 con 0x7fbe60003a50 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe79752640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbe740cfb30 con 0x7fbe741f80c0 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe741f8cd0 0x7fbe741610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe741f8cd0 0x7fbe741610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:54168/0 (socket says 172.21.15.81:54168) 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 -- 172.21.15.81:0/929703509 learned_addr learned my addr 172.21.15.81:0/929703509 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe72ffd640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe60003a50 0x7fbe7415e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe737fe640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe741f80c0 0x7fbe741f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 -- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe741f80c0 msgr2=0x7fbe741f8550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe741f80c0 0x7fbe741f8550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 -- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe60003a50 msgr2=0x7fbe7415e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:19.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe60003a50 0x7fbe7415e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe727fc640 1 -- 172.21.15.81:0/929703509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe74155b60 con 0x7fbe741f8cd0 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.938+0000 7fbe737fe640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe741f80c0 0x7fbe741f8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.939+0000 7fbe727fc640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe741f8cd0 0x7fbe741610a0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c011780 tx=0x7fbe5c011c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.939+0000 7fbe6b7fe640 1 -- 172.21.15.81:0/929703509 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c00fd50 con 0x7fbe741f8cd0 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.939+0000 7fbe6b7fe640 1 -- 172.21.15.81:0/929703509 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe5c011e90 con 0x7fbe741f8cd0 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.939+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe74156ea0 con 0x7fbe741f8cd0 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.939+0000 7fbe6b7fe640 1 -- 172.21.15.81:0/929703509 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c004290 con 0x7fbe741f8cd0 2024-09-17T05:25:19.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.939+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe741560e0 con 0x7fbe741f8cd0 2024-09-17T05:25:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.940+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe740d07a0 con 0x7fbe741f8cd0 2024-09-17T05:25:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.940+0000 7fbe6b7fe640 1 -- 172.21.15.81:0/929703509 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fbe5c0035f0 con 0x7fbe741f8cd0 2024-09-17T05:25:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.941+0000 7fbe6b7fe640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe54079250 0x7fbe5407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.941+0000 7fbe72ffd640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe54079250 0x7fbe5407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.941+0000 7fbe6b7fe640 1 -- 172.21.15.81:0/929703509 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fbe5c09c4b0 con 0x7fbe741f8cd0 2024-09-17T05:25:19.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.941+0000 7fbe72ffd640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe54079250 0x7fbe5407b710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe64033000 tx=0x7fbe64001360 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:19.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:19.945+0000 7fbe6b7fe640 1 -- 172.21.15.81:0/929703509 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbe5c063940 con 0x7fbe741f8cd0 2024-09-17T05:25:20.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.121+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fbe7406eb90 con 0x7fbe54079250 2024-09-17T05:25:20.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.124+0000 7fbe6b7fe640 1 -- 172.21.15.81:0/929703509 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252480 (secure 0 0 0) 0x7fbe7406eb90 con 0x7fbe54079250 2024-09-17T05:25:20.128 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:20.129 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:25:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.127+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe54079250 msgr2=0x7fbe5407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:20.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe54079250 0x7fbe5407b710 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fbe64033000 tx=0x7fbe64001360 comp rx=0 tx=0).stop 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe741f8cd0 msgr2=0x7fbe741610a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe741f8cd0 0x7fbe741610a0 secure :-1 s=READY pgs=1570 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c011780 tx=0x7fbe5c011c40 comp rx=0 tx=0).stop 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 shutdown_connections 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe741f80c0 0x7fbe741f8550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe741f8cd0 0x7fbe741610a0 unknown :-1 s=CLOSED pgs=1570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe54079250 0x7fbe5407b710 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 --2- 172.21.15.81:0/929703509 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe60003a50 0x7fbe7415e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 >> 172.21.15.81:0/929703509 conn(0x7fbe740d3ea0 msgr2=0x7fbe740d4280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 shutdown_connections 2024-09-17T05:25:20.131 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:20.128+0000 7fbe79752640 1 -- 172.21.15.81:0/929703509 wait complete. 2024-09-17T05:25:20.139 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-09-17T05:25:20.053000+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264460,"kb_used_data":14920,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710260,"statfs":{"total":773094113280,"available":772823306240,"internally_reserved":0,"allocated":15278080,"data_stored":7371092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000996"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059162+0000","last_change":"2024-09-17T05:25:15.781275+0000","last_active":"2024-09-17T05:25:18.059162+0000","last_peered":"2024-09-17T05:25:18.059162+0000","last_clean":"2024-09-17T05:25:18.059162+0000","last_became_active":"2024-09-17T05:25:15.780958+0000","last_became_peered":"2024-09-17T05:25:15.780958+0000","last_unstale":"2024-09-17T05:25:18.059162+0000","last_undegraded":"2024-09-17T05:25:18.059162+0000","last_fullsized":"2024-09-17T05:25:18.059162+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:45.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775840+0000","last_change":"2024-09-17T05:25:15.779234+0000","last_active":"2024-09-17T05:25:16.775840+0000","last_peered":"2024-09-17T05:25:16.775840+0000","last_clean":"2024-09-17T05:25:16.775840+0000","last_became_active":"2024-09-17T05:25:15.778988+0000","last_became_peered":"2024-09-17T05:25:15.778988+0000","last_unstale":"2024-09-17T05:25:16.775840+0000","last_undegraded":"2024-09-17T05:25:16.775840+0000","last_fullsized":"2024-09-17T05:25:16.775840+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:04.380751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932985+0000","last_change":"2024-09-17T05:25:15.782174+0000","last_active":"2024-09-17T05:25:16.932985+0000","last_peered":"2024-09-17T05:25:16.932985+0000","last_clean":"2024-09-17T05:25:16.932985+0000","last_became_active":"2024-09-17T05:25:15.781566+0000","last_became_peered":"2024-09-17T05:25:15.781566+0000","last_unstale":"2024-09-17T05:25:16.932985+0000","last_undegraded":"2024-09-17T05:25:16.932985+0000","last_fullsized":"2024-09-17T05:25:16.932985+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:34.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539770+0000","last_change":"2024-09-17T05:25:15.780953+0000","last_active":"2024-09-17T05:25:17.539770+0000","last_peered":"2024-09-17T05:25:17.539770+0000","last_clean":"2024-09-17T05:25:17.539770+0000","last_became_active":"2024-09-17T05:25:15.780366+0000","last_became_peered":"2024-09-17T05:25:15.780366+0000","last_unstale":"2024-09-17T05:25:17.539770+0000","last_undegraded":"2024-09-17T05:25:17.539770+0000","last_fullsized":"2024-09-17T05:25:17.539770+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:29.231313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775776+0000","last_change":"2024-09-17T05:25:15.775617+0000","last_active":"2024-09-17T05:25:16.775776+0000","last_peered":"2024-09-17T05:25:16.775776+0000","last_clean":"2024-09-17T05:25:16.775776+0000","last_became_active":"2024-09-17T05:25:15.775327+0000","last_became_peered":"2024-09-17T05:25:15.775327+0000","last_unstale":"2024-09-17T05:25:16.775776+0000","last_undegraded":"2024-09-17T05:25:16.775776+0000","last_fullsized":"2024-09-17T05:25:16.775776+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:33.478051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769789+0000","last_change":"2024-09-17T05:25:15.773096+0000","last_active":"2024-09-17T05:25:16.769789+0000","last_peered":"2024-09-17T05:25:16.769789+0000","last_clean":"2024-09-17T05:25:16.769789+0000","last_became_active":"2024-09-17T05:25:15.772711+0000","last_became_peered":"2024-09-17T05:25:15.772711+0000","last_unstale":"2024-09-17T05:25:16.769789+0000","last_undegraded":"2024-09-17T05:25:16.769789+0000","last_fullsized":"2024-09-17T05:25:16.769789+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:57.168138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058865+0000","last_change":"2024-09-17T05:25:15.778273+0000","last_active":"2024-09-17T05:25:18.058865+0000","last_peered":"2024-09-17T05:25:18.058865+0000","last_clean":"2024-09-17T05:25:18.058865+0000","last_became_active":"2024-09-17T05:25:15.777997+0000","last_became_peered":"2024-09-17T05:25:15.777997+0000","last_unstale":"2024-09-17T05:25:18.058865+0000","last_undegraded":"2024-09-17T05:25:18.058865+0000","last_fullsized":"2024-09-17T05:25:18.058865+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:55.772250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775358+0000","last_change":"2024-09-17T05:25:15.779874+0000","last_active":"2024-09-17T05:25:16.775358+0000","last_peered":"2024-09-17T05:25:16.775358+0000","last_clean":"2024-09-17T05:25:16.775358+0000","last_became_active":"2024-09-17T05:25:15.779598+0000","last_became_peered":"2024-09-17T05:25:15.779598+0000","last_unstale":"2024-09-17T05:25:16.775358+0000","last_undegraded":"2024-09-17T05:25:16.775358+0000","last_fullsized":"2024-09-17T05:25:16.775358+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:15.089447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776291+0000","last_change":"2024-09-17T05:25:15.775090+0000","last_active":"2024-09-17T05:25:16.776291+0000","last_peered":"2024-09-17T05:25:16.776291+0000","last_clean":"2024-09-17T05:25:16.776291+0000","last_became_active":"2024-09-17T05:25:15.774800+0000","last_became_peered":"2024-09-17T05:25:15.774800+0000","last_unstale":"2024-09-17T05:25:16.776291+0000","last_undegraded":"2024-09-17T05:25:16.776291+0000","last_fullsized":"2024-09-17T05:25:16.776291+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:14.805451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775978+0000","last_change":"2024-09-17T05:25:15.783867+0000","last_active":"2024-09-17T05:25:16.775978+0000","last_peered":"2024-09-17T05:25:16.775978+0000","last_clean":"2024-09-17T05:25:16.775978+0000","last_became_active":"2024-09-17T05:25:15.783461+0000","last_became_peered":"2024-09-17T05:25:15.783461+0000","last_unstale":"2024-09-17T05:25:16.775978+0000","last_undegraded":"2024-09-17T05:25:16.775978+0000","last_fullsized":"2024-09-17T05:25:16.775978+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:44.512254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775709+0000","last_change":"2024-09-17T05:25:15.783754+0000","last_active":"2024-09-17T05:25:16.775709+0000","last_peered":"2024-09-17T05:25:16.775709+0000","last_clean":"2024-09-17T05:25:16.775709+0000","last_became_active":"2024-09-17T05:25:15.783442+0000","last_became_peered":"2024-09-17T05:25:15.783442+0000","last_unstale":"2024-09-17T05:25:16.775709+0000","last_undegraded":"2024-09-17T05:25:16.775709+0000","last_fullsized":"2024-09-17T05:25:16.775709+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:35.221850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775614+0000","last_change":"2024-09-17T05:25:15.778550+0000","last_active":"2024-09-17T05:25:16.775614+0000","last_peered":"2024-09-17T05:25:16.775614+0000","last_clean":"2024-09-17T05:25:16.775614+0000","last_became_active":"2024-09-17T05:25:15.778184+0000","last_became_peered":"2024-09-17T05:25:15.778184+0000","last_unstale":"2024-09-17T05:25:16.775614+0000","last_undegraded":"2024-09-17T05:25:16.775614+0000","last_fullsized":"2024-09-17T05:25:16.775614+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:34.040502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932991+0000","last_change":"2024-09-17T05:25:15.771243+0000","last_active":"2024-09-17T05:25:16.932991+0000","last_peered":"2024-09-17T05:25:16.932991+0000","last_clean":"2024-09-17T05:25:16.932991+0000","last_became_active":"2024-09-17T05:25:15.770980+0000","last_became_peered":"2024-09-17T05:25:15.770980+0000","last_unstale":"2024-09-17T05:25:16.932991+0000","last_undegraded":"2024-09-17T05:25:16.932991+0000","last_fullsized":"2024-09-17T05:25:16.932991+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:15.089447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932685+0000","last_change":"2024-09-17T05:25:15.778841+0000","last_active":"2024-09-17T05:25:16.932685+0000","last_peered":"2024-09-17T05:25:16.932685+0000","last_clean":"2024-09-17T05:25:16.932685+0000","last_became_active":"2024-09-17T05:25:15.778540+0000","last_became_peered":"2024-09-17T05:25:15.778540+0000","last_unstale":"2024-09-17T05:25:16.932685+0000","last_undegraded":"2024-09-17T05:25:16.932685+0000","last_fullsized":"2024-09-17T05:25:16.932685+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:25.695653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058935+0000","last_change":"2024-09-17T05:25:15.780028+0000","last_active":"2024-09-17T05:25:18.058935+0000","last_peered":"2024-09-17T05:25:18.058935+0000","last_clean":"2024-09-17T05:25:18.058935+0000","last_became_active":"2024-09-17T05:25:15.779745+0000","last_became_peered":"2024-09-17T05:25:15.779745+0000","last_unstale":"2024-09-17T05:25:18.058935+0000","last_undegraded":"2024-09-17T05:25:18.058935+0000","last_fullsized":"2024-09-17T05:25:18.058935+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:13.037164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.057959+0000","last_change":"2024-09-17T05:25:15.776111+0000","last_active":"2024-09-17T05:25:18.057959+0000","last_peered":"2024-09-17T05:25:18.057959+0000","last_clean":"2024-09-17T05:25:18.057959+0000","last_became_active":"2024-09-17T05:25:15.775840+0000","last_became_peered":"2024-09-17T05:25:15.775840+0000","last_unstale":"2024-09-17T05:25:18.057959+0000","last_undegraded":"2024-09-17T05:25:18.057959+0000","last_fullsized":"2024-09-17T05:25:18.057959+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:10.254729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769808+0000","last_change":"2024-09-17T05:25:15.772090+0000","last_active":"2024-09-17T05:25:16.769808+0000","last_peered":"2024-09-17T05:25:16.769808+0000","last_clean":"2024-09-17T05:25:16.769808+0000","last_became_active":"2024-09-17T05:25:15.771844+0000","last_became_peered":"2024-09-17T05:25:15.771844+0000","last_unstale":"2024-09-17T05:25:16.769808+0000","last_undegraded":"2024-09-17T05:25:16.769808+0000","last_fullsized":"2024-09-17T05:25:16.769808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:21.634960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058704+0000","last_change":"2024-09-17T05:25:15.768637+0000","last_active":"2024-09-17T05:25:18.058704+0000","last_peered":"2024-09-17T05:25:18.058704+0000","last_clean":"2024-09-17T05:25:18.058704+0000","last_became_active":"2024-09-17T05:25:15.768327+0000","last_became_peered":"2024-09-17T05:25:15.768327+0000","last_unstale":"2024-09-17T05:25:18.058704+0000","last_undegraded":"2024-09-17T05:25:18.058704+0000","last_fullsized":"2024-09-17T05:25:18.058704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:52.922629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769774+0000","last_change":"2024-09-17T05:25:15.781739+0000","last_active":"2024-09-17T05:25:16.769774+0000","last_peered":"2024-09-17T05:25:16.769774+0000","last_clean":"2024-09-17T05:25:16.769774+0000","last_became_active":"2024-09-17T05:25:15.781446+0000","last_became_peered":"2024-09-17T05:25:15.781446+0000","last_unstale":"2024-09-17T05:25:16.769774+0000","last_undegraded":"2024-09-17T05:25:16.769774+0000","last_fullsized":"2024-09-17T05:25:16.769774+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:12.549783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932929+0000","last_change":"2024-09-17T05:25:15.775588+0000","last_active":"2024-09-17T05:25:16.932929+0000","last_peered":"2024-09-17T05:25:16.932929+0000","last_clean":"2024-09-17T05:25:16.932929+0000","last_became_active":"2024-09-17T05:25:15.775288+0000","last_became_peered":"2024-09-17T05:25:15.775288+0000","last_unstale":"2024-09-17T05:25:16.932929+0000","last_undegraded":"2024-09-17T05:25:16.932929+0000","last_fullsized":"2024-09-17T05:25:16.932929+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:51.557756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769747+0000","last_change":"2024-09-17T05:25:15.770291+0000","last_active":"2024-09-17T05:25:16.769747+0000","last_peered":"2024-09-17T05:25:16.769747+0000","last_clean":"2024-09-17T05:25:16.769747+0000","last_became_active":"2024-09-17T05:25:15.769916+0000","last_became_peered":"2024-09-17T05:25:15.769916+0000","last_unstale":"2024-09-17T05:25:16.769747+0000","last_undegraded":"2024-09-17T05:25:16.769747+0000","last_fullsized":"2024-09-17T05:25:16.769747+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:46.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775604+0000","last_change":"2024-09-17T05:25:15.773447+0000","last_active":"2024-09-17T05:25:16.775604+0000","last_peered":"2024-09-17T05:25:16.775604+0000","last_clean":"2024-09-17T05:25:16.775604+0000","last_became_active":"2024-09-17T05:25:15.773192+0000","last_became_peered":"2024-09-17T05:25:15.773192+0000","last_unstale":"2024-09-17T05:25:16.775604+0000","last_undegraded":"2024-09-17T05:25:16.775604+0000","last_fullsized":"2024-09-17T05:25:16.775604+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:48.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769635+0000","last_change":"2024-09-17T05:25:15.771301+0000","last_active":"2024-09-17T05:25:16.769635+0000","last_peered":"2024-09-17T05:25:16.769635+0000","last_clean":"2024-09-17T05:25:16.769635+0000","last_became_active":"2024-09-17T05:25:15.770952+0000","last_became_peered":"2024-09-17T05:25:15.770952+0000","last_unstale":"2024-09-17T05:25:16.769635+0000","last_undegraded":"2024-09-17T05:25:16.769635+0000","last_fullsized":"2024-09-17T05:25:16.769635+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:49.941023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775428+0000","last_change":"2024-09-17T05:25:15.774105+0000","last_active":"2024-09-17T05:25:16.775428+0000","last_peered":"2024-09-17T05:25:16.775428+0000","last_clean":"2024-09-17T05:25:16.775428+0000","last_became_active":"2024-09-17T05:25:15.773801+0000","last_became_peered":"2024-09-17T05:25:15.773801+0000","last_unstale":"2024-09-17T05:25:16.775428+0000","last_undegraded":"2024-09-17T05:25:16.775428+0000","last_fullsized":"2024-09-17T05:25:16.775428+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:57.061440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933174+0000","last_change":"2024-09-17T05:25:15.778030+0000","last_active":"2024-09-17T05:25:16.933174+0000","last_peered":"2024-09-17T05:25:16.933174+0000","last_clean":"2024-09-17T05:25:16.933174+0000","last_became_active":"2024-09-17T05:25:15.777765+0000","last_became_peered":"2024-09-17T05:25:15.777765+0000","last_unstale":"2024-09-17T05:25:16.933174+0000","last_undegraded":"2024-09-17T05:25:16.933174+0000","last_fullsized":"2024-09-17T05:25:16.933174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:29.357981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058298+0000","last_change":"2024-09-17T05:25:15.783304+0000","last_active":"2024-09-17T05:25:18.058298+0000","last_peered":"2024-09-17T05:25:18.058298+0000","last_clean":"2024-09-17T05:25:18.058298+0000","last_became_active":"2024-09-17T05:25:15.782984+0000","last_became_peered":"2024-09-17T05:25:15.782984+0000","last_unstale":"2024-09-17T05:25:18.058298+0000","last_undegraded":"2024-09-17T05:25:18.058298+0000","last_fullsized":"2024-09-17T05:25:18.058298+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:51.556695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933227+0000","last_change":"2024-09-17T05:25:15.781893+0000","last_active":"2024-09-17T05:25:16.933227+0000","last_peered":"2024-09-17T05:25:16.933227+0000","last_clean":"2024-09-17T05:25:16.933227+0000","last_became_active":"2024-09-17T05:25:15.781519+0000","last_became_peered":"2024-09-17T05:25:15.781519+0000","last_unstale":"2024-09-17T05:25:16.933227+0000","last_undegraded":"2024-09-17T05:25:16.933227+0000","last_fullsized":"2024-09-17T05:25:16.933227+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:36.963481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539784+0000","last_change":"2024-09-17T05:25:15.783842+0000","last_active":"2024-09-17T05:25:17.539784+0000","last_peered":"2024-09-17T05:25:17.539784+0000","last_clean":"2024-09-17T05:25:17.539784+0000","last_became_active":"2024-09-17T05:25:15.783544+0000","last_became_peered":"2024-09-17T05:25:15.783544+0000","last_unstale":"2024-09-17T05:25:17.539784+0000","last_undegraded":"2024-09-17T05:25:17.539784+0000","last_fullsized":"2024-09-17T05:25:17.539784+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:30.018153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933059+0000","last_change":"2024-09-17T05:25:15.781787+0000","last_active":"2024-09-17T05:25:16.933059+0000","last_peered":"2024-09-17T05:25:16.933059+0000","last_clean":"2024-09-17T05:25:16.933059+0000","last_became_active":"2024-09-17T05:25:15.781467+0000","last_became_peered":"2024-09-17T05:25:15.781467+0000","last_unstale":"2024-09-17T05:25:16.933059+0000","last_undegraded":"2024-09-17T05:25:16.933059+0000","last_fullsized":"2024-09-17T05:25:16.933059+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:34.155724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776849+0000","last_change":"2024-09-17T05:25:15.780464+0000","last_active":"2024-09-17T05:25:16.776849+0000","last_peered":"2024-09-17T05:25:16.776849+0000","last_clean":"2024-09-17T05:25:16.776849+0000","last_became_active":"2024-09-17T05:25:15.779128+0000","last_became_peered":"2024-09-17T05:25:15.779128+0000","last_unstale":"2024-09-17T05:25:16.776849+0000","last_undegraded":"2024-09-17T05:25:16.776849+0000","last_fullsized":"2024-09-17T05:25:16.776849+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:30.953416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776304+0000","last_change":"2024-09-17T05:25:15.778049+0000","last_active":"2024-09-17T05:25:16.776304+0000","last_peered":"2024-09-17T05:25:16.776304+0000","last_clean":"2024-09-17T05:25:16.776304+0000","last_became_active":"2024-09-17T05:25:15.777282+0000","last_became_peered":"2024-09-17T05:25:15.777282+0000","last_unstale":"2024-09-17T05:25:16.776304+0000","last_undegraded":"2024-09-17T05:25:16.776304+0000","last_fullsized":"2024-09-17T05:25:16.776304+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:30.018153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058049+0000","last_change":"2024-09-17T05:25:15.768506+0000","last_active":"2024-09-17T05:25:18.058049+0000","last_peered":"2024-09-17T05:25:18.058049+0000","last_clean":"2024-09-17T05:25:18.058049+0000","last_became_active":"2024-09-17T05:25:15.768210+0000","last_became_peered":"2024-09-17T05:25:15.768210+0000","last_unstale":"2024-09-17T05:25:18.058049+0000","last_undegraded":"2024-09-17T05:25:18.058049+0000","last_fullsized":"2024-09-17T05:25:18.058049+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:28.501661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058495+0000","last_change":"2024-09-17T05:25:15.780918+0000","last_active":"2024-09-17T05:25:18.058495+0000","last_peered":"2024-09-17T05:25:18.058495+0000","last_clean":"2024-09-17T05:25:18.058495+0000","last_became_active":"2024-09-17T05:25:15.780662+0000","last_became_peered":"2024-09-17T05:25:15.780662+0000","last_unstale":"2024-09-17T05:25:18.058495+0000","last_undegraded":"2024-09-17T05:25:18.058495+0000","last_fullsized":"2024-09-17T05:25:18.058495+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:54.640228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"139'4","reported_seq":19,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059254+0000","last_change":"2024-09-17T05:25:14.796665+0000","last_active":"2024-09-17T05:25:18.059254+0000","last_peered":"2024-09-17T05:25:18.059254+0000","last_clean":"2024-09-17T05:25:18.059254+0000","last_became_active":"2024-09-17T05:25:14.796385+0000","last_became_peered":"2024-09-17T05:25:14.796385+0000","last_unstale":"2024-09-17T05:25:18.059254+0000","last_undegraded":"2024-09-17T05:25:18.059254+0000","last_fullsized":"2024-09-17T05:25:18.059254+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:06.502467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776988+0000","last_change":"2024-09-17T05:25:15.776858+0000","last_active":"2024-09-17T05:25:16.776988+0000","last_peered":"2024-09-17T05:25:16.776988+0000","last_clean":"2024-09-17T05:25:16.776988+0000","last_became_active":"2024-09-17T05:25:15.776519+0000","last_became_peered":"2024-09-17T05:25:15.776519+0000","last_unstale":"2024-09-17T05:25:16.776988+0000","last_undegraded":"2024-09-17T05:25:16.776988+0000","last_fullsized":"2024-09-17T05:25:16.776988+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:24.065056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776808+0000","last_change":"2024-09-17T05:25:14.794435+0000","last_active":"2024-09-17T05:25:16.776808+0000","last_peered":"2024-09-17T05:25:16.776808+0000","last_clean":"2024-09-17T05:25:16.776808+0000","last_became_active":"2024-09-17T05:25:14.794186+0000","last_became_peered":"2024-09-17T05:25:14.794186+0000","last_unstale":"2024-09-17T05:25:16.776808+0000","last_undegraded":"2024-09-17T05:25:16.776808+0000","last_fullsized":"2024-09-17T05:25:16.776808+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:03.376818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769874+0000","last_change":"2024-09-17T05:25:15.774879+0000","last_active":"2024-09-17T05:25:16.769874+0000","last_peered":"2024-09-17T05:25:16.769874+0000","last_clean":"2024-09-17T05:25:16.769874+0000","last_became_active":"2024-09-17T05:25:15.774613+0000","last_became_peered":"2024-09-17T05:25:15.774613+0000","last_unstale":"2024-09-17T05:25:16.769874+0000","last_undegraded":"2024-09-17T05:25:16.769874+0000","last_fullsized":"2024-09-17T05:25:16.769874+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:16.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539514+0000","last_change":"2024-09-17T05:25:14.794639+0000","last_active":"2024-09-17T05:25:17.539514+0000","last_peered":"2024-09-17T05:25:17.539514+0000","last_clean":"2024-09-17T05:25:17.539514+0000","last_became_active":"2024-09-17T05:25:14.794396+0000","last_became_peered":"2024-09-17T05:25:14.794396+0000","last_unstale":"2024-09-17T05:25:17.539514+0000","last_undegraded":"2024-09-17T05:25:17.539514+0000","last_fullsized":"2024-09-17T05:25:17.539514+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:35.589378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933247+0000","last_change":"2024-09-17T05:25:15.768605+0000","last_active":"2024-09-17T05:25:16.933247+0000","last_peered":"2024-09-17T05:25:16.933247+0000","last_clean":"2024-09-17T05:25:16.933247+0000","last_became_active":"2024-09-17T05:25:15.768350+0000","last_became_peered":"2024-09-17T05:25:15.768350+0000","last_unstale":"2024-09-17T05:25:16.933247+0000","last_undegraded":"2024-09-17T05:25:16.933247+0000","last_fullsized":"2024-09-17T05:25:16.933247+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:57.061440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539940+0000","last_change":"2024-09-17T05:25:14.793110+0000","last_active":"2024-09-17T05:25:17.539940+0000","last_peered":"2024-09-17T05:25:17.539940+0000","last_clean":"2024-09-17T05:25:17.539940+0000","last_became_active":"2024-09-17T05:25:14.792837+0000","last_became_peered":"2024-09-17T05:25:14.792837+0000","last_unstale":"2024-09-17T05:25:17.539940+0000","last_undegraded":"2024-09-17T05:25:17.539940+0000","last_fullsized":"2024-09-17T05:25:17.539940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:15.489523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058580+0000","last_change":"2024-09-17T05:25:15.776112+0000","last_active":"2024-09-17T05:25:18.058580+0000","last_peered":"2024-09-17T05:25:18.058580+0000","last_clean":"2024-09-17T05:25:18.058580+0000","last_became_active":"2024-09-17T05:25:15.775131+0000","last_became_peered":"2024-09-17T05:25:15.775131+0000","last_unstale":"2024-09-17T05:25:18.058580+0000","last_undegraded":"2024-09-17T05:25:18.058580+0000","last_fullsized":"2024-09-17T05:25:18.058580+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:44.062976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933232+0000","last_change":"2024-09-17T05:25:14.797188+0000","last_active":"2024-09-17T05:25:16.933232+0000","last_peered":"2024-09-17T05:25:16.933232+0000","last_clean":"2024-09-17T05:25:16.933232+0000","last_became_active":"2024-09-17T05:25:14.794128+0000","last_became_peered":"2024-09-17T05:25:14.794128+0000","last_unstale":"2024-09-17T05:25:16.933232+0000","last_undegraded":"2024-09-17T05:25:16.933232+0000","last_fullsized":"2024-09-17T05:25:16.933232+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:52.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539453+0000","last_change":"2024-09-17T05:25:15.779868+0000","last_active":"2024-09-17T05:25:17.539453+0000","last_peered":"2024-09-17T05:25:17.539453+0000","last_clean":"2024-09-17T05:25:17.539453+0000","last_became_active":"2024-09-17T05:25:15.778972+0000","last_became_peered":"2024-09-17T05:25:15.778972+0000","last_unstale":"2024-09-17T05:25:17.539453+0000","last_undegraded":"2024-09-17T05:25:17.539453+0000","last_fullsized":"2024-09-17T05:25:17.539453+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:15.867309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539331+0000","last_change":"2024-09-17T05:25:14.786746+0000","last_active":"2024-09-17T05:25:17.539331+0000","last_peered":"2024-09-17T05:25:17.539331+0000","last_clean":"2024-09-17T05:25:17.539331+0000","last_became_active":"2024-09-17T05:25:14.786464+0000","last_became_peered":"2024-09-17T05:25:14.786464+0000","last_unstale":"2024-09-17T05:25:17.539331+0000","last_undegraded":"2024-09-17T05:25:17.539331+0000","last_fullsized":"2024-09-17T05:25:17.539331+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:33.116403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539307+0000","last_change":"2024-09-17T05:25:15.778406+0000","last_active":"2024-09-17T05:25:17.539307+0000","last_peered":"2024-09-17T05:25:17.539307+0000","last_clean":"2024-09-17T05:25:17.539307+0000","last_became_active":"2024-09-17T05:25:15.778216+0000","last_became_peered":"2024-09-17T05:25:15.778216+0000","last_unstale":"2024-09-17T05:25:17.539307+0000","last_undegraded":"2024-09-17T05:25:17.539307+0000","last_fullsized":"2024-09-17T05:25:17.539307+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:35.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776389+0000","last_change":"2024-09-17T05:25:14.796913+0000","last_active":"2024-09-17T05:25:16.776389+0000","last_peered":"2024-09-17T05:25:16.776389+0000","last_clean":"2024-09-17T05:25:16.776389+0000","last_became_active":"2024-09-17T05:25:14.796389+0000","last_became_peered":"2024-09-17T05:25:14.796389+0000","last_unstale":"2024-09-17T05:25:16.776389+0000","last_undegraded":"2024-09-17T05:25:16.776389+0000","last_fullsized":"2024-09-17T05:25:16.776389+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:07.251490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769695+0000","last_change":"2024-09-17T05:25:15.773099+0000","last_active":"2024-09-17T05:25:16.769695+0000","last_peered":"2024-09-17T05:25:16.769695+0000","last_clean":"2024-09-17T05:25:16.769695+0000","last_became_active":"2024-09-17T05:25:15.772604+0000","last_became_peered":"2024-09-17T05:25:15.772604+0000","last_unstale":"2024-09-17T05:25:16.769695+0000","last_undegraded":"2024-09-17T05:25:16.769695+0000","last_fullsized":"2024-09-17T05:25:16.769695+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:23.912406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058171+0000","last_change":"2024-09-17T05:25:14.793890+0000","last_active":"2024-09-17T05:25:18.058171+0000","last_peered":"2024-09-17T05:25:18.058171+0000","last_clean":"2024-09-17T05:25:18.058171+0000","last_became_active":"2024-09-17T05:25:14.793633+0000","last_became_peered":"2024-09-17T05:25:14.793633+0000","last_unstale":"2024-09-17T05:25:18.058171+0000","last_undegraded":"2024-09-17T05:25:18.058171+0000","last_fullsized":"2024-09-17T05:25:18.058171+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:50.264346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058654+0000","last_change":"2024-09-17T05:25:15.781922+0000","last_active":"2024-09-17T05:25:18.058654+0000","last_peered":"2024-09-17T05:25:18.058654+0000","last_clean":"2024-09-17T05:25:18.058654+0000","last_became_active":"2024-09-17T05:25:15.781474+0000","last_became_peered":"2024-09-17T05:25:15.781474+0000","last_unstale":"2024-09-17T05:25:18.058654+0000","last_undegraded":"2024-09-17T05:25:18.058654+0000","last_fullsized":"2024-09-17T05:25:18.058654+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:02.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769844+0000","last_change":"2024-09-17T05:25:14.792239+0000","last_active":"2024-09-17T05:25:16.769844+0000","last_peered":"2024-09-17T05:25:16.769844+0000","last_clean":"2024-09-17T05:25:16.769844+0000","last_became_active":"2024-09-17T05:25:14.791912+0000","last_became_peered":"2024-09-17T05:25:14.791912+0000","last_unstale":"2024-09-17T05:25:16.769844+0000","last_undegraded":"2024-09-17T05:25:16.769844+0000","last_fullsized":"2024-09-17T05:25:16.769844+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:00.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059016+0000","last_change":"2024-09-17T05:25:15.781725+0000","last_active":"2024-09-17T05:25:18.059016+0000","last_peered":"2024-09-17T05:25:18.059016+0000","last_clean":"2024-09-17T05:25:18.059016+0000","last_became_active":"2024-09-17T05:25:15.781430+0000","last_became_peered":"2024-09-17T05:25:15.781430+0000","last_unstale":"2024-09-17T05:25:18.059016+0000","last_undegraded":"2024-09-17T05:25:18.059016+0000","last_fullsized":"2024-09-17T05:25:18.059016+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:13.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"139'3","reported_seq":18,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769953+0000","last_change":"2024-09-17T05:25:14.793250+0000","last_active":"2024-09-17T05:25:16.769953+0000","last_peered":"2024-09-17T05:25:16.769953+0000","last_clean":"2024-09-17T05:25:16.769953+0000","last_became_active":"2024-09-17T05:25:14.792972+0000","last_became_peered":"2024-09-17T05:25:14.792972+0000","last_unstale":"2024-09-17T05:25:16.769953+0000","last_undegraded":"2024-09-17T05:25:16.769953+0000","last_fullsized":"2024-09-17T05:25:16.769953+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:43.923144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.777012+0000","last_change":"2024-09-17T05:25:15.782695+0000","last_active":"2024-09-17T05:25:16.777012+0000","last_peered":"2024-09-17T05:25:16.777012+0000","last_clean":"2024-09-17T05:25:16.777012+0000","last_became_active":"2024-09-17T05:25:15.782403+0000","last_became_peered":"2024-09-17T05:25:15.782403+0000","last_unstale":"2024-09-17T05:25:16.777012+0000","last_undegraded":"2024-09-17T05:25:16.777012+0000","last_fullsized":"2024-09-17T05:25:16.777012+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:39.044245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"139'6","reported_seq":21,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776685+0000","last_change":"2024-09-17T05:25:14.796088+0000","last_active":"2024-09-17T05:25:16.776685+0000","last_peered":"2024-09-17T05:25:16.776685+0000","last_clean":"2024-09-17T05:25:16.776685+0000","last_became_active":"2024-09-17T05:25:14.795601+0000","last_became_peered":"2024-09-17T05:25:14.795601+0000","last_unstale":"2024-09-17T05:25:16.776685+0000","last_undegraded":"2024-09-17T05:25:16.776685+0000","last_fullsized":"2024-09-17T05:25:16.776685+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058430+0000","last_change":"2024-09-17T05:25:15.769810+0000","last_active":"2024-09-17T05:25:18.058430+0000","last_peered":"2024-09-17T05:25:18.058430+0000","last_clean":"2024-09-17T05:25:18.058430+0000","last_became_active":"2024-09-17T05:25:15.768945+0000","last_became_peered":"2024-09-17T05:25:15.768945+0000","last_unstale":"2024-09-17T05:25:18.058430+0000","last_undegraded":"2024-09-17T05:25:18.058430+0000","last_fullsized":"2024-09-17T05:25:18.058430+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:53.364493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539458+0000","last_change":"2024-09-17T05:25:14.789024+0000","last_active":"2024-09-17T05:25:17.539458+0000","last_peered":"2024-09-17T05:25:17.539458+0000","last_clean":"2024-09-17T05:25:17.539458+0000","last_became_active":"2024-09-17T05:25:14.788769+0000","last_became_peered":"2024-09-17T05:25:14.788769+0000","last_unstale":"2024-09-17T05:25:17.539458+0000","last_undegraded":"2024-09-17T05:25:17.539458+0000","last_fullsized":"2024-09-17T05:25:17.539458+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:52.856520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058713+0000","last_change":"2024-09-17T05:25:15.772400+0000","last_active":"2024-09-17T05:25:18.058713+0000","last_peered":"2024-09-17T05:25:18.058713+0000","last_clean":"2024-09-17T05:25:18.058713+0000","last_became_active":"2024-09-17T05:25:15.772095+0000","last_became_peered":"2024-09-17T05:25:15.772095+0000","last_unstale":"2024-09-17T05:25:18.058713+0000","last_undegraded":"2024-09-17T05:25:18.058713+0000","last_fullsized":"2024-09-17T05:25:18.058713+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:22.046599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058762+0000","last_change":"2024-09-17T05:25:14.794322+0000","last_active":"2024-09-17T05:25:18.058762+0000","last_peered":"2024-09-17T05:25:18.058762+0000","last_clean":"2024-09-17T05:25:18.058762+0000","last_became_active":"2024-09-17T05:25:14.793988+0000","last_became_peered":"2024-09-17T05:25:14.793988+0000","last_unstale":"2024-09-17T05:25:18.058762+0000","last_undegraded":"2024-09-17T05:25:18.058762+0000","last_fullsized":"2024-09-17T05:25:18.058762+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:29.014220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539315+0000","last_change":"2024-09-17T05:25:15.779341+0000","last_active":"2024-09-17T05:25:17.539315+0000","last_peered":"2024-09-17T05:25:17.539315+0000","last_clean":"2024-09-17T05:25:17.539315+0000","last_became_active":"2024-09-17T05:25:15.779088+0000","last_became_peered":"2024-09-17T05:25:15.779088+0000","last_unstale":"2024-09-17T05:25:17.539315+0000","last_undegraded":"2024-09-17T05:25:17.539315+0000","last_fullsized":"2024-09-17T05:25:17.539315+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:25.047576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539366+0000","last_change":"2024-09-17T05:25:14.795615+0000","last_active":"2024-09-17T05:25:17.539366+0000","last_peered":"2024-09-17T05:25:17.539366+0000","last_clean":"2024-09-17T05:25:17.539366+0000","last_became_active":"2024-09-17T05:25:14.795338+0000","last_became_peered":"2024-09-17T05:25:14.795338+0000","last_unstale":"2024-09-17T05:25:17.539366+0000","last_undegraded":"2024-09-17T05:25:17.539366+0000","last_fullsized":"2024-09-17T05:25:17.539366+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:46.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932617+0000","last_change":"2024-09-17T05:25:15.770689+0000","last_active":"2024-09-17T05:25:16.932617+0000","last_peered":"2024-09-17T05:25:16.932617+0000","last_clean":"2024-09-17T05:25:16.932617+0000","last_became_active":"2024-09-17T05:25:15.770418+0000","last_became_peered":"2024-09-17T05:25:15.770418+0000","last_unstale":"2024-09-17T05:25:16.932617+0000","last_undegraded":"2024-09-17T05:25:16.932617+0000","last_fullsized":"2024-09-17T05:25:16.932617+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:31.466891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"139'8","reported_seq":23,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776139+0000","last_change":"2024-09-17T05:25:14.797300+0000","last_active":"2024-09-17T05:25:16.776139+0000","last_peered":"2024-09-17T05:25:16.776139+0000","last_clean":"2024-09-17T05:25:16.776139+0000","last_became_active":"2024-09-17T05:25:14.797009+0000","last_became_peered":"2024-09-17T05:25:14.797009+0000","last_unstale":"2024-09-17T05:25:16.776139+0000","last_undegraded":"2024-09-17T05:25:16.776139+0000","last_fullsized":"2024-09-17T05:25:16.776139+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:27.908257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539733+0000","last_change":"2024-09-17T05:25:15.779643+0000","last_active":"2024-09-17T05:25:17.539733+0000","last_peered":"2024-09-17T05:25:17.539733+0000","last_clean":"2024-09-17T05:25:17.539733+0000","last_became_active":"2024-09-17T05:25:15.779371+0000","last_became_peered":"2024-09-17T05:25:15.779371+0000","last_unstale":"2024-09-17T05:25:17.539733+0000","last_undegraded":"2024-09-17T05:25:17.539733+0000","last_fullsized":"2024-09-17T05:25:17.539733+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:28.913239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933105+0000","last_change":"2024-09-17T05:25:14.795978+0000","last_active":"2024-09-17T05:25:16.933105+0000","last_peered":"2024-09-17T05:25:16.933105+0000","last_clean":"2024-09-17T05:25:16.933105+0000","last_became_active":"2024-09-17T05:25:14.795145+0000","last_became_peered":"2024-09-17T05:25:14.795145+0000","last_unstale":"2024-09-17T05:25:16.933105+0000","last_undegraded":"2024-09-17T05:25:16.933105+0000","last_fullsized":"2024-09-17T05:25:16.933105+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:16.134634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058825+0000","last_change":"2024-09-17T05:25:15.777994+0000","last_active":"2024-09-17T05:25:18.058825+0000","last_peered":"2024-09-17T05:25:18.058825+0000","last_clean":"2024-09-17T05:25:18.058825+0000","last_became_active":"2024-09-17T05:25:15.777771+0000","last_became_peered":"2024-09-17T05:25:15.777771+0000","last_unstale":"2024-09-17T05:25:18.058825+0000","last_undegraded":"2024-09-17T05:25:18.058825+0000","last_fullsized":"2024-09-17T05:25:18.058825+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:38.148403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933015+0000","last_change":"2024-09-17T05:25:14.798054+0000","last_active":"2024-09-17T05:25:16.933015+0000","last_peered":"2024-09-17T05:25:16.933015+0000","last_clean":"2024-09-17T05:25:16.933015+0000","last_became_active":"2024-09-17T05:25:14.797432+0000","last_became_peered":"2024-09-17T05:25:14.797432+0000","last_unstale":"2024-09-17T05:25:16.933015+0000","last_undegraded":"2024-09-17T05:25:16.933015+0000","last_fullsized":"2024-09-17T05:25:16.933015+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:15.631374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539983+0000","last_change":"2024-09-17T05:25:15.780014+0000","last_active":"2024-09-17T05:25:17.539983+0000","last_peered":"2024-09-17T05:25:17.539983+0000","last_clean":"2024-09-17T05:25:17.539983+0000","last_became_active":"2024-09-17T05:25:15.778873+0000","last_became_peered":"2024-09-17T05:25:15.778873+0000","last_unstale":"2024-09-17T05:25:17.539983+0000","last_undegraded":"2024-09-17T05:25:17.539983+0000","last_fullsized":"2024-09-17T05:25:17.539983+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:30.953416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059074+0000","last_change":"2024-09-17T05:25:14.801709+0000","last_active":"2024-09-17T05:25:18.059074+0000","last_peered":"2024-09-17T05:25:18.059074+0000","last_clean":"2024-09-17T05:25:18.059074+0000","last_became_active":"2024-09-17T05:25:14.801400+0000","last_became_peered":"2024-09-17T05:25:14.801400+0000","last_unstale":"2024-09-17T05:25:18.059074+0000","last_undegraded":"2024-09-17T05:25:18.059074+0000","last_fullsized":"2024-09-17T05:25:18.059074+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:27.497728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058380+0000","last_change":"2024-09-17T05:25:15.783814+0000","last_active":"2024-09-17T05:25:18.058380+0000","last_peered":"2024-09-17T05:25:18.058380+0000","last_clean":"2024-09-17T05:25:18.058380+0000","last_became_active":"2024-09-17T05:25:15.783556+0000","last_became_peered":"2024-09-17T05:25:15.783556+0000","last_unstale":"2024-09-17T05:25:18.058380+0000","last_undegraded":"2024-09-17T05:25:18.058380+0000","last_fullsized":"2024-09-17T05:25:18.058380+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:52.630444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059261+0000","last_change":"2024-09-17T05:25:14.797861+0000","last_active":"2024-09-17T05:25:18.059261+0000","last_peered":"2024-09-17T05:25:18.059261+0000","last_clean":"2024-09-17T05:25:18.059261+0000","last_became_active":"2024-09-17T05:25:14.797490+0000","last_became_peered":"2024-09-17T05:25:14.797490+0000","last_unstale":"2024-09-17T05:25:18.059261+0000","last_undegraded":"2024-09-17T05:25:18.059261+0000","last_fullsized":"2024-09-17T05:25:18.059261+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:46.057529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932847+0000","last_change":"2024-09-17T05:25:15.772080+0000","last_active":"2024-09-17T05:25:16.932847+0000","last_peered":"2024-09-17T05:25:16.932847+0000","last_clean":"2024-09-17T05:25:16.932847+0000","last_became_active":"2024-09-17T05:25:15.771805+0000","last_became_peered":"2024-09-17T05:25:15.771805+0000","last_unstale":"2024-09-17T05:25:16.932847+0000","last_undegraded":"2024-09-17T05:25:16.932847+0000","last_fullsized":"2024-09-17T05:25:16.932847+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:10.867709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539582+0000","last_change":"2024-09-17T05:25:14.793137+0000","last_active":"2024-09-17T05:25:17.539582+0000","last_peered":"2024-09-17T05:25:17.539582+0000","last_clean":"2024-09-17T05:25:17.539582+0000","last_became_active":"2024-09-17T05:25:14.792865+0000","last_became_peered":"2024-09-17T05:25:14.792865+0000","last_unstale":"2024-09-17T05:25:17.539582+0000","last_undegraded":"2024-09-17T05:25:17.539582+0000","last_fullsized":"2024-09-17T05:25:17.539582+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:48.545193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058881+0000","last_change":"2024-09-17T05:25:15.774884+0000","last_active":"2024-09-17T05:25:18.058881+0000","last_peered":"2024-09-17T05:25:18.058881+0000","last_clean":"2024-09-17T05:25:18.058881+0000","last_became_active":"2024-09-17T05:25:15.774599+0000","last_became_peered":"2024-09-17T05:25:15.774599+0000","last_unstale":"2024-09-17T05:25:18.058881+0000","last_undegraded":"2024-09-17T05:25:18.058881+0000","last_fullsized":"2024-09-17T05:25:18.058881+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:32.022507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058948+0000","last_change":"2024-09-17T05:25:14.798585+0000","last_active":"2024-09-17T05:25:18.058948+0000","last_peered":"2024-09-17T05:25:18.058948+0000","last_clean":"2024-09-17T05:25:18.058948+0000","last_became_active":"2024-09-17T05:25:14.798315+0000","last_became_peered":"2024-09-17T05:25:14.798315+0000","last_unstale":"2024-09-17T05:25:18.058948+0000","last_undegraded":"2024-09-17T05:25:18.058948+0000","last_fullsized":"2024-09-17T05:25:18.058948+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:03.445359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059252+0000","last_change":"2024-09-17T05:25:15.777564+0000","last_active":"2024-09-17T05:25:18.059252+0000","last_peered":"2024-09-17T05:25:18.059252+0000","last_clean":"2024-09-17T05:25:18.059252+0000","last_became_active":"2024-09-17T05:25:15.776379+0000","last_became_peered":"2024-09-17T05:25:15.776379+0000","last_unstale":"2024-09-17T05:25:18.059252+0000","last_undegraded":"2024-09-17T05:25:18.059252+0000","last_fullsized":"2024-09-17T05:25:18.059252+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:58.550913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539422+0000","last_change":"2024-09-17T05:25:14.786737+0000","last_active":"2024-09-17T05:25:17.539422+0000","last_peered":"2024-09-17T05:25:17.539422+0000","last_clean":"2024-09-17T05:25:17.539422+0000","last_became_active":"2024-09-17T05:25:14.786430+0000","last_became_peered":"2024-09-17T05:25:14.786430+0000","last_unstale":"2024-09-17T05:25:17.539422+0000","last_undegraded":"2024-09-17T05:25:17.539422+0000","last_fullsized":"2024-09-17T05:25:17.539422+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:50.260359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769903+0000","last_change":"2024-09-17T05:25:15.769491+0000","last_active":"2024-09-17T05:25:16.769903+0000","last_peered":"2024-09-17T05:25:16.769903+0000","last_clean":"2024-09-17T05:25:16.769903+0000","last_became_active":"2024-09-17T05:25:15.769145+0000","last_became_peered":"2024-09-17T05:25:15.769145+0000","last_unstale":"2024-09-17T05:25:16.769903+0000","last_undegraded":"2024-09-17T05:25:16.769903+0000","last_fullsized":"2024-09-17T05:25:16.769903+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:43.813417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059272+0000","last_change":"2024-09-17T05:25:14.804390+0000","last_active":"2024-09-17T05:25:18.059272+0000","last_peered":"2024-09-17T05:25:18.059272+0000","last_clean":"2024-09-17T05:25:18.059272+0000","last_became_active":"2024-09-17T05:25:14.804104+0000","last_became_peered":"2024-09-17T05:25:14.804104+0000","last_unstale":"2024-09-17T05:25:18.059272+0000","last_undegraded":"2024-09-17T05:25:18.059272+0000","last_fullsized":"2024-09-17T05:25:18.059272+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:20.358596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059070+0000","last_change":"2024-09-17T05:25:15.780348+0000","last_active":"2024-09-17T05:25:18.059070+0000","last_peered":"2024-09-17T05:25:18.059070+0000","last_clean":"2024-09-17T05:25:18.059070+0000","last_became_active":"2024-09-17T05:25:15.780079+0000","last_became_peered":"2024-09-17T05:25:15.780079+0000","last_unstale":"2024-09-17T05:25:18.059070+0000","last_undegraded":"2024-09-17T05:25:18.059070+0000","last_fullsized":"2024-09-17T05:25:18.059070+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:52.925198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058951+0000","last_change":"2024-09-17T05:25:14.795475+0000","last_active":"2024-09-17T05:25:18.058951+0000","last_peered":"2024-09-17T05:25:18.058951+0000","last_clean":"2024-09-17T05:25:18.058951+0000","last_became_active":"2024-09-17T05:25:14.795056+0000","last_became_peered":"2024-09-17T05:25:14.795056+0000","last_unstale":"2024-09-17T05:25:18.058951+0000","last_undegraded":"2024-09-17T05:25:18.058951+0000","last_fullsized":"2024-09-17T05:25:18.058951+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:27.909306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058684+0000","last_change":"2024-09-17T05:25:15.775813+0000","last_active":"2024-09-17T05:25:18.058684+0000","last_peered":"2024-09-17T05:25:18.058684+0000","last_clean":"2024-09-17T05:25:18.058684+0000","last_became_active":"2024-09-17T05:25:15.775548+0000","last_became_peered":"2024-09-17T05:25:15.775548+0000","last_unstale":"2024-09-17T05:25:18.058684+0000","last_undegraded":"2024-09-17T05:25:18.058684+0000","last_fullsized":"2024-09-17T05:25:18.058684+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:26.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"140'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933097+0000","last_change":"2024-09-17T05:25:14.799199+0000","last_active":"2024-09-17T05:25:16.933097+0000","last_peered":"2024-09-17T05:25:16.933097+0000","last_clean":"2024-09-17T05:25:16.933097+0000","last_became_active":"2024-09-17T05:25:14.798912+0000","last_became_peered":"2024-09-17T05:25:14.798912+0000","last_unstale":"2024-09-17T05:25:16.933097+0000","last_undegraded":"2024-09-17T05:25:16.933097+0000","last_fullsized":"2024-09-17T05:25:16.933097+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:59.950112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769984+0000","last_change":"2024-09-17T05:25:15.780326+0000","last_active":"2024-09-17T05:25:16.769984+0000","last_peered":"2024-09-17T05:25:16.769984+0000","last_clean":"2024-09-17T05:25:16.769984+0000","last_became_active":"2024-09-17T05:25:15.779755+0000","last_became_peered":"2024-09-17T05:25:15.779755+0000","last_unstale":"2024-09-17T05:25:16.769984+0000","last_undegraded":"2024-09-17T05:25:16.769984+0000","last_fullsized":"2024-09-17T05:25:16.769984+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:21.583723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775915+0000","last_change":"2024-09-17T05:25:14.799256+0000","last_active":"2024-09-17T05:25:16.775915+0000","last_peered":"2024-09-17T05:25:16.775915+0000","last_clean":"2024-09-17T05:25:16.775915+0000","last_became_active":"2024-09-17T05:25:14.798928+0000","last_became_peered":"2024-09-17T05:25:14.798928+0000","last_unstale":"2024-09-17T05:25:16.775915+0000","last_undegraded":"2024-09-17T05:25:16.775915+0000","last_fullsized":"2024-09-17T05:25:16.775915+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:00.060015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058415+0000","last_change":"2024-09-17T05:25:15.774346+0000","last_active":"2024-09-17T05:25:18.058415+0000","last_peered":"2024-09-17T05:25:18.058415+0000","last_clean":"2024-09-17T05:25:18.058415+0000","last_became_active":"2024-09-17T05:25:15.774029+0000","last_became_peered":"2024-09-17T05:25:15.774029+0000","last_unstale":"2024-09-17T05:25:18.058415+0000","last_undegraded":"2024-09-17T05:25:18.058415+0000","last_fullsized":"2024-09-17T05:25:18.058415+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:04.449292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059064+0000","last_change":"2024-09-17T05:25:14.792783+0000","last_active":"2024-09-17T05:25:18.059064+0000","last_peered":"2024-09-17T05:25:18.059064+0000","last_clean":"2024-09-17T05:25:18.059064+0000","last_became_active":"2024-09-17T05:25:14.792499+0000","last_became_peered":"2024-09-17T05:25:14.792499+0000","last_unstale":"2024-09-17T05:25:18.059064+0000","last_undegraded":"2024-09-17T05:25:18.059064+0000","last_fullsized":"2024-09-17T05:25:18.059064+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:14.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058633+0000","last_change":"2024-09-17T05:25:15.769194+0000","last_active":"2024-09-17T05:25:18.058633+0000","last_peered":"2024-09-17T05:25:18.058633+0000","last_clean":"2024-09-17T05:25:18.058633+0000","last_became_active":"2024-09-17T05:25:15.768581+0000","last_became_peered":"2024-09-17T05:25:15.768581+0000","last_unstale":"2024-09-17T05:25:18.058633+0000","last_undegraded":"2024-09-17T05:25:18.058633+0000","last_fullsized":"2024-09-17T05:25:18.058633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:07.506400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776512+0000","last_change":"2024-09-17T05:25:14.795833+0000","last_active":"2024-09-17T05:25:16.776512+0000","last_peered":"2024-09-17T05:25:16.776512+0000","last_clean":"2024-09-17T05:25:16.776512+0000","last_became_active":"2024-09-17T05:25:14.795529+0000","last_became_peered":"2024-09-17T05:25:14.795529+0000","last_unstale":"2024-09-17T05:25:16.776512+0000","last_undegraded":"2024-09-17T05:25:16.776512+0000","last_fullsized":"2024-09-17T05:25:16.776512+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:34.217917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776430+0000","last_change":"2024-09-17T05:25:15.775565+0000","last_active":"2024-09-17T05:25:16.776430+0000","last_peered":"2024-09-17T05:25:16.776430+0000","last_clean":"2024-09-17T05:25:16.776430+0000","last_became_active":"2024-09-17T05:25:15.774645+0000","last_became_peered":"2024-09-17T05:25:15.774645+0000","last_unstale":"2024-09-17T05:25:16.776430+0000","last_undegraded":"2024-09-17T05:25:16.776430+0000","last_fullsized":"2024-09-17T05:25:16.776430+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:37.246476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539336+0000","last_change":"2024-09-17T05:25:14.790605+0000","last_active":"2024-09-17T05:25:17.539336+0000","last_peered":"2024-09-17T05:25:17.539336+0000","last_clean":"2024-09-17T05:25:17.539336+0000","last_became_active":"2024-09-17T05:25:14.790285+0000","last_became_peered":"2024-09-17T05:25:14.790285+0000","last_unstale":"2024-09-17T05:25:17.539336+0000","last_undegraded":"2024-09-17T05:25:17.539336+0000","last_fullsized":"2024-09-17T05:25:17.539336+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:03.046454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.057953+0000","last_change":"2024-09-17T05:25:15.776416+0000","last_active":"2024-09-17T05:25:18.057953+0000","last_peered":"2024-09-17T05:25:18.057953+0000","last_clean":"2024-09-17T05:25:18.057953+0000","last_became_active":"2024-09-17T05:25:15.775434+0000","last_became_peered":"2024-09-17T05:25:15.775434+0000","last_unstale":"2024-09-17T05:25:18.057953+0000","last_undegraded":"2024-09-17T05:25:18.057953+0000","last_fullsized":"2024-09-17T05:25:18.057953+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:26.337136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776284+0000","last_change":"2024-09-17T05:25:14.799017+0000","last_active":"2024-09-17T05:25:16.776284+0000","last_peered":"2024-09-17T05:25:16.776284+0000","last_clean":"2024-09-17T05:25:16.776284+0000","last_became_active":"2024-09-17T05:25:14.798741+0000","last_became_peered":"2024-09-17T05:25:14.798741+0000","last_unstale":"2024-09-17T05:25:16.776284+0000","last_undegraded":"2024-09-17T05:25:16.776284+0000","last_fullsized":"2024-09-17T05:25:16.776284+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:29.276065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932660+0000","last_change":"2024-09-17T05:25:15.769360+0000","last_active":"2024-09-17T05:25:16.932660+0000","last_peered":"2024-09-17T05:25:16.932660+0000","last_clean":"2024-09-17T05:25:16.932660+0000","last_became_active":"2024-09-17T05:25:15.769076+0000","last_became_peered":"2024-09-17T05:25:15.769076+0000","last_unstale":"2024-09-17T05:25:16.932660+0000","last_undegraded":"2024-09-17T05:25:16.932660+0000","last_fullsized":"2024-09-17T05:25:16.932660+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:07.983473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776617+0000","last_change":"2024-09-17T05:25:14.788995+0000","last_active":"2024-09-17T05:25:16.776617+0000","last_peered":"2024-09-17T05:25:16.776617+0000","last_clean":"2024-09-17T05:25:16.776617+0000","last_became_active":"2024-09-17T05:25:14.788708+0000","last_became_peered":"2024-09-17T05:25:14.788708+0000","last_unstale":"2024-09-17T05:25:16.776617+0000","last_undegraded":"2024-09-17T05:25:16.776617+0000","last_fullsized":"2024-09-17T05:25:16.776617+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:53.467883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058887+0000","last_change":"2024-09-17T05:25:15.781032+0000","last_active":"2024-09-17T05:25:18.058887+0000","last_peered":"2024-09-17T05:25:18.058887+0000","last_clean":"2024-09-17T05:25:18.058887+0000","last_became_active":"2024-09-17T05:25:15.780775+0000","last_became_peered":"2024-09-17T05:25:15.780775+0000","last_unstale":"2024-09-17T05:25:18.058887+0000","last_undegraded":"2024-09-17T05:25:18.058887+0000","last_fullsized":"2024-09-17T05:25:18.058887+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:46.450452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776961+0000","last_change":"2024-09-17T05:25:14.793360+0000","last_active":"2024-09-17T05:25:16.776961+0000","last_peered":"2024-09-17T05:25:16.776961+0000","last_clean":"2024-09-17T05:25:16.776961+0000","last_became_active":"2024-09-17T05:25:14.793062+0000","last_became_peered":"2024-09-17T05:25:14.793062+0000","last_unstale":"2024-09-17T05:25:16.776961+0000","last_undegraded":"2024-09-17T05:25:16.776961+0000","last_fullsized":"2024-09-17T05:25:16.776961+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:13.801518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":350,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059377+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:25:18.059377+0000","last_peered":"2024-09-17T05:25:18.059377+0000","last_clean":"2024-09-17T05:25:18.059377+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:25:18.059377+0000","last_undegraded":"2024-09-17T05:25:18.059377+0000","last_fullsized":"2024-09-17T05:25:18.059377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33504,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338336,"statfs":{"total":96636764160,"available":96602456064,"internally_reserved":0,"allocated":2371584,"data_stored":1365914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1757184,"data_stored":773214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1761280,"data_stored":773796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1769472,"data_stored":774874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1757184,"data_stored":773226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1757184,"data_stored":773282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509524,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":773226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33484,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338356,"statfs":{"total":96636764160,"available":96602476544,"internally_reserved":0,"allocated":2347008,"data_stored":1363560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:25:23.144 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:25:23.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.314+0000 7f827bc40640 1 -- 172.21.15.81:0/641246028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c003fd0 msgr2=0x7f825c004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.314+0000 7f827bc40640 1 --2- 172.21.15.81:0/641246028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f825c003fd0 0x7f825c004800 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7f8268009b80 tx=0x7f825c005830 comp rx=0 tx=0).stop 2024-09-17T05:25:23.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.314+0000 7f827a1dd640 1 -- 172.21.15.81:0/641246028 reap_dead start 2024-09-17T05:25:23.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.314+0000 7f827bc40640 1 -- 172.21.15.81:0/641246028 shutdown_connections 2024-09-17T05:25:23.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.314+0000 7f827bc40640 1 -- 172.21.15.81:0/641246028 >> 172.21.15.81:0/641246028 conn(0x7f82740b1690 msgr2=0x7f82740b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:23.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.314+0000 7f827bc40640 1 -- 172.21.15.81:0/641246028 shutdown_connections 2024-09-17T05:25:23.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.314+0000 7f827bc40640 1 -- 172.21.15.81:0/641246028 wait complete. 2024-09-17T05:25:23.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.315+0000 7f827bc40640 1 Processor -- start 2024-09-17T05:25:23.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.315+0000 7f827bc40640 1 -- start start 2024-09-17T05:25:23.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f827bc40640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f825c003fd0 0x7f82741f3ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f827bc40640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827414c0d0 0x7f827414c550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f827bc40640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8274073020 0x7f8274073480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f827bc40640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f82740cf560 con 0x7f827414c0d0 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f827bc40640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f82740cf3e0 con 0x7f8274073020 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f827bc40640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f827415fc90 con 0x7f825c003fd0 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827414c0d0 0x7f827414c550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827414c0d0 0x7f827414c550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47174/0 (socket says 172.21.15.81:47174) 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 -- 172.21.15.81:0/3898109504 learned_addr learned my addr 172.21.15.81:0/3898109504 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82799dc640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f825c003fd0 0x7f82741f3ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f827a1dd640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8274073020 0x7f8274073480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 -- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f825c003fd0 msgr2=0x7f82741f3ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f825c003fd0 0x7f82741f3ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 -- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8274073020 msgr2=0x7f8274073480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8274073020 0x7f8274073480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.316+0000 7f82791db640 1 -- 172.21.15.81:0/3898109504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8274073d90 con 0x7f827414c0d0 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.317+0000 7f82791db640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827414c0d0 0x7f827414c550 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8268036040 tx=0x7f8268033c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.317+0000 7f82727fc640 1 -- 172.21.15.81:0/3898109504 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8268038040 con 0x7f827414c0d0 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.317+0000 7f82727fc640 1 -- 172.21.15.81:0/3898109504 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f826802b850 con 0x7f827414c0d0 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.317+0000 7f82727fc640 1 -- 172.21.15.81:0/3898109504 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f826803c690 con 0x7f827414c0d0 2024-09-17T05:25:23.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.317+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8274074070 con 0x7f827414c0d0 2024-09-17T05:25:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.317+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f827415d890 con 0x7f827414c0d0 2024-09-17T05:25:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.318+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f827415dd70 con 0x7f827414c0d0 2024-09-17T05:25:23.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.318+0000 7f82727fc640 1 -- 172.21.15.81:0/3898109504 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f8268043020 con 0x7f827414c0d0 2024-09-17T05:25:23.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.319+0000 7f82727fc640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8260079280 0x7f826007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.319+0000 7f82799dc640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8260079280 0x7f826007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.319+0000 7f82727fc640 1 -- 172.21.15.81:0/3898109504 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f82680bbe10 con 0x7f827414c0d0 2024-09-17T05:25:23.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.320+0000 7f82799dc640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8260079280 0x7f826007b740 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8264005fd0 tx=0x7f8264009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:23.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.324+0000 7f82727fc640 1 -- 172.21.15.81:0/3898109504 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f827415dd70 con 0x7f827414c0d0 2024-09-17T05:25:23.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.494+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f827415f750 con 0x7f8260079280 2024-09-17T05:25:23.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.498+0000 7f82727fc640 1 -- 172.21.15.81:0/3898109504 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252480 (secure 0 0 0) 0x7f827415f750 con 0x7f8260079280 2024-09-17T05:25:23.501 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:23.503 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:25:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8260079280 msgr2=0x7f826007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8260079280 0x7f826007b740 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f8264005fd0 tx=0x7f8264009500 comp rx=0 tx=0).stop 2024-09-17T05:25:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827414c0d0 msgr2=0x7f827414c550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.504 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827414c0d0 0x7f827414c550 secure :-1 s=READY pgs=1573 cs=0 l=1 rev1=1 crypto rx=0x7f8268036040 tx=0x7f8268033c30 comp rx=0 tx=0).stop 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 shutdown_connections 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8260079280 0x7f826007b740 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8274073020 0x7f8274073480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f827414c0d0 0x7f827414c550 unknown :-1 s=CLOSED pgs=1573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 --2- 172.21.15.81:0/3898109504 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f825c003fd0 0x7f82741f3ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 >> 172.21.15.81:0/3898109504 conn(0x7f82740b1690 msgr2=0x7f82740cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 shutdown_connections 2024-09-17T05:25:23.505 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.501+0000 7f827bc40640 1 -- 172.21.15.81:0/3898109504 wait complete. 2024-09-17T05:25:23.513 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":151,"stamp":"2024-09-17T05:25:22.053540+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":264460,"kb_used_data":14920,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754710260,"statfs":{"total":773094113280,"available":772823306240,"internally_reserved":0,"allocated":15278080,"data_stored":7371092,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":18,"apply_latency_ms":18,"commit_latency_ns":18000000,"apply_latency_ns":18000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.275491"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059162+0000","last_change":"2024-09-17T05:25:15.781275+0000","last_active":"2024-09-17T05:25:18.059162+0000","last_peered":"2024-09-17T05:25:18.059162+0000","last_clean":"2024-09-17T05:25:18.059162+0000","last_became_active":"2024-09-17T05:25:15.780958+0000","last_became_peered":"2024-09-17T05:25:15.780958+0000","last_unstale":"2024-09-17T05:25:18.059162+0000","last_undegraded":"2024-09-17T05:25:18.059162+0000","last_fullsized":"2024-09-17T05:25:18.059162+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:16:45.353533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775840+0000","last_change":"2024-09-17T05:25:15.779234+0000","last_active":"2024-09-17T05:25:16.775840+0000","last_peered":"2024-09-17T05:25:16.775840+0000","last_clean":"2024-09-17T05:25:16.775840+0000","last_became_active":"2024-09-17T05:25:15.778988+0000","last_became_peered":"2024-09-17T05:25:15.778988+0000","last_unstale":"2024-09-17T05:25:16.775840+0000","last_undegraded":"2024-09-17T05:25:16.775840+0000","last_fullsized":"2024-09-17T05:25:16.775840+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:04.380751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932985+0000","last_change":"2024-09-17T05:25:15.782174+0000","last_active":"2024-09-17T05:25:16.932985+0000","last_peered":"2024-09-17T05:25:16.932985+0000","last_clean":"2024-09-17T05:25:16.932985+0000","last_became_active":"2024-09-17T05:25:15.781566+0000","last_became_peered":"2024-09-17T05:25:15.781566+0000","last_unstale":"2024-09-17T05:25:16.932985+0000","last_undegraded":"2024-09-17T05:25:16.932985+0000","last_fullsized":"2024-09-17T05:25:16.932985+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:19:34.001571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539770+0000","last_change":"2024-09-17T05:25:15.780953+0000","last_active":"2024-09-17T05:25:17.539770+0000","last_peered":"2024-09-17T05:25:17.539770+0000","last_clean":"2024-09-17T05:25:17.539770+0000","last_became_active":"2024-09-17T05:25:15.780366+0000","last_became_peered":"2024-09-17T05:25:15.780366+0000","last_unstale":"2024-09-17T05:25:17.539770+0000","last_undegraded":"2024-09-17T05:25:17.539770+0000","last_fullsized":"2024-09-17T05:25:17.539770+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:58:29.231313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775776+0000","last_change":"2024-09-17T05:25:15.775617+0000","last_active":"2024-09-17T05:25:16.775776+0000","last_peered":"2024-09-17T05:25:16.775776+0000","last_clean":"2024-09-17T05:25:16.775776+0000","last_became_active":"2024-09-17T05:25:15.775327+0000","last_became_peered":"2024-09-17T05:25:15.775327+0000","last_unstale":"2024-09-17T05:25:16.775776+0000","last_undegraded":"2024-09-17T05:25:16.775776+0000","last_fullsized":"2024-09-17T05:25:16.775776+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:33.478051+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769789+0000","last_change":"2024-09-17T05:25:15.773096+0000","last_active":"2024-09-17T05:25:16.769789+0000","last_peered":"2024-09-17T05:25:16.769789+0000","last_clean":"2024-09-17T05:25:16.769789+0000","last_became_active":"2024-09-17T05:25:15.772711+0000","last_became_peered":"2024-09-17T05:25:15.772711+0000","last_unstale":"2024-09-17T05:25:16.769789+0000","last_undegraded":"2024-09-17T05:25:16.769789+0000","last_fullsized":"2024-09-17T05:25:16.769789+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:14:57.168138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058865+0000","last_change":"2024-09-17T05:25:15.778273+0000","last_active":"2024-09-17T05:25:18.058865+0000","last_peered":"2024-09-17T05:25:18.058865+0000","last_clean":"2024-09-17T05:25:18.058865+0000","last_became_active":"2024-09-17T05:25:15.777997+0000","last_became_peered":"2024-09-17T05:25:15.777997+0000","last_unstale":"2024-09-17T05:25:18.058865+0000","last_undegraded":"2024-09-17T05:25:18.058865+0000","last_fullsized":"2024-09-17T05:25:18.058865+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:59:55.772250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775358+0000","last_change":"2024-09-17T05:25:15.779874+0000","last_active":"2024-09-17T05:25:16.775358+0000","last_peered":"2024-09-17T05:25:16.775358+0000","last_clean":"2024-09-17T05:25:16.775358+0000","last_became_active":"2024-09-17T05:25:15.779598+0000","last_became_peered":"2024-09-17T05:25:15.779598+0000","last_unstale":"2024-09-17T05:25:16.775358+0000","last_undegraded":"2024-09-17T05:25:16.775358+0000","last_fullsized":"2024-09-17T05:25:16.775358+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:15.089447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776291+0000","last_change":"2024-09-17T05:25:15.775090+0000","last_active":"2024-09-17T05:25:16.776291+0000","last_peered":"2024-09-17T05:25:16.776291+0000","last_clean":"2024-09-17T05:25:16.776291+0000","last_became_active":"2024-09-17T05:25:15.774800+0000","last_became_peered":"2024-09-17T05:25:15.774800+0000","last_unstale":"2024-09-17T05:25:16.776291+0000","last_undegraded":"2024-09-17T05:25:16.776291+0000","last_fullsized":"2024-09-17T05:25:16.776291+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:14.805451+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775978+0000","last_change":"2024-09-17T05:25:15.783867+0000","last_active":"2024-09-17T05:25:16.775978+0000","last_peered":"2024-09-17T05:25:16.775978+0000","last_clean":"2024-09-17T05:25:16.775978+0000","last_became_active":"2024-09-17T05:25:15.783461+0000","last_became_peered":"2024-09-17T05:25:15.783461+0000","last_unstale":"2024-09-17T05:25:16.775978+0000","last_undegraded":"2024-09-17T05:25:16.775978+0000","last_fullsized":"2024-09-17T05:25:16.775978+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:44.512254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775709+0000","last_change":"2024-09-17T05:25:15.783754+0000","last_active":"2024-09-17T05:25:16.775709+0000","last_peered":"2024-09-17T05:25:16.775709+0000","last_clean":"2024-09-17T05:25:16.775709+0000","last_became_active":"2024-09-17T05:25:15.783442+0000","last_became_peered":"2024-09-17T05:25:15.783442+0000","last_unstale":"2024-09-17T05:25:16.775709+0000","last_undegraded":"2024-09-17T05:25:16.775709+0000","last_fullsized":"2024-09-17T05:25:16.775709+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:35.221850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775614+0000","last_change":"2024-09-17T05:25:15.778550+0000","last_active":"2024-09-17T05:25:16.775614+0000","last_peered":"2024-09-17T05:25:16.775614+0000","last_clean":"2024-09-17T05:25:16.775614+0000","last_became_active":"2024-09-17T05:25:15.778184+0000","last_became_peered":"2024-09-17T05:25:15.778184+0000","last_unstale":"2024-09-17T05:25:16.775614+0000","last_undegraded":"2024-09-17T05:25:16.775614+0000","last_fullsized":"2024-09-17T05:25:16.775614+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:34.040502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932991+0000","last_change":"2024-09-17T05:25:15.771243+0000","last_active":"2024-09-17T05:25:16.932991+0000","last_peered":"2024-09-17T05:25:16.932991+0000","last_clean":"2024-09-17T05:25:16.932991+0000","last_became_active":"2024-09-17T05:25:15.770980+0000","last_became_peered":"2024-09-17T05:25:15.770980+0000","last_unstale":"2024-09-17T05:25:16.932991+0000","last_undegraded":"2024-09-17T05:25:16.932991+0000","last_fullsized":"2024-09-17T05:25:16.932991+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:14:15.089447+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932685+0000","last_change":"2024-09-17T05:25:15.778841+0000","last_active":"2024-09-17T05:25:16.932685+0000","last_peered":"2024-09-17T05:25:16.932685+0000","last_clean":"2024-09-17T05:25:16.932685+0000","last_became_active":"2024-09-17T05:25:15.778540+0000","last_became_peered":"2024-09-17T05:25:15.778540+0000","last_unstale":"2024-09-17T05:25:16.932685+0000","last_undegraded":"2024-09-17T05:25:16.932685+0000","last_fullsized":"2024-09-17T05:25:16.932685+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:43:25.695653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058935+0000","last_change":"2024-09-17T05:25:15.780028+0000","last_active":"2024-09-17T05:25:18.058935+0000","last_peered":"2024-09-17T05:25:18.058935+0000","last_clean":"2024-09-17T05:25:18.058935+0000","last_became_active":"2024-09-17T05:25:15.779745+0000","last_became_peered":"2024-09-17T05:25:15.779745+0000","last_unstale":"2024-09-17T05:25:18.058935+0000","last_undegraded":"2024-09-17T05:25:18.058935+0000","last_fullsized":"2024-09-17T05:25:18.058935+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:13.037164+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.057959+0000","last_change":"2024-09-17T05:25:15.776111+0000","last_active":"2024-09-17T05:25:18.057959+0000","last_peered":"2024-09-17T05:25:18.057959+0000","last_clean":"2024-09-17T05:25:18.057959+0000","last_became_active":"2024-09-17T05:25:15.775840+0000","last_became_peered":"2024-09-17T05:25:15.775840+0000","last_unstale":"2024-09-17T05:25:18.057959+0000","last_undegraded":"2024-09-17T05:25:18.057959+0000","last_fullsized":"2024-09-17T05:25:18.057959+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:17:10.254729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769808+0000","last_change":"2024-09-17T05:25:15.772090+0000","last_active":"2024-09-17T05:25:16.769808+0000","last_peered":"2024-09-17T05:25:16.769808+0000","last_clean":"2024-09-17T05:25:16.769808+0000","last_became_active":"2024-09-17T05:25:15.771844+0000","last_became_peered":"2024-09-17T05:25:15.771844+0000","last_unstale":"2024-09-17T05:25:16.769808+0000","last_undegraded":"2024-09-17T05:25:16.769808+0000","last_fullsized":"2024-09-17T05:25:16.769808+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:51:21.634960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058704+0000","last_change":"2024-09-17T05:25:15.768637+0000","last_active":"2024-09-17T05:25:18.058704+0000","last_peered":"2024-09-17T05:25:18.058704+0000","last_clean":"2024-09-17T05:25:18.058704+0000","last_became_active":"2024-09-17T05:25:15.768327+0000","last_became_peered":"2024-09-17T05:25:15.768327+0000","last_unstale":"2024-09-17T05:25:18.058704+0000","last_undegraded":"2024-09-17T05:25:18.058704+0000","last_fullsized":"2024-09-17T05:25:18.058704+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:52.922629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769774+0000","last_change":"2024-09-17T05:25:15.781739+0000","last_active":"2024-09-17T05:25:16.769774+0000","last_peered":"2024-09-17T05:25:16.769774+0000","last_clean":"2024-09-17T05:25:16.769774+0000","last_became_active":"2024-09-17T05:25:15.781446+0000","last_became_peered":"2024-09-17T05:25:15.781446+0000","last_unstale":"2024-09-17T05:25:16.769774+0000","last_undegraded":"2024-09-17T05:25:16.769774+0000","last_fullsized":"2024-09-17T05:25:16.769774+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:12.549783+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932929+0000","last_change":"2024-09-17T05:25:15.775588+0000","last_active":"2024-09-17T05:25:16.932929+0000","last_peered":"2024-09-17T05:25:16.932929+0000","last_clean":"2024-09-17T05:25:16.932929+0000","last_became_active":"2024-09-17T05:25:15.775288+0000","last_became_peered":"2024-09-17T05:25:15.775288+0000","last_unstale":"2024-09-17T05:25:16.932929+0000","last_undegraded":"2024-09-17T05:25:16.932929+0000","last_fullsized":"2024-09-17T05:25:16.932929+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:15:51.557756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769747+0000","last_change":"2024-09-17T05:25:15.770291+0000","last_active":"2024-09-17T05:25:16.769747+0000","last_peered":"2024-09-17T05:25:16.769747+0000","last_clean":"2024-09-17T05:25:16.769747+0000","last_became_active":"2024-09-17T05:25:15.769916+0000","last_became_peered":"2024-09-17T05:25:15.769916+0000","last_unstale":"2024-09-17T05:25:16.769747+0000","last_undegraded":"2024-09-17T05:25:16.769747+0000","last_fullsized":"2024-09-17T05:25:16.769747+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:55:46.855346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775604+0000","last_change":"2024-09-17T05:25:15.773447+0000","last_active":"2024-09-17T05:25:16.775604+0000","last_peered":"2024-09-17T05:25:16.775604+0000","last_clean":"2024-09-17T05:25:16.775604+0000","last_became_active":"2024-09-17T05:25:15.773192+0000","last_became_peered":"2024-09-17T05:25:15.773192+0000","last_unstale":"2024-09-17T05:25:16.775604+0000","last_undegraded":"2024-09-17T05:25:16.775604+0000","last_fullsized":"2024-09-17T05:25:16.775604+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:21:48.928213+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769635+0000","last_change":"2024-09-17T05:25:15.771301+0000","last_active":"2024-09-17T05:25:16.769635+0000","last_peered":"2024-09-17T05:25:16.769635+0000","last_clean":"2024-09-17T05:25:16.769635+0000","last_became_active":"2024-09-17T05:25:15.770952+0000","last_became_peered":"2024-09-17T05:25:15.770952+0000","last_unstale":"2024-09-17T05:25:16.769635+0000","last_undegraded":"2024-09-17T05:25:16.769635+0000","last_fullsized":"2024-09-17T05:25:16.769635+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:49.941023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775428+0000","last_change":"2024-09-17T05:25:15.774105+0000","last_active":"2024-09-17T05:25:16.775428+0000","last_peered":"2024-09-17T05:25:16.775428+0000","last_clean":"2024-09-17T05:25:16.775428+0000","last_became_active":"2024-09-17T05:25:15.773801+0000","last_became_peered":"2024-09-17T05:25:15.773801+0000","last_unstale":"2024-09-17T05:25:16.775428+0000","last_undegraded":"2024-09-17T05:25:16.775428+0000","last_fullsized":"2024-09-17T05:25:16.775428+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:57.061440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933174+0000","last_change":"2024-09-17T05:25:15.778030+0000","last_active":"2024-09-17T05:25:16.933174+0000","last_peered":"2024-09-17T05:25:16.933174+0000","last_clean":"2024-09-17T05:25:16.933174+0000","last_became_active":"2024-09-17T05:25:15.777765+0000","last_became_peered":"2024-09-17T05:25:15.777765+0000","last_unstale":"2024-09-17T05:25:16.933174+0000","last_undegraded":"2024-09-17T05:25:16.933174+0000","last_fullsized":"2024-09-17T05:25:16.933174+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:29.357981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058298+0000","last_change":"2024-09-17T05:25:15.783304+0000","last_active":"2024-09-17T05:25:18.058298+0000","last_peered":"2024-09-17T05:25:18.058298+0000","last_clean":"2024-09-17T05:25:18.058298+0000","last_became_active":"2024-09-17T05:25:15.782984+0000","last_became_peered":"2024-09-17T05:25:15.782984+0000","last_unstale":"2024-09-17T05:25:18.058298+0000","last_undegraded":"2024-09-17T05:25:18.058298+0000","last_fullsized":"2024-09-17T05:25:18.058298+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:12:51.556695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933227+0000","last_change":"2024-09-17T05:25:15.781893+0000","last_active":"2024-09-17T05:25:16.933227+0000","last_peered":"2024-09-17T05:25:16.933227+0000","last_clean":"2024-09-17T05:25:16.933227+0000","last_became_active":"2024-09-17T05:25:15.781519+0000","last_became_peered":"2024-09-17T05:25:15.781519+0000","last_unstale":"2024-09-17T05:25:16.933227+0000","last_undegraded":"2024-09-17T05:25:16.933227+0000","last_fullsized":"2024-09-17T05:25:16.933227+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:23:36.963481+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539784+0000","last_change":"2024-09-17T05:25:15.783842+0000","last_active":"2024-09-17T05:25:17.539784+0000","last_peered":"2024-09-17T05:25:17.539784+0000","last_clean":"2024-09-17T05:25:17.539784+0000","last_became_active":"2024-09-17T05:25:15.783544+0000","last_became_peered":"2024-09-17T05:25:15.783544+0000","last_unstale":"2024-09-17T05:25:17.539784+0000","last_undegraded":"2024-09-17T05:25:17.539784+0000","last_fullsized":"2024-09-17T05:25:17.539784+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:30.018153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933059+0000","last_change":"2024-09-17T05:25:15.781787+0000","last_active":"2024-09-17T05:25:16.933059+0000","last_peered":"2024-09-17T05:25:16.933059+0000","last_clean":"2024-09-17T05:25:16.933059+0000","last_became_active":"2024-09-17T05:25:15.781467+0000","last_became_peered":"2024-09-17T05:25:15.781467+0000","last_unstale":"2024-09-17T05:25:16.933059+0000","last_undegraded":"2024-09-17T05:25:16.933059+0000","last_fullsized":"2024-09-17T05:25:16.933059+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:34.155724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776849+0000","last_change":"2024-09-17T05:25:15.780464+0000","last_active":"2024-09-17T05:25:16.776849+0000","last_peered":"2024-09-17T05:25:16.776849+0000","last_clean":"2024-09-17T05:25:16.776849+0000","last_became_active":"2024-09-17T05:25:15.779128+0000","last_became_peered":"2024-09-17T05:25:15.779128+0000","last_unstale":"2024-09-17T05:25:16.776849+0000","last_undegraded":"2024-09-17T05:25:16.776849+0000","last_fullsized":"2024-09-17T05:25:16.776849+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:30.953416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776304+0000","last_change":"2024-09-17T05:25:15.778049+0000","last_active":"2024-09-17T05:25:16.776304+0000","last_peered":"2024-09-17T05:25:16.776304+0000","last_clean":"2024-09-17T05:25:16.776304+0000","last_became_active":"2024-09-17T05:25:15.777282+0000","last_became_peered":"2024-09-17T05:25:15.777282+0000","last_unstale":"2024-09-17T05:25:16.776304+0000","last_undegraded":"2024-09-17T05:25:16.776304+0000","last_fullsized":"2024-09-17T05:25:16.776304+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:30.018153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058049+0000","last_change":"2024-09-17T05:25:15.768506+0000","last_active":"2024-09-17T05:25:18.058049+0000","last_peered":"2024-09-17T05:25:18.058049+0000","last_clean":"2024-09-17T05:25:18.058049+0000","last_became_active":"2024-09-17T05:25:15.768210+0000","last_became_peered":"2024-09-17T05:25:15.768210+0000","last_unstale":"2024-09-17T05:25:18.058049+0000","last_undegraded":"2024-09-17T05:25:18.058049+0000","last_fullsized":"2024-09-17T05:25:18.058049+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:28.501661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058495+0000","last_change":"2024-09-17T05:25:15.780918+0000","last_active":"2024-09-17T05:25:18.058495+0000","last_peered":"2024-09-17T05:25:18.058495+0000","last_clean":"2024-09-17T05:25:18.058495+0000","last_became_active":"2024-09-17T05:25:15.780662+0000","last_became_peered":"2024-09-17T05:25:15.780662+0000","last_unstale":"2024-09-17T05:25:18.058495+0000","last_undegraded":"2024-09-17T05:25:18.058495+0000","last_fullsized":"2024-09-17T05:25:18.058495+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:55:54.640228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"139'4","reported_seq":19,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059254+0000","last_change":"2024-09-17T05:25:14.796665+0000","last_active":"2024-09-17T05:25:18.059254+0000","last_peered":"2024-09-17T05:25:18.059254+0000","last_clean":"2024-09-17T05:25:18.059254+0000","last_became_active":"2024-09-17T05:25:14.796385+0000","last_became_peered":"2024-09-17T05:25:14.796385+0000","last_unstale":"2024-09-17T05:25:18.059254+0000","last_undegraded":"2024-09-17T05:25:18.059254+0000","last_fullsized":"2024-09-17T05:25:18.059254+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:06.502467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776988+0000","last_change":"2024-09-17T05:25:15.776858+0000","last_active":"2024-09-17T05:25:16.776988+0000","last_peered":"2024-09-17T05:25:16.776988+0000","last_clean":"2024-09-17T05:25:16.776988+0000","last_became_active":"2024-09-17T05:25:15.776519+0000","last_became_peered":"2024-09-17T05:25:15.776519+0000","last_unstale":"2024-09-17T05:25:16.776988+0000","last_undegraded":"2024-09-17T05:25:16.776988+0000","last_fullsized":"2024-09-17T05:25:16.776988+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:28:24.065056+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776808+0000","last_change":"2024-09-17T05:25:14.794435+0000","last_active":"2024-09-17T05:25:16.776808+0000","last_peered":"2024-09-17T05:25:16.776808+0000","last_clean":"2024-09-17T05:25:16.776808+0000","last_became_active":"2024-09-17T05:25:14.794186+0000","last_became_peered":"2024-09-17T05:25:14.794186+0000","last_unstale":"2024-09-17T05:25:16.776808+0000","last_undegraded":"2024-09-17T05:25:16.776808+0000","last_fullsized":"2024-09-17T05:25:16.776808+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:45:03.376818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769874+0000","last_change":"2024-09-17T05:25:15.774879+0000","last_active":"2024-09-17T05:25:16.769874+0000","last_peered":"2024-09-17T05:25:16.769874+0000","last_clean":"2024-09-17T05:25:16.769874+0000","last_became_active":"2024-09-17T05:25:15.774613+0000","last_became_peered":"2024-09-17T05:25:15.774613+0000","last_unstale":"2024-09-17T05:25:16.769874+0000","last_undegraded":"2024-09-17T05:25:16.769874+0000","last_fullsized":"2024-09-17T05:25:16.769874+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:28:16.699643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539514+0000","last_change":"2024-09-17T05:25:14.794639+0000","last_active":"2024-09-17T05:25:17.539514+0000","last_peered":"2024-09-17T05:25:17.539514+0000","last_clean":"2024-09-17T05:25:17.539514+0000","last_became_active":"2024-09-17T05:25:14.794396+0000","last_became_peered":"2024-09-17T05:25:14.794396+0000","last_unstale":"2024-09-17T05:25:17.539514+0000","last_undegraded":"2024-09-17T05:25:17.539514+0000","last_fullsized":"2024-09-17T05:25:17.539514+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:35.589378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933247+0000","last_change":"2024-09-17T05:25:15.768605+0000","last_active":"2024-09-17T05:25:16.933247+0000","last_peered":"2024-09-17T05:25:16.933247+0000","last_clean":"2024-09-17T05:25:16.933247+0000","last_became_active":"2024-09-17T05:25:15.768350+0000","last_became_peered":"2024-09-17T05:25:15.768350+0000","last_unstale":"2024-09-17T05:25:16.933247+0000","last_undegraded":"2024-09-17T05:25:16.933247+0000","last_fullsized":"2024-09-17T05:25:16.933247+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:01:57.061440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539940+0000","last_change":"2024-09-17T05:25:14.793110+0000","last_active":"2024-09-17T05:25:17.539940+0000","last_peered":"2024-09-17T05:25:17.539940+0000","last_clean":"2024-09-17T05:25:17.539940+0000","last_became_active":"2024-09-17T05:25:14.792837+0000","last_became_peered":"2024-09-17T05:25:14.792837+0000","last_unstale":"2024-09-17T05:25:17.539940+0000","last_undegraded":"2024-09-17T05:25:17.539940+0000","last_fullsized":"2024-09-17T05:25:17.539940+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:15.489523+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058580+0000","last_change":"2024-09-17T05:25:15.776112+0000","last_active":"2024-09-17T05:25:18.058580+0000","last_peered":"2024-09-17T05:25:18.058580+0000","last_clean":"2024-09-17T05:25:18.058580+0000","last_became_active":"2024-09-17T05:25:15.775131+0000","last_became_peered":"2024-09-17T05:25:15.775131+0000","last_unstale":"2024-09-17T05:25:18.058580+0000","last_undegraded":"2024-09-17T05:25:18.058580+0000","last_fullsized":"2024-09-17T05:25:18.058580+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:11:44.062976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933232+0000","last_change":"2024-09-17T05:25:14.797188+0000","last_active":"2024-09-17T05:25:16.933232+0000","last_peered":"2024-09-17T05:25:16.933232+0000","last_clean":"2024-09-17T05:25:16.933232+0000","last_became_active":"2024-09-17T05:25:14.794128+0000","last_became_peered":"2024-09-17T05:25:14.794128+0000","last_unstale":"2024-09-17T05:25:16.933232+0000","last_undegraded":"2024-09-17T05:25:16.933232+0000","last_fullsized":"2024-09-17T05:25:16.933232+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:52.216453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539453+0000","last_change":"2024-09-17T05:25:15.779868+0000","last_active":"2024-09-17T05:25:17.539453+0000","last_peered":"2024-09-17T05:25:17.539453+0000","last_clean":"2024-09-17T05:25:17.539453+0000","last_became_active":"2024-09-17T05:25:15.778972+0000","last_became_peered":"2024-09-17T05:25:15.778972+0000","last_unstale":"2024-09-17T05:25:17.539453+0000","last_undegraded":"2024-09-17T05:25:17.539453+0000","last_fullsized":"2024-09-17T05:25:17.539453+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:15.867309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539331+0000","last_change":"2024-09-17T05:25:14.786746+0000","last_active":"2024-09-17T05:25:17.539331+0000","last_peered":"2024-09-17T05:25:17.539331+0000","last_clean":"2024-09-17T05:25:17.539331+0000","last_became_active":"2024-09-17T05:25:14.786464+0000","last_became_peered":"2024-09-17T05:25:14.786464+0000","last_unstale":"2024-09-17T05:25:17.539331+0000","last_undegraded":"2024-09-17T05:25:17.539331+0000","last_fullsized":"2024-09-17T05:25:17.539331+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:43:33.116403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539307+0000","last_change":"2024-09-17T05:25:15.778406+0000","last_active":"2024-09-17T05:25:17.539307+0000","last_peered":"2024-09-17T05:25:17.539307+0000","last_clean":"2024-09-17T05:25:17.539307+0000","last_became_active":"2024-09-17T05:25:15.778216+0000","last_became_peered":"2024-09-17T05:25:15.778216+0000","last_unstale":"2024-09-17T05:25:17.539307+0000","last_undegraded":"2024-09-17T05:25:17.539307+0000","last_fullsized":"2024-09-17T05:25:17.539307+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:35.523992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776389+0000","last_change":"2024-09-17T05:25:14.796913+0000","last_active":"2024-09-17T05:25:16.776389+0000","last_peered":"2024-09-17T05:25:16.776389+0000","last_clean":"2024-09-17T05:25:16.776389+0000","last_became_active":"2024-09-17T05:25:14.796389+0000","last_became_peered":"2024-09-17T05:25:14.796389+0000","last_unstale":"2024-09-17T05:25:16.776389+0000","last_undegraded":"2024-09-17T05:25:16.776389+0000","last_fullsized":"2024-09-17T05:25:16.776389+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:48:07.251490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769695+0000","last_change":"2024-09-17T05:25:15.773099+0000","last_active":"2024-09-17T05:25:16.769695+0000","last_peered":"2024-09-17T05:25:16.769695+0000","last_clean":"2024-09-17T05:25:16.769695+0000","last_became_active":"2024-09-17T05:25:15.772604+0000","last_became_peered":"2024-09-17T05:25:15.772604+0000","last_unstale":"2024-09-17T05:25:16.769695+0000","last_undegraded":"2024-09-17T05:25:16.769695+0000","last_fullsized":"2024-09-17T05:25:16.769695+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:54:23.912406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058171+0000","last_change":"2024-09-17T05:25:14.793890+0000","last_active":"2024-09-17T05:25:18.058171+0000","last_peered":"2024-09-17T05:25:18.058171+0000","last_clean":"2024-09-17T05:25:18.058171+0000","last_became_active":"2024-09-17T05:25:14.793633+0000","last_became_peered":"2024-09-17T05:25:14.793633+0000","last_unstale":"2024-09-17T05:25:18.058171+0000","last_undegraded":"2024-09-17T05:25:18.058171+0000","last_fullsized":"2024-09-17T05:25:18.058171+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:23:50.264346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058654+0000","last_change":"2024-09-17T05:25:15.781922+0000","last_active":"2024-09-17T05:25:18.058654+0000","last_peered":"2024-09-17T05:25:18.058654+0000","last_clean":"2024-09-17T05:25:18.058654+0000","last_became_active":"2024-09-17T05:25:15.781474+0000","last_became_peered":"2024-09-17T05:25:15.781474+0000","last_unstale":"2024-09-17T05:25:18.058654+0000","last_undegraded":"2024-09-17T05:25:18.058654+0000","last_fullsized":"2024-09-17T05:25:18.058654+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:02.640800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769844+0000","last_change":"2024-09-17T05:25:14.792239+0000","last_active":"2024-09-17T05:25:16.769844+0000","last_peered":"2024-09-17T05:25:16.769844+0000","last_clean":"2024-09-17T05:25:16.769844+0000","last_became_active":"2024-09-17T05:25:14.791912+0000","last_became_peered":"2024-09-17T05:25:14.791912+0000","last_unstale":"2024-09-17T05:25:16.769844+0000","last_undegraded":"2024-09-17T05:25:16.769844+0000","last_fullsized":"2024-09-17T05:25:16.769844+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:26:00.447199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059016+0000","last_change":"2024-09-17T05:25:15.781725+0000","last_active":"2024-09-17T05:25:18.059016+0000","last_peered":"2024-09-17T05:25:18.059016+0000","last_clean":"2024-09-17T05:25:18.059016+0000","last_became_active":"2024-09-17T05:25:15.781430+0000","last_became_peered":"2024-09-17T05:25:15.781430+0000","last_unstale":"2024-09-17T05:25:18.059016+0000","last_undegraded":"2024-09-17T05:25:18.059016+0000","last_fullsized":"2024-09-17T05:25:18.059016+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:07:13.827504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"139'3","reported_seq":18,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769953+0000","last_change":"2024-09-17T05:25:14.793250+0000","last_active":"2024-09-17T05:25:16.769953+0000","last_peered":"2024-09-17T05:25:16.769953+0000","last_clean":"2024-09-17T05:25:16.769953+0000","last_became_active":"2024-09-17T05:25:14.792972+0000","last_became_peered":"2024-09-17T05:25:14.792972+0000","last_unstale":"2024-09-17T05:25:16.769953+0000","last_undegraded":"2024-09-17T05:25:16.769953+0000","last_fullsized":"2024-09-17T05:25:16.769953+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:52:43.923144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.777012+0000","last_change":"2024-09-17T05:25:15.782695+0000","last_active":"2024-09-17T05:25:16.777012+0000","last_peered":"2024-09-17T05:25:16.777012+0000","last_clean":"2024-09-17T05:25:16.777012+0000","last_became_active":"2024-09-17T05:25:15.782403+0000","last_became_peered":"2024-09-17T05:25:15.782403+0000","last_unstale":"2024-09-17T05:25:16.777012+0000","last_undegraded":"2024-09-17T05:25:16.777012+0000","last_fullsized":"2024-09-17T05:25:16.777012+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:31:39.044245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"139'6","reported_seq":21,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776685+0000","last_change":"2024-09-17T05:25:14.796088+0000","last_active":"2024-09-17T05:25:16.776685+0000","last_peered":"2024-09-17T05:25:16.776685+0000","last_clean":"2024-09-17T05:25:16.776685+0000","last_became_active":"2024-09-17T05:25:14.795601+0000","last_became_peered":"2024-09-17T05:25:14.795601+0000","last_unstale":"2024-09-17T05:25:16.776685+0000","last_undegraded":"2024-09-17T05:25:16.776685+0000","last_fullsized":"2024-09-17T05:25:16.776685+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:43.508321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058430+0000","last_change":"2024-09-17T05:25:15.769810+0000","last_active":"2024-09-17T05:25:18.058430+0000","last_peered":"2024-09-17T05:25:18.058430+0000","last_clean":"2024-09-17T05:25:18.058430+0000","last_became_active":"2024-09-17T05:25:15.768945+0000","last_became_peered":"2024-09-17T05:25:15.768945+0000","last_unstale":"2024-09-17T05:25:18.058430+0000","last_undegraded":"2024-09-17T05:25:18.058430+0000","last_fullsized":"2024-09-17T05:25:18.058430+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:51:53.364493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539458+0000","last_change":"2024-09-17T05:25:14.789024+0000","last_active":"2024-09-17T05:25:17.539458+0000","last_peered":"2024-09-17T05:25:17.539458+0000","last_clean":"2024-09-17T05:25:17.539458+0000","last_became_active":"2024-09-17T05:25:14.788769+0000","last_became_peered":"2024-09-17T05:25:14.788769+0000","last_unstale":"2024-09-17T05:25:17.539458+0000","last_undegraded":"2024-09-17T05:25:17.539458+0000","last_fullsized":"2024-09-17T05:25:17.539458+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:32:52.856520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058713+0000","last_change":"2024-09-17T05:25:15.772400+0000","last_active":"2024-09-17T05:25:18.058713+0000","last_peered":"2024-09-17T05:25:18.058713+0000","last_clean":"2024-09-17T05:25:18.058713+0000","last_became_active":"2024-09-17T05:25:15.772095+0000","last_became_peered":"2024-09-17T05:25:15.772095+0000","last_unstale":"2024-09-17T05:25:18.058713+0000","last_undegraded":"2024-09-17T05:25:18.058713+0000","last_fullsized":"2024-09-17T05:25:18.058713+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:38:22.046599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058762+0000","last_change":"2024-09-17T05:25:14.794322+0000","last_active":"2024-09-17T05:25:18.058762+0000","last_peered":"2024-09-17T05:25:18.058762+0000","last_clean":"2024-09-17T05:25:18.058762+0000","last_became_active":"2024-09-17T05:25:14.793988+0000","last_became_peered":"2024-09-17T05:25:14.793988+0000","last_unstale":"2024-09-17T05:25:18.058762+0000","last_undegraded":"2024-09-17T05:25:18.058762+0000","last_fullsized":"2024-09-17T05:25:18.058762+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:18:29.014220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539315+0000","last_change":"2024-09-17T05:25:15.779341+0000","last_active":"2024-09-17T05:25:17.539315+0000","last_peered":"2024-09-17T05:25:17.539315+0000","last_clean":"2024-09-17T05:25:17.539315+0000","last_became_active":"2024-09-17T05:25:15.779088+0000","last_became_peered":"2024-09-17T05:25:15.779088+0000","last_unstale":"2024-09-17T05:25:17.539315+0000","last_undegraded":"2024-09-17T05:25:17.539315+0000","last_fullsized":"2024-09-17T05:25:17.539315+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:16:25.047576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539366+0000","last_change":"2024-09-17T05:25:14.795615+0000","last_active":"2024-09-17T05:25:17.539366+0000","last_peered":"2024-09-17T05:25:17.539366+0000","last_clean":"2024-09-17T05:25:17.539366+0000","last_became_active":"2024-09-17T05:25:14.795338+0000","last_became_peered":"2024-09-17T05:25:14.795338+0000","last_unstale":"2024-09-17T05:25:17.539366+0000","last_undegraded":"2024-09-17T05:25:17.539366+0000","last_fullsized":"2024-09-17T05:25:17.539366+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:46.069453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932617+0000","last_change":"2024-09-17T05:25:15.770689+0000","last_active":"2024-09-17T05:25:16.932617+0000","last_peered":"2024-09-17T05:25:16.932617+0000","last_clean":"2024-09-17T05:25:16.932617+0000","last_became_active":"2024-09-17T05:25:15.770418+0000","last_became_peered":"2024-09-17T05:25:15.770418+0000","last_unstale":"2024-09-17T05:25:16.932617+0000","last_undegraded":"2024-09-17T05:25:16.932617+0000","last_fullsized":"2024-09-17T05:25:16.932617+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:55:31.466891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"139'8","reported_seq":23,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776139+0000","last_change":"2024-09-17T05:25:14.797300+0000","last_active":"2024-09-17T05:25:16.776139+0000","last_peered":"2024-09-17T05:25:16.776139+0000","last_clean":"2024-09-17T05:25:16.776139+0000","last_became_active":"2024-09-17T05:25:14.797009+0000","last_became_peered":"2024-09-17T05:25:14.797009+0000","last_unstale":"2024-09-17T05:25:16.776139+0000","last_undegraded":"2024-09-17T05:25:16.776139+0000","last_fullsized":"2024-09-17T05:25:16.776139+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:07:27.908257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539733+0000","last_change":"2024-09-17T05:25:15.779643+0000","last_active":"2024-09-17T05:25:17.539733+0000","last_peered":"2024-09-17T05:25:17.539733+0000","last_clean":"2024-09-17T05:25:17.539733+0000","last_became_active":"2024-09-17T05:25:15.779371+0000","last_became_peered":"2024-09-17T05:25:15.779371+0000","last_unstale":"2024-09-17T05:25:17.539733+0000","last_undegraded":"2024-09-17T05:25:17.539733+0000","last_fullsized":"2024-09-17T05:25:17.539733+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:28.913239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933105+0000","last_change":"2024-09-17T05:25:14.795978+0000","last_active":"2024-09-17T05:25:16.933105+0000","last_peered":"2024-09-17T05:25:16.933105+0000","last_clean":"2024-09-17T05:25:16.933105+0000","last_became_active":"2024-09-17T05:25:14.795145+0000","last_became_peered":"2024-09-17T05:25:14.795145+0000","last_unstale":"2024-09-17T05:25:16.933105+0000","last_undegraded":"2024-09-17T05:25:16.933105+0000","last_fullsized":"2024-09-17T05:25:16.933105+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:24:16.134634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058825+0000","last_change":"2024-09-17T05:25:15.777994+0000","last_active":"2024-09-17T05:25:18.058825+0000","last_peered":"2024-09-17T05:25:18.058825+0000","last_clean":"2024-09-17T05:25:18.058825+0000","last_became_active":"2024-09-17T05:25:15.777771+0000","last_became_peered":"2024-09-17T05:25:15.777771+0000","last_unstale":"2024-09-17T05:25:18.058825+0000","last_undegraded":"2024-09-17T05:25:18.058825+0000","last_fullsized":"2024-09-17T05:25:18.058825+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:13:38.148403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933015+0000","last_change":"2024-09-17T05:25:14.798054+0000","last_active":"2024-09-17T05:25:16.933015+0000","last_peered":"2024-09-17T05:25:16.933015+0000","last_clean":"2024-09-17T05:25:16.933015+0000","last_became_active":"2024-09-17T05:25:14.797432+0000","last_became_peered":"2024-09-17T05:25:14.797432+0000","last_unstale":"2024-09-17T05:25:16.933015+0000","last_undegraded":"2024-09-17T05:25:16.933015+0000","last_fullsized":"2024-09-17T05:25:16.933015+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:15.631374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539983+0000","last_change":"2024-09-17T05:25:15.780014+0000","last_active":"2024-09-17T05:25:17.539983+0000","last_peered":"2024-09-17T05:25:17.539983+0000","last_clean":"2024-09-17T05:25:17.539983+0000","last_became_active":"2024-09-17T05:25:15.778873+0000","last_became_peered":"2024-09-17T05:25:15.778873+0000","last_unstale":"2024-09-17T05:25:17.539983+0000","last_undegraded":"2024-09-17T05:25:17.539983+0000","last_fullsized":"2024-09-17T05:25:17.539983+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:29:30.953416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"139'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059074+0000","last_change":"2024-09-17T05:25:14.801709+0000","last_active":"2024-09-17T05:25:18.059074+0000","last_peered":"2024-09-17T05:25:18.059074+0000","last_clean":"2024-09-17T05:25:18.059074+0000","last_became_active":"2024-09-17T05:25:14.801400+0000","last_became_peered":"2024-09-17T05:25:14.801400+0000","last_unstale":"2024-09-17T05:25:18.059074+0000","last_undegraded":"2024-09-17T05:25:18.059074+0000","last_fullsized":"2024-09-17T05:25:18.059074+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:27.497728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058380+0000","last_change":"2024-09-17T05:25:15.783814+0000","last_active":"2024-09-17T05:25:18.058380+0000","last_peered":"2024-09-17T05:25:18.058380+0000","last_clean":"2024-09-17T05:25:18.058380+0000","last_became_active":"2024-09-17T05:25:15.783556+0000","last_became_peered":"2024-09-17T05:25:15.783556+0000","last_unstale":"2024-09-17T05:25:18.058380+0000","last_undegraded":"2024-09-17T05:25:18.058380+0000","last_fullsized":"2024-09-17T05:25:18.058380+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:48:52.630444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059261+0000","last_change":"2024-09-17T05:25:14.797861+0000","last_active":"2024-09-17T05:25:18.059261+0000","last_peered":"2024-09-17T05:25:18.059261+0000","last_clean":"2024-09-17T05:25:18.059261+0000","last_became_active":"2024-09-17T05:25:14.797490+0000","last_became_peered":"2024-09-17T05:25:14.797490+0000","last_unstale":"2024-09-17T05:25:18.059261+0000","last_undegraded":"2024-09-17T05:25:18.059261+0000","last_fullsized":"2024-09-17T05:25:18.059261+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:40:46.057529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932847+0000","last_change":"2024-09-17T05:25:15.772080+0000","last_active":"2024-09-17T05:25:16.932847+0000","last_peered":"2024-09-17T05:25:16.932847+0000","last_clean":"2024-09-17T05:25:16.932847+0000","last_became_active":"2024-09-17T05:25:15.771805+0000","last_became_peered":"2024-09-17T05:25:15.771805+0000","last_unstale":"2024-09-17T05:25:16.932847+0000","last_undegraded":"2024-09-17T05:25:16.932847+0000","last_fullsized":"2024-09-17T05:25:16.932847+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:30:10.867709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539582+0000","last_change":"2024-09-17T05:25:14.793137+0000","last_active":"2024-09-17T05:25:17.539582+0000","last_peered":"2024-09-17T05:25:17.539582+0000","last_clean":"2024-09-17T05:25:17.539582+0000","last_became_active":"2024-09-17T05:25:14.792865+0000","last_became_peered":"2024-09-17T05:25:14.792865+0000","last_unstale":"2024-09-17T05:25:17.539582+0000","last_undegraded":"2024-09-17T05:25:17.539582+0000","last_fullsized":"2024-09-17T05:25:17.539582+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:25:48.545193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058881+0000","last_change":"2024-09-17T05:25:15.774884+0000","last_active":"2024-09-17T05:25:18.058881+0000","last_peered":"2024-09-17T05:25:18.058881+0000","last_clean":"2024-09-17T05:25:18.058881+0000","last_became_active":"2024-09-17T05:25:15.774599+0000","last_became_peered":"2024-09-17T05:25:15.774599+0000","last_unstale":"2024-09-17T05:25:18.058881+0000","last_undegraded":"2024-09-17T05:25:18.058881+0000","last_fullsized":"2024-09-17T05:25:18.058881+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:56:32.022507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058948+0000","last_change":"2024-09-17T05:25:14.798585+0000","last_active":"2024-09-17T05:25:18.058948+0000","last_peered":"2024-09-17T05:25:18.058948+0000","last_clean":"2024-09-17T05:25:18.058948+0000","last_became_active":"2024-09-17T05:25:14.798315+0000","last_became_peered":"2024-09-17T05:25:14.798315+0000","last_unstale":"2024-09-17T05:25:18.058948+0000","last_undegraded":"2024-09-17T05:25:18.058948+0000","last_fullsized":"2024-09-17T05:25:18.058948+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:03.445359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059252+0000","last_change":"2024-09-17T05:25:15.777564+0000","last_active":"2024-09-17T05:25:18.059252+0000","last_peered":"2024-09-17T05:25:18.059252+0000","last_clean":"2024-09-17T05:25:18.059252+0000","last_became_active":"2024-09-17T05:25:15.776379+0000","last_became_peered":"2024-09-17T05:25:15.776379+0000","last_unstale":"2024-09-17T05:25:18.059252+0000","last_undegraded":"2024-09-17T05:25:18.059252+0000","last_fullsized":"2024-09-17T05:25:18.059252+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:24:58.550913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539422+0000","last_change":"2024-09-17T05:25:14.786737+0000","last_active":"2024-09-17T05:25:17.539422+0000","last_peered":"2024-09-17T05:25:17.539422+0000","last_clean":"2024-09-17T05:25:17.539422+0000","last_became_active":"2024-09-17T05:25:14.786430+0000","last_became_peered":"2024-09-17T05:25:14.786430+0000","last_unstale":"2024-09-17T05:25:17.539422+0000","last_undegraded":"2024-09-17T05:25:17.539422+0000","last_fullsized":"2024-09-17T05:25:17.539422+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:33:50.260359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769903+0000","last_change":"2024-09-17T05:25:15.769491+0000","last_active":"2024-09-17T05:25:16.769903+0000","last_peered":"2024-09-17T05:25:16.769903+0000","last_clean":"2024-09-17T05:25:16.769903+0000","last_became_active":"2024-09-17T05:25:15.769145+0000","last_became_peered":"2024-09-17T05:25:15.769145+0000","last_unstale":"2024-09-17T05:25:16.769903+0000","last_undegraded":"2024-09-17T05:25:16.769903+0000","last_fullsized":"2024-09-17T05:25:16.769903+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:43.813417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059272+0000","last_change":"2024-09-17T05:25:14.804390+0000","last_active":"2024-09-17T05:25:18.059272+0000","last_peered":"2024-09-17T05:25:18.059272+0000","last_clean":"2024-09-17T05:25:18.059272+0000","last_became_active":"2024-09-17T05:25:14.804104+0000","last_became_peered":"2024-09-17T05:25:14.804104+0000","last_unstale":"2024-09-17T05:25:18.059272+0000","last_undegraded":"2024-09-17T05:25:18.059272+0000","last_fullsized":"2024-09-17T05:25:18.059272+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:37:20.358596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059070+0000","last_change":"2024-09-17T05:25:15.780348+0000","last_active":"2024-09-17T05:25:18.059070+0000","last_peered":"2024-09-17T05:25:18.059070+0000","last_clean":"2024-09-17T05:25:18.059070+0000","last_became_active":"2024-09-17T05:25:15.780079+0000","last_became_peered":"2024-09-17T05:25:15.780079+0000","last_unstale":"2024-09-17T05:25:18.059070+0000","last_undegraded":"2024-09-17T05:25:18.059070+0000","last_fullsized":"2024-09-17T05:25:18.059070+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:00:52.925198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"139'2","reported_seq":17,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058951+0000","last_change":"2024-09-17T05:25:14.795475+0000","last_active":"2024-09-17T05:25:18.058951+0000","last_peered":"2024-09-17T05:25:18.058951+0000","last_clean":"2024-09-17T05:25:18.058951+0000","last_became_active":"2024-09-17T05:25:14.795056+0000","last_became_peered":"2024-09-17T05:25:14.795056+0000","last_unstale":"2024-09-17T05:25:18.058951+0000","last_undegraded":"2024-09-17T05:25:18.058951+0000","last_fullsized":"2024-09-17T05:25:18.058951+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:27.909306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058684+0000","last_change":"2024-09-17T05:25:15.775813+0000","last_active":"2024-09-17T05:25:18.058684+0000","last_peered":"2024-09-17T05:25:18.058684+0000","last_clean":"2024-09-17T05:25:18.058684+0000","last_became_active":"2024-09-17T05:25:15.775548+0000","last_became_peered":"2024-09-17T05:25:15.775548+0000","last_unstale":"2024-09-17T05:25:18.058684+0000","last_undegraded":"2024-09-17T05:25:18.058684+0000","last_fullsized":"2024-09-17T05:25:18.058684+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:26.533597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"140'1","reported_seq":16,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.933097+0000","last_change":"2024-09-17T05:25:14.799199+0000","last_active":"2024-09-17T05:25:16.933097+0000","last_peered":"2024-09-17T05:25:16.933097+0000","last_clean":"2024-09-17T05:25:16.933097+0000","last_became_active":"2024-09-17T05:25:14.798912+0000","last_became_peered":"2024-09-17T05:25:14.798912+0000","last_unstale":"2024-09-17T05:25:16.933097+0000","last_undegraded":"2024-09-17T05:25:16.933097+0000","last_fullsized":"2024-09-17T05:25:16.933097+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:24:59.950112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.769984+0000","last_change":"2024-09-17T05:25:15.780326+0000","last_active":"2024-09-17T05:25:16.769984+0000","last_peered":"2024-09-17T05:25:16.769984+0000","last_clean":"2024-09-17T05:25:16.769984+0000","last_became_active":"2024-09-17T05:25:15.779755+0000","last_became_peered":"2024-09-17T05:25:15.779755+0000","last_unstale":"2024-09-17T05:25:16.769984+0000","last_undegraded":"2024-09-17T05:25:16.769984+0000","last_fullsized":"2024-09-17T05:25:16.769984+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:44:21.583723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.775915+0000","last_change":"2024-09-17T05:25:14.799256+0000","last_active":"2024-09-17T05:25:16.775915+0000","last_peered":"2024-09-17T05:25:16.775915+0000","last_clean":"2024-09-17T05:25:16.775915+0000","last_became_active":"2024-09-17T05:25:14.798928+0000","last_became_peered":"2024-09-17T05:25:14.798928+0000","last_unstale":"2024-09-17T05:25:16.775915+0000","last_undegraded":"2024-09-17T05:25:16.775915+0000","last_fullsized":"2024-09-17T05:25:16.775915+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:30:00.060015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058415+0000","last_change":"2024-09-17T05:25:15.774346+0000","last_active":"2024-09-17T05:25:18.058415+0000","last_peered":"2024-09-17T05:25:18.058415+0000","last_clean":"2024-09-17T05:25:18.058415+0000","last_became_active":"2024-09-17T05:25:15.774029+0000","last_became_peered":"2024-09-17T05:25:15.774029+0000","last_unstale":"2024-09-17T05:25:18.058415+0000","last_undegraded":"2024-09-17T05:25:18.058415+0000","last_fullsized":"2024-09-17T05:25:18.058415+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:04.449292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059064+0000","last_change":"2024-09-17T05:25:14.792783+0000","last_active":"2024-09-17T05:25:18.059064+0000","last_peered":"2024-09-17T05:25:18.059064+0000","last_clean":"2024-09-17T05:25:18.059064+0000","last_became_active":"2024-09-17T05:25:14.792499+0000","last_became_peered":"2024-09-17T05:25:14.792499+0000","last_unstale":"2024-09-17T05:25:18.059064+0000","last_undegraded":"2024-09-17T05:25:18.059064+0000","last_fullsized":"2024-09-17T05:25:18.059064+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:31:14.863376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058633+0000","last_change":"2024-09-17T05:25:15.769194+0000","last_active":"2024-09-17T05:25:18.058633+0000","last_peered":"2024-09-17T05:25:18.058633+0000","last_clean":"2024-09-17T05:25:18.058633+0000","last_became_active":"2024-09-17T05:25:15.768581+0000","last_became_peered":"2024-09-17T05:25:15.768581+0000","last_unstale":"2024-09-17T05:25:18.058633+0000","last_undegraded":"2024-09-17T05:25:18.058633+0000","last_fullsized":"2024-09-17T05:25:18.058633+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:07.506400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776512+0000","last_change":"2024-09-17T05:25:14.795833+0000","last_active":"2024-09-17T05:25:16.776512+0000","last_peered":"2024-09-17T05:25:16.776512+0000","last_clean":"2024-09-17T05:25:16.776512+0000","last_became_active":"2024-09-17T05:25:14.795529+0000","last_became_peered":"2024-09-17T05:25:14.795529+0000","last_unstale":"2024-09-17T05:25:16.776512+0000","last_undegraded":"2024-09-17T05:25:16.776512+0000","last_fullsized":"2024-09-17T05:25:16.776512+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:36:34.217917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776430+0000","last_change":"2024-09-17T05:25:15.775565+0000","last_active":"2024-09-17T05:25:16.776430+0000","last_peered":"2024-09-17T05:25:16.776430+0000","last_clean":"2024-09-17T05:25:16.776430+0000","last_became_active":"2024-09-17T05:25:15.774645+0000","last_became_peered":"2024-09-17T05:25:15.774645+0000","last_unstale":"2024-09-17T05:25:16.776430+0000","last_undegraded":"2024-09-17T05:25:16.776430+0000","last_fullsized":"2024-09-17T05:25:16.776430+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:15:37.246476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:17.539336+0000","last_change":"2024-09-17T05:25:14.790605+0000","last_active":"2024-09-17T05:25:17.539336+0000","last_peered":"2024-09-17T05:25:17.539336+0000","last_clean":"2024-09-17T05:25:17.539336+0000","last_became_active":"2024-09-17T05:25:14.790285+0000","last_became_peered":"2024-09-17T05:25:14.790285+0000","last_unstale":"2024-09-17T05:25:17.539336+0000","last_undegraded":"2024-09-17T05:25:17.539336+0000","last_fullsized":"2024-09-17T05:25:17.539336+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:03.046454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.057953+0000","last_change":"2024-09-17T05:25:15.776416+0000","last_active":"2024-09-17T05:25:18.057953+0000","last_peered":"2024-09-17T05:25:18.057953+0000","last_clean":"2024-09-17T05:25:18.057953+0000","last_became_active":"2024-09-17T05:25:15.775434+0000","last_became_peered":"2024-09-17T05:25:15.775434+0000","last_unstale":"2024-09-17T05:25:18.057953+0000","last_undegraded":"2024-09-17T05:25:18.057953+0000","last_fullsized":"2024-09-17T05:25:18.057953+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:41:26.337136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776284+0000","last_change":"2024-09-17T05:25:14.799017+0000","last_active":"2024-09-17T05:25:16.776284+0000","last_peered":"2024-09-17T05:25:16.776284+0000","last_clean":"2024-09-17T05:25:16.776284+0000","last_became_active":"2024-09-17T05:25:14.798741+0000","last_became_peered":"2024-09-17T05:25:14.798741+0000","last_unstale":"2024-09-17T05:25:16.776284+0000","last_undegraded":"2024-09-17T05:25:16.776284+0000","last_fullsized":"2024-09-17T05:25:16.776284+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:16:29.276065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.932660+0000","last_change":"2024-09-17T05:25:15.769360+0000","last_active":"2024-09-17T05:25:16.932660+0000","last_peered":"2024-09-17T05:25:16.932660+0000","last_clean":"2024-09-17T05:25:16.932660+0000","last_became_active":"2024-09-17T05:25:15.769076+0000","last_became_peered":"2024-09-17T05:25:15.769076+0000","last_unstale":"2024-09-17T05:25:16.932660+0000","last_undegraded":"2024-09-17T05:25:16.932660+0000","last_fullsized":"2024-09-17T05:25:16.932660+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:24:07.983473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776617+0000","last_change":"2024-09-17T05:25:14.788995+0000","last_active":"2024-09-17T05:25:16.776617+0000","last_peered":"2024-09-17T05:25:16.776617+0000","last_clean":"2024-09-17T05:25:16.776617+0000","last_became_active":"2024-09-17T05:25:14.788708+0000","last_became_peered":"2024-09-17T05:25:14.788708+0000","last_unstale":"2024-09-17T05:25:16.776617+0000","last_undegraded":"2024-09-17T05:25:16.776617+0000","last_fullsized":"2024-09-17T05:25:16.776617+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:18:53.467883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":13,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.058887+0000","last_change":"2024-09-17T05:25:15.781032+0000","last_active":"2024-09-17T05:25:18.058887+0000","last_peered":"2024-09-17T05:25:18.058887+0000","last_clean":"2024-09-17T05:25:18.058887+0000","last_became_active":"2024-09-17T05:25:15.780775+0000","last_became_peered":"2024-09-17T05:25:15.780775+0000","last_unstale":"2024-09-17T05:25:18.058887+0000","last_undegraded":"2024-09-17T05:25:18.058887+0000","last_fullsized":"2024-09-17T05:25:18.058887+0000","mapping_epoch":138,"log_start":"0'0","ondisk_log_start":"0'0","created":138,"last_epoch_clean":139,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:14.771353+0000","last_clean_scrub_stamp":"2024-09-17T05:25:14.771353+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:53:46.450452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":15,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:16.776961+0000","last_change":"2024-09-17T05:25:14.793360+0000","last_active":"2024-09-17T05:25:16.776961+0000","last_peered":"2024-09-17T05:25:16.776961+0000","last_clean":"2024-09-17T05:25:16.776961+0000","last_became_active":"2024-09-17T05:25:14.793062+0000","last_became_peered":"2024-09-17T05:25:14.793062+0000","last_unstale":"2024-09-17T05:25:16.776961+0000","last_undegraded":"2024-09-17T05:25:16.776961+0000","last_fullsized":"2024-09-17T05:25:16.776961+0000","mapping_epoch":137,"log_start":"0'0","ondisk_log_start":"0'0","created":137,"last_epoch_clean":138,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:13.767420+0000","last_clean_scrub_stamp":"2024-09-17T05:25:13.767420+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:13.801518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":350,"reported_epoch":140,"state":"active+clean","last_fresh":"2024-09-17T05:25:18.059377+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:25:18.059377+0000","last_peered":"2024-09-17T05:25:18.059377+0000","last_clean":"2024-09-17T05:25:18.059377+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:25:18.059377+0000","last_undegraded":"2024-09-17T05:25:18.059377+0000","last_fullsized":"2024-09-17T05:25:18.059377+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509525,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33504,"kb_used_data":2316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338336,"statfs":{"total":96636764160,"available":96602456064,"internally_reserved":0,"allocated":2371584,"data_stored":1365914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509525,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1757184,"data_stored":773214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32912,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338928,"statfs":{"total":96636764160,"available":96603062272,"internally_reserved":0,"allocated":1761280,"data_stored":773796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509524,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32924,"kb_used_data":1728,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338916,"statfs":{"total":96636764160,"available":96603049984,"internally_reserved":0,"allocated":1769472,"data_stored":774874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509524,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32908,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338932,"statfs":{"total":96636764160,"available":96603066368,"internally_reserved":0,"allocated":1757184,"data_stored":773226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509525,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32916,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338924,"statfs":{"total":96636764160,"available":96603058176,"internally_reserved":0,"allocated":1757184,"data_stored":773282,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509524,"num_pgs":28,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32904,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338936,"statfs":{"total":96636764160,"available":96603070464,"internally_reserved":0,"allocated":1757184,"data_stored":773226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33484,"kb_used_data":2292,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338356,"statfs":{"total":96636764160,"available":96602476544,"internally_reserved":0,"allocated":2347008,"data_stored":1363560,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":34,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":22,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":2354,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":23,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:25:23.517 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:25:23.517 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:25:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.661+0000 7fe9a39a3640 1 -- 172.21.15.81:0/1642657761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe984004080 msgr2=0x7fe984004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.661+0000 7fe9a39a3640 1 --2- 172.21.15.81:0/1642657761 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe984004080 0x7fe984004800 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7fe99c1531d0 tx=0x7fe984005830 comp rx=0 tx=0).stop 2024-09-17T05:25:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.661+0000 7fe9a1f40640 1 -- 172.21.15.81:0/1642657761 reap_dead start 2024-09-17T05:25:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.661+0000 7fe9a39a3640 1 -- 172.21.15.81:0/1642657761 shutdown_connections 2024-09-17T05:25:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.661+0000 7fe9a39a3640 1 -- 172.21.15.81:0/1642657761 >> 172.21.15.81:0/1642657761 conn(0x7fe99c0b1700 msgr2=0x7fe99c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.662+0000 7fe9a39a3640 1 -- 172.21.15.81:0/1642657761 shutdown_connections 2024-09-17T05:25:23.663 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.662+0000 7fe9a39a3640 1 -- 172.21.15.81:0/1642657761 wait complete. 2024-09-17T05:25:23.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 Processor -- start 2024-09-17T05:25:23.664 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 -- start start 2024-09-17T05:25:23.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe984004080 0x7fe99c154440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99c1551c0 0x7fe99c155990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe99c155ed0 0x7fe99c0c6c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0cc8d0 con 0x7fe99c1551c0 2024-09-17T05:25:23.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe99c0cc750 con 0x7fe984004080 2024-09-17T05:25:23.666 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.663+0000 7fe9a39a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe99c0cca50 con 0x7fe99c155ed0 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99c1551c0 0x7fe99c155990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99c1551c0 0x7fe99c155990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47196/0 (socket says 172.21.15.81:47196) 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 -- 172.21.15.81:0/2529955592 learned_addr learned my addr 172.21.15.81:0/2529955592 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a173f640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe984004080 0x7fe99c154440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a1f40640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe99c155ed0 0x7fe99c0c6c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 -- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe99c155ed0 msgr2=0x7fe99c0c6c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe99c155ed0 0x7fe99c0c6c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 -- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe984004080 msgr2=0x7fe99c154440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe984004080 0x7fe99c154440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 -- 172.21.15.81:0/2529955592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe99c1533c0 con 0x7fe99c1551c0 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a0f3e640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99c1551c0 0x7fe99c155990 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe99002aef0 tx=0x7fe99000b6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:23.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe999ffb640 1 -- 172.21.15.81:0/2529955592 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe990004230 con 0x7fe99c1551c0 2024-09-17T05:25:23.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe999ffb640 1 -- 172.21.15.81:0/2529955592 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe9900043d0 con 0x7fe99c1551c0 2024-09-17T05:25:23.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe99c1536a0 con 0x7fe99c1551c0 2024-09-17T05:25:23.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe999ffb640 1 -- 172.21.15.81:0/2529955592 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe99003c8a0 con 0x7fe99c1551c0 2024-09-17T05:25:23.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.664+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe99c153c60 con 0x7fe99c1551c0 2024-09-17T05:25:23.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.665+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe99c0cf370 con 0x7fe99c1551c0 2024-09-17T05:25:23.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.666+0000 7fe999ffb640 1 -- 172.21.15.81:0/2529955592 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fe9900334a0 con 0x7fe99c1551c0 2024-09-17T05:25:23.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.667+0000 7fe999ffb640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe988079280 0x7fe98807b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:23.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.667+0000 7fe9a173f640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe988079280 0x7fe98807b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:23.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.667+0000 7fe999ffb640 1 -- 172.21.15.81:0/2529955592 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fe9900bc5f0 con 0x7fe99c1551c0 2024-09-17T05:25:23.669 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.667+0000 7fe9a173f640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe988079280 0x7fe98807b740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe98c001330 tx=0x7fe98c006040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:23.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.671+0000 7fe999ffb640 1 -- 172.21.15.81:0/2529955592 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe990042020 con 0x7fe99c1551c0 2024-09-17T05:25:23.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.918+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7fe99c0b1e60 con 0x7fe99c1551c0 2024-09-17T05:25:23.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.920+0000 7fe999ffb640 1 -- 172.21.15.81:0/2529955592 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v25) ==== 190+0+147 (secure 0 0 0) 0x7fe990083860 con 0x7fe99c1551c0 2024-09-17T05:25:23.921 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:25:23.922 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:25:23.922 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:25:23.922 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:25:23.922 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:25:23.922 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:25:23.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe988079280 msgr2=0x7fe98807b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe988079280 0x7fe98807b740 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fe98c001330 tx=0x7fe98c006040 comp rx=0 tx=0).stop 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99c1551c0 msgr2=0x7fe99c155990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99c1551c0 0x7fe99c155990 secure :-1 s=READY pgs=1576 cs=0 l=1 rev1=1 crypto rx=0x7fe99002aef0 tx=0x7fe99000b6f0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 shutdown_connections 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe99c155ed0 0x7fe99c0c6c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe99c1551c0 0x7fe99c155990 unknown :-1 s=CLOSED pgs=1576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe988079280 0x7fe98807b740 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 --2- 172.21.15.81:0/2529955592 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe984004080 0x7fe99c154440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 >> 172.21.15.81:0/2529955592 conn(0x7fe99c0b1700 msgr2=0x7fe99c0b02a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 shutdown_connections 2024-09-17T05:25:23.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:23.922+0000 7fe9a39a3640 1 -- 172.21.15.81:0/2529955592 wait complete. 2024-09-17T05:25:23.934 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 -- 172.21.15.81:0/1172808560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac151370 msgr2=0x7f3dac0cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 --2- 172.21.15.81:0/1172808560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac151370 0x7f3dac0cef30 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c005fd0 tx=0x7f3d9c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.035 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 -- 172.21.15.81:0/1172808560 shutdown_connections 2024-09-17T05:25:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 --2- 172.21.15.81:0/1172808560 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac072cb0 0x7f3dac0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 --2- 172.21.15.81:0/1172808560 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac151370 0x7f3dac0cef30 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 -- 172.21.15.81:0/1172808560 >> 172.21.15.81:0/1172808560 conn(0x7f3dac0b1690 msgr2=0x7f3dac0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 -- 172.21.15.81:0/1172808560 shutdown_connections 2024-09-17T05:25:24.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.034+0000 7f3db3452640 1 -- 172.21.15.81:0/1172808560 wait complete. 2024-09-17T05:25:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.035+0000 7f3db3452640 1 Processor -- start 2024-09-17T05:25:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.035+0000 7f3db3452640 1 -- start start 2024-09-17T05:25:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db3452640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac072cb0 0x7f3dac143600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db3452640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac0b3140 0x7f3dac144840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db3452640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac151370 0x7f3dac164ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db3452640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac06ec10 con 0x7f3dac0b3140 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db3452640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3dac06ea90 con 0x7f3dac072cb0 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db3452640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3dac06f9f0 con 0x7f3dac151370 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac0b3140 0x7f3dac144840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac0b3140 0x7f3dac144840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47224/0 (socket says 172.21.15.81:47224) 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 -- 172.21.15.81:0/683460348 learned_addr learned my addr 172.21.15.81:0/683460348 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 -- 172.21.15.81:0/683460348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac151370 msgr2=0x7f3dac164ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac151370 0x7f3dac164ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 -- 172.21.15.81:0/683460348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac072cb0 msgr2=0x7f3dac143600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac072cb0 0x7f3dac143600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 -- 172.21.15.81:0/683460348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3dac1565d0 con 0x7f3dac0b3140 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.036+0000 7f3db09ed640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac0b3140 0x7f3dac144840 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c4c0 tx=0x7f3da000c980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.037+0000 7f3da9ffb640 1 -- 172.21.15.81:0/683460348 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0016020 con 0x7f3dac0b3140 2024-09-17T05:25:24.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.037+0000 7f3da9ffb640 1 -- 172.21.15.81:0/683460348 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3da0012940 con 0x7f3dac0b3140 2024-09-17T05:25:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.037+0000 7f3da9ffb640 1 -- 172.21.15.81:0/683460348 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3da0012d90 con 0x7f3dac0b3140 2024-09-17T05:25:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.037+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3dac1562f0 con 0x7f3dac0b3140 2024-09-17T05:25:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.037+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3dac144040 con 0x7f3dac0b3140 2024-09-17T05:25:24.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.038+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dac0725a0 con 0x7f3dac0b3140 2024-09-17T05:25:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.038+0000 7f3da9ffb640 1 -- 172.21.15.81:0/683460348 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f3da0019020 con 0x7f3dac0b3140 2024-09-17T05:25:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.039+0000 7f3da9ffb640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3d98079250 0x7f3d9807b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.039+0000 7f3db11ee640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3d98079250 0x7f3d9807b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.039+0000 7f3da9ffb640 1 -- 172.21.15.81:0/683460348 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f3da009b660 con 0x7f3dac0b3140 2024-09-17T05:25:24.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.039+0000 7f3db11ee640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3d98079250 0x7f3d9807b710 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c034000 tx=0x7f3d9c004a40 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.043+0000 7f3da9ffb640 1 -- 172.21.15.81:0/683460348 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3da0020030 con 0x7f3dac0b3140 2024-09-17T05:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.256+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3dac0b0390 con 0x7f3dac0b3140 2024-09-17T05:25:24.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.257+0000 7f3da9ffb640 1 -- 172.21.15.81:0/683460348 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 84 v84) ==== 94+0+5230 (secure 0 0 0) 0x7f3da0063030 con 0x7f3dac0b3140 2024-09-17T05:25:24.258 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:24.258 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":84,"btime":"2024-09-17T05:25:17:786037+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2171494728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2171494728},{"type":"v1","addr":"172.21.15.160:6835","nonce":2171494728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/428822375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":428822375},{"type":"v1","addr":"172.21.15.81:6834","nonce":428822375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4108203098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4108203098},{"type":"v1","addr":"172.21.15.81:6835","nonce":4108203098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:15.136657+0000","modified":"2024-09-17T05:25:17.128529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6801/2976390052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2976390052},{"type":"v1","addr":"172.21.15.160:6801","nonce":2976390052}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":11}]} 2024-09-17T05:25:24.258 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 84 2024-09-17T05:25:24.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3d98079250 msgr2=0x7f3d9807b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3d98079250 0x7f3d9807b710 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f3d9c034000 tx=0x7f3d9c004a40 comp rx=0 tx=0).stop 2024-09-17T05:25:24.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac0b3140 msgr2=0x7f3dac144840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac0b3140 0x7f3dac144840 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f3da000c4c0 tx=0x7f3da000c980 comp rx=0 tx=0).stop 2024-09-17T05:25:24.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 shutdown_connections 2024-09-17T05:25:24.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3dac151370 0x7f3dac164ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3dac0b3140 0x7f3dac144840 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3d98079250 0x7f3d9807b710 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 --2- 172.21.15.81:0/683460348 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3dac072cb0 0x7f3dac143600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 >> 172.21.15.81:0/683460348 conn(0x7f3dac0b1690 msgr2=0x7f3dac1517f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 shutdown_connections 2024-09-17T05:25:24.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.259+0000 7f3db3452640 1 -- 172.21.15.81:0/683460348 wait complete. 2024-09-17T05:25:24.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 84, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:25:15.136657+0000', 'modified': '2024-09-17T05:25:17.128529+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8439}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8439': {'gid': 8439, 'name': 'b', 'rank': 0, 'incarnation': 82, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.160:6801/2976390052', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6800', 'nonce': 2976390052}, {'type': 'v1', 'addr': '172.21.15.160:6801', 'nonce': 2976390052}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8439, 'qdb_cluster': [8439]} 2024-09-17T05:25:24.673 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:25:24.674 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T05:25:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 -- 172.21.15.81:0/1650247767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c00735a0 msgr2=0x7fa1c00739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/1650247767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c00735a0 0x7fa1c00739d0 secure :-1 s=READY pgs=1581 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00b26e0 tx=0x7fa1b402a530 comp rx=0 tx=0).stop 2024-09-17T05:25:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 -- 172.21.15.81:0/1650247767 shutdown_connections 2024-09-17T05:25:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/1650247767 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c00735a0 0x7fa1c00739d0 unknown :-1 s=CLOSED pgs=1581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/1650247767 >> v2:172.21.15.160:3300/0 conn(0x7fa1c015aa70 0x7fa1c00b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 -- 172.21.15.81:0/1650247767 >> 172.21.15.81:0/1650247767 conn(0x7fa1c00b1690 msgr2=0x7fa1c00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 -- 172.21.15.81:0/1650247767 shutdown_connections 2024-09-17T05:25:24.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.775+0000 7fa1c6a47640 1 -- 172.21.15.81:0/1650247767 wait complete. 2024-09-17T05:25:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.776+0000 7fa1c6a47640 1 Processor -- start 2024-09-17T05:25:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.776+0000 7fa1c6a47640 1 -- start start 2024-09-17T05:25:24.798 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c6a47640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c006ff80 0x7fa1c00cd680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c6a47640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1c00735a0 0x7fa1c00cdbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c6a47640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c015aa70 0x7fa1c00ac060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c6a47640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c0070570 con 0x7fa1c015aa70 2024-09-17T05:25:24.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c6a47640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c00703f0 con 0x7fa1c006ff80 2024-09-17T05:25:24.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c6a47640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c00706f0 con 0x7fa1c00735a0 2024-09-17T05:25:24.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c015aa70 0x7fa1c00ac060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c015aa70 0x7fa1c00ac060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47244/0 (socket says 172.21.15.81:47244) 2024-09-17T05:25:24.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 -- 172.21.15.81:0/230198676 learned_addr learned my addr 172.21.15.81:0/230198676 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:24.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1c00735a0 0x7fa1c00cdbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.800 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1bffff640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c006ff80 0x7fa1c00cd680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 -- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1c00735a0 msgr2=0x7fa1c00cdbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1c00735a0 0x7fa1c00cdbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 -- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c006ff80 msgr2=0x7fa1c00cd680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c006ff80 0x7fa1c00cd680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.801 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.777+0000 7fa1c4fe4640 1 -- 172.21.15.81:0/230198676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1c01f2220 con 0x7fa1c015aa70 2024-09-17T05:25:24.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.778+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c015aa70 0x7fa1c00ac060 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800c770 tx=0x7fa1b800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.778+0000 7fa1bcff9640 1 -- 172.21.15.81:0/230198676 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8003da0 con 0x7fa1c015aa70 2024-09-17T05:25:24.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.778+0000 7fa1bcff9640 1 -- 172.21.15.81:0/230198676 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b8005070 con 0x7fa1c015aa70 2024-09-17T05:25:24.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.778+0000 7fa1bcff9640 1 -- 172.21.15.81:0/230198676 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b8005500 con 0x7fa1c015aa70 2024-09-17T05:25:24.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.778+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1c01f2500 con 0x7fa1c015aa70 2024-09-17T05:25:24.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.778+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1c01f2ac0 con 0x7fa1c015aa70 2024-09-17T05:25:24.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.779+0000 7fa1bcff9640 1 -- 172.21.15.81:0/230198676 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fa1b80056a0 con 0x7fa1c015aa70 2024-09-17T05:25:24.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.780+0000 7fa1bcff9640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa1ac079250 0x7fa1ac07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.780+0000 7fa1bffff640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa1ac079250 0x7fa1ac07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.780+0000 7fa1bcff9640 1 -- 172.21.15.81:0/230198676 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fa1b809b6c0 con 0x7fa1c015aa70 2024-09-17T05:25:24.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.781+0000 7fa1bffff640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa1ac079250 0x7fa1ac07b710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00ce3d0 tx=0x7fa1b0008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.781+0000 7fa1c9815740 1 Processor -- start 2024-09-17T05:25:24.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.781+0000 7fa1c9815740 1 -- start start 2024-09-17T05:25:24.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e4231b0 0x55774e3fab20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e442df0 0x55774e4431f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e3f85f0 0x55774e3f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c9815740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55774e36f820 con 0x55774e442df0 2024-09-17T05:25:24.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55774e35ec50 con 0x55774e4231b0 2024-09-17T05:25:24.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55774e362a60 con 0x55774e3f85f0 2024-09-17T05:25:24.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e442df0 0x55774e4431f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e442df0 0x55774e4431f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47246/0 (socket says 172.21.15.81:47246) 2024-09-17T05:25:24.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/3523925093 learned_addr learned my addr 172.21.15.81:0/3523925093 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:24.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bffff640 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e4231b0 0x55774e3fab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e3f85f0 0x55774e3f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e3f85f0 msgr2=0x55774e3f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e3f85f0 0x55774e3f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e4231b0 msgr2=0x55774e3fab20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e4231b0 0x55774e3fab20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/3523925093 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55774e0c0850 con 0x55774e442df0 2024-09-17T05:25:24.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bffff640 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e4231b0 0x55774e3fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:24.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e3f85f0 0x55774e3f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:24.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e442df0 0x55774e4431f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4000c00 tx=0x7fa1b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6c57a6be2bd6fe3 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1a5ffb640 1 -- 172.21.15.81:0/3523925093 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4040070 con 0x55774e442df0 2024-09-17T05:25:24.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1a5ffb640 1 -- 172.21.15.81:0/3523925093 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b4005020 con 0x55774e442df0 2024-09-17T05:25:24.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.782+0000 7fa1a5ffb640 1 -- 172.21.15.81:0/3523925093 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4005470 con 0x55774e442df0 2024-09-17T05:25:24.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 -- 172.21.15.81:0/3523925093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e442df0 msgr2=0x55774e4431f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e442df0 0x55774e4431f0 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7fa1b4000c00 tx=0x7fa1b40046c0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 -- 172.21.15.81:0/3523925093 shutdown_connections 2024-09-17T05:25:24.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e3f85f0 0x55774e3f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e442df0 0x55774e4431f0 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 --2- 172.21.15.81:0/3523925093 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e4231b0 0x55774e3fab20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 -- 172.21.15.81:0/3523925093 >> 172.21.15.81:0/3523925093 conn(0x55774e3f96a0 msgr2=0x55774e3fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 -- 172.21.15.81:0/3523925093 shutdown_connections 2024-09-17T05:25:24.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.783+0000 7fa1c9815740 1 -- 172.21.15.81:0/3523925093 wait complete. 2024-09-17T05:25:24.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.784+0000 7fa1c9815740 1 -- start start 2024-09-17T05:25:24.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.784+0000 7fa1c9815740 1 Processor -- start 2024-09-17T05:25:24.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e40a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e442df0 0x55774e43d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.810 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e455ad0 0x55774e409960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55774e0cf620 con 0x55774e4231b0 2024-09-17T05:25:24.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55774e3045f0 con 0x55774e442df0 2024-09-17T05:25:24.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55774e3f7b30 con 0x55774e455ad0 2024-09-17T05:25:24.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 10 client.0 _ll_register_callbacks cb 0x55774e3080a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:25:24.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e40a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e40a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47254/0 (socket says 172.21.15.81:47254) 2024-09-17T05:25:24.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 -- 172.21.15.81:0/1684898253 learned_addr learned my addr 172.21.15.81:0/1684898253 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:24.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e442df0 0x55774e43d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 -- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e455ad0 msgr2=0x55774e409960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e455ad0 0x55774e409960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 -- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e442df0 msgr2=0x55774e43d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.812 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e442df0 0x55774e43d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 -- 172.21.15.81:0/1684898253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55774e1376b0 con 0x55774e4231b0 2024-09-17T05:25:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1bffff640 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e40a4b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000df10 tx=0x7fa1b00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5749c540fb44a7ec server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa19effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:25:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa19effd640 1 -- 172.21.15.81:0/1684898253 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0014e40 con 0x55774e4231b0 2024-09-17T05:25:24.813 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa19effd640 1 -- 172.21.15.81:0/1684898253 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fa1b000f040 con 0x55774e4231b0 2024-09-17T05:25:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b4005020 con 0x55774e4231b0 2024-09-17T05:25:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa19effd640 1 -- 172.21.15.81:0/1684898253 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fa1b0005920 con 0x55774e4231b0 2024-09-17T05:25:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 10 client.8586 fetch_fsmap learned FSMap version 84 2024-09-17T05:25:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.785+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55774e43d180 con 0x55774e4231b0 2024-09-17T05:25:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa19effd640 1 -- 172.21.15.81:0/1684898253 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b4005020 con 0x55774e4231b0 2024-09-17T05:25:24.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa19effd640 1 -- 172.21.15.81:0/1684898253 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fa1b0030080 con 0x55774e4231b0 2024-09-17T05:25:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1c9815740 10 client.8586 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:25:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1c9815740 10 client.8586 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:25:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1c9815740 20 client.8586 populate_metadata read hostname 'smithi081' 2024-09-17T05:25:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1c9815740 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e441240 0x55774e441620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1c9815740 4 client.8586 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:25:24.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 --> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55774e371770 con 0x55774e441240 2024-09-17T05:25:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e441240 0x55774e441620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e441240 0x55774e441620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b9e238cc7e779ae server_cookie=2073f1feb659d3a7 in_seq=0 out_seq=0 2024-09-17T05:25:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.786+0000 7fa19effd640 10 client.8586 ms_handle_connect on v2:172.21.15.160:6800/2976390052 2024-09-17T05:25:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa19effd640 1 -- 172.21.15.81:0/1684898253 <== mds.0 v2:172.21.15.160:6800/2976390052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x55774e371770 con 0x55774e441240 2024-09-17T05:25:24.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa19effd640 10 client.8586 handle_command_reply: tid=0 2024-09-17T05:25:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 client.8586 shutdown 2024-09-17T05:25:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 msgr2=0x55774e40a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e40a4b0 secure :-1 s=READY pgs=1584 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000df10 tx=0x7fa1b00046c0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 shutdown_connections 2024-09-17T05:25:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e441240 0x55774e441620 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e455ad0 0x55774e409960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e442df0 0x55774e43d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa19effd640 0 client.8586 ms_handle_reset on v2:172.21.15.160:6800/2976390052 2024-09-17T05:25:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 --2- 172.21.15.81:0/1684898253 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e40a4b0 unknown :-1 s=CLOSED pgs=1584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 >> 172.21.15.81:0/1684898253 conn(0x55774e3f85f0 msgr2=0x55774e442680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.787+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 shutdown_connections 2024-09-17T05:25:24.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.788+0000 7fa1c9815740 1 -- 172.21.15.81:0/1684898253 wait complete. 2024-09-17T05:25:24.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.788+0000 7fa1c9815740 20 client.8586 trim_cache size 0 max 16384 2024-09-17T05:25:24.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.805+0000 7fa1c9815740 1 Processor -- start 2024-09-17T05:25:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.805+0000 7fa1c9815740 1 -- start start 2024-09-17T05:25:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e3f89d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e441ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e4406e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c9815740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c01fdcb0 con 0x55774e4231b0 2024-09-17T05:25:24.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa1c00aec80 con 0x55774e3f85f0 2024-09-17T05:25:24.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa1c00af2d0 con 0x55774e442df0 2024-09-17T05:25:24.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e441ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e441ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47270/0 (socket says 172.21.15.81:47270) 2024-09-17T05:25:24.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/2089713016 learned_addr learned my addr 172.21.15.81:0/2089713016 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:24.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bffff640 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e3f89d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e4406e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 msgr2=0x55774e4406e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e4406e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 msgr2=0x55774e3f89d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e3f89d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/2089713016 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55774e4241c0 con 0x55774e4231b0 2024-09-17T05:25:24.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1bffff640 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e3f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:24.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.806+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e4406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:24.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e441ab0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40098f0 tx=0x7fa1b4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b449c4a9df426 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1a57fa640 1 -- 172.21.15.81:0/2089713016 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4040040 con 0x55774e4231b0 2024-09-17T05:25:24.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1a57fa640 1 -- 172.21.15.81:0/2089713016 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b4003a30 con 0x55774e4231b0 2024-09-17T05:25:24.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1a57fa640 1 -- 172.21.15.81:0/2089713016 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b4003e80 con 0x55774e4231b0 2024-09-17T05:25:24.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 -- 172.21.15.81:0/2089713016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 msgr2=0x55774e441ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e441ab0 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7fa1b40098f0 tx=0x7fa1b4005f90 comp rx=0 tx=0).stop 2024-09-17T05:25:24.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 -- 172.21.15.81:0/2089713016 shutdown_connections 2024-09-17T05:25:24.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e4406e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e441ab0 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 --2- 172.21.15.81:0/2089713016 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e3f89d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 -- 172.21.15.81:0/2089713016 >> 172.21.15.81:0/2089713016 conn(0x55774e40a700 msgr2=0x55774e451410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 -- 172.21.15.81:0/2089713016 shutdown_connections 2024-09-17T05:25:24.838 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.807+0000 7fa1c9815740 1 -- 172.21.15.81:0/2089713016 wait complete. 2024-09-17T05:25:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.808+0000 7fa1c9815740 1 -- start start 2024-09-17T05:25:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.808+0000 7fa1c9815740 1 Processor -- start 2024-09-17T05:25:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e4bd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e4c6b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c9815740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e3fc600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c9815740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x55774e40aae0 con 0x55774e4231b0 2024-09-17T05:25:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x55774e40ace0 con 0x55774e3f85f0 2024-09-17T05:25:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c9815740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x55774e456090 con 0x55774e442df0 2024-09-17T05:25:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c9815740 10 client.0 _ll_register_callbacks cb 0x7fa1b000bdc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:25:24.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e4c6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e4c6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47278/0 (socket says 172.21.15.81:47278) 2024-09-17T05:25:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/940975979 learned_addr learned my addr 172.21.15.81:0/940975979 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bffff640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e4bd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1c4fe4640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e3fc600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 msgr2=0x55774e3fc600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.841 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e3fc600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 msgr2=0x55774e4bd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e4bd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 -- 172.21.15.81:0/940975979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55774e3fafb0 con 0x55774e4231b0 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bffff640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e4bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa1bf7fe640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e4c6b10 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fa1b402ab20 tx=0x7fa1b4005b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de7d3f6067bf080 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.809+0000 7fa19effd640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa19effd640 1 -- 172.21.15.81:0/940975979 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b405b060 con 0x55774e4231b0 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa19effd640 1 -- 172.21.15.81:0/940975979 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fa1b4003df0 con 0x55774e4231b0 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1b4003a30 con 0x55774e4231b0 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa19effd640 1 -- 172.21.15.81:0/940975979 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=84) ==== 24+0+0 (secure 0 0 0) 0x7fa1b4061050 con 0x55774e4231b0 2024-09-17T05:25:24.842 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 10 client.8592 fetch_fsmap learned FSMap version 84 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=84,monmap=2+}) -- 0x55774e467000 con 0x55774e4231b0 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa19effd640 1 -- 172.21.15.81:0/940975979 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa1b4003a30 con 0x55774e4231b0 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa19effd640 1 -- 172.21.15.81:0/940975979 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 84) ==== 3502+0+0 (secure 0 0 0) 0x7fa1b4064020 con 0x55774e4231b0 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 10 client.8592 fetch_fsmap finished waiting for FSMap version 84 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 10 client.8592 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 20 client.8592 populate_metadata read hostname 'smithi081' 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e455ad0 0x55774e40c790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 4 client.8592 mds_command: new command op to 8439 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 --> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] -- command(tid 0: {"prefix": "status"}) -- 0x55774e36d220 con 0x55774e455ad0 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.810+0000 7fa1bffff640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e455ad0 0x55774e40c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa19effd640 10 client.8592 ms_handle_connect on v2:172.21.15.160:6800/2976390052 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1bffff640 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e455ad0 0x55774e40c790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=32eacf135fd78daa server_cookie=8f09d2a55fa3f29b in_seq=0 out_seq=0 2024-09-17T05:25:24.843 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa19effd640 1 -- 172.21.15.81:0/940975979 <== mds.0 v2:172.21.15.160:6800/2976390052 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55774e36d220 con 0x55774e455ad0 2024-09-17T05:25:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa19effd640 10 client.8592 handle_command_reply: tid=0 2024-09-17T05:25:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 client.8592 shutdown 2024-09-17T05:25:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 msgr2=0x55774e4c6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e4c6b10 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7fa1b402ab20 tx=0x7fa1b4005b20 comp rx=0 tx=0).stop 2024-09-17T05:25:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 shutdown_connections 2024-09-17T05:25:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:6800/2976390052,v1:172.21.15.160:6801/2976390052] conn(0x55774e455ad0 0x55774e40c790 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x55774e442df0 0x55774e3fc600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x55774e4231b0 0x55774e4c6b10 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 --2- 172.21.15.81:0/940975979 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x55774e3f85f0 0x55774e4bd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa19effd640 0 client.8592 ms_handle_reset on v2:172.21.15.160:6800/2976390052 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 >> 172.21.15.81:0/940975979 conn(0x55774e40a700 msgr2=0x55774e440950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 shutdown_connections 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 1 -- 172.21.15.81:0/940975979 wait complete. 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.811+0000 7fa1c9815740 20 client.8592 trim_cache size 0 max 16384 2024-09-17T05:25:24.845 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8439, 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 9.0296114890000005, 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 84, 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 140, 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 140, 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 12.777154397 2024-09-17T05:25:24.846 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa1ac079250 msgr2=0x7fa1ac07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa1ac079250 0x7fa1ac07b710 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00ce3d0 tx=0x7fa1b0008040 comp rx=0 tx=0).stop 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c015aa70 msgr2=0x7fa1c00ac060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c015aa70 0x7fa1c00ac060 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7fa1b800c770 tx=0x7fa1b800cc30 comp rx=0 tx=0).stop 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 shutdown_connections 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa1c015aa70 0x7fa1c00ac060 unknown :-1 s=CLOSED pgs=1582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa1c00735a0 0x7fa1c00cdbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa1ac079250 0x7fa1ac07b710 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 --2- 172.21.15.81:0/230198676 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa1c006ff80 0x7fa1c00cd680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 >> 172.21.15.81:0/230198676 conn(0x7fa1c00b1690 msgr2=0x7fa1c00af840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 shutdown_connections 2024-09-17T05:25:24.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.812+0000 7fa1c6a47640 1 -- 172.21.15.81:0/230198676 wait complete. 2024-09-17T05:25:24.849 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:25:24.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.950+0000 7fb0f83bb640 1 -- 172.21.15.81:0/3361411419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8004800 msgr2=0x7fb0d8004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.950+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/3361411419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8004800 0x7fb0d8004c80 secure :-1 s=READY pgs=1588 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4006fd0 tx=0x7fb0d8005830 comp rx=0 tx=0).stop 2024-09-17T05:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.950+0000 7fb0f83bb640 1 -- 172.21.15.81:0/3361411419 shutdown_connections 2024-09-17T05:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.950+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/3361411419 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0d8004800 0x7fb0d8004c80 unknown :-1 s=CLOSED pgs=1588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.950+0000 7fb0f83bb640 1 -- 172.21.15.81:0/3361411419 >> 172.21.15.81:0/3361411419 conn(0x7fb0f00b1690 msgr2=0x7fb0f00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.950+0000 7fb0f83bb640 1 -- 172.21.15.81:0/3361411419 shutdown_connections 2024-09-17T05:25:24.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.950+0000 7fb0f83bb640 1 -- 172.21.15.81:0/3361411419 wait complete. 2024-09-17T05:25:24.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.951+0000 7fb0f83bb640 1 Processor -- start 2024-09-17T05:25:24.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.951+0000 7fb0f83bb640 1 -- start start 2024-09-17T05:25:24.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f83bb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0d8004800 0x7fb0f01f0460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f83bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01f4460 0x7fb0f014c780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f83bb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0f01575f0 0x7fb0f0157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f83bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0073f20 con 0x7fb0f01f4460 2024-09-17T05:25:24.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f83bb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb0f0073da0 con 0x7fb0d8004800 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f83bb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb0f00b4690 con 0x7fb0f01575f0 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01f4460 0x7fb0f014c780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01f4460 0x7fb0f014c780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47286/0 (socket says 172.21.15.81:47286) 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 -- 172.21.15.81:0/2135289334 learned_addr learned my addr 172.21.15.81:0/2135289334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f6157640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0d8004800 0x7fb0f01f0460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f6958640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0f01575f0 0x7fb0f0157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 -- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0f01575f0 msgr2=0x7fb0f0157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0f01575f0 0x7fb0f0157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 -- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0d8004800 msgr2=0x7fb0f01f0460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0d8004800 0x7fb0f01f0460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:24.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f5956640 1 -- 172.21.15.81:0/2135289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0f014ccc0 con 0x7fb0f01f4460 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.952+0000 7fb0f6157640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0d8004800 0x7fb0f01f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.953+0000 7fb0f5956640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01f4460 0x7fb0f014c780 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4000c00 tx=0x7fb0e4001ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.953+0000 7fb0eeffd640 1 -- 172.21.15.81:0/2135289334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4031040 con 0x7fb0f01f4460 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.953+0000 7fb0eeffd640 1 -- 172.21.15.81:0/2135289334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb0e4006540 con 0x7fb0f01f4460 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.953+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0f01f48e0 con 0x7fb0f01f4460 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.953+0000 7fb0eeffd640 1 -- 172.21.15.81:0/2135289334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0e4003a60 con 0x7fb0f01f4460 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.953+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0f01f0e40 con 0x7fb0f01f4460 2024-09-17T05:25:24.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.954+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0f00b4bf0 con 0x7fb0f01f4460 2024-09-17T05:25:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.954+0000 7fb0eeffd640 1 -- 172.21.15.81:0/2135289334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fb0e4034070 con 0x7fb0f01f4460 2024-09-17T05:25:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.955+0000 7fb0eeffd640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb0dc079250 0x7fb0dc07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.955+0000 7fb0eeffd640 1 -- 172.21.15.81:0/2135289334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fb0e40bb9d0 con 0x7fb0f01f4460 2024-09-17T05:25:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.955+0000 7fb0f6157640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb0dc079250 0x7fb0dc07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:24.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.955+0000 7fb0f6157640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb0dc079250 0x7fb0dc07b710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00756b0 tx=0x7fb0e8005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:24.960 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:24.959+0000 7fb0eeffd640 1 -- 172.21.15.81:0/2135289334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb0e4083420 con 0x7fb0f01f4460 2024-09-17T05:25:25.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.175+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb0f00b0a50 con 0x7fb0f01f4460 2024-09-17T05:25:25.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.176+0000 7fb0eeffd640 1 -- 172.21.15.81:0/2135289334 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7fb0e4082d20 con 0x7fb0f01f4460 2024-09-17T05:25:25.177 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:25:25.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb0dc079250 msgr2=0x7fb0dc07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:25.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb0dc079250 0x7fb0dc07b710 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fb0f00756b0 tx=0x7fb0e8005f90 comp rx=0 tx=0).stop 2024-09-17T05:25:25.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01f4460 msgr2=0x7fb0f014c780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:25.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01f4460 0x7fb0f014c780 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7fb0e4000c00 tx=0x7fb0e4001ce0 comp rx=0 tx=0).stop 2024-09-17T05:25:25.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 shutdown_connections 2024-09-17T05:25:25.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb0f01575f0 0x7fb0f0157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:25.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb0f01f4460 0x7fb0f014c780 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:25.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb0dc079250 0x7fb0dc07b710 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:25.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 --2- 172.21.15.81:0/2135289334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb0d8004800 0x7fb0f01f0460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:25.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 >> 172.21.15.81:0/2135289334 conn(0x7fb0f00b1690 msgr2=0x7fb0f00b0f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:25.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 shutdown_connections 2024-09-17T05:25:25.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25.178+0000 7fb0f83bb640 1 -- 172.21.15.81:0/2135289334 wait complete. 2024-09-17T05:25:25.190 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:25:25.190 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:25:25.190 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:25:25.190 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:25:25.190 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:25.190 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:25:25.190 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:25:25.191 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:25:25.191 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:25:25.191 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:25.191 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:25:25.207 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:25:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:25:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:25:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:25:25.207 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:25.207 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:25.208 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42392sec preferred_lft 42392sec 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:25.209 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:25.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:25.210 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:25:25.271 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:25:25.272 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:25.272 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:25:25.328 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:25:25.329 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:25:25.329 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:25:25.329 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:25:25.329 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:25:25.329 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:25:25.329 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:25:25.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:25:25.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:25:25.330 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:25:25.330 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:25:25.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:25:25.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:25.453 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:25.454 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:25:25.469 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:25:25.469 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:25:25.469 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:25:25.469 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:25.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:25:25.533 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:25:25.533 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:25.533 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:25.589 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:25:25.589 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:25.589 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:25.643 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:25:25.708 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:25:25.764 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:25:25.764 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:25:25.764 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:25:25.764 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:25:25.765 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:25:25.766 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:25:25.767 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:25:25.767 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:25:25.767 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:25.767 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:25.767 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:25.767 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:25.768 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:25.768 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:25:25.823 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:25:25.823 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:25:25.865 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:25:25.889 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:25:25.945 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:25:25.946 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:25:25.947 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:25:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:25:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:25:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:25:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:25:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:25:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:25.948 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:25.949 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:25.949 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:25.949 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:25:25.945+0000 7fe96ca43480 -1 init, newargv = 0x56268ec55640 newargc=15 2024-09-17T05:25:25.950 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:25.950 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:25:25.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[76303]: starting ceph client 2024-09-17T05:25:25.951 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[76303]: starting fuse 2024-09-17T05:25:25.965 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:25:25.966 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:25:25.966 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:25:25.967 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:25:25.968 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:25:26.083 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.76303.asok 2024-09-17T05:25:26.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:26.094 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.76303.asok 2024-09-17T05:25:26.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.76303.asok status 2024-09-17T05:25:26.227 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:25:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:25:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:25:26.227 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "76303", 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:25:26.228 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8604, 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8604 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2346280696 2024-09-17T05:25:26.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 2346280696 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.8604 192.168.0.1:0/2346280696", 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/2346280696", 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 84, 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 140, 2024-09-17T05:25:26.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:25:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:25:26.231 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:25:26.231 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:25:26.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.236 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:25:26.236 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:26.252 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:25:26.252 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:26.252 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.252 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:26.317 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:25:26.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.458+0000 7f05da07f640 1 -- 172.21.15.81:0/1690802202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c0005e50 msgr2=0x7f05c00062d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.458+0000 7f05da07f640 1 --2- 172.21.15.81:0/1690802202 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05c0005e50 0x7f05c00062d0 secure :-1 s=READY pgs=1593 cs=0 l=1 rev1=1 crypto rx=0x7f05cc009b50 tx=0x7f05c0006940 comp rx=0 tx=0).stop 2024-09-17T05:25:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.458+0000 7f05d3fff640 1 -- 172.21.15.81:0/1690802202 reap_dead start 2024-09-17T05:25:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.458+0000 7f05da07f640 1 -- 172.21.15.81:0/1690802202 shutdown_connections 2024-09-17T05:25:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.458+0000 7f05da07f640 1 -- 172.21.15.81:0/1690802202 >> 172.21.15.81:0/1690802202 conn(0x7f05d40b1690 msgr2=0x7f05d40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.458+0000 7f05da07f640 1 -- 172.21.15.81:0/1690802202 shutdown_connections 2024-09-17T05:25:26.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.458+0000 7f05da07f640 1 -- 172.21.15.81:0/1690802202 wait complete. 2024-09-17T05:25:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.460+0000 7f05da07f640 1 Processor -- start 2024-09-17T05:25:26.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.460+0000 7f05da07f640 1 -- start start 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.460+0000 7f05da07f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05c0005e50 0x7f05d4154d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05da07f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d414a8f0 0x7f05d414f450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05da07f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d41432b0 0x7f05d40cdb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05da07f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05d406e760 con 0x7f05d414a8f0 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05da07f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f05d406e5e0 con 0x7f05d41432b0 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05da07f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f05d406e8e0 con 0x7f05c0005e50 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d414a8f0 0x7f05d414f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:26.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d414a8f0 0x7f05d414f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47304/0 (socket says 172.21.15.81:47304) 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 -- 172.21.15.81:0/68305333 learned_addr learned my addr 172.21.15.81:0/68305333 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d37fe640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05c0005e50 0x7f05d4154d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d3fff640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d41432b0 0x7f05d40cdb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 -- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05c0005e50 msgr2=0x7f05d4154d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05c0005e50 0x7f05d4154d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 -- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d41432b0 msgr2=0x7f05d40cdb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d41432b0 0x7f05d40cdb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 -- 172.21.15.81:0/68305333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05d4150890 con 0x7f05d414a8f0 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05d2ffd640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d414a8f0 0x7f05d414f450 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f05bc006f70 tx=0x7f05bc003a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05cbfff640 1 -- 172.21.15.81:0/68305333 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00f800 con 0x7f05d414a8f0 2024-09-17T05:25:26.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05cbfff640 1 -- 172.21.15.81:0/68305333 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f05bc016020 con 0x7f05d414a8f0 2024-09-17T05:25:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05d414e970 con 0x7f05d414a8f0 2024-09-17T05:25:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05cbfff640 1 -- 172.21.15.81:0/68305333 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f05bc00fc40 con 0x7f05d414a8f0 2024-09-17T05:25:26.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.461+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05d414f990 con 0x7f05d414a8f0 2024-09-17T05:25:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.462+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f05d40cef30 con 0x7f05d414a8f0 2024-09-17T05:25:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.463+0000 7f05cbfff640 1 -- 172.21.15.81:0/68305333 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f05bc011430 con 0x7f05d414a8f0 2024-09-17T05:25:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.464+0000 7f05cbfff640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f05b4079250 0x7f05b407b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.464+0000 7f05cbfff640 1 -- 172.21.15.81:0/68305333 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f05bc09c530 con 0x7f05d414a8f0 2024-09-17T05:25:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.464+0000 7f05d37fe640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f05b4079250 0x7f05b407b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:26.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.464+0000 7f05d37fe640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f05b4079250 0x7f05b407b710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005fd0 tx=0x7f05c4009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:26.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.468+0000 7f05cbfff640 1 -- 172.21.15.81:0/68305333 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f05bc020020 con 0x7f05d414a8f0 2024-09-17T05:25:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.677+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f05d40697e0 con 0x7f05d414a8f0 2024-09-17T05:25:26.678 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.678+0000 7f05cbfff640 1 -- 172.21.15.81:0/68305333 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v84) ==== 53+0+73 (secure 0 0 0) 0x7f05bc0638c0 con 0x7f05d414a8f0 2024-09-17T05:25:26.679 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:25:26.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f05b4079250 msgr2=0x7f05b407b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:26.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f05b4079250 0x7f05b407b710 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f05c4005fd0 tx=0x7f05c4009500 comp rx=0 tx=0).stop 2024-09-17T05:25:26.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d414a8f0 msgr2=0x7f05d414f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:26.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d414a8f0 0x7f05d414f450 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7f05bc006f70 tx=0x7f05bc003a80 comp rx=0 tx=0).stop 2024-09-17T05:25:26.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 shutdown_connections 2024-09-17T05:25:26.681 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f05b4079250 0x7f05b407b710 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05d41432b0 0x7f05d40cdb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05d414a8f0 0x7f05d414f450 unknown :-1 s=CLOSED pgs=1594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 --2- 172.21.15.81:0/68305333 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f05c0005e50 0x7f05d4154d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 >> 172.21.15.81:0/68305333 conn(0x7f05d40b1690 msgr2=0x7f05d40af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 shutdown_connections 2024-09-17T05:25:26.682 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:26.680+0000 7f05da07f640 1 -- 172.21.15.81:0/68305333 wait complete. 2024-09-17T05:25:26.692 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:25:26.692 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:25:26.692 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:25:26.692 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:25:26.692 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:26.692 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:25:26.692 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:25:26.693 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:25:26.693 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:25:26.693 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.693 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:25:26.713 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:25:26.713 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:25:26.713 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:25:26.713 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:26.713 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:25:26.713 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:26.714 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42388sec preferred_lft 42388sec 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:26.715 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:26.716 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:25:26.716 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:26.716 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:26.716 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:26.716 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:25:26.716 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:26.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.716 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:25:26.782 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:25:26.783 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.784 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:25:26.843 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:25:26.844 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:25:26.844 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:25:26.844 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:25:26.844 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:25:26.844 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:25:26.844 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:25:26.844 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:25:26.844 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:25:26.845 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:25:26.845 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:25:26.940 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:25:26 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:25:26.975 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:25:26 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:26.982 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.982 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:25:26.998 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:25:26.998 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:25:26.999 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:25:26.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:26.999 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:25:27.064 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:25:27.064 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:27.065 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:27.120 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:25:27.120 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:27.120 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:27.175 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:25:27.240 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:25:27.297 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:25:27.298 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:27.299 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:27.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:27.300 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:25:27.352 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:25:27.353 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:25:27.395 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:25:27.418 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:25:27.475 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:25:27.475 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:25:27.475 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:25:27.475 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:25:27.475 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:25:27.475 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:25:27.475 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:25:27.476 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:25:27.477 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:25:27.478 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:25:27.478 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:27.478 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:27.478 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:27.478 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:27.478 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:27.478 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:25:27.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:25:27.475+0000 7f3e9f7b9480 -1 init, newargv = 0x557137a29730 newargc=15 2024-09-17T05:25:27.479 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[49336]: starting ceph client 2024-09-17T05:25:27.480 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[49336]: starting fuse 2024-09-17T05:25:27.494 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:25:27.494 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:25:27.494 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:25:27.495 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:25:27.496 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:25:27.497 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:25:27.612 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.49336.asok 2024-09-17T05:25:27.615 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:25:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:27.622 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.49336.asok 2024-09-17T05:25:27.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:27.622 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.49336.asok status 2024-09-17T05:25:27.756 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:25:27.756 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:25:27.756 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:25:27.756 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:25:27.756 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:25:27.756 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:25:27.756 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "49336", 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 6905, 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 6905 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:25:27.757 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 4032301325 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 4032301325 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:25:27.758 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.6905 192.168.0.1:0/4032301325", 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/4032301325", 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 84, 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 140, 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:25:27.759 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:25:27.765 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:27.765 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:25:27.765 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:27.780 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:25:27.781 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:27.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:27.781 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:27.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.961+0000 7f4e74b82640 1 -- 172.21.15.81:0/3346942434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e700aee40 msgr2=0x7f4e7015b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.961+0000 7f4e74b82640 1 --2- 172.21.15.81:0/3346942434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e700aee40 0x7f4e7015b970 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7f4e70074950 tx=0x7f4e6002a560 comp rx=0 tx=0).stop 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.962+0000 7f4e74b82640 1 -- 172.21.15.81:0/3346942434 shutdown_connections 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.962+0000 7f4e74b82640 1 --2- 172.21.15.81:0/3346942434 >> v2:172.21.15.160:3300/0 conn(0x7f4e70070590 0x7f4e70157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.962+0000 7f4e74b82640 1 --2- 172.21.15.81:0/3346942434 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e700aee40 0x7f4e7015b970 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.962+0000 7f4e74b82640 1 -- 172.21.15.81:0/3346942434 >> 172.21.15.81:0/3346942434 conn(0x7f4e700b1620 msgr2=0x7f4e700b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.962+0000 7f4e74b82640 1 -- 172.21.15.81:0/3346942434 shutdown_connections 2024-09-17T05:25:27.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.962+0000 7f4e74b82640 1 -- 172.21.15.81:0/3346942434 wait complete. 2024-09-17T05:25:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.963+0000 7f4e74b82640 1 Processor -- start 2024-09-17T05:25:27.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.963+0000 7f4e74b82640 1 -- start start 2024-09-17T05:25:27.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e74b82640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7006e940 0x7f4e70152f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:27.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e74b82640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e70070590 0x7f4e701f4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:27.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e74b82640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e700aee40 0x7f4e701ee8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e74b82640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e701586a0 con 0x7f4e70070590 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e74b82640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4e70158520 con 0x7f4e700aee40 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e74b82640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4e70158820 con 0x7f4e7006e940 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e70070590 0x7f4e701f4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e70070590 0x7f4e701f4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47312/0 (socket says 172.21.15.81:47312) 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 -- 172.21.15.81:0/4078372501 learned_addr learned my addr 172.21.15.81:0/4078372501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e6e59c640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7006e940 0x7f4e70152f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e6ed9d640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e700aee40 0x7f4e701ee8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 -- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7006e940 msgr2=0x7f4e70152f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7006e940 0x7f4e70152f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 -- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e700aee40 msgr2=0x7f4e701ee8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:27.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e700aee40 0x7f4e701ee8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 -- 172.21.15.81:0/4078372501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e70151470 con 0x7f4e70070590 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e67fff640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e70070590 0x7f4e701f4980 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c400 tx=0x7f4e5800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.964+0000 7f4e66ffd640 1 -- 172.21.15.81:0/4078372501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58011790 con 0x7f4e70070590 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.965+0000 7f4e66ffd640 1 -- 172.21.15.81:0/4078372501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4e58017070 con 0x7f4e70070590 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.965+0000 7f4e66ffd640 1 -- 172.21.15.81:0/4078372501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e58011d00 con 0x7f4e70070590 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.965+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e701f4ec0 con 0x7f4e70070590 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.965+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e701f5430 con 0x7f4e70070590 2024-09-17T05:25:27.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.966+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e70157cf0 con 0x7f4e70070590 2024-09-17T05:25:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.966+0000 7f4e66ffd640 1 -- 172.21.15.81:0/4078372501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f4e5801c460 con 0x7f4e70070590 2024-09-17T05:25:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.967+0000 7f4e66ffd640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4e50079250 0x7f4e5007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.967+0000 7f4e6e59c640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4e50079250 0x7f4e5007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.967+0000 7f4e66ffd640 1 -- 172.21.15.81:0/4078372501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f4e5809b600 con 0x7f4e70070590 2024-09-17T05:25:27.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.967+0000 7f4e6e59c640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4e50079250 0x7f4e5007b710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e60033000 tx=0x7f4e60004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:27.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:27.971+0000 7f4e66ffd640 1 -- 172.21.15.81:0/4078372501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4e70151470 con 0x7f4e70070590 2024-09-17T05:25:28.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:28.186+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f4e700cf7a0 con 0x7f4e70070590 2024-09-17T05:25:29.148 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.147+0000 7f4e66ffd640 1 -- 172.21.15.81:0/4078372501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v85) ==== 136+0+0 (secure 0 0 0) 0x7f4e58062b90 con 0x7f4e70070590 2024-09-17T05:25:29.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4e50079250 msgr2=0x7f4e5007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4e50079250 0x7f4e5007b710 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4e60033000 tx=0x7f4e60004730 comp rx=0 tx=0).stop 2024-09-17T05:25:29.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e70070590 msgr2=0x7f4e701f4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e70070590 0x7f4e701f4980 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f4e5800c400 tx=0x7f4e5800c8c0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 shutdown_connections 2024-09-17T05:25:29.151 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4e50079250 0x7f4e5007b710 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e700aee40 0x7f4e701ee8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e70070590 0x7f4e701f4980 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 --2- 172.21.15.81:0/4078372501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e7006e940 0x7f4e70152f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 >> 172.21.15.81:0/4078372501 conn(0x7f4e700b1620 msgr2=0x7f4e700b4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:29.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 shutdown_connections 2024-09-17T05:25:29.152 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.150+0000 7f4e74b82640 1 -- 172.21.15.81:0/4078372501 wait complete. 2024-09-17T05:25:29.166 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:25:29.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 -- 172.21.15.81:0/736256867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 msgr2=0x7f83580cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 --2- 172.21.15.81:0/736256867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83580cf9b0 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f83580b9f50 tx=0x7f834002aac0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 -- 172.21.15.81:0/736256867 shutdown_connections 2024-09-17T05:25:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 --2- 172.21.15.81:0/736256867 >> v2:172.21.15.160:3300/0 conn(0x7f83580d49c0 0x7f83580b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 --2- 172.21.15.81:0/736256867 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83580cf9b0 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 -- 172.21.15.81:0/736256867 >> 172.21.15.81:0/736256867 conn(0x7f83580d3ea0 msgr2=0x7f83580d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 -- 172.21.15.81:0/736256867 shutdown_connections 2024-09-17T05:25:29.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.272+0000 7f835f08c640 1 -- 172.21.15.81:0/736256867 wait complete. 2024-09-17T05:25:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.273+0000 7f835f08c640 1 Processor -- start 2024-09-17T05:25:29.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.274+0000 7f835f08c640 1 -- start start 2024-09-17T05:25:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.274+0000 7f835f08c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83581f4b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.274+0000 7f835f08c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83580d49c0 0x7f835815fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.274+0000 7f835f08c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f835815df90 0x7f83581f1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.274+0000 7f835f08c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8358162690 con 0x7f83580d0d40 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.274+0000 7f835f08c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f83580b3d40 con 0x7f835815df90 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.274+0000 7f835f08c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f835815eaf0 con 0x7f83580d49c0 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83581f4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83581f4b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47316/0 (socket says 172.21.15.81:47316) 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 -- 172.21.15.81:0/3499037314 learned_addr learned my addr 172.21.15.81:0/3499037314 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f8357fff640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83580d49c0 0x7f835815fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 -- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83580d49c0 msgr2=0x7f835815fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83580d49c0 0x7f835815fb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 -- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f835815df90 msgr2=0x7f83581f1ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f835815df90 0x7f83581f1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 -- 172.21.15.81:0/3499037314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f835815edd0 con 0x7f83580d0d40 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f8357fff640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83580d49c0 0x7f835815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835ce28640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83581f4b50 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f834800c3c0 tx=0x7f834800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f83557fa640 1 -- 172.21.15.81:0/3499037314 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348017070 con 0x7f83580d0d40 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f83557fa640 1 -- 172.21.15.81:0/3499037314 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83480035f0 con 0x7f83580d0d40 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f835815f0b0 con 0x7f83580d0d40 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f83557fa640 1 -- 172.21.15.81:0/3499037314 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8348003a80 con 0x7f83580d0d40 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.275+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f835815f670 con 0x7f83580d0d40 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.276+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83580b3180 con 0x7f83580d0d40 2024-09-17T05:25:29.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.277+0000 7f83557fa640 1 -- 172.21.15.81:0/3499037314 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f834801a070 con 0x7f83580d0d40 2024-09-17T05:25:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.277+0000 7f83557fa640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8338079250 0x7f833807b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.277+0000 7f83557fa640 1 -- 172.21.15.81:0/3499037314 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f834809ad10 con 0x7f83580d0d40 2024-09-17T05:25:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.277+0000 7f8357fff640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8338079250 0x7f833807b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:29.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.278+0000 7f8357fff640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8338079250 0x7f833807b710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8340035000 tx=0x7f8340004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:29.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.282+0000 7f83557fa640 1 -- 172.21.15.81:0/3499037314 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f83580b3180 con 0x7f83580d0d40 2024-09-17T05:25:29.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.481+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f83580b4260 con 0x7f8338079250 2024-09-17T05:25:29.483 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.483+0000 7f83557fa640 1 -- 172.21.15.81:0/3499037314 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f83580b4260 con 0x7f8338079250 2024-09-17T05:25:29.484 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:25:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:25:29.484 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:29.484 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8338079250 msgr2=0x7f833807b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8338079250 0x7f833807b710 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f8340035000 tx=0x7f8340004ab0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 msgr2=0x7f83581f4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83581f4b50 secure :-1 s=READY pgs=1599 cs=0 l=1 rev1=1 crypto rx=0x7f834800c3c0 tx=0x7f834800c880 comp rx=0 tx=0).stop 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 shutdown_connections 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8338079250 0x7f833807b710 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f835815df90 0x7f83581f1ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83580d49c0 0x7f835815fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 --2- 172.21.15.81:0/3499037314 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f83580d0d40 0x7f83581f4b50 unknown :-1 s=CLOSED pgs=1599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 >> 172.21.15.81:0/3499037314 conn(0x7f83580d3ea0 msgr2=0x7f83580b6170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:29.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 shutdown_connections 2024-09-17T05:25:29.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.485+0000 7f835f08c640 1 -- 172.21.15.81:0/3499037314 wait complete. 2024-09-17T05:25:29.497 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:25:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.599+0000 7f8be64a9640 1 -- 172.21.15.81:0/1882932060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 msgr2=0x7f8be00cd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.599+0000 7f8be64a9640 1 --2- 172.21.15.81:0/1882932060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be00cd700 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f8be00b2740 tx=0x7f8bd402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.599+0000 7f8be64a9640 1 -- 172.21.15.81:0/1882932060 shutdown_connections 2024-09-17T05:25:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.599+0000 7f8be64a9640 1 --2- 172.21.15.81:0/1882932060 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be00cd700 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.599+0000 7f8be64a9640 1 --2- 172.21.15.81:0/1882932060 >> v2:172.21.15.160:3300/0 conn(0x7f8be0152980 0x7f8be00cf370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.599+0000 7f8be64a9640 1 -- 172.21.15.81:0/1882932060 >> 172.21.15.81:0/1882932060 conn(0x7f8be00b1700 msgr2=0x7f8be00b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:29.601 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.599+0000 7f8be64a9640 1 -- 172.21.15.81:0/1882932060 shutdown_connections 2024-09-17T05:25:29.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.600+0000 7f8be64a9640 1 -- 172.21.15.81:0/1882932060 wait complete. 2024-09-17T05:25:29.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.601+0000 7f8be64a9640 1 Processor -- start 2024-09-17T05:25:29.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.601+0000 7f8be64a9640 1 -- start start 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.601+0000 7f8be64a9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8be0152980 0x7f8be0156060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be64a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be01501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be64a9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8be015fed0 0x7f8be0153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be64a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8be015c0e0 con 0x7f8be0152d60 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be64a9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8be0160570 con 0x7f8be0152980 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be64a9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8be015c260 con 0x7f8be015fed0 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be01501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be01501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47330/0 (socket says 172.21.15.81:47330) 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 -- 172.21.15.81:0/3341482607 learned_addr learned my addr 172.21.15.81:0/3341482607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be4a46640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8be015fed0 0x7f8be0153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdffff640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8be0152980 0x7f8be0156060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:29.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 -- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8be015fed0 msgr2=0x7f8be0153db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8be015fed0 0x7f8be0153db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 -- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8be0152980 msgr2=0x7f8be0156060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8be0152980 0x7f8be0156060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 -- 172.21.15.81:0/3341482607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be0150730 con 0x7f8be0152d60 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdf7fe640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be01501f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009850 tx=0x7f8bd4003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdcff9640 1 -- 172.21.15.81:0/3341482607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd403f070 con 0x7f8be0152d60 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdcff9640 1 -- 172.21.15.81:0/3341482607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8bd40047a0 con 0x7f8be0152d60 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be01f3750 con 0x7f8be0152d60 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8bdcff9640 1 -- 172.21.15.81:0/3341482607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4035030 con 0x7f8be0152d60 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.602+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be01f3d10 con 0x7f8be0152d60 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.603+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be006e4a0 con 0x7f8be0152d60 2024-09-17T05:25:29.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.604+0000 7f8bdcff9640 1 -- 172.21.15.81:0/3341482607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f8bd4042070 con 0x7f8be0152d60 2024-09-17T05:25:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.604+0000 7f8bdcff9640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8bcc079250 0x7f8bcc07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.604+0000 7f8bdcff9640 1 -- 172.21.15.81:0/3341482607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f8bd40bc690 con 0x7f8be0152d60 2024-09-17T05:25:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.604+0000 7f8bdffff640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8bcc079250 0x7f8bcc07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:29.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.605+0000 7f8bdffff640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8bcc079250 0x7f8bcc07b710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8be015d850 tx=0x7f8bd000b390 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:29.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.609+0000 7f8bdcff9640 1 -- 172.21.15.81:0/3341482607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8bd4083bb0 con 0x7f8be0152d60 2024-09-17T05:25:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.785+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f8be00cf320 con 0x7f8be0152d60 2024-09-17T05:25:29.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.786+0000 7f8bdcff9640 1 -- 172.21.15.81:0/3341482607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v44)=0 v44) ==== 122+0+0 (secure 0 0 0) 0x7f8bd40885e0 con 0x7f8be0152d60 2024-09-17T05:25:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8bcc079250 msgr2=0x7f8bcc07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8bcc079250 0x7f8bcc07b710 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f8be015d850 tx=0x7f8bd000b390 comp rx=0 tx=0).stop 2024-09-17T05:25:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 msgr2=0x7f8be01501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:29.789 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be01501f0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009850 tx=0x7f8bd4003910 comp rx=0 tx=0).stop 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 shutdown_connections 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8be015fed0 0x7f8be0153db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8be0152d60 0x7f8be01501f0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8bcc079250 0x7f8bcc07b710 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 --2- 172.21.15.81:0/3341482607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8be0152980 0x7f8be0156060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 >> 172.21.15.81:0/3341482607 conn(0x7f8be00b1700 msgr2=0x7f8be006fbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 shutdown_connections 2024-09-17T05:25:29.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:29.788+0000 7f8be64a9640 1 -- 172.21.15.81:0/3341482607 wait complete. 2024-09-17T05:25:29.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:29.800 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/_nogroup/subvol37500) 2024-09-17T05:25:29.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:29.834 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp52470/subvol3371) 2024-09-17T05:25:29.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol37500 2024-09-17T05:25:30.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.050+0000 7f9a6c02b640 1 -- 172.21.15.81:0/3752672061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 msgr2=0x7f9a640ce000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.050+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/3752672061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640ce000 secure :-1 s=READY pgs=1603 cs=0 l=1 rev1=1 crypto rx=0x7f9a5c009830 tx=0x7f9a5c02a480 comp rx=0 tx=0).stop 2024-09-17T05:25:30.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.050+0000 7f9a6c02b640 1 -- 172.21.15.81:0/3752672061 shutdown_connections 2024-09-17T05:25:30.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.050+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/3752672061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640ce000 unknown :-1 s=CLOSED pgs=1603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.050+0000 7f9a6c02b640 1 -- 172.21.15.81:0/3752672061 >> 172.21.15.81:0/3752672061 conn(0x7f9a640b1700 msgr2=0x7f9a640b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:30.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.050+0000 7f9a6c02b640 1 -- 172.21.15.81:0/3752672061 shutdown_connections 2024-09-17T05:25:30.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.050+0000 7f9a6c02b640 1 -- 172.21.15.81:0/3752672061 wait complete. 2024-09-17T05:25:30.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.051+0000 7f9a6c02b640 1 Processor -- start 2024-09-17T05:25:30.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.051+0000 7f9a6c02b640 1 -- start start 2024-09-17T05:25:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a6c02b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a640cdb90 0x7f9a640cff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a6c02b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640cba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a6c02b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a6415bab0 0x7f9a64152990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a6c02b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6406fff0 con 0x7f9a640cf4f0 2024-09-17T05:25:30.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a6c02b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9a6406fe70 con 0x7f9a640cdb90 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a6c02b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9a64070170 con 0x7f9a6415bab0 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a695c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640cba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a695c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640cba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47354/0 (socket says 172.21.15.81:47354) 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a695c6640 1 -- 172.21.15.81:0/4278564311 learned_addr learned my addr 172.21.15.81:0/4278564311 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a6a5c8640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a6415bab0 0x7f9a64152990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a69dc7640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a640cdb90 0x7f9a640cff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a695c6640 1 -- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a6415bab0 msgr2=0x7f9a64152990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.052+0000 7f9a695c6640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a6415bab0 0x7f9a64152990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a695c6640 1 -- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a640cdb90 msgr2=0x7f9a640cff00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a695c6640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a640cdb90 0x7f9a640cff00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a695c6640 1 -- 172.21.15.81:0/4278564311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a640ad8b0 con 0x7f9a640cf4f0 2024-09-17T05:25:30.055 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a6a5c8640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a6415bab0 0x7f9a64152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:30.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a69dc7640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a640cdb90 0x7f9a640cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:30.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a695c6640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640cba10 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c450 tx=0x7f9a5800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:30.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a627fc640 1 -- 172.21.15.81:0/4278564311 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58016020 con 0x7f9a640cf4f0 2024-09-17T05:25:30.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a627fc640 1 -- 172.21.15.81:0/4278564311 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9a58012920 con 0x7f9a640cf4f0 2024-09-17T05:25:30.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a640adb90 con 0x7f9a640cf4f0 2024-09-17T05:25:30.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a627fc640 1 -- 172.21.15.81:0/4278564311 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a58012d70 con 0x7f9a640cf4f0 2024-09-17T05:25:30.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.053+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a640ae150 con 0x7f9a640cf4f0 2024-09-17T05:25:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.054+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a64070690 con 0x7f9a640cf4f0 2024-09-17T05:25:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.054+0000 7f9a627fc640 1 -- 172.21.15.81:0/4278564311 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f9a58019020 con 0x7f9a640cf4f0 2024-09-17T05:25:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.055+0000 7f9a627fc640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9a50079280 0x7f9a5007b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.055+0000 7f9a69dc7640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9a50079280 0x7f9a5007b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.055+0000 7f9a627fc640 1 -- 172.21.15.81:0/4278564311 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f9a5809ba60 con 0x7f9a640cf4f0 2024-09-17T05:25:30.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.055+0000 7f9a69dc7640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9a50079280 0x7f9a5007b740 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9a54007e90 tx=0x7f9a540073a0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:30.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.059+0000 7f9a627fc640 1 -- 172.21.15.81:0/4278564311 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9a58020020 con 0x7f9a640cf4f0 2024-09-17T05:25:30.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.267+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol37500", "target": ["mon-mgr", ""]}) -- 0x7f9a6406f140 con 0x7f9a50079280 2024-09-17T05:25:30.273 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:30.272+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:30.273 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:30.272+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:30.273 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:30.272+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:30.273 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:30.272+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:30.273 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:30.272+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:30.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.298+0000 7f9a627fc640 1 -- 172.21.15.81:0/4278564311 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f9a6406f140 con 0x7f9a50079280 2024-09-17T05:25:30.299 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol37500 2024-09-17T05:25:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9a50079280 msgr2=0x7f9a5007b740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9a50079280 0x7f9a5007b740 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9a54007e90 tx=0x7f9a540073a0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 msgr2=0x7f9a640cba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640cba10 secure :-1 s=READY pgs=1604 cs=0 l=1 rev1=1 crypto rx=0x7f9a5800c450 tx=0x7f9a5800c910 comp rx=0 tx=0).stop 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 shutdown_connections 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9a6415bab0 0x7f9a64152990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9a640cf4f0 0x7f9a640cba10 unknown :-1 s=CLOSED pgs=1604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9a50079280 0x7f9a5007b740 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 --2- 172.21.15.81:0/4278564311 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9a640cdb90 0x7f9a640cff00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 >> 172.21.15.81:0/4278564311 conn(0x7f9a640b1700 msgr2=0x7f9a641560c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 shutdown_connections 2024-09-17T05:25:30.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.301+0000 7f9a6c02b640 1 -- 172.21.15.81:0/4278564311 wait complete. 2024-09-17T05:25:30.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol3371 subvol_grp52470 2024-09-17T05:25:30.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.416+0000 7fd5767b4640 1 -- 172.21.15.81:0/4245120063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd570161300 msgr2=0x7fd5700d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.416+0000 7fd5767b4640 1 --2- 172.21.15.81:0/4245120063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd570161300 0x7fd5700d4940 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7fd560005fd0 tx=0x7fd56002a670 comp rx=0 tx=0).stop 2024-09-17T05:25:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.416+0000 7fd5767b4640 1 -- 172.21.15.81:0/4245120063 shutdown_connections 2024-09-17T05:25:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.416+0000 7fd5767b4640 1 --2- 172.21.15.81:0/4245120063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd570161300 0x7fd5700d4940 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.416+0000 7fd5767b4640 1 -- 172.21.15.81:0/4245120063 >> 172.21.15.81:0/4245120063 conn(0x7fd5700d3e20 msgr2=0x7fd5700d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.416+0000 7fd5767b4640 1 -- 172.21.15.81:0/4245120063 shutdown_connections 2024-09-17T05:25:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.416+0000 7fd5767b4640 1 -- 172.21.15.81:0/4245120063 wait complete. 2024-09-17T05:25:30.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.417+0000 7fd5767b4640 1 Processor -- start 2024-09-17T05:25:30.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.418+0000 7fd5767b4640 1 -- start start 2024-09-17T05:25:30.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.418+0000 7fd5767b4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5700d25b0 0x7fd5700a1130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.418+0000 7fd5767b4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd570161300 0x7fd5701f4ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.418+0000 7fd5767b4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5701616e0 0x7fd570160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.418+0000 7fd5767b4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd5700b7ec0 con 0x7fd5700d25b0 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.418+0000 7fd5767b4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd5700b7d40 con 0x7fd5701616e0 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.418+0000 7fd5767b4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd5700b8040 con 0x7fd570161300 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5700d25b0 0x7fd5700a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5700d25b0 0x7fd5700a1130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47396/0 (socket says 172.21.15.81:47396) 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 -- 172.21.15.81:0/849407757 learned_addr learned my addr 172.21.15.81:0/849407757 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd574d51640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5701616e0 0x7fd570160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56f7fe640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd570161300 0x7fd5701f4ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 -- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd570161300 msgr2=0x7fd5701f4ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd570161300 0x7fd5701f4ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 -- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5701616e0 msgr2=0x7fd570160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5701616e0 0x7fd570160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 -- 172.21.15.81:0/849407757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5701f5bb0 con 0x7fd5700d25b0 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56ffff640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5700d25b0 0x7fd5700a1130 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fd560009850 tx=0x7fd5600039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56cff9640 1 -- 172.21.15.81:0/849407757 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd56003f070 con 0x7fd5700d25b0 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56cff9640 1 -- 172.21.15.81:0/849407757 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd560004890 con 0x7fd5700d25b0 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5701f5e90 con 0x7fd5700d25b0 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd56cff9640 1 -- 172.21.15.81:0/849407757 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd560035030 con 0x7fd5700d25b0 2024-09-17T05:25:30.422 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.419+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5700a1670 con 0x7fd5700d25b0 2024-09-17T05:25:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.420+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5700b8510 con 0x7fd5700d25b0 2024-09-17T05:25:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.421+0000 7fd56cff9640 1 -- 172.21.15.81:0/849407757 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7fd560042070 con 0x7fd5700d25b0 2024-09-17T05:25:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.421+0000 7fd56cff9640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd55c079250 0x7fd55c07b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.421+0000 7fd56cff9640 1 -- 172.21.15.81:0/849407757 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fd5600bc920 con 0x7fd5700d25b0 2024-09-17T05:25:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.421+0000 7fd56f7fe640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd55c079250 0x7fd55c07b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.423 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.422+0000 7fd56f7fe640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd55c079250 0x7fd55c07b710 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd564007fd0 tx=0x7fd564009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:30.426 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.426+0000 7fd56cff9640 1 -- 172.21.15.81:0/849407757 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd560084300 con 0x7fd5700d25b0 2024-09-17T05:25:30.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.628+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol3371", "group_name": "subvol_grp52470", "target": ["mon-mgr", ""]}) -- 0x7fd5700cac80 con 0x7fd55c079250 2024-09-17T05:25:30.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.645+0000 7fd56cff9640 1 -- 172.21.15.81:0/849407757 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fd5700cac80 con 0x7fd55c079250 2024-09-17T05:25:30.647 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp52470/subvol3371 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd55c079250 msgr2=0x7fd55c07b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd55c079250 0x7fd55c07b710 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fd564007fd0 tx=0x7fd564009040 comp rx=0 tx=0).stop 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5700d25b0 msgr2=0x7fd5700a1130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5700d25b0 0x7fd5700a1130 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7fd560009850 tx=0x7fd5600039e0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 shutdown_connections 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd55c079250 0x7fd55c07b710 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd5701616e0 0x7fd570160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd570161300 0x7fd5701f4ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 --2- 172.21.15.81:0/849407757 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd5700d25b0 0x7fd5700a1130 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.647+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 >> 172.21.15.81:0/849407757 conn(0x7fd5700d3e20 msgr2=0x7fd57006de00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:30.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.648+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 shutdown_connections 2024-09-17T05:25:30.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.648+0000 7fd5767b4640 1 -- 172.21.15.81:0/849407757 wait complete. 2024-09-17T05:25:30.660 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol37500 2024-09-17T05:25:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 -- 172.21.15.81:0/3733107929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a070 msgr2=0x7f3c64072e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 --2- 172.21.15.81:0/3733107929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a070 0x7f3c64072e70 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c005fd0 tx=0x7f3c5c02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 -- 172.21.15.81:0/3733107929 shutdown_connections 2024-09-17T05:25:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 --2- 172.21.15.81:0/3733107929 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6406e300 0x7f3c6406e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 --2- 172.21.15.81:0/3733107929 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a070 0x7f3c64072e70 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 -- 172.21.15.81:0/3733107929 >> 172.21.15.81:0/3733107929 conn(0x7f3c640b1700 msgr2=0x7f3c640b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 -- 172.21.15.81:0/3733107929 shutdown_connections 2024-09-17T05:25:30.765 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.763+0000 7f3c6c023640 1 -- 172.21.15.81:0/3733107929 wait complete. 2024-09-17T05:25:30.767 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.764+0000 7f3c6c023640 1 Processor -- start 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.764+0000 7f3c6c023640 1 -- start start 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6c023640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6406e300 0x7f3c6415a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6c023640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c6415a070 0x7f3c6415d530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6c023640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a450 0x7f3c640b4610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6c023640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6415dde0 con 0x7f3c6415a070 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6c023640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3c6415df60 con 0x7f3c6415a450 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6c023640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3c6415e0e0 con 0x7f3c6406e300 2024-09-17T05:25:30.768 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c6415a070 0x7f3c6415d530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c6415a070 0x7f3c6415d530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47404/0 (socket says 172.21.15.81:47404) 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 -- 172.21.15.81:0/2987564381 learned_addr learned my addr 172.21.15.81:0/2987564381 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c69dbf640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6406e300 0x7f3c6415a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6a5c0640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a450 0x7f3c640b4610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 -- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6406e300 msgr2=0x7f3c6415a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6406e300 0x7f3c6415a860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 -- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a450 msgr2=0x7f3c640b4610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a450 0x7f3c640b4610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 -- 172.21.15.81:0/2987564381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3c640c7f10 con 0x7f3c6415a070 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c6a5c0640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a450 0x7f3c640b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:30.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.765+0000 7f3c695be640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c6415a070 0x7f3c6415d530 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c730 tx=0x7f3c5800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:30.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.766+0000 7f3c627fc640 1 -- 172.21.15.81:0/2987564381 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c58003b70 con 0x7f3c6415a070 2024-09-17T05:25:30.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.766+0000 7f3c627fc640 1 -- 172.21.15.81:0/2987564381 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3c58003d10 con 0x7f3c6415a070 2024-09-17T05:25:30.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.766+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3c640c81f0 con 0x7f3c6415a070 2024-09-17T05:25:30.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.766+0000 7f3c627fc640 1 -- 172.21.15.81:0/2987564381 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3c5800aab0 con 0x7f3c6415a070 2024-09-17T05:25:30.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.766+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3c6415ada0 con 0x7f3c6415a070 2024-09-17T05:25:30.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.767+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3c640c8430 con 0x7f3c6415a070 2024-09-17T05:25:30.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.767+0000 7f3c627fc640 1 -- 172.21.15.81:0/2987564381 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 23) ==== 102053+0+0 (secure 0 0 0) 0x7f3c5800ac50 con 0x7f3c6415a070 2024-09-17T05:25:30.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.768+0000 7f3c627fc640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c50079250 0x7f3c5007b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:30.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.768+0000 7f3c627fc640 1 -- 172.21.15.81:0/2987564381 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f3c5809b600 con 0x7f3c6415a070 2024-09-17T05:25:30.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.768+0000 7f3c69dbf640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c50079250 0x7f3c5007b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:30.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.768+0000 7f3c69dbf640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c50079250 0x7f3c5007b710 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c033000 tx=0x7f3c5c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:30.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.772+0000 7f3c627fc640 1 -- 172.21.15.81:0/2987564381 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3c580631f0 con 0x7f3c6415a070 2024-09-17T05:25:30.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.977+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol37500", "target": ["mon-mgr", ""]}) -- 0x7f3c640c7cc0 con 0x7f3c50079250 2024-09-17T05:25:30.983 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.982+0000 7f3c627fc640 1 -- 172.21.15.81:0/2987564381 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+30 (secure 0 0 0) 0x7f3c640c7cc0 con 0x7f3c50079250 2024-09-17T05:25:30.983 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol37500 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.984+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c50079250 msgr2=0x7f3c5007b710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.984+0000 7f3c6c023640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c50079250 0x7f3c5007b710 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f3c5c033000 tx=0x7f3c5c004730 comp rx=0 tx=0).stop 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.984+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c6415a070 msgr2=0x7f3c6415d530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.984+0000 7f3c6c023640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c6415a070 0x7f3c6415d530 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f3c5800c730 tx=0x7f3c5800cbf0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 shutdown_connections 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3c50079250 0x7f3c5007b710 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3c6415a450 0x7f3c640b4610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3c6415a070 0x7f3c6415d530 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 --2- 172.21.15.81:0/2987564381 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3c6406e300 0x7f3c6415a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:30.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 >> 172.21.15.81:0/2987564381 conn(0x7f3c640b1700 msgr2=0x7f3c64158f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:30.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 shutdown_connections 2024-09-17T05:25:30.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:30.985+0000 7f3c6c023640 1 -- 172.21.15.81:0/2987564381 wait complete. 2024-09-17T05:25:30.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:30.997 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/e9198718ffca373ceabc511f7f300065.meta) 2024-09-17T05:25:32.044 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:25:32.044 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:25:32.044 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:25:32.044 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol37500 2024-09-17T05:25:32.044 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:25:32.044 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:32.046 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol3371 subvol_grp52470 2024-09-17T05:25:32.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 -- 172.21.15.81:0/3668505094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6180aec50 msgr2=0x7fc618072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:32.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 --2- 172.21.15.81:0/3668505094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6180aec50 0x7fc618072a10 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7fc618074d60 tx=0x7fc60802a530 comp rx=0 tx=0).stop 2024-09-17T05:25:32.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 -- 172.21.15.81:0/3668505094 shutdown_connections 2024-09-17T05:25:32.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 --2- 172.21.15.81:0/3668505094 >> v2:172.21.15.160:3300/0 conn(0x7fc6180ae690 0x7fc618072f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 --2- 172.21.15.81:0/3668505094 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc6180aec50 0x7fc618072a10 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 -- 172.21.15.81:0/3668505094 >> 172.21.15.81:0/3668505094 conn(0x7fc6180b1620 msgr2=0x7fc6180b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:32.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 -- 172.21.15.81:0/3668505094 shutdown_connections 2024-09-17T05:25:32.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.162+0000 7fc61fda0640 1 -- 172.21.15.81:0/3668505094 wait complete. 2024-09-17T05:25:32.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 Processor -- start 2024-09-17T05:25:32.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 -- start start 2024-09-17T05:25:32.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6180ae690 0x7fc61814a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:32.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6180aec50 0x7fc618159ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:32.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61815d610 0x7fc61815a010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:32.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180b2e50 con 0x7fc61815d610 2024-09-17T05:25:32.168 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc6180b2cd0 con 0x7fc6180ae690 2024-09-17T05:25:32.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61fda0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc6180b2fd0 con 0x7fc6180aec50 2024-09-17T05:25:32.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.164+0000 7fc61e33d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61815d610 0x7fc61815a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:32.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61815d610 0x7fc61815a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47436/0 (socket says 172.21.15.81:47436) 2024-09-17T05:25:32.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 -- 172.21.15.81:0/1081406987 learned_addr learned my addr 172.21.15.81:0/1081406987 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:32.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61d33b640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6180aec50 0x7fc618159ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:32.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61db3c640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6180ae690 0x7fc61814a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 -- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6180aec50 msgr2=0x7fc618159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6180aec50 0x7fc618159ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 -- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6180ae690 msgr2=0x7fc61814a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6180ae690 0x7fc61814a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 -- 172.21.15.81:0/1081406987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc6181f3a20 con 0x7fc61815d610 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61db3c640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6180ae690 0x7fc61814a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61e33d640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61815d610 0x7fc61815a010 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fc61000eaa0 tx=0x7fc61000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc60e7fc640 1 -- 172.21.15.81:0/1081406987 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61000cdb0 con 0x7fc61815d610 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc60e7fc640 1 -- 172.21.15.81:0/1081406987 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc610004c10 con 0x7fc61815d610 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc60e7fc640 1 -- 172.21.15.81:0/1081406987 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc610005020 con 0x7fc61815d610 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc6181f2ea0 con 0x7fc61815d610 2024-09-17T05:25:32.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.165+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6181f3740 con 0x7fc61815d610 2024-09-17T05:25:32.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.167+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6180b33e0 con 0x7fc61815d610 2024-09-17T05:25:32.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.175+0000 7fc60e7fc640 1 -- 172.21.15.81:0/1081406987 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 102104+0+0 (secure 0 0 0) 0x7fc6100051c0 con 0x7fc61815d610 2024-09-17T05:25:32.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.176+0000 7fc60e7fc640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc5fc0792e0 0x7fc5fc07b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:32.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.176+0000 7fc60e7fc640 1 -- 172.21.15.81:0/1081406987 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fc61009c930 con 0x7fc61815d610 2024-09-17T05:25:32.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.176+0000 7fc61db3c640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc5fc0792e0 0x7fc5fc07b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:32.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.176+0000 7fc61db3c640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc5fc0792e0 0x7fc5fc07b7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc6140016a0 tx=0x7fc614009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:32.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.179+0000 7fc60e7fc640 1 -- 172.21.15.81:0/1081406987 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc610016030 con 0x7fc61815d610 2024-09-17T05:25:32.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.382+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol3371", "group_name": "subvol_grp52470", "target": ["mon-mgr", ""]}) -- 0x7fc61813cf50 con 0x7fc5fc0792e0 2024-09-17T05:25:32.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.387+0000 7fc60e7fc640 1 -- 172.21.15.81:0/1081406987 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fc6140012e0 con 0x7fc5fc0792e0 2024-09-17T05:25:32.387 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp52470/subvol3371 2024-09-17T05:25:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc5fc0792e0 msgr2=0x7fc5fc07b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc5fc0792e0 0x7fc5fc07b7a0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fc6140016a0 tx=0x7fc614009040 comp rx=0 tx=0).stop 2024-09-17T05:25:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61815d610 msgr2=0x7fc61815a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61815d610 0x7fc61815a010 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7fc61000eaa0 tx=0x7fc61000ef60 comp rx=0 tx=0).stop 2024-09-17T05:25:32.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 shutdown_connections 2024-09-17T05:25:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc61815d610 0x7fc61815a010 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc6180aec50 0x7fc618159ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc5fc0792e0 0x7fc5fc07b7a0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 --2- 172.21.15.81:0/1081406987 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc6180ae690 0x7fc61814a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 >> 172.21.15.81:0/1081406987 conn(0x7fc6180b1620 msgr2=0x7fc6180cd3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 shutdown_connections 2024-09-17T05:25:32.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:32.389+0000 7fc61fda0640 1 -- 172.21.15.81:0/1081406987 wait complete. 2024-09-17T05:25:32.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:32.401 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/9a21258f62e5d75769a3c135d0882c31.meta) 2024-09-17T05:25:37.042 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:25:37.042 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:25:37.042 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:25:37.043 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/subvol_grp52470/subvol3371 2024-09-17T05:25:37.043 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:25:37.043 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:37.045 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol37500 2024-09-17T05:25:37.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 -- 172.21.15.81:0/2363685303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cd430 msgr2=0x7f673c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 --2- 172.21.15.81:0/2363685303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cd430 0x7f673c0cb7c0 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f673c072a60 tx=0x7f672c02a530 comp rx=0 tx=0).stop 2024-09-17T05:25:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 -- 172.21.15.81:0/2363685303 shutdown_connections 2024-09-17T05:25:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 --2- 172.21.15.81:0/2363685303 >> v2:172.21.15.160:3300/0 conn(0x7f673c0cbd00 0x7f673c0b0380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 --2- 172.21.15.81:0/2363685303 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cd430 0x7f673c0cb7c0 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 -- 172.21.15.81:0/2363685303 >> 172.21.15.81:0/2363685303 conn(0x7f673c074160 msgr2=0x7f673c074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 -- 172.21.15.81:0/2363685303 shutdown_connections 2024-09-17T05:25:37.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.159+0000 7f67445f3640 1 -- 172.21.15.81:0/2363685303 wait complete. 2024-09-17T05:25:37.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.160+0000 7f67445f3640 1 Processor -- start 2024-09-17T05:25:37.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.160+0000 7f67445f3640 1 -- start start 2024-09-17T05:25:37.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f67445f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cbd00 0x7f673c159830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f67445f3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f673c0cd430 0x7f673c1f8800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f67445f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f673c15adb0 0x7f673c0c7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f67445f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f673c0b0c50 con 0x7f673c0cbd00 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f67445f3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f673c0b0ad0 con 0x7f673c15adb0 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f67445f3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f673c0b0dd0 con 0x7f673c0cd430 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f674238f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cbd00 0x7f673c159830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f674238f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cbd00 0x7f673c159830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37396/0 (socket says 172.21.15.81:37396) 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f674238f640 1 -- 172.21.15.81:0/3595239334 learned_addr learned my addr 172.21.15.81:0/3595239334 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f6741b8e640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f673c0cd430 0x7f673c1f8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.161+0000 7f6742b90640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f673c15adb0 0x7f673c0c7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f674238f640 1 -- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f673c0cd430 msgr2=0x7f673c1f8800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f674238f640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f673c0cd430 0x7f673c1f8800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f674238f640 1 -- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f673c15adb0 msgr2=0x7f673c0c7ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f674238f640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f673c15adb0 0x7f673c0c7ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f674238f640 1 -- 172.21.15.81:0/3595239334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f673c0ad150 con 0x7f673c0cbd00 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f674238f640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cbd00 0x7f673c159830 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f673800c3e0 tx=0x7f673800c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f6732ffd640 1 -- 172.21.15.81:0/3595239334 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738011790 con 0x7f673c0cbd00 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f6732ffd640 1 -- 172.21.15.81:0/3595239334 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6738017070 con 0x7f673c0cbd00 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f673c1f8d40 con 0x7f673c0cbd00 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f6732ffd640 1 -- 172.21.15.81:0/3595239334 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6738011ce0 con 0x7f673c0cbd00 2024-09-17T05:25:37.165 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.162+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f673c0ad6d0 con 0x7f673c0cbd00 2024-09-17T05:25:37.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.163+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f673c0b0380 con 0x7f673c0cbd00 2024-09-17T05:25:37.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.164+0000 7f6732ffd640 1 -- 172.21.15.81:0/3595239334 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 102104+0+0 (secure 0 0 0) 0x7f673801c460 con 0x7f673c0cbd00 2024-09-17T05:25:37.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.164+0000 7f6732ffd640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67200792e0 0x7f672007b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.164+0000 7f6732ffd640 1 -- 172.21.15.81:0/3595239334 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f673809bd60 con 0x7f673c0cbd00 2024-09-17T05:25:37.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.164+0000 7f6741b8e640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67200792e0 0x7f672007b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.165+0000 7f6741b8e640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67200792e0 0x7f672007b7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f672c034000 tx=0x7f672c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:37.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.168+0000 7f6732ffd640 1 -- 172.21.15.81:0/3595239334 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6738063320 con 0x7f673c0cbd00 2024-09-17T05:25:37.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.368+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol37500", "target": ["mon-mgr", ""]}) -- 0x7f673c159d70 con 0x7f67200792e0 2024-09-17T05:25:37.389 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.388+0000 7f6732ffd640 1 -- 172.21.15.81:0/3595239334 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f672c004210 con 0x7f67200792e0 2024-09-17T05:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67200792e0 msgr2=0x7f672007b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67200792e0 0x7f672007b7a0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f672c034000 tx=0x7f672c004730 comp rx=0 tx=0).stop 2024-09-17T05:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cbd00 msgr2=0x7f673c159830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cbd00 0x7f673c159830 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7f673800c3e0 tx=0x7f673800c8a0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 shutdown_connections 2024-09-17T05:25:37.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67200792e0 0x7f672007b7a0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f673c15adb0 0x7f673c0c7ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f673c0cd430 0x7f673c1f8800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 --2- 172.21.15.81:0/3595239334 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f673c0cbd00 0x7f673c159830 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 >> 172.21.15.81:0/3595239334 conn(0x7f673c074160 msgr2=0x7f673c070330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 shutdown_connections 2024-09-17T05:25:37.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.391+0000 7f67445f3640 1 -- 172.21.15.81:0/3595239334 wait complete. 2024-09-17T05:25:37.394 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.393+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.394 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.393+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.394 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.393+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.394 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.393+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.394 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.393+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.404 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol3371 subvol_grp52470 2024-09-17T05:25:37.408 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.407+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.408 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.407+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.408 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.407+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.408 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.407+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.408 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:25:37.407+0000 7fe395773640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.508+0000 7f26f522a640 1 -- 172.21.15.81:0/232631891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 msgr2=0x7f26f0157cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.508+0000 7f26f522a640 1 --2- 172.21.15.81:0/232631891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f0157cf0 secure :-1 s=READY pgs=1621 cs=0 l=1 rev1=1 crypto rx=0x7f26f0074dd0 tx=0x7f26e802a560 comp rx=0 tx=0).stop 2024-09-17T05:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.509+0000 7f26f522a640 1 -- 172.21.15.81:0/232631891 shutdown_connections 2024-09-17T05:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.509+0000 7f26f522a640 1 --2- 172.21.15.81:0/232631891 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f0157cf0 unknown :-1 s=CLOSED pgs=1621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.509+0000 7f26f522a640 1 --2- 172.21.15.81:0/232631891 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26f006e940 0x7f26f006fe80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.509+0000 7f26f522a640 1 --2- 172.21.15.81:0/232631891 >> v2:172.21.15.160:3300/0 conn(0x7f26f00aee40 0x7f26f015b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.509+0000 7f26f522a640 1 -- 172.21.15.81:0/232631891 >> 172.21.15.81:0/232631891 conn(0x7f26f00b1620 msgr2=0x7f26f00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.509+0000 7f26f522a640 1 -- 172.21.15.81:0/232631891 shutdown_connections 2024-09-17T05:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.509+0000 7f26f522a640 1 -- 172.21.15.81:0/232631891 wait complete. 2024-09-17T05:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.510+0000 7f26f522a640 1 Processor -- start 2024-09-17T05:25:37.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.510+0000 7f26f522a640 1 -- start start 2024-09-17T05:25:37.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26f522a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26f006e940 0x7f26f01476f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26f522a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f01f5ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26f522a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26f00aee40 0x7f26f01f61e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26f522a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f26f01585c0 con 0x7f26f00703c0 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26f522a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f26f0158440 con 0x7f26f006e940 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26f522a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f26f0158740 con 0x7f26f00aee40 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f01f5ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f01f5ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37454/0 (socket says 172.21.15.81:37454) 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 -- 172.21.15.81:0/2659020028 learned_addr learned my addr 172.21.15.81:0/2659020028 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:37.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26eed9d640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26f006e940 0x7f26f01476f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ef59e640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26f00aee40 0x7f26f01f61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 -- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26f00aee40 msgr2=0x7f26f01f61e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26f00aee40 0x7f26f01f61e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 -- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26f006e940 msgr2=0x7f26f01476f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26f006e940 0x7f26f01476f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 -- 172.21.15.81:0/2659020028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f00ab4f0 con 0x7f26f00703c0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.511+0000 7f26ee59c640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f01f5ca0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f26e400d950 tx=0x7f26e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.512+0000 7f26d77fe640 1 -- 172.21.15.81:0/2659020028 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4017070 con 0x7f26f00703c0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.512+0000 7f26d77fe640 1 -- 172.21.15.81:0/2659020028 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26e4009d20 con 0x7f26f00703c0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.512+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f0147c30 con 0x7f26f00703c0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.512+0000 7f26d77fe640 1 -- 172.21.15.81:0/2659020028 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26e4004280 con 0x7f26f00703c0 2024-09-17T05:25:37.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.512+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f00ab760 con 0x7f26f00703c0 2024-09-17T05:25:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.513+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f0157cf0 con 0x7f26f00703c0 2024-09-17T05:25:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.514+0000 7f26d77fe640 1 -- 172.21.15.81:0/2659020028 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 24) ==== 102104+0+0 (secure 0 0 0) 0x7f26e40035f0 con 0x7f26f00703c0 2024-09-17T05:25:37.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.514+0000 7f26d77fe640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26dc0792e0 0x7f26dc07b7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.514+0000 7f26d77fe640 1 -- 172.21.15.81:0/2659020028 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f26e409c100 con 0x7f26f00703c0 2024-09-17T05:25:37.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.514+0000 7f26eed9d640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26dc0792e0 0x7f26dc07b7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.515+0000 7f26eed9d640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26dc0792e0 0x7f26dc07b7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005fd0 tx=0x7f26e0009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:37.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.518+0000 7f26d77fe640 1 -- 172.21.15.81:0/2659020028 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f26e4062f20 con 0x7f26f00703c0 2024-09-17T05:25:37.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.718+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol3371", "group_name": "subvol_grp52470", "target": ["mon-mgr", ""]}) -- 0x7f26f006e720 con 0x7f26dc0792e0 2024-09-17T05:25:37.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.733+0000 7f26d77fe640 1 -- 172.21.15.81:0/2659020028 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f26f006e720 con 0x7f26dc0792e0 2024-09-17T05:25:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26dc0792e0 msgr2=0x7f26dc07b7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26dc0792e0 0x7f26dc07b7a0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f26e0005fd0 tx=0x7f26e0009500 comp rx=0 tx=0).stop 2024-09-17T05:25:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 msgr2=0x7f26f01f5ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f01f5ca0 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f26e400d950 tx=0x7f26e400de10 comp rx=0 tx=0).stop 2024-09-17T05:25:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 shutdown_connections 2024-09-17T05:25:37.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f26f00aee40 0x7f26f01f61e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26f00703c0 0x7f26f01f5ca0 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26dc0792e0 0x7f26dc07b7a0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 --2- 172.21.15.81:0/2659020028 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26f006e940 0x7f26f01476f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 >> 172.21.15.81:0/2659020028 conn(0x7f26f00b1620 msgr2=0x7f26f015d380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 shutdown_connections 2024-09-17T05:25:37.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.735+0000 7f26f522a640 1 -- 172.21.15.81:0/2659020028 wait complete. 2024-09-17T05:25:37.748 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:25:37.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:25:37.845 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-17T05:25:37.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:37.852 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp52470 2024-09-17T05:25:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.956+0000 7f61f6847640 1 -- 172.21.15.81:0/710585732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015f730 msgr2=0x7f61f00ce780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.956+0000 7f61f6847640 1 --2- 172.21.15.81:0/710585732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015f730 0x7f61f00ce780 secure :-1 s=READY pgs=1624 cs=0 l=1 rev1=1 crypto rx=0x7f61f00cd560 tx=0x7f61e802a820 comp rx=0 tx=0).stop 2024-09-17T05:25:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.956+0000 7f61f6847640 1 -- 172.21.15.81:0/710585732 shutdown_connections 2024-09-17T05:25:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.956+0000 7f61f6847640 1 --2- 172.21.15.81:0/710585732 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015f730 0x7f61f00ce780 unknown :-1 s=CLOSED pgs=1624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.956+0000 7f61f6847640 1 --2- 172.21.15.81:0/710585732 >> v2:172.21.15.160:3300/0 conn(0x7f61f015b9f0 0x7f61f00b65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.956+0000 7f61f6847640 1 -- 172.21.15.81:0/710585732 >> 172.21.15.81:0/710585732 conn(0x7f61f00d0bb0 msgr2=0x7f61f00d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:37.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.956+0000 7f61f6847640 1 -- 172.21.15.81:0/710585732 shutdown_connections 2024-09-17T05:25:37.959 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.957+0000 7f61f6847640 1 -- 172.21.15.81:0/710585732 wait complete. 2024-09-17T05:25:37.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.958+0000 7f61f6847640 1 Processor -- start 2024-09-17T05:25:37.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.958+0000 7f61f6847640 1 -- start start 2024-09-17T05:25:37.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61f015b9f0 0x7f61f01f2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015bdd0 0x7f61f00c46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61f015f730 0x7f61f01f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61f00cd170 con 0x7f61f015bdd0 2024-09-17T05:25:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f61f00cecc0 con 0x7f61f015f730 2024-09-17T05:25:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f61f00c4c20 con 0x7f61f015b9f0 2024-09-17T05:25:37.964 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015bdd0 0x7f61f00c46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015bdd0 0x7f61f00c46e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37474/0 (socket says 172.21.15.81:37474) 2024-09-17T05:25:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 -- 172.21.15.81:0/996095024 learned_addr learned my addr 172.21.15.81:0/996095024 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61effff640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61f015b9f0 0x7f61f01f2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f4de4640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61f015f730 0x7f61f01f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.965 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 -- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61f015b9f0 msgr2=0x7f61f01f2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61f015b9f0 0x7f61f01f2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 -- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61f015f730 msgr2=0x7f61f01f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61f015f730 0x7f61f01f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 -- 172.21.15.81:0/996095024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61f01f1ff0 con 0x7f61f015bdd0 2024-09-17T05:25:37.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61e7fff640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015bdd0 0x7f61f00c46e0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c500 tx=0x7f61d800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61ed7fa640 1 -- 172.21.15.81:0/996095024 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d8011790 con 0x7f61f015bdd0 2024-09-17T05:25:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61ed7fa640 1 -- 172.21.15.81:0/996095024 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61d8017070 con 0x7f61f015bdd0 2024-09-17T05:25:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61ed7fa640 1 -- 172.21.15.81:0/996095024 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61d8011c60 con 0x7f61f015bdd0 2024-09-17T05:25:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61f00c4e50 con 0x7f61f015bdd0 2024-09-17T05:25:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.959+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61f00c5410 con 0x7f61f015bdd0 2024-09-17T05:25:37.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.960+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61f00b65c0 con 0x7f61f015bdd0 2024-09-17T05:25:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.961+0000 7f61ed7fa640 1 -- 172.21.15.81:0/996095024 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f61d801c460 con 0x7f61f015bdd0 2024-09-17T05:25:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.961+0000 7f61ed7fa640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61d0079400 0x7f61d007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.962+0000 7f61effff640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61d0079400 0x7f61d007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.962+0000 7f61ed7fa640 1 -- 172.21.15.81:0/996095024 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f61d80992e0 con 0x7f61f015bdd0 2024-09-17T05:25:37.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.962+0000 7f61effff640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61d0079400 0x7f61d007b8c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009990 tx=0x7f61e0009110 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:37.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:37.966+0000 7f61ed7fa640 1 -- 172.21.15.81:0/996095024 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f61d8063260 con 0x7f61f015bdd0 2024-09-17T05:25:38.169 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.168+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp52470", "target": ["mon-mgr", ""]}) -- 0x7f61f00b5f70 con 0x7f61d0079400 2024-09-17T05:25:38.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.173+0000 7f61ed7fa640 1 -- 172.21.15.81:0/996095024 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f61f00b5f70 con 0x7f61d0079400 2024-09-17T05:25:38.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61d0079400 msgr2=0x7f61d007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61d0079400 0x7f61d007b8c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f61e0009990 tx=0x7f61e0009110 comp rx=0 tx=0).stop 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015bdd0 msgr2=0x7f61f00c46e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015bdd0 0x7f61f00c46e0 secure :-1 s=READY pgs=1625 cs=0 l=1 rev1=1 crypto rx=0x7f61d800c500 tx=0x7f61d800c900 comp rx=0 tx=0).stop 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 shutdown_connections 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61d0079400 0x7f61d007b8c0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f61f015f730 0x7f61f01f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61f015bdd0 0x7f61f00c46e0 unknown :-1 s=CLOSED pgs=1625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 --2- 172.21.15.81:0/996095024 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61f015b9f0 0x7f61f01f2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 >> 172.21.15.81:0/996095024 conn(0x7f61f00d0bb0 msgr2=0x7f61f00d0f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 shutdown_connections 2024-09-17T05:25:38.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.175+0000 7f61f6847640 1 -- 172.21.15.81:0/996095024 wait complete. 2024-09-17T05:25:38.187 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:25:38.187 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:38.229 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:38.275 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:25:38.275 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:38.276 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:38.276 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:38.291 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:38.291 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:38.348 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:25:38.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 -- 172.21.15.81:0/3663220756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c06ff80 msgr2=0x7f3e4c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/3663220756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c06ff80 0x7f3e4c070410 secure :-1 s=READY pgs=1626 cs=0 l=1 rev1=1 crypto rx=0x7f3e4c0b26e0 tx=0x7f3e4402aa30 comp rx=0 tx=0).stop 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 -- 172.21.15.81:0/3663220756 shutdown_connections 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/3663220756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c06ff80 0x7f3e4c070410 unknown :-1 s=CLOSED pgs=1626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/3663220756 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e4c0735a0 0x7f3e4c0739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/3663220756 >> v2:172.21.15.160:3300/0 conn(0x7f3e4c15aa70 0x7f3e4c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 -- 172.21.15.81:0/3663220756 >> 172.21.15.81:0/3663220756 conn(0x7f3e4c0b1690 msgr2=0x7f3e4c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 -- 172.21.15.81:0/3663220756 shutdown_connections 2024-09-17T05:25:38.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.488+0000 7f3e50bd3640 1 -- 172.21.15.81:0/3663220756 wait complete. 2024-09-17T05:25:38.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 Processor -- start 2024-09-17T05:25:38.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 -- start start 2024-09-17T05:25:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e4c06ff80 0x7f3e4c1f5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c0735a0 0x7f3e4c14c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c15aa70 0x7f3e4c15d2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0cd060 con 0x7f3e4c15aa70 2024-09-17T05:25:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3e4c0ccee0 con 0x7f3e4c0735a0 2024-09-17T05:25:38.493 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.490+0000 7f3e50bd3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3e4c0cd1e0 con 0x7f3e4c06ff80 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c15aa70 0x7f3e4c15d2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c15aa70 0x7f3e4c15d2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37490/0 (socket says 172.21.15.81:37490) 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 -- 172.21.15.81:0/1115033741 learned_addr learned my addr 172.21.15.81:0/1115033741 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4a59c640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e4c06ff80 0x7f3e4c1f5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e43fff640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c0735a0 0x7f3e4c14c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 -- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e4c06ff80 msgr2=0x7f3e4c1f5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e4c06ff80 0x7f3e4c1f5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 -- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c0735a0 msgr2=0x7f3e4c14c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c0735a0 0x7f3e4c14c4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.494 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 -- 172.21.15.81:0/1115033741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e4c1f6510 con 0x7f3e4c15aa70 2024-09-17T05:25:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e4ad9d640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c15aa70 0x7f3e4c15d2a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3e4402b020 tx=0x7f3e44003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e42ffd640 1 -- 172.21.15.81:0/1115033741 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44046070 con 0x7f3e4c15aa70 2024-09-17T05:25:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e42ffd640 1 -- 172.21.15.81:0/1115033741 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3e44004250 con 0x7f3e4c15aa70 2024-09-17T05:25:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e4c1f67f0 con 0x7f3e4c15aa70 2024-09-17T05:25:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e42ffd640 1 -- 172.21.15.81:0/1115033741 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e44033050 con 0x7f3e4c15aa70 2024-09-17T05:25:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.491+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e4c0c7710 con 0x7f3e4c15aa70 2024-09-17T05:25:38.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.492+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e4c0739a0 con 0x7f3e4c15aa70 2024-09-17T05:25:38.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.493+0000 7f3e42ffd640 1 -- 172.21.15.81:0/1115033741 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f3e44049070 con 0x7f3e4c15aa70 2024-09-17T05:25:38.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.493+0000 7f3e42ffd640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3e2c079400 0x7f3e2c07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.494+0000 7f3e4a59c640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3e2c079400 0x7f3e2c07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.494+0000 7f3e42ffd640 1 -- 172.21.15.81:0/1115033741 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f3e440ba400 con 0x7f3e4c15aa70 2024-09-17T05:25:38.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.494+0000 7f3e4a59c640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3e2c079400 0x7f3e2c07b8c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00bad0 tx=0x7f3e3c00b2e0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:38.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.498+0000 7f3e42ffd640 1 -- 172.21.15.81:0/1115033741 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3e44083d30 con 0x7f3e4c15aa70 2024-09-17T05:25:38.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.687+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3e4c155970 con 0x7f3e4c15aa70 2024-09-17T05:25:38.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.687+0000 7f3e42ffd640 1 -- 172.21.15.81:0/1115033741 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) ==== 80+0+0 (secure 0 0 0) 0x7f3e44088760 con 0x7f3e4c15aa70 2024-09-17T05:25:38.688 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3e2c079400 msgr2=0x7f3e2c07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3e2c079400 0x7f3e2c07b8c0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3e3c00bad0 tx=0x7f3e3c00b2e0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c15aa70 msgr2=0x7f3e4c15d2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c15aa70 0x7f3e4c15d2a0 secure :-1 s=READY pgs=1627 cs=0 l=1 rev1=1 crypto rx=0x7f3e4402b020 tx=0x7f3e44003f10 comp rx=0 tx=0).stop 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 shutdown_connections 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3e4c15aa70 0x7f3e4c15d2a0 unknown :-1 s=CLOSED pgs=1627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3e2c079400 0x7f3e2c07b8c0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3e4c0735a0 0x7f3e4c14c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 --2- 172.21.15.81:0/1115033741 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3e4c06ff80 0x7f3e4c1f5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 >> 172.21.15.81:0/1115033741 conn(0x7f3e4c0b1690 msgr2=0x7f3e4c154ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 shutdown_connections 2024-09-17T05:25:38.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.690+0000 7f3e50bd3640 1 -- 172.21.15.81:0/1115033741 wait complete. 2024-09-17T05:25:38.701 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:25:38.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:38.702 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:38.725 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[76303]: fuse finished with error 0 and tester_r 0 2024-09-17T05:25:38.726 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:25:38.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:38.726 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:25:38.805 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:38.805 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:38.806 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:38.823 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:38.823 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:38.880 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:25:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.983+0000 7f884d233640 1 -- 172.21.15.81:0/422175727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8834003a50 msgr2=0x7f8834003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.983+0000 7f884d233640 1 --2- 172.21.15.81:0/422175727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8834003a50 0x7f8834003e70 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f884000a790 tx=0x7f8834005830 comp rx=0 tx=0).stop 2024-09-17T05:25:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.983+0000 7f884d233640 1 -- 172.21.15.81:0/422175727 shutdown_connections 2024-09-17T05:25:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.983+0000 7f884d233640 1 --2- 172.21.15.81:0/422175727 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8834003a50 0x7f8834003e70 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.984 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.983+0000 7f884d233640 1 -- 172.21.15.81:0/422175727 >> 172.21.15.81:0/422175727 conn(0x7f88480d3ea0 msgr2=0x7f88480d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.983+0000 7f884d233640 1 -- 172.21.15.81:0/422175727 shutdown_connections 2024-09-17T05:25:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.983+0000 7f884d233640 1 -- 172.21.15.81:0/422175727 wait complete. 2024-09-17T05:25:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.984+0000 7f884d233640 1 Processor -- start 2024-09-17T05:25:38.985 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.984+0000 7f884d233640 1 -- start start 2024-09-17T05:25:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884d233640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8834003a50 0x7f884815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884d233640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88481612d0 0x7f88480b5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884d233640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88480b5c60 0x7f88480b4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884d233640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f88480cf9b0 con 0x7f88481612d0 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884d233640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f88481627a0 con 0x7f8834003a50 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884d233640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f88480cfb30 con 0x7f88480b5c60 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88481612d0 0x7f88480b5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88481612d0 0x7f88480b5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37504/0 (socket says 172.21.15.81:37504) 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 -- 172.21.15.81:0/3579219945 learned_addr learned my addr 172.21.15.81:0/3579219945 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f8846d9d640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8834003a50 0x7f884815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884759e640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88480b5c60 0x7f88480b4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 -- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88480b5c60 msgr2=0x7f88480b4850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88480b5c60 0x7f88480b4850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.988 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 -- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8834003a50 msgr2=0x7f884815e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8834003a50 0x7f884815e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.985+0000 7f884659c640 1 -- 172.21.15.81:0/3579219945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884815aaf0 con 0x7f88481612d0 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.986+0000 7f884659c640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88481612d0 0x7f88480b5720 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f8830004d60 tx=0x7f8830001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.986+0000 7f883f7fe640 1 -- 172.21.15.81:0/3579219945 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88300107d0 con 0x7f88481612d0 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.986+0000 7f883f7fe640 1 -- 172.21.15.81:0/3579219945 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8830010970 con 0x7f88481612d0 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.986+0000 7f883f7fe640 1 -- 172.21.15.81:0/3579219945 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8830010dc0 con 0x7f88481612d0 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.986+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8848160ad0 con 0x7f88481612d0 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.986+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f884814ddd0 con 0x7f88481612d0 2024-09-17T05:25:38.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.987+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f88480d07a0 con 0x7f88481612d0 2024-09-17T05:25:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.987+0000 7f883f7fe640 1 -- 172.21.15.81:0/3579219945 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f883001c470 con 0x7f88481612d0 2024-09-17T05:25:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.988+0000 7f883f7fe640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8828079430 0x7f882807b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.988+0000 7f8846d9d640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8828079430 0x7f882807b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.988+0000 7f883f7fe640 1 -- 172.21.15.81:0/3579219945 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f883009c660 con 0x7f88481612d0 2024-09-17T05:25:38.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.988+0000 7f8846d9d640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8828079430 0x7f882807b8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8840033000 tx=0x7f8840001f40 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:38.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:38.992+0000 7f883f7fe640 1 -- 172.21.15.81:0/3579219945 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8830063bf0 con 0x7f88481612d0 2024-09-17T05:25:39.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.177+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f884808d590 con 0x7f88481612d0 2024-09-17T05:25:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.178+0000 7f883f7fe640 1 -- 172.21.15.81:0/3579219945 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) ==== 80+0+0 (secure 0 0 0) 0x7f88300634f0 con 0x7f88481612d0 2024-09-17T05:25:39.179 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:25:39.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8828079430 msgr2=0x7f882807b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8828079430 0x7f882807b8f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f8840033000 tx=0x7f8840001f40 comp rx=0 tx=0).stop 2024-09-17T05:25:39.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88481612d0 msgr2=0x7f88480b5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88481612d0 0x7f88480b5720 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f8830004d60 tx=0x7f8830001670 comp rx=0 tx=0).stop 2024-09-17T05:25:39.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 shutdown_connections 2024-09-17T05:25:39.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f88480b5c60 0x7f88480b4850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.181 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f88481612d0 0x7f88480b5720 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8828079430 0x7f882807b8f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 --2- 172.21.15.81:0/3579219945 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8834003a50 0x7f884815e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 >> 172.21.15.81:0/3579219945 conn(0x7f88480d3ea0 msgr2=0x7f88480b23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 shutdown_connections 2024-09-17T05:25:39.182 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.180+0000 7f884d233640 1 -- 172.21.15.81:0/3579219945 wait complete. 2024-09-17T05:25:39.191 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:25:39.192 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:39.192 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:39.219 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[49336]: fuse finished with error 0 and tester_r 0 2024-09-17T05:25:39.221 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:25:39.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:39.221 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:25:39.280 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:39.280 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:39.280 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:39.298 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:25:39.298 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:25:39.298 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:39.298 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:39.338 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:25:39.338 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.437+0000 7f3f1795d640 1 -- 172.21.15.81:0/3520914390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f10159680 msgr2=0x7f3f1015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.437+0000 7f3f1795d640 1 --2- 172.21.15.81:0/3520914390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f10159680 0x7f3f1015d270 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7f3f100b2330 tx=0x7f3f0c02a560 comp rx=0 tx=0).stop 2024-09-17T05:25:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.437+0000 7f3f1795d640 1 -- 172.21.15.81:0/3520914390 shutdown_connections 2024-09-17T05:25:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.437+0000 7f3f1795d640 1 --2- 172.21.15.81:0/3520914390 >> v2:172.21.15.160:3300/0 conn(0x7f3f100cc490 0x7f3f1015f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.437+0000 7f3f1795d640 1 --2- 172.21.15.81:0/3520914390 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f10159680 0x7f3f1015d270 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.437+0000 7f3f1795d640 1 -- 172.21.15.81:0/3520914390 >> 172.21.15.81:0/3520914390 conn(0x7f3f100b1690 msgr2=0x7f3f100b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:39.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.438+0000 7f3f1795d640 1 -- 172.21.15.81:0/3520914390 shutdown_connections 2024-09-17T05:25:39.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.438+0000 7f3f1795d640 1 -- 172.21.15.81:0/3520914390 wait complete. 2024-09-17T05:25:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 Processor -- start 2024-09-17T05:25:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 -- start start 2024-09-17T05:25:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f100cc490 0x7f3f10156fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f100cc900 0x7f3f100ab350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f10159680 0x7f3f100aa6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3f100cf350 con 0x7f3f100cc900 2024-09-17T05:25:39.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3f100cf1d0 con 0x7f3f100cc490 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f1795d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3f100cf4d0 con 0x7f3f10159680 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.439+0000 7f3f14ef8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f100cc900 0x7f3f100ab350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f100cc900 0x7f3f100ab350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37518/0 (socket says 172.21.15.81:37518) 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 -- 172.21.15.81:0/2168561223 learned_addr learned my addr 172.21.15.81:0/2168561223 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f156f9640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f100cc490 0x7f3f10156fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f15efa640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f10159680 0x7f3f100aa6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 -- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f10159680 msgr2=0x7f3f100aa6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f10159680 0x7f3f100aa6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 -- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f100cc490 msgr2=0x7f3f10156fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f100cc490 0x7f3f10156fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 -- 172.21.15.81:0/2168561223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f100abcc0 con 0x7f3f100cc900 2024-09-17T05:25:39.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f15efa640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f10159680 0x7f3f100aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f14ef8640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f100cc900 0x7f3f100ab350 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000b4a0 tx=0x7f3f0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f05ffb640 1 -- 172.21.15.81:0/2168561223 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00014070 con 0x7f3f100cc900 2024-09-17T05:25:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f05ffb640 1 -- 172.21.15.81:0/2168561223 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3f00010700 con 0x7f3f100cc900 2024-09-17T05:25:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f101f5f50 con 0x7f3f100cc900 2024-09-17T05:25:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f05ffb640 1 -- 172.21.15.81:0/2168561223 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f00010b50 con 0x7f3f100cc900 2024-09-17T05:25:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.440+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101f6510 con 0x7f3f100cc900 2024-09-17T05:25:39.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.441+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f100ceaa0 con 0x7f3f100cc900 2024-09-17T05:25:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.442+0000 7f3f05ffb640 1 -- 172.21.15.81:0/2168561223 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f3f00017070 con 0x7f3f100cc900 2024-09-17T05:25:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.442+0000 7f3f05ffb640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ef4079400 0x7f3ef407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.442+0000 7f3f05ffb640 1 -- 172.21.15.81:0/2168561223 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f3f00098f50 con 0x7f3f100cc900 2024-09-17T05:25:39.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.442+0000 7f3f156f9640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ef4079400 0x7f3ef407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.443+0000 7f3f156f9640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ef4079400 0x7f3ef407b8c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c033000 tx=0x7f3f0c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:39.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.447+0000 7f3f05ffb640 1 -- 172.21.15.81:0/2168561223 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3f00062880 con 0x7f3f100cc900 2024-09-17T05:25:39.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.656+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f1015fe00 con 0x7f3f100cc900 2024-09-17T05:25:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.656+0000 7f3f05ffb640 1 -- 172.21.15.81:0/2168561223 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5230 (secure 0 0 0) 0x7f3f000672b0 con 0x7f3f100cc900 2024-09-17T05:25:39.658 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:39.658 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":85,"btime":"2024-09-17T05:25:29:146528+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2171494728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2171494728},{"type":"v1","addr":"172.21.15.160:6835","nonce":2171494728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/428822375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":428822375},{"type":"v1","addr":"172.21.15.81:6834","nonce":428822375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4108203098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4108203098},{"type":"v1","addr":"172.21.15.81:6835","nonce":4108203098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:15.136657+0000","modified":"2024-09-17T05:25:17.128529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6801/2976390052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2976390052},{"type":"v1","addr":"172.21.15.160:6801","nonce":2976390052}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":11}]} 2024-09-17T05:25:39.658 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 85 2024-09-17T05:25:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ef4079400 msgr2=0x7f3ef407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ef4079400 0x7f3ef407b8c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c033000 tx=0x7f3f0c004730 comp rx=0 tx=0).stop 2024-09-17T05:25:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f100cc900 msgr2=0x7f3f100ab350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f100cc900 0x7f3f100ab350 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000b4a0 tx=0x7f3f0000b960 comp rx=0 tx=0).stop 2024-09-17T05:25:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 shutdown_connections 2024-09-17T05:25:39.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3f10159680 0x7f3f100aa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3f100cc900 0x7f3f100ab350 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3ef4079400 0x7f3ef407b8c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 --2- 172.21.15.81:0/2168561223 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3f100cc490 0x7f3f10156fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 >> 172.21.15.81:0/2168561223 conn(0x7f3f100b1690 msgr2=0x7f3f1006e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 shutdown_connections 2024-09-17T05:25:39.661 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.659+0000 7f3f1795d640 1 -- 172.21.15.81:0/2168561223 wait complete. 2024-09-17T05:25:39.671 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 -- 172.21.15.81:0/2957405571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d0d40 msgr2=0x7f14bc0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 --2- 172.21.15.81:0/2957405571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d0d40 0x7f14bc0cf9b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f14a8009830 tx=0x7f14a802a510 comp rx=0 tx=0).stop 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 -- 172.21.15.81:0/2957405571 shutdown_connections 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 --2- 172.21.15.81:0/2957405571 >> v2:172.21.15.160:3300/0 conn(0x7f14bc0d49c0 0x7f14bc0b3800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 --2- 172.21.15.81:0/2957405571 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d0d40 0x7f14bc0cf9b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 -- 172.21.15.81:0/2957405571 >> 172.21.15.81:0/2957405571 conn(0x7f14bc0d3ea0 msgr2=0x7f14bc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 -- 172.21.15.81:0/2957405571 shutdown_connections 2024-09-17T05:25:39.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.771+0000 7f14c31bb640 1 -- 172.21.15.81:0/2957405571 wait complete. 2024-09-17T05:25:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.772+0000 7f14c31bb640 1 Processor -- start 2024-09-17T05:25:39.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.773+0000 7f14c31bb640 1 -- start start 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.773+0000 7f14c31bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0d0d40 0x7f14bc0ca310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.773+0000 7f14c31bb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d49c0 0x7f14bc0b7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.773+0000 7f14c31bb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc15df90 0x7f14bc1f8270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.773+0000 7f14c31bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc0b3d40 con 0x7f14bc0d0d40 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.773+0000 7f14c31bb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f14bc162710 con 0x7f14bc15df90 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.773+0000 7f14c31bb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f14bc0b3ec0 con 0x7f14bc0d49c0 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0d0d40 0x7f14bc0ca310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.776 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0d0d40 0x7f14bc0ca310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37532/0 (socket says 172.21.15.81:37532) 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 -- 172.21.15.81:0/1940239467 learned_addr learned my addr 172.21.15.81:0/1940239467 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14bbfff640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d49c0 0x7f14bc0b7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c1758640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc15df90 0x7f14bc1f8270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 -- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d49c0 msgr2=0x7f14bc0b7d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d49c0 0x7f14bc0b7d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 -- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc15df90 msgr2=0x7f14bc1f8270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc15df90 0x7f14bc1f8270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 -- 172.21.15.81:0/1940239467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14bc0b8260 con 0x7f14bc0d0d40 2024-09-17T05:25:39.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c0f57640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0d0d40 0x7f14bc0ca310 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c3a0 tx=0x7f14b000c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14b97fa640 1 -- 172.21.15.81:0/1940239467 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0011790 con 0x7f14bc0d0d40 2024-09-17T05:25:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14b97fa640 1 -- 172.21.15.81:0/1940239467 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f14b0017070 con 0x7f14bc0d0d40 2024-09-17T05:25:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14b97fa640 1 -- 172.21.15.81:0/1940239467 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14b0011cc0 con 0x7f14bc0d0d40 2024-09-17T05:25:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.774+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14bc160480 con 0x7f14bc0d0d40 2024-09-17T05:25:39.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.775+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14bc1f8f30 con 0x7f14bc0d0d40 2024-09-17T05:25:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.776+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14bc0b4310 con 0x7f14bc0d0d40 2024-09-17T05:25:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.776+0000 7f14b97fa640 1 -- 172.21.15.81:0/1940239467 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f14b001c460 con 0x7f14bc0d0d40 2024-09-17T05:25:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.777+0000 7f14b97fa640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14a0079430 0x7f14a007b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.777+0000 7f14bbfff640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14a0079430 0x7f14a007b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.777+0000 7f14b97fa640 1 -- 172.21.15.81:0/1940239467 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f14b0099170 con 0x7f14bc0d0d40 2024-09-17T05:25:39.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.777+0000 7f14bbfff640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14a0079430 0x7f14a007b8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f14a8034000 tx=0x7f14a8004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:39.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.781+0000 7f14b97fa640 1 -- 172.21.15.81:0/1940239467 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f14bc0ce970 con 0x7f14bc0d0d40 2024-09-17T05:25:39.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.993+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14bc162260 con 0x7f14bc0d0d40 2024-09-17T05:25:39.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.994+0000 7f14b97fa640 1 -- 172.21.15.81:0/1940239467 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5230 (secure 0 0 0) 0x7f14b00630f0 con 0x7f14bc0d0d40 2024-09-17T05:25:39.995 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:39.995 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":85,"btime":"2024-09-17T05:25:29:146528+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2171494728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2171494728},{"type":"v1","addr":"172.21.15.160:6835","nonce":2171494728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/428822375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":428822375},{"type":"v1","addr":"172.21.15.81:6834","nonce":428822375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4108203098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4108203098},{"type":"v1","addr":"172.21.15.81:6835","nonce":4108203098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:15.136657+0000","modified":"2024-09-17T05:25:17.128529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6801/2976390052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2976390052},{"type":"v1","addr":"172.21.15.160:6801","nonce":2976390052}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":11}]} 2024-09-17T05:25:39.996 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 85 2024-09-17T05:25:39.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14a0079430 msgr2=0x7f14a007b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14a0079430 0x7f14a007b8f0 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f14a8034000 tx=0x7f14a8004730 comp rx=0 tx=0).stop 2024-09-17T05:25:39.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0d0d40 msgr2=0x7f14bc0ca310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0d0d40 0x7f14bc0ca310 secure :-1 s=READY pgs=1633 cs=0 l=1 rev1=1 crypto rx=0x7f14b000c3a0 tx=0x7f14b000c7a0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 shutdown_connections 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f14a0079430 0x7f14a007b8f0 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f14bc15df90 0x7f14bc1f8270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f14bc0d49c0 0x7f14bc0b7d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 --2- 172.21.15.81:0/1940239467 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f14bc0d0d40 0x7f14bc0ca310 unknown :-1 s=CLOSED pgs=1633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 >> 172.21.15.81:0/1940239467 conn(0x7f14bc0d3ea0 msgr2=0x7f14bc0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 shutdown_connections 2024-09-17T05:25:39.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:39.996+0000 7f14c31bb640 1 -- 172.21.15.81:0/1940239467 wait complete. 2024-09-17T05:25:40.009 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:40.110 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3505791120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b20070690 msgr2=0x7f6b200739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3505791120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b20070690 0x7f6b200739d0 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f6b200b26e0 tx=0x7f6b1802aa30 comp rx=0 tx=0).stop 2024-09-17T05:25:40.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3505791120 shutdown_connections 2024-09-17T05:25:40.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3505791120 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b20070690 0x7f6b200739d0 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3505791120 >> v2:172.21.15.160:3300/0 conn(0x7f6b2015aa70 0x7f6b200b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3505791120 >> 172.21.15.81:0/3505791120 conn(0x7f6b200b1690 msgr2=0x7f6b200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:40.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3505791120 shutdown_connections 2024-09-17T05:25:40.111 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.109+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3505791120 wait complete. 2024-09-17T05:25:40.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.110+0000 7f6b27c8c640 1 Processor -- start 2024-09-17T05:25:40.113 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.110+0000 7f6b27c8c640 1 -- start start 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b27c8c640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b20070690 0x7f6b201f2100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b27c8c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b200735a0 0x7f6b201e5dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b27c8c640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b2015aa70 0x7f6b20151370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b27c8c640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b200cd270 con 0x7f6b200735a0 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b27c8c640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6b200cd0f0 con 0x7f6b2015aa70 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b27c8c640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6b200cd3f0 con 0x7f6b20070690 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b200735a0 0x7f6b201e5dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b200735a0 0x7f6b201e5dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37540/0 (socket says 172.21.15.81:37540) 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 -- 172.21.15.81:0/3621519103 learned_addr learned my addr 172.21.15.81:0/3621519103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:40.114 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b26229640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b2015aa70 0x7f6b20151370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25a28640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b20070690 0x7f6b201f2100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 -- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b20070690 msgr2=0x7f6b201f2100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b20070690 0x7f6b201f2100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 -- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b2015aa70 msgr2=0x7f6b20151370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b2015aa70 0x7f6b20151370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 -- 172.21.15.81:0/3621519103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b201e70c0 con 0x7f6b200735a0 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.111+0000 7f6b25227640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b200735a0 0x7f6b201e5dd0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c410 tx=0x7f6b1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.112+0000 7f6b167fc640 1 -- 172.21.15.81:0/3621519103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10017070 con 0x7f6b200735a0 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.112+0000 7f6b167fc640 1 -- 172.21.15.81:0/3621519103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b100035f0 con 0x7f6b200735a0 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.112+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b201e6540 con 0x7f6b200735a0 2024-09-17T05:25:40.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.112+0000 7f6b167fc640 1 -- 172.21.15.81:0/3621519103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b10003a80 con 0x7f6b200735a0 2024-09-17T05:25:40.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.112+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b201e6b00 con 0x7f6b200735a0 2024-09-17T05:25:40.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.113+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b200cd930 con 0x7f6b200735a0 2024-09-17T05:25:40.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.113+0000 7f6b167fc640 1 -- 172.21.15.81:0/3621519103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f6b10003c20 con 0x7f6b200735a0 2024-09-17T05:25:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.114+0000 7f6b167fc640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b04079400 0x7f6b0407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.114+0000 7f6b25a28640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b04079400 0x7f6b0407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.114+0000 7f6b167fc640 1 -- 172.21.15.81:0/3621519103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f6b100988a0 con 0x7f6b200735a0 2024-09-17T05:25:40.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.114+0000 7f6b25a28640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b04079400 0x7f6b0407b8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c005fd0 tx=0x7f6b1c005da0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:40.119 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.118+0000 7f6b167fc640 1 -- 172.21.15.81:0/3621519103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6b100627a0 con 0x7f6b200735a0 2024-09-17T05:25:40.295 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.294+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b20158320 con 0x7f6b200735a0 2024-09-17T05:25:40.296 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.295+0000 7f6b167fc640 1 -- 172.21.15.81:0/3621519103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16843 (secure 0 0 0) 0x7f6b100010c0 con 0x7f6b200735a0 2024-09-17T05:25:40.296 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:40.297 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":140,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:16.760240+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:13.741069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:14.089486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:40.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b04079400 msgr2=0x7f6b0407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b04079400 0x7f6b0407b8c0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f6b1c005fd0 tx=0x7f6b1c005da0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b200735a0 msgr2=0x7f6b201e5dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b200735a0 0x7f6b201e5dd0 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f6b1000c410 tx=0x7f6b1000c8d0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 shutdown_connections 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b04079400 0x7f6b0407b8c0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b2015aa70 0x7f6b20151370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b200735a0 0x7f6b201e5dd0 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 --2- 172.21.15.81:0/3621519103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b20070690 0x7f6b201f2100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 >> 172.21.15.81:0/3621519103 conn(0x7f6b200b1690 msgr2=0x7f6b2006ff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 shutdown_connections 2024-09-17T05:25:40.299 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.297+0000 7f6b27c8c640 1 -- 172.21.15.81:0/3621519103 wait complete. 2024-09-17T05:25:40.310 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:25:40.310 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 -- 172.21.15.81:0/4091039603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80cf640 msgr2=0x7f85e80725a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 --2- 172.21.15.81:0/4091039603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80cf640 0x7f85e80725a0 secure :-1 s=READY pgs=1636 cs=0 l=1 rev1=1 crypto rx=0x7f85dc005fd0 tx=0x7f85dc02a530 comp rx=0 tx=0).stop 2024-09-17T05:25:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 -- 172.21.15.81:0/4091039603 shutdown_connections 2024-09-17T05:25:40.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 --2- 172.21.15.81:0/4091039603 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85e80b3140 0x7f85e8072ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 --2- 172.21.15.81:0/4091039603 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80cf640 0x7f85e80725a0 unknown :-1 s=CLOSED pgs=1636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 -- 172.21.15.81:0/4091039603 >> 172.21.15.81:0/4091039603 conn(0x7f85e80b1690 msgr2=0x7f85e80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 -- 172.21.15.81:0/4091039603 shutdown_connections 2024-09-17T05:25:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.410+0000 7f85ecb73640 1 -- 172.21.15.81:0/4091039603 wait complete. 2024-09-17T05:25:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.411+0000 7f85ecb73640 1 Processor -- start 2024-09-17T05:25:40.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.411+0000 7f85ecb73640 1 -- start start 2024-09-17T05:25:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85ecb73640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80b3140 0x7f85e8140280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85ecb73640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85e80cf640 0x7f85e8145410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85ecb73640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8151370 0x7f85e8145950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85ecb73640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f85e806ebe0 con 0x7f85e80b3140 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85ecb73640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f85e806ea60 con 0x7f85e8151370 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85ecb73640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f85e806f9f0 con 0x7f85e80cf640 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80b3140 0x7f85e8140280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80b3140 0x7f85e8140280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37572/0 (socket says 172.21.15.81:37572) 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 -- 172.21.15.81:0/2251032234 learned_addr learned my addr 172.21.15.81:0/2251032234 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e5d9b640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85e80cf640 0x7f85e8145410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e6d9d640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8151370 0x7f85e8145950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 -- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85e80cf640 msgr2=0x7f85e8145410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85e80cf640 0x7f85e8145410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 -- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8151370 msgr2=0x7f85e8145950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8151370 0x7f85e8145950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.412+0000 7f85e659c640 1 -- 172.21.15.81:0/2251032234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85e814b870 con 0x7f85e80b3140 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.413+0000 7f85e659c640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80b3140 0x7f85e8140280 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba50 tx=0x7f85d800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.413+0000 7f85d6ffd640 1 -- 172.21.15.81:0/2251032234 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d8019070 con 0x7f85e80b3140 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.413+0000 7f85d6ffd640 1 -- 172.21.15.81:0/2251032234 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f85d800cd00 con 0x7f85e80b3140 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.413+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85e814bb50 con 0x7f85e80b3140 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.413+0000 7f85d6ffd640 1 -- 172.21.15.81:0/2251032234 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85d80146a0 con 0x7f85e80b3140 2024-09-17T05:25:40.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.413+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85e814c110 con 0x7f85e80b3140 2024-09-17T05:25:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.414+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85e80cef30 con 0x7f85e80b3140 2024-09-17T05:25:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.414+0000 7f85d6ffd640 1 -- 172.21.15.81:0/2251032234 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f85d801c070 con 0x7f85e80b3140 2024-09-17T05:25:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.415+0000 7f85d6ffd640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f85c8079400 0x7f85c807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.415+0000 7f85d6ffd640 1 -- 172.21.15.81:0/2251032234 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f85d8099330 con 0x7f85e80b3140 2024-09-17T05:25:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.415+0000 7f85e5d9b640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f85c8079400 0x7f85c807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.417 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.415+0000 7f85e5d9b640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f85c8079400 0x7f85c807b8c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f85dc033000 tx=0x7f85dc004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:40.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.419+0000 7f85d6ffd640 1 -- 172.21.15.81:0/2251032234 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f85d80632b0 con 0x7f85e80b3140 2024-09-17T05:25:40.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.630+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85e8072c00 con 0x7f85e80b3140 2024-09-17T05:25:40.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.631+0000 7f85d6ffd640 1 -- 172.21.15.81:0/2251032234 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5230 (secure 0 0 0) 0x7f85d8062bb0 con 0x7f85e80b3140 2024-09-17T05:25:40.632 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:40.632 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":85,"btime":"2024-09-17T05:25:29:146528+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2171494728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2171494728},{"type":"v1","addr":"172.21.15.160:6835","nonce":2171494728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/428822375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":428822375},{"type":"v1","addr":"172.21.15.81:6834","nonce":428822375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4108203098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4108203098},{"type":"v1","addr":"172.21.15.81:6835","nonce":4108203098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:15.136657+0000","modified":"2024-09-17T05:25:17.128529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6801/2976390052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2976390052},{"type":"v1","addr":"172.21.15.160:6801","nonce":2976390052}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":11}]} 2024-09-17T05:25:40.632 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 85 2024-09-17T05:25:40.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f85c8079400 msgr2=0x7f85c807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f85c8079400 0x7f85c807b8c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f85dc033000 tx=0x7f85dc004730 comp rx=0 tx=0).stop 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80b3140 msgr2=0x7f85e8140280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80b3140 0x7f85e8140280 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7f85d800ba50 tx=0x7f85d800bf10 comp rx=0 tx=0).stop 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 shutdown_connections 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f85c8079400 0x7f85c807b8c0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f85e8151370 0x7f85e8145950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f85e80cf640 0x7f85e8145410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 --2- 172.21.15.81:0/2251032234 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f85e80b3140 0x7f85e8140280 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 >> 172.21.15.81:0/2251032234 conn(0x7f85e80b1690 msgr2=0x7f85e8144350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 shutdown_connections 2024-09-17T05:25:40.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.633+0000 7f85ecb73640 1 -- 172.21.15.81:0/2251032234 wait complete. 2024-09-17T05:25:40.645 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.746+0000 7fdbd0b00640 1 -- 172.21.15.81:0/3240077868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbb8004d40 msgr2=0x7fdbb80051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.746+0000 7fdbd0b00640 1 --2- 172.21.15.81:0/3240077868 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbb8004d40 0x7fdbb80051c0 secure :-1 s=READY pgs=1639 cs=0 l=1 rev1=1 crypto rx=0x7fdbc400c610 tx=0x7fdbb8005830 comp rx=0 tx=0).stop 2024-09-17T05:25:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.746+0000 7fdbcad9d640 1 -- 172.21.15.81:0/3240077868 reap_dead start 2024-09-17T05:25:40.747 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.746+0000 7fdbd0b00640 1 -- 172.21.15.81:0/3240077868 shutdown_connections 2024-09-17T05:25:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.746+0000 7fdbd0b00640 1 -- 172.21.15.81:0/3240077868 >> 172.21.15.81:0/3240077868 conn(0x7fdbcc0d3ea0 msgr2=0x7fdbcc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.746+0000 7fdbd0b00640 1 -- 172.21.15.81:0/3240077868 shutdown_connections 2024-09-17T05:25:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.746+0000 7fdbd0b00640 1 -- 172.21.15.81:0/3240077868 wait complete. 2024-09-17T05:25:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.747+0000 7fdbd0b00640 1 Processor -- start 2024-09-17T05:25:40.748 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.747+0000 7fdbd0b00640 1 -- start start 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbd0b00640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbb8004d40 0x7fdbcc0cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbd0b00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc15d3d0 0x7fdbcc1f7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbd0b00640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbcc1f50d0 0x7fdbcc0b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbd0b00640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc0cf9b0 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbd0b00640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdbcc162710 con 0x7fdbcc1f50d0 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbd0b00640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdbcc0cfb30 con 0x7fdbb8004d40 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc15d3d0 0x7fdbcc1f7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc15d3d0 0x7fdbcc1f7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37598/0 (socket says 172.21.15.81:37598) 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 -- 172.21.15.81:0/2882553909 learned_addr learned my addr 172.21.15.81:0/2882553909 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:40.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbcad9d640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbcc1f50d0 0x7fdbcc0b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 -- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbb8004d40 msgr2=0x7fdbcc0cbee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbca59c640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbb8004d40 0x7fdbcc0cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbb8004d40 0x7fdbcc0cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 -- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbcc1f50d0 msgr2=0x7fdbcc0b9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbcc1f50d0 0x7fdbcc0b9280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 -- 172.21.15.81:0/2882553909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbcc1f82f0 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbcad9d640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbcc1f50d0 0x7fdbcc0b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.748+0000 7fdbc9d9b640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc15d3d0 0x7fdbcc1f7db0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4011ae0 tx=0x7fdbb4009e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.749+0000 7fdbc2ffd640 1 -- 172.21.15.81:0/2882553909 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb401e070 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.749+0000 7fdbc2ffd640 1 -- 172.21.15.81:0/2882553909 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdbb400fe70 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.749+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbcc1f85c0 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.749+0000 7fdbc2ffd640 1 -- 172.21.15.81:0/2882553909 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4004290 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.749+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbcc1f4bb0 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.750+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdbcc0cb220 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.750+0000 7fdbc2ffd640 1 -- 172.21.15.81:0/2882553909 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fdbb4021070 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.751+0000 7fdbc2ffd640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbac079400 0x7fdbac07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.751+0000 7fdbc2ffd640 1 -- 172.21.15.81:0/2882553909 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7fdbb4099f80 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.751+0000 7fdbca59c640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbac079400 0x7fdbac07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:40.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.751+0000 7fdbca59c640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbac079400 0x7fdbac07b8c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc006d10 tx=0x7fdbbc006c80 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:40.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.755+0000 7fdbc2ffd640 1 -- 172.21.15.81:0/2882553909 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdbb4063970 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.969+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdbcc08d590 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.969+0000 7fdbc2ffd640 1 -- 172.21.15.81:0/2882553909 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 85 v85) ==== 94+0+5230 (secure 0 0 0) 0x7fdbb40683a0 con 0x7fdbcc15d3d0 2024-09-17T05:25:40.971 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:40.971 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":85,"btime":"2024-09-17T05:25:29:146528+0000","default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2171494728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2171494728},{"type":"v1","addr":"172.21.15.160:6835","nonce":2171494728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/428822375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":428822375},{"type":"v1","addr":"172.21.15.81:6834","nonce":428822375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4108203098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4108203098},{"type":"v1","addr":"172.21.15.81:6835","nonce":4108203098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[{"mdsmap":{"epoch":84,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:15.136657+0000","modified":"2024-09-17T05:25:17.128529+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8439},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8439":{"gid":8439,"name":"b","rank":0,"incarnation":82,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6801/2976390052","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2976390052},{"type":"v1","addr":"172.21.15.160:6801","nonce":2976390052}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8439,"qdb_cluster":[8439]},"id":11}]} 2024-09-17T05:25:40.971 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 85 2024-09-17T05:25:40.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.971+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbac079400 msgr2=0x7fdbac07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.971+0000 7fdbd0b00640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbac079400 0x7fdbac07b8c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc006d10 tx=0x7fdbbc006c80 comp rx=0 tx=0).stop 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.971+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc15d3d0 msgr2=0x7fdbcc1f7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.971+0000 7fdbd0b00640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc15d3d0 0x7fdbcc1f7db0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4011ae0 tx=0x7fdbb4009e90 comp rx=0 tx=0).stop 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.971+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 shutdown_connections 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.971+0000 7fdbd0b00640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdbac079400 0x7fdbac07b8c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.972+0000 7fdbd0b00640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdbcc1f50d0 0x7fdbcc0b9280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.972+0000 7fdbd0b00640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdbcc15d3d0 0x7fdbcc1f7db0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.972+0000 7fdbd0b00640 1 --2- 172.21.15.81:0/2882553909 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdbb8004d40 0x7fdbcc0cbee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.972+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 >> 172.21.15.81:0/2882553909 conn(0x7fdbcc0d3ea0 msgr2=0x7fdbcc0b4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.972+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 shutdown_connections 2024-09-17T05:25:40.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:40.972+0000 7fdbd0b00640 1 -- 172.21.15.81:0/2882553909 wait complete. 2024-09-17T05:25:40.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.084+0000 7f59b03ca640 1 -- 172.21.15.81:0/3220420675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5990003a50 msgr2=0x7f5990003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.084+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3220420675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5990003a50 0x7f5990003e70 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7f59a0001050 tx=0x7f5990005830 comp rx=0 tx=0).stop 2024-09-17T05:25:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.084+0000 7f59b03ca640 1 -- 172.21.15.81:0/3220420675 shutdown_connections 2024-09-17T05:25:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.084+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3220420675 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5990003a50 0x7f5990003e70 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.085 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.084+0000 7f59b03ca640 1 -- 172.21.15.81:0/3220420675 >> 172.21.15.81:0/3220420675 conn(0x7f59a809af50 msgr2=0x7f59a80d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:41.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.084+0000 7f59b03ca640 1 -- 172.21.15.81:0/3220420675 shutdown_connections 2024-09-17T05:25:41.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.084+0000 7f59b03ca640 1 -- 172.21.15.81:0/3220420675 wait complete. 2024-09-17T05:25:41.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.085+0000 7f59b03ca640 1 Processor -- start 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.085+0000 7f59b03ca640 1 -- start start 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5990003a50 0x7f59a80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59a80cafa0 0x7f59a80c7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59a80c8450 0x7f59a81f2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59a80ce740 con 0x7f59a80cafa0 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f59a80ce5c0 con 0x7f59a80c8450 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f59a80ce8c0 con 0x7f5990003a50 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59a80cafa0 0x7f59a80c7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59a80cafa0 0x7f59a80c7f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37620/0 (socket says 172.21.15.81:37620) 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 -- 172.21.15.81:0/3585562224 learned_addr learned my addr 172.21.15.81:0/3585562224 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:41.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 -- 172.21.15.81:0/3585562224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5990003a50 msgr2=0x7f59a80ca070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5990003a50 0x7f59a80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 -- 172.21.15.81:0/3585562224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59a80c8450 msgr2=0x7f59a81f2df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59a80c8450 0x7f59a81f2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 -- 172.21.15.81:0/3585562224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59a80c8fd0 con 0x7f59a80cafa0 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59ad965640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59a80cafa0 0x7f59a80c7f10 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f599c010ca0 tx=0x7f599c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59a6ffd640 1 -- 172.21.15.81:0/3585562224 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c017070 con 0x7f59a80cafa0 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59a6ffd640 1 -- 172.21.15.81:0/3585562224 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f599c011640 con 0x7f59a80cafa0 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59a80c92b0 con 0x7f59a80cafa0 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59a6ffd640 1 -- 172.21.15.81:0/3585562224 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f599c011a90 con 0x7f59a80cafa0 2024-09-17T05:25:41.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.086+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59a80c9870 con 0x7f59a80cafa0 2024-09-17T05:25:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.087+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59a80cee20 con 0x7f59a80cafa0 2024-09-17T05:25:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.088+0000 7f59a6ffd640 1 -- 172.21.15.81:0/3585562224 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f599c011c30 con 0x7f59a80cafa0 2024-09-17T05:25:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.088+0000 7f59a6ffd640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5994079400 0x7f599407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.088+0000 7f59ae166640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5994079400 0x7f599407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.088+0000 7f59a6ffd640 1 -- 172.21.15.81:0/3585562224 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7f599c09a2e0 con 0x7f59a80cafa0 2024-09-17T05:25:41.090 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.089+0000 7f59ae166640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5994079400 0x7f599407b8c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59a0033000 tx=0x7f59a80b2bb0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:41.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.092+0000 7f59a6ffd640 1 -- 172.21.15.81:0/3585562224 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f599c064260 con 0x7f59a80cafa0 2024-09-17T05:25:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.270+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59a8071da0 con 0x7f59a80cafa0 2024-09-17T05:25:41.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.271+0000 7f59a6ffd640 1 -- 172.21.15.81:0/3585562224 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) ==== 74+0+16843 (secure 0 0 0) 0x7f599c063b60 con 0x7f59a80cafa0 2024-09-17T05:25:41.272 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:41.273 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":140,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:16.760240+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:13.741069+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"139","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:14.089486+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:41.274 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5994079400 msgr2=0x7f599407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5994079400 0x7f599407b8c0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f59a0033000 tx=0x7f59a80b2bb0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59a80cafa0 msgr2=0x7f59a80c7f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59a80cafa0 0x7f59a80c7f10 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7f599c010ca0 tx=0x7f599c00e720 comp rx=0 tx=0).stop 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 shutdown_connections 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5994079400 0x7f599407b8c0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59a80c8450 0x7f59a81f2df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59a80cafa0 0x7f59a80c7f10 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 --2- 172.21.15.81:0/3585562224 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5990003a50 0x7f59a80ca070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 >> 172.21.15.81:0/3585562224 conn(0x7f59a809af50 msgr2=0x7f59a8070610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 shutdown_connections 2024-09-17T05:25:41.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.273+0000 7f59b03ca640 1 -- 172.21.15.81:0/3585562224 wait complete. 2024-09-17T05:25:41.286 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/469914084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc490 msgr2=0x7ff0d015f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/469914084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc490 0x7ff0d015f750 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7ff0d0069dc0 tx=0x7ff0c002a530 comp rx=0 tx=0).stop 2024-09-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/469914084 shutdown_connections 2024-09-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/469914084 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc490 0x7ff0d015f750 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/469914084 >> v2:172.21.15.160:3300/0 conn(0x7ff0d0159680 0x7ff0d015d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/469914084 >> 172.21.15.81:0/469914084 conn(0x7ff0d00b1690 msgr2=0x7ff0d00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/469914084 shutdown_connections 2024-09-17T05:25:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.386+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/469914084 wait complete. 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.387+0000 7ff0d7f5d640 1 Processor -- start 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.387+0000 7ff0d7f5d640 1 -- start start 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d00cc490 0x7ff0d01f4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc900 0x7ff0d015e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d0159680 0x7ff0d015ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d00cf350 con 0x7ff0d00cc900 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff0d00cf1d0 con 0x7ff0d0159680 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff0d00cf4d0 con 0x7ff0d00cc490 2024-09-17T05:25:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc900 0x7ff0d015e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc900 0x7ff0d015e740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37626/0 (socket says 172.21.15.81:37626) 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 -- 172.21.15.81:0/191552514 learned_addr learned my addr 172.21.15.81:0/191552514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d64fa640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d0159680 0x7ff0d015ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d5cf9640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d00cc490 0x7ff0d01f4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 -- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d00cc490 msgr2=0x7ff0d01f4cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d00cc490 0x7ff0d01f4cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 -- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d0159680 msgr2=0x7ff0d015ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d0159680 0x7ff0d015ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 -- 172.21.15.81:0/191552514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0d01f5210 con 0x7ff0d00cc900 2024-09-17T05:25:41.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d64fa640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d0159680 0x7ff0d015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d54f8640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc900 0x7ff0d015e740 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009920 tx=0x7ff0c0032d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0c67fc640 1 -- 172.21.15.81:0/191552514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0040070 con 0x7ff0d00cc900 2024-09-17T05:25:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0c67fc640 1 -- 172.21.15.81:0/191552514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff0c0005310 con 0x7ff0d00cc900 2024-09-17T05:25:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0d0147230 con 0x7ff0d00cc900 2024-09-17T05:25:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0c67fc640 1 -- 172.21.15.81:0/191552514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0c0003800 con 0x7ff0d00cc900 2024-09-17T05:25:41.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.388+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0d01477f0 con 0x7ff0d00cc900 2024-09-17T05:25:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.389+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0d015fd70 con 0x7ff0d00cc900 2024-09-17T05:25:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.390+0000 7ff0c67fc640 1 -- 172.21.15.81:0/191552514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7ff0c0039040 con 0x7ff0d00cc900 2024-09-17T05:25:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.390+0000 7ff0c67fc640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff0b4079400 0x7ff0b407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.391+0000 7ff0c67fc640 1 -- 172.21.15.81:0/191552514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(140..140 src has 1..140) ==== 5781+0+0 (secure 0 0 0) 0x7ff0c00ba7c0 con 0x7ff0d00cc900 2024-09-17T05:25:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.391+0000 7ff0d5cf9640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff0b4079400 0x7ff0b407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.391+0000 7ff0d5cf9640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff0b4079400 0x7ff0b407b8c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00b9a0 tx=0x7ff0cc005c20 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:41.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.395+0000 7ff0c67fc640 1 -- 172.21.15.81:0/191552514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff0c0084740 con 0x7ff0d00cc900 2024-09-17T05:25:41.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.605+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7ff0d00adae0 con 0x7ff0d00cc900 2024-09-17T05:25:41.606 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:25:41.605+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:25:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.607+0000 7ff0c67fc640 1 -- 172.21.15.81:0/191552514 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v86) ==== 161+0+0 (secure 0 0 0) 0x7ff0c0084040 con 0x7ff0d00cc900 2024-09-17T05:25:41.608 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff0b4079400 msgr2=0x7ff0b407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff0b4079400 0x7ff0b407b8c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc00b9a0 tx=0x7ff0cc005c20 comp rx=0 tx=0).stop 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc900 msgr2=0x7ff0d015e740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc900 0x7ff0d015e740 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7ff0c0009920 tx=0x7ff0c0032d50 comp rx=0 tx=0).stop 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 shutdown_connections 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff0b4079400 0x7ff0b407b8c0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0d0159680 0x7ff0d015ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0d00cc900 0x7ff0d015e740 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 --2- 172.21.15.81:0/191552514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0d00cc490 0x7ff0d01f4cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.609+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 >> 172.21.15.81:0/191552514 conn(0x7ff0d00b1690 msgr2=0x7ff0d00ceac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.610+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 shutdown_connections 2024-09-17T05:25:41.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.610+0000 7ff0d7f5d640 1 -- 172.21.15.81:0/191552514 wait complete. 2024-09-17T05:25:41.622 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:25:41.649 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:25:41.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.725+0000 7f4317ad6640 1 -- 172.21.15.81:0/152736979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42fc003a50 msgr2=0x7f42fc003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.725+0000 7f4317ad6640 1 --2- 172.21.15.81:0/152736979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42fc003a50 0x7f42fc003e70 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7f430c001690 tx=0x7f42fc005830 comp rx=0 tx=0).stop 2024-09-17T05:25:41.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.725+0000 7f4317ad6640 1 -- 172.21.15.81:0/152736979 shutdown_connections 2024-09-17T05:25:41.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.725+0000 7f4317ad6640 1 --2- 172.21.15.81:0/152736979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f42fc003a50 0x7f42fc003e70 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.725+0000 7f4317ad6640 1 -- 172.21.15.81:0/152736979 >> 172.21.15.81:0/152736979 conn(0x7f43100d3e30 msgr2=0x7f43100d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:41.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.725+0000 7f4317ad6640 1 -- 172.21.15.81:0/152736979 shutdown_connections 2024-09-17T05:25:41.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.725+0000 7f4317ad6640 1 -- 172.21.15.81:0/152736979 wait complete. 2024-09-17T05:25:41.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.726+0000 7f4317ad6640 1 Processor -- start 2024-09-17T05:25:41.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.726+0000 7f4317ad6640 1 -- start start 2024-09-17T05:25:41.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4317ad6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42fc003a50 0x7f431015ebf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4317ad6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43101f83b0 0x7f43101589a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4317ad6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43100b8e20 0x7f43100cd330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4317ad6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f43100d20c0 con 0x7f43101f83b0 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4317ad6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f43100d1f40 con 0x7f43100b8e20 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4317ad6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f43100d2240 con 0x7f42fc003a50 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315071640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43101f83b0 0x7f43101589a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315071640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43101f83b0 0x7f43101589a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37650/0 (socket says 172.21.15.81:37650) 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315071640 1 -- 172.21.15.81:0/3018335164 learned_addr learned my addr 172.21.15.81:0/3018335164 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4316073640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43100b8e20 0x7f43100cd330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315872640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42fc003a50 0x7f431015ebf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.730 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315071640 1 -- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42fc003a50 msgr2=0x7f431015ebf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315071640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42fc003a50 0x7f431015ebf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315071640 1 -- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43100b8e20 msgr2=0x7f43100cd330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.727+0000 7f4315071640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43100b8e20 0x7f43100cd330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f4315071640 1 -- 172.21.15.81:0/3018335164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43101f8920 con 0x7f43101f83b0 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f4316073640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43100b8e20 0x7f43100cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f4315071640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43101f83b0 0x7f43101589a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4300001a20 tx=0x7f430000ea00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f43067fc640 1 -- 172.21.15.81:0/3018335164 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300015070 con 0x7f43101f83b0 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f43067fc640 1 -- 172.21.15.81:0/3018335164 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4300010980 con 0x7f43101f83b0 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43101f8c00 con 0x7f43101f83b0 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f43067fc640 1 -- 172.21.15.81:0/3018335164 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4300010dd0 con 0x7f43101f83b0 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.728+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43101f91c0 con 0x7f43101f83b0 2024-09-17T05:25:41.731 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.729+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43100d27a0 con 0x7f43101f83b0 2024-09-17T05:25:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.729+0000 7f43067fc640 1 -- 172.21.15.81:0/3018335164 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f4300018070 con 0x7f43101f83b0 2024-09-17T05:25:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.730+0000 7f43067fc640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f42f4079430 0x7f42f407b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.730+0000 7f43067fc640 1 -- 172.21.15.81:0/3018335164 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5867+0+0 (secure 0 0 0) 0x7f4300099820 con 0x7f43101f83b0 2024-09-17T05:25:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.730+0000 7f4315872640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f42f4079430 0x7f42f407b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:41.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.731+0000 7f4315872640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f42f4079430 0x7f42f407b8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f430c032000 tx=0x7f430c02c040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:41.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.734+0000 7f43067fc640 1 -- 172.21.15.81:0/3018335164 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f43000630c0 con 0x7f43101f83b0 2024-09-17T05:25:41.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:41.950+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f43100b3570 con 0x7f43101f83b0 2024-09-17T05:25:42.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.608+0000 7f43067fc640 1 -- 172.21.15.81:0/3018335164 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v87) ==== 104+0+0 (secure 0 0 0) 0x7f4300067af0 con 0x7f43101f83b0 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f42f4079430 msgr2=0x7f42f407b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f42f4079430 0x7f42f407b8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f430c032000 tx=0x7f430c02c040 comp rx=0 tx=0).stop 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43101f83b0 msgr2=0x7f43101589a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43101f83b0 0x7f43101589a0 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4300001a20 tx=0x7f430000ea00 comp rx=0 tx=0).stop 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 shutdown_connections 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f42f4079430 0x7f42f407b8f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f43100b8e20 0x7f43100cd330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:42.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f43101f83b0 0x7f43101589a0 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 --2- 172.21.15.81:0/3018335164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f42fc003a50 0x7f431015ebf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 >> 172.21.15.81:0/3018335164 conn(0x7f43100d3e30 msgr2=0x7f43100b0a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 shutdown_connections 2024-09-17T05:25:42.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.611+0000 7f4317ad6640 1 -- 172.21.15.81:0/3018335164 wait complete. 2024-09-17T05:25:42.625 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:25:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.733+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/2551629360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 msgr2=0x7f9f90005210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.733+0000 7f9fa8dbb640 1 --2- 172.21.15.81:0/2551629360 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 0x7f9f90005210 secure :-1 s=READY pgs=1652 cs=0 l=1 rev1=1 crypto rx=0x7f9f9c00c710 tx=0x7f9f90005830 comp rx=0 tx=0).stop 2024-09-17T05:25:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.733+0000 7f9fa2d9d640 1 -- 172.21.15.81:0/2551629360 reap_dead start 2024-09-17T05:25:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.733+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/2551629360 shutdown_connections 2024-09-17T05:25:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.733+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/2551629360 >> 172.21.15.81:0/2551629360 conn(0x7f9fa40d3e20 msgr2=0x7f9fa40d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.733+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/2551629360 shutdown_connections 2024-09-17T05:25:42.734 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.733+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/2551629360 wait complete. 2024-09-17T05:25:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.734+0000 7f9fa8dbb640 1 Processor -- start 2024-09-17T05:25:42.735 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.734+0000 7f9fa8dbb640 1 -- start start 2024-09-17T05:25:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa8dbb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 0x7f9fa40ca7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa8dbb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fa40b4ac0 0x7f9fa415e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa8dbb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9fa40b8000 0x7f9fa40b8490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa8dbb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa40d4cd0 con 0x7f9f90004d90 2024-09-17T05:25:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa8dbb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9fa40d4b50 con 0x7f9fa40b4ac0 2024-09-17T05:25:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa8dbb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f9fa40b7af0 con 0x7f9fa40b8000 2024-09-17T05:25:42.737 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 0x7f9fa40ca7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 0x7f9fa40ca7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:37680/0 (socket says 172.21.15.81:37680) 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 -- 172.21.15.81:0/3045755588 learned_addr learned my addr 172.21.15.81:0/3045755588 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 -- 172.21.15.81:0/3045755588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9fa40b8000 msgr2=0x7f9fa40b8490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9fa40b8000 0x7f9fa40b8490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 -- 172.21.15.81:0/3045755588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fa40b4ac0 msgr2=0x7f9fa415e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fa40b4ac0 0x7f9fa415e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 -- 172.21.15.81:0/3045755588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fa41f7cd0 con 0x7f9f90004d90 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.735+0000 7f9fa259c640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 0x7f9fa40ca7d0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f9f94010b40 tx=0x7f9f9400e2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.736+0000 7f9f9affd640 1 -- 172.21.15.81:0/3045755588 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94012450 con 0x7f9f90004d90 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.736+0000 7f9f9affd640 1 -- 172.21.15.81:0/3045755588 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9f940125f0 con 0x7f9f90004d90 2024-09-17T05:25:42.738 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.736+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fa41f7fb0 con 0x7f9f90004d90 2024-09-17T05:25:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.736+0000 7f9f9affd640 1 -- 172.21.15.81:0/3045755588 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f94012a20 con 0x7f9f90004d90 2024-09-17T05:25:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.736+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fa41f8570 con 0x7f9f90004d90 2024-09-17T05:25:42.739 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.737+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9fa40cad10 con 0x7f9f90004d90 2024-09-17T05:25:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.737+0000 7f9f9affd640 1 -- 172.21.15.81:0/3045755588 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f9f9401a020 con 0x7f9f90004d90 2024-09-17T05:25:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.738+0000 7f9f9affd640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9f84079400 0x7f9f8407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.738+0000 7f9fa1d9b640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9f84079400 0x7f9f8407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.738+0000 7f9f9affd640 1 -- 172.21.15.81:0/3045755588 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(141..141 src has 1..141) ==== 5867+0+0 (secure 0 0 0) 0x7f9f9409a450 con 0x7f9f90004d90 2024-09-17T05:25:42.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.738+0000 7f9fa1d9b640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9f84079400 0x7f9f8407b8c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c001860 tx=0x7f9f8c001b90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:42.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.742+0000 7f9f9affd640 1 -- 172.21.15.81:0/3045755588 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f9fa40cad10 con 0x7f9f90004d90 2024-09-17T05:25:42.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:42.920+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9fa40b73e0 con 0x7f9f90004d90 2024-09-17T05:25:43.809 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.808+0000 7f9f9affd640 1 -- 172.21.15.81:0/3045755588 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v142) ==== 181+0+0 (secure 0 0 0) 0x7f9f940643d0 con 0x7f9f90004d90 2024-09-17T05:25:43.810 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9f84079400 msgr2=0x7f9f8407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9f84079400 0x7f9f8407b8c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f9f8c001860 tx=0x7f9f8c001b90 comp rx=0 tx=0).stop 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 msgr2=0x7f9fa40ca7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 0x7f9fa40ca7d0 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f9f94010b40 tx=0x7f9f9400e2f0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 shutdown_connections 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f9fa40b8000 0x7f9fa40b8490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f9f84079400 0x7f9f8407b8c0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f9fa40b4ac0 0x7f9fa415e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 --2- 172.21.15.81:0/3045755588 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f9f90004d90 0x7f9fa40ca7d0 unknown :-1 s=CLOSED pgs=1653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 >> 172.21.15.81:0/3045755588 conn(0x7f9fa40d3e20 msgr2=0x7f9fa406d390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:43.814 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.812+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 shutdown_connections 2024-09-17T05:25:43.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.813+0000 7f9fa8dbb640 1 -- 172.21.15.81:0/3045755588 wait complete. 2024-09-17T05:25:43.828 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:25:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 -- 172.21.15.81:0/2775176017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 msgr2=0x7f7cd00ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 --2- 172.21.15.81:0/2775176017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00ce1b0 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f7cc8005fd0 tx=0x7f7cc802a810 comp rx=0 tx=0).stop 2024-09-17T05:25:43.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 -- 172.21.15.81:0/2775176017 shutdown_connections 2024-09-17T05:25:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 --2- 172.21.15.81:0/2775176017 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00ce1b0 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 --2- 172.21.15.81:0/2775176017 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cd0072d50 0x7f7cd006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 -- 172.21.15.81:0/2775176017 >> 172.21.15.81:0/2775176017 conn(0x7f7cd00cfdf0 msgr2=0x7f7cd00d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 -- 172.21.15.81:0/2775176017 shutdown_connections 2024-09-17T05:25:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.938+0000 7f7cd493d640 1 -- 172.21.15.81:0/2775176017 wait complete. 2024-09-17T05:25:43.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.939+0000 7f7cd493d640 1 Processor -- start 2024-09-17T05:25:43.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.939+0000 7f7cd493d640 1 -- start start 2024-09-17T05:25:43.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cd493d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00acfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cd493d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cd0072d50 0x7f7cd00c56e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cd493d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cd015ac80 0x7f7cd00c5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cd493d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00cea80 con 0x7f7cd006ff50 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cd493d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7cd00ce900 con 0x7f7cd015ac80 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cd493d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7cd00cec00 con 0x7f7cd0072d50 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00acfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00acfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47450/0 (socket says 172.21.15.81:47450) 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 -- 172.21.15.81:0/4117071445 learned_addr learned my addr 172.21.15.81:0/4117071445 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7ccdd9b640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cd0072d50 0x7f7cd00c56e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cced9d640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cd015ac80 0x7f7cd00c5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:43.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 -- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cd0072d50 msgr2=0x7f7cd00c56e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cd0072d50 0x7f7cd00c56e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 -- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cd015ac80 msgr2=0x7f7cd00c5c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cd015ac80 0x7f7cd00c5c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.940+0000 7f7cce59c640 1 -- 172.21.15.81:0/4117071445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cd00c7200 con 0x7f7cd006ff50 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.941+0000 7f7cce59c640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00acfd0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c450 tx=0x7f7cc000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.941+0000 7f7cbeffd640 1 -- 172.21.15.81:0/4117071445 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0011790 con 0x7f7cd006ff50 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.941+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cd00c74e0 con 0x7f7cd006ff50 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.941+0000 7f7cbeffd640 1 -- 172.21.15.81:0/4117071445 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7cc0017070 con 0x7f7cd006ff50 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.941+0000 7f7cbeffd640 1 -- 172.21.15.81:0/4117071445 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0011cc0 con 0x7f7cd006ff50 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.941+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cd00c7aa0 con 0x7f7cd006ff50 2024-09-17T05:25:43.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.942+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cd00cf140 con 0x7f7cd006ff50 2024-09-17T05:25:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.943+0000 7f7cbeffd640 1 -- 172.21.15.81:0/4117071445 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f7cc001c460 con 0x7f7cd006ff50 2024-09-17T05:25:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.943+0000 7f7cbeffd640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cb0079430 0x7f7cb007b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.943+0000 7f7cbeffd640 1 -- 172.21.15.81:0/4117071445 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(142..142 src has 1..142) ==== 5429+0+0 (secure 0 0 0) 0x7f7cc0099370 con 0x7f7cd006ff50 2024-09-17T05:25:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.943+0000 7f7ccdd9b640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cb0079430 0x7f7cb007b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:43.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.944+0000 7f7ccdd9b640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cb0079430 0x7f7cb007b8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00b5ef0 tx=0x7f7cc4008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:43.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:43.948+0000 7f7cbeffd640 1 -- 172.21.15.81:0/4117071445 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7cd00749a0 con 0x7f7cd006ff50 2024-09-17T05:25:44.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.125+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f7cd0074bc0 con 0x7f7cd006ff50 2024-09-17T05:25:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.814+0000 7f7cbeffd640 1 -- 172.21.15.81:0/4117071445 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v143) ==== 169+0+0 (secure 0 0 0) 0x7f7cc0063270 con 0x7f7cd006ff50 2024-09-17T05:25:44.815 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.817+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cb0079430 msgr2=0x7f7cb007b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.817+0000 7f7cd493d640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cb0079430 0x7f7cb007b8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f7cd00b5ef0 tx=0x7f7cc4008040 comp rx=0 tx=0).stop 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.817+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 msgr2=0x7f7cd00acfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.817+0000 7f7cd493d640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00acfd0 secure :-1 s=READY pgs=1656 cs=0 l=1 rev1=1 crypto rx=0x7f7cc000c450 tx=0x7f7cc000c910 comp rx=0 tx=0).stop 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.818+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 shutdown_connections 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.818+0000 7f7cd493d640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7cb0079430 0x7f7cb007b8f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.818+0000 7f7cd493d640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7cd015ac80 0x7f7cd00c5c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.818+0000 7f7cd493d640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7cd0072d50 0x7f7cd00c56e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.818+0000 7f7cd493d640 1 --2- 172.21.15.81:0/4117071445 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7cd006ff50 0x7f7cd00acfd0 unknown :-1 s=CLOSED pgs=1656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.818+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 >> 172.21.15.81:0/4117071445 conn(0x7f7cd00cfdf0 msgr2=0x7f7cd006d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.819+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 shutdown_connections 2024-09-17T05:25:44.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.820+0000 7f7cd493d640 1 -- 172.21.15.81:0/4117071445 wait complete. 2024-09-17T05:25:44.835 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:25:44.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 -- 172.21.15.81:0/3496195733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440b3090 msgr2=0x7ff54415f6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:44.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 --2- 172.21.15.81:0/3496195733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440b3090 0x7ff54415f6d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ff538005fd0 tx=0x7ff53802a670 comp rx=0 tx=0).stop 2024-09-17T05:25:44.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 -- 172.21.15.81:0/3496195733 shutdown_connections 2024-09-17T05:25:44.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 --2- 172.21.15.81:0/3496195733 >> v2:172.21.15.160:3300/0 conn(0x7ff5440cfce0 0x7ff5440d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 --2- 172.21.15.81:0/3496195733 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440b3090 0x7ff54415f6d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 -- 172.21.15.81:0/3496195733 >> 172.21.15.81:0/3496195733 conn(0x7ff54409aa30 msgr2=0x7ff54409ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:44.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 -- 172.21.15.81:0/3496195733 shutdown_connections 2024-09-17T05:25:44.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.938+0000 7ff5493f8640 1 -- 172.21.15.81:0/3496195733 wait complete. 2024-09-17T05:25:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 Processor -- start 2024-09-17T05:25:44.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 -- start start 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5440b3090 0x7ff5440c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440cfce0 0x7ff5440b7180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5440d2410 0x7ff5441f2c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff5440b13c0 con 0x7ff5440d2410 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff5440b1240 con 0x7ff5440b3090 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5493f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff5440b1540 con 0x7ff5440cfce0 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5440d2410 0x7ff5441f2c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5437fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5440d2410 0x7ff5441f2c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47458/0 (socket says 172.21.15.81:47458) 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff5437fe640 1 -- 172.21.15.81:0/2129348252 learned_addr learned my addr 172.21.15.81:0/2129348252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:44.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.940+0000 7ff542ffd640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5440b3090 0x7ff5440c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5427fc640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440cfce0 0x7ff5440b7180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5437fe640 1 -- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440cfce0 msgr2=0x7ff5440b7180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5437fe640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440cfce0 0x7ff5440b7180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5437fe640 1 -- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5440b3090 msgr2=0x7ff5440c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5437fe640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5440b3090 0x7ff5440c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5437fe640 1 -- 172.21.15.81:0/2129348252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5440c5e80 con 0x7ff5440d2410 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5437fe640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5440d2410 0x7ff5441f2c40 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00efd0 tx=0x7ff53c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff52b7fe640 1 -- 172.21.15.81:0/2129348252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c003b70 con 0x7ff5440d2410 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff52b7fe640 1 -- 172.21.15.81:0/2129348252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff53c003e00 con 0x7ff5440d2410 2024-09-17T05:25:44.945 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5440c6160 con 0x7ff5440d2410 2024-09-17T05:25:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff52b7fe640 1 -- 172.21.15.81:0/2129348252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff53c004280 con 0x7ff5440d2410 2024-09-17T05:25:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.941+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5441f2410 con 0x7ff5440d2410 2024-09-17T05:25:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.942+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5440b19d0 con 0x7ff5440d2410 2024-09-17T05:25:44.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.943+0000 7ff52b7fe640 1 -- 172.21.15.81:0/2129348252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7ff53c004420 con 0x7ff5440d2410 2024-09-17T05:25:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.943+0000 7ff52b7fe640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff530079400 0x7ff53007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.943+0000 7ff52b7fe640 1 -- 172.21.15.81:0/2129348252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7ff53c09a280 con 0x7ff5440d2410 2024-09-17T05:25:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.943+0000 7ff542ffd640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff530079400 0x7ff53007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:44.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.944+0000 7ff542ffd640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff530079400 0x7ff53007b8c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff54415f0f0 tx=0x7ff534009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:44.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:44.947+0000 7ff52b7fe640 1 -- 172.21.15.81:0/2129348252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff53c063bb0 con 0x7ff5440d2410 2024-09-17T05:25:45.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.129+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7ff5440d29a0 con 0x7ff5440d2410 2024-09-17T05:25:45.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.132+0000 7ff52b7fe640 1 -- 172.21.15.81:0/2129348252 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v45) ==== 71+0+0 (secure 0 0 0) 0x7ff53c0685e0 con 0x7ff5440d2410 2024-09-17T05:25:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff530079400 msgr2=0x7ff53007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff530079400 0x7ff53007b8c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7ff54415f0f0 tx=0x7ff534009040 comp rx=0 tx=0).stop 2024-09-17T05:25:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5440d2410 msgr2=0x7ff5441f2c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5440d2410 0x7ff5441f2c40 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7ff53c00efd0 tx=0x7ff53c00c6a0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 shutdown_connections 2024-09-17T05:25:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff5440d2410 0x7ff5441f2c40 unknown :-1 s=CLOSED pgs=1657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff5440cfce0 0x7ff5440b7180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff530079400 0x7ff53007b8c0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 --2- 172.21.15.81:0/2129348252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff5440b3090 0x7ff5440c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 >> 172.21.15.81:0/2129348252 conn(0x7ff54409aa30 msgr2=0x7ff54415d1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 shutdown_connections 2024-09-17T05:25:45.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.135+0000 7ff5493f8640 1 -- 172.21.15.81:0/2129348252 wait complete. 2024-09-17T05:25:45.147 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1' 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 -- 172.21.15.81:0/2627273983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 msgr2=0x7f525c0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 --2- 172.21.15.81:0/2627273983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c0b4690 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f525c06ee40 tx=0x7f524c02a560 comp rx=0 tx=0).stop 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 -- 172.21.15.81:0/2627273983 shutdown_connections 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 --2- 172.21.15.81:0/2627273983 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f525c06ff80 0x7f525c070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 --2- 172.21.15.81:0/2627273983 >> v2:172.21.15.160:3300/0 conn(0x7f525c0735a0 0x7f525c0739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 --2- 172.21.15.81:0/2627273983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c0b4690 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 -- 172.21.15.81:0/2627273983 >> 172.21.15.81:0/2627273983 conn(0x7f525c0b1690 msgr2=0x7f525c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 -- 172.21.15.81:0/2627273983 shutdown_connections 2024-09-17T05:25:45.248 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.246+0000 7f5262408640 1 -- 172.21.15.81:0/2627273983 wait complete. 2024-09-17T05:25:45.250 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.247+0000 7f5262408640 1 Processor -- start 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.248+0000 7f5262408640 1 -- start start 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.248+0000 7f5262408640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f525c06ff80 0x7f525c143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.248+0000 7f5262408640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c0735a0 0x7f525c1e60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.248+0000 7f5262408640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c144a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.248+0000 7f5262408640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0cd060 con 0x7f525c15aa70 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.248+0000 7f5262408640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f525c0ccee0 con 0x7f525c0735a0 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.248+0000 7f5262408640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f525c0cd1e0 con 0x7f525c06ff80 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c144a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c144a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47476/0 (socket says 172.21.15.81:47476) 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 -- 172.21.15.81:0/1398383406 learned_addr learned my addr 172.21.15.81:0/1398383406 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:45.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f525bfff640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f525c06ff80 0x7f525c143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f525b7fe640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c0735a0 0x7f525c1e60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 -- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f525c06ff80 msgr2=0x7f525c143320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f525c06ff80 0x7f525c143320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 -- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c0735a0 msgr2=0x7f525c1e60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c0735a0 0x7f525c1e60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 -- 172.21.15.81:0/1398383406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f525c1439e0 con 0x7f525c15aa70 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f52609a5640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c144a80 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f525400b970 tx=0x7f525400bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f5258ff9640 1 -- 172.21.15.81:0/1398383406 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254019070 con 0x7f525c15aa70 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f5258ff9640 1 -- 172.21.15.81:0/1398383406 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f525400cb50 con 0x7f525c15aa70 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f5258ff9640 1 -- 172.21.15.81:0/1398383406 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5254014440 con 0x7f525c15aa70 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f525c143cc0 con 0x7f525c15aa70 2024-09-17T05:25:45.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.249+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f525c144280 con 0x7f525c15aa70 2024-09-17T05:25:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.250+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f525c0739d0 con 0x7f525c15aa70 2024-09-17T05:25:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.251+0000 7f5258ff9640 1 -- 172.21.15.81:0/1398383406 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f525401c070 con 0x7f525c15aa70 2024-09-17T05:25:45.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.251+0000 7f5258ff9640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5248079400 0x7f524807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.252+0000 7f525bfff640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5248079400 0x7f524807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.252+0000 7f5258ff9640 1 -- 172.21.15.81:0/1398383406 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7f52540990e0 con 0x7f525c15aa70 2024-09-17T05:25:45.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.252+0000 7f525bfff640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5248079400 0x7f524807b8c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f524c033000 tx=0x7f524c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:45.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.256+0000 7f5258ff9640 1 -- 172.21.15.81:0/1398383406 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5254062a10 con 0x7f525c15aa70 2024-09-17T05:25:45.501 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.500+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]} v 0) -- 0x7f525c0b1a70 con 0x7f525c15aa70 2024-09-17T05:25:45.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.815+0000 7f5258ff9640 1 -- 172.21.15.81:0/1398383406 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_legacy_to_v1"]}]=0 v387) ==== 149+0+0 (secure 0 0 0) 0x7f5254067440 con 0x7f525c15aa70 2024-09-17T05:25:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5248079400 msgr2=0x7f524807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5248079400 0x7f524807b8c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f524c033000 tx=0x7f524c004730 comp rx=0 tx=0).stop 2024-09-17T05:25:45.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 msgr2=0x7f525c144a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c144a80 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7f525400b970 tx=0x7f525400bd70 comp rx=0 tx=0).stop 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 shutdown_connections 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f525c15aa70 0x7f525c144a80 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5248079400 0x7f524807b8c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f525c0735a0 0x7f525c1e60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 --2- 172.21.15.81:0/1398383406 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f525c06ff80 0x7f525c143320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 >> 172.21.15.81:0/1398383406 conn(0x7f525c0b1690 msgr2=0x7f525c15c870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 shutdown_connections 2024-09-17T05:25:45.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.817+0000 7f5262408640 1 -- 172.21.15.81:0/1398383406 wait complete. 2024-09-17T05:25:45.830 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- rather than going through a full upgrade cycle, ... ok 2024-09-17T05:25:45.830 INFO:tasks.cephfs_test_runner:Starting test: test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) poor man's upgrade test -- theme continues... 2024-09-17T05:25:45.830 INFO:tasks.cephfs_test_runner:test_subvolume_upgrade_v1_to_v2 (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:25:45.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:45.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.931+0000 7f7855510640 1 -- 172.21.15.81:0/772599922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 msgr2=0x7f7838004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.931+0000 7f7855510640 1 --2- 172.21.15.81:0/772599922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f7838004c80 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f784400c260 tx=0x7f7838005830 comp rx=0 tx=0).stop 2024-09-17T05:25:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.931+0000 7f7855510640 1 -- 172.21.15.81:0/772599922 shutdown_connections 2024-09-17T05:25:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.931+0000 7f7855510640 1 --2- 172.21.15.81:0/772599922 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f7838004c80 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.931+0000 7f7855510640 1 -- 172.21.15.81:0/772599922 >> 172.21.15.81:0/772599922 conn(0x7f78500d1c40 msgr2=0x7f78500d2050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.931+0000 7f7855510640 1 -- 172.21.15.81:0/772599922 shutdown_connections 2024-09-17T05:25:45.933 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.931+0000 7f7855510640 1 -- 172.21.15.81:0/772599922 wait complete. 2024-09-17T05:25:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 Processor -- start 2024-09-17T05:25:45.934 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 -- start start 2024-09-17T05:25:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f78500b65f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7850151a60 0x7f78500b4a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78500b4fb0 0x7f78500b5430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78500cf590 con 0x7f7838004800 2024-09-17T05:25:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f78500cf410 con 0x7f78500b4fb0 2024-09-17T05:25:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f7855510640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f78500ce630 con 0x7f7850151a60 2024-09-17T05:25:45.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.933+0000 7f784effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f78500b65f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f78500b65f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47496/0 (socket says 172.21.15.81:47496) 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 -- 172.21.15.81:0/3297599053 learned_addr learned my addr 172.21.15.81:0/3297599053 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784f7fe640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78500b4fb0 0x7f78500b5430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784e7fc640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7850151a60 0x7f78500b4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 -- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7850151a60 msgr2=0x7f78500b4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7850151a60 0x7f78500b4a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 -- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78500b4fb0 msgr2=0x7f78500b5430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78500b4fb0 0x7f78500b5430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 -- 172.21.15.81:0/3297599053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7850152550 con 0x7f7838004800 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f784effd640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f78500b65f0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f78400018c0 tx=0x7f7840001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:45.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f78377fe640 1 -- 172.21.15.81:0/3297599053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7840015070 con 0x7f7838004800 2024-09-17T05:25:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f78377fe640 1 -- 172.21.15.81:0/3297599053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f784000ebd0 con 0x7f7838004800 2024-09-17T05:25:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78500c5770 con 0x7f7838004800 2024-09-17T05:25:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f78377fe640 1 -- 172.21.15.81:0/3297599053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78400020c0 con 0x7f7838004800 2024-09-17T05:25:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.934+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78500c5a10 con 0x7f7838004800 2024-09-17T05:25:45.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.935+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78500ceb30 con 0x7f7838004800 2024-09-17T05:25:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.936+0000 7f78377fe640 1 -- 172.21.15.81:0/3297599053 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f7840018070 con 0x7f7838004800 2024-09-17T05:25:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.936+0000 7f78377fe640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f783c079430 0x7f783c07b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.936+0000 7f78377fe640 1 -- 172.21.15.81:0/3297599053 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7f7840099e00 con 0x7f7838004800 2024-09-17T05:25:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.936+0000 7f784e7fc640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f783c079430 0x7f783c07b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:45.939 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.937+0000 7f784e7fc640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f783c079430 0x7f783c07b8f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7844033000 tx=0x7f7844000fe0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:45.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:45.940+0000 7f78377fe640 1 -- 172.21.15.81:0/3297599053 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7850152550 con 0x7f7838004800 2024-09-17T05:25:45.995 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:25:45.998 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:25:46.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.122+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f78500cf1f0 con 0x7f7838004800 2024-09-17T05:25:46.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.122+0000 7f78377fe640 1 -- 172.21.15.81:0/3297599053 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v143) ==== 74+0+13156 (secure 0 0 0) 0x7f7840063d00 con 0x7f7838004800 2024-09-17T05:25:46.123 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:46.123 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":143,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:44.810253+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":138,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6801/2976390052":"2024-09-18T05:25:41.606614+0000","172.21.15.160:6800/2976390052":"2024-09-18T05:25:41.606614+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f783c079430 msgr2=0x7f783c07b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f783c079430 0x7f783c07b8f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f7844033000 tx=0x7f7844000fe0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 msgr2=0x7f78500b65f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f78500b65f0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f78400018c0 tx=0x7f7840001d80 comp rx=0 tx=0).stop 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 shutdown_connections 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f783c079430 0x7f783c07b8f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f78500b4fb0 0x7f78500b5430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7850151a60 0x7f78500b4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 --2- 172.21.15.81:0/3297599053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7838004800 0x7f78500b65f0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.124+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 >> 172.21.15.81:0/3297599053 conn(0x7f78500d1c40 msgr2=0x7f7850152920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.125+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 shutdown_connections 2024-09-17T05:25:46.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.125+0000 7f7855510640 1 -- 172.21.15.81:0/3297599053 wait complete. 2024-09-17T05:25:46.137 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:25:46.137 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:25:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.280+0000 7f2c68272640 1 -- 172.21.15.81:0/720584181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4c003a30 msgr2=0x7f2c4c003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.280+0000 7f2c68272640 1 --2- 172.21.15.81:0/720584181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c4c003a30 0x7f2c4c003e50 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c009b50 tx=0x7f2c4c005830 comp rx=0 tx=0).stop 2024-09-17T05:25:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.280+0000 7f2c6680f640 1 -- 172.21.15.81:0/720584181 reap_dead start 2024-09-17T05:25:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.280+0000 7f2c68272640 1 -- 172.21.15.81:0/720584181 shutdown_connections 2024-09-17T05:25:46.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.280+0000 7f2c68272640 1 -- 172.21.15.81:0/720584181 >> 172.21.15.81:0/720584181 conn(0x7f2c600d0bb0 msgr2=0x7f2c600d0fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.280+0000 7f2c68272640 1 -- 172.21.15.81:0/720584181 shutdown_connections 2024-09-17T05:25:46.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.280+0000 7f2c68272640 1 -- 172.21.15.81:0/720584181 wait complete. 2024-09-17T05:25:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.281+0000 7f2c68272640 1 Processor -- start 2024-09-17T05:25:46.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.281+0000 7f2c68272640 1 -- start start 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c4c003a30 0x7f2c6014c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6014f600 0x7f2c6014b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c6006cb40 0x7f2c6006cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2c6015efa0 con 0x7f2c6006cb40 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2c600cfae0 con 0x7f2c6014f600 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2c6015f120 con 0x7f2c4c003a30 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c6006cb40 0x7f2c6006cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c6006cb40 0x7f2c6006cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47506/0 (socket says 172.21.15.81:47506) 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 -- 172.21.15.81:0/3740784442 learned_addr learned my addr 172.21.15.81:0/3740784442 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:46.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6600e640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c4c003a30 0x7f2c6014c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 -- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c4c003a30 msgr2=0x7f2c6014c2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6580d640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6014f600 0x7f2c6014b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c4c003a30 0x7f2c6014c2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 -- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6014f600 msgr2=0x7f2c6014b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6014f600 0x7f2c6014b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 -- 172.21.15.81:0/3740784442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c601f5e50 con 0x7f2c6006cb40 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6600e640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c4c003a30 0x7f2c6014c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c6680f640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c6006cb40 0x7f2c6006cfc0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2c58000f80 tx=0x7f2c5800dd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c56ffd640 1 -- 172.21.15.81:0/3740784442 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c58003d80 con 0x7f2c6006cb40 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c56ffd640 1 -- 172.21.15.81:0/3740784442 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2c5800b800 con 0x7f2c6006cb40 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c601f6130 con 0x7f2c6006cb40 2024-09-17T05:25:46.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c56ffd640 1 -- 172.21.15.81:0/3740784442 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c5800bc30 con 0x7f2c6006cb40 2024-09-17T05:25:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.282+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c601f66f0 con 0x7f2c6006cb40 2024-09-17T05:25:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.283+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c6015afa0 con 0x7f2c6006cb40 2024-09-17T05:25:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.284+0000 7f2c56ffd640 1 -- 172.21.15.81:0/3740784442 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f2c58006070 con 0x7f2c6006cb40 2024-09-17T05:25:46.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.284+0000 7f2c56ffd640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2c44079400 0x7f2c4407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.285+0000 7f2c56ffd640 1 -- 172.21.15.81:0/3740784442 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7f2c580998b0 con 0x7f2c6006cb40 2024-09-17T05:25:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.285+0000 7f2c6600e640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2c44079400 0x7f2c4407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.285+0000 7f2c6600e640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2c44079400 0x7f2c4407b8c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c035000 tx=0x7f2c5c02d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:46.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.289+0000 7f2c56ffd640 1 -- 172.21.15.81:0/3740784442 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2c58063830 con 0x7f2c6006cb40 2024-09-17T05:25:46.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.463+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2c601f68c0 con 0x7f2c6006cb40 2024-09-17T05:25:46.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.463+0000 7f2c56ffd640 1 -- 172.21.15.81:0/3740784442 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v143) ==== 93+0+10 (secure 0 0 0) 0x7f2c58063130 con 0x7f2c6006cb40 2024-09-17T05:25:46.465 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:25:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2c44079400 msgr2=0x7f2c4407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2c44079400 0x7f2c4407b8c0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f2c5c035000 tx=0x7f2c5c02d040 comp rx=0 tx=0).stop 2024-09-17T05:25:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c6006cb40 msgr2=0x7f2c6006cfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c6006cb40 0x7f2c6006cfc0 secure :-1 s=READY pgs=1665 cs=0 l=1 rev1=1 crypto rx=0x7f2c58000f80 tx=0x7f2c5800dd80 comp rx=0 tx=0).stop 2024-09-17T05:25:46.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 shutdown_connections 2024-09-17T05:25:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2c6006cb40 0x7f2c6006cfc0 unknown :-1 s=CLOSED pgs=1665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2c44079400 0x7f2c4407b8c0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2c6014f600 0x7f2c6014b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 --2- 172.21.15.81:0/3740784442 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2c4c003a30 0x7f2c6014c2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 >> 172.21.15.81:0/3740784442 conn(0x7f2c600d0bb0 msgr2=0x7f2c600732a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 shutdown_connections 2024-09-17T05:25:46.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.466+0000 7f2c68272640 1 -- 172.21.15.81:0/3740784442 wait complete. 2024-09-17T05:25:46.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-17T05:25:46.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.577+0000 7f719e594640 1 -- 172.21.15.81:0/1094253701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7184003a00 msgr2=0x7f7184003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.577+0000 7f719e594640 1 --2- 172.21.15.81:0/1094253701 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7184003a00 0x7f7184003e20 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f7188009b50 tx=0x7f7184005830 comp rx=0 tx=0).stop 2024-09-17T05:25:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.577+0000 7f719cb31640 1 -- 172.21.15.81:0/1094253701 reap_dead start 2024-09-17T05:25:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.577+0000 7f719e594640 1 -- 172.21.15.81:0/1094253701 shutdown_connections 2024-09-17T05:25:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.577+0000 7f719e594640 1 -- 172.21.15.81:0/1094253701 >> 172.21.15.81:0/1094253701 conn(0x7f71980b1690 msgr2=0x7f71980b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.577+0000 7f719e594640 1 -- 172.21.15.81:0/1094253701 shutdown_connections 2024-09-17T05:25:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.577+0000 7f719e594640 1 -- 172.21.15.81:0/1094253701 wait complete. 2024-09-17T05:25:46.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.578+0000 7f719e594640 1 Processor -- start 2024-09-17T05:25:46.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719e594640 1 -- start start 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719e594640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7184003a00 0x7f7198150720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719e594640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71980b44a0 0x7f71981f4330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719e594640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71981f4870 0x7f71981f4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719e594640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f71980cca80 con 0x7f71981f4870 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719e594640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f71980cc900 con 0x7f71980b44a0 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719e594640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f71980ccc00 con 0x7f7184003a00 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719cb31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71981f4870 0x7f71981f4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719cb31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71981f4870 0x7f71981f4cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47526/0 (socket says 172.21.15.81:47526) 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f719cb31640 1 -- 172.21.15.81:0/243113217 learned_addr learned my addr 172.21.15.81:0/243113217 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:46.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f7197fff640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7184003a00 0x7f7198150720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.579+0000 7f71977fe640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71980b44a0 0x7f71981f4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719cb31640 1 -- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7184003a00 msgr2=0x7f7198150720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719cb31640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7184003a00 0x7f7198150720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719cb31640 1 -- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71980b44a0 msgr2=0x7f71981f4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719cb31640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71980b44a0 0x7f71981f4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719cb31640 1 -- 172.21.15.81:0/243113217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7198150da0 con 0x7f71981f4870 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719cb31640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71981f4870 0x7f71981f4cf0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f7198070a80 tx=0x7f7190010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f7194ff9640 1 -- 172.21.15.81:0/243113217 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f719000ee70 con 0x7f71981f4870 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f7194ff9640 1 -- 172.21.15.81:0/243113217 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7190015070 con 0x7f71981f4870 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7198151080 con 0x7f71981f4870 2024-09-17T05:25:46.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f7194ff9640 1 -- 172.21.15.81:0/243113217 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7190003d20 con 0x7f71981f4870 2024-09-17T05:25:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.580+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7198151640 con 0x7f71981f4870 2024-09-17T05:25:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.581+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f719815d270 con 0x7f71981f4870 2024-09-17T05:25:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.582+0000 7f7194ff9640 1 -- 172.21.15.81:0/243113217 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f7190004030 con 0x7f71981f4870 2024-09-17T05:25:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.582+0000 7f7194ff9640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7178079430 0x7f717807b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:46.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.582+0000 7f7194ff9640 1 -- 172.21.15.81:0/243113217 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7f7190099ee0 con 0x7f71981f4870 2024-09-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.582+0000 7f7197fff640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7178079430 0x7f717807b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:46.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.583+0000 7f7197fff640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7178079430 0x7f717807b8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7188035000 tx=0x7f718802d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:46.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.586+0000 7f7194ff9640 1 -- 172.21.15.81:0/243113217 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7190063810 con 0x7f71981f4870 2024-09-17T05:25:46.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:46.833+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7f71980b1260 con 0x7f71981f4870 2024-09-17T05:25:47.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.822+0000 7f7194ff9640 1 -- 172.21.15.81:0/243113217 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v389) ==== 148+0+0 (secure 0 0 0) 0x7f7190068240 con 0x7f71981f4870 2024-09-17T05:25:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7178079430 msgr2=0x7f717807b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:47.826 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7178079430 0x7f717807b8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f7188035000 tx=0x7f718802d040 comp rx=0 tx=0).stop 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71981f4870 msgr2=0x7f71981f4cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71981f4870 0x7f71981f4cf0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7f7198070a80 tx=0x7f7190010f40 comp rx=0 tx=0).stop 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 shutdown_connections 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f71981f4870 0x7f71981f4cf0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7178079430 0x7f717807b8f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f71980b44a0 0x7f71981f4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 --2- 172.21.15.81:0/243113217 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7184003a00 0x7f7198150720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 >> 172.21.15.81:0/243113217 conn(0x7f71980b1690 msgr2=0x7f71980cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 shutdown_connections 2024-09-17T05:25:47.827 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.825+0000 7f719e594640 1 -- 172.21.15.81:0/243113217 wait complete. 2024-09-17T05:25:47.840 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:25:47.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.946+0000 7fca7d7f3640 1 -- 172.21.15.81:0/3375637983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca64004d40 msgr2=0x7fca640051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:47.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.946+0000 7fca7d7f3640 1 --2- 172.21.15.81:0/3375637983 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca64004d40 0x7fca640051c0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7fca70009ed0 tx=0x7fca64005830 comp rx=0 tx=0).stop 2024-09-17T05:25:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.946+0000 7fca777fe640 1 -- 172.21.15.81:0/3375637983 reap_dead start 2024-09-17T05:25:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.946+0000 7fca7d7f3640 1 -- 172.21.15.81:0/3375637983 shutdown_connections 2024-09-17T05:25:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.946+0000 7fca7d7f3640 1 -- 172.21.15.81:0/3375637983 >> 172.21.15.81:0/3375637983 conn(0x7fca780d3e40 msgr2=0x7fca780d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.946+0000 7fca7d7f3640 1 -- 172.21.15.81:0/3375637983 shutdown_connections 2024-09-17T05:25:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.946+0000 7fca7d7f3640 1 -- 172.21.15.81:0/3375637983 wait complete. 2024-09-17T05:25:47.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.947+0000 7fca7d7f3640 1 Processor -- start 2024-09-17T05:25:47.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.947+0000 7fca7d7f3640 1 -- start start 2024-09-17T05:25:47.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca7d7f3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca64004d40 0x7fca781f53f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:47.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca7d7f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7815eeb0 0x7fca781f7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca7d7f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca781f5a80 0x7fca780cd4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca7d7f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fca780d2ae0 con 0x7fca7815eeb0 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca7d7f3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fca780cf9e0 con 0x7fca781f5a80 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca7d7f3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fca78161720 con 0x7fca64004d40 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca6e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7815eeb0 0x7fca781f7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca6e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7815eeb0 0x7fca781f7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47544/0 (socket says 172.21.15.81:47544) 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca6e7fc640 1 -- 172.21.15.81:0/1532582885 learned_addr learned my addr 172.21.15.81:0/1532582885 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca76ffd640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca64004d40 0x7fca781f53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.948+0000 7fca777fe640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca781f5a80 0x7fca780cd4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:47.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6e7fc640 1 -- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca64004d40 msgr2=0x7fca781f53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6e7fc640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca64004d40 0x7fca781f53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6e7fc640 1 -- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca781f5a80 msgr2=0x7fca780cd4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6e7fc640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca781f5a80 0x7fca780cd4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6e7fc640 1 -- 172.21.15.81:0/1532582885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca780cc440 con 0x7fca7815eeb0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6e7fc640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7815eeb0 0x7fca781f7690 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fca60011820 tx=0x7fca60011ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6ffff640 1 -- 172.21.15.81:0/1532582885 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6001f070 con 0x7fca7815eeb0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6ffff640 1 -- 172.21.15.81:0/1532582885 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fca6000fe40 con 0x7fca7815eeb0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca780cc720 con 0x7fca7815eeb0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca6ffff640 1 -- 172.21.15.81:0/1532582885 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca600126b0 con 0x7fca7815eeb0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.949+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca780ccce0 con 0x7fca7815eeb0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.950+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca780d05f0 con 0x7fca7815eeb0 2024-09-17T05:25:47.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.951+0000 7fca6ffff640 1 -- 172.21.15.81:0/1532582885 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fca60022070 con 0x7fca7815eeb0 2024-09-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.951+0000 7fca6ffff640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fca58079400 0x7fca5807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.951+0000 7fca6ffff640 1 -- 172.21.15.81:0/1532582885 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7fca60099ee0 con 0x7fca7815eeb0 2024-09-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.951+0000 7fca76ffd640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fca58079400 0x7fca5807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:47.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.952+0000 7fca76ffd640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fca58079400 0x7fca5807b8c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca68001d50 tx=0x7fca68006040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:47.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:47.956+0000 7fca6ffff640 1 -- 172.21.15.81:0/1532582885 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fca60063810 con 0x7fca7815eeb0 2024-09-17T05:25:48.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.133+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fca780d13f0 con 0x7fca7815eeb0 2024-09-17T05:25:48.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.134+0000 7fca6ffff640 1 -- 172.21.15.81:0/1532582885 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v45) ==== 59+0+1998 (secure 0 0 0) 0x7fca60068240 con 0x7fca7815eeb0 2024-09-17T05:25:48.135 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:25:48.135 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:25:48.135 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:25:48.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:25:48.135 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:25:48.136 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:25:48.137 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fca58079400 msgr2=0x7fca5807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fca58079400 0x7fca5807b8c0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fca68001d50 tx=0x7fca68006040 comp rx=0 tx=0).stop 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7815eeb0 msgr2=0x7fca781f7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7815eeb0 0x7fca781f7690 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7fca60011820 tx=0x7fca60011ce0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 shutdown_connections 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fca58079400 0x7fca5807b8c0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fca781f5a80 0x7fca780cd4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fca7815eeb0 0x7fca781f7690 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 --2- 172.21.15.81:0/1532582885 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fca64004d40 0x7fca781f53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 >> 172.21.15.81:0/1532582885 conn(0x7fca780d3e40 msgr2=0x7fca780b6c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 shutdown_connections 2024-09-17T05:25:48.139 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.136+0000 7fca7d7f3640 1 -- 172.21.15.81:0/1532582885 wait complete. 2024-09-17T05:25:48.148 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 -- 172.21.15.81:0/1345046459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c15b380 msgr2=0x7fd80c072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 --2- 172.21.15.81:0/1345046459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c15b380 0x7fd80c072b50 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd808005fd0 tx=0x7fd80802a5d0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 -- 172.21.15.81:0/1345046459 shutdown_connections 2024-09-17T05:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 --2- 172.21.15.81:0/1345046459 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80c0ce120 0x7fd80c0cabc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 --2- 172.21.15.81:0/1345046459 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c15b380 0x7fd80c072b50 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 -- 172.21.15.81:0/1345046459 >> 172.21.15.81:0/1345046459 conn(0x7fd80c0b1700 msgr2=0x7fd80c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 -- 172.21.15.81:0/1345046459 shutdown_connections 2024-09-17T05:25:48.253 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.251+0000 7fd813a08640 1 -- 172.21.15.81:0/1345046459 wait complete. 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.252+0000 7fd813a08640 1 Processor -- start 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.252+0000 7fd813a08640 1 -- start start 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.252+0000 7fd813a08640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c073090 0x7fd80c14c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd813a08640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c0ce120 0x7fd80c14aca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd813a08640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80c15b380 0x7fd80c0b3f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd813a08640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c0cc8e0 con 0x7fd80c073090 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd813a08640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd80c0cc760 con 0x7fd80c0ce120 2024-09-17T05:25:48.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd813a08640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd80c0cca60 con 0x7fd80c15b380 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c073090 0x7fd80c14c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c073090 0x7fd80c14c920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47546/0 (socket says 172.21.15.81:47546) 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 -- 172.21.15.81:0/3143766451 learned_addr learned my addr 172.21.15.81:0/3143766451 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd810fa3640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c0ce120 0x7fd80c14aca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd811fa5640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80c15b380 0x7fd80c0b3f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 -- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80c15b380 msgr2=0x7fd80c0b3f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80c15b380 0x7fd80c0b3f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 -- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c0ce120 msgr2=0x7fd80c14aca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c0ce120 0x7fd80c14aca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 -- 172.21.15.81:0/3143766451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd80c14c360 con 0x7fd80c073090 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd810fa3640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c0ce120 0x7fd80c14aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:48.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd811fa5640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80c15b380 0x7fd80c0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd8117a4640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c073090 0x7fd80c14c920 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd808034040 tx=0x7fd8080035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd801ffb640 1 -- 172.21.15.81:0/3143766451 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80803e030 con 0x7fd80c073090 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd801ffb640 1 -- 172.21.15.81:0/3143766451 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd808003ae0 con 0x7fd80c073090 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd80c14c640 con 0x7fd80c073090 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.253+0000 7fd801ffb640 1 -- 172.21.15.81:0/3143766451 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd808035040 con 0x7fd80c073090 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.254+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd80c14b1e0 con 0x7fd80c073090 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.255+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd80c0cabc0 con 0x7fd80c073090 2024-09-17T05:25:48.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.255+0000 7fd801ffb640 1 -- 172.21.15.81:0/3143766451 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fd808041030 con 0x7fd80c073090 2024-09-17T05:25:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.256+0000 7fd801ffb640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7f0079400 0x7fd7f007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.256+0000 7fd810fa3640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7f0079400 0x7fd7f007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.256+0000 7fd801ffb640 1 -- 172.21.15.81:0/3143766451 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7fd8080b9930 con 0x7fd80c073090 2024-09-17T05:25:48.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.256+0000 7fd810fa3640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7f0079400 0x7fd7f007b8c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd80c14ce60 tx=0x7fd7fc009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:48.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.260+0000 7fd801ffb640 1 -- 172.21.15.81:0/3143766451 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd8080838b0 con 0x7fd80c073090 2024-09-17T05:25:48.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.435+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fd80c0b1fb0 con 0x7fd80c073090 2024-09-17T05:25:48.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.438+0000 7fd801ffb640 1 -- 172.21.15.81:0/3143766451 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7fd808088e20 con 0x7fd80c073090 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7f0079400 msgr2=0x7fd7f007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7f0079400 0x7fd7f007b8c0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fd80c14ce60 tx=0x7fd7fc009040 comp rx=0 tx=0).stop 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c073090 msgr2=0x7fd80c14c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c073090 0x7fd80c14c920 secure :-1 s=READY pgs=1672 cs=0 l=1 rev1=1 crypto rx=0x7fd808034040 tx=0x7fd8080035f0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 shutdown_connections 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd80c15b380 0x7fd80c0b3f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd7f0079400 0x7fd7f007b8c0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd80c0ce120 0x7fd80c14aca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 --2- 172.21.15.81:0/3143766451 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd80c073090 0x7fd80c14c920 unknown :-1 s=CLOSED pgs=1672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.440+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 >> 172.21.15.81:0/3143766451 conn(0x7fd80c0b1700 msgr2=0x7fd80c150c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.441+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 shutdown_connections 2024-09-17T05:25:48.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.441+0000 7fd813a08640 1 -- 172.21.15.81:0/3143766451 wait complete. 2024-09-17T05:25:48.452 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:25:48.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:48.502 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:25:48.559 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:25:48.559 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:48.559 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:48.575 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:25:48.575 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:48.575 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:48.594 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:25:48.594 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:25:48.594 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:48.631 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:25:48.632 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:25:48.632 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:25:48.652 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:25:48.652 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:25:48.653 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.772+0000 7fedc1fad640 1 -- 172.21.15.81:0/1052931182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feda4004d40 msgr2=0x7feda40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.772+0000 7fedc1fad640 1 --2- 172.21.15.81:0/1052931182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feda4004d40 0x7feda40051c0 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7fedb400c670 tx=0x7feda4005830 comp rx=0 tx=0).stop 2024-09-17T05:25:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.772+0000 7fedbbfff640 1 -- 172.21.15.81:0/1052931182 reap_dead start 2024-09-17T05:25:48.773 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.772+0000 7fedc1fad640 1 -- 172.21.15.81:0/1052931182 shutdown_connections 2024-09-17T05:25:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.772+0000 7fedc1fad640 1 -- 172.21.15.81:0/1052931182 >> 172.21.15.81:0/1052931182 conn(0x7fedbc0d3e40 msgr2=0x7fedbc0d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.772+0000 7fedc1fad640 1 -- 172.21.15.81:0/1052931182 shutdown_connections 2024-09-17T05:25:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.772+0000 7fedc1fad640 1 -- 172.21.15.81:0/1052931182 wait complete. 2024-09-17T05:25:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.773+0000 7fedc1fad640 1 Processor -- start 2024-09-17T05:25:48.774 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.773+0000 7fedc1fad640 1 -- start start 2024-09-17T05:25:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedc1fad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc0c93e0 0x7fedbc0c74f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedc1fad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedbc0c97c0 0x7fedbc06e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedc1fad640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedbc06e580 0x7fedbc1f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedc1fad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc161f10 con 0x7fedbc0c93e0 2024-09-17T05:25:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedc1fad640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fedbc161920 con 0x7fedbc0c97c0 2024-09-17T05:25:48.777 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedc1fad640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fedbc162090 con 0x7fedbc06e580 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc0c93e0 0x7fedbc0c74f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc0c93e0 0x7fedbc0c74f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47566/0 (socket says 172.21.15.81:47566) 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 -- 172.21.15.81:0/1005567707 learned_addr learned my addr 172.21.15.81:0/1005567707 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbaffd640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedbc0c97c0 0x7fedbc06e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbbfff640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedbc06e580 0x7fedbc1f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 -- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedbc06e580 msgr2=0x7fedbc1f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedbc06e580 0x7fedbc1f8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 -- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedbc0c97c0 msgr2=0x7fedbc06e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.778 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedbc0c97c0 0x7fedbc06e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbb7fe640 1 -- 172.21.15.81:0/1005567707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedbc1f8e70 con 0x7fedbc0c93e0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbaffd640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedbc0c97c0 0x7fedbc06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.774+0000 7fedbbfff640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedbc06e580 0x7fedbc1f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.775+0000 7fedbb7fe640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc0c93e0 0x7fedbc0c74f0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fedac011a50 tx=0x7fedac011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.775+0000 7feda3fff640 1 -- 172.21.15.81:0/1005567707 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac01f070 con 0x7fedbc0c93e0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.775+0000 7feda3fff640 1 -- 172.21.15.81:0/1005567707 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fedac00fe80 con 0x7fedbc0c93e0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.775+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedbc1f9150 con 0x7fedbc0c93e0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.775+0000 7feda3fff640 1 -- 172.21.15.81:0/1005567707 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedac012690 con 0x7fedbc0c93e0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.775+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedbc0b86d0 con 0x7fedbc0c93e0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.776+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedbc06e990 con 0x7fedbc0c93e0 2024-09-17T05:25:48.779 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.776+0000 7feda3fff640 1 -- 172.21.15.81:0/1005567707 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fedac022070 con 0x7fedbc0c93e0 2024-09-17T05:25:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.777+0000 7feda3fff640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feda8079400 0x7feda807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.777+0000 7feda3fff640 1 -- 172.21.15.81:0/1005567707 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7fedac099fa0 con 0x7fedbc0c93e0 2024-09-17T05:25:48.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.777+0000 7fedbaffd640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feda8079400 0x7feda807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:48.781 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.777+0000 7fedbaffd640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feda8079400 0x7feda807b8c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0cd510 tx=0x7fedb0005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:48.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.781+0000 7feda3fff640 1 -- 172.21.15.81:0/1005567707 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fedbc06e990 con 0x7fedbc0c93e0 2024-09-17T05:25:48.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.992+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fedbc162410 con 0x7fedbc0c93e0 2024-09-17T05:25:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.993+0000 7feda3fff640 1 -- 172.21.15.81:0/1005567707 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 87 v87) ==== 94+0+3911 (secure 0 0 0) 0x7fedac0638d0 con 0x7fedbc0c93e0 2024-09-17T05:25:48.994 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:48.994 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":87,"btime":"2024-09-17T05:25:42:608327+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7300,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2171494728","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6834","nonce":2171494728},{"type":"v1","addr":"172.21.15.160:6835","nonce":2171494728}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81},{"gid":7537,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6801/854086514","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":854086514},{"type":"v1","addr":"172.21.15.160:6801","nonce":854086514}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":87},{"gid":8421,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/428822375","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":428822375},{"type":"v1","addr":"172.21.15.81:6834","nonce":428822375}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":80},{"gid":8424,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/4108203098","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":4108203098},{"type":"v1","addr":"172.21.15.81:6835","nonce":4108203098}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":81}],"filesystems":[]} 2024-09-17T05:25:48.994 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 87 2024-09-17T05:25:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feda8079400 msgr2=0x7feda807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feda8079400 0x7feda807b8c0 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fedbc0cd510 tx=0x7fedb0005f90 comp rx=0 tx=0).stop 2024-09-17T05:25:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc0c93e0 msgr2=0x7fedbc0c74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc0c93e0 0x7fedbc0c74f0 secure :-1 s=READY pgs=1675 cs=0 l=1 rev1=1 crypto rx=0x7fedac011a50 tx=0x7fedac011f10 comp rx=0 tx=0).stop 2024-09-17T05:25:48.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 shutdown_connections 2024-09-17T05:25:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fedbc06e580 0x7fedbc1f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feda8079400 0x7feda807b8c0 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fedbc0c97c0 0x7fedbc06e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 --2- 172.21.15.81:0/1005567707 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fedbc0c93e0 0x7fedbc0c74f0 unknown :-1 s=CLOSED pgs=1675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 >> 172.21.15.81:0/1005567707 conn(0x7fedbc0d3e40 msgr2=0x7fedbc0b26e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 shutdown_connections 2024-09-17T05:25:48.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:48.995+0000 7fedc1fad640 1 -- 172.21.15.81:0/1005567707 wait complete. 2024-09-17T05:25:49.007 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:25:49.007 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:25:49.008 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:25:49.008 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:49.008 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:25:49.008 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:25:49.008 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:25:49.008 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:49.009 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:25:49.009 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:25:49.009 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:25:49.009 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:49.009 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:25:49.009 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:25:49.010 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:25:49.010 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:25:49.016 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:25:49.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:25:49.017 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:25:49.018 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:25:49.021 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:25:49.021 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:25:49.022 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:25:49.022 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:25:49.059 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:25:49.060 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:49.061 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:25:49.061 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:49.064 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:25:49.064 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:49.065 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:25:49.065 DEBUG:teuthology.parallel:result is None 2024-09-17T05:25:49.065 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:25:49.137 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:25:49.138 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:25:49.147 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:25:49.148 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.170+0000 7f270c32b640 1 -- 172.21.15.81:0/1017825934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270415df90 msgr2=0x7f27040cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.170+0000 7f270c32b640 1 --2- 172.21.15.81:0/1017825934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270415df90 0x7f27040cf9b0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7f27040d1380 tx=0x7f26f402a560 comp rx=0 tx=0).stop 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.171+0000 7f270c32b640 1 -- 172.21.15.81:0/1017825934 shutdown_connections 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.171+0000 7f270c32b640 1 --2- 172.21.15.81:0/1017825934 >> v2:172.21.15.160:3300/0 conn(0x7f2704162480 0x7f27040d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.171+0000 7f270c32b640 1 --2- 172.21.15.81:0/1017825934 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f27040d49c0 0x7f27040d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.171+0000 7f270c32b640 1 --2- 172.21.15.81:0/1017825934 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f270415df90 0x7f27040cf9b0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.171+0000 7f270c32b640 1 -- 172.21.15.81:0/1017825934 >> 172.21.15.81:0/1017825934 conn(0x7f27040d3ea0 msgr2=0x7f27040d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:49.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.171+0000 7f270c32b640 1 -- 172.21.15.81:0/1017825934 shutdown_connections 2024-09-17T05:25:49.173 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.171+0000 7f270c32b640 1 -- 172.21.15.81:0/1017825934 wait complete. 2024-09-17T05:25:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.172+0000 7f270c32b640 1 Processor -- start 2024-09-17T05:25:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.172+0000 7f270c32b640 1 -- start start 2024-09-17T05:25:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27040d49c0 0x7f27040b17f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270415df90 0x7f27040cd7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2704162480 0x7f27040cdd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f27040b3b90 con 0x7f27040d49c0 2024-09-17T05:25:49.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f27040b3a10 con 0x7f270415df90 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f27040b3d10 con 0x7f2704162480 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27040d49c0 0x7f27040b17f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27040d49c0 0x7f27040b17f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47608/0 (socket says 172.21.15.81:47608) 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 -- 172.21.15.81:0/2716349265 learned_addr learned my addr 172.21.15.81:0/2716349265 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a8c8640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2704162480 0x7f27040cdd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f27098c6640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270415df90 0x7f27040cd7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 -- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2704162480 msgr2=0x7f27040cdd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2704162480 0x7f27040cdd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 -- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270415df90 msgr2=0x7f27040cd7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270415df90 0x7f27040cd7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 -- 172.21.15.81:0/2716349265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27041f7a40 con 0x7f27040d49c0 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f27098c6640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270415df90 0x7f27040cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270a0c7640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27040d49c0 0x7f27040b17f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009850 tx=0x7f26f40039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f26faffd640 1 -- 172.21.15.81:0/2716349265 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f403f070 con 0x7f27040d49c0 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f26faffd640 1 -- 172.21.15.81:0/2716349265 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f26f4004890 con 0x7f27040d49c0 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27041f8000 con 0x7f27040d49c0 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f26faffd640 1 -- 172.21.15.81:0/2716349265 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f4035030 con 0x7f27040d49c0 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.173+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27041f85c0 con 0x7f27040d49c0 2024-09-17T05:25:49.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.174+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f27041f7e30 con 0x7f27040d49c0 2024-09-17T05:25:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.175+0000 7f26faffd640 1 -- 172.21.15.81:0/2716349265 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f26f4042070 con 0x7f27040d49c0 2024-09-17T05:25:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.176+0000 7f26faffd640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26e8079400 0x7f26e807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.176+0000 7f26faffd640 1 -- 172.21.15.81:0/2716349265 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(143..143 src has 1..143) ==== 5015+0+0 (secure 0 0 0) 0x7f26f40ba9a0 con 0x7f27040d49c0 2024-09-17T05:25:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.176+0000 7f27098c6640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26e8079400 0x7f26e807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.178 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.176+0000 7f27098c6640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26e8079400 0x7f26e807b8c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f27040ce4c0 tx=0x7f2700005d90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:49.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.179+0000 7f26faffd640 1 -- 172.21.15.81:0/2716349265 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f26f4084900 con 0x7f27040d49c0 2024-09-17T05:25:49.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.365+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7f27040cf9b0 con 0x7f27040d49c0 2024-09-17T05:25:49.844 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.843+0000 7f26faffd640 1 -- 172.21.15.81:0/2716349265 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v145) ==== 97+0+0 (secure 0 0 0) 0x7f26f4084200 con 0x7f27040d49c0 2024-09-17T05:25:49.845 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:25:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26e8079400 msgr2=0x7f26e807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26e8079400 0x7f26e807b8c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f27040ce4c0 tx=0x7f2700005d90 comp rx=0 tx=0).stop 2024-09-17T05:25:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27040d49c0 msgr2=0x7f27040b17f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27040d49c0 0x7f27040b17f0 secure :-1 s=READY pgs=1685 cs=0 l=1 rev1=1 crypto rx=0x7f26f4009850 tx=0x7f26f40039e0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.847 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 shutdown_connections 2024-09-17T05:25:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2704162480 0x7f27040cdd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f26e8079400 0x7f26e807b8c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f270415df90 0x7f27040cd7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 --2- 172.21.15.81:0/2716349265 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f27040d49c0 0x7f27040b17f0 unknown :-1 s=CLOSED pgs=1685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 >> 172.21.15.81:0/2716349265 conn(0x7f27040d3ea0 msgr2=0x7f27040b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 shutdown_connections 2024-09-17T05:25:49.848 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.846+0000 7f270c32b640 1 -- 172.21.15.81:0/2716349265 wait complete. 2024-09-17T05:25:49.860 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:25:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.961+0000 7f113c9a3640 1 -- 172.21.15.81:0/1541629783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 msgr2=0x7f11240051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.961+0000 7f113c9a3640 1 --2- 172.21.15.81:0/1541629783 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 0x7f11240051c0 secure :-1 s=READY pgs=1687 cs=0 l=1 rev1=1 crypto rx=0x7f1130005fd0 tx=0x7f1124005830 comp rx=0 tx=0).stop 2024-09-17T05:25:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.961+0000 7f1136d9d640 1 -- 172.21.15.81:0/1541629783 reap_dead start 2024-09-17T05:25:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.961+0000 7f113c9a3640 1 -- 172.21.15.81:0/1541629783 shutdown_connections 2024-09-17T05:25:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.961+0000 7f113c9a3640 1 -- 172.21.15.81:0/1541629783 >> 172.21.15.81:0/1541629783 conn(0x7f11380b1690 msgr2=0x7f11380b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.961+0000 7f113c9a3640 1 -- 172.21.15.81:0/1541629783 shutdown_connections 2024-09-17T05:25:49.963 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.961+0000 7f113c9a3640 1 -- 172.21.15.81:0/1541629783 wait complete. 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.962+0000 7f113c9a3640 1 Processor -- start 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.962+0000 7f113c9a3640 1 -- start start 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113c9a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 0x7f11381f2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113c9a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1138153440 0x7f1138159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113c9a3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f113815a2a0 0x7f11381f56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113c9a3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f113815f8d0 con 0x7f1124004d40 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113c9a3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f113815f750 con 0x7f113815a2a0 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113c9a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f113815fa50 con 0x7f1138153440 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 0x7f11381f2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113659c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 0x7f11381f2ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47620/0 (socket says 172.21.15.81:47620) 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113659c640 1 -- 172.21.15.81:0/811670469 learned_addr learned my addr 172.21.15.81:0/811670469 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:49.966 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f1136d9d640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f113815a2a0 0x7f11381f56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f112dd9b640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1138153440 0x7f1138159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113659c640 1 -- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1138153440 msgr2=0x7f1138159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113659c640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1138153440 0x7f1138159d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113659c640 1 -- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f113815a2a0 msgr2=0x7f11381f56a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.963+0000 7f113659c640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f113815a2a0 0x7f11381f56a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.964+0000 7f113659c640 1 -- 172.21.15.81:0/811670469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1138156df0 con 0x7f1124004d40 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.964+0000 7f113659c640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 0x7f11381f2ca0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f112800e6d0 tx=0x7f112800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.964+0000 7f112f7fe640 1 -- 172.21.15.81:0/811670469 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1128004230 con 0x7f1124004d40 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.964+0000 7f112f7fe640 1 -- 172.21.15.81:0/811670469 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1128016070 con 0x7f1124004d40 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.964+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f11381f6280 con 0x7f1124004d40 2024-09-17T05:25:49.967 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.964+0000 7f112f7fe640 1 -- 172.21.15.81:0/811670469 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f112800c840 con 0x7f1124004d40 2024-09-17T05:25:49.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.964+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11381f21c0 con 0x7f1124004d40 2024-09-17T05:25:49.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.965+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f113815a6b0 con 0x7f1124004d40 2024-09-17T05:25:49.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.965+0000 7f112f7fe640 1 -- 172.21.15.81:0/811670469 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f112800ca00 con 0x7f1124004d40 2024-09-17T05:25:49.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.966+0000 7f112f7fe640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1118079430 0x7f111807b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:49.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.966+0000 7f112dd9b640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1118079430 0x7f111807b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:49.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.966+0000 7f112f7fe640 1 -- 172.21.15.81:0/811670469 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4929+0+0 (secure 0 0 0) 0x7f1128099ad0 con 0x7f1124004d40 2024-09-17T05:25:49.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.966+0000 7f112dd9b640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1118079430 0x7f111807b8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f112000e980 tx=0x7f112000e380 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:49.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:49.970+0000 7f112f7fe640 1 -- 172.21.15.81:0/811670469 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f113815a6b0 con 0x7f1124004d40 2024-09-17T05:25:50.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.215+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f113815fc60 con 0x7f1124004d40 2024-09-17T05:25:50.217 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.216+0000 7f112f7fe640 1 -- 172.21.15.81:0/811670469 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v25) ==== 80+0+5304 (secure 0 0 0) 0x7f1138156df0 con 0x7f1124004d40 2024-09-17T05:25:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:50.217 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:25:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:25:50.217 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.218 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.219 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.220 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.221 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.222 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:25:50.223 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.224 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.225 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.226 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.227 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:25:50.228 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.229 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.230 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:25:50.231 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:25:50.232 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:25:50.233 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:25:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:25:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:25:50.234 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:25:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:25:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:25:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.235 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:25:50.235 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:25:50.236 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1118079430 msgr2=0x7f111807b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1118079430 0x7f111807b8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f112000e980 tx=0x7f112000e380 comp rx=0 tx=0).stop 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 msgr2=0x7f11381f2ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 0x7f11381f2ca0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7f112800e6d0 tx=0x7f112800eb90 comp rx=0 tx=0).stop 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 shutdown_connections 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1118079430 0x7f111807b8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f113815a2a0 0x7f11381f56a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1138153440 0x7f1138159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 --2- 172.21.15.81:0/811670469 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1124004d40 0x7f11381f2ca0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 >> 172.21.15.81:0/811670469 conn(0x7f11380b1690 msgr2=0x7f11380cecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:50.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 shutdown_connections 2024-09-17T05:25:50.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.218+0000 7f113c9a3640 1 -- 172.21.15.81:0/811670469 wait complete. 2024-09-17T05:25:50.238 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:25:50.340 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.339+0000 7fdc568a9640 1 -- 172.21.15.81:0/3305729946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc38004020 msgr2=0x7fdc38004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.339+0000 7fdc568a9640 1 --2- 172.21.15.81:0/3305729946 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc38004020 0x7fdc38004800 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7fdc44009b50 tx=0x7fdc38005830 comp rx=0 tx=0).stop 2024-09-17T05:25:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.339+0000 7fdc54e46640 1 -- 172.21.15.81:0/3305729946 reap_dead start 2024-09-17T05:25:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.339+0000 7fdc568a9640 1 -- 172.21.15.81:0/3305729946 shutdown_connections 2024-09-17T05:25:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.339+0000 7fdc568a9640 1 -- 172.21.15.81:0/3305729946 >> 172.21.15.81:0/3305729946 conn(0x7fdc500b1690 msgr2=0x7fdc500b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.339+0000 7fdc568a9640 1 -- 172.21.15.81:0/3305729946 shutdown_connections 2024-09-17T05:25:50.341 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.339+0000 7fdc568a9640 1 -- 172.21.15.81:0/3305729946 wait complete. 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.340+0000 7fdc568a9640 1 Processor -- start 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.340+0000 7fdc568a9640 1 -- start start 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc568a9640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc38004020 0x7fdc500c6280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc568a9640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc501f53e0 0x7fdc50158e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc568a9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc501593a0 0x7fdc501f47b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc568a9640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdc500707a0 con 0x7fdc501593a0 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc568a9640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdc50070620 con 0x7fdc38004020 2024-09-17T05:25:50.344 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc568a9640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdc50158a80 con 0x7fdc501f53e0 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc54e46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc501593a0 0x7fdc501f47b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc54e46640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc501593a0 0x7fdc501f47b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47640/0 (socket says 172.21.15.81:47640) 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc54e46640 1 -- 172.21.15.81:0/1391274209 learned_addr learned my addr 172.21.15.81:0/1391274209 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc4ffff640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc38004020 0x7fdc500c6280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.341+0000 7fdc4f7fe640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc501f53e0 0x7fdc50158e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc54e46640 1 -- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc501f53e0 msgr2=0x7fdc50158e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc54e46640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc501f53e0 0x7fdc50158e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc54e46640 1 -- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc38004020 msgr2=0x7fdc500c6280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc54e46640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc38004020 0x7fdc500c6280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc54e46640 1 -- 172.21.15.81:0/1391274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc501579e0 con 0x7fdc501593a0 2024-09-17T05:25:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc54e46640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc501593a0 0x7fdc501f47b0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdc500b3370 tx=0x7fdc48010e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc4cff9640 1 -- 172.21.15.81:0/1391274209 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc4800edf0 con 0x7fdc501593a0 2024-09-17T05:25:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc4cff9640 1 -- 172.21.15.81:0/1391274209 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdc48015070 con 0x7fdc501593a0 2024-09-17T05:25:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc50157cc0 con 0x7fdc501593a0 2024-09-17T05:25:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc4cff9640 1 -- 172.21.15.81:0/1391274209 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc48003d00 con 0x7fdc501593a0 2024-09-17T05:25:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.342+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc50158280 con 0x7fdc501593a0 2024-09-17T05:25:50.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.343+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc500739d0 con 0x7fdc501593a0 2024-09-17T05:25:50.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.343+0000 7fdc4cff9640 1 -- 172.21.15.81:0/1391274209 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fdc48004030 con 0x7fdc501593a0 2024-09-17T05:25:50.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.344+0000 7fdc4cff9640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc3c079400 0x7fdc3c07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.344+0000 7fdc4cff9640 1 -- 172.21.15.81:0/1391274209 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4929+0+0 (secure 0 0 0) 0x7fdc48099ea0 con 0x7fdc501593a0 2024-09-17T05:25:50.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.344+0000 7fdc4ffff640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc3c079400 0x7fdc3c07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.344+0000 7fdc4ffff640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc3c079400 0x7fdc3c07b8c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdc50157910 tx=0x7fdc40006040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:50.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.348+0000 7fdc4cff9640 1 -- 172.21.15.81:0/1391274209 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdc480637d0 con 0x7fdc501593a0 2024-09-17T05:25:50.527 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.526+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fdc500cc520 con 0x7fdc501593a0 2024-09-17T05:25:50.528 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.527+0000 7fdc4cff9640 1 -- 172.21.15.81:0/1391274209 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v147) ==== 84+0+65 (secure 0 0 0) 0x7fdc48068200 con 0x7fdc501593a0 2024-09-17T05:25:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:50.528 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:25:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:25:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:25:50.528 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:25:50.529 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:50.529 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:25:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc3c079400 msgr2=0x7fdc3c07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc3c079400 0x7fdc3c07b8c0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fdc50157910 tx=0x7fdc40006040 comp rx=0 tx=0).stop 2024-09-17T05:25:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc501593a0 msgr2=0x7fdc501f47b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.530 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc501593a0 0x7fdc501f47b0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7fdc500b3370 tx=0x7fdc48010e50 comp rx=0 tx=0).stop 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 shutdown_connections 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdc501593a0 0x7fdc501f47b0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdc501f53e0 0x7fdc50158e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdc3c079400 0x7fdc3c07b8c0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 --2- 172.21.15.81:0/1391274209 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdc38004020 0x7fdc500c6280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 >> 172.21.15.81:0/1391274209 conn(0x7fdc500b1690 msgr2=0x7fdc5015d740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 shutdown_connections 2024-09-17T05:25:50.531 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.529+0000 7fdc568a9640 1 -- 172.21.15.81:0/1391274209 wait complete. 2024-09-17T05:25:50.541 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:25:50.541 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:25:50.645 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.644+0000 7ff3663e2640 1 -- 172.21.15.81:0/2983172394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 msgr2=0x7ff3600b2cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.644+0000 7ff3663e2640 1 --2- 172.21.15.81:0/2983172394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff3600b2cd0 secure :-1 s=READY pgs=1693 cs=0 l=1 rev1=1 crypto rx=0x7ff358005fd0 tx=0x7ff35802a9d0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.644+0000 7ff3663e2640 1 -- 172.21.15.81:0/2983172394 shutdown_connections 2024-09-17T05:25:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.644+0000 7ff3663e2640 1 --2- 172.21.15.81:0/2983172394 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff3600b2cd0 unknown :-1 s=CLOSED pgs=1693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.644+0000 7ff3663e2640 1 -- 172.21.15.81:0/2983172394 >> 172.21.15.81:0/2983172394 conn(0x7ff3600b1620 msgr2=0x7ff3600b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.644+0000 7ff3663e2640 1 -- 172.21.15.81:0/2983172394 shutdown_connections 2024-09-17T05:25:50.646 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.644+0000 7ff3663e2640 1 -- 172.21.15.81:0/2983172394 wait complete. 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.645+0000 7ff3663e2640 1 Processor -- start 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.645+0000 7ff3663e2640 1 -- start start 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff3663e2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff36015c120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff3663e2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3600aec50 0x7ff360146b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff3663e2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff36015d610 0x7ff360147080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff3663e2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3600b3390 con 0x7ff360073120 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff3663e2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff3600b3210 con 0x7ff3600aec50 2024-09-17T05:25:50.649 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff3663e2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff3600b3510 con 0x7ff36015d610 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff36015c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff36015c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47644/0 (socket says 172.21.15.81:47644) 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 -- 172.21.15.81:0/3527158905 learned_addr learned my addr 172.21.15.81:0/3527158905 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35f7fe640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3600aec50 0x7ff360146b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff36497f640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff36015d610 0x7ff360147080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 -- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff36015d610 msgr2=0x7ff360147080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff36015d610 0x7ff360147080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 -- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3600aec50 msgr2=0x7ff360146b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3600aec50 0x7ff360146b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 -- 172.21.15.81:0/3527158905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff360148f50 con 0x7ff360073120 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35f7fe640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3600aec50 0x7ff360146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:50.650 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff36497f640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff36015d610 0x7ff360147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.646+0000 7ff35ffff640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff36015c120 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff35000c400 tx=0x7ff35000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.647+0000 7ff35cff9640 1 -- 172.21.15.81:0/3527158905 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350017070 con 0x7ff360073120 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.647+0000 7ff35cff9640 1 -- 172.21.15.81:0/3527158905 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3500053c0 con 0x7ff360073120 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.647+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff360146210 con 0x7ff360073120 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.647+0000 7ff35cff9640 1 -- 172.21.15.81:0/3527158905 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff350003850 con 0x7ff360073120 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.647+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3601467d0 con 0x7ff360073120 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.648+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3600b1340 con 0x7ff360073120 2024-09-17T05:25:50.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.648+0000 7ff35cff9640 1 -- 172.21.15.81:0/3527158905 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7ff35001a070 con 0x7ff360073120 2024-09-17T05:25:50.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.649+0000 7ff35cff9640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff34c079400 0x7ff34c07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.649+0000 7ff35cff9640 1 -- 172.21.15.81:0/3527158905 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(147..147 src has 1..147) ==== 4929+0+0 (secure 0 0 0) 0x7ff3500988f0 con 0x7ff360073120 2024-09-17T05:25:50.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.649+0000 7ff35f7fe640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff34c079400 0x7ff34c07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:50.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.649+0000 7ff35f7fe640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff34c079400 0x7ff34c07b8c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff360142730 tx=0x7ff354009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:50.653 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.653+0000 7ff35cff9640 1 -- 172.21.15.81:0/3527158905 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff350062870 con 0x7ff360073120 2024-09-17T05:25:50.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.827+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7ff36014f970 con 0x7ff360073120 2024-09-17T05:25:50.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.870+0000 7ff35cff9640 1 -- 172.21.15.81:0/3527158905 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v148) ==== 138+0+0 (secure 0 0 0) 0x7ff350062170 con 0x7ff360073120 2024-09-17T05:25:50.871 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:25:50.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff34c079400 msgr2=0x7ff34c07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff34c079400 0x7ff34c07b8c0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7ff360142730 tx=0x7ff354009040 comp rx=0 tx=0).stop 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 msgr2=0x7ff36015c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff36015c120 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7ff35000c400 tx=0x7ff35000c8c0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 shutdown_connections 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff36015d610 0x7ff360147080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff34c079400 0x7ff34c07b8c0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3600aec50 0x7ff360146b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 --2- 172.21.15.81:0/3527158905 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff360073120 0x7ff36015c120 unknown :-1 s=CLOSED pgs=1694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 >> 172.21.15.81:0/3527158905 conn(0x7ff3600b1620 msgr2=0x7ff36006e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.872+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 shutdown_connections 2024-09-17T05:25:50.874 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.873+0000 7ff3663e2640 1 -- 172.21.15.81:0/3527158905 wait complete. 2024-09-17T05:25:50.887 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:25:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 -- 172.21.15.81:0/542400270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 msgr2=0x7f0c6c152af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 --2- 172.21.15.81:0/542400270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c152af0 secure :-1 s=READY pgs=1696 cs=0 l=1 rev1=1 crypto rx=0x7f0c60005fd0 tx=0x7f0c6002a8b0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 -- 172.21.15.81:0/542400270 shutdown_connections 2024-09-17T05:25:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 --2- 172.21.15.81:0/542400270 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c6c0cc500 0x7f0c6c0cc970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 --2- 172.21.15.81:0/542400270 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c152af0 unknown :-1 s=CLOSED pgs=1696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 -- 172.21.15.81:0/542400270 >> 172.21.15.81:0/542400270 conn(0x7f0c6c0b1700 msgr2=0x7f0c6c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 -- 172.21.15.81:0/542400270 shutdown_connections 2024-09-17T05:25:50.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.995+0000 7f0c72b89640 1 -- 172.21.15.81:0/542400270 wait complete. 2024-09-17T05:25:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.996+0000 7f0c72b89640 1 Processor -- start 2024-09-17T05:25:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.996+0000 7f0c72b89640 1 -- start start 2024-09-17T05:25:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c72b89640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c1efae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c72b89640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c6c0cc500 0x7f0c6c157710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c72b89640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c6c152710 0x7f0c6c0c6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:50.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c72b89640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c06fd70 con 0x7f0c6c072f20 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c72b89640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0c6c06fbf0 con 0x7f0c6c0cc500 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c72b89640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0c6c06fef0 con 0x7f0c6c152710 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c1efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c1efae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47656/0 (socket says 172.21.15.81:47656) 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 -- 172.21.15.81:0/4185775971 learned_addr learned my addr 172.21.15.81:0/4185775971 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 -- 172.21.15.81:0/4185775971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c6c152710 msgr2=0x7f0c6c0c6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c6c152710 0x7f0c6c0c6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 -- 172.21.15.81:0/4185775971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c6c0cc500 msgr2=0x7f0c6c157710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c6c0cc500 0x7f0c6c157710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:51.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 -- 172.21.15.81:0/4185775971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c6c1449a0 con 0x7f0c6c072f20 2024-09-17T05:25:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c70925640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c1efae0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c450 tx=0x7f0c5c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c697fa640 1 -- 172.21.15.81:0/4185775971 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c016020 con 0x7f0c6c072f20 2024-09-17T05:25:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c6c0c5680 con 0x7f0c6c072f20 2024-09-17T05:25:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c697fa640 1 -- 172.21.15.81:0/4185775971 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0c5c012920 con 0x7f0c6c072f20 2024-09-17T05:25:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.997+0000 7f0c697fa640 1 -- 172.21.15.81:0/4185775971 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c5c012d70 con 0x7f0c6c072f20 2024-09-17T05:25:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.998+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c6c0c5c40 con 0x7f0c6c072f20 2024-09-17T05:25:51.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.998+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c6c152af0 con 0x7f0c6c072f20 2024-09-17T05:25:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:50.999+0000 7f0c697fa640 1 -- 172.21.15.81:0/4185775971 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f0c5c019020 con 0x7f0c6c072f20 2024-09-17T05:25:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.000+0000 7f0c697fa640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c58079400 0x7f0c5807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.000+0000 7f0c697fa640 1 -- 172.21.15.81:0/4185775971 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(148..148 src has 1..148) ==== 5299+0+0 (secure 0 0 0) 0x7f0c5c0995b0 con 0x7f0c6c072f20 2024-09-17T05:25:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.000+0000 7f0c6bfff640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c58079400 0x7f0c5807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:51.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.000+0000 7f0c6bfff640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c58079400 0x7f0c5807b8c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0c60034000 tx=0x7f0c60004a40 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:51.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.004+0000 7f0c697fa640 1 -- 172.21.15.81:0/4185775971 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0c5c020020 con 0x7f0c6c072f20 2024-09-17T05:25:51.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.186+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f0c6c15f340 con 0x7f0c6c072f20 2024-09-17T05:25:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.872+0000 7f0c697fa640 1 -- 172.21.15.81:0/4185775971 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v149) ==== 170+0+0 (secure 0 0 0) 0x7f0c5c0634b0 con 0x7f0c6c072f20 2024-09-17T05:25:51.873 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:25:51.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c58079400 msgr2=0x7f0c5807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:51.876 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c58079400 0x7f0c5807b8c0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f0c60034000 tx=0x7f0c60004a40 comp rx=0 tx=0).stop 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 msgr2=0x7f0c6c1efae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c1efae0 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0c5c00c450 tx=0x7f0c5c00c910 comp rx=0 tx=0).stop 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 shutdown_connections 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0c6c152710 0x7f0c6c0c6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0c58079400 0x7f0c5807b8c0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0c6c0cc500 0x7f0c6c157710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 --2- 172.21.15.81:0/4185775971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0c6c072f20 0x7f0c6c1efae0 unknown :-1 s=CLOSED pgs=1697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 >> 172.21.15.81:0/4185775971 conn(0x7f0c6c0b1700 msgr2=0x7f0c6c0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 shutdown_connections 2024-09-17T05:25:51.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:51.875+0000 7f0c72b89640 1 -- 172.21.15.81:0/4185775971 wait complete. 2024-09-17T05:25:51.898 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:25:52.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 -- 172.21.15.81:0/2182181731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 msgr2=0x7fa2680ce970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:52.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2182181731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2680ce970 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7fa260005fd0 tx=0x7fa26002a670 comp rx=0 tx=0).stop 2024-09-17T05:25:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 -- 172.21.15.81:0/2182181731 shutdown_connections 2024-09-17T05:25:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2182181731 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2680ce970 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2182181731 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815f240 0x7fa2680ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 -- 172.21.15.81:0/2182181731 >> 172.21.15.81:0/2182181731 conn(0x7fa2680d1a20 msgr2=0x7fa2680d1e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 -- 172.21.15.81:0/2182181731 shutdown_connections 2024-09-17T05:25:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.002+0000 7fa26e99d640 1 -- 172.21.15.81:0/2182181731 wait complete. 2024-09-17T05:25:52.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.003+0000 7fa26e99d640 1 Processor -- start 2024-09-17T05:25:52.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.003+0000 7fa26e99d640 1 -- start start 2024-09-17T05:25:52.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26e99d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2681ef7e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26e99d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d2540 0x7fa2681f2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26e99d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815f240 0x7fa2681f5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26e99d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa2680d01b0 con 0x7fa2680b6120 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26e99d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa2680b32f0 con 0x7fa2680d2540 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26e99d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa2680d0330 con 0x7fa26815f240 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26d99b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2681ef7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26d99b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2681ef7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47672/0 (socket says 172.21.15.81:47672) 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26d99b640 1 -- 172.21.15.81:0/2208693410 learned_addr learned my addr 172.21.15.81:0/2208693410 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26d19a640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d2540 0x7fa2681f2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.004+0000 7fa26e19c640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815f240 0x7fa2681f5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:52.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26d99b640 1 -- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815f240 msgr2=0x7fa2681f5970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26d99b640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815f240 0x7fa2681f5970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26d99b640 1 -- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d2540 msgr2=0x7fa2681f2d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26d99b640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d2540 0x7fa2681f2d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26d99b640 1 -- 172.21.15.81:0/2208693410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa26815c510 con 0x7fa2680b6120 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26d99b640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2681ef7e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fa25800da20 tx=0x7fa25800dee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa2667fc640 1 -- 172.21.15.81:0/2208693410 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa258017070 con 0x7fa2680b6120 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa2667fc640 1 -- 172.21.15.81:0/2208693410 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa258010460 con 0x7fa2680b6120 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa26815c7f0 con 0x7fa2680b6120 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa2667fc640 1 -- 172.21.15.81:0/2208693410 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2580108b0 con 0x7fa2680b6120 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.005+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2680c6be0 con 0x7fa2680b6120 2024-09-17T05:25:52.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.006+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa2680d0850 con 0x7fa2680b6120 2024-09-17T05:25:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.007+0000 7fa2667fc640 1 -- 172.21.15.81:0/2208693410 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fa25801a070 con 0x7fa2680b6120 2024-09-17T05:25:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.007+0000 7fa2667fc640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa254079400 0x7fa25407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.007+0000 7fa2667fc640 1 -- 172.21.15.81:0/2208693410 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(149..149 src has 1..149) ==== 5681+0+0 (secure 0 0 0) 0x7fa258099970 con 0x7fa2680b6120 2024-09-17T05:25:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.007+0000 7fa26d19a640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa254079400 0x7fa25407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:52.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.008+0000 7fa26d19a640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa254079400 0x7fa25407b8c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa2680b2e20 tx=0x7fa25c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:52.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.012+0000 7fa2667fc640 1 -- 172.21.15.81:0/2208693410 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa2580632a0 con 0x7fa2680b6120 2024-09-17T05:25:52.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.225+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fa2680ce210 con 0x7fa2680b6120 2024-09-17T05:25:52.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.883+0000 7fa2667fc640 1 -- 172.21.15.81:0/2208693410 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 24 and data pool 25 v90) ==== 174+0+0 (secure 0 0 0) 0x7fa258067cd0 con 0x7fa2680b6120 2024-09-17T05:25:52.885 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 24 and data pool 25 2024-09-17T05:25:52.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.894+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa254079400 msgr2=0x7fa25407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:52.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.894+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa254079400 0x7fa25407b8c0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa2680b2e20 tx=0x7fa25c009040 comp rx=0 tx=0).stop 2024-09-17T05:25:52.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.894+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 msgr2=0x7fa2681ef7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:52.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.894+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2681ef7e0 secure :-1 s=READY pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fa25800da20 tx=0x7fa25800dee0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.895+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 shutdown_connections 2024-09-17T05:25:52.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.895+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa26815f240 0x7fa2681f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.895+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa254079400 0x7fa25407b8c0 secure :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fa2680b2e20 tx=0x7fa25c009040 comp rx=0 tx=0).stop 2024-09-17T05:25:52.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.895+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa2680d2540 0x7fa2681f2d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.895+0000 7fa26e99d640 1 --2- 172.21.15.81:0/2208693410 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa2680b6120 0x7fa2681ef7e0 secure :-1 s=CLOSED pgs=1699 cs=0 l=1 rev1=1 crypto rx=0x7fa25800da20 tx=0x7fa25800dee0 comp rx=0 tx=0).stop 2024-09-17T05:25:52.897 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.895+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 >> 172.21.15.81:0/2208693410 conn(0x7fa2680d1a20 msgr2=0x7fa2680b3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.898+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 shutdown_connections 2024-09-17T05:25:52.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:52.899+0000 7fa26e99d640 1 -- 172.21.15.81:0/2208693410 wait complete. 2024-09-17T05:25:52.915 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.018+0000 7f0173d64640 1 -- 172.21.15.81:0/1016610258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 msgr2=0x7f0154003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.018+0000 7f0173d64640 1 --2- 172.21.15.81:0/1016610258 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 0x7f0154003e20 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f0164009b50 tx=0x7f0154005830 comp rx=0 tx=0).stop 2024-09-17T05:25:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.018+0000 7f0172301640 1 -- 172.21.15.81:0/1016610258 reap_dead start 2024-09-17T05:25:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.018+0000 7f0173d64640 1 -- 172.21.15.81:0/1016610258 shutdown_connections 2024-09-17T05:25:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.018+0000 7f0173d64640 1 -- 172.21.15.81:0/1016610258 >> 172.21.15.81:0/1016610258 conn(0x7f016c09af50 msgr2=0x7f016c0d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.018+0000 7f0173d64640 1 -- 172.21.15.81:0/1016610258 shutdown_connections 2024-09-17T05:25:53.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.018+0000 7f0173d64640 1 -- 172.21.15.81:0/1016610258 wait complete. 2024-09-17T05:25:53.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.019+0000 7f0173d64640 1 Processor -- start 2024-09-17T05:25:53.020 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.019+0000 7f0173d64640 1 -- start start 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 0x7f016c1f3220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016c0c8d80 0x7f016c15b570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f016c0cb3e0 0x7f016c0cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f016c0ccd30 con 0x7f0154003a00 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f016c0ccbb0 con 0x7f016c0c8d80 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f016c0cceb0 con 0x7f016c0cb3e0 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 0x7f016c1f3220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 0x7f016c1f3220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:47678/0 (socket says 172.21.15.81:47678) 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 -- 172.21.15.81:0/2321925664 learned_addr learned my addr 172.21.15.81:0/2321925664 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:53.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0172301640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f016c0cb3e0 0x7f016c0cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f01712ff640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016c0c8d80 0x7f016c15b570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 -- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f016c0cb3e0 msgr2=0x7f016c0cb870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f016c0cb3e0 0x7f016c0cb870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 -- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016c0c8d80 msgr2=0x7f016c15b570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016c0c8d80 0x7f016c15b570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 -- 172.21.15.81:0/2321925664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f016c0ce630 con 0x7f0154003a00 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f01712ff640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016c0c8d80 0x7f016c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0171b00640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 0x7f016c1f3220 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f0164009a70 tx=0x7f0164033670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f016a7fc640 1 -- 172.21.15.81:0/2321925664 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164038040 con 0x7f0154003a00 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f016a7fc640 1 -- 172.21.15.81:0/2321925664 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0164004020 con 0x7f0154003a00 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f016c0ce910 con 0x7f0154003a00 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f016a7fc640 1 -- 172.21.15.81:0/2321925664 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0164004470 con 0x7f0154003a00 2024-09-17T05:25:53.029 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.020+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f016c0cbdb0 con 0x7f0154003a00 2024-09-17T05:25:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.021+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f016c0cd3d0 con 0x7f0154003a00 2024-09-17T05:25:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.022+0000 7f016a7fc640 1 -- 172.21.15.81:0/2321925664 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f0164045020 con 0x7f0154003a00 2024-09-17T05:25:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.023+0000 7f016a7fc640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0158079400 0x7f015807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.023+0000 7f016a7fc640 1 -- 172.21.15.81:0/2321925664 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5781+0+0 (secure 0 0 0) 0x7f01640bc6c0 con 0x7f0154003a00 2024-09-17T05:25:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.023+0000 7f01712ff640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0158079400 0x7f015807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.023+0000 7f01712ff640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0158079400 0x7f015807b8c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0160001860 tx=0x7f0160000ed0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:53.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.027+0000 7f016a7fc640 1 -- 172.21.15.81:0/2321925664 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0164083580 con 0x7f0154003a00 2024-09-17T05:25:53.208 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.207+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f016c15e9f0 con 0x7f0154003a00 2024-09-17T05:25:53.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.208+0000 7f016a7fc640 1 -- 172.21.15.81:0/2321925664 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) ==== 74+0+16864 (secure 0 0 0) 0x7f0164087fb0 con 0x7f0154003a00 2024-09-17T05:25:53.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:53.209 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":150,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:52.226852+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:50.832850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:51.191902+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0158079400 msgr2=0x7f015807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0158079400 0x7f015807b8c0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0160001860 tx=0x7f0160000ed0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 msgr2=0x7f016c1f3220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 0x7f016c1f3220 secure :-1 s=READY pgs=1702 cs=0 l=1 rev1=1 crypto rx=0x7f0164009a70 tx=0x7f0164033670 comp rx=0 tx=0).stop 2024-09-17T05:25:53.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 shutdown_connections 2024-09-17T05:25:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f016c0cb3e0 0x7f016c0cb870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0158079400 0x7f015807b8c0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f016c0c8d80 0x7f016c15b570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 --2- 172.21.15.81:0/2321925664 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0154003a00 0x7f016c1f3220 unknown :-1 s=CLOSED pgs=1702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 >> 172.21.15.81:0/2321925664 conn(0x7f016c09af50 msgr2=0x7f016c0ae9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 shutdown_connections 2024-09-17T05:25:53.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.210+0000 7f0173d64640 1 -- 172.21.15.81:0/2321925664 wait complete. 2024-09-17T05:25:53.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 -- 172.21.15.81:0/1201438993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c15aa70 msgr2=0x7f6b6c0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 --2- 172.21.15.81:0/1201438993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c15aa70 0x7f6b6c0b4690 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009830 tx=0x7f6b5c02a510 comp rx=0 tx=0).stop 2024-09-17T05:25:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 -- 172.21.15.81:0/1201438993 shutdown_connections 2024-09-17T05:25:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 --2- 172.21.15.81:0/1201438993 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b6c0735a0 0x7f6b6c0739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 --2- 172.21.15.81:0/1201438993 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c15aa70 0x7f6b6c0b4690 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 -- 172.21.15.81:0/1201438993 >> 172.21.15.81:0/1201438993 conn(0x7f6b6c0b1690 msgr2=0x7f6b6c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 -- 172.21.15.81:0/1201438993 shutdown_connections 2024-09-17T05:25:53.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.322+0000 7f6b70833640 1 -- 172.21.15.81:0/1201438993 wait complete. 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.323+0000 7f6b70833640 1 Processor -- start 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.323+0000 7f6b70833640 1 -- start start 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b70833640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c06ff80 0x7f6b6c1472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b70833640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c0735a0 0x7f6b6c0b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b70833640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b6c15aa70 0x7f6b6c0cb650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b70833640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c0707a0 con 0x7f6b6c06ff80 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b70833640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6b6c070620 con 0x7f6b6c0735a0 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b70833640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6b6c0c6c50 con 0x7f6b6c15aa70 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b6a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c06ff80 0x7f6b6c1472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b6a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c06ff80 0x7f6b6c1472f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46070/0 (socket says 172.21.15.81:46070) 2024-09-17T05:25:53.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b6a59c640 1 -- 172.21.15.81:0/4063460280 learned_addr learned my addr 172.21.15.81:0/4063460280 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b63fff640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c0735a0 0x7f6b6c0b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.324+0000 7f6b6ad9d640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b6c15aa70 0x7f6b6c0cb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b6a59c640 1 -- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b6c15aa70 msgr2=0x7f6b6c0cb650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b6a59c640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b6c15aa70 0x7f6b6c0cb650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b6a59c640 1 -- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c0735a0 msgr2=0x7f6b6c0b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b6a59c640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c0735a0 0x7f6b6c0b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b6a59c640 1 -- 172.21.15.81:0/4063460280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b6c0c6f10 con 0x7f6b6c06ff80 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b6a59c640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c06ff80 0x7f6b6c1472f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009950 tx=0x7f6b5c033c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b62ffd640 1 -- 172.21.15.81:0/4063460280 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c005c90 con 0x7f6b6c06ff80 2024-09-17T05:25:53.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b62ffd640 1 -- 172.21.15.81:0/4063460280 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6b5c031e50 con 0x7f6b6c06ff80 2024-09-17T05:25:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b6c0c71f0 con 0x7f6b6c06ff80 2024-09-17T05:25:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b62ffd640 1 -- 172.21.15.81:0/4063460280 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b5c005260 con 0x7f6b6c06ff80 2024-09-17T05:25:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.325+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b6c0cbb90 con 0x7f6b6c06ff80 2024-09-17T05:25:53.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.326+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b6c0cd8a0 con 0x7f6b6c06ff80 2024-09-17T05:25:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.326+0000 7f6b62ffd640 1 -- 172.21.15.81:0/4063460280 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f6b5c005400 con 0x7f6b6c06ff80 2024-09-17T05:25:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.327+0000 7f6b62ffd640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b4c079400 0x7f6b4c07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.327+0000 7f6b63fff640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b4c079400 0x7f6b4c07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.327+0000 7f6b62ffd640 1 -- 172.21.15.81:0/4063460280 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5781+0+0 (secure 0 0 0) 0x7f6b5c0ba460 con 0x7f6b6c06ff80 2024-09-17T05:25:53.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.327+0000 7f6b63fff640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b4c079400 0x7f6b4c07b8c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6b540095f0 tx=0x7f6b54005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:53.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.331+0000 7f6b62ffd640 1 -- 172.21.15.81:0/4063460280 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6b5c03f030 con 0x7f6b6c06ff80 2024-09-17T05:25:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.507+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6b6c075a30 con 0x7f6b6c06ff80 2024-09-17T05:25:53.508 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.508+0000 7f6b62ffd640 1 -- 172.21.15.81:0/4063460280 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v150) ==== 74+0+16864 (secure 0 0 0) 0x7f6b5c083d10 con 0x7f6b6c06ff80 2024-09-17T05:25:53.509 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:53.509 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":150,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:52.226852+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:50.832850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:51.191902+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b4c079400 msgr2=0x7f6b4c07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b4c079400 0x7f6b4c07b8c0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f6b540095f0 tx=0x7f6b54005f90 comp rx=0 tx=0).stop 2024-09-17T05:25:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c06ff80 msgr2=0x7f6b6c1472f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c06ff80 0x7f6b6c1472f0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f6b5c009950 tx=0x7f6b5c033c20 comp rx=0 tx=0).stop 2024-09-17T05:25:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 shutdown_connections 2024-09-17T05:25:53.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6b6c15aa70 0x7f6b6c0cb650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6b4c079400 0x7f6b4c07b8c0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6b6c0735a0 0x7f6b6c0b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 --2- 172.21.15.81:0/4063460280 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6b6c06ff80 0x7f6b6c1472f0 unknown :-1 s=CLOSED pgs=1703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 >> 172.21.15.81:0/4063460280 conn(0x7f6b6c0b1690 msgr2=0x7f6b6c15d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 shutdown_connections 2024-09-17T05:25:53.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.510+0000 7f6b70833640 1 -- 172.21.15.81:0/4063460280 wait complete. 2024-09-17T05:25:53.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:25:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.625+0000 7fc0afabd640 1 -- 172.21.15.81:0/3873417885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0940052e0 msgr2=0x7fc09400b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.625+0000 7fc0afabd640 1 --2- 172.21.15.81:0/3873417885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0940052e0 0x7fc09400b9c0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fc0a0001d90 tx=0x7fc094005830 comp rx=0 tx=0).stop 2024-09-17T05:25:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.626+0000 7fc0afabd640 1 -- 172.21.15.81:0/3873417885 shutdown_connections 2024-09-17T05:25:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.626+0000 7fc0afabd640 1 --2- 172.21.15.81:0/3873417885 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0940052e0 0x7fc09400b9c0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.626+0000 7fc0afabd640 1 -- 172.21.15.81:0/3873417885 >> 172.21.15.81:0/3873417885 conn(0x7fc0a80b1700 msgr2=0x7fc0a80b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.626+0000 7fc0afabd640 1 -- 172.21.15.81:0/3873417885 shutdown_connections 2024-09-17T05:25:53.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.626+0000 7fc0afabd640 1 -- 172.21.15.81:0/3873417885 wait complete. 2024-09-17T05:25:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.627+0000 7fc0afabd640 1 Processor -- start 2024-09-17T05:25:53.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.627+0000 7fc0afabd640 1 -- start start 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.627+0000 7fc0afabd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0940052e0 0x7fc0a8146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.627+0000 7fc0afabd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8147d40 0x7fc0a814ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.627+0000 7fc0afabd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0a814ef50 0x7fc0a814f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0afabd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8072ee0 con 0x7fc0a8147d40 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0afabd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc0a8072d60 con 0x7fc0a814ef50 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0afabd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc0a815b810 con 0x7fc0940052e0 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8147d40 0x7fc0a814ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8147d40 0x7fc0a814ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46088/0 (socket says 172.21.15.81:46088) 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 -- 172.21.15.81:0/880600536 learned_addr learned my addr 172.21.15.81:0/880600536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 -- 172.21.15.81:0/880600536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0940052e0 msgr2=0x7fc0a8146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0940052e0 0x7fc0a8146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 -- 172.21.15.81:0/880600536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0a814ef50 msgr2=0x7fc0a814f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0a814ef50 0x7fc0a814f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 -- 172.21.15.81:0/880600536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0a8147100 con 0x7fc0a8147d40 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0ad058640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8147d40 0x7fc0a814ea10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e590 tx=0x7fc09800ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc09e7fc640 1 -- 172.21.15.81:0/880600536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc098015070 con 0x7fc0a8147d40 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc09e7fc640 1 -- 172.21.15.81:0/880600536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc09800c9e0 con 0x7fc0a8147d40 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0a8151460 con 0x7fc0a8147d40 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc09e7fc640 1 -- 172.21.15.81:0/880600536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09800cdf0 con 0x7fc0a8147d40 2024-09-17T05:25:53.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.628+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0a81460b0 con 0x7fc0a8147d40 2024-09-17T05:25:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.629+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc0a80cdd20 con 0x7fc0a8147d40 2024-09-17T05:25:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.630+0000 7fc09e7fc640 1 -- 172.21.15.81:0/880600536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fc098018070 con 0x7fc0a8147d40 2024-09-17T05:25:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.630+0000 7fc09e7fc640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc08c079430 0x7fc08c07b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.630+0000 7fc09e7fc640 1 -- 172.21.15.81:0/880600536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(150..150 src has 1..150) ==== 5781+0+0 (secure 0 0 0) 0x7fc098099910 con 0x7fc0a8147d40 2024-09-17T05:25:53.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.630+0000 7fc0ad859640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc08c079430 0x7fc08c07b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:53.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.631+0000 7fc0ad859640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc08c079430 0x7fc08c07b8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40058c0 tx=0x7fc0a4005850 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:53.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.634+0000 7fc09e7fc640 1 -- 172.21.15.81:0/880600536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc098063810 con 0x7fc0a8147d40 2024-09-17T05:25:53.852 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.851+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fc0a806c660 con 0x7fc0a8147d40 2024-09-17T05:25:53.884 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.884+0000 7fc09e7fc640 1 -- 172.21.15.81:0/880600536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v91) ==== 118+0+0 (secure 0 0 0) 0x7fc098063110 con 0x7fc0a8147d40 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc08c079430 msgr2=0x7fc08c07b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc08c079430 0x7fc08c07b8f0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fc0a40058c0 tx=0x7fc0a4005850 comp rx=0 tx=0).stop 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8147d40 msgr2=0x7fc0a814ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8147d40 0x7fc0a814ea10 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fc09800e590 tx=0x7fc09800ea50 comp rx=0 tx=0).stop 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 shutdown_connections 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc08c079430 0x7fc08c07b8f0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc0a814ef50 0x7fc0a814f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc0a8147d40 0x7fc0a814ea10 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 --2- 172.21.15.81:0/880600536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc0940052e0 0x7fc0a8146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:53.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 >> 172.21.15.81:0/880600536 conn(0x7fc0a80b1700 msgr2=0x7fc0a80b5310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:53.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 shutdown_connections 2024-09-17T05:25:53.901 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:53.887+0000 7fc0afabd640 1 -- 172.21.15.81:0/880600536 wait complete. 2024-09-17T05:25:53.901 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:25:53.901 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:25:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 -- 172.21.15.81:0/1047530379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45440cdb90 msgr2=0x7f45440cdf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 --2- 172.21.15.81:0/1047530379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45440cdb90 0x7f45440cdf70 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f45440cd880 tx=0x7f453c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 -- 172.21.15.81:0/1047530379 shutdown_connections 2024-09-17T05:25:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 --2- 172.21.15.81:0/1047530379 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45440cdb90 0x7f45440cdf70 unknown :-1 s=CLOSED pgs=1708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 --2- 172.21.15.81:0/1047530379 >> v2:172.21.15.160:3300/0 conn(0x7f45440cede0 0x7f45440cf250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 -- 172.21.15.81:0/1047530379 >> 172.21.15.81:0/1047530379 conn(0x7f45440b1700 msgr2=0x7f45440b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 -- 172.21.15.81:0/1047530379 shutdown_connections 2024-09-17T05:25:54.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.005+0000 7f454bd5d640 1 -- 172.21.15.81:0/1047530379 wait complete. 2024-09-17T05:25:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.006+0000 7f454bd5d640 1 Processor -- start 2024-09-17T05:25:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.006+0000 7f454bd5d640 1 -- start start 2024-09-17T05:25:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454bd5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45440cdb90 0x7f4544152870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454bd5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45440cede0 0x7f45440ac020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:54.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454bd5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454415bb20 0x7f45440ac560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454bd5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f454406fde0 con 0x7f454415bb20 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454bd5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f454406fc60 con 0x7f45440cdb90 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454bd5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f454406ff60 con 0x7f45440cede0 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454415bb20 0x7f45440ac560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454415bb20 0x7f45440ac560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46094/0 (socket says 172.21.15.81:46094) 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 -- 172.21.15.81:0/4246277501 learned_addr learned my addr 172.21.15.81:0/4246277501 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f4549af9640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45440cdb90 0x7f4544152870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f45492f8640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45440cede0 0x7f45440ac020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 -- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45440cede0 msgr2=0x7f45440ac020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45440cede0 0x7f45440ac020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 -- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45440cdb90 msgr2=0x7f4544152870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:54.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45440cdb90 0x7f4544152870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 -- 172.21.15.81:0/4246277501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45440abda0 con 0x7f454415bb20 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f4549af9640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45440cdb90 0x7f4544152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f454a2fa640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454415bb20 0x7f45440ac560 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f453c02aea0 tx=0x7f453c0316f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.007+0000 7f453a7fc640 1 -- 172.21.15.81:0/4246277501 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c040070 con 0x7f454415bb20 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.008+0000 7f453a7fc640 1 -- 172.21.15.81:0/4246277501 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f453c004040 con 0x7f454415bb20 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.008+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45440aad00 con 0x7f454415bb20 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.008+0000 7f453a7fc640 1 -- 172.21.15.81:0/4246277501 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453c004470 con 0x7f454415bb20 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.008+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45440ab2c0 con 0x7f454415bb20 2024-09-17T05:25:54.011 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.008+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45440cdf70 con 0x7f454415bb20 2024-09-17T05:25:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.009+0000 7f453a7fc640 1 -- 172.21.15.81:0/4246277501 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f453c039040 con 0x7f454415bb20 2024-09-17T05:25:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.010+0000 7f453a7fc640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4528079400 0x7f452807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.010+0000 7f453a7fc640 1 -- 172.21.15.81:0/4246277501 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f453c0bab10 con 0x7f454415bb20 2024-09-17T05:25:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.010+0000 7f4549af9640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4528079400 0x7f452807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:54.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.010+0000 7f4549af9640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4528079400 0x7f452807b8c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4540001220 tx=0x7f4540009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:54.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.014+0000 7f453a7fc640 1 -- 172.21.15.81:0/4246277501 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f453c084a10 con 0x7f454415bb20 2024-09-17T05:25:54.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.226+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f4544072ca0 con 0x7f454415bb20 2024-09-17T05:25:54.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.894+0000 7f453a7fc640 1 -- 172.21.15.81:0/4246277501 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v92) ==== 122+0+0 (secure 0 0 0) 0x7f453c084310 con 0x7f454415bb20 2024-09-17T05:25:54.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4528079400 msgr2=0x7f452807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:54.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4528079400 0x7f452807b8c0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f4540001220 tx=0x7f4540009040 comp rx=0 tx=0).stop 2024-09-17T05:25:54.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454415bb20 msgr2=0x7f45440ac560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:54.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454415bb20 0x7f45440ac560 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f453c02aea0 tx=0x7f453c0316f0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 shutdown_connections 2024-09-17T05:25:54.899 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f454415bb20 0x7f45440ac560 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45440cede0 0x7f45440ac020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4528079400 0x7f452807b8c0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 --2- 172.21.15.81:0/4246277501 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45440cdb90 0x7f4544152870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 >> 172.21.15.81:0/4246277501 conn(0x7f45440b1700 msgr2=0x7f45440b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 shutdown_connections 2024-09-17T05:25:54.900 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:54.898+0000 7f454bd5d640 1 -- 172.21.15.81:0/4246277501 wait complete. 2024-09-17T05:25:54.911 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:25:54.911 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:55.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.012+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3149159236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6de4004800 msgr2=0x7f6de4004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.013 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.012+0000 7f6dffb3a640 1 --2- 172.21.15.81:0/3149159236 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6de4004800 0x7f6de4004c80 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7f6de800bb20 tx=0x7f6de4005830 comp rx=0 tx=0).stop 2024-09-17T05:25:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.012+0000 7f6dfe0d7640 1 -- 172.21.15.81:0/3149159236 reap_dead start 2024-09-17T05:25:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.012+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3149159236 shutdown_connections 2024-09-17T05:25:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.012+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3149159236 >> 172.21.15.81:0/3149159236 conn(0x7f6df80741f0 msgr2=0x7f6df8074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.012+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3149159236 shutdown_connections 2024-09-17T05:25:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.012+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3149159236 wait complete. 2024-09-17T05:25:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.013+0000 7f6dffb3a640 1 Processor -- start 2024-09-17T05:25:55.014 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.013+0000 7f6dffb3a640 1 -- start start 2024-09-17T05:25:55.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dffb3a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de4004800 0x7f6df814eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dffb3a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6df81f7ba0 0x7f6df81f8020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dffb3a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df80c98b0 0x7f6df80c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dffb3a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6df8070b90 con 0x7f6df80c98b0 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dffb3a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6df8070a10 con 0x7f6de4004800 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dffb3a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6df8070d10 con 0x7f6df81f7ba0 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df80c98b0 0x7f6df80c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df80c98b0 0x7f6df80c9d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46120/0 (socket says 172.21.15.81:46120) 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 -- 172.21.15.81:0/3971955990 learned_addr learned my addr 172.21.15.81:0/3971955990 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 -- 172.21.15.81:0/3971955990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6df81f7ba0 msgr2=0x7f6df81f8020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6df81f7ba0 0x7f6df81f8020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 -- 172.21.15.81:0/3971955990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de4004800 msgr2=0x7f6df814eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de4004800 0x7f6df814eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.014+0000 7f6dfe0d7640 1 -- 172.21.15.81:0/3971955990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6df80ca620 con 0x7f6df80c98b0 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.015+0000 7f6dfe0d7640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df80c98b0 0x7f6df80c9d10 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f6df8074100 tx=0x7f6df0010f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.015+0000 7f6dee7fc640 1 -- 172.21.15.81:0/3971955990 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df000ec70 con 0x7f6df80c98b0 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.015+0000 7f6dee7fc640 1 -- 172.21.15.81:0/3971955990 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6df000ee30 con 0x7f6df80c98b0 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.015+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6df80b0d50 con 0x7f6df80c98b0 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.015+0000 7f6dee7fc640 1 -- 172.21.15.81:0/3971955990 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6df0004d60 con 0x7f6df80c98b0 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.015+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6df80b1310 con 0x7f6df80c98b0 2024-09-17T05:25:55.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.016+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6df80cafe0 con 0x7f6df80c98b0 2024-09-17T05:25:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.016+0000 7f6dee7fc640 1 -- 172.21.15.81:0/3971955990 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f6df001c020 con 0x7f6df80c98b0 2024-09-17T05:25:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.017+0000 7f6dee7fc640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ddc079400 0x7f6ddc07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.017+0000 7f6dee7fc640 1 -- 172.21.15.81:0/3971955990 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f6df0099760 con 0x7f6df80c98b0 2024-09-17T05:25:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.017+0000 7f6dfd8d6640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ddc079400 0x7f6ddc07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.019 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.018+0000 7f6dfd8d6640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ddc079400 0x7f6ddc07b8c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6df4001eb0 tx=0x7f6df4000f50 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:55.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.022+0000 7f6dee7fc640 1 -- 172.21.15.81:0/3971955990 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6df00a2080 con 0x7f6df80c98b0 2024-09-17T05:25:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.233+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6df815d050 con 0x7f6df80c98b0 2024-09-17T05:25:55.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.234+0000 7f6dee7fc640 1 -- 172.21.15.81:0/3971955990 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5233 (secure 0 0 0) 0x7f6df00636e0 con 0x7f6df80c98b0 2024-09-17T05:25:55.235 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:55.235 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"btime":"2024-09-17T05:25:54:889822+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2035889358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2035889358},{"type":"v1","addr":"172.21.15.160:6834","nonce":2035889358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3559863017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3559863017},{"type":"v1","addr":"172.21.15.81:6834","nonce":3559863017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3296945190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3296945190},{"type":"v1","addr":"172.21.15.81:6835","nonce":3296945190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:52.226778+0000","modified":"2024-09-17T05:25:54.227757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8853":{"gid":8853,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/3389320458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3389320458},{"type":"v1","addr":"172.21.15.160:6835","nonce":3389320458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8853,"qdb_cluster":[8853]},"id":12}]} 2024-09-17T05:25:55.235 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 92 2024-09-17T05:25:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ddc079400 msgr2=0x7f6ddc07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ddc079400 0x7f6ddc07b8c0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f6df4001eb0 tx=0x7f6df4000f50 comp rx=0 tx=0).stop 2024-09-17T05:25:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df80c98b0 msgr2=0x7f6df80c9d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df80c98b0 0x7f6df80c9d10 secure :-1 s=READY pgs=1712 cs=0 l=1 rev1=1 crypto rx=0x7f6df8074100 tx=0x7f6df0010f00 comp rx=0 tx=0).stop 2024-09-17T05:25:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 shutdown_connections 2024-09-17T05:25:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6df80c98b0 0x7f6df80c9d10 unknown :-1 s=CLOSED pgs=1712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.237 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6df81f7ba0 0x7f6df81f8020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ddc079400 0x7f6ddc07b8c0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 --2- 172.21.15.81:0/3971955990 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6de4004800 0x7f6df814eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 >> 172.21.15.81:0/3971955990 conn(0x7f6df80741f0 msgr2=0x7f6df80ae5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 shutdown_connections 2024-09-17T05:25:55.238 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.236+0000 7f6dffb3a640 1 -- 172.21.15.81:0/3971955990 wait complete. 2024-09-17T05:25:55.248 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:25:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.349+0000 7f5914a16640 1 -- 172.21.15.81:0/1027095203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 msgr2=0x7f58fc0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.349+0000 7f5914a16640 1 --2- 172.21.15.81:0/1027095203 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 0x7f58fc0051c0 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f5908005fd0 tx=0x7f58fc005830 comp rx=0 tx=0).stop 2024-09-17T05:25:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.349+0000 7f590ed9d640 1 -- 172.21.15.81:0/1027095203 reap_dead start 2024-09-17T05:25:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.349+0000 7f5914a16640 1 -- 172.21.15.81:0/1027095203 shutdown_connections 2024-09-17T05:25:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.349+0000 7f5914a16640 1 -- 172.21.15.81:0/1027095203 >> 172.21.15.81:0/1027095203 conn(0x7f59100d3ea0 msgr2=0x7f59100d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:55.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.349+0000 7f5914a16640 1 -- 172.21.15.81:0/1027095203 shutdown_connections 2024-09-17T05:25:55.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.349+0000 7f5914a16640 1 -- 172.21.15.81:0/1027095203 wait complete. 2024-09-17T05:25:55.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.350+0000 7f5914a16640 1 Processor -- start 2024-09-17T05:25:55.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.350+0000 7f5914a16640 1 -- start start 2024-09-17T05:25:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5914a16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 0x7f59100b0c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5914a16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cd370 0x7f59101613c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5914a16640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cd7f0 0x7f5910161900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5914a16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5910162690 con 0x7f58fc004d40 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5914a16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f59100cf9b0 con 0x7f59100cd370 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5914a16640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f59101f4c20 con 0x7f59100cd7f0 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 0x7f59100b0c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 0x7f59100b0c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46128/0 (socket says 172.21.15.81:46128) 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 -- 172.21.15.81:0/3294086953 learned_addr learned my addr 172.21.15.81:0/3294086953 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5907fff640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cd370 0x7f59101613c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590ed9d640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cd7f0 0x7f5910161900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 -- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cd7f0 msgr2=0x7f5910161900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cd7f0 0x7f5910161900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.354 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 -- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cd370 msgr2=0x7f59101613c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cd370 0x7f59101613c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 -- 172.21.15.81:0/3294086953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59100cdf80 con 0x7f58fc004d40 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f590e59c640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 0x7f59100b0c70 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5900006f30 tx=0x7f59000049d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5906ffd640 1 -- 172.21.15.81:0/3294086953 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900015020 con 0x7f58fc004d40 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5906ffd640 1 -- 172.21.15.81:0/3294086953 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5900010980 con 0x7f58fc004d40 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59101f4ea0 con 0x7f58fc004d40 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.351+0000 7f5906ffd640 1 -- 172.21.15.81:0/3294086953 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5900010d70 con 0x7f58fc004d40 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.352+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59101f5460 con 0x7f58fc004d40 2024-09-17T05:25:55.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.353+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59100d0630 con 0x7f58fc004d40 2024-09-17T05:25:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.353+0000 7f5906ffd640 1 -- 172.21.15.81:0/3294086953 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f5900018020 con 0x7f58fc004d40 2024-09-17T05:25:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.354+0000 7f5906ffd640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f58f0079400 0x7f58f007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.354+0000 7f5906ffd640 1 -- 172.21.15.81:0/3294086953 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f590009a180 con 0x7f58fc004d40 2024-09-17T05:25:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.354+0000 7f5907fff640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f58f0079400 0x7f58f007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.356 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.354+0000 7f5907fff640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f58f0079400 0x7f58f007b8c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f59101f5d90 tx=0x7f58f800b260 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:55.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.358+0000 7f5906ffd640 1 -- 172.21.15.81:0/3294086953 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f590001f020 con 0x7f58fc004d40 2024-09-17T05:25:55.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.536+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5910074720 con 0x7f58fc004d40 2024-09-17T05:25:55.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.537+0000 7f5906ffd640 1 -- 172.21.15.81:0/3294086953 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16851 (secure 0 0 0) 0x7f59100ce970 con 0x7f58fc004d40 2024-09-17T05:25:55.539 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:55.539 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":151,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:53.884202+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:50.832850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:51.191902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:25:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f58f0079400 msgr2=0x7f58f007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f58f0079400 0x7f58f007b8c0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f59101f5d90 tx=0x7f58f800b260 comp rx=0 tx=0).stop 2024-09-17T05:25:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 msgr2=0x7f59100b0c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 0x7f59100b0c70 secure :-1 s=READY pgs=1715 cs=0 l=1 rev1=1 crypto rx=0x7f5900006f30 tx=0x7f59000049d0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.541 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 shutdown_connections 2024-09-17T05:25:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59100cd7f0 0x7f5910161900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f58f0079400 0x7f58f007b8c0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59100cd370 0x7f59101613c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 --2- 172.21.15.81:0/3294086953 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f58fc004d40 0x7f59100b0c70 unknown :-1 s=CLOSED pgs=1715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 >> 172.21.15.81:0/3294086953 conn(0x7f59100d3ea0 msgr2=0x7f59100d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 shutdown_connections 2024-09-17T05:25:55.542 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.540+0000 7f5914a16640 1 -- 172.21.15.81:0/3294086953 wait complete. 2024-09-17T05:25:55.552 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:25:55.553 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 -- 172.21.15.81:0/1945756793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 msgr2=0x7fb7740b3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 --2- 172.21.15.81:0/1945756793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb7740b3800 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fb77408cf10 tx=0x7fb76c02a8b0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 -- 172.21.15.81:0/1945756793 shutdown_connections 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 --2- 172.21.15.81:0/1945756793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb7740b3800 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 --2- 172.21.15.81:0/1945756793 >> v2:172.21.15.160:3300/0 conn(0x7fb77415df90 0x7fb7740cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 -- 172.21.15.81:0/1945756793 >> 172.21.15.81:0/1945756793 conn(0x7fb7740d3ea0 msgr2=0x7fb7740d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 -- 172.21.15.81:0/1945756793 shutdown_connections 2024-09-17T05:25:55.654 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.652+0000 7fb77a952640 1 -- 172.21.15.81:0/1945756793 wait complete. 2024-09-17T05:25:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 Processor -- start 2024-09-17T05:25:55.655 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 -- start start 2024-09-17T05:25:55.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb77415f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7740d49c0 0x7fb774160b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb77415df90 0x7fb7740a0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb774162690 con 0x7fb7740d0d40 2024-09-17T05:25:55.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb7740b3d40 con 0x7fb7740d49c0 2024-09-17T05:25:55.657 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.654+0000 7fb77a952640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb7740b2d50 con 0x7fb77415df90 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb77415f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb77415f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46148/0 (socket says 172.21.15.81:46148) 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 -- 172.21.15.81:0/4244993063 learned_addr learned my addr 172.21.15.81:0/4244993063 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb778eef640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb77415df90 0x7fb7740a0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb7737fe640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7740d49c0 0x7fb774160b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 -- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb77415df90 msgr2=0x7fb7740a0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb77415df90 0x7fb7740a0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 -- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7740d49c0 msgr2=0x7fb774160b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7740d49c0 0x7fb774160b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 -- 172.21.15.81:0/4244993063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7741610d0 con 0x7fb7740d0d40 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb778eef640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb77415df90 0x7fb7740a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:55.658 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb7737fe640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7740d49c0 0x7fb774160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb773fff640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb77415f400 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c9a0 tx=0x7fb76400ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb770ff9640 1 -- 172.21.15.81:0/4244993063 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764007b50 con 0x7fb7740d0d40 2024-09-17T05:25:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb770ff9640 1 -- 172.21.15.81:0/4244993063 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb764007de0 con 0x7fb7740d0d40 2024-09-17T05:25:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb77415e680 con 0x7fb7740d0d40 2024-09-17T05:25:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb770ff9640 1 -- 172.21.15.81:0/4244993063 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb764005280 con 0x7fb7740d0d40 2024-09-17T05:25:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.655+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb77415ec00 con 0x7fb7740d0d40 2024-09-17T05:25:55.659 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.656+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7740b4260 con 0x7fb7740d0d40 2024-09-17T05:25:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.657+0000 7fb770ff9640 1 -- 172.21.15.81:0/4244993063 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fb764005420 con 0x7fb7740d0d40 2024-09-17T05:25:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.657+0000 7fb770ff9640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb760079400 0x7fb76007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.657+0000 7fb770ff9640 1 -- 172.21.15.81:0/4244993063 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7fb764099990 con 0x7fb7740d0d40 2024-09-17T05:25:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.657+0000 7fb7737fe640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb760079400 0x7fb76007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.660 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.658+0000 7fb7737fe640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb760079400 0x7fb76007b8c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b0f90 tx=0x7fb768009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:55.662 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.662+0000 7fb770ff9640 1 -- 172.21.15.81:0/4244993063 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb7741610d0 con 0x7fb7740d0d40 2024-09-17T05:25:55.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.835+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fb77408d590 con 0x7fb760079400 2024-09-17T05:25:55.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.838+0000 7fb770ff9640 1 -- 172.21.15.81:0/4244993063 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+237273 (secure 0 0 0) 0x7fb77408d590 con 0x7fb760079400 2024-09-17T05:25:55.842 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:55.843 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb760079400 msgr2=0x7fb76007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb760079400 0x7fb76007b8c0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7fb7740b0f90 tx=0x7fb768009040 comp rx=0 tx=0).stop 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 msgr2=0x7fb77415f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb77415f400 secure :-1 s=READY pgs=1718 cs=0 l=1 rev1=1 crypto rx=0x7fb76400c9a0 tx=0x7fb76400ce60 comp rx=0 tx=0).stop 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 shutdown_connections 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb77415df90 0x7fb7740a0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb760079400 0x7fb76007b8c0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb7740d49c0 0x7fb774160b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 --2- 172.21.15.81:0/4244993063 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb7740d0d40 0x7fb77415f400 unknown :-1 s=CLOSED pgs=1718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.845 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 >> 172.21.15.81:0/4244993063 conn(0x7fb7740d3ea0 msgr2=0x7fb7740b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:55.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 shutdown_connections 2024-09-17T05:25:55.846 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.842+0000 7fb77a952640 1 -- 172.21.15.81:0/4244993063 wait complete. 2024-09-17T05:25:55.854 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":178,"stamp":"2024-09-17T05:25:54.059400+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":35,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":264752,"kb_used_data":15220,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709968,"statfs":{"total":773094113280,"available":772823007232,"internally_reserved":0,"allocated":15585280,"data_stored":7514407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000552"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:51.871276+0000","last_change":"2024-09-17T05:25:51.871276+0000","last_active":"2024-09-17T05:25:51.871276+0000","last_peered":"2024-09-17T05:25:51.871276+0000","last_clean":"2024-09-17T05:25:51.871276+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:51.871276+0000","last_undegraded":"2024-09-17T05:25:51.871276+0000","last_fullsized":"2024-09-17T05:25:51.871276+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2024-09-17T05:25:50.861988+0000","last_change":"2024-09-17T05:25:50.861988+0000","last_active":"2024-09-17T05:25:50.861988+0000","last_peered":"2024-09-17T05:25:50.861988+0000","last_clean":"2024-09-17T05:25:50.861988+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2024-09-17T05:25:50.861988+0000","last_undegraded":"2024-09-17T05:25:50.861988+0000","last_fullsized":"2024-09-17T05:25:50.861988+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":356,"reported_epoch":143,"state":"active+clean","last_fresh":"2024-09-17T05:25:45.124279+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:25:45.124279+0000","last_peered":"2024-09-17T05:25:45.124279+0000","last_clean":"2024-09-17T05:25:45.124279+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:25:45.124279+0000","last_undegraded":"2024-09-17T05:25:45.124279+0000","last_fullsized":"2024-09-17T05:25:45.124279+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509531,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33528,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338312,"statfs":{"total":96636764160,"available":96602431488,"internally_reserved":0,"allocated":2392064,"data_stored":1381425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":791057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32956,"kb_used_data":1768,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338884,"statfs":{"total":96636764160,"available":96603017216,"internally_reserved":0,"allocated":1810432,"data_stored":796272,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":791057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":791057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":791057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509530,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":32948,"kb_used_data":1756,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338892,"statfs":{"total":96636764160,"available":96603025408,"internally_reserved":0,"allocated":1798144,"data_stored":791057,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574939,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33528,"kb_used_data":2336,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338312,"statfs":{"total":96636764160,"available":96602431488,"internally_reserved":0,"allocated":2392064,"data_stored":1381425,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:25:55.858 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:25:55.858 INFO:tasks.ceph.mds.b.smithi160.stderr:2024-09-17T05:25:55.853+0000 7f2924ada640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:25:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/1955513558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 msgr2=0x7f7d340cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/1955513558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d340cd3e0 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f7d340731e0 tx=0x7f7d2402a560 comp rx=0 tx=0).stop 2024-09-17T05:25:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/1955513558 shutdown_connections 2024-09-17T05:25:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/1955513558 >> v2:172.21.15.160:3300/0 conn(0x7f7d340ce780 0x7f7d340cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/1955513558 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d3406f490 0x7f7d340ce240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/1955513558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d340cd3e0 unknown :-1 s=CLOSED pgs=1719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/1955513558 >> 172.21.15.81:0/1955513558 conn(0x7f7d340741f0 msgr2=0x7f7d34074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/1955513558 shutdown_connections 2024-09-17T05:25:55.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.993+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/1955513558 wait complete. 2024-09-17T05:25:55.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.994+0000 7f7d3a9a3640 1 Processor -- start 2024-09-17T05:25:55.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.994+0000 7f7d3a9a3640 1 -- start start 2024-09-17T05:25:55.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d3a9a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d3415b890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d3a9a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d3406f490 0x7f7d341f6220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d3a9a3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d340ce780 0x7f7d341f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d3a9a3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3415e5e0 con 0x7f7d3406f0b0 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d3a9a3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7d3415e460 con 0x7f7d340ce780 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d3a9a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7d340cc0c0 con 0x7f7d3406f490 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d3415b890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d3415b890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46162/0 (socket says 172.21.15.81:46162) 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 -- 172.21.15.81:0/3303120100 learned_addr learned my addr 172.21.15.81:0/3303120100 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d38f40640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d340ce780 0x7f7d341f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d337fe640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d3406f490 0x7f7d341f6220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 -- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d3406f490 msgr2=0x7f7d341f6220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d3406f490 0x7f7d341f6220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 -- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d340ce780 msgr2=0x7f7d341f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d340ce780 0x7f7d341f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.995+0000 7f7d33fff640 1 -- 172.21.15.81:0/3303120100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d341553f0 con 0x7f7d3406f0b0 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.996+0000 7f7d33fff640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d3415b890 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7d24000c00 tx=0x7f7d24003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.996+0000 7f7d30ff9640 1 -- 172.21.15.81:0/3303120100 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d2403f070 con 0x7f7d3406f0b0 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.996+0000 7f7d30ff9640 1 -- 172.21.15.81:0/3303120100 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7d240047a0 con 0x7f7d3406f0b0 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.996+0000 7f7d30ff9640 1 -- 172.21.15.81:0/3303120100 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d24035030 con 0x7f7d3406f0b0 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.996+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d3415bdd0 con 0x7f7d3406f0b0 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.996+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d34158420 con 0x7f7d3406f0b0 2024-09-17T05:25:55.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.997+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d340cc560 con 0x7f7d3406f0b0 2024-09-17T05:25:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.997+0000 7f7d30ff9640 1 -- 172.21.15.81:0/3303120100 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f7d24042070 con 0x7f7d3406f0b0 2024-09-17T05:25:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.998+0000 7f7d30ff9640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d20079400 0x7f7d2007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.998+0000 7f7d30ff9640 1 -- 172.21.15.81:0/3303120100 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f7d240ba440 con 0x7f7d3406f0b0 2024-09-17T05:25:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.998+0000 7f7d337fe640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d20079400 0x7f7d2007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:56.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:55.998+0000 7f7d337fe640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d20079400 0x7f7d2007b8c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7d340cc980 tx=0x7f7d28005e50 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:56.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.002+0000 7f7d30ff9640 1 -- 172.21.15.81:0/3303120100 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7d240c1070 con 0x7f7d3406f0b0 2024-09-17T05:25:56.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.176+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7d340b2d10 con 0x7f7d20079400 2024-09-17T05:25:56.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.180+0000 7f7d30ff9640 1 -- 172.21.15.81:0/3303120100 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252476 (secure 0 0 0) 0x7f7d340b2d10 con 0x7f7d20079400 2024-09-17T05:25:56.183 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:56.184 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d20079400 msgr2=0x7f7d2007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d20079400 0x7f7d2007b8c0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7d340cc980 tx=0x7f7d28005e50 comp rx=0 tx=0).stop 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 msgr2=0x7f7d3415b890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d3415b890 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f7d24000c00 tx=0x7f7d24003910 comp rx=0 tx=0).stop 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 shutdown_connections 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7d20079400 0x7f7d2007b8c0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7d340ce780 0x7f7d341f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.186 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7d3406f490 0x7f7d341f6220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 --2- 172.21.15.81:0/3303120100 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7d3406f0b0 0x7f7d3415b890 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 >> 172.21.15.81:0/3303120100 conn(0x7f7d340741f0 msgr2=0x7f7d340cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:56.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 shutdown_connections 2024-09-17T05:25:56.187 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.183+0000 7f7d3a9a3640 1 -- 172.21.15.81:0/3303120100 wait complete. 2024-09-17T05:25:56.195 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":179,"stamp":"2024-09-17T05:25:56.059727+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":102,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":265544,"kb_used_data":16016,"kb_used_omap":12,"kb_used_meta":249331,"kb_avail":754709176,"statfs":{"total":773094113280,"available":772822196224,"internally_reserved":0,"allocated":16400384,"data_stored":7870284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":255315504},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.185523"},"pg_stats":[{"pgid":"25.3f","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324024+0000","last_change":"2024-09-17T05:25:52.893030+0000","last_active":"2024-09-17T05:25:54.324024+0000","last_peered":"2024-09-17T05:25:54.324024+0000","last_clean":"2024-09-17T05:25:54.324024+0000","last_became_active":"2024-09-17T05:25:52.892692+0000","last_became_peered":"2024-09-17T05:25:52.892692+0000","last_unstale":"2024-09-17T05:25:54.324024+0000","last_undegraded":"2024-09-17T05:25:54.324024+0000","last_fullsized":"2024-09-17T05:25:54.324024+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:06.754016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.3e","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324599+0000","last_change":"2024-09-17T05:25:52.890773+0000","last_active":"2024-09-17T05:25:54.324599+0000","last_peered":"2024-09-17T05:25:54.324599+0000","last_clean":"2024-09-17T05:25:54.324599+0000","last_became_active":"2024-09-17T05:25:52.889934+0000","last_became_peered":"2024-09-17T05:25:52.889934+0000","last_unstale":"2024-09-17T05:25:54.324599+0000","last_undegraded":"2024-09-17T05:25:54.324599+0000","last_fullsized":"2024-09-17T05:25:54.324599+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:09:50.137086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3d","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896929+0000","last_change":"2024-09-17T05:25:52.890628+0000","last_active":"2024-09-17T05:25:53.896929+0000","last_peered":"2024-09-17T05:25:53.896929+0000","last_clean":"2024-09-17T05:25:53.896929+0000","last_became_active":"2024-09-17T05:25:52.890380+0000","last_became_peered":"2024-09-17T05:25:52.890380+0000","last_unstale":"2024-09-17T05:25:53.896929+0000","last_undegraded":"2024-09-17T05:25:53.896929+0000","last_fullsized":"2024-09-17T05:25:53.896929+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:34:51.168716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.3c","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323658+0000","last_change":"2024-09-17T05:25:52.889425+0000","last_active":"2024-09-17T05:25:54.323658+0000","last_peered":"2024-09-17T05:25:54.323658+0000","last_clean":"2024-09-17T05:25:54.323658+0000","last_became_active":"2024-09-17T05:25:52.889122+0000","last_became_peered":"2024-09-17T05:25:52.889122+0000","last_unstale":"2024-09-17T05:25:54.323658+0000","last_undegraded":"2024-09-17T05:25:54.323658+0000","last_fullsized":"2024-09-17T05:25:54.323658+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:55:24.493942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.3b","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323966+0000","last_change":"2024-09-17T05:25:52.897061+0000","last_active":"2024-09-17T05:25:54.323966+0000","last_peered":"2024-09-17T05:25:54.323966+0000","last_clean":"2024-09-17T05:25:54.323966+0000","last_became_active":"2024-09-17T05:25:52.896771+0000","last_became_peered":"2024-09-17T05:25:52.896771+0000","last_unstale":"2024-09-17T05:25:54.323966+0000","last_undegraded":"2024-09-17T05:25:54.323966+0000","last_fullsized":"2024-09-17T05:25:54.323966+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:28.364215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.3a","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896640+0000","last_change":"2024-09-17T05:25:52.889935+0000","last_active":"2024-09-17T05:25:53.896640+0000","last_peered":"2024-09-17T05:25:53.896640+0000","last_clean":"2024-09-17T05:25:53.896640+0000","last_became_active":"2024-09-17T05:25:52.889674+0000","last_became_peered":"2024-09-17T05:25:52.889674+0000","last_unstale":"2024-09-17T05:25:53.896640+0000","last_undegraded":"2024-09-17T05:25:53.896640+0000","last_fullsized":"2024-09-17T05:25:53.896640+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:50.017773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.39","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899055+0000","last_change":"2024-09-17T05:25:52.899864+0000","last_active":"2024-09-17T05:25:53.899055+0000","last_peered":"2024-09-17T05:25:53.899055+0000","last_clean":"2024-09-17T05:25:53.899055+0000","last_became_active":"2024-09-17T05:25:52.899541+0000","last_became_peered":"2024-09-17T05:25:52.899541+0000","last_unstale":"2024-09-17T05:25:53.899055+0000","last_undegraded":"2024-09-17T05:25:53.899055+0000","last_fullsized":"2024-09-17T05:25:53.899055+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:18:59.942830+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.38","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324236+0000","last_change":"2024-09-17T05:25:52.891158+0000","last_active":"2024-09-17T05:25:54.324236+0000","last_peered":"2024-09-17T05:25:54.324236+0000","last_clean":"2024-09-17T05:25:54.324236+0000","last_became_active":"2024-09-17T05:25:52.890678+0000","last_became_peered":"2024-09-17T05:25:52.890678+0000","last_unstale":"2024-09-17T05:25:54.324236+0000","last_undegraded":"2024-09-17T05:25:54.324236+0000","last_fullsized":"2024-09-17T05:25:54.324236+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:32.573786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.37","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.325075+0000","last_change":"2024-09-17T05:25:52.893352+0000","last_active":"2024-09-17T05:25:54.325075+0000","last_peered":"2024-09-17T05:25:54.325075+0000","last_clean":"2024-09-17T05:25:54.325075+0000","last_became_active":"2024-09-17T05:25:52.892853+0000","last_became_peered":"2024-09-17T05:25:52.892853+0000","last_unstale":"2024-09-17T05:25:54.325075+0000","last_undegraded":"2024-09-17T05:25:54.325075+0000","last_fullsized":"2024-09-17T05:25:54.325075+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:05.601584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.36","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895833+0000","last_change":"2024-09-17T05:25:52.894625+0000","last_active":"2024-09-17T05:25:53.895833+0000","last_peered":"2024-09-17T05:25:53.895833+0000","last_clean":"2024-09-17T05:25:53.895833+0000","last_became_active":"2024-09-17T05:25:52.894296+0000","last_became_peered":"2024-09-17T05:25:52.894296+0000","last_unstale":"2024-09-17T05:25:53.895833+0000","last_undegraded":"2024-09-17T05:25:53.895833+0000","last_fullsized":"2024-09-17T05:25:53.895833+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:14:31.727333+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.35","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899114+0000","last_change":"2024-09-17T05:25:52.903057+0000","last_active":"2024-09-17T05:25:53.899114+0000","last_peered":"2024-09-17T05:25:53.899114+0000","last_clean":"2024-09-17T05:25:53.899114+0000","last_became_active":"2024-09-17T05:25:52.902513+0000","last_became_peered":"2024-09-17T05:25:52.902513+0000","last_unstale":"2024-09-17T05:25:53.899114+0000","last_undegraded":"2024-09-17T05:25:53.899114+0000","last_fullsized":"2024-09-17T05:25:53.899114+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:01:40.867315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.34","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324151+0000","last_change":"2024-09-17T05:25:52.893265+0000","last_active":"2024-09-17T05:25:54.324151+0000","last_peered":"2024-09-17T05:25:54.324151+0000","last_clean":"2024-09-17T05:25:54.324151+0000","last_became_active":"2024-09-17T05:25:52.892980+0000","last_became_peered":"2024-09-17T05:25:52.892980+0000","last_unstale":"2024-09-17T05:25:54.324151+0000","last_undegraded":"2024-09-17T05:25:54.324151+0000","last_fullsized":"2024-09-17T05:25:54.324151+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:59.066262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.33","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323589+0000","last_change":"2024-09-17T05:25:52.892340+0000","last_active":"2024-09-17T05:25:54.323589+0000","last_peered":"2024-09-17T05:25:54.323589+0000","last_clean":"2024-09-17T05:25:54.323589+0000","last_became_active":"2024-09-17T05:25:52.892071+0000","last_became_peered":"2024-09-17T05:25:52.892071+0000","last_unstale":"2024-09-17T05:25:54.323589+0000","last_undegraded":"2024-09-17T05:25:54.323589+0000","last_fullsized":"2024-09-17T05:25:54.323589+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:52:30.464416+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.32","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.325056+0000","last_change":"2024-09-17T05:25:52.897465+0000","last_active":"2024-09-17T05:25:54.325056+0000","last_peered":"2024-09-17T05:25:54.325056+0000","last_clean":"2024-09-17T05:25:54.325056+0000","last_became_active":"2024-09-17T05:25:52.897196+0000","last_became_peered":"2024-09-17T05:25:52.897196+0000","last_unstale":"2024-09-17T05:25:54.325056+0000","last_undegraded":"2024-09-17T05:25:54.325056+0000","last_fullsized":"2024-09-17T05:25:54.325056+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:58:21.865895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.31","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324680+0000","last_change":"2024-09-17T05:25:52.892421+0000","last_active":"2024-09-17T05:25:54.324680+0000","last_peered":"2024-09-17T05:25:54.324680+0000","last_clean":"2024-09-17T05:25:54.324680+0000","last_became_active":"2024-09-17T05:25:52.892120+0000","last_became_peered":"2024-09-17T05:25:52.892120+0000","last_unstale":"2024-09-17T05:25:54.324680+0000","last_undegraded":"2024-09-17T05:25:54.324680+0000","last_fullsized":"2024-09-17T05:25:54.324680+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:22.453456+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.30","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324138+0000","last_change":"2024-09-17T05:25:52.887375+0000","last_active":"2024-09-17T05:25:54.324138+0000","last_peered":"2024-09-17T05:25:54.324138+0000","last_clean":"2024-09-17T05:25:54.324138+0000","last_became_active":"2024-09-17T05:25:52.887086+0000","last_became_peered":"2024-09-17T05:25:52.887086+0000","last_unstale":"2024-09-17T05:25:54.324138+0000","last_undegraded":"2024-09-17T05:25:54.324138+0000","last_fullsized":"2024-09-17T05:25:54.324138+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:04:06.754016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2f","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324215+0000","last_change":"2024-09-17T05:25:52.886282+0000","last_active":"2024-09-17T05:25:54.324215+0000","last_peered":"2024-09-17T05:25:54.324215+0000","last_clean":"2024-09-17T05:25:54.324215+0000","last_became_active":"2024-09-17T05:25:52.885961+0000","last_became_peered":"2024-09-17T05:25:52.885961+0000","last_unstale":"2024-09-17T05:25:54.324215+0000","last_undegraded":"2024-09-17T05:25:54.324215+0000","last_fullsized":"2024-09-17T05:25:54.324215+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:26.649049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2e","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323682+0000","last_change":"2024-09-17T05:25:52.902056+0000","last_active":"2024-09-17T05:25:54.323682+0000","last_peered":"2024-09-17T05:25:54.323682+0000","last_clean":"2024-09-17T05:25:54.323682+0000","last_became_active":"2024-09-17T05:25:52.901790+0000","last_became_peered":"2024-09-17T05:25:52.901790+0000","last_unstale":"2024-09-17T05:25:54.323682+0000","last_undegraded":"2024-09-17T05:25:54.323682+0000","last_fullsized":"2024-09-17T05:25:54.323682+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:12.735180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.2d","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895712+0000","last_change":"2024-09-17T05:25:52.902711+0000","last_active":"2024-09-17T05:25:53.895712+0000","last_peered":"2024-09-17T05:25:53.895712+0000","last_clean":"2024-09-17T05:25:53.895712+0000","last_became_active":"2024-09-17T05:25:52.902250+0000","last_became_peered":"2024-09-17T05:25:52.902250+0000","last_unstale":"2024-09-17T05:25:53.895712+0000","last_undegraded":"2024-09-17T05:25:53.895712+0000","last_fullsized":"2024-09-17T05:25:53.895712+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:04.474729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.2c","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323558+0000","last_change":"2024-09-17T05:25:52.896535+0000","last_active":"2024-09-17T05:25:54.323558+0000","last_peered":"2024-09-17T05:25:54.323558+0000","last_clean":"2024-09-17T05:25:54.323558+0000","last_became_active":"2024-09-17T05:25:52.895497+0000","last_became_peered":"2024-09-17T05:25:52.895497+0000","last_unstale":"2024-09-17T05:25:54.323558+0000","last_undegraded":"2024-09-17T05:25:54.323558+0000","last_fullsized":"2024-09-17T05:25:54.323558+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:13.693234+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2b","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323815+0000","last_change":"2024-09-17T05:25:52.896284+0000","last_active":"2024-09-17T05:25:54.323815+0000","last_peered":"2024-09-17T05:25:54.323815+0000","last_clean":"2024-09-17T05:25:54.323815+0000","last_became_active":"2024-09-17T05:25:52.895979+0000","last_became_peered":"2024-09-17T05:25:52.895979+0000","last_unstale":"2024-09-17T05:25:54.323815+0000","last_undegraded":"2024-09-17T05:25:54.323815+0000","last_fullsized":"2024-09-17T05:25:54.323815+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:33:30.960375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.2a","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895464+0000","last_change":"2024-09-17T05:25:52.896017+0000","last_active":"2024-09-17T05:25:53.895464+0000","last_peered":"2024-09-17T05:25:53.895464+0000","last_clean":"2024-09-17T05:25:53.895464+0000","last_became_active":"2024-09-17T05:25:52.895467+0000","last_became_peered":"2024-09-17T05:25:52.895467+0000","last_unstale":"2024-09-17T05:25:53.895464+0000","last_undegraded":"2024-09-17T05:25:53.895464+0000","last_fullsized":"2024-09-17T05:25:53.895464+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:00:03.601332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.29","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896681+0000","last_change":"2024-09-17T05:25:52.889798+0000","last_active":"2024-09-17T05:25:53.896681+0000","last_peered":"2024-09-17T05:25:53.896681+0000","last_clean":"2024-09-17T05:25:53.896681+0000","last_became_active":"2024-09-17T05:25:52.889530+0000","last_became_peered":"2024-09-17T05:25:52.889530+0000","last_unstale":"2024-09-17T05:25:53.896681+0000","last_undegraded":"2024-09-17T05:25:53.896681+0000","last_fullsized":"2024-09-17T05:25:53.896681+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:39:28.868130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.28","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324317+0000","last_change":"2024-09-17T05:25:52.884535+0000","last_active":"2024-09-17T05:25:54.324317+0000","last_peered":"2024-09-17T05:25:54.324317+0000","last_clean":"2024-09-17T05:25:54.324317+0000","last_became_active":"2024-09-17T05:25:52.884315+0000","last_became_peered":"2024-09-17T05:25:52.884315+0000","last_unstale":"2024-09-17T05:25:54.324317+0000","last_undegraded":"2024-09-17T05:25:54.324317+0000","last_fullsized":"2024-09-17T05:25:54.324317+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:08.732317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.27","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.325052+0000","last_change":"2024-09-17T05:25:52.890759+0000","last_active":"2024-09-17T05:25:54.325052+0000","last_peered":"2024-09-17T05:25:54.325052+0000","last_clean":"2024-09-17T05:25:54.325052+0000","last_became_active":"2024-09-17T05:25:52.890238+0000","last_became_peered":"2024-09-17T05:25:52.890238+0000","last_unstale":"2024-09-17T05:25:54.325052+0000","last_undegraded":"2024-09-17T05:25:54.325052+0000","last_fullsized":"2024-09-17T05:25:54.325052+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:07:39.654075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.26","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899004+0000","last_change":"2024-09-17T05:25:52.900711+0000","last_active":"2024-09-17T05:25:53.899004+0000","last_peered":"2024-09-17T05:25:53.899004+0000","last_clean":"2024-09-17T05:25:53.899004+0000","last_became_active":"2024-09-17T05:25:52.900051+0000","last_became_peered":"2024-09-17T05:25:52.900051+0000","last_unstale":"2024-09-17T05:25:53.899004+0000","last_undegraded":"2024-09-17T05:25:53.899004+0000","last_fullsized":"2024-09-17T05:25:53.899004+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:03:46.563668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.25","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.897030+0000","last_change":"2024-09-17T05:25:52.891975+0000","last_active":"2024-09-17T05:25:53.897030+0000","last_peered":"2024-09-17T05:25:53.897030+0000","last_clean":"2024-09-17T05:25:53.897030+0000","last_became_active":"2024-09-17T05:25:52.891715+0000","last_became_peered":"2024-09-17T05:25:52.891715+0000","last_unstale":"2024-09-17T05:25:53.897030+0000","last_undegraded":"2024-09-17T05:25:53.897030+0000","last_fullsized":"2024-09-17T05:25:53.897030+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:00.027749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.24","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323668+0000","last_change":"2024-09-17T05:25:52.896260+0000","last_active":"2024-09-17T05:25:54.323668+0000","last_peered":"2024-09-17T05:25:54.323668+0000","last_clean":"2024-09-17T05:25:54.323668+0000","last_became_active":"2024-09-17T05:25:52.895138+0000","last_became_peered":"2024-09-17T05:25:52.895138+0000","last_unstale":"2024-09-17T05:25:54.323668+0000","last_undegraded":"2024-09-17T05:25:54.323668+0000","last_fullsized":"2024-09-17T05:25:54.323668+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:15:24.173309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.23","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323826+0000","last_change":"2024-09-17T05:25:52.895151+0000","last_active":"2024-09-17T05:25:54.323826+0000","last_peered":"2024-09-17T05:25:54.323826+0000","last_clean":"2024-09-17T05:25:54.323826+0000","last_became_active":"2024-09-17T05:25:52.894876+0000","last_became_peered":"2024-09-17T05:25:52.894876+0000","last_unstale":"2024-09-17T05:25:54.323826+0000","last_undegraded":"2024-09-17T05:25:54.323826+0000","last_fullsized":"2024-09-17T05:25:54.323826+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:24:07.547428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.22","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324912+0000","last_change":"2024-09-17T05:25:52.893345+0000","last_active":"2024-09-17T05:25:54.324912+0000","last_peered":"2024-09-17T05:25:54.324912+0000","last_clean":"2024-09-17T05:25:54.324912+0000","last_became_active":"2024-09-17T05:25:52.893078+0000","last_became_peered":"2024-09-17T05:25:52.893078+0000","last_unstale":"2024-09-17T05:25:54.324912+0000","last_undegraded":"2024-09-17T05:25:54.324912+0000","last_fullsized":"2024-09-17T05:25:54.324912+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:34:57.113391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.21","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896854+0000","last_change":"2024-09-17T05:25:52.893591+0000","last_active":"2024-09-17T05:25:53.896854+0000","last_peered":"2024-09-17T05:25:53.896854+0000","last_clean":"2024-09-17T05:25:53.896854+0000","last_became_active":"2024-09-17T05:25:52.893332+0000","last_became_peered":"2024-09-17T05:25:52.893332+0000","last_unstale":"2024-09-17T05:25:53.896854+0000","last_undegraded":"2024-09-17T05:25:53.896854+0000","last_fullsized":"2024-09-17T05:25:53.896854+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:42.341222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.20","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323424+0000","last_change":"2024-09-17T05:25:52.895301+0000","last_active":"2024-09-17T05:25:54.323424+0000","last_peered":"2024-09-17T05:25:54.323424+0000","last_clean":"2024-09-17T05:25:54.323424+0000","last_became_active":"2024-09-17T05:25:52.895029+0000","last_became_peered":"2024-09-17T05:25:52.895029+0000","last_unstale":"2024-09-17T05:25:54.323424+0000","last_undegraded":"2024-09-17T05:25:54.323424+0000","last_fullsized":"2024-09-17T05:25:54.323424+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:20:11.101493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1e","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324227+0000","last_change":"2024-09-17T05:25:52.892839+0000","last_active":"2024-09-17T05:25:54.324227+0000","last_peered":"2024-09-17T05:25:54.324227+0000","last_clean":"2024-09-17T05:25:54.324227+0000","last_became_active":"2024-09-17T05:25:52.892535+0000","last_became_peered":"2024-09-17T05:25:52.892535+0000","last_unstale":"2024-09-17T05:25:54.324227+0000","last_undegraded":"2024-09-17T05:25:54.324227+0000","last_fullsized":"2024-09-17T05:25:54.324227+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:20.531006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1f","version":"150'4","reported_seq":19,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323899+0000","last_change":"2024-09-17T05:25:51.886364+0000","last_active":"2024-09-17T05:25:54.323899+0000","last_peered":"2024-09-17T05:25:54.323899+0000","last_clean":"2024-09-17T05:25:54.323899+0000","last_became_active":"2024-09-17T05:25:51.886086+0000","last_became_peered":"2024-09-17T05:25:51.886086+0000","last_unstale":"2024-09-17T05:25:54.323899+0000","last_undegraded":"2024-09-17T05:25:54.323899+0000","last_fullsized":"2024-09-17T05:25:54.323899+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:48:53.453748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1f","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895983+0000","last_change":"2024-09-17T05:25:52.898282+0000","last_active":"2024-09-17T05:25:53.895983+0000","last_peered":"2024-09-17T05:25:53.895983+0000","last_clean":"2024-09-17T05:25:53.895983+0000","last_became_active":"2024-09-17T05:25:52.897694+0000","last_became_peered":"2024-09-17T05:25:52.897694+0000","last_unstale":"2024-09-17T05:25:53.895983+0000","last_undegraded":"2024-09-17T05:25:53.895983+0000","last_fullsized":"2024-09-17T05:25:53.895983+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:30.980988+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1e","version":"150'1","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324912+0000","last_change":"2024-09-17T05:25:51.886272+0000","last_active":"2024-09-17T05:25:54.324912+0000","last_peered":"2024-09-17T05:25:54.324912+0000","last_clean":"2024-09-17T05:25:54.324912+0000","last_became_active":"2024-09-17T05:25:51.885980+0000","last_became_peered":"2024-09-17T05:25:51.885980+0000","last_unstale":"2024-09-17T05:25:54.324912+0000","last_undegraded":"2024-09-17T05:25:54.324912+0000","last_fullsized":"2024-09-17T05:25:54.324912+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:33.806735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.1c","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899227+0000","last_change":"2024-09-17T05:25:52.899506+0000","last_active":"2024-09-17T05:25:53.899227+0000","last_peered":"2024-09-17T05:25:53.899227+0000","last_clean":"2024-09-17T05:25:53.899227+0000","last_became_active":"2024-09-17T05:25:52.899203+0000","last_became_peered":"2024-09-17T05:25:52.899203+0000","last_unstale":"2024-09-17T05:25:53.899227+0000","last_undegraded":"2024-09-17T05:25:53.899227+0000","last_fullsized":"2024-09-17T05:25:53.899227+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:05:18.546049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.1d","version":"150'2","reported_seq":17,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.897044+0000","last_change":"2024-09-17T05:25:51.890270+0000","last_active":"2024-09-17T05:25:53.897044+0000","last_peered":"2024-09-17T05:25:53.897044+0000","last_clean":"2024-09-17T05:25:53.897044+0000","last_became_active":"2024-09-17T05:25:51.890009+0000","last_became_peered":"2024-09-17T05:25:51.890009+0000","last_unstale":"2024-09-17T05:25:53.897044+0000","last_undegraded":"2024-09-17T05:25:53.897044+0000","last_fullsized":"2024-09-17T05:25:53.897044+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:14:14.239037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.1d","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324988+0000","last_change":"2024-09-17T05:25:52.894377+0000","last_active":"2024-09-17T05:25:54.324988+0000","last_peered":"2024-09-17T05:25:54.324988+0000","last_clean":"2024-09-17T05:25:54.324988+0000","last_became_active":"2024-09-17T05:25:52.892591+0000","last_became_peered":"2024-09-17T05:25:52.892591+0000","last_unstale":"2024-09-17T05:25:54.324988+0000","last_undegraded":"2024-09-17T05:25:54.324988+0000","last_fullsized":"2024-09-17T05:25:54.324988+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:36:04.398140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.1c","version":"150'2","reported_seq":17,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324163+0000","last_change":"2024-09-17T05:25:51.888391+0000","last_active":"2024-09-17T05:25:54.324163+0000","last_peered":"2024-09-17T05:25:54.324163+0000","last_clean":"2024-09-17T05:25:54.324163+0000","last_became_active":"2024-09-17T05:25:51.888135+0000","last_became_peered":"2024-09-17T05:25:51.888135+0000","last_unstale":"2024-09-17T05:25:54.324163+0000","last_undegraded":"2024-09-17T05:25:54.324163+0000","last_fullsized":"2024-09-17T05:25:54.324163+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:05.321948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1a","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895626+0000","last_change":"2024-09-17T05:25:52.895721+0000","last_active":"2024-09-17T05:25:53.895626+0000","last_peered":"2024-09-17T05:25:53.895626+0000","last_clean":"2024-09-17T05:25:53.895626+0000","last_became_active":"2024-09-17T05:25:52.895099+0000","last_became_peered":"2024-09-17T05:25:52.895099+0000","last_unstale":"2024-09-17T05:25:53.895626+0000","last_undegraded":"2024-09-17T05:25:53.895626+0000","last_fullsized":"2024-09-17T05:25:53.895626+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:54:08.477824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.1b","version":"150'1","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323922+0000","last_change":"2024-09-17T05:25:51.887676+0000","last_active":"2024-09-17T05:25:54.323922+0000","last_peered":"2024-09-17T05:25:54.323922+0000","last_clean":"2024-09-17T05:25:54.323922+0000","last_became_active":"2024-09-17T05:25:51.887438+0000","last_became_peered":"2024-09-17T05:25:51.887438+0000","last_unstale":"2024-09-17T05:25:54.323922+0000","last_undegraded":"2024-09-17T05:25:54.323922+0000","last_fullsized":"2024-09-17T05:25:54.323922+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:39:07.970556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.1b","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324225+0000","last_change":"2024-09-17T05:25:52.886594+0000","last_active":"2024-09-17T05:25:54.324225+0000","last_peered":"2024-09-17T05:25:54.324225+0000","last_clean":"2024-09-17T05:25:54.324225+0000","last_became_active":"2024-09-17T05:25:52.886326+0000","last_became_peered":"2024-09-17T05:25:52.886326+0000","last_unstale":"2024-09-17T05:25:54.324225+0000","last_undegraded":"2024-09-17T05:25:54.324225+0000","last_fullsized":"2024-09-17T05:25:54.324225+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:15.687411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.1a","version":"150'1","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323737+0000","last_change":"2024-09-17T05:25:51.890375+0000","last_active":"2024-09-17T05:25:54.323737+0000","last_peered":"2024-09-17T05:25:54.323737+0000","last_clean":"2024-09-17T05:25:54.323737+0000","last_became_active":"2024-09-17T05:25:51.890008+0000","last_became_peered":"2024-09-17T05:25:51.890008+0000","last_unstale":"2024-09-17T05:25:54.323737+0000","last_undegraded":"2024-09-17T05:25:54.323737+0000","last_fullsized":"2024-09-17T05:25:54.323737+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:13:37.169717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.19","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.898987+0000","last_change":"2024-09-17T05:25:52.895967+0000","last_active":"2024-09-17T05:25:53.898987+0000","last_peered":"2024-09-17T05:25:53.898987+0000","last_clean":"2024-09-17T05:25:53.898987+0000","last_became_active":"2024-09-17T05:25:52.895664+0000","last_became_peered":"2024-09-17T05:25:52.895664+0000","last_unstale":"2024-09-17T05:25:53.898987+0000","last_undegraded":"2024-09-17T05:25:53.898987+0000","last_fullsized":"2024-09-17T05:25:53.898987+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:39:32.903589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.18","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323196+0000","last_change":"2024-09-17T05:25:51.892652+0000","last_active":"2024-09-17T05:25:54.323196+0000","last_peered":"2024-09-17T05:25:54.323196+0000","last_clean":"2024-09-17T05:25:54.323196+0000","last_became_active":"2024-09-17T05:25:51.892331+0000","last_became_peered":"2024-09-17T05:25:51.892331+0000","last_unstale":"2024-09-17T05:25:54.323196+0000","last_undegraded":"2024-09-17T05:25:54.323196+0000","last_fullsized":"2024-09-17T05:25:54.323196+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:30:54.788687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.16","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.897300+0000","last_change":"2024-09-17T05:25:52.891998+0000","last_active":"2024-09-17T05:25:53.897300+0000","last_peered":"2024-09-17T05:25:53.897300+0000","last_clean":"2024-09-17T05:25:53.897300+0000","last_became_active":"2024-09-17T05:25:52.891729+0000","last_became_peered":"2024-09-17T05:25:52.891729+0000","last_unstale":"2024-09-17T05:25:53.897300+0000","last_undegraded":"2024-09-17T05:25:53.897300+0000","last_fullsized":"2024-09-17T05:25:53.897300+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:42:42.271215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.17","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899231+0000","last_change":"2024-09-17T05:25:51.889705+0000","last_active":"2024-09-17T05:25:53.899231+0000","last_peered":"2024-09-17T05:25:53.899231+0000","last_clean":"2024-09-17T05:25:53.899231+0000","last_became_active":"2024-09-17T05:25:51.889302+0000","last_became_peered":"2024-09-17T05:25:51.889302+0000","last_unstale":"2024-09-17T05:25:53.899231+0000","last_undegraded":"2024-09-17T05:25:53.899231+0000","last_fullsized":"2024-09-17T05:25:53.899231+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:40.539927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.17","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323935+0000","last_change":"2024-09-17T05:25:52.889982+0000","last_active":"2024-09-17T05:25:54.323935+0000","last_peered":"2024-09-17T05:25:54.323935+0000","last_clean":"2024-09-17T05:25:54.323935+0000","last_became_active":"2024-09-17T05:25:52.889730+0000","last_became_peered":"2024-09-17T05:25:52.889730+0000","last_unstale":"2024-09-17T05:25:54.323935+0000","last_undegraded":"2024-09-17T05:25:54.323935+0000","last_fullsized":"2024-09-17T05:25:54.323935+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:33.149083+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.16","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323752+0000","last_change":"2024-09-17T05:25:51.890737+0000","last_active":"2024-09-17T05:25:54.323752+0000","last_peered":"2024-09-17T05:25:54.323752+0000","last_clean":"2024-09-17T05:25:54.323752+0000","last_became_active":"2024-09-17T05:25:51.890501+0000","last_became_peered":"2024-09-17T05:25:51.890501+0000","last_unstale":"2024-09-17T05:25:54.323752+0000","last_undegraded":"2024-09-17T05:25:54.323752+0000","last_fullsized":"2024-09-17T05:25:54.323752+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:16:25.554393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.14","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899371+0000","last_change":"2024-09-17T05:25:52.902631+0000","last_active":"2024-09-17T05:25:53.899371+0000","last_peered":"2024-09-17T05:25:53.899371+0000","last_clean":"2024-09-17T05:25:53.899371+0000","last_became_active":"2024-09-17T05:25:52.902366+0000","last_became_peered":"2024-09-17T05:25:52.902366+0000","last_unstale":"2024-09-17T05:25:53.899371+0000","last_undegraded":"2024-09-17T05:25:53.899371+0000","last_fullsized":"2024-09-17T05:25:53.899371+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:58:35.076249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.15","version":"150'3","reported_seq":18,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323692+0000","last_change":"2024-09-17T05:25:51.885423+0000","last_active":"2024-09-17T05:25:54.323692+0000","last_peered":"2024-09-17T05:25:54.323692+0000","last_clean":"2024-09-17T05:25:54.323692+0000","last_became_active":"2024-09-17T05:25:51.885166+0000","last_became_peered":"2024-09-17T05:25:51.885166+0000","last_unstale":"2024-09-17T05:25:54.323692+0000","last_undegraded":"2024-09-17T05:25:54.323692+0000","last_fullsized":"2024-09-17T05:25:54.323692+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:33.424567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.15","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895888+0000","last_change":"2024-09-17T05:25:52.897015+0000","last_active":"2024-09-17T05:25:53.895888+0000","last_peered":"2024-09-17T05:25:53.895888+0000","last_clean":"2024-09-17T05:25:53.895888+0000","last_became_active":"2024-09-17T05:25:52.896635+0000","last_became_peered":"2024-09-17T05:25:52.896635+0000","last_unstale":"2024-09-17T05:25:53.895888+0000","last_undegraded":"2024-09-17T05:25:53.895888+0000","last_fullsized":"2024-09-17T05:25:53.895888+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:27.143793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.14","version":"150'6","reported_seq":21,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896838+0000","last_change":"2024-09-17T05:25:51.887896+0000","last_active":"2024-09-17T05:25:53.896838+0000","last_peered":"2024-09-17T05:25:53.896838+0000","last_clean":"2024-09-17T05:25:53.896838+0000","last_became_active":"2024-09-17T05:25:51.887643+0000","last_became_peered":"2024-09-17T05:25:51.887643+0000","last_unstale":"2024-09-17T05:25:53.896838+0000","last_undegraded":"2024-09-17T05:25:53.896838+0000","last_fullsized":"2024-09-17T05:25:53.896838+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:43.597035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.12","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896705+0000","last_change":"2024-09-17T05:25:52.892668+0000","last_active":"2024-09-17T05:25:53.896705+0000","last_peered":"2024-09-17T05:25:53.896705+0000","last_clean":"2024-09-17T05:25:53.896705+0000","last_became_active":"2024-09-17T05:25:52.892402+0000","last_became_peered":"2024-09-17T05:25:52.892402+0000","last_unstale":"2024-09-17T05:25:53.896705+0000","last_undegraded":"2024-09-17T05:25:53.896705+0000","last_fullsized":"2024-09-17T05:25:53.896705+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:11:12.061468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"24.13","version":"150'2","reported_seq":17,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323578+0000","last_change":"2024-09-17T05:25:51.886547+0000","last_active":"2024-09-17T05:25:54.323578+0000","last_peered":"2024-09-17T05:25:54.323578+0000","last_clean":"2024-09-17T05:25:54.323578+0000","last_became_active":"2024-09-17T05:25:51.886291+0000","last_became_peered":"2024-09-17T05:25:51.886291+0000","last_unstale":"2024-09-17T05:25:54.323578+0000","last_undegraded":"2024-09-17T05:25:54.323578+0000","last_fullsized":"2024-09-17T05:25:54.323578+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:02.675531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.13","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899198+0000","last_change":"2024-09-17T05:25:52.900612+0000","last_active":"2024-09-17T05:25:53.899198+0000","last_peered":"2024-09-17T05:25:53.899198+0000","last_clean":"2024-09-17T05:25:53.899198+0000","last_became_active":"2024-09-17T05:25:52.900273+0000","last_became_peered":"2024-09-17T05:25:52.900273+0000","last_unstale":"2024-09-17T05:25:53.899198+0000","last_undegraded":"2024-09-17T05:25:53.899198+0000","last_fullsized":"2024-09-17T05:25:53.899198+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:21:03.748061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.12","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895716+0000","last_change":"2024-09-17T05:25:51.893925+0000","last_active":"2024-09-17T05:25:53.895716+0000","last_peered":"2024-09-17T05:25:53.895716+0000","last_clean":"2024-09-17T05:25:53.895716+0000","last_became_active":"2024-09-17T05:25:51.893675+0000","last_became_peered":"2024-09-17T05:25:51.893675+0000","last_unstale":"2024-09-17T05:25:53.895716+0000","last_undegraded":"2024-09-17T05:25:53.895716+0000","last_fullsized":"2024-09-17T05:25:53.895716+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:58:37.797642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.10","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324571+0000","last_change":"2024-09-17T05:25:52.895847+0000","last_active":"2024-09-17T05:25:54.324571+0000","last_peered":"2024-09-17T05:25:54.324571+0000","last_clean":"2024-09-17T05:25:54.324571+0000","last_became_active":"2024-09-17T05:25:52.895566+0000","last_became_peered":"2024-09-17T05:25:52.895566+0000","last_unstale":"2024-09-17T05:25:54.324571+0000","last_undegraded":"2024-09-17T05:25:54.324571+0000","last_fullsized":"2024-09-17T05:25:54.324571+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:01.500210+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.11","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323402+0000","last_change":"2024-09-17T05:25:51.891736+0000","last_active":"2024-09-17T05:25:54.323402+0000","last_peered":"2024-09-17T05:25:54.323402+0000","last_clean":"2024-09-17T05:25:54.323402+0000","last_became_active":"2024-09-17T05:25:51.891490+0000","last_became_peered":"2024-09-17T05:25:51.891490+0000","last_unstale":"2024-09-17T05:25:54.323402+0000","last_undegraded":"2024-09-17T05:25:54.323402+0000","last_fullsized":"2024-09-17T05:25:54.323402+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:04.638997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.11","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895456+0000","last_change":"2024-09-17T05:25:52.898705+0000","last_active":"2024-09-17T05:25:53.895456+0000","last_peered":"2024-09-17T05:25:53.895456+0000","last_clean":"2024-09-17T05:25:53.895456+0000","last_became_active":"2024-09-17T05:25:52.898323+0000","last_became_peered":"2024-09-17T05:25:52.898323+0000","last_unstale":"2024-09-17T05:25:53.895456+0000","last_undegraded":"2024-09-17T05:25:53.895456+0000","last_fullsized":"2024-09-17T05:25:53.895456+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:58:48.228025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.10","version":"150'8","reported_seq":23,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323754+0000","last_change":"2024-09-17T05:25:51.892676+0000","last_active":"2024-09-17T05:25:54.323754+0000","last_peered":"2024-09-17T05:25:54.323754+0000","last_clean":"2024-09-17T05:25:54.323754+0000","last_became_active":"2024-09-17T05:25:51.892392+0000","last_became_peered":"2024-09-17T05:25:51.892392+0000","last_unstale":"2024-09-17T05:25:54.323754+0000","last_undegraded":"2024-09-17T05:25:54.323754+0000","last_fullsized":"2024-09-17T05:25:54.323754+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:31.646627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.e","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895931+0000","last_change":"2024-09-17T05:25:52.898275+0000","last_active":"2024-09-17T05:25:53.895931+0000","last_peered":"2024-09-17T05:25:53.895931+0000","last_clean":"2024-09-17T05:25:53.895931+0000","last_became_active":"2024-09-17T05:25:52.897839+0000","last_became_peered":"2024-09-17T05:25:52.897839+0000","last_unstale":"2024-09-17T05:25:53.895931+0000","last_undegraded":"2024-09-17T05:25:53.895931+0000","last_fullsized":"2024-09-17T05:25:53.895931+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:50:24.655984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.f","version":"150'1","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323995+0000","last_change":"2024-09-17T05:25:51.888660+0000","last_active":"2024-09-17T05:25:54.323995+0000","last_peered":"2024-09-17T05:25:54.323995+0000","last_clean":"2024-09-17T05:25:54.323995+0000","last_became_active":"2024-09-17T05:25:51.888408+0000","last_became_peered":"2024-09-17T05:25:51.888408+0000","last_unstale":"2024-09-17T05:25:54.323995+0000","last_undegraded":"2024-09-17T05:25:54.323995+0000","last_fullsized":"2024-09-17T05:25:54.323995+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:00.971912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.f","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.325235+0000","last_change":"2024-09-17T05:25:52.896660+0000","last_active":"2024-09-17T05:25:54.325235+0000","last_peered":"2024-09-17T05:25:54.325235+0000","last_clean":"2024-09-17T05:25:54.325235+0000","last_became_active":"2024-09-17T05:25:52.896409+0000","last_became_peered":"2024-09-17T05:25:52.896409+0000","last_unstale":"2024-09-17T05:25:54.325235+0000","last_undegraded":"2024-09-17T05:25:54.325235+0000","last_fullsized":"2024-09-17T05:25:54.325235+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:51:41.549215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.e","version":"150'2","reported_seq":17,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324331+0000","last_change":"2024-09-17T05:25:51.888046+0000","last_active":"2024-09-17T05:25:54.324331+0000","last_peered":"2024-09-17T05:25:54.324331+0000","last_clean":"2024-09-17T05:25:54.324331+0000","last_became_active":"2024-09-17T05:25:51.887785+0000","last_became_peered":"2024-09-17T05:25:51.887785+0000","last_unstale":"2024-09-17T05:25:54.324331+0000","last_undegraded":"2024-09-17T05:25:54.324331+0000","last_fullsized":"2024-09-17T05:25:54.324331+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:31:11.009146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.c","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.325050+0000","last_change":"2024-09-17T05:25:52.894397+0000","last_active":"2024-09-17T05:25:54.325050+0000","last_peered":"2024-09-17T05:25:54.325050+0000","last_clean":"2024-09-17T05:25:54.325050+0000","last_became_active":"2024-09-17T05:25:52.894090+0000","last_became_peered":"2024-09-17T05:25:52.894090+0000","last_unstale":"2024-09-17T05:25:54.325050+0000","last_undegraded":"2024-09-17T05:25:54.325050+0000","last_fullsized":"2024-09-17T05:25:54.325050+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:08:55.325361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"24.d","version":"150'1","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323701+0000","last_change":"2024-09-17T05:25:51.885426+0000","last_active":"2024-09-17T05:25:54.323701+0000","last_peered":"2024-09-17T05:25:54.323701+0000","last_clean":"2024-09-17T05:25:54.323701+0000","last_became_active":"2024-09-17T05:25:51.885147+0000","last_became_peered":"2024-09-17T05:25:51.885147+0000","last_unstale":"2024-09-17T05:25:54.323701+0000","last_undegraded":"2024-09-17T05:25:54.323701+0000","last_fullsized":"2024-09-17T05:25:54.323701+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:28.841432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.d","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324896+0000","last_change":"2024-09-17T05:25:52.890471+0000","last_active":"2024-09-17T05:25:54.324896+0000","last_peered":"2024-09-17T05:25:54.324896+0000","last_clean":"2024-09-17T05:25:54.324896+0000","last_became_active":"2024-09-17T05:25:52.889633+0000","last_became_peered":"2024-09-17T05:25:52.889633+0000","last_unstale":"2024-09-17T05:25:54.324896+0000","last_undegraded":"2024-09-17T05:25:54.324896+0000","last_fullsized":"2024-09-17T05:25:54.324896+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:25:35.650836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.c","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899400+0000","last_change":"2024-09-17T05:25:51.890844+0000","last_active":"2024-09-17T05:25:53.899400+0000","last_peered":"2024-09-17T05:25:53.899400+0000","last_clean":"2024-09-17T05:25:53.899400+0000","last_became_active":"2024-09-17T05:25:51.890548+0000","last_became_peered":"2024-09-17T05:25:51.890548+0000","last_unstale":"2024-09-17T05:25:53.899400+0000","last_undegraded":"2024-09-17T05:25:53.899400+0000","last_fullsized":"2024-09-17T05:25:53.899400+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:23.152097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"25.a","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895658+0000","last_change":"2024-09-17T05:25:52.897561+0000","last_active":"2024-09-17T05:25:53.895658+0000","last_peered":"2024-09-17T05:25:53.895658+0000","last_clean":"2024-09-17T05:25:53.895658+0000","last_became_active":"2024-09-17T05:25:52.897097+0000","last_became_peered":"2024-09-17T05:25:52.897097+0000","last_unstale":"2024-09-17T05:25:53.895658+0000","last_undegraded":"2024-09-17T05:25:53.895658+0000","last_fullsized":"2024-09-17T05:25:53.895658+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:49:25.116539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.b","version":"150'2","reported_seq":17,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896511+0000","last_change":"2024-09-17T05:25:51.891855+0000","last_active":"2024-09-17T05:25:53.896511+0000","last_peered":"2024-09-17T05:25:53.896511+0000","last_clean":"2024-09-17T05:25:53.896511+0000","last_became_active":"2024-09-17T05:25:51.891367+0000","last_became_peered":"2024-09-17T05:25:51.891367+0000","last_unstale":"2024-09-17T05:25:53.896511+0000","last_undegraded":"2024-09-17T05:25:53.896511+0000","last_fullsized":"2024-09-17T05:25:53.896511+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:48:38.731435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.b","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.899341+0000","last_change":"2024-09-17T05:25:52.895201+0000","last_active":"2024-09-17T05:25:53.899341+0000","last_peered":"2024-09-17T05:25:53.899341+0000","last_clean":"2024-09-17T05:25:53.899341+0000","last_became_active":"2024-09-17T05:25:52.894896+0000","last_became_peered":"2024-09-17T05:25:52.894896+0000","last_unstale":"2024-09-17T05:25:53.899341+0000","last_undegraded":"2024-09-17T05:25:53.899341+0000","last_fullsized":"2024-09-17T05:25:53.899341+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:26:44.351597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"24.a","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323555+0000","last_change":"2024-09-17T05:25:51.892153+0000","last_active":"2024-09-17T05:25:54.323555+0000","last_peered":"2024-09-17T05:25:54.323555+0000","last_clean":"2024-09-17T05:25:54.323555+0000","last_became_active":"2024-09-17T05:25:51.891896+0000","last_became_peered":"2024-09-17T05:25:51.891896+0000","last_unstale":"2024-09-17T05:25:54.323555+0000","last_undegraded":"2024-09-17T05:25:54.323555+0000","last_fullsized":"2024-09-17T05:25:54.323555+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:22:03.853824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"25.8","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324254+0000","last_change":"2024-09-17T05:25:52.896305+0000","last_active":"2024-09-17T05:25:54.324254+0000","last_peered":"2024-09-17T05:25:54.324254+0000","last_clean":"2024-09-17T05:25:54.324254+0000","last_became_active":"2024-09-17T05:25:52.893644+0000","last_became_peered":"2024-09-17T05:25:52.893644+0000","last_unstale":"2024-09-17T05:25:54.324254+0000","last_undegraded":"2024-09-17T05:25:54.324254+0000","last_fullsized":"2024-09-17T05:25:54.324254+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:14.256672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.9","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896942+0000","last_change":"2024-09-17T05:25:51.891760+0000","last_active":"2024-09-17T05:25:53.896942+0000","last_peered":"2024-09-17T05:25:53.896942+0000","last_clean":"2024-09-17T05:25:53.896942+0000","last_became_active":"2024-09-17T05:25:51.891501+0000","last_became_peered":"2024-09-17T05:25:51.891501+0000","last_unstale":"2024-09-17T05:25:53.896942+0000","last_undegraded":"2024-09-17T05:25:53.896942+0000","last_fullsized":"2024-09-17T05:25:53.896942+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:29.013263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.9","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323579+0000","last_change":"2024-09-17T05:25:52.891097+0000","last_active":"2024-09-17T05:25:54.323579+0000","last_peered":"2024-09-17T05:25:54.323579+0000","last_clean":"2024-09-17T05:25:54.323579+0000","last_became_active":"2024-09-17T05:25:52.890820+0000","last_became_peered":"2024-09-17T05:25:52.890820+0000","last_unstale":"2024-09-17T05:25:54.323579+0000","last_undegraded":"2024-09-17T05:25:54.323579+0000","last_fullsized":"2024-09-17T05:25:54.323579+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:27:00.959448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.8","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324709+0000","last_change":"2024-09-17T05:25:51.883138+0000","last_active":"2024-09-17T05:25:54.324709+0000","last_peered":"2024-09-17T05:25:54.324709+0000","last_clean":"2024-09-17T05:25:54.324709+0000","last_became_active":"2024-09-17T05:25:51.882778+0000","last_became_peered":"2024-09-17T05:25:51.882778+0000","last_unstale":"2024-09-17T05:25:54.324709+0000","last_undegraded":"2024-09-17T05:25:54.324709+0000","last_fullsized":"2024-09-17T05:25:54.324709+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:13:49.792669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.6","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323653+0000","last_change":"2024-09-17T05:25:52.889017+0000","last_active":"2024-09-17T05:25:54.323653+0000","last_peered":"2024-09-17T05:25:54.323653+0000","last_clean":"2024-09-17T05:25:54.323653+0000","last_became_active":"2024-09-17T05:25:52.888742+0000","last_became_peered":"2024-09-17T05:25:52.888742+0000","last_unstale":"2024-09-17T05:25:54.323653+0000","last_undegraded":"2024-09-17T05:25:54.323653+0000","last_fullsized":"2024-09-17T05:25:54.323653+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:17:41.150310+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.7","version":"150'2","reported_seq":17,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324141+0000","last_change":"2024-09-17T05:25:51.887239+0000","last_active":"2024-09-17T05:25:54.324141+0000","last_peered":"2024-09-17T05:25:54.324141+0000","last_clean":"2024-09-17T05:25:54.324141+0000","last_became_active":"2024-09-17T05:25:51.886977+0000","last_became_peered":"2024-09-17T05:25:51.886977+0000","last_unstale":"2024-09-17T05:25:54.324141+0000","last_undegraded":"2024-09-17T05:25:54.324141+0000","last_fullsized":"2024-09-17T05:25:54.324141+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:19.498042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"25.7","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895976+0000","last_change":"2024-09-17T05:25:52.892328+0000","last_active":"2024-09-17T05:25:53.895976+0000","last_peered":"2024-09-17T05:25:53.895976+0000","last_clean":"2024-09-17T05:25:53.895976+0000","last_became_active":"2024-09-17T05:25:52.892068+0000","last_became_peered":"2024-09-17T05:25:52.892068+0000","last_unstale":"2024-09-17T05:25:53.895976+0000","last_undegraded":"2024-09-17T05:25:53.895976+0000","last_fullsized":"2024-09-17T05:25:53.895976+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:03:33.287922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.6","version":"150'1","reported_seq":16,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895942+0000","last_change":"2024-09-17T05:25:51.893055+0000","last_active":"2024-09-17T05:25:53.895942+0000","last_peered":"2024-09-17T05:25:53.895942+0000","last_clean":"2024-09-17T05:25:53.895942+0000","last_became_active":"2024-09-17T05:25:51.892785+0000","last_became_peered":"2024-09-17T05:25:51.892785+0000","last_unstale":"2024-09-17T05:25:53.895942+0000","last_undegraded":"2024-09-17T05:25:53.895942+0000","last_fullsized":"2024-09-17T05:25:53.895942+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:21:42.658729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.4","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323976+0000","last_change":"2024-09-17T05:25:52.887923+0000","last_active":"2024-09-17T05:25:54.323976+0000","last_peered":"2024-09-17T05:25:54.323976+0000","last_clean":"2024-09-17T05:25:54.323976+0000","last_became_active":"2024-09-17T05:25:52.887674+0000","last_became_peered":"2024-09-17T05:25:52.887674+0000","last_unstale":"2024-09-17T05:25:54.323976+0000","last_undegraded":"2024-09-17T05:25:54.323976+0000","last_fullsized":"2024-09-17T05:25:54.323976+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:18.968239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.5","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895807+0000","last_change":"2024-09-17T05:25:51.893371+0000","last_active":"2024-09-17T05:25:53.895807+0000","last_peered":"2024-09-17T05:25:53.895807+0000","last_clean":"2024-09-17T05:25:53.895807+0000","last_became_active":"2024-09-17T05:25:51.892482+0000","last_became_peered":"2024-09-17T05:25:51.892482+0000","last_unstale":"2024-09-17T05:25:53.895807+0000","last_undegraded":"2024-09-17T05:25:53.895807+0000","last_fullsized":"2024-09-17T05:25:53.895807+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:04.428761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"25.5","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324051+0000","last_change":"2024-09-17T05:25:52.892100+0000","last_active":"2024-09-17T05:25:54.324051+0000","last_peered":"2024-09-17T05:25:54.324051+0000","last_clean":"2024-09-17T05:25:54.324051+0000","last_became_active":"2024-09-17T05:25:52.891850+0000","last_became_peered":"2024-09-17T05:25:52.891850+0000","last_unstale":"2024-09-17T05:25:54.324051+0000","last_undegraded":"2024-09-17T05:25:54.324051+0000","last_fullsized":"2024-09-17T05:25:54.324051+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:46:12.735180+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"24.4","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324072+0000","last_change":"2024-09-17T05:25:51.888814+0000","last_active":"2024-09-17T05:25:54.324072+0000","last_peered":"2024-09-17T05:25:54.324072+0000","last_clean":"2024-09-17T05:25:54.324072+0000","last_became_active":"2024-09-17T05:25:51.888571+0000","last_became_peered":"2024-09-17T05:25:51.888571+0000","last_unstale":"2024-09-17T05:25:54.324072+0000","last_undegraded":"2024-09-17T05:25:54.324072+0000","last_fullsized":"2024-09-17T05:25:54.324072+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:51:32.093371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"25.2","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324106+0000","last_change":"2024-09-17T05:25:52.898482+0000","last_active":"2024-09-17T05:25:54.324106+0000","last_peered":"2024-09-17T05:25:54.324106+0000","last_clean":"2024-09-17T05:25:54.324106+0000","last_became_active":"2024-09-17T05:25:52.897732+0000","last_became_peered":"2024-09-17T05:25:52.897732+0000","last_unstale":"2024-09-17T05:25:54.324106+0000","last_undegraded":"2024-09-17T05:25:54.324106+0000","last_fullsized":"2024-09-17T05:25:54.324106+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:17:15.687411+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.3","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324623+0000","last_change":"2024-09-17T05:25:51.889241+0000","last_active":"2024-09-17T05:25:54.324623+0000","last_peered":"2024-09-17T05:25:54.324623+0000","last_clean":"2024-09-17T05:25:54.324623+0000","last_became_active":"2024-09-17T05:25:51.888979+0000","last_became_peered":"2024-09-17T05:25:51.888979+0000","last_unstale":"2024-09-17T05:25:54.324623+0000","last_undegraded":"2024-09-17T05:25:54.324623+0000","last_fullsized":"2024-09-17T05:25:54.324623+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:15.724840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.3","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323616+0000","last_change":"2024-09-17T05:25:52.898435+0000","last_active":"2024-09-17T05:25:54.323616+0000","last_peered":"2024-09-17T05:25:54.323616+0000","last_clean":"2024-09-17T05:25:54.323616+0000","last_became_active":"2024-09-17T05:25:52.898094+0000","last_became_peered":"2024-09-17T05:25:52.898094+0000","last_unstale":"2024-09-17T05:25:54.323616+0000","last_undegraded":"2024-09-17T05:25:54.323616+0000","last_fullsized":"2024-09-17T05:25:54.323616+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:48:18.968239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"24.2","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.325035+0000","last_change":"2024-09-17T05:25:51.888444+0000","last_active":"2024-09-17T05:25:54.325035+0000","last_peered":"2024-09-17T05:25:54.325035+0000","last_clean":"2024-09-17T05:25:54.325035+0000","last_became_active":"2024-09-17T05:25:51.888159+0000","last_became_peered":"2024-09-17T05:25:51.888159+0000","last_unstale":"2024-09-17T05:25:54.325035+0000","last_undegraded":"2024-09-17T05:25:54.325035+0000","last_fullsized":"2024-09-17T05:25:54.325035+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:15.464985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"25.0","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324299+0000","last_change":"2024-09-17T05:25:52.890982+0000","last_active":"2024-09-17T05:25:54.324299+0000","last_peered":"2024-09-17T05:25:54.324299+0000","last_clean":"2024-09-17T05:25:54.324299+0000","last_became_active":"2024-09-17T05:25:52.890666+0000","last_became_peered":"2024-09-17T05:25:52.890666+0000","last_unstale":"2024-09-17T05:25:54.324299+0000","last_undegraded":"2024-09-17T05:25:54.324299+0000","last_fullsized":"2024-09-17T05:25:54.324299+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:26.654534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"24.1","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.324788+0000","last_change":"2024-09-17T05:25:51.887614+0000","last_active":"2024-09-17T05:25:54.324788+0000","last_peered":"2024-09-17T05:25:54.324788+0000","last_clean":"2024-09-17T05:25:54.324788+0000","last_became_active":"2024-09-17T05:25:51.887348+0000","last_became_peered":"2024-09-17T05:25:51.887348+0000","last_unstale":"2024-09-17T05:25:54.324788+0000","last_undegraded":"2024-09-17T05:25:54.324788+0000","last_fullsized":"2024-09-17T05:25:54.324788+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:25.377917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"25.1","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323925+0000","last_change":"2024-09-17T05:25:52.894584+0000","last_active":"2024-09-17T05:25:54.323925+0000","last_peered":"2024-09-17T05:25:54.323925+0000","last_clean":"2024-09-17T05:25:54.323925+0000","last_became_active":"2024-09-17T05:25:52.894293+0000","last_became_peered":"2024-09-17T05:25:52.894293+0000","last_unstale":"2024-09-17T05:25:54.323925+0000","last_undegraded":"2024-09-17T05:25:54.323925+0000","last_fullsized":"2024-09-17T05:25:54.323925+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:56:53.593378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"24.0","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.896497+0000","last_change":"2024-09-17T05:25:51.885359+0000","last_active":"2024-09-17T05:25:53.896497+0000","last_peered":"2024-09-17T05:25:53.896497+0000","last_clean":"2024-09-17T05:25:53.896497+0000","last_became_active":"2024-09-17T05:25:51.885093+0000","last_became_peered":"2024-09-17T05:25:51.885093+0000","last_unstale":"2024-09-17T05:25:53.896497+0000","last_undegraded":"2024-09-17T05:25:53.896497+0000","last_fullsized":"2024-09-17T05:25:53.896497+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:23.152097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"25.18","version":"0'0","reported_seq":13,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:53.895340+0000","last_change":"2024-09-17T05:25:52.891848+0000","last_active":"2024-09-17T05:25:53.895340+0000","last_peered":"2024-09-17T05:25:53.895340+0000","last_clean":"2024-09-17T05:25:53.895340+0000","last_became_active":"2024-09-17T05:25:52.891535+0000","last_became_peered":"2024-09-17T05:25:52.891535+0000","last_unstale":"2024-09-17T05:25:53.895340+0000","last_undegraded":"2024-09-17T05:25:53.895340+0000","last_fullsized":"2024-09-17T05:25:53.895340+0000","mapping_epoch":149,"log_start":"0'0","ondisk_log_start":"0'0","created":149,"last_epoch_clean":150,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:51.871276+0000","last_clean_scrub_stamp":"2024-09-17T05:25:51.871276+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:04:11.804611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"24.19","version":"0'0","reported_seq":15,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323433+0000","last_change":"2024-09-17T05:25:51.888069+0000","last_active":"2024-09-17T05:25:54.323433+0000","last_peered":"2024-09-17T05:25:54.323433+0000","last_clean":"2024-09-17T05:25:54.323433+0000","last_became_active":"2024-09-17T05:25:51.887754+0000","last_became_peered":"2024-09-17T05:25:51.887754+0000","last_unstale":"2024-09-17T05:25:54.323433+0000","last_undegraded":"2024-09-17T05:25:54.323433+0000","last_fullsized":"2024-09-17T05:25:54.323433+0000","mapping_epoch":148,"log_start":"0'0","ondisk_log_start":"0'0","created":148,"last_epoch_clean":149,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:25:50.861988+0000","last_clean_scrub_stamp":"2024-09-17T05:25:50.861988+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:02.904788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":369,"reported_epoch":151,"state":"active+clean","last_fresh":"2024-09-17T05:25:54.323263+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:25:54.323263+0000","last_peered":"2024-09-17T05:25:54.323263+0000","last_clean":"2024-09-17T05:25:54.323263+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:25:54.323263+0000","last_undegraded":"2024-09-17T05:25:54.323263+0000","last_fullsized":"2024-09-17T05:25:54.323263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":25,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":24,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509532,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33616,"kb_used_data":2428,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338224,"statfs":{"total":96636764160,"available":96602341376,"internally_reserved":0,"allocated":2486272,"data_stored":1421284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509532,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33048,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338792,"statfs":{"total":96636764160,"available":96602923008,"internally_reserved":0,"allocated":1896448,"data_stored":837184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509531,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33040,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338800,"statfs":{"total":96636764160,"available":96602931200,"internally_reserved":0,"allocated":1896448,"data_stored":837184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509531,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33056,"kb_used_data":1868,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338784,"statfs":{"total":96636764160,"available":96602914816,"internally_reserved":0,"allocated":1912832,"data_stored":839378,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509531,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33044,"kb_used_data":1852,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338796,"statfs":{"total":96636764160,"available":96602927104,"internally_reserved":0,"allocated":1896448,"data_stored":831006,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509532,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33056,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338784,"statfs":{"total":96636764160,"available":96602914816,"internally_reserved":0,"allocated":1908736,"data_stored":837878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509531,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33052,"kb_used_data":1864,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338788,"statfs":{"total":96636764160,"available":96602918912,"internally_reserved":0,"allocated":1908736,"data_stored":838796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574940,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33632,"kb_used_data":2436,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338208,"statfs":{"total":96636764160,"available":96602324992,"internally_reserved":0,"allocated":2494464,"data_stored":1427574,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":22,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":694,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":24,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":25,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:25:56.199 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:25:56.199 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:25:56.345 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.344+0000 7f452ee2a640 1 -- 172.21.15.81:0/3413074517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 msgr2=0x7f4514003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.344+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3413074517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4514003e70 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f4518009ed0 tx=0x7f4514005830 comp rx=0 tx=0).stop 2024-09-17T05:25:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.344+0000 7f452ee2a640 1 -- 172.21.15.81:0/3413074517 shutdown_connections 2024-09-17T05:25:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.344+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3413074517 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4514003e70 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.344+0000 7f452ee2a640 1 -- 172.21.15.81:0/3413074517 >> 172.21.15.81:0/3413074517 conn(0x7f45280b1700 msgr2=0x7f45280b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.344+0000 7f452ee2a640 1 -- 172.21.15.81:0/3413074517 shutdown_connections 2024-09-17T05:25:56.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.344+0000 7f452ee2a640 1 -- 172.21.15.81:0/3413074517 wait complete. 2024-09-17T05:25:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.345+0000 7f452ee2a640 1 Processor -- start 2024-09-17T05:25:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.345+0000 7f452ee2a640 1 -- start start 2024-09-17T05:25:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452ee2a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4528147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452ee2a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45280b4430 0x7f45280b48b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452ee2a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4528143690 0x7f4528143b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452ee2a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f452815ea60 con 0x7f4514003a50 2024-09-17T05:25:56.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452ee2a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f452815e8e0 con 0x7f4528143690 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452ee2a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f45280cabb0 con 0x7f45280b4430 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4528147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4528147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46186/0 (socket says 172.21.15.81:46186) 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 -- 172.21.15.81:0/3585478151 learned_addr learned my addr 172.21.15.81:0/3585478151 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 -- 172.21.15.81:0/3585478151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45280b4430 msgr2=0x7f45280b48b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45280b4430 0x7f45280b48b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 -- 172.21.15.81:0/3585478151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4528143690 msgr2=0x7f4528143b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4528143690 0x7f4528143b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.346+0000 7f452cbc6640 1 -- 172.21.15.81:0/3585478151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45281444a0 con 0x7f4514003a50 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.347+0000 7f452cbc6640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4528147400 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f4518009e20 tx=0x7f45180336f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.347+0000 7f45257fa640 1 -- 172.21.15.81:0/3585478151 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518033cf0 con 0x7f4514003a50 2024-09-17T05:25:56.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.347+0000 7f45257fa640 1 -- 172.21.15.81:0/3585478151 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f451803e030 con 0x7f4514003a50 2024-09-17T05:25:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.347+0000 7f45257fa640 1 -- 172.21.15.81:0/3585478151 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4518043660 con 0x7f4514003a50 2024-09-17T05:25:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.347+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45280b4fd0 con 0x7f4514003a50 2024-09-17T05:25:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.347+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4528152ac0 con 0x7f4514003a50 2024-09-17T05:25:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.348+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45280cc3b0 con 0x7f4514003a50 2024-09-17T05:25:56.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.348+0000 7f45257fa640 1 -- 172.21.15.81:0/3585478151 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f451802bcf0 con 0x7f4514003a50 2024-09-17T05:25:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.349+0000 7f45257fa640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4508079430 0x7f450807b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.349+0000 7f4527fff640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4508079430 0x7f450807b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.349+0000 7f45257fa640 1 -- 172.21.15.81:0/3585478151 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f45180bba10 con 0x7f4514003a50 2024-09-17T05:25:56.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.349+0000 7f4527fff640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4508079430 0x7f450807b8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4528157b40 tx=0x7f45100014f0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:56.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.353+0000 7f45257fa640 1 -- 172.21.15.81:0/3585478151 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4518085450 con 0x7f4514003a50 2024-09-17T05:25:56.598 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.597+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f45280ca990 con 0x7f4514003a50 2024-09-17T05:25:56.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.599+0000 7f45257fa640 1 -- 172.21.15.81:0/3585478151 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v26) ==== 190+0+147 (secure 0 0 0) 0x7f4518089e80 con 0x7f4514003a50 2024-09-17T05:25:56.600 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:25:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:25:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:25:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:25:56.600 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:25:56.601 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4508079430 msgr2=0x7f450807b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4508079430 0x7f450807b8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4528157b40 tx=0x7f45100014f0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 msgr2=0x7f4528147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4528147400 secure :-1 s=READY pgs=1723 cs=0 l=1 rev1=1 crypto rx=0x7f4518009e20 tx=0x7f45180336f0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 shutdown_connections 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4508079430 0x7f450807b8f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4528143690 0x7f4528143b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45280b4430 0x7f45280b48b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 --2- 172.21.15.81:0/3585478151 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4514003a50 0x7f4528147400 unknown :-1 s=CLOSED pgs=1723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 >> 172.21.15.81:0/3585478151 conn(0x7f45280b1700 msgr2=0x7f45280cfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 shutdown_connections 2024-09-17T05:25:56.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.602+0000 7f452ee2a640 1 -- 172.21.15.81:0/3585478151 wait complete. 2024-09-17T05:25:56.614 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:25:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.714+0000 7fdf67f75640 1 -- 172.21.15.81:0/799688182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf48003fd0 msgr2=0x7fdf48004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.714+0000 7fdf67f75640 1 --2- 172.21.15.81:0/799688182 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf48003fd0 0x7fdf48004800 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c2c0 tx=0x7fdf48005830 comp rx=0 tx=0).stop 2024-09-17T05:25:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.714+0000 7fdf66512640 1 -- 172.21.15.81:0/799688182 reap_dead start 2024-09-17T05:25:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.714+0000 7fdf67f75640 1 -- 172.21.15.81:0/799688182 shutdown_connections 2024-09-17T05:25:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.714+0000 7fdf67f75640 1 -- 172.21.15.81:0/799688182 >> 172.21.15.81:0/799688182 conn(0x7fdf600b1690 msgr2=0x7fdf600b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.714+0000 7fdf67f75640 1 -- 172.21.15.81:0/799688182 shutdown_connections 2024-09-17T05:25:56.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.714+0000 7fdf67f75640 1 -- 172.21.15.81:0/799688182 wait complete. 2024-09-17T05:25:56.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.715+0000 7fdf67f75640 1 Processor -- start 2024-09-17T05:25:56.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.715+0000 7fdf67f75640 1 -- start start 2024-09-17T05:25:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf48003fd0 0x7fdf6013c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf601506b0 0x7fdf6014ea40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf6014f170 0x7fdf601f8050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fdf60072930 con 0x7fdf601506b0 2024-09-17T05:25:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fdf600727b0 con 0x7fdf6014f170 2024-09-17T05:25:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fdf60072ab0 con 0x7fdf48003fd0 2024-09-17T05:25:56.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf601506b0 0x7fdf6014ea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf601506b0 0x7fdf6014ea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46198/0 (socket says 172.21.15.81:46198) 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 -- 172.21.15.81:0/1846013780 learned_addr learned my addr 172.21.15.81:0/1846013780 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 -- 172.21.15.81:0/1846013780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf48003fd0 msgr2=0x7fdf6013c4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf66512640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf6014f170 0x7fdf601f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf48003fd0 0x7fdf6013c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 -- 172.21.15.81:0/1846013780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf6014f170 msgr2=0x7fdf601f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf6014f170 0x7fdf601f8050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 -- 172.21.15.81:0/1846013780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf6014dc80 con 0x7fdf601506b0 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf65510640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf601506b0 0x7fdf6014ea40 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c3e0 tx=0x7fdf54001d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf5e7fc640 1 -- 172.21.15.81:0/1846013780 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54031040 con 0x7fdf601506b0 2024-09-17T05:25:56.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf5e7fc640 1 -- 172.21.15.81:0/1846013780 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fdf540035f0 con 0x7fdf601506b0 2024-09-17T05:25:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf5e7fc640 1 -- 172.21.15.81:0/1846013780 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf54003a40 con 0x7fdf601506b0 2024-09-17T05:25:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf6014df60 con 0x7fdf601506b0 2024-09-17T05:25:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.716+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf601523f0 con 0x7fdf601506b0 2024-09-17T05:25:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.717+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf6013f290 con 0x7fdf601506b0 2024-09-17T05:25:56.720 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.718+0000 7fdf5e7fc640 1 -- 172.21.15.81:0/1846013780 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fdf54034070 con 0x7fdf601506b0 2024-09-17T05:25:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.718+0000 7fdf5e7fc640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdf4c079430 0x7fdf4c07b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.719+0000 7fdf65d11640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdf4c079430 0x7fdf4c07b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.719+0000 7fdf5e7fc640 1 -- 172.21.15.81:0/1846013780 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7fdf540b97c0 con 0x7fdf601506b0 2024-09-17T05:25:56.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.719+0000 7fdf65d11640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdf4c079430 0x7fdf4c07b8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdf50005fd0 tx=0x7fdf50009a30 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:56.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.723+0000 7fdf5e7fc640 1 -- 172.21.15.81:0/1846013780 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fdf54083720 con 0x7fdf601506b0 2024-09-17T05:25:56.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.936+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdf60154480 con 0x7fdf601506b0 2024-09-17T05:25:56.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.936+0000 7fdf5e7fc640 1 -- 172.21.15.81:0/1846013780 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 92 v92) ==== 94+0+5233 (secure 0 0 0) 0x7fdf54083020 con 0x7fdf601506b0 2024-09-17T05:25:56.938 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:25:56.938 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":92,"btime":"2024-09-17T05:25:54:889822+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2035889358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2035889358},{"type":"v1","addr":"172.21.15.160:6834","nonce":2035889358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3559863017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3559863017},{"type":"v1","addr":"172.21.15.81:6834","nonce":3559863017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3296945190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3296945190},{"type":"v1","addr":"172.21.15.81:6835","nonce":3296945190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:52.226778+0000","modified":"2024-09-17T05:25:54.227757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8853":{"gid":8853,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/3389320458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3389320458},{"type":"v1","addr":"172.21.15.160:6835","nonce":3389320458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8853,"qdb_cluster":[8853]},"id":12}]} 2024-09-17T05:25:56.938 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 92 2024-09-17T05:25:56.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdf4c079430 msgr2=0x7fdf4c07b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdf4c079430 0x7fdf4c07b8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fdf50005fd0 tx=0x7fdf50009a30 comp rx=0 tx=0).stop 2024-09-17T05:25:56.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf601506b0 msgr2=0x7fdf6014ea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:56.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf601506b0 0x7fdf6014ea40 secure :-1 s=READY pgs=1726 cs=0 l=1 rev1=1 crypto rx=0x7fdf5400c3e0 tx=0x7fdf54001d40 comp rx=0 tx=0).stop 2024-09-17T05:25:56.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 shutdown_connections 2024-09-17T05:25:56.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fdf4c079430 0x7fdf4c07b8f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fdf6014f170 0x7fdf601f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fdf601506b0 0x7fdf6014ea40 unknown :-1 s=CLOSED pgs=1726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 --2- 172.21.15.81:0/1846013780 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fdf48003fd0 0x7fdf6013c4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:56.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 >> 172.21.15.81:0/1846013780 conn(0x7fdf600b1690 msgr2=0x7fdf600b2c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:56.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 shutdown_connections 2024-09-17T05:25:56.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:56.939+0000 7fdf67f75640 1 -- 172.21.15.81:0/1846013780 wait complete. 2024-09-17T05:25:57.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 92, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:25:52.226778+0000', 'modified': '2024-09-17T05:25:54.227757+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8853}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8853': {'gid': 8853, 'name': 'b', 'rank': 0, 'incarnation': 90, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.160:6835/3389320458', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.160:6801', 'nonce': 3389320458}, {'type': 'v1', 'addr': '172.21.15.160:6835', 'nonce': 3389320458}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [25], 'metadata_pool': 24, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 8853, 'qdb_cluster': [8853]} 2024-09-17T05:25:57.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:25:57.353 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-09-17T05:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.456+0000 7f32baf65640 1 -- 172.21.15.81:0/2193210024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0003a00 msgr2=0x7f32a0003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.456+0000 7f32baf65640 1 --2- 172.21.15.81:0/2193210024 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32a0003a00 0x7f32a0003e20 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7f32a400c610 tx=0x7f32a0005830 comp rx=0 tx=0).stop 2024-09-17T05:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.456+0000 7f32b9502640 1 -- 172.21.15.81:0/2193210024 reap_dead start 2024-09-17T05:25:57.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.456+0000 7f32baf65640 1 -- 172.21.15.81:0/2193210024 shutdown_connections 2024-09-17T05:25:57.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.456+0000 7f32baf65640 1 -- 172.21.15.81:0/2193210024 >> 172.21.15.81:0/2193210024 conn(0x7f32b40b1690 msgr2=0x7f32b40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.456+0000 7f32baf65640 1 -- 172.21.15.81:0/2193210024 shutdown_connections 2024-09-17T05:25:57.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.456+0000 7f32baf65640 1 -- 172.21.15.81:0/2193210024 wait complete. 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.457+0000 7f32baf65640 1 Processor -- start 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.457+0000 7f32baf65640 1 -- start start 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32a0003a00 0x7f32b41f1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b41f4a80 0x7f32b4144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b4152a10 0x7f32b414ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32b406e760 con 0x7f32b4152a10 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32b406e5e0 con 0x7f32b41f4a80 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f32b406e8e0 con 0x7f32a0003a00 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b4152a10 0x7f32b414ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b4152a10 0x7f32b414ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46222/0 (socket says 172.21.15.81:46222) 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 -- 172.21.15.81:0/3348100080 learned_addr learned my addr 172.21.15.81:0/3348100080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 -- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32a0003a00 msgr2=0x7f32b41f1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b8d01640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32a0003a00 0x7f32b41f1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b3fff640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b41f4a80 0x7f32b4144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32a0003a00 0x7f32b41f1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 -- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b41f4a80 msgr2=0x7f32b4144d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b41f4a80 0x7f32b4144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 -- 172.21.15.81:0/3348100080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b41f1a70 con 0x7f32b4152a10 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b9502640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b4152a10 0x7f32b414ee40 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f32b4154d40 tx=0x7f32ac011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b17fa640 1 -- 172.21.15.81:0/3348100080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac0035f0 con 0x7f32b4152a10 2024-09-17T05:25:57.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b17fa640 1 -- 172.21.15.81:0/3348100080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32ac016070 con 0x7f32b4152a10 2024-09-17T05:25:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b41f1d50 con 0x7f32b4152a10 2024-09-17T05:25:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32b17fa640 1 -- 172.21.15.81:0/3348100080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac003b00 con 0x7f32b4152a10 2024-09-17T05:25:57.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.458+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b41f2310 con 0x7f32b4152a10 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.460+0000 7f32b17fa640 1 -- 172.21.15.81:0/3348100080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f32ac003ca0 con 0x7f32b4152a10 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.461+0000 7f32b17fa640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3294079400 0x7f329407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.461+0000 7f32b17fa640 1 -- 172.21.15.81:0/3348100080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f32ac099e40 con 0x7f32b4152a10 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.461+0000 7f32b8d01640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3294079400 0x7f329407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.461+0000 7f32b8d01640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3294079400 0x7f329407b8c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f32a4033000 tx=0x7f32a4038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.461+0000 7f32bde0e740 1 Processor -- start 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.461+0000 7f32bde0e740 1 -- start start 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c55db20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5a5df0 0x56475c5a61f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c55b5f0 0x56475c55ba40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32bde0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56475c4d2820 con 0x56475c55b5f0 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56475c4c1c50 con 0x56475c5a5df0 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x56475c4c5a60 con 0x56475c5861b0 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32b9502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c55b5f0 0x56475c55ba40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32b9502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c55b5f0 0x56475c55ba40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46224/0 (socket says 172.21.15.81:46224) 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32b9502640 1 -- 172.21.15.81:0/2886143858 learned_addr learned my addr 172.21.15.81:0/2886143858 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32b8d01640 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c55db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.462+0000 7f32b3fff640 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5a5df0 0x56475c5a61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b9502640 1 -- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 msgr2=0x56475c55db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b9502640 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c55db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b9502640 1 -- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5a5df0 msgr2=0x56475c5a61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b9502640 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5a5df0 0x56475c5a61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b9502640 1 -- 172.21.15.81:0/2886143858 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475c223850 con 0x56475c55b5f0 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b8d01640 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c55db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b3fff640 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5a5df0 0x56475c5a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32b9502640 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c55b5f0 0x56475c55ba40 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f32ac000c00 tx=0x7f32ac063590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747bb536f97f46a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32aa7fc640 1 -- 172.21.15.81:0/2886143858 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac09c2c0 con 0x56475c55b5f0 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32aa7fc640 1 -- 172.21.15.81:0/2886143858 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32ac089070 con 0x56475c55b5f0 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32aa7fc640 1 -- 172.21.15.81:0/2886143858 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac06a630 con 0x56475c55b5f0 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 -- 172.21.15.81:0/2886143858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c55b5f0 msgr2=0x56475c55ba40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.467 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c55b5f0 0x56475c55ba40 secure :-1 s=READY pgs=1730 cs=0 l=1 rev1=1 crypto rx=0x7f32ac000c00 tx=0x7f32ac063590 comp rx=0 tx=0).stop 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 -- 172.21.15.81:0/2886143858 shutdown_connections 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c55b5f0 0x56475c55ba40 unknown :-1 s=CLOSED pgs=1730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5a5df0 0x56475c5a61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2886143858 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c55db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 -- 172.21.15.81:0/2886143858 >> 172.21.15.81:0/2886143858 conn(0x56475c55c6a0 msgr2=0x56475c5600c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 -- 172.21.15.81:0/2886143858 shutdown_connections 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.463+0000 7f32bde0e740 1 -- 172.21.15.81:0/2886143858 wait complete. 2024-09-17T05:25:57.468 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.464+0000 7f32bde0e740 1 -- start start 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.464+0000 7f32bde0e740 1 Processor -- start 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5861b0 0x56475c589590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5b5d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c581c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32bde0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56475c232620 con 0x56475c5861b0 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56475c4675f0 con 0x56475c5b62d0 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x56475c55a850 con 0x56475c5a5df0 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32bde0e740 10 client.0 _ll_register_callbacks cb 0x56475c46b0a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:25:57.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5861b0 0x56475c589590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5861b0 0x56475c589590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46240/0 (socket says 172.21.15.81:46240) 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 -- 172.21.15.81:0/3850617276 learned_addr learned my addr 172.21.15.81:0/3850617276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b3fff640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5b5d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b9502640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c581c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 -- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 msgr2=0x56475c5b5d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5b5d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 -- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 msgr2=0x56475c581c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c581c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 -- 172.21.15.81:0/3850617276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475c29a6b0 con 0x56475c5861b0 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b3fff640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:57.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b9502640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c581c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32b8d01640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5861b0 0x56475c589590 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f32a402b4b0 tx=0x7f32a402d070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e58b6ff5b49cbb0e server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.465+0000 7f32937fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32937fe640 1 -- 172.21.15.81:0/3850617276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32a402ba00 con 0x56475c5861b0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32937fe640 1 -- 172.21.15.81:0/3850617276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f32a402bba0 con 0x56475c5861b0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32ac089070 con 0x56475c5861b0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32937fe640 1 -- 172.21.15.81:0/3850617276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f32a402bda0 con 0x56475c5861b0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 10 client.8970 fetch_fsmap learned FSMap version 92 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) -- 0x56475c588d90 con 0x56475c5861b0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32937fe640 1 -- 172.21.15.81:0/3850617276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32ac089070 con 0x56475c5861b0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32937fe640 1 -- 172.21.15.81:0/3850617276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 92) ==== 3502+0+0 (secure 0 0 0) 0x7f32a40060c0 con 0x56475c5861b0 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 10 client.8970 fetch_fsmap finished waiting for FSMap version 92 2024-09-17T05:25:57.475 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 10 client.8970 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 20 client.8970 populate_metadata read hostname 'smithi081' 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5b4fb0 0x56475c5b8520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 4 client.8970 mds_command: new command op to 8853 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 --> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56475c4d4770 con 0x56475c5b4fb0 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.466+0000 7f32b3fff640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5b4fb0 0x56475c5b8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.467+0000 7f32937fe640 10 client.8970 ms_handle_connect on v2:172.21.15.160:6801/3389320458 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.467+0000 7f32b3fff640 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5b4fb0 0x56475c5b8520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e84a2a1b98fffedb server_cookie=61d663f9fd2380de in_seq=0 out_seq=0 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.467+0000 7f32937fe640 1 -- 172.21.15.81:0/3850617276 <== mds.0 v2:172.21.15.160:6801/3389320458 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x56475c4d4770 con 0x56475c5b4fb0 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.467+0000 7f32937fe640 10 client.8970 handle_command_reply: tid=0 2024-09-17T05:25:57.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.467+0000 7f32bde0e740 1 client.8970 shutdown 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5861b0 msgr2=0x56475c589590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5861b0 0x56475c589590 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f32a402b4b0 tx=0x7f32a402d070 comp rx=0 tx=0).stop 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 shutdown_connections 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c581c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5b4fb0 0x56475c5b8520 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5b5d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 --2- 172.21.15.81:0/3850617276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5861b0 0x56475c589590 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32937fe640 0 client.8970 ms_handle_reset on v2:172.21.15.160:6801/3389320458 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 >> 172.21.15.81:0/3850617276 conn(0x56475c55b5f0 msgr2=0x56475c5a6cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 shutdown_connections 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 1 -- 172.21.15.81:0/3850617276 wait complete. 2024-09-17T05:25:57.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.468+0000 7f32bde0e740 20 client.8970 trim_cache size 0 max 16384 2024-09-17T05:25:57.486 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 Processor -- start 2024-09-17T05:25:57.487 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 -- start start 2024-09-17T05:25:57.488 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5861b0 0x56475c55bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5595b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5b62d0 0x56475c559af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32b4152100 con 0x56475c5b62d0 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32b413d490 con 0x56475c5861b0 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.486+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f32b4151ab0 con 0x56475c5a5df0 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5b62d0 0x56475c559af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5b62d0 0x56475c559af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46256/0 (socket says 172.21.15.81:46256) 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 -- 172.21.15.81:0/461548400 learned_addr learned my addr 172.21.15.81:0/461548400 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 -- 172.21.15.81:0/461548400 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 msgr2=0x56475c5595b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 --2- 172.21.15.81:0/461548400 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5595b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.489 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 -- 172.21.15.81:0/461548400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5861b0 msgr2=0x56475c55bf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 --2- 172.21.15.81:0/461548400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5861b0 0x56475c55bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 -- 172.21.15.81:0/461548400 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475c5be5f0 con 0x56475c5b62d0 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32b9502640 1 --2- 172.21.15.81:0/461548400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5b62d0 0x56475c559af0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f32ac000c00 tx=0x7f32ac003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd2d8742fb6efd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32a9ffb640 1 -- 172.21.15.81:0/461548400 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac07dd80 con 0x56475c5b62d0 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32a9ffb640 1 -- 172.21.15.81:0/461548400 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32ac083070 con 0x56475c5b62d0 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32a9ffb640 1 -- 172.21.15.81:0/461548400 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32ac06a630 con 0x56475c5b62d0 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32bde0e740 1 -- 172.21.15.81:0/461548400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5b62d0 msgr2=0x56475c559af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32bde0e740 1 --2- 172.21.15.81:0/461548400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5b62d0 0x56475c559af0 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f32ac000c00 tx=0x7f32ac003f90 comp rx=0 tx=0).stop 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32bde0e740 1 -- 172.21.15.81:0/461548400 shutdown_connections 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32bde0e740 1 --2- 172.21.15.81:0/461548400 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5b62d0 0x56475c559af0 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32bde0e740 1 --2- 172.21.15.81:0/461548400 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5a5df0 0x56475c5595b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.490 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32bde0e740 1 --2- 172.21.15.81:0/461548400 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5861b0 0x56475c55bf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.487+0000 7f32bde0e740 1 -- 172.21.15.81:0/461548400 >> 172.21.15.81:0/461548400 conn(0x56475c55b5f0 msgr2=0x56475c560190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.488+0000 7f32bde0e740 1 -- 172.21.15.81:0/461548400 shutdown_connections 2024-09-17T05:25:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.488+0000 7f32bde0e740 1 -- 172.21.15.81:0/461548400 wait complete. 2024-09-17T05:25:57.491 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.488+0000 7f32bde0e740 1 -- start start 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.488+0000 7f32bde0e740 1 Processor -- start 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c560380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5a5df0 0x56475c6294e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32bde0e740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c629a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32bde0e740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x56475c5b4e30 con 0x56475c5a5df0 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x56475c5b6860 con 0x56475c5b62d0 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32bde0e740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x56475c5b5480 con 0x56475c5861b0 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32bde0e740 10 client.0 _ll_register_callbacks cb 0x7f32a00036f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5a5df0 0x56475c6294e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.495 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5a5df0 0x56475c6294e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46264/0 (socket says 172.21.15.81:46264) 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 -- 172.21.15.81:0/2055077742 learned_addr learned my addr 172.21.15.81:0/2055077742 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b8d01640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c560380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b9502640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c629a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 -- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 msgr2=0x56475c560380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c560380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 -- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 msgr2=0x56475c629a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c629a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b3fff640 1 -- 172.21.15.81:0/2055077742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475c59c8a0 con 0x56475c5a5df0 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.489+0000 7f32b9502640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c629a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32b3fff640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5a5df0 0x56475c6294e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x56475c5b5930 tx=0x7f329c012820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d73ad81553a1ddb server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32937fe640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:25:57.496 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32937fe640 1 -- 172.21.15.81:0/2055077742 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329c01e600 con 0x56475c5a5df0 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32937fe640 1 -- 172.21.15.81:0/2055077742 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f329c01e7a0 con 0x56475c5a5df0 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32ac083070 con 0x56475c5a5df0 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32937fe640 1 -- 172.21.15.81:0/2055077742 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=92) ==== 24+0+0 (secure 0 0 0) 0x7f329c02c050 con 0x56475c5a5df0 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 10 client.8976 fetch_fsmap learned FSMap version 92 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=92,monmap=2+}) -- 0x56475c5a3480 con 0x56475c5a5df0 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32937fe640 1 -- 172.21.15.81:0/2055077742 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f32ac083070 con 0x56475c5a5df0 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32937fe640 1 -- 172.21.15.81:0/2055077742 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 92) ==== 3502+0+0 (secure 0 0 0) 0x7f329c02f020 con 0x56475c5a5df0 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 10 client.8976 fetch_fsmap finished waiting for FSMap version 92 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 10 client.8976 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-17T05:25:57.497 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 20 client.8976 populate_metadata read hostname 'smithi081' 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5819b0 0x56475c5a23a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 4 client.8976 mds_command: new command op to 8853 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 --> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] -- command(tid 0: {"prefix": "status"}) -- 0x56475c4d0220 con 0x56475c5819b0 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.490+0000 7f32b8d01640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5819b0 0x56475c5a23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32937fe640 10 client.8976 ms_handle_connect on v2:172.21.15.160:6801/3389320458 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32b8d01640 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5819b0 0x56475c5a23a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9c4d870e5a87e190 server_cookie=6d5516a425302fcc in_seq=0 out_seq=0 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32937fe640 1 -- 172.21.15.81:0/2055077742 <== mds.0 v2:172.21.15.160:6801/3389320458 1 ==== command_reply(tid 0: 0 ) ==== 8+0+333 (crc 0 0 0) 0x56475c4d0220 con 0x56475c5819b0 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32937fe640 10 client.8976 handle_command_reply: tid=0 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 client.8976 shutdown 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5a5df0 msgr2=0x56475c6294e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.498 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5a5df0 0x56475c6294e0 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x56475c5b5930 tx=0x7f329c012820 comp rx=0 tx=0).stop 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 shutdown_connections 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x56475c5b62d0 0x56475c629a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x56475c5a5df0 0x56475c6294e0 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:6801/3389320458,v1:172.21.15.160:6835/3389320458] conn(0x56475c5819b0 0x56475c5a23a0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 --2- 172.21.15.81:0/2055077742 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x56475c5861b0 0x56475c560380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32937fe640 0 client.8976 ms_handle_reset on v2:172.21.15.160:6801/3389320458 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 >> 172.21.15.81:0/2055077742 conn(0x56475c55b5f0 msgr2=0x56475c57e520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 shutdown_connections 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 1 -- 172.21.15.81:0/2055077742 wait complete. 2024-09-17T05:25:57.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.491+0000 7f32bde0e740 20 client.8976 trim_cache size 0 max 16384 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8853, 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:25:57.500 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 4.6073607460000003, 2024-09-17T05:25:57.501 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 92, 2024-09-17T05:25:57.501 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 151, 2024-09-17T05:25:57.501 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 151, 2024-09-17T05:25:57.501 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.3431860570000005 2024-09-17T05:25:57.501 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3294079400 msgr2=0x7f329407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3294079400 0x7f329407b8c0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f32a4033000 tx=0x7f32a4038040 comp rx=0 tx=0).stop 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b4152a10 msgr2=0x7f32b414ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b4152a10 0x7f32b414ee40 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f32b4154d40 tx=0x7f32ac011aa0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 shutdown_connections 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b4152a10 0x7f32b414ee40 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3294079400 0x7f329407b8c0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b41f4a80 0x7f32b4144d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 --2- 172.21.15.81:0/3348100080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32a0003a00 0x7f32b41f1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 >> 172.21.15.81:0/3348100080 conn(0x7f32b40b1690 msgr2=0x7f32b41476c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 shutdown_connections 2024-09-17T05:25:57.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.492+0000 7f32baf65640 1 -- 172.21.15.81:0/3348100080 wait complete. 2024-09-17T05:25:57.504 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:25:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.605+0000 7fd9fc260640 1 -- 172.21.15.81:0/3147235305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e0005210 msgr2=0x7fd9e000b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.605+0000 7fd9fc260640 1 --2- 172.21.15.81:0/3147235305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e0005210 0x7fd9e000b9c0 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fd9ec001d90 tx=0x7fd9e0005830 comp rx=0 tx=0).stop 2024-09-17T05:25:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.605+0000 7fd9fc260640 1 -- 172.21.15.81:0/3147235305 shutdown_connections 2024-09-17T05:25:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.605+0000 7fd9fc260640 1 --2- 172.21.15.81:0/3147235305 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9e0005210 0x7fd9e000b9c0 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.605+0000 7fd9fc260640 1 -- 172.21.15.81:0/3147235305 >> 172.21.15.81:0/3147235305 conn(0x7fd9f40741f0 msgr2=0x7fd9f4074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.605+0000 7fd9fc260640 1 -- 172.21.15.81:0/3147235305 shutdown_connections 2024-09-17T05:25:57.607 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.605+0000 7fd9fc260640 1 -- 172.21.15.81:0/3147235305 wait complete. 2024-09-17T05:25:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.606+0000 7fd9fc260640 1 Processor -- start 2024-09-17T05:25:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.606+0000 7fd9fc260640 1 -- start start 2024-09-17T05:25:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9e0005210 0x7fd9f40c3090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f40c5e50 0x7fd9f40ca0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f41f51f0 0x7fd9f40b12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.609 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f415e670 con 0x7fd9f40c5e50 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd9f40cd960 con 0x7fd9e0005210 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd9f40ce240 con 0x7fd9f41f51f0 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f40c5e50 0x7fd9f40ca0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f40c5e50 0x7fd9f40ca0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46284/0 (socket says 172.21.15.81:46284) 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 -- 172.21.15.81:0/171013061 learned_addr learned my addr 172.21.15.81:0/171013061 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f9ffc640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9e0005210 0x7fd9f40c3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fa7fd640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f41f51f0 0x7fd9f40b12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 -- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f41f51f0 msgr2=0x7fd9f40b12b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f41f51f0 0x7fd9f40b12b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.610 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 -- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9e0005210 msgr2=0x7fd9f40c3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9e0005210 0x7fd9f40c3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 -- 172.21.15.81:0/171013061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd9f41f4a10 con 0x7fd9f40c5e50 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9f97fb640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f40c5e50 0x7fd9f40ca0a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40117d0 tx=0x7fd9e4011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9ea7fc640 1 -- 172.21.15.81:0/171013061 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e4004460 con 0x7fd9f40c5e50 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9ea7fc640 1 -- 172.21.15.81:0/171013061 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd9e4016070 con 0x7fd9f40c5e50 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd9f40c6350 con 0x7fd9f40c5e50 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9ea7fc640 1 -- 172.21.15.81:0/171013061 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd9e400fb60 con 0x7fd9f40c5e50 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.607+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9f40c6910 con 0x7fd9f40c5e50 2024-09-17T05:25:57.611 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.608+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd9f406f4e0 con 0x7fd9f40c5e50 2024-09-17T05:25:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.609+0000 7fd9ea7fc640 1 -- 172.21.15.81:0/171013061 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fd9e4018030 con 0x7fd9f40c5e50 2024-09-17T05:25:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.610+0000 7fd9ea7fc640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d8079400 0x7fd9d807b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.610+0000 7fd9ea7fc640 1 -- 172.21.15.81:0/171013061 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7fd9e4099c70 con 0x7fd9f40c5e50 2024-09-17T05:25:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.610+0000 7fd9f9ffc640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d8079400 0x7fd9d807b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:57.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.610+0000 7fd9f9ffc640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d8079400 0x7fd9d807b8c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0001860 tx=0x7fd9f0006040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:57.614 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.614+0000 7fd9ea7fc640 1 -- 172.21.15.81:0/171013061 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd9e40635a0 con 0x7fd9f40c5e50 2024-09-17T05:25:57.828 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.827+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fd9f4074d10 con 0x7fd9f40c5e50 2024-09-17T05:25:57.829 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.828+0000 7fd9ea7fc640 1 -- 172.21.15.81:0/171013061 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) ==== 53+0+73 (secure 0 0 0) 0x7fd9e4067fd0 con 0x7fd9f40c5e50 2024-09-17T05:25:57.829 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:25:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d8079400 msgr2=0x7fd9d807b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d8079400 0x7fd9d807b8c0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fd9f0001860 tx=0x7fd9f0006040 comp rx=0 tx=0).stop 2024-09-17T05:25:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f40c5e50 msgr2=0x7fd9f40ca0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f40c5e50 0x7fd9f40ca0a0 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fd9e40117d0 tx=0x7fd9e4011c90 comp rx=0 tx=0).stop 2024-09-17T05:25:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 shutdown_connections 2024-09-17T05:25:57.831 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd9f41f51f0 0x7fd9f40b12b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd9f40c5e50 0x7fd9f40ca0a0 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd9d8079400 0x7fd9d807b8c0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 --2- 172.21.15.81:0/171013061 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd9e0005210 0x7fd9f40c3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 >> 172.21.15.81:0/171013061 conn(0x7fd9f40741f0 msgr2=0x7fd9f40d0340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 shutdown_connections 2024-09-17T05:25:57.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:57.830+0000 7fd9fc260640 1 -- 172.21.15.81:0/171013061 wait complete. 2024-09-17T05:25:57.842 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:25:57.842 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:25:57.842 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:25:57.842 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:25:57.842 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:57.842 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:25:57.842 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:25:57.843 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:25:57.843 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:25:57.843 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:57.843 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:25:57.860 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:25:57.860 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:25:57.860 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:25:57.861 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:57.861 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:25:57.861 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:57.861 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:57.861 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:57.862 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:25:57.862 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:57.862 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:57.862 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:25:57.862 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:57.863 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:57.863 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:25:57.863 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:57.863 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:25:57.863 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42360sec preferred_lft 42360sec 2024-09-17T05:25:57.864 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:25:57.864 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:57.864 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:25:57.864 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:57.864 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:25:57.864 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:57.865 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:25:57.865 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:57.865 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:57.865 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:57.865 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:25:57.866 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:57.866 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:57.866 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:57.866 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:25:57.866 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:57.867 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:57.867 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:25:57.924 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:25:57.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:57.926 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:25:57.982 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:25:57.982 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:25:57.982 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:25:57.982 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:25:57.982 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:25:57.983 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:25:57.983 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:25:57.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:25:57.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:25:57.983 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:25:57.983 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:25:58.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:58 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:25:58.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:58.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:58.108 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:25:58.123 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:25:58.123 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:25:58.123 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:25:58.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:58.123 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:25:58.187 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:25:58.188 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:58.188 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:58.244 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:25:58.244 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:58.244 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:58.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:25:58.364 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:25:58.420 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:25:58.420 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:25:58.421 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:25:58.422 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:25:58.423 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:25:58.424 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:25:58.424 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:25:58.424 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:58.424 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:58.424 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:58.424 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:58.424 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:58.425 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:25:58.476 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:25:58.476 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:25:58.518 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:25:58.543 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:25:58.599 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:25:58.600 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:25:58.601 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:58.602 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:25:58.602 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:58.602 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:25:58.602 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:58.602 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:25:58.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:25:58.599+0000 7f2dbbd1a480 -1 init, newargv = 0x560963eeb430 newargc=15 2024-09-17T05:25:58.603 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[79149]: starting ceph client 2024-09-17T05:25:58.605 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[79149]: starting fuse 2024-09-17T05:25:58.617 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:25:58.618 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:25:58.618 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:25:58.619 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:25:58.620 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:25:58.620 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:25:58.620 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:25:58.620 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:25:58.735 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.79149.asok 2024-09-17T05:25:58.742 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:58 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:58.746 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.79149.asok 2024-09-17T05:25:58.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:58.746 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.79149.asok status 2024-09-17T05:25:58.879 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:25:58.879 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:25:58.879 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:25:58.879 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:25:58.879 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:25:58.880 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:25:58.880 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:25:58.880 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "79149", 2024-09-17T05:25:58.880 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:25:58.880 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:58.880 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:25:58.881 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:25:58.881 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 8985, 2024-09-17T05:25:58.881 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:25:58.881 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:25:58.881 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:25:58.881 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 8985 2024-09-17T05:25:58.881 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:58.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:25:58.882 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:25:58.882 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:25:58.882 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 873888858 2024-09-17T05:25:58.882 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:25:58.882 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 873888858 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.8985 192.168.0.1:0/873888858", 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/873888858", 2024-09-17T05:25:58.883 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:25:58.884 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 92, 2024-09-17T05:25:58.884 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 151, 2024-09-17T05:25:58.884 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:25:58.884 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:25:58.884 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:25:58.884 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:25:58.888 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:58.888 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:25:58.888 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:58.904 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:25:58.904 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:58.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:58.905 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:25:58.972 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:25:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.112+0000 7f263c216640 1 -- 172.21.15.81:0/3184287949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340ccde0 msgr2=0x7f26340cb690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:59.115 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.112+0000 7f263c216640 1 --2- 172.21.15.81:0/3184287949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340ccde0 0x7f26340cb690 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f262c009be0 tx=0x7f262c02a8d0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.113+0000 7f263c216640 1 -- 172.21.15.81:0/3184287949 shutdown_connections 2024-09-17T05:25:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.113+0000 7f263c216640 1 --2- 172.21.15.81:0/3184287949 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340ccde0 0x7f26340cb690 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.113+0000 7f263c216640 1 --2- 172.21.15.81:0/3184287949 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f263406d590 0x7f2634074130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.113+0000 7f263c216640 1 -- 172.21.15.81:0/3184287949 >> 172.21.15.81:0/3184287949 conn(0x7f26340d0c20 msgr2=0x7f26340d1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.113+0000 7f263c216640 1 -- 172.21.15.81:0/3184287949 shutdown_connections 2024-09-17T05:25:59.116 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.113+0000 7f263c216640 1 -- 172.21.15.81:0/3184287949 wait complete. 2024-09-17T05:25:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.114+0000 7f263c216640 1 Processor -- start 2024-09-17T05:25:59.117 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.114+0000 7f263c216640 1 -- start start 2024-09-17T05:25:59.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f263406d590 0x7f26341573e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:59.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340cb270 0x7f26341f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26340ccde0 0x7f26341f5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2634070d20 con 0x7f26340cb270 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2634070ba0 con 0x7f26340ccde0 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2634070ea0 con 0x7f263406d590 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340cb270 0x7f26341f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340cb270 0x7f26341f1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46290/0 (socket says 172.21.15.81:46290) 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 -- 172.21.15.81:0/3529357694 learned_addr learned my addr 172.21.15.81:0/3529357694 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f2639fb2640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f263406d590 0x7f26341573e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263a7b3640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26340ccde0 0x7f26341f5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 -- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f263406d590 msgr2=0x7f26341573e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:59.124 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f263406d590 0x7f26341573e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 -- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26340ccde0 msgr2=0x7f26341f5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26340ccde0 0x7f26341f5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 -- 172.21.15.81:0/3529357694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26340ca6c0 con 0x7f26340cb270 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f2639fb2640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f263406d590 0x7f26341573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26397b1640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340cb270 0x7f26341f1ff0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f262800c460 tx=0x7f262800c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26327fc640 1 -- 172.21.15.81:0/3529357694 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628016020 con 0x7f26340cb270 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26327fc640 1 -- 172.21.15.81:0/3529357694 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2628012920 con 0x7f26340cb270 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26340ca9a0 con 0x7f26340cb270 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f26327fc640 1 -- 172.21.15.81:0/3529357694 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2628012d50 con 0x7f26340cb270 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.115+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2634155a40 con 0x7f26340cb270 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.116+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2634155c40 con 0x7f26340cb270 2024-09-17T05:25:59.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.117+0000 7f26327fc640 1 -- 172.21.15.81:0/3529357694 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f2628019020 con 0x7f26340cb270 2024-09-17T05:25:59.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.117+0000 7f26327fc640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2620079400 0x7f262007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:25:59.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.118+0000 7f2639fb2640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2620079400 0x7f262007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:25:59.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.118+0000 7f26327fc640 1 -- 172.21.15.81:0/3529357694 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f262809ba30 con 0x7f26340cb270 2024-09-17T05:25:59.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.118+0000 7f2639fb2640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2620079400 0x7f262007b8c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2624009930 tx=0x7f2624008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:25:59.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.122+0000 7f26327fc640 1 -- 172.21.15.81:0/3529357694 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2634155c40 con 0x7f26340cb270 2024-09-17T05:25:59.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.333+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f26340b6ba0 con 0x7f26340cb270 2024-09-17T05:25:59.334 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.333+0000 7f26327fc640 1 -- 172.21.15.81:0/3529357694 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v92) ==== 53+0+73 (secure 0 0 0) 0x7f2628020070 con 0x7f26340cb270 2024-09-17T05:25:59.334 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2620079400 msgr2=0x7f262007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2620079400 0x7f262007b8c0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f2624009930 tx=0x7f2624008040 comp rx=0 tx=0).stop 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340cb270 msgr2=0x7f26341f1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340cb270 0x7f26341f1ff0 secure :-1 s=READY pgs=1740 cs=0 l=1 rev1=1 crypto rx=0x7f262800c460 tx=0x7f262800c920 comp rx=0 tx=0).stop 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 shutdown_connections 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2620079400 0x7f262007b8c0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f26340ccde0 0x7f26341f5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f26340cb270 0x7f26341f1ff0 unknown :-1 s=CLOSED pgs=1740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 --2- 172.21.15.81:0/3529357694 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f263406d590 0x7f26341573e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 >> 172.21.15.81:0/3529357694 conn(0x7f26340d0c20 msgr2=0x7f26340b28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 shutdown_connections 2024-09-17T05:25:59.337 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:25:59.335+0000 7f263c216640 1 -- 172.21.15.81:0/3529357694 wait complete. 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:25:59.347 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:25:59.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:59.348 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:25:59.368 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:25:59.368 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:25:59.368 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:25:59.369 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42356sec preferred_lft 42356sec 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:25:59.370 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:25:59.371 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:25:59.372 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:59.372 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:25:59.437 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:25:59.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:59.439 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:25:59.497 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:25:59.497 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:25:59.497 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:25:59.497 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:25:59.497 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:25:59.498 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:25:59.498 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:25:59.498 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:25:59.498 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:25:59.498 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:25:59.498 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:25:59.594 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:25:59 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:25:59.630 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:25:59 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:25:59.637 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:59.637 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:25:59.653 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:25:59.653 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:25:59.653 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:25:59.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:59.653 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:25:59.719 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:25:59.719 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:59.719 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:59.776 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:25:59.777 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:25:59.777 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:25:59.832 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:25:59.900 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:25:59.957 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:25:59.958 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:25:59.959 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:25:59.960 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:59.960 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:25:59.960 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:59.960 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:25:59.960 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:25:59.960 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:26:00.014 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:26:00.014 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:26:00.057 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:26:00.082 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:26:00.139 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:26:00.139 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:26:00.139 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:26:00.139 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:26:00.139 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:26:00.139 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:26:00.139 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:26:00.140 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:26:00.141 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:26:00.142 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:00.142 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:00.142 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:00.142 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:00.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:00.142 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:26:00.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:26:00.138+0000 7fd260b1f480 -1 init, newargv = 0x560dfaaaa4b0 newargc=15 2024-09-17T05:26:00.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[49998]: starting ceph client 2024-09-17T05:26:00.143 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[49998]: starting fuse 2024-09-17T05:26:00.158 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:26:00.158 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:26:00.158 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:26:00.159 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:26:00.159 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:26:00.159 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:26:00.160 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:26:00.160 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:26:00.161 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:26:00.162 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:26:00.162 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:26:00.162 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:26:00.162 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:26:00.162 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:26:00.163 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:26:00.163 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:00.163 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:26:00.163 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:26:00.276 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.49998.asok 2024-09-17T05:26:00.279 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:26:00 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:26:00.287 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.49998.asok 2024-09-17T05:26:00.287 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:00.287 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.49998.asok status 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:26:00.421 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "49998", 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 7115, 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 7115 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:00.422 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1712303063 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 1712303063 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:00.423 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.7115 192.168.0.1:0/1712303063", 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/1712303063", 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 92, 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 151, 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:26:00.424 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:26:00.429 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:00.429 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:26:00.429 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:00.445 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:26:00.445 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:00.445 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:00.445 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:00.510 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:26:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3093966164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b08068ac0 msgr2=0x7f3b080b06e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3093966164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b08068ac0 0x7f3b080b06e0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7f3b00005fd0 tx=0x7f3b0002a970 comp rx=0 tx=0).stop 2024-09-17T05:26:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3093966164 shutdown_connections 2024-09-17T05:26:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3093966164 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b08068ac0 0x7f3b080b06e0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3093966164 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b080ce8d0 0x7f3b08074c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3093966164 >> 172.21.15.81:0/3093966164 conn(0x7f3b08074160 msgr2=0x7f3b08074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3093966164 shutdown_connections 2024-09-17T05:26:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.627+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3093966164 wait complete. 2024-09-17T05:26:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.628+0000 7f3b0ed9b640 1 Processor -- start 2024-09-17T05:26:00.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.628+0000 7f3b0ed9b640 1 -- start start 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0ed9b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b08068ac0 0x7f3b081f4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0ed9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b080ce8d0 0x7f3b080d0530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0ed9b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0815ab70 0x7f3b081f6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0ed9b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3b080b1150 con 0x7f3b080ce8d0 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0ed9b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f3b080b0fd0 con 0x7f3b0815ab70 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0ed9b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f3b080b12d0 con 0x7f3b08068ac0 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b080ce8d0 0x7f3b080d0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:00.632 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b080ce8d0 0x7f3b080d0530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46304/0 (socket says 172.21.15.81:46304) 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 -- 172.21.15.81:0/3599438319 learned_addr learned my addr 172.21.15.81:0/3599438319 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0cb37640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b08068ac0 0x7f3b081f4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3b0d338640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0815ab70 0x7f3b081f6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 -- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b08068ac0 msgr2=0x7f3b081f4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b08068ac0 0x7f3b081f4ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 -- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0815ab70 msgr2=0x7f3b081f6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0815ab70 0x7f3b081f6dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.629+0000 7f3afffff640 1 -- 172.21.15.81:0/3599438319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b080c3e90 con 0x7f3b080ce8d0 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.630+0000 7f3afffff640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b080ce8d0 0x7f3b080d0530 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c920 tx=0x7f3af800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:00.633 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.630+0000 7f3afd7fa640 1 -- 172.21.15.81:0/3599438319 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af8007c70 con 0x7f3b080ce8d0 2024-09-17T05:26:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.630+0000 7f3afd7fa640 1 -- 172.21.15.81:0/3599438319 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3af800f450 con 0x7f3b080ce8d0 2024-09-17T05:26:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.630+0000 7f3afd7fa640 1 -- 172.21.15.81:0/3599438319 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3af800f8a0 con 0x7f3b080ce8d0 2024-09-17T05:26:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.630+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b080c4130 con 0x7f3b080ce8d0 2024-09-17T05:26:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.630+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b080b5c60 con 0x7f3b080ce8d0 2024-09-17T05:26:00.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.631+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b080b17f0 con 0x7f3b080ce8d0 2024-09-17T05:26:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.631+0000 7f3afd7fa640 1 -- 172.21.15.81:0/3599438319 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f3af800fa40 con 0x7f3b080ce8d0 2024-09-17T05:26:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.632+0000 7f3afd7fa640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3af4079400 0x7f3af407b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.632+0000 7f3b0cb37640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3af4079400 0x7f3af407b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.632+0000 7f3afd7fa640 1 -- 172.21.15.81:0/3599438319 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f3af809c620 con 0x7f3b080ce8d0 2024-09-17T05:26:00.635 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.632+0000 7f3b0cb37640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3af4079400 0x7f3af407b8c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3b080caa20 tx=0x7f3b04009060 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:00.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.637+0000 7f3afd7fa640 1 -- 172.21.15.81:0/3599438319 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3af8014030 con 0x7f3b080ce8d0 2024-09-17T05:26:00.849 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.848+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f3b080b6240 con 0x7f3b080ce8d0 2024-09-17T05:26:00.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.916+0000 7f3afd7fa640 1 -- 172.21.15.81:0/3599438319 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v93) ==== 136+0+0 (secure 0 0 0) 0x7f3af806a070 con 0x7f3b080ce8d0 2024-09-17T05:26:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3af4079400 msgr2=0x7f3af407b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:00.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3af4079400 0x7f3af407b8c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3b080caa20 tx=0x7f3b04009060 comp rx=0 tx=0).stop 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b080ce8d0 msgr2=0x7f3b080d0530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b080ce8d0 0x7f3b080d0530 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f3af800c920 tx=0x7f3af800cde0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 shutdown_connections 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3af4079400 0x7f3af407b8c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f3b0815ab70 0x7f3b081f6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f3b080ce8d0 0x7f3b080d0530 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 --2- 172.21.15.81:0/3599438319 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3b08068ac0 0x7f3b081f4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 >> 172.21.15.81:0/3599438319 conn(0x7f3b08074160 msgr2=0x7f3b0815d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 shutdown_connections 2024-09-17T05:26:00.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:00.919+0000 7f3b0ed9b640 1 -- 172.21.15.81:0/3599438319 wait complete. 2024-09-17T05:26:00.931 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:26:01.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.032+0000 7f3865cb0640 1 -- 172.21.15.81:0/2640682851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 msgr2=0x7f38600cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.032+0000 7f3865cb0640 1 --2- 172.21.15.81:0/2640682851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f38600cf9b0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7f38600b9f50 tx=0x7f385802a4f0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.032+0000 7f3865cb0640 1 -- 172.21.15.81:0/2640682851 shutdown_connections 2024-09-17T05:26:01.033 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.032+0000 7f3865cb0640 1 --2- 172.21.15.81:0/2640682851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f38600cf9b0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.032+0000 7f3865cb0640 1 -- 172.21.15.81:0/2640682851 >> 172.21.15.81:0/2640682851 conn(0x7f38600d3ea0 msgr2=0x7f38600d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:01.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.032+0000 7f3865cb0640 1 -- 172.21.15.81:0/2640682851 shutdown_connections 2024-09-17T05:26:01.034 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.032+0000 7f3865cb0640 1 -- 172.21.15.81:0/2640682851 wait complete. 2024-09-17T05:26:01.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.033+0000 7f3865cb0640 1 Processor -- start 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.033+0000 7f3865cb0640 1 -- start start 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3865cb0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38600d0d40 0x7f3860160540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3865cb0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f386015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3865cb0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386015df90 0x7f386014e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3865cb0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f3860162690 con 0x7f38600d49c0 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3865cb0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f38600b3f10 con 0x7f386015df90 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3865cb0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f386014e850 con 0x7f38600d0d40 2024-09-17T05:26:01.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f386015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f386015ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46324/0 (socket says 172.21.15.81:46324) 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 -- 172.21.15.81:0/285820154 learned_addr learned my addr 172.21.15.81:0/285820154 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385ffff640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386015df90 0x7f386014e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 -- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38600d0d40 msgr2=0x7f3860160540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385f7fe640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38600d0d40 0x7f3860160540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38600d0d40 0x7f3860160540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 -- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386015df90 msgr2=0x7f386014e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386015df90 0x7f386014e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 -- 172.21.15.81:0/285820154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386015f4a0 con 0x7f38600d49c0 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385ffff640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386015df90 0x7f386014e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:01.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f385effd640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f386015ee50 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f385400c430 tx=0x7f385400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:01.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3847fff640 1 -- 172.21.15.81:0/285820154 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854011790 con 0x7f38600d49c0 2024-09-17T05:26:01.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3847fff640 1 -- 172.21.15.81:0/285820154 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3854017070 con 0x7f38600d49c0 2024-09-17T05:26:01.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386015f780 con 0x7f38600d49c0 2024-09-17T05:26:01.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.034+0000 7f3847fff640 1 -- 172.21.15.81:0/285820154 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3854011d00 con 0x7f38600d49c0 2024-09-17T05:26:01.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.035+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386015fd40 con 0x7f38600d49c0 2024-09-17T05:26:01.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.035+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38600b4450 con 0x7f38600d49c0 2024-09-17T05:26:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.036+0000 7f3847fff640 1 -- 172.21.15.81:0/285820154 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f385401c460 con 0x7f38600d49c0 2024-09-17T05:26:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.037+0000 7f3847fff640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f384c079400 0x7f384c07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.037+0000 7f385f7fe640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f384c079400 0x7f384c07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.037+0000 7f3847fff640 1 -- 172.21.15.81:0/285820154 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f38540994a0 con 0x7f38600d49c0 2024-09-17T05:26:01.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.037+0000 7f385f7fe640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f384c079400 0x7f384c07b8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3850002020 tx=0x7f3850009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:01.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.042+0000 7f3847fff640 1 -- 172.21.15.81:0/285820154 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f38540633a0 con 0x7f38600d49c0 2024-09-17T05:26:01.241 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.240+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f386008d590 con 0x7f384c079400 2024-09-17T05:26:01.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.241+0000 7f3847fff640 1 -- 172.21.15.81:0/285820154 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f386008d590 con 0x7f384c079400 2024-09-17T05:26:01.242 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:26:01.242 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:26:01.243 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:01.243 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f384c079400 msgr2=0x7f384c07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f384c079400 0x7f384c07b8c0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f3850002020 tx=0x7f3850009040 comp rx=0 tx=0).stop 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 msgr2=0x7f386015ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f386015ee50 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7f385400c430 tx=0x7f385400c8f0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 shutdown_connections 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f384c079400 0x7f384c07b8c0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f386015df90 0x7f386014e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f38600d49c0 0x7f386015ee50 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 --2- 172.21.15.81:0/285820154 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f38600d0d40 0x7f3860160540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.245 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 >> 172.21.15.81:0/285820154 conn(0x7f38600d3ea0 msgr2=0x7f3860161ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 shutdown_connections 2024-09-17T05:26:01.246 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.244+0000 7f3865cb0640 1 -- 172.21.15.81:0/285820154 wait complete. 2024-09-17T05:26:01.256 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:26:01.359 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 -- 172.21.15.81:0/899873245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f401617f0 msgr2=0x7f5f400d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 --2- 172.21.15.81:0/899873245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f401617f0 0x7f5f400d1d30 secure :-1 s=READY pgs=1748 cs=0 l=1 rev1=1 crypto rx=0x7f5f38009830 tx=0x7f5f3802a480 comp rx=0 tx=0).stop 2024-09-17T05:26:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 -- 172.21.15.81:0/899873245 shutdown_connections 2024-09-17T05:26:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 --2- 172.21.15.81:0/899873245 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f400d01b0 0x7f5f400d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 --2- 172.21.15.81:0/899873245 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f401617f0 0x7f5f400d1d30 unknown :-1 s=CLOSED pgs=1748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 -- 172.21.15.81:0/899873245 >> 172.21.15.81:0/899873245 conn(0x7f5f400d3e30 msgr2=0x7f5f400d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 -- 172.21.15.81:0/899873245 shutdown_connections 2024-09-17T05:26:01.360 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.358+0000 7f5f46f32640 1 -- 172.21.15.81:0/899873245 wait complete. 2024-09-17T05:26:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.359+0000 7f5f46f32640 1 Processor -- start 2024-09-17T05:26:01.362 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.359+0000 7f5f46f32640 1 -- start start 2024-09-17T05:26:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f46f32640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400d01b0 0x7f5f400b8ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f46f32640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f400d27b0 0x7f5f4015e930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f46f32640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f401617f0 0x7f5f4015a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f46f32640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5f400d0f50 con 0x7f5f400d01b0 2024-09-17T05:26:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f46f32640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5f400b5000 con 0x7f5f401617f0 2024-09-17T05:26:01.363 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f46f32640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5f400d10d0 con 0x7f5f400d27b0 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f44cce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400d01b0 0x7f5f400b8ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f44cce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400d01b0 0x7f5f400b8ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46334/0 (socket says 172.21.15.81:46334) 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f44cce640 1 -- 172.21.15.81:0/3075415080 learned_addr learned my addr 172.21.15.81:0/3075415080 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.360+0000 7f5f3ffff640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f400d27b0 0x7f5f4015e930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f454cf640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f401617f0 0x7f5f4015a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f44cce640 1 -- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f400d27b0 msgr2=0x7f5f4015e930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f44cce640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f400d27b0 0x7f5f4015e930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f44cce640 1 -- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f401617f0 msgr2=0x7f5f4015a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f44cce640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f401617f0 0x7f5f4015a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.364 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f44cce640 1 -- 172.21.15.81:0/3075415080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f40158880 con 0x7f5f400d01b0 2024-09-17T05:26:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f3ffff640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f400d27b0 0x7f5f4015e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f44cce640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400d01b0 0x7f5f400b8ef0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5f3802aa70 tx=0x7f5f380040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f3d7fa640 1 -- 172.21.15.81:0/3075415080 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38005220 con 0x7f5f400d01b0 2024-09-17T05:26:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f3d7fa640 1 -- 172.21.15.81:0/3075415080 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5f380054b0 con 0x7f5f400d01b0 2024-09-17T05:26:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f401f5490 con 0x7f5f400d01b0 2024-09-17T05:26:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f3d7fa640 1 -- 172.21.15.81:0/3075415080 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f38004a00 con 0x7f5f400d01b0 2024-09-17T05:26:01.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.361+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f400b9430 con 0x7f5f400d01b0 2024-09-17T05:26:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.362+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f401f5880 con 0x7f5f400d01b0 2024-09-17T05:26:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.363+0000 7f5f3d7fa640 1 -- 172.21.15.81:0/3075415080 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f5f38004ba0 con 0x7f5f400d01b0 2024-09-17T05:26:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.363+0000 7f5f3d7fa640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f20079400 0x7f5f2007b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.363+0000 7f5f3ffff640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f20079400 0x7f5f2007b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.363+0000 7f5f3d7fa640 1 -- 172.21.15.81:0/3075415080 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f5f380bd360 con 0x7f5f400d01b0 2024-09-17T05:26:01.366 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.364+0000 7f5f3ffff640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f20079400 0x7f5f2007b8c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5f400cae50 tx=0x7f5f28005d30 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:01.368 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.369+0000 7f5f3d7fa640 1 -- 172.21.15.81:0/3075415080 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5f3803f030 con 0x7f5f400d01b0 2024-09-17T05:26:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.544+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f5f400d15f0 con 0x7f5f400d01b0 2024-09-17T05:26:01.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.544+0000 7f5f3d7fa640 1 -- 172.21.15.81:0/3075415080 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v46)=0 v46) ==== 122+0+0 (secure 0 0 0) 0x7f5f38084730 con 0x7f5f400d01b0 2024-09-17T05:26:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f20079400 msgr2=0x7f5f2007b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.546 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f20079400 0x7f5f2007b8c0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5f400cae50 tx=0x7f5f28005d30 comp rx=0 tx=0).stop 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400d01b0 msgr2=0x7f5f400b8ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400d01b0 0x7f5f400b8ef0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f5f3802aa70 tx=0x7f5f380040c0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 shutdown_connections 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5f20079400 0x7f5f2007b8c0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5f401617f0 0x7f5f4015a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5f400d27b0 0x7f5f4015e930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 --2- 172.21.15.81:0/3075415080 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5f400d01b0 0x7f5f400b8ef0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 >> 172.21.15.81:0/3075415080 conn(0x7f5f400d3e30 msgr2=0x7f5f400b1c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 shutdown_connections 2024-09-17T05:26:01.547 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:01.546+0000 7f5f46f32640 1 -- 172.21.15.81:0/3075415080 wait complete. 2024-09-17T05:26:01.557 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:01.558 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/_nogroup/subvol92470/44ec71e3-638f-4231-9d32-9bca0a3a23ec) 2024-09-17T05:26:01.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:01.593 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:26:01.650 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:26:01.650 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:01.650 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/_nogroup/subvol92470/44ec71e3-638f-4231-9d32-9bca0a3a23ec) 2024-09-17T05:26:01.720 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:01.721 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/_nogroup/subvol92470/.meta 2024-09-17T05:26:01.790 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:01.790 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p volumes/subvol_grp89290/subvol85991/4a9dbd1b-00d3-45e7-a718-7997feb27a32) 2024-09-17T05:26:01.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:01.860 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:26:01.917 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:26:01.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:01.918 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data volumes/subvol_grp89290/subvol85991/4a9dbd1b-00d3-45e7-a718-7997feb27a32) 2024-09-17T05:26:01.988 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:01.988 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/volumes/subvol_grp89290/subvol85991/.meta 2024-09-17T05:26:02.056 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol92470 2024-09-17T05:26:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.200+0000 7f4333fe8640 1 -- 172.21.15.81:0/2616560532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4318003a50 msgr2=0x7f4318003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.200+0000 7f4333fe8640 1 --2- 172.21.15.81:0/2616560532 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4318003a50 0x7f4318003e70 secure :-1 s=READY pgs=1751 cs=0 l=1 rev1=1 crypto rx=0x7f4328009b20 tx=0x7f4318005830 comp rx=0 tx=0).stop 2024-09-17T05:26:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.200+0000 7f4332585640 1 -- 172.21.15.81:0/2616560532 reap_dead start 2024-09-17T05:26:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.200+0000 7f4333fe8640 1 -- 172.21.15.81:0/2616560532 shutdown_connections 2024-09-17T05:26:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.200+0000 7f4333fe8640 1 -- 172.21.15.81:0/2616560532 >> 172.21.15.81:0/2616560532 conn(0x7f432c0d3e30 msgr2=0x7f432c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.200+0000 7f4333fe8640 1 -- 172.21.15.81:0/2616560532 shutdown_connections 2024-09-17T05:26:02.201 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.200+0000 7f4333fe8640 1 -- 172.21.15.81:0/2616560532 wait complete. 2024-09-17T05:26:02.203 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 Processor -- start 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 -- start start 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4318003a50 0x7f432c14f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f432c157070 0x7f432c1f4ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1f51e0 0x7f432c06e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f432c0d1d30 con 0x7f432c157070 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f432c0b5000 con 0x7f432c1f51e0 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4333fe8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f432c0d1eb0 con 0x7f4318003a50 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4331583640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f432c157070 0x7f432c1f4ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4331583640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f432c157070 0x7f432c1f4ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46342/0 (socket says 172.21.15.81:46342) 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4331583640 1 -- 172.21.15.81:0/2820627237 learned_addr learned my addr 172.21.15.81:0/2820627237 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:02.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.202+0000 7f4331d84640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4318003a50 0x7f432c14f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4332585640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1f51e0 0x7f432c06e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4331583640 1 -- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4318003a50 msgr2=0x7f432c14f310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4331583640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4318003a50 0x7f432c14f310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4331583640 1 -- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1f51e0 msgr2=0x7f432c06e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4331583640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1f51e0 0x7f432c06e270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4331583640 1 -- 172.21.15.81:0/2820627237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432c0cdfb0 con 0x7f432c157070 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4332585640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1f51e0 0x7f432c06e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4331583640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f432c157070 0x7f432c1f4ca0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f431c005bc0 tx=0x7f431c011f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f43227fc640 1 -- 172.21.15.81:0/2820627237 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c00fc10 con 0x7f432c157070 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f43227fc640 1 -- 172.21.15.81:0/2820627237 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f431c00fdb0 con 0x7f432c157070 2024-09-17T05:26:02.205 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f43227fc640 1 -- 172.21.15.81:0/2820627237 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c019670 con 0x7f432c157070 2024-09-17T05:26:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f432c0b8230 con 0x7f432c157070 2024-09-17T05:26:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.203+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f432c0b87f0 con 0x7f432c157070 2024-09-17T05:26:02.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.204+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f432c0d2250 con 0x7f432c157070 2024-09-17T05:26:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.204+0000 7f43227fc640 1 -- 172.21.15.81:0/2820627237 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f431c019810 con 0x7f432c157070 2024-09-17T05:26:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.205+0000 7f43227fc640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4310079430 0x7f431007b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.205+0000 7f43227fc640 1 -- 172.21.15.81:0/2820627237 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f431c099dc0 con 0x7f432c157070 2024-09-17T05:26:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.205+0000 7f4331d84640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4310079430 0x7f431007b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.206+0000 7f4331d84640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4310079430 0x7f431007b8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4328035000 tx=0x7f432802d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:02.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.209+0000 7f43227fc640 1 -- 172.21.15.81:0/2820627237 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f431c0636f0 con 0x7f432c157070 2024-09-17T05:26:02.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.411+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol92470", "target": ["mon-mgr", ""]}) -- 0x7f432c0b6660 con 0x7f4310079430 2024-09-17T05:26:02.415 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:02.415+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:02.415 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:02.415+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:02.415 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:02.415+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:02.416 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:02.415+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:02.416 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:02.415+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:02.462 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.462+0000 7f43227fc640 1 -- 172.21.15.81:0/2820627237 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+67 (secure 0 0 0) 0x7f432c0b6660 con 0x7f4310079430 2024-09-17T05:26:02.463 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/_nogroup/subvol92470/44ec71e3-638f-4231-9d32-9bca0a3a23ec 2024-09-17T05:26:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4310079430 msgr2=0x7f431007b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4310079430 0x7f431007b8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4328035000 tx=0x7f432802d040 comp rx=0 tx=0).stop 2024-09-17T05:26:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f432c157070 msgr2=0x7f432c1f4ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f432c157070 0x7f432c1f4ca0 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f431c005bc0 tx=0x7f431c011f40 comp rx=0 tx=0).stop 2024-09-17T05:26:02.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 shutdown_connections 2024-09-17T05:26:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4310079430 0x7f431007b8f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f432c1f51e0 0x7f432c06e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f432c157070 0x7f432c1f4ca0 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 --2- 172.21.15.81:0/2820627237 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4318003a50 0x7f432c14f310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 >> 172.21.15.81:0/2820627237 conn(0x7f432c0d3e30 msgr2=0x7f432c0b2a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 shutdown_connections 2024-09-17T05:26:02.466 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.465+0000 7f4333fe8640 1 -- 172.21.15.81:0/2820627237 wait complete. 2024-09-17T05:26:02.476 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol85991 subvol_grp89290 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 -- 172.21.15.81:0/703528877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 msgr2=0x7fbe700ce1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 --2- 172.21.15.81:0/703528877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 0x7fbe700ce1b0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fbe68005fd0 tx=0x7fbe6802a540 comp rx=0 tx=0).stop 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 -- 172.21.15.81:0/703528877 shutdown_connections 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 --2- 172.21.15.81:0/703528877 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 0x7fbe700ce1b0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 --2- 172.21.15.81:0/703528877 >> v2:172.21.15.160:3300/0 conn(0x7fbe70072d50 0x7fbe7006fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 -- 172.21.15.81:0/703528877 >> 172.21.15.81:0/703528877 conn(0x7fbe700cfdf0 msgr2=0x7fbe700d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 -- 172.21.15.81:0/703528877 shutdown_connections 2024-09-17T05:26:02.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.581+0000 7fbe75f45640 1 -- 172.21.15.81:0/703528877 wait complete. 2024-09-17T05:26:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.582+0000 7fbe75f45640 1 Processor -- start 2024-09-17T05:26:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.583+0000 7fbe75f45640 1 -- start start 2024-09-17T05:26:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.583+0000 7fbe75f45640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 0x7fbe700c5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.583+0000 7fbe75f45640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe70072d50 0x7fbe700b5600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.583+0000 7fbe75f45640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7015ac80 0x7fbe7015a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.583+0000 7fbe75f45640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbe700ceac0 con 0x7fbe70072d50 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.583+0000 7fbe75f45640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbe700ce940 con 0x7fbe7015ac80 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.583+0000 7fbe75f45640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbe700cec40 con 0x7fbe7006ff50 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe70072d50 0x7fbe700b5600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe70072d50 0x7fbe700b5600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46364/0 (socket says 172.21.15.81:46364) 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 -- 172.21.15.81:0/2674611371 learned_addr learned my addr 172.21.15.81:0/2674611371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6f7fe640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 0x7fbe700c5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6ffff640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7015ac80 0x7fbe7015a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 -- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 msgr2=0x7fbe700c5400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 0x7fbe700c5400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 -- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7015ac80 msgr2=0x7fbe7015a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7015ac80 0x7fbe7015a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 -- 172.21.15.81:0/2674611371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe700c43d0 con 0x7fbe70072d50 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6f7fe640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 0x7fbe700c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe6effd640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe70072d50 0x7fbe700b5600 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400e9d0 tx=0x7fbe6400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe57fff640 1 -- 172.21.15.81:0/2674611371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6400cde0 con 0x7fbe70072d50 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe57fff640 1 -- 172.21.15.81:0/2674611371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbe64004020 con 0x7fbe70072d50 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe700c4640 con 0x7fbe70072d50 2024-09-17T05:26:02.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe57fff640 1 -- 172.21.15.81:0/2674611371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64004450 con 0x7fbe70072d50 2024-09-17T05:26:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.584+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe700c4c00 con 0x7fbe70072d50 2024-09-17T05:26:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.585+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe700ce1b0 con 0x7fbe70072d50 2024-09-17T05:26:02.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.586+0000 7fbe57fff640 1 -- 172.21.15.81:0/2674611371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7fbe640035f0 con 0x7fbe70072d50 2024-09-17T05:26:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.586+0000 7fbe57fff640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe5c079400 0x7fbe5c07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.586+0000 7fbe57fff640 1 -- 172.21.15.81:0/2674611371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7fbe6409c5d0 con 0x7fbe70072d50 2024-09-17T05:26:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.586+0000 7fbe6f7fe640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe5c079400 0x7fbe5c07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:02.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.587+0000 7fbe6f7fe640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe5c079400 0x7fbe5c07b8c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe7006dad0 tx=0x7fbe60009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:02.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.591+0000 7fbe57fff640 1 -- 172.21.15.81:0/2674611371 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbe64063ec0 con 0x7fbe70072d50 2024-09-17T05:26:02.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.795+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol85991", "group_name": "subvol_grp89290", "target": ["mon-mgr", ""]}) -- 0x7fbe70074bc0 con 0x7fbe5c079400 2024-09-17T05:26:02.837 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.837+0000 7fbe57fff640 1 -- 172.21.15.81:0/2674611371 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+74 (secure 0 0 0) 0x7fbe70074bc0 con 0x7fbe5c079400 2024-09-17T05:26:02.837 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp89290/subvol85991/4a9dbd1b-00d3-45e7-a718-7997feb27a32 2024-09-17T05:26:02.839 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe5c079400 msgr2=0x7fbe5c07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe5c079400 0x7fbe5c07b8c0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fbe7006dad0 tx=0x7fbe60009040 comp rx=0 tx=0).stop 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe70072d50 msgr2=0x7fbe700b5600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe70072d50 0x7fbe700b5600 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400e9d0 tx=0x7fbe6400ee90 comp rx=0 tx=0).stop 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 shutdown_connections 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbe5c079400 0x7fbe5c07b8c0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbe7015ac80 0x7fbe7015a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbe70072d50 0x7fbe700b5600 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 --2- 172.21.15.81:0/2674611371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbe7006ff50 0x7fbe700c5400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.839+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 >> 172.21.15.81:0/2674611371 conn(0x7fbe700cfdf0 msgr2=0x7fbe700acd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.840+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 shutdown_connections 2024-09-17T05:26:02.840 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:02.840+0000 7fbe75f45640 1 -- 172.21.15.81:0/2674611371 wait complete. 2024-09-17T05:26:02.850 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:02.850 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_nogroup/subvol92470/.meta) 2024-09-17T05:26:02.877 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:26:02.877 INFO:teuthology.orchestra.run.smithi081.stdout:version = 2 2024-09-17T05:26:02.877 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:26:02.877 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/_nogroup/subvol92470/44ec71e3-638f-4231-9d32-9bca0a3a23ec 2024-09-17T05:26:02.877 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:26:02.877 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:02.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:02.879 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/subvol_grp89290/subvol85991/.meta) 2024-09-17T05:26:02.946 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:26:02.946 INFO:teuthology.orchestra.run.smithi081.stdout:version = 2 2024-09-17T05:26:02.946 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:26:02.946 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/subvol_grp89290/subvol85991/4a9dbd1b-00d3-45e7-a718-7997feb27a32 2024-09-17T05:26:02.947 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:26:02.947 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:02.948 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol92470 2024-09-17T05:26:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.092+0000 7f392f7da640 1 -- 172.21.15.81:0/609419104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392815a450 msgr2=0x7f39280cbaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.092+0000 7f392f7da640 1 --2- 172.21.15.81:0/609419104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392815a450 0x7f39280cbaa0 secure :-1 s=READY pgs=1757 cs=0 l=1 rev1=1 crypto rx=0x7f391800a940 tx=0x7f391802b850 comp rx=0 tx=0).stop 2024-09-17T05:26:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.092+0000 7f392f7da640 1 -- 172.21.15.81:0/609419104 shutdown_connections 2024-09-17T05:26:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.092+0000 7f392f7da640 1 --2- 172.21.15.81:0/609419104 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f392815a450 0x7f39280cbaa0 unknown :-1 s=CLOSED pgs=1757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.092+0000 7f392f7da640 1 --2- 172.21.15.81:0/609419104 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f392815a070 0x7f3928072e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.093 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.092+0000 7f392f7da640 1 -- 172.21.15.81:0/609419104 >> 172.21.15.81:0/609419104 conn(0x7f39280b1700 msgr2=0x7f39280b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.093+0000 7f392f7da640 1 -- 172.21.15.81:0/609419104 shutdown_connections 2024-09-17T05:26:03.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.093+0000 7f392f7da640 1 -- 172.21.15.81:0/609419104 wait complete. 2024-09-17T05:26:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.094+0000 7f392f7da640 1 Processor -- start 2024-09-17T05:26:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.094+0000 7f392f7da640 1 -- start start 2024-09-17T05:26:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.094+0000 7f392f7da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39280cbfe0 0x7f39280c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.094+0000 7f392f7da640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f392815a070 0x7f39281e59e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.094+0000 7f392f7da640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f392815a450 0x7f39281e5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.094+0000 7f392f7da640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f39280cc5b0 con 0x7f39280cbfe0 2024-09-17T05:26:03.096 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392f7da640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f392806ec20 con 0x7f392815a450 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392f7da640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f39280cc730 con 0x7f392815a070 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39280cbfe0 0x7f39280c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39280cbfe0 0x7f39280c6e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46376/0 (socket says 172.21.15.81:46376) 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 -- 172.21.15.81:0/1972502008 learned_addr learned my addr 172.21.15.81:0/1972502008 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 -- 172.21.15.81:0/1972502008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f392815a070 msgr2=0x7f39281e59e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f392815a070 0x7f39281e59e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 -- 172.21.15.81:0/1972502008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f392815a450 msgr2=0x7f39281e5f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f392815a450 0x7f39281e5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 -- 172.21.15.81:0/1972502008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f392813eb40 con 0x7f39280cbfe0 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392d576640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39280cbfe0 0x7f39280c6e70 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f392400d950 tx=0x7f392400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f391dffb640 1 -- 172.21.15.81:0/1972502008 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3924017070 con 0x7f39280cbfe0 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f391dffb640 1 -- 172.21.15.81:0/1972502008 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3924009d20 con 0x7f39280cbfe0 2024-09-17T05:26:03.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f39280c9ae0 con 0x7f39280cbfe0 2024-09-17T05:26:03.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f391dffb640 1 -- 172.21.15.81:0/1972502008 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39240106c0 con 0x7f39280cbfe0 2024-09-17T05:26:03.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.095+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39281e51e0 con 0x7f39280cbfe0 2024-09-17T05:26:03.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.096+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f39280d0290 con 0x7f39280cbfe0 2024-09-17T05:26:03.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.097+0000 7f391dffb640 1 -- 172.21.15.81:0/1972502008 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f3924010860 con 0x7f39280cbfe0 2024-09-17T05:26:03.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.097+0000 7f391dffb640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f390c079400 0x7f390c07b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.097+0000 7f391dffb640 1 -- 172.21.15.81:0/1972502008 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f3924099940 con 0x7f39280cbfe0 2024-09-17T05:26:03.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.097+0000 7f392cd75640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f390c079400 0x7f390c07b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:03.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.098+0000 7f392cd75640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f390c079400 0x7f390c07b8c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3918036000 tx=0x7f39180046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:03.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.102+0000 7f391dffb640 1 -- 172.21.15.81:0/1972502008 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f39240638c0 con 0x7f39280cbfe0 2024-09-17T05:26:03.303 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.303+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol92470", "target": ["mon-mgr", ""]}) -- 0x7f39280ca000 con 0x7f390c079400 2024-09-17T05:26:03.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.322+0000 7f391dffb640 1 -- 172.21.15.81:0/1972502008 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f39280ca000 con 0x7f390c079400 2024-09-17T05:26:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f390c079400 msgr2=0x7f390c07b8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f390c079400 0x7f390c07b8c0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3918036000 tx=0x7f39180046c0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39280cbfe0 msgr2=0x7f39280c6e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39280cbfe0 0x7f39280c6e70 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7f392400d950 tx=0x7f392400de10 comp rx=0 tx=0).stop 2024-09-17T05:26:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 shutdown_connections 2024-09-17T05:26:03.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f390c079400 0x7f390c07b8c0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f392815a450 0x7f39281e5f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f392815a070 0x7f39281e59e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 --2- 172.21.15.81:0/1972502008 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f39280cbfe0 0x7f39280c6e70 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.324+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 >> 172.21.15.81:0/1972502008 conn(0x7f39280b1700 msgr2=0x7f392806e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.325+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 shutdown_connections 2024-09-17T05:26:03.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.325+0000 7f392f7da640 1 -- 172.21.15.81:0/1972502008 wait complete. 2024-09-17T05:26:03.327 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.326+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.327 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.326+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.327 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.326+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.327 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.326+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.327 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.326+0000 7fe394f72640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.337 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol85991 subvol_grp89290 2024-09-17T05:26:03.340 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.340+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.340 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.340+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.340 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.340+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.340 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.340+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.340 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:03.340+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.443+0000 7f176b732640 1 -- 172.21.15.81:0/4148221576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 msgr2=0x7f1750004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.443+0000 7f176b732640 1 --2- 172.21.15.81:0/4148221576 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 0x7f1750004800 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f1754009b80 tx=0x7f1750005830 comp rx=0 tx=0).stop 2024-09-17T05:26:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.443+0000 7f1769ccf640 1 -- 172.21.15.81:0/4148221576 reap_dead start 2024-09-17T05:26:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.443+0000 7f176b732640 1 -- 172.21.15.81:0/4148221576 shutdown_connections 2024-09-17T05:26:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.443+0000 7f176b732640 1 -- 172.21.15.81:0/4148221576 >> 172.21.15.81:0/4148221576 conn(0x7f17640b1620 msgr2=0x7f17640b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.444+0000 7f176b732640 1 -- 172.21.15.81:0/4148221576 shutdown_connections 2024-09-17T05:26:03.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.444+0000 7f176b732640 1 -- 172.21.15.81:0/4148221576 wait complete. 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 Processor -- start 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 -- start start 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 0x7f176414fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17641f8da0 0x7f17641f4ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17641f50e0 0x7f1764148c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1764070210 con 0x7f1750003fd0 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1764070090 con 0x7f17641f50e0 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.445+0000 7f176b732640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1764158230 con 0x7f17641f8da0 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 0x7f176414fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 0x7f176414fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46622/0 (socket says 172.21.15.81:46622) 2024-09-17T05:26:03.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 -- 172.21.15.81:0/3108369252 learned_addr learned my addr 172.21.15.81:0/3108369252 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f1768ccd640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17641f8da0 0x7f17641f4ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f1769ccf640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17641f50e0 0x7f1764148c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 -- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17641f8da0 msgr2=0x7f17641f4ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17641f8da0 0x7f17641f4ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 -- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17641f50e0 msgr2=0x7f1764148c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17641f50e0 0x7f1764148c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 -- 172.21.15.81:0/3108369252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17641f5580 con 0x7f1750003fd0 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f17694ce640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 0x7f176414fa30 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f1760006630 tx=0x7f17600039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f1759ffb640 1 -- 172.21.15.81:0/3108369252 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760015070 con 0x7f1750003fd0 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f1759ffb640 1 -- 172.21.15.81:0/3108369252 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1760011920 con 0x7f1750003fd0 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17641f5860 con 0x7f1750003fd0 2024-09-17T05:26:03.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f1759ffb640 1 -- 172.21.15.81:0/3108369252 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1760011d70 con 0x7f1750003fd0 2024-09-17T05:26:03.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.446+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1764149140 con 0x7f1750003fd0 2024-09-17T05:26:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.447+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17641f5aa0 con 0x7f1750003fd0 2024-09-17T05:26:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.448+0000 7f1759ffb640 1 -- 172.21.15.81:0/3108369252 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 25) ==== 102206+0+0 (secure 0 0 0) 0x7f1760010420 con 0x7f1750003fd0 2024-09-17T05:26:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.448+0000 7f1759ffb640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1748079430 0x7f174807b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.448+0000 7f1768ccd640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1748079430 0x7f174807b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.449+0000 7f1759ffb640 1 -- 172.21.15.81:0/3108369252 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f176009a330 con 0x7f1750003fd0 2024-09-17T05:26:03.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.449+0000 7f1768ccd640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1748079430 0x7f174807b8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1754035000 tx=0x7f17540046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:03.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.453+0000 7f1759ffb640 1 -- 172.21.15.81:0/3108369252 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f17641f5aa0 con 0x7f1750003fd0 2024-09-17T05:26:03.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.652+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol85991", "group_name": "subvol_grp89290", "target": ["mon-mgr", ""]}) -- 0x7f176415e330 con 0x7f1748079430 2024-09-17T05:26:03.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.673+0000 7f1759ffb640 1 -- 172.21.15.81:0/3108369252 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f176415e330 con 0x7f1748079430 2024-09-17T05:26:03.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1748079430 msgr2=0x7f174807b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1748079430 0x7f174807b8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f1754035000 tx=0x7f17540046c0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 msgr2=0x7f176414fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 0x7f176414fa30 secure :-1 s=READY pgs=1765 cs=0 l=1 rev1=1 crypto rx=0x7f1760006630 tx=0x7f17600039c0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 shutdown_connections 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1748079430 0x7f174807b8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17641f50e0 0x7f1764148c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17641f8da0 0x7f17641f4ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 --2- 172.21.15.81:0/3108369252 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1750003fd0 0x7f176414fa30 unknown :-1 s=CLOSED pgs=1765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 >> 172.21.15.81:0/3108369252 conn(0x7f17640b1620 msgr2=0x7f176415a6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:03.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 shutdown_connections 2024-09-17T05:26:03.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03.675+0000 7f176b732640 1 -- 172.21.15.81:0/3108369252 wait complete. 2024-09-17T05:26:03.687 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:26:03.736 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:26:03.742 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-17T05:26:03.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:03 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:26:03.749 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:26:03.749 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:26:03.799 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:26:03.853 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:26:03.854 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:03.854 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:03.854 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:03.870 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:03.870 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:03.927 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:26:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 -- 172.21.15.81:0/2536882832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100d2410 msgr2=0x7f7c100b3090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.069 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 --2- 172.21.15.81:0/2536882832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100d2410 0x7f7c100b3090 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7f7c00005fd0 tx=0x7f7c0002a940 comp rx=0 tx=0).stop 2024-09-17T05:26:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 -- 172.21.15.81:0/2536882832 shutdown_connections 2024-09-17T05:26:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 --2- 172.21.15.81:0/2536882832 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c1015f6d0 0x7f7c1015c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 --2- 172.21.15.81:0/2536882832 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c100d2410 0x7f7c100b3090 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 -- 172.21.15.81:0/2536882832 >> 172.21.15.81:0/2536882832 conn(0x7f7c1009aa30 msgr2=0x7f7c1009ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 -- 172.21.15.81:0/2536882832 shutdown_connections 2024-09-17T05:26:04.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.069+0000 7f7c156dd640 1 -- 172.21.15.81:0/2536882832 wait complete. 2024-09-17T05:26:04.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.070+0000 7f7c156dd640 1 Processor -- start 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.070+0000 7f7c156dd640 1 -- start start 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c156dd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100d2410 0x7f7c100c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c156dd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c1015cdc0 0x7f7c100b0240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c156dd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c1015f6d0 0x7f7c1006e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c156dd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100b13c0 con 0x7f7c1015cdc0 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c156dd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7c100b1240 con 0x7f7c100d2410 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c156dd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7c100b1540 con 0x7f7c1015f6d0 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c1015cdc0 0x7f7c100b0240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c1015cdc0 0x7f7c100b0240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46628/0 (socket says 172.21.15.81:46628) 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 -- 172.21.15.81:0/3261435839 learned_addr learned my addr 172.21.15.81:0/3261435839 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0effd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100d2410 0x7f7c100c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0f7fe640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c1015f6d0 0x7f7c1006e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 -- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c1015f6d0 msgr2=0x7f7c1006e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c1015f6d0 0x7f7c1006e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 -- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100d2410 msgr2=0x7f7c100c7bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100d2410 0x7f7c100c7bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.071+0000 7f7c0e7fc640 1 -- 172.21.15.81:0/3261435839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c1006f4a0 con 0x7f7c1015cdc0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.072+0000 7f7c0e7fc640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c1015cdc0 0x7f7c100b0240 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800b410 tx=0x7f7bf800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.072+0000 7f7c077fe640 1 -- 172.21.15.81:0/3261435839 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8015020 con 0x7f7c1015cdc0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.072+0000 7f7c077fe640 1 -- 172.21.15.81:0/3261435839 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7bf8011940 con 0x7f7c1015cdc0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.072+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c101f93c0 con 0x7f7c1015cdc0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.072+0000 7f7c077fe640 1 -- 172.21.15.81:0/3261435839 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bf8011d90 con 0x7f7c1015cdc0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.072+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c1006fa20 con 0x7f7c1015cdc0 2024-09-17T05:26:04.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.073+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c100b19f0 con 0x7f7c1015cdc0 2024-09-17T05:26:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.073+0000 7f7c077fe640 1 -- 172.21.15.81:0/3261435839 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f7bf8018020 con 0x7f7c1015cdc0 2024-09-17T05:26:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.074+0000 7f7c077fe640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7bf00795b0 0x7f7bf007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.074+0000 7f7c077fe640 1 -- 172.21.15.81:0/3261435839 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f7bf80997e0 con 0x7f7c1015cdc0 2024-09-17T05:26:04.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.074+0000 7f7c0effd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7bf00795b0 0x7f7bf007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.074+0000 7f7c0effd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7bf00795b0 0x7f7bf007ba70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7c00034000 tx=0x7f7c00004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:04.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.078+0000 7f7c077fe640 1 -- 172.21.15.81:0/3261435839 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f7bf801f020 con 0x7f7c1015cdc0 2024-09-17T05:26:04.268 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.268+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f7c100d29a0 con 0x7f7c1015cdc0 2024-09-17T05:26:04.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.268+0000 7f7c077fe640 1 -- 172.21.15.81:0/3261435839 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v151) ==== 80+0+0 (secure 0 0 0) 0x7f7bf8063540 con 0x7f7c1015cdc0 2024-09-17T05:26:04.269 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:26:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7bf00795b0 msgr2=0x7f7bf007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7bf00795b0 0x7f7bf007ba70 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7c00034000 tx=0x7f7c00004ab0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c1015cdc0 msgr2=0x7f7c100b0240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c1015cdc0 0x7f7c100b0240 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7f7bf800b410 tx=0x7f7bf800b8d0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 shutdown_connections 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7c1015f6d0 0x7f7c1006e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f7c1015cdc0 0x7f7c100b0240 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7bf00795b0 0x7f7bf007ba70 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 --2- 172.21.15.81:0/3261435839 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7c100d2410 0x7f7c100c7bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 >> 172.21.15.81:0/3261435839 conn(0x7f7c1009aa30 msgr2=0x7f7c100cf800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 shutdown_connections 2024-09-17T05:26:04.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.271+0000 7f7c156dd640 1 -- 172.21.15.81:0/3261435839 wait complete. 2024-09-17T05:26:04.282 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:26:04.282 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:04.282 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:04.306 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[79149]: fuse finished with error 0 and tester_r 0 2024-09-17T05:26:04.307 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:26:04.308 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:04.308 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:26:04.394 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:04.394 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:04.394 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:04.412 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:04.412 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:04.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:26:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 -- 172.21.15.81:0/1342687184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 msgr2=0x7f301815f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 --2- 172.21.15.81:0/1342687184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f301815f750 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7f30180ce5a0 tx=0x7f300802a560 comp rx=0 tx=0).stop 2024-09-17T05:26:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 -- 172.21.15.81:0/1342687184 shutdown_connections 2024-09-17T05:26:04.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 --2- 172.21.15.81:0/1342687184 >> v2:172.21.15.160:3300/0 conn(0x7f30180cc8d0 0x7f301815fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 --2- 172.21.15.81:0/1342687184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f301815f750 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 --2- 172.21.15.81:0/1342687184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3018159680 0x7f301815d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 -- 172.21.15.81:0/1342687184 >> 172.21.15.81:0/1342687184 conn(0x7f30180b1690 msgr2=0x7f30180b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 -- 172.21.15.81:0/1342687184 shutdown_connections 2024-09-17T05:26:04.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.572+0000 7f3020687640 1 -- 172.21.15.81:0/1342687184 wait complete. 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.573+0000 7f3020687640 1 Processor -- start 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.573+0000 7f3020687640 1 -- start start 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f3018145e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30180cc8d0 0x7f30180af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3018159680 0x7f30180afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f30180cec40 con 0x7f30180cc490 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f30180ceac0 con 0x7f30180cc8d0 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f30180cedc0 con 0x7f3018159680 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f3018145e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f3018145e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46644/0 (socket says 172.21.15.81:46644) 2024-09-17T05:26:04.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 -- 172.21.15.81:0/4212940557 learned_addr learned my addr 172.21.15.81:0/4212940557 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301dc22640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30180cc8d0 0x7f30180af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301ec24640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3018159680 0x7f30180afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 -- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3018159680 msgr2=0x7f30180afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3018159680 0x7f30180afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 -- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30180cc8d0 msgr2=0x7f30180af600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30180cc8d0 0x7f30180af600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 -- 172.21.15.81:0/4212940557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30181f27a0 con 0x7f30180cc490 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f301e423640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f3018145e50 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f301400d6d0 tx=0x7f301400db90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f300effd640 1 -- 172.21.15.81:0/4212940557 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014017070 con 0x7f30180cc490 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f300effd640 1 -- 172.21.15.81:0/4212940557 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f3014005330 con 0x7f30180cc490 2024-09-17T05:26:04.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f300effd640 1 -- 172.21.15.81:0/4212940557 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3014009820 con 0x7f30180cc490 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30181f6b70 con 0x7f30180cc490 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.574+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30181f2d40 con 0x7f30180cc490 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.575+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f30180cf2e0 con 0x7f30180cc490 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.576+0000 7f300effd640 1 -- 172.21.15.81:0/4212940557 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f3014009bd0 con 0x7f30180cc490 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.576+0000 7f300effd640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2ffc0795e0 0x7f2ffc07baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.576+0000 7f301dc22640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2ffc0795e0 0x7f2ffc07baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.576+0000 7f300effd640 1 -- 172.21.15.81:0/4212940557 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f3014099890 con 0x7f30180cc490 2024-09-17T05:26:04.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.577+0000 7f301dc22640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2ffc0795e0 0x7f2ffc07baa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3008033000 tx=0x7f3008004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:04.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.581+0000 7f300effd640 1 -- 172.21.15.81:0/4212940557 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f3014063810 con 0x7f30180cc490 2024-09-17T05:26:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.769+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f30181580c0 con 0x7f30180cc490 2024-09-17T05:26:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.769+0000 7f300effd640 1 -- 172.21.15.81:0/4212940557 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v151) ==== 80+0+0 (secure 0 0 0) 0x7f3014063110 con 0x7f30180cc490 2024-09-17T05:26:04.769 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:26:04.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2ffc0795e0 msgr2=0x7f2ffc07baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2ffc0795e0 0x7f2ffc07baa0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f3008033000 tx=0x7f3008004730 comp rx=0 tx=0).stop 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 msgr2=0x7f3018145e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f3018145e50 secure :-1 s=READY pgs=1770 cs=0 l=1 rev1=1 crypto rx=0x7f301400d6d0 tx=0x7f301400db90 comp rx=0 tx=0).stop 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 shutdown_connections 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f3018159680 0x7f30180afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2ffc0795e0 0x7f2ffc07baa0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f30180cc8d0 0x7f30180af600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 --2- 172.21.15.81:0/4212940557 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f30180cc490 0x7f3018145e50 unknown :-1 s=CLOSED pgs=1770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 >> 172.21.15.81:0/4212940557 conn(0x7f30180b1690 msgr2=0x7f3018159db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 shutdown_connections 2024-09-17T05:26:04.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:04.771+0000 7f3020687640 1 -- 172.21.15.81:0/4212940557 wait complete. 2024-09-17T05:26:04.784 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:26:04.784 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:04.784 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:04.812 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[49998]: fuse finished with error 0 and tester_r 0 2024-09-17T05:26:04.814 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:26:04.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:04.815 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:26:04.936 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:04.936 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:04.936 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:04.952 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:26:04.952 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:04.952 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:04.952 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:04.970 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:26:04.971 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.093+0000 7ff3ee285640 1 -- 172.21.15.81:0/256602183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80735a0 msgr2=0x7ff3e80739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.093+0000 7ff3ee285640 1 --2- 172.21.15.81:0/256602183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80735a0 0x7ff3e80739a0 secure :-1 s=READY pgs=1772 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc005fd0 tx=0x7ff3dc02a5d0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.093+0000 7ff3ee285640 1 -- 172.21.15.81:0/256602183 shutdown_connections 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.093+0000 7ff3ee285640 1 --2- 172.21.15.81:0/256602183 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e80735a0 0x7ff3e80739a0 unknown :-1 s=CLOSED pgs=1772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.093+0000 7ff3ee285640 1 --2- 172.21.15.81:0/256602183 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3e815aa70 0x7ff3e80b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.093+0000 7ff3ee285640 1 -- 172.21.15.81:0/256602183 >> 172.21.15.81:0/256602183 conn(0x7ff3e80b1690 msgr2=0x7ff3e80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.094+0000 7ff3ee285640 1 -- 172.21.15.81:0/256602183 shutdown_connections 2024-09-17T05:26:05.094 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.094+0000 7ff3ee285640 1 -- 172.21.15.81:0/256602183 wait complete. 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.095+0000 7ff3ee285640 1 Processor -- start 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.095+0000 7ff3ee285640 1 -- start start 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e806ff80 0x7ff3e8140520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3e80735a0 0x7ff3e81f1040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3e815aa70 0x7ff3e81e3300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e80707c0 con 0x7ff3e806ff80 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff3e8070640 con 0x7ff3e815aa70 2024-09-17T05:26:05.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff3e80cd5f0 con 0x7ff3e80735a0 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e806ff80 0x7ff3e8140520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e806ff80 0x7ff3e8140520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46672/0 (socket says 172.21.15.81:46672) 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 -- 172.21.15.81:0/3633758308 learned_addr learned my addr 172.21.15.81:0/3633758308 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 -- 172.21.15.81:0/3633758308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3e80735a0 msgr2=0x7ff3e81f1040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3e80735a0 0x7ff3e81f1040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 -- 172.21.15.81:0/3633758308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3e815aa70 msgr2=0x7ff3e81e3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3e815aa70 0x7ff3e81e3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 -- 172.21.15.81:0/3633758308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3e81f1ae0 con 0x7ff3e806ff80 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e7fff640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e806ff80 0x7ff3e8140520 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800c970 tx=0x7ff3d800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e4ff9640 1 -- 172.21.15.81:0/3633758308 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d8007bb0 con 0x7ff3e806ff80 2024-09-17T05:26:05.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e4ff9640 1 -- 172.21.15.81:0/3633758308 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff3d8007e40 con 0x7ff3e806ff80 2024-09-17T05:26:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3e81f1dc0 con 0x7ff3e806ff80 2024-09-17T05:26:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3e4ff9640 1 -- 172.21.15.81:0/3633758308 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d800f690 con 0x7ff3e806ff80 2024-09-17T05:26:05.099 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.096+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3e8150c40 con 0x7ff3e806ff80 2024-09-17T05:26:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.097+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3e81f2000 con 0x7ff3e806ff80 2024-09-17T05:26:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.098+0000 7ff3e4ff9640 1 -- 172.21.15.81:0/3633758308 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7ff3d8018400 con 0x7ff3e806ff80 2024-09-17T05:26:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.098+0000 7ff3e4ff9640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff3d40795b0 0x7ff3d407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.099+0000 7ff3e4ff9640 1 -- 172.21.15.81:0/3633758308 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7ff3d809a000 con 0x7ff3e806ff80 2024-09-17T05:26:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.099+0000 7ff3e77fe640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff3d40795b0 0x7ff3d407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.099+0000 7ff3e77fe640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff3d40795b0 0x7ff3d407ba70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc033000 tx=0x7ff3dc0046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:05.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.103+0000 7ff3e4ff9640 1 -- 172.21.15.81:0/3633758308 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff3e81f2000 con 0x7ff3e806ff80 2024-09-17T05:26:05.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.315+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff3e80739a0 con 0x7ff3e806ff80 2024-09-17T05:26:05.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.315+0000 7ff3e4ff9640 1 -- 172.21.15.81:0/3633758308 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5233 (secure 0 0 0) 0x7ff3d8014030 con 0x7ff3e806ff80 2024-09-17T05:26:05.315 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:05.316 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":93,"btime":"2024-09-17T05:26:00:912724+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2035889358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2035889358},{"type":"v1","addr":"172.21.15.160:6834","nonce":2035889358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3559863017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3559863017},{"type":"v1","addr":"172.21.15.81:6834","nonce":3559863017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3296945190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3296945190},{"type":"v1","addr":"172.21.15.81:6835","nonce":3296945190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:52.226778+0000","modified":"2024-09-17T05:25:54.227757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8853":{"gid":8853,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/3389320458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3389320458},{"type":"v1","addr":"172.21.15.160:6835","nonce":3389320458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8853,"qdb_cluster":[8853]},"id":12}]} 2024-09-17T05:26:05.316 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 93 2024-09-17T05:26:05.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff3d40795b0 msgr2=0x7ff3d407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff3d40795b0 0x7ff3d407ba70 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc033000 tx=0x7ff3dc0046c0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e806ff80 msgr2=0x7ff3e8140520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e806ff80 0x7ff3e8140520 secure :-1 s=READY pgs=1773 cs=0 l=1 rev1=1 crypto rx=0x7ff3d800c970 tx=0x7ff3d800ce30 comp rx=0 tx=0).stop 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 shutdown_connections 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff3d40795b0 0x7ff3d407ba70 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff3e815aa70 0x7ff3e81e3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff3e80735a0 0x7ff3e81f1040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 --2- 172.21.15.81:0/3633758308 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff3e806ff80 0x7ff3e8140520 unknown :-1 s=CLOSED pgs=1773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 >> 172.21.15.81:0/3633758308 conn(0x7ff3e80b1690 msgr2=0x7ff3e8159b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 shutdown_connections 2024-09-17T05:26:05.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.317+0000 7ff3ee285640 1 -- 172.21.15.81:0/3633758308 wait complete. 2024-09-17T05:26:05.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 -- 172.21.15.81:0/1405737162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 msgr2=0x7fd85c0b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 --2- 172.21.15.81:0/1405737162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0b4690 secure :-1 s=READY pgs=1774 cs=0 l=1 rev1=1 crypto rx=0x7fd85c0cf960 tx=0x7fd84c02a560 comp rx=0 tx=0).stop 2024-09-17T05:26:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 -- 172.21.15.81:0/1405737162 shutdown_connections 2024-09-17T05:26:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 --2- 172.21.15.81:0/1405737162 >> v2:172.21.15.160:3300/0 conn(0x7fd85c06ff80 0x7fd85c070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 --2- 172.21.15.81:0/1405737162 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd85c0735a0 0x7fd85c0739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 --2- 172.21.15.81:0/1405737162 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0b4690 unknown :-1 s=CLOSED pgs=1774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.429 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 -- 172.21.15.81:0/1405737162 >> 172.21.15.81:0/1405737162 conn(0x7fd85c0b1690 msgr2=0x7fd85c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 -- 172.21.15.81:0/1405737162 shutdown_connections 2024-09-17T05:26:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.429+0000 7fd86107f640 1 -- 172.21.15.81:0/1405737162 wait complete. 2024-09-17T05:26:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.430+0000 7fd86107f640 1 Processor -- start 2024-09-17T05:26:05.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.430+0000 7fd86107f640 1 -- start start 2024-09-17T05:26:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd86107f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd85c06ff80 0x7fd85c1f5360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd86107f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85c0735a0 0x7fd85c0c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.432 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd86107f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0c7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd86107f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0cd060 con 0x7fd85c15aa70 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd86107f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd85c0ccee0 con 0x7fd85c0735a0 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd86107f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd85c0cd1e0 con 0x7fd85c06ff80 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0c7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0c7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46694/0 (socket says 172.21.15.81:46694) 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 -- 172.21.15.81:0/4134559640 learned_addr learned my addr 172.21.15.81:0/4134559640 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85ad9d640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd85c06ff80 0x7fd85c1f5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85a59c640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85c0735a0 0x7fd85c0c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 -- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd85c06ff80 msgr2=0x7fd85c1f5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd85c06ff80 0x7fd85c1f5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 -- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85c0735a0 msgr2=0x7fd85c0c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85c0735a0 0x7fd85c0c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85b59e640 1 -- 172.21.15.81:0/4134559640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85c1f58a0 con 0x7fd85c15aa70 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85a59c640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85c0735a0 0x7fd85c0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.431+0000 7fd85ad9d640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd85c06ff80 0x7fd85c1f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.432+0000 7fd85b59e640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0c7930 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd85400b970 tx=0x7fd85400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.432+0000 7fd8437fe640 1 -- 172.21.15.81:0/4134559640 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854019070 con 0x7fd85c15aa70 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.432+0000 7fd8437fe640 1 -- 172.21.15.81:0/4134559640 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd85400cbf0 con 0x7fd85c15aa70 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.432+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85c1f1990 con 0x7fd85c15aa70 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.432+0000 7fd8437fe640 1 -- 172.21.15.81:0/4134559640 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd854014440 con 0x7fd85c15aa70 2024-09-17T05:26:05.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.432+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd85c1f1f50 con 0x7fd85c15aa70 2024-09-17T05:26:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.433+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd85c0739a0 con 0x7fd85c15aa70 2024-09-17T05:26:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.434+0000 7fd8437fe640 1 -- 172.21.15.81:0/4134559640 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fd85401c070 con 0x7fd85c15aa70 2024-09-17T05:26:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.434+0000 7fd8437fe640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd8480795b0 0x7fd84807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.434+0000 7fd8437fe640 1 -- 172.21.15.81:0/4134559640 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7fd8540994d0 con 0x7fd85c15aa70 2024-09-17T05:26:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.434+0000 7fd85ad9d640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd8480795b0 0x7fd84807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.434+0000 7fd85ad9d640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd8480795b0 0x7fd84807ba70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd84c033000 tx=0x7fd84c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:05.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.438+0000 7fd8437fe640 1 -- 172.21.15.81:0/4134559640 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd85c1f58a0 con 0x7fd85c15aa70 2024-09-17T05:26:05.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.648+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd85c156b00 con 0x7fd85c15aa70 2024-09-17T05:26:05.648 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.648+0000 7fd8437fe640 1 -- 172.21.15.81:0/4134559640 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5233 (secure 0 0 0) 0x7fd854063230 con 0x7fd85c15aa70 2024-09-17T05:26:05.649 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:05.649 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":93,"btime":"2024-09-17T05:26:00:912724+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2035889358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2035889358},{"type":"v1","addr":"172.21.15.160:6834","nonce":2035889358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3559863017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3559863017},{"type":"v1","addr":"172.21.15.81:6834","nonce":3559863017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3296945190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3296945190},{"type":"v1","addr":"172.21.15.81:6835","nonce":3296945190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:52.226778+0000","modified":"2024-09-17T05:25:54.227757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8853":{"gid":8853,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/3389320458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3389320458},{"type":"v1","addr":"172.21.15.160:6835","nonce":3389320458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8853,"qdb_cluster":[8853]},"id":12}]} 2024-09-17T05:26:05.649 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 93 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd8480795b0 msgr2=0x7fd84807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd8480795b0 0x7fd84807ba70 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd84c033000 tx=0x7fd84c004730 comp rx=0 tx=0).stop 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 msgr2=0x7fd85c0c7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0c7930 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7fd85400b970 tx=0x7fd85400be30 comp rx=0 tx=0).stop 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 shutdown_connections 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd85c15aa70 0x7fd85c0c7930 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd8480795b0 0x7fd84807ba70 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd85c0735a0 0x7fd85c0c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.650+0000 7fd86107f640 1 --2- 172.21.15.81:0/4134559640 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd85c06ff80 0x7fd85c1f5360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.651 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.651+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 >> 172.21.15.81:0/4134559640 conn(0x7fd85c0b1690 msgr2=0x7fd85c072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.651+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 shutdown_connections 2024-09-17T05:26:05.652 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.651+0000 7fd86107f640 1 -- 172.21.15.81:0/4134559640 wait complete. 2024-09-17T05:26:05.662 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:05.763 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.763+0000 7f6bc393d640 1 -- 172.21.15.81:0/2156282475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc15df90 msgr2=0x7f6bbc0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.763+0000 7f6bc393d640 1 --2- 172.21.15.81:0/2156282475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc15df90 0x7f6bbc0cf9b0 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc0cf6a0 tx=0x7f6bac02aa90 comp rx=0 tx=0).stop 2024-09-17T05:26:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.763+0000 7f6bc393d640 1 -- 172.21.15.81:0/2156282475 shutdown_connections 2024-09-17T05:26:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.763+0000 7f6bc393d640 1 --2- 172.21.15.81:0/2156282475 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc15df90 0x7f6bbc0cf9b0 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.763+0000 7f6bc393d640 1 -- 172.21.15.81:0/2156282475 >> 172.21.15.81:0/2156282475 conn(0x7f6bbc0d3ea0 msgr2=0x7f6bbc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.763+0000 7f6bc393d640 1 -- 172.21.15.81:0/2156282475 shutdown_connections 2024-09-17T05:26:05.764 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.763+0000 7f6bc393d640 1 -- 172.21.15.81:0/2156282475 wait complete. 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.764+0000 7f6bc393d640 1 Processor -- start 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.764+0000 7f6bc393d640 1 -- start start 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc393d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc0d0d40 0x7f6bbc1509e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc393d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc0d49c0 0x7f6bbc0cdd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc393d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc15df90 0x7f6bbc0c8fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc393d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc0b3f10 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc393d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f6bbc162710 con 0x7f6bbc0d0d40 2024-09-17T05:26:05.769 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc393d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6bbc0b4090 con 0x7f6bbc15df90 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc0ed8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc0d49c0 0x7f6bbc0cdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc0ed8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc0d49c0 0x7f6bbc0cdd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46718/0 (socket says 172.21.15.81:46718) 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc0ed8640 1 -- 172.21.15.81:0/4244805139 learned_addr learned my addr 172.21.15.81:0/4244805139 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.765+0000 7f6bc16d9640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc0d0d40 0x7f6bbc1509e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc1eda640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc15df90 0x7f6bbc0c8fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc0ed8640 1 -- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc15df90 msgr2=0x7f6bbc0c8fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc0ed8640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc15df90 0x7f6bbc0c8fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc0ed8640 1 -- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc0d0d40 msgr2=0x7f6bbc1509e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc0ed8640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc0d0d40 0x7f6bbc1509e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc0ed8640 1 -- 172.21.15.81:0/4244805139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bbc15f660 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc16d9640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc0d0d40 0x7f6bbc1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:05.770 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc1eda640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc15df90 0x7f6bbc0c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc0ed8640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc0d49c0 0x7f6bbc0cdd50 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c410 tx=0x7f6bb000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bb9ffb640 1 -- 172.21.15.81:0/4244805139 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0017070 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bb9ffb640 1 -- 172.21.15.81:0/4244805139 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6bb00035f0 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bbc15f940 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bb9ffb640 1 -- 172.21.15.81:0/4244805139 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6bb0003a80 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.766+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bbc15ff00 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.767+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bbc08d590 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.768+0000 7f6bb9ffb640 1 -- 172.21.15.81:0/4244805139 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f6bb001a070 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.769+0000 7f6bb9ffb640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba80795b0 0x7f6ba807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.769+0000 7f6bc16d9640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba80795b0 0x7f6ba807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.769+0000 7f6bb9ffb640 1 -- 172.21.15.81:0/4244805139 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f6bb0098bb0 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.771 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.769+0000 7f6bc16d9640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba80795b0 0x7f6ba807ba70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6bac035000 tx=0x7f6bac004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:05.772 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.773+0000 7f6bb9ffb640 1 -- 172.21.15.81:0/4244805139 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f6bb0062910 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.951+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6bbc0d0150 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.952+0000 7f6bb9ffb640 1 -- 172.21.15.81:0/4244805139 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16851 (secure 0 0 0) 0x7f6bb00010c0 con 0x7f6bbc0d49c0 2024-09-17T05:26:05.952 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:05.952 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":151,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:53.884202+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:50.832850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:51.191902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba80795b0 msgr2=0x7f6ba807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba80795b0 0x7f6ba807ba70 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f6bac035000 tx=0x7f6bac004ab0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc0d49c0 msgr2=0x7f6bbc0cdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc0d49c0 0x7f6bbc0cdd50 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7f6bb000c410 tx=0x7f6bb000c8d0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 shutdown_connections 2024-09-17T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6bbc15df90 0x7f6bbc0c8fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6bbc0d49c0 0x7f6bbc0cdd50 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6ba80795b0 0x7f6ba807ba70 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 --2- 172.21.15.81:0/4244805139 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6bbc0d0d40 0x7f6bbc1509e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 >> 172.21.15.81:0/4244805139 conn(0x7f6bbc0d3ea0 msgr2=0x7f6bbc0b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 shutdown_connections 2024-09-17T05:26:05.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:05.954+0000 7f6bc393d640 1 -- 172.21.15.81:0/4244805139 wait complete. 2024-09-17T05:26:05.965 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:26:05.965 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:06.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 -- 172.21.15.81:0/1503235019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 msgr2=0x7f45fc0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 --2- 172.21.15.81:0/1503235019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc0cf9b0 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7f45fc0d1c90 tx=0x7f45ec02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 -- 172.21.15.81:0/1503235019 shutdown_connections 2024-09-17T05:26:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 --2- 172.21.15.81:0/1503235019 >> v2:172.21.15.160:3300/0 conn(0x7f45fc0d49c0 0x7f45fc0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 --2- 172.21.15.81:0/1503235019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc0cf9b0 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 -- 172.21.15.81:0/1503235019 >> 172.21.15.81:0/1503235019 conn(0x7f45fc0d3ea0 msgr2=0x7f45fc0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 -- 172.21.15.81:0/1503235019 shutdown_connections 2024-09-17T05:26:06.067 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.066+0000 7f4600df3640 1 -- 172.21.15.81:0/1503235019 wait complete. 2024-09-17T05:26:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.067+0000 7f4600df3640 1 Processor -- start 2024-09-17T05:26:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f4600df3640 1 -- start start 2024-09-17T05:26:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f4600df3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45fc0d49c0 0x7f45fc15f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f4600df3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc1f8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f4600df3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45fc162480 0x7f45fc1f43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f4600df3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0d0f00 con 0x7f45fc15df90 2024-09-17T05:26:06.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f4600df3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f45fc0d0d80 con 0x7f45fc162480 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f4600df3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f45fc0b3f10 con 0x7f45fc0d49c0 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc1f8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f45f3fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc1f8a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46736/0 (socket says 172.21.15.81:46736) 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.068+0000 7f45f3fff640 1 -- 172.21.15.81:0/762660037 learned_addr learned my addr 172.21.15.81:0/762660037 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45fad9d640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45fc162480 0x7f45fc1f43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45fa59c640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45fc0d49c0 0x7f45fc15f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f3fff640 1 -- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45fc0d49c0 msgr2=0x7f45fc15f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f3fff640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45fc0d49c0 0x7f45fc15f5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f3fff640 1 -- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45fc162480 msgr2=0x7f45fc1f43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f3fff640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45fc162480 0x7f45fc1f43e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f3fff640 1 -- 172.21.15.81:0/762660037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45fc1f4920 con 0x7f45fc15df90 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f3fff640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc1f8a80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b4a0 tx=0x7f45e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:06.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f2ffd640 1 -- 172.21.15.81:0/762660037 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4014070 con 0x7f45fc15df90 2024-09-17T05:26:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f2ffd640 1 -- 172.21.15.81:0/762660037 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f45e4010700 con 0x7f45fc15df90 2024-09-17T05:26:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45fc15fc80 con 0x7f45fc15df90 2024-09-17T05:26:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f45f2ffd640 1 -- 172.21.15.81:0/762660037 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e4010b50 con 0x7f45fc15df90 2024-09-17T05:26:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.069+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45fc160240 con 0x7f45fc15df90 2024-09-17T05:26:06.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.070+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45fc06f060 con 0x7f45fc15df90 2024-09-17T05:26:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.071+0000 7f45f2ffd640 1 -- 172.21.15.81:0/762660037 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f45e4017070 con 0x7f45fc15df90 2024-09-17T05:26:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.071+0000 7f45f2ffd640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f45dc0795e0 0x7f45dc07baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.071+0000 7f45f2ffd640 1 -- 172.21.15.81:0/762660037 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f45e4099220 con 0x7f45fc15df90 2024-09-17T05:26:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.071+0000 7f45fa59c640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f45dc0795e0 0x7f45dc07baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.072+0000 7f45fa59c640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f45dc0795e0 0x7f45dc07baa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45ec033000 tx=0x7f45ec004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:06.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.075+0000 7f45f2ffd640 1 -- 172.21.15.81:0/762660037 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f45fc06f060 con 0x7f45fc15df90 2024-09-17T05:26:06.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.288+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45fc0b4430 con 0x7f45fc15df90 2024-09-17T05:26:06.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.288+0000 7f45f2ffd640 1 -- 172.21.15.81:0/762660037 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5233 (secure 0 0 0) 0x7f45e4062f80 con 0x7f45fc15df90 2024-09-17T05:26:06.289 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:06.289 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":93,"btime":"2024-09-17T05:26:00:912724+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2035889358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2035889358},{"type":"v1","addr":"172.21.15.160:6834","nonce":2035889358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3559863017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3559863017},{"type":"v1","addr":"172.21.15.81:6834","nonce":3559863017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3296945190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3296945190},{"type":"v1","addr":"172.21.15.81:6835","nonce":3296945190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:52.226778+0000","modified":"2024-09-17T05:25:54.227757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8853":{"gid":8853,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/3389320458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3389320458},{"type":"v1","addr":"172.21.15.160:6835","nonce":3389320458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8853,"qdb_cluster":[8853]},"id":12}]} 2024-09-17T05:26:06.289 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 93 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f45dc0795e0 msgr2=0x7f45dc07baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f45dc0795e0 0x7f45dc07baa0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f45ec033000 tx=0x7f45ec004730 comp rx=0 tx=0).stop 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 msgr2=0x7f45fc1f8a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc1f8a80 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7f45e400b4a0 tx=0x7f45e400b960 comp rx=0 tx=0).stop 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 shutdown_connections 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f45dc0795e0 0x7f45dc07baa0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f45fc162480 0x7f45fc1f43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f45fc15df90 0x7f45fc1f8a80 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 --2- 172.21.15.81:0/762660037 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f45fc0d49c0 0x7f45fc15f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.291 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.290+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 >> 172.21.15.81:0/762660037 conn(0x7f45fc0d3ea0 msgr2=0x7f45fc0b8ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:06.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.291+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 shutdown_connections 2024-09-17T05:26:06.292 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.291+0000 7f4600df3640 1 -- 172.21.15.81:0/762660037 wait complete. 2024-09-17T05:26:06.305 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.407+0000 7f576f6c6640 1 -- 172.21.15.81:0/1203494994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 msgr2=0x7f57500051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.407+0000 7f576f6c6640 1 --2- 172.21.15.81:0/1203494994 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 0x7f57500051c0 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f5760009b50 tx=0x7f5750005830 comp rx=0 tx=0).stop 2024-09-17T05:26:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.407+0000 7f576dc63640 1 -- 172.21.15.81:0/1203494994 reap_dead start 2024-09-17T05:26:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.407+0000 7f576f6c6640 1 -- 172.21.15.81:0/1203494994 shutdown_connections 2024-09-17T05:26:06.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.407+0000 7f576f6c6640 1 -- 172.21.15.81:0/1203494994 >> 172.21.15.81:0/1203494994 conn(0x7f57680d3ea0 msgr2=0x7f57680d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.407+0000 7f576f6c6640 1 -- 172.21.15.81:0/1203494994 shutdown_connections 2024-09-17T05:26:06.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.407+0000 7f576f6c6640 1 -- 172.21.15.81:0/1203494994 wait complete. 2024-09-17T05:26:06.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.408+0000 7f576f6c6640 1 Processor -- start 2024-09-17T05:26:06.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.408+0000 7f576f6c6640 1 -- start start 2024-09-17T05:26:06.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576f6c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 0x7f576815e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576f6c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57680b7e40 0x7f5768161b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576f6c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57680cc5e0 0x7f57680cca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576f6c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5768162690 con 0x7f5750004d40 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576f6c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f57680b3800 con 0x7f57680cc5e0 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576f6c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5768162060 con 0x7f57680b7e40 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 0x7f576815e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 0x7f576815e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46748/0 (socket says 172.21.15.81:46748) 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 -- 172.21.15.81:0/1886801460 learned_addr learned my addr 172.21.15.81:0/1886801460 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576dc63640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57680cc5e0 0x7f57680cca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576cc61640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57680b7e40 0x7f5768161b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 -- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57680b7e40 msgr2=0x7f5768161b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57680b7e40 0x7f5768161b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 -- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57680cc5e0 msgr2=0x7f57680cca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57680cc5e0 0x7f57680cca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 -- 172.21.15.81:0/1886801460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57681f4b50 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576dc63640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57680cc5e0 0x7f57680cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576d462640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 0x7f576815e570 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5758010d70 tx=0x7f575800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f5765ffb640 1 -- 172.21.15.81:0/1886801460 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758017070 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f5765ffb640 1 -- 172.21.15.81:0/1886801460 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5758011730 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57681f4e30 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.409+0000 7f5765ffb640 1 -- 172.21.15.81:0/1886801460 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5758011b60 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.410+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57680cac70 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.410+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57680d2a30 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.411+0000 7f5765ffb640 1 -- 172.21.15.81:0/1886801460 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f5758011d00 con 0x7f5750004d40 2024-09-17T05:26:06.414 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.412+0000 7f5765ffb640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f57540795e0 0x7f575407baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.412+0000 7f5765ffb640 1 -- 172.21.15.81:0/1886801460 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f575809a590 con 0x7f5750004d40 2024-09-17T05:26:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.412+0000 7f576cc61640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f57540795e0 0x7f575407baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.412+0000 7f576cc61640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f57540795e0 0x7f575407baa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f575c001a30 tx=0x7f575c000bc0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:06.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.416+0000 7f5765ffb640 1 -- 172.21.15.81:0/1886801460 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f57680d2a30 con 0x7f5750004d40 2024-09-17T05:26:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.625+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57680cf9b0 con 0x7f5750004d40 2024-09-17T05:26:06.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.626+0000 7f5765ffb640 1 -- 172.21.15.81:0/1886801460 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 93 v93) ==== 94+0+5233 (secure 0 0 0) 0x7f57580642f0 con 0x7f5750004d40 2024-09-17T05:26:06.626 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:06.626 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":93,"btime":"2024-09-17T05:26:00:912724+0000","default_fscid":12,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2035889358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2035889358},{"type":"v1","addr":"172.21.15.160:6834","nonce":2035889358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3559863017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3559863017},{"type":"v1","addr":"172.21.15.81:6834","nonce":3559863017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3296945190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3296945190},{"type":"v1","addr":"172.21.15.81:6835","nonce":3296945190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[{"mdsmap":{"epoch":92,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:25:52.226778+0000","modified":"2024-09-17T05:25:54.227757+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":8853},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8853":{"gid":8853,"name":"b","rank":0,"incarnation":90,"state":"up:active","state_seq":2,"addr":"172.21.15.160:6835/3389320458","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3389320458},{"type":"v1","addr":"172.21.15.160:6835","nonce":3389320458}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[25],"metadata_pool":24,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":8853,"qdb_cluster":[8853]},"id":12}]} 2024-09-17T05:26:06.626 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 93 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f57540795e0 msgr2=0x7f575407baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f57540795e0 0x7f575407baa0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f575c001a30 tx=0x7f575c000bc0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 msgr2=0x7f576815e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 0x7f576815e570 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5758010d70 tx=0x7f575800e720 comp rx=0 tx=0).stop 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 shutdown_connections 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f57540795e0 0x7f575407baa0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f57680cc5e0 0x7f57680cca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f57680b7e40 0x7f5768161b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 --2- 172.21.15.81:0/1886801460 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5750004d40 0x7f576815e570 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 >> 172.21.15.81:0/1886801460 conn(0x7f57680d3ea0 msgr2=0x7f57680b4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 shutdown_connections 2024-09-17T05:26:06.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.628+0000 7f576f6c6640 1 -- 172.21.15.81:0/1886801460 wait complete. 2024-09-17T05:26:06.638 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 -- 172.21.15.81:0/3892118774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 msgr2=0x7f175c0cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 --2- 172.21.15.81:0/3892118774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 0x7f175c0cf9b0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f1754009830 tx=0x7f175402a510 comp rx=0 tx=0).stop 2024-09-17T05:26:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 -- 172.21.15.81:0/3892118774 shutdown_connections 2024-09-17T05:26:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 --2- 172.21.15.81:0/3892118774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f175c0d49c0 0x7f175c0d0630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.740 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 --2- 172.21.15.81:0/3892118774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 0x7f175c0cf9b0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 -- 172.21.15.81:0/3892118774 >> 172.21.15.81:0/3892118774 conn(0x7f175c0d3ea0 msgr2=0x7f175c0d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:06.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 -- 172.21.15.81:0/3892118774 shutdown_connections 2024-09-17T05:26:06.741 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.740+0000 7f1760816640 1 -- 172.21.15.81:0/3892118774 wait complete. 2024-09-17T05:26:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.741+0000 7f1760816640 1 Processor -- start 2024-09-17T05:26:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.741+0000 7f1760816640 1 -- start start 2024-09-17T05:26:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f1760816640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f175c0d49c0 0x7f175c1f8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f1760816640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 0x7f175c0ca350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f1760816640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f175c162480 0x7f175c0cc0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.743 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f1760816640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f175c0d0f00 con 0x7f175c162480 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f1760816640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f175c0d0d80 con 0x7f175c15df90 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f1760816640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f175c0b3f10 con 0x7f175c0d49c0 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f175c162480 0x7f175c0cc0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f175c162480 0x7f175c0cc0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46758/0 (socket says 172.21.15.81:46758) 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 -- 172.21.15.81:0/4209863507 learned_addr learned my addr 172.21.15.81:0/4209863507 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175a59c640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f175c0d49c0 0x7f175c1f8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f1759d9b640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 0x7f175c0ca350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 -- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f175c0d49c0 msgr2=0x7f175c1f8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f175c0d49c0 0x7f175c1f8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.744 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 -- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 msgr2=0x7f175c0ca350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 0x7f175c0ca350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 -- 172.21.15.81:0/4209863507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f175c0ca890 con 0x7f175c162480 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.742+0000 7f175ad9d640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f175c162480 0x7f175c0cc0f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c3f0 tx=0x7f174c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.743+0000 7f174affd640 1 -- 172.21.15.81:0/4209863507 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c017070 con 0x7f175c162480 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.743+0000 7f174affd640 1 -- 172.21.15.81:0/4209863507 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f174c0053c0 con 0x7f175c162480 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.743+0000 7f174affd640 1 -- 172.21.15.81:0/4209863507 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174c003850 con 0x7f175c162480 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.743+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f175c0cc920 con 0x7f175c162480 2024-09-17T05:26:06.745 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.743+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f175c0ccee0 con 0x7f175c162480 2024-09-17T05:26:06.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.744+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f175c0b4430 con 0x7f175c162480 2024-09-17T05:26:06.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.744+0000 7f174affd640 1 -- 172.21.15.81:0/4209863507 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f174c01a070 con 0x7f175c162480 2024-09-17T05:26:06.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.745+0000 7f174affd640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f173c0795b0 0x7f173c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:06.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.745+0000 7f174affd640 1 -- 172.21.15.81:0/4209863507 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f174c09b6e0 con 0x7f175c162480 2024-09-17T05:26:06.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.745+0000 7f175a59c640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f173c0795b0 0x7f173c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:06.746 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.745+0000 7f175a59c640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f173c0795b0 0x7f173c07ba70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1754034000 tx=0x7f1754004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:06.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.749+0000 7f174affd640 1 -- 172.21.15.81:0/4209863507 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f175c0ce970 con 0x7f175c162480 2024-09-17T05:26:06.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.927+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f175c0b39a0 con 0x7f175c162480 2024-09-17T05:26:06.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.928+0000 7f174affd640 1 -- 172.21.15.81:0/4209863507 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v151) ==== 74+0+16851 (secure 0 0 0) 0x7f174c062140 con 0x7f175c162480 2024-09-17T05:26:06.928 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:06.928 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":151,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:25:53.884202+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":24,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:25:50.832850+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"150","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":25,"pool_name":"cephfs_data","create_time":"2024-09-17T05:25:51.191902+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"151","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f173c0795b0 msgr2=0x7f173c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f173c0795b0 0x7f173c07ba70 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f1754034000 tx=0x7f1754004730 comp rx=0 tx=0).stop 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f175c162480 msgr2=0x7f175c0cc0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f175c162480 0x7f175c0cc0f0 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f174c00c3f0 tx=0x7f174c00c8b0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 shutdown_connections 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f175c162480 0x7f175c0cc0f0 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f173c0795b0 0x7f173c07ba70 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.930 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f175c15df90 0x7f175c0ca350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 --2- 172.21.15.81:0/4209863507 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f175c0d49c0 0x7f175c1f8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 >> 172.21.15.81:0/4209863507 conn(0x7f175c0d3ea0 msgr2=0x7f175c0b2690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 shutdown_connections 2024-09-17T05:26:06.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:06.930+0000 7f1760816640 1 -- 172.21.15.81:0/4209863507 wait complete. 2024-09-17T05:26:06.941 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:26:07.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/2712819862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f0b0 msgr2=0x7f1b880cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/2712819862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f0b0 0x7f1b880cd3e0 secure :-1 s=READY pgs=1787 cs=0 l=1 rev1=1 crypto rx=0x7f1b880d02f0 tx=0x7f1b8402a5f0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/2712819862 shutdown_connections 2024-09-17T05:26:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/2712819862 >> v2:172.21.15.160:3300/0 conn(0x7f1b880ce950 0x7f1b880cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/2712819862 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f0b0 0x7f1b880cd3e0 unknown :-1 s=CLOSED pgs=1787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/2712819862 >> 172.21.15.81:0/2712819862 conn(0x7f1b880741f0 msgr2=0x7f1b88074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/2712819862 shutdown_connections 2024-09-17T05:26:07.044 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.043+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/2712819862 wait complete. 2024-09-17T05:26:07.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.044+0000 7f1b8fc5a640 1 Processor -- start 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.044+0000 7f1b8fc5a640 1 -- start start 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8fc5a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8806f0b0 0x7f1b880b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8fc5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f490 0x7f1b881f1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8fc5a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ce950 0x7f1b880b1860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8fc5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1b880cc0c0 con 0x7f1b8806f490 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8fc5a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1b8815e670 con 0x7f1b880ce950 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8fc5a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1b880cc240 con 0x7f1b8806f0b0 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f490 0x7f1b881f1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f490 0x7f1b881f1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46788/0 (socket says 172.21.15.81:46788) 2024-09-17T05:26:07.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 -- 172.21.15.81:0/315529275 learned_addr learned my addr 172.21.15.81:0/315529275 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8e1f7640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ce950 0x7f1b880b1860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 -- 172.21.15.81:0/315529275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8806f0b0 msgr2=0x7f1b880b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8806f0b0 0x7f1b880b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 -- 172.21.15.81:0/315529275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ce950 msgr2=0x7f1b880b1860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ce950 0x7f1b880b1860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.045+0000 7f1b8d1f5640 1 -- 172.21.15.81:0/315529275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b881f35d0 con 0x7f1b8806f490 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.046+0000 7f1b8d1f5640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f490 0x7f1b881f1ee0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c500 tx=0x7f1b7800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.046+0000 7f1b7e7fc640 1 -- 172.21.15.81:0/315529275 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b780052d0 con 0x7f1b8806f490 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.046+0000 7f1b7e7fc640 1 -- 172.21.15.81:0/315529275 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1b78005470 con 0x7f1b8806f490 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.046+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b881f2810 con 0x7f1b8806f490 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.046+0000 7f1b7e7fc640 1 -- 172.21.15.81:0/315529275 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1b78012870 con 0x7f1b8806f490 2024-09-17T05:26:07.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.046+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b881f2dd0 con 0x7f1b8806f490 2024-09-17T05:26:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.047+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b880cd3e0 con 0x7f1b8806f490 2024-09-17T05:26:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.047+0000 7f1b7e7fc640 1 -- 172.21.15.81:0/315529275 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f1b780035f0 con 0x7f1b8806f490 2024-09-17T05:26:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.048+0000 7f1b7e7fc640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1b6c0795b0 0x7f1b6c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.049 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.048+0000 7f1b8d9f6640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1b6c0795b0 0x7f1b6c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:07.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.048+0000 7f1b7e7fc640 1 -- 172.21.15.81:0/315529275 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(151..151 src has 1..151) ==== 5781+0+0 (secure 0 0 0) 0x7f1b78099450 con 0x7f1b8806f490 2024-09-17T05:26:07.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.049+0000 7f1b8d9f6640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1b6c0795b0 0x7f1b6c07ba70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1b84033000 tx=0x7f1b840046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:07.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.052+0000 7f1b7e7fc640 1 -- 172.21.15.81:0/315529275 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1b78063130 con 0x7f1b8806f490 2024-09-17T05:26:07.265 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.265+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f1b88075070 con 0x7f1b8806f490 2024-09-17T05:26:07.265 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:26:07.266+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:26:07.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.269+0000 7f1b7e7fc640 1 -- 172.21.15.81:0/315529275 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v94) ==== 161+0+0 (secure 0 0 0) 0x7f1b78062a30 con 0x7f1b8806f490 2024-09-17T05:26:07.269 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:26:07.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.271+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1b6c0795b0 msgr2=0x7f1b6c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.271+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1b6c0795b0 0x7f1b6c07ba70 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f1b84033000 tx=0x7f1b840046c0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.271+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f490 msgr2=0x7f1b881f1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.271+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f490 0x7f1b881f1ee0 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f1b7800c500 tx=0x7f1b7800c9c0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 shutdown_connections 2024-09-17T05:26:07.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1b6c0795b0 0x7f1b6c07ba70 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.272 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1b880ce950 0x7f1b880b1860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1b8806f490 0x7f1b881f1ee0 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 --2- 172.21.15.81:0/315529275 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1b8806f0b0 0x7f1b880b5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 >> 172.21.15.81:0/315529275 conn(0x7f1b880741f0 msgr2=0x7f1b880adcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:07.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 shutdown_connections 2024-09-17T05:26:07.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.272+0000 7f1b8fc5a640 1 -- 172.21.15.81:0/315529275 wait complete. 2024-09-17T05:26:07.284 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:26:07.312 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.387+0000 7f0676de2640 1 -- 172.21.15.81:0/1769384670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 msgr2=0x7f06700cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.387+0000 7f0676de2640 1 --2- 172.21.15.81:0/1769384670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700cc9b0 secure :-1 s=READY pgs=1790 cs=0 l=1 rev1=1 crypto rx=0x7f06700cd5b0 tx=0x7f065802a5f0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.387+0000 7f0676de2640 1 -- 172.21.15.81:0/1769384670 shutdown_connections 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.387+0000 7f0676de2640 1 --2- 172.21.15.81:0/1769384670 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700cc9b0 unknown :-1 s=CLOSED pgs=1790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.387+0000 7f0676de2640 1 --2- 172.21.15.81:0/1769384670 >> v2:172.21.15.160:3300/0 conn(0x7f0670151e30 0x7f067006fb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.387+0000 7f0676de2640 1 -- 172.21.15.81:0/1769384670 >> 172.21.15.81:0/1769384670 conn(0x7f06700b1700 msgr2=0x7f06700b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.387+0000 7f0676de2640 1 -- 172.21.15.81:0/1769384670 shutdown_connections 2024-09-17T05:26:07.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.388+0000 7f0676de2640 1 -- 172.21.15.81:0/1769384670 wait complete. 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.389+0000 7f0676de2640 1 Processor -- start 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.389+0000 7f0676de2640 1 -- start start 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.389+0000 7f0676de2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700c4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.389+0000 7f0676de2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0670151e30 0x7f06700c7300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0676de2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067015b3d0 0x7f06701f8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0676de2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f06700cb000 con 0x7f06700cc540 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0676de2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f06700cae80 con 0x7f067015b3d0 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0676de2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f06700cb180 con 0x7f0670151e30 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700c4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700c4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46804/0 (socket says 172.21.15.81:46804) 2024-09-17T05:26:07.391 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 -- 172.21.15.81:0/2948635262 learned_addr learned my addr 172.21.15.81:0/2948635262 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f066ffff640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0670151e30 0x7f06700c7300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f067537f640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067015b3d0 0x7f06701f8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 -- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0670151e30 msgr2=0x7f06700c7300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0670151e30 0x7f06700c7300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 -- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067015b3d0 msgr2=0x7f06701f8530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067015b3d0 0x7f06701f8530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 -- 172.21.15.81:0/2948635262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06701f8a70 con 0x7f06700cc540 2024-09-17T05:26:07.392 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0674b7e640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700c4b60 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f066800d770 tx=0x7f066800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f066d7fa640 1 -- 172.21.15.81:0/2948635262 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668017070 con 0x7f06700cc540 2024-09-17T05:26:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f066d7fa640 1 -- 172.21.15.81:0/2948635262 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0668009d20 con 0x7f06700cc540 2024-09-17T05:26:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f066d7fa640 1 -- 172.21.15.81:0/2948635262 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0668005280 con 0x7f06700cc540 2024-09-17T05:26:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f067015c600 con 0x7f06700cc540 2024-09-17T05:26:07.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.390+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06701f8ff0 con 0x7f06700cc540 2024-09-17T05:26:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.391+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06700cb630 con 0x7f06700cc540 2024-09-17T05:26:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.392+0000 7f066d7fa640 1 -- 172.21.15.81:0/2948635262 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f0668005420 con 0x7f06700cc540 2024-09-17T05:26:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.393+0000 7f066d7fa640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f06500795b0 0x7f065007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.393+0000 7f066d7fa640 1 -- 172.21.15.81:0/2948635262 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5867+0+0 (secure 0 0 0) 0x7f0668099980 con 0x7f06700cc540 2024-09-17T05:26:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.393+0000 7f066ffff640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f06500795b0 0x7f065007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:07.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.393+0000 7f066ffff640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f06500795b0 0x7f065007ba70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0658033000 tx=0x7f0658004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:07.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.397+0000 7f066d7fa640 1 -- 172.21.15.81:0/2948635262 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0668063090 con 0x7f06700cc540 2024-09-17T05:26:07.612 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:07.612+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f06700c3440 con 0x7f06700cc540 2024-09-17T05:26:08.273 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.272+0000 7f066d7fa640 1 -- 172.21.15.81:0/2948635262 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v95) ==== 104+0+0 (secure 0 0 0) 0x7f0668067ac0 con 0x7f06700cc540 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.274+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f06500795b0 msgr2=0x7f065007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.274+0000 7f0676de2640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f06500795b0 0x7f065007ba70 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f0658033000 tx=0x7f0658004730 comp rx=0 tx=0).stop 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.274+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 msgr2=0x7f06700c4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.274+0000 7f0676de2640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700c4b60 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f066800d770 tx=0x7f066800dc30 comp rx=0 tx=0).stop 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 shutdown_connections 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f06500795b0 0x7f065007ba70 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f067015b3d0 0x7f06701f8530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0670151e30 0x7f06700c7300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 --2- 172.21.15.81:0/2948635262 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f06700cc540 0x7f06700c4b60 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:08.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 >> 172.21.15.81:0/2948635262 conn(0x7f06700b1700 msgr2=0x7f06700b0da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 shutdown_connections 2024-09-17T05:26:08.277 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.275+0000 7f0676de2640 1 -- 172.21.15.81:0/2948635262 wait complete. 2024-09-17T05:26:08.290 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:26:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.400+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/3866707346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c004d40 msgr2=0x7f1e4c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.400+0000 7f1e6ab3d640 1 --2- 172.21.15.81:0/3866707346 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e4c004d40 0x7f1e4c0051c0 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c006fd0 tx=0x7f1e4c005830 comp rx=0 tx=0).stop 2024-09-17T05:26:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.400+0000 7f1e690da640 1 -- 172.21.15.81:0/3866707346 reap_dead start 2024-09-17T05:26:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.400+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/3866707346 shutdown_connections 2024-09-17T05:26:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.400+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/3866707346 >> 172.21.15.81:0/3866707346 conn(0x7f1e640d3e20 msgr2=0x7f1e640d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.400+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/3866707346 shutdown_connections 2024-09-17T05:26:08.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.400+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/3866707346 wait complete. 2024-09-17T05:26:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.402+0000 7f1e6ab3d640 1 Processor -- start 2024-09-17T05:26:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.402+0000 7f1e6ab3d640 1 -- start start 2024-09-17T05:26:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.402+0000 7f1e6ab3d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4c004d40 0x7f1e641f4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.402+0000 7f1e6ab3d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e640cc4e0 0x7f1e640a1530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e6ab3d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6415e520 0x7f1e6415e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e6ab3d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1e640d4cd0 con 0x7f1e6415e520 2024-09-17T05:26:08.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e6ab3d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1e640d4b50 con 0x7f1e4c004d40 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e6ab3d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1e640b7af0 con 0x7f1e640cc4e0 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6415e520 0x7f1e6415e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6415e520 0x7f1e6415e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46820/0 (socket says 172.21.15.81:46820) 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 -- 172.21.15.81:0/1544029085 learned_addr learned my addr 172.21.15.81:0/1544029085 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e688d9640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4c004d40 0x7f1e641f4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e63fff640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e640cc4e0 0x7f1e640a1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 -- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e640cc4e0 msgr2=0x7f1e640a1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e640cc4e0 0x7f1e640a1530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 -- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4c004d40 msgr2=0x7f1e641f4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:08.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4c004d40 0x7f1e641f4370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 -- 172.21.15.81:0/1544029085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e640cc960 con 0x7f1e6415e520 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e690da640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6415e520 0x7f1e6415e9b0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c02b0f0 tx=0x7f1e5c006670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e617fa640 1 -- 172.21.15.81:0/1544029085 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c031050 con 0x7f1e6415e520 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e617fa640 1 -- 172.21.15.81:0/1544029085 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1e5c036660 con 0x7f1e6415e520 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e617fa640 1 -- 172.21.15.81:0/1544029085 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c001c70 con 0x7f1e6415e520 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e6415eef0 con 0x7f1e6415e520 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.403+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e640ccbe0 con 0x7f1e6415e520 2024-09-17T05:26:08.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.404+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1e640b73e0 con 0x7f1e6415e520 2024-09-17T05:26:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.405+0000 7f1e617fa640 1 -- 172.21.15.81:0/1544029085 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f1e5c034070 con 0x7f1e6415e520 2024-09-17T05:26:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.405+0000 7f1e617fa640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e500795e0 0x7f1e5007baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.405+0000 7f1e617fa640 1 -- 172.21.15.81:0/1544029085 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(152..152 src has 1..152) ==== 5867+0+0 (secure 0 0 0) 0x7f1e5c0b9400 con 0x7f1e6415e520 2024-09-17T05:26:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.405+0000 7f1e688d9640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e500795e0 0x7f1e5007baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:08.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.406+0000 7f1e688d9640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e500795e0 0x7f1e5007baa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e640b9e20 tx=0x7f1e54005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:08.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.410+0000 7f1e617fa640 1 -- 172.21.15.81:0/1544029085 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1e5c045020 con 0x7f1e6415e520 2024-09-17T05:26:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:08.587+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f1e6406d4e0 con 0x7f1e6415e520 2024-09-17T05:26:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.273+0000 7f1e617fa640 1 -- 172.21.15.81:0/1544029085 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v153) ==== 181+0+0 (secure 0 0 0) 0x7f1e640cc960 con 0x7f1e6415e520 2024-09-17T05:26:09.275 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:26:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e500795e0 msgr2=0x7f1e5007baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e500795e0 0x7f1e5007baa0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f1e640b9e20 tx=0x7f1e54005f90 comp rx=0 tx=0).stop 2024-09-17T05:26:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6415e520 msgr2=0x7f1e6415e9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:09.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6415e520 0x7f1e6415e9b0 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c02b0f0 tx=0x7f1e5c006670 comp rx=0 tx=0).stop 2024-09-17T05:26:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 shutdown_connections 2024-09-17T05:26:09.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1e6415e520 0x7f1e6415e9b0 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1e640cc4e0 0x7f1e640a1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1e500795e0 0x7f1e5007baa0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 --2- 172.21.15.81:0/1544029085 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1e4c004d40 0x7f1e641f4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 >> 172.21.15.81:0/1544029085 conn(0x7f1e640d3e20 msgr2=0x7f1e64160630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:09.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 shutdown_connections 2024-09-17T05:26:09.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.277+0000 7f1e6ab3d640 1 -- 172.21.15.81:0/1544029085 wait complete. 2024-09-17T05:26:09.292 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 -- 172.21.15.81:0/3809728450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02901616e0 msgr2=0x7f02900d4940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 --2- 172.21.15.81:0/3809728450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02901616e0 0x7f02900d4940 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f0284005fd0 tx=0x7f028402a670 comp rx=0 tx=0).stop 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 -- 172.21.15.81:0/3809728450 shutdown_connections 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 --2- 172.21.15.81:0/3809728450 >> v2:172.21.15.160:3300/0 conn(0x7f02900d25b0 0x7f02900b73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 --2- 172.21.15.81:0/3809728450 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02901616e0 0x7f02900d4940 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 -- 172.21.15.81:0/3809728450 >> 172.21.15.81:0/3809728450 conn(0x7f02900d3e20 msgr2=0x7f02900d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 -- 172.21.15.81:0/3809728450 shutdown_connections 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.406+0000 7f02987bb640 1 -- 172.21.15.81:0/3809728450 wait complete. 2024-09-17T05:26:09.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.407+0000 7f02987bb640 1 Processor -- start 2024-09-17T05:26:09.409 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.407+0000 7f02987bb640 1 -- start start 2024-09-17T05:26:09.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f02987bb640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02900d25b0 0x7f0290159fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:09.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f02987bb640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0290161300 0x7f0290157ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f02987bb640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02901616e0 0x7f0290158410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f02987bb640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02900b7cb0 con 0x7f0290161300 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f02987bb640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f02900b7b30 con 0x7f02901616e0 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f02987bb640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f02900b7e30 con 0x7f02900d25b0 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0290161300 0x7f0290157ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0290161300 0x7f0290157ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46826/0 (socket says 172.21.15.81:46826) 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 -- 172.21.15.81:0/3729332655 learned_addr learned my addr 172.21.15.81:0/3729332655 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0296d58640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02901616e0 0x7f0290158410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0296557640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02900d25b0 0x7f0290159fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 -- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02900d25b0 msgr2=0x7f0290159fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02900d25b0 0x7f0290159fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.411 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 -- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02901616e0 msgr2=0x7f0290158410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02901616e0 0x7f0290158410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 -- 172.21.15.81:0/3729332655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02901f8100 con 0x7f0290161300 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.408+0000 7f0295d56640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0290161300 0x7f0290157ed0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f0284034040 tx=0x7f02840038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.409+0000 7f028effd640 1 -- 172.21.15.81:0/3729332655 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f028403e030 con 0x7f0290161300 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.409+0000 7f028effd640 1 -- 172.21.15.81:0/3729332655 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0284003db0 con 0x7f0290161300 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.409+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02901f83e0 con 0x7f0290161300 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.409+0000 7f028effd640 1 -- 172.21.15.81:0/3729332655 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0284035040 con 0x7f0290161300 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.409+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02901f89a0 con 0x7f0290161300 2024-09-17T05:26:09.412 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.410+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02900b73e0 con 0x7f0290161300 2024-09-17T05:26:09.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.410+0000 7f028effd640 1 -- 172.21.15.81:0/3729332655 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f0284041030 con 0x7f0290161300 2024-09-17T05:26:09.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.411+0000 7f028effd640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f027c0795b0 0x7f027c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:09.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.411+0000 7f028effd640 1 -- 172.21.15.81:0/3729332655 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(153..153 src has 1..153) ==== 5429+0+0 (secure 0 0 0) 0x7f02840b9e30 con 0x7f0290161300 2024-09-17T05:26:09.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.411+0000 7f0296557640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f027c0795b0 0x7f027c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:09.413 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.411+0000 7f0296557640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f027c0795b0 0x7f027c07ba70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0280007fd0 tx=0x7f0280009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:09.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.415+0000 7f028effd640 1 -- 172.21.15.81:0/3729332655 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0284083b90 con 0x7f0290161300 2024-09-17T05:26:09.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:09.592+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f029015f850 con 0x7f0290161300 2024-09-17T05:26:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.279+0000 7f028effd640 1 -- 172.21.15.81:0/3729332655 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v154) ==== 169+0+0 (secure 0 0 0) 0x7f0284083490 con 0x7f0290161300 2024-09-17T05:26:10.280 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:26:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.282+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f027c0795b0 msgr2=0x7f027c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.282+0000 7f02987bb640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f027c0795b0 0x7f027c07ba70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f0280007fd0 tx=0x7f0280009040 comp rx=0 tx=0).stop 2024-09-17T05:26:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.282+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0290161300 msgr2=0x7f0290157ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.282+0000 7f02987bb640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0290161300 0x7f0290157ed0 secure :-1 s=READY pgs=1795 cs=0 l=1 rev1=1 crypto rx=0x7f0284034040 tx=0x7f02840038a0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.283+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 shutdown_connections 2024-09-17T05:26:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.283+0000 7f02987bb640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f027c0795b0 0x7f027c07ba70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.283+0000 7f02987bb640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02901616e0 0x7f0290158410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.283+0000 7f02987bb640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0290161300 0x7f0290157ed0 unknown :-1 s=CLOSED pgs=1795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.283+0000 7f02987bb640 1 --2- 172.21.15.81:0/3729332655 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02900d25b0 0x7f0290159fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.283+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 >> 172.21.15.81:0/3729332655 conn(0x7f02900d3e20 msgr2=0x7f029006d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.283+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 shutdown_connections 2024-09-17T05:26:10.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.284+0000 7f02987bb640 1 -- 172.21.15.81:0/3729332655 wait complete. 2024-09-17T05:26:10.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:26:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.400+0000 7f4b59564640 1 -- 172.21.15.81:0/3824079260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b40003a00 msgr2=0x7f4b40003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.400+0000 7f4b59564640 1 --2- 172.21.15.81:0/3824079260 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b40003a00 0x7f4b40003e20 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7f4b4400bb20 tx=0x7f4b40005830 comp rx=0 tx=0).stop 2024-09-17T05:26:10.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.400+0000 7f4b537fe640 1 -- 172.21.15.81:0/3824079260 reap_dead start 2024-09-17T05:26:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.400+0000 7f4b59564640 1 -- 172.21.15.81:0/3824079260 shutdown_connections 2024-09-17T05:26:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.400+0000 7f4b59564640 1 -- 172.21.15.81:0/3824079260 >> 172.21.15.81:0/3824079260 conn(0x7f4b540d3ea0 msgr2=0x7f4b540d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.400+0000 7f4b59564640 1 -- 172.21.15.81:0/3824079260 shutdown_connections 2024-09-17T05:26:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.400+0000 7f4b59564640 1 -- 172.21.15.81:0/3824079260 wait complete. 2024-09-17T05:26:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.401+0000 7f4b59564640 1 Processor -- start 2024-09-17T05:26:10.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.401+0000 7f4b59564640 1 -- start start 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b59564640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b40003a00 0x7f4b5415ea70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b59564640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b540ca050 0x7f4b540b17c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b59564640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b540b1d00 0x7f4b54161210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b59564640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b540cfd40 con 0x7f4b540b1d00 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b59564640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b540cfbc0 con 0x7f4b540ca050 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b59564640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4b540d0b70 con 0x7f4b40003a00 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b540b1d00 0x7f4b54161210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b540b1d00 0x7f4b54161210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46848/0 (socket says 172.21.15.81:46848) 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 -- 172.21.15.81:0/2758185849 learned_addr learned my addr 172.21.15.81:0/2758185849 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b52ffd640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b40003a00 0x7f4b5415ea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b4a7fc640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b540ca050 0x7f4b540b17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 -- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b40003a00 msgr2=0x7f4b5415ea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b40003a00 0x7f4b5415ea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 -- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b540ca050 msgr2=0x7f4b540b17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b540ca050 0x7f4b540b17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.402+0000 7f4b537fe640 1 -- 172.21.15.81:0/2758185849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b5414b680 con 0x7f4b540b1d00 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.403+0000 7f4b537fe640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b540b1d00 0x7f4b54161210 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f4b54162860 tx=0x7f4b4c006720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.403+0000 7f4b4bfff640 1 -- 172.21.15.81:0/2758185849 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c00fbb0 con 0x7f4b540b1d00 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.403+0000 7f4b4bfff640 1 -- 172.21.15.81:0/2758185849 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b4c018070 con 0x7f4b540b1d00 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.403+0000 7f4b4bfff640 1 -- 172.21.15.81:0/2758185849 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b4c011430 con 0x7f4b540b1d00 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.403+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b5414b960 con 0x7f4b540b1d00 2024-09-17T05:26:10.406 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.403+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b5414bf20 con 0x7f4b540b1d00 2024-09-17T05:26:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.404+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b540b2180 con 0x7f4b540b1d00 2024-09-17T05:26:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.404+0000 7f4b4bfff640 1 -- 172.21.15.81:0/2758185849 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f4b4c0115d0 con 0x7f4b540b1d00 2024-09-17T05:26:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.405+0000 7f4b4bfff640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b340795e0 0x7f4b3407baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.407 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.405+0000 7f4b52ffd640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b340795e0 0x7f4b3407baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.405+0000 7f4b4bfff640 1 -- 172.21.15.81:0/2758185849 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7f4b4c099d80 con 0x7f4b540b1d00 2024-09-17T05:26:10.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.405+0000 7f4b52ffd640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b340795e0 0x7f4b3407baa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4b44036000 tx=0x7f4b440046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:10.410 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.409+0000 7f4b4bfff640 1 -- 172.21.15.81:0/2758185849 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4b540ce970 con 0x7f4b540b1d00 2024-09-17T05:26:10.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.588+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f4b540d0630 con 0x7f4b540b1d00 2024-09-17T05:26:10.592 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.591+0000 7f4b4bfff640 1 -- 172.21.15.81:0/2758185849 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v47) ==== 71+0+0 (secure 0 0 0) 0x7f4b4c06c020 con 0x7f4b540b1d00 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.593+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b340795e0 msgr2=0x7f4b3407baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.593+0000 7f4b59564640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b340795e0 0x7f4b3407baa0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f4b44036000 tx=0x7f4b440046c0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.593+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b540b1d00 msgr2=0x7f4b54161210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.593+0000 7f4b59564640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b540b1d00 0x7f4b54161210 secure :-1 s=READY pgs=1798 cs=0 l=1 rev1=1 crypto rx=0x7f4b54162860 tx=0x7f4b4c006720 comp rx=0 tx=0).stop 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.593+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 shutdown_connections 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.593+0000 7f4b59564640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b540b1d00 0x7f4b54161210 unknown :-1 s=CLOSED pgs=1798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.593+0000 7f4b59564640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b340795e0 0x7f4b3407baa0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.594+0000 7f4b59564640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b540ca050 0x7f4b540b17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.594+0000 7f4b59564640 1 --2- 172.21.15.81:0/2758185849 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b40003a00 0x7f4b5415ea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.594+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 >> 172.21.15.81:0/2758185849 conn(0x7f4b540d3ea0 msgr2=0x7f4b540b50b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:10.595 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.594+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 shutdown_connections 2024-09-17T05:26:10.596 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.594+0000 7f4b59564640 1 -- 172.21.15.81:0/2758185849 wait complete. 2024-09-17T05:26:10.605 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2' 2024-09-17T05:26:10.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.705+0000 7fefb5bda640 1 -- 172.21.15.81:0/3633252981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 msgr2=0x7fef98005910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.705+0000 7fefb5bda640 1 --2- 172.21.15.81:0/3633252981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 0x7fef98005910 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fefa4009b50 tx=0x7fef98006940 comp rx=0 tx=0).stop 2024-09-17T05:26:10.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.705+0000 7fefaffff640 1 -- 172.21.15.81:0/3633252981 reap_dead start 2024-09-17T05:26:10.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.705+0000 7fefb5bda640 1 -- 172.21.15.81:0/3633252981 shutdown_connections 2024-09-17T05:26:10.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.705+0000 7fefb5bda640 1 -- 172.21.15.81:0/3633252981 >> 172.21.15.81:0/3633252981 conn(0x7fefb00b1690 msgr2=0x7fefb00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:10.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.705+0000 7fefb5bda640 1 -- 172.21.15.81:0/3633252981 shutdown_connections 2024-09-17T05:26:10.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.705+0000 7fefb5bda640 1 -- 172.21.15.81:0/3633252981 wait complete. 2024-09-17T05:26:10.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.706+0000 7fefb5bda640 1 Processor -- start 2024-09-17T05:26:10.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.707+0000 7fefb5bda640 1 -- start start 2024-09-17T05:26:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.707+0000 7fefb5bda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 0x7fefb01e6500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.707+0000 7fefb5bda640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefb01495f0 0x7fefb0148ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.707+0000 7fefb5bda640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefb01f24a0 0x7fefb014c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.707+0000 7fefb5bda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fefb006e760 con 0x7fef980050e0 2024-09-17T05:26:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.707+0000 7fefb5bda640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fefb006e5e0 con 0x7fefb01495f0 2024-09-17T05:26:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.707+0000 7fefb5bda640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fefb006e8e0 con 0x7fefb01f24a0 2024-09-17T05:26:10.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 0x7fefb01e6500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 0x7fefb01e6500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46872/0 (socket says 172.21.15.81:46872) 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 -- 172.21.15.81:0/124025714 learned_addr learned my addr 172.21.15.81:0/124025714 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaeffd640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefb01495f0 0x7fefb0148ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaffff640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefb01f24a0 0x7fefb014c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 -- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefb01f24a0 msgr2=0x7fefb014c7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefb01f24a0 0x7fefb014c7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 -- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefb01495f0 msgr2=0x7fefb0148ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefb01495f0 0x7fefb0148ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 -- 172.21.15.81:0/124025714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefb01541b0 con 0x7fef980050e0 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaffff640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefb01f24a0 0x7fefb014c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:10.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefaf7fe640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 0x7fefb01e6500 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fefa0011a50 tx=0x7fefa0011f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:10.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fef97fff640 1 -- 172.21.15.81:0/124025714 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa001f070 con 0x7fef980050e0 2024-09-17T05:26:10.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fef97fff640 1 -- 172.21.15.81:0/124025714 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fefa000fcd0 con 0x7fef980050e0 2024-09-17T05:26:10.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefb0149400 con 0x7fef980050e0 2024-09-17T05:26:10.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fef97fff640 1 -- 172.21.15.81:0/124025714 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefa000fea0 con 0x7fef980050e0 2024-09-17T05:26:10.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.708+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefb014dbb0 con 0x7fef980050e0 2024-09-17T05:26:10.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.709+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefb00cf470 con 0x7fef980050e0 2024-09-17T05:26:10.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.710+0000 7fef97fff640 1 -- 172.21.15.81:0/124025714 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fefa0022070 con 0x7fef980050e0 2024-09-17T05:26:10.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.710+0000 7fef97fff640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fef9c0795e0 0x7fef9c07baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:10.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.711+0000 7fefaeffd640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fef9c0795e0 0x7fef9c07baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:10.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.711+0000 7fef97fff640 1 -- 172.21.15.81:0/124025714 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7fefa009a080 con 0x7fef980050e0 2024-09-17T05:26:10.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.711+0000 7fefaeffd640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fef9c0795e0 0x7fef9c07baa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fefa4035000 tx=0x7fefa40046c0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:10.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.715+0000 7fef97fff640 1 -- 172.21.15.81:0/124025714 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fefa0063730 con 0x7fef980050e0 2024-09-17T05:26:10.962 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:10.961+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]} v 0) -- 0x7fefb014bfd0 con 0x7fef980050e0 2024-09-17T05:26:11.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.280+0000 7fef97fff640 1 -- 172.21.15.81:0/124025714 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_subvolume_upgrade_v1_to_v2"]}]=0 v412) ==== 145+0+0 (secure 0 0 0) 0x7fefa0068160 con 0x7fef980050e0 2024-09-17T05:26:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fef9c0795e0 msgr2=0x7fef9c07baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fef9c0795e0 0x7fef9c07baa0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fefa4035000 tx=0x7fefa40046c0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 msgr2=0x7fefb01e6500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 0x7fefb01e6500 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7fefa0011a50 tx=0x7fefa0011f10 comp rx=0 tx=0).stop 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 shutdown_connections 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fefb01f24a0 0x7fefb014c7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fef9c0795e0 0x7fef9c07baa0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fefb01495f0 0x7fefb0148ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 --2- 172.21.15.81:0/124025714 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fef980050e0 0x7fefb01e6500 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 >> 172.21.15.81:0/124025714 conn(0x7fefb00b1690 msgr2=0x7fefb015ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 shutdown_connections 2024-09-17T05:26:11.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.282+0000 7fefb5bda640 1 -- 172.21.15.81:0/124025714 wait complete. 2024-09-17T05:26:11.294 INFO:tasks.cephfs_test_runner:poor man's upgrade test -- theme continues... ... ok 2024-09-17T05:26:11.295 INFO:tasks.cephfs_test_runner:Starting test: test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) Validate unparseable text .meta file on legacy subvol root doesn't break the system 2024-09-17T05:26:11.295 INFO:tasks.cephfs_test_runner:test_unparseable_metafile_on_legacy_to_v1_upgrade (tasks.cephfs.test_volumes.TestMisc) 2024-09-17T05:26:11.295 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.394+0000 7f59f45f3640 1 -- 172.21.15.81:0/3998786529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 msgr2=0x7f59ec15d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.394+0000 7f59f45f3640 1 --2- 172.21.15.81:0/3998786529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec15d270 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f59ec0b2330 tx=0x7f59e802a560 comp rx=0 tx=0).stop 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.395+0000 7f59f45f3640 1 -- 172.21.15.81:0/3998786529 shutdown_connections 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.395+0000 7f59f45f3640 1 --2- 172.21.15.81:0/3998786529 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59ec0cc900 0x7f59ec15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.395+0000 7f59f45f3640 1 --2- 172.21.15.81:0/3998786529 >> v2:172.21.15.160:3300/0 conn(0x7f59ec0cc490 0x7f59ec15f750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.395+0000 7f59f45f3640 1 --2- 172.21.15.81:0/3998786529 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec15d270 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.395+0000 7f59f45f3640 1 -- 172.21.15.81:0/3998786529 >> 172.21.15.81:0/3998786529 conn(0x7f59ec0b1690 msgr2=0x7f59ec0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:11.396 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.395+0000 7f59f45f3640 1 -- 172.21.15.81:0/3998786529 shutdown_connections 2024-09-17T05:26:11.397 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.395+0000 7f59f45f3640 1 -- 172.21.15.81:0/3998786529 wait complete. 2024-09-17T05:26:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 Processor -- start 2024-09-17T05:26:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 -- start start 2024-09-17T05:26:11.398 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59ec0cc490 0x7f59ec154290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59ec0cc900 0x7f59ec1f6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec1efc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0cec40 con 0x7f59ec159680 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f59ec0ceac0 con 0x7f59ec0cc900 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.396+0000 7f59f45f3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f59ec0cedc0 con 0x7f59ec0cc490 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec1efc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec1efc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46890/0 (socket says 172.21.15.81:46890) 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 -- 172.21.15.81:0/1217493774 learned_addr learned my addr 172.21.15.81:0/1217493774 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f1b8e640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59ec0cc900 0x7f59ec1f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f238f640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59ec0cc490 0x7f59ec154290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 -- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59ec0cc490 msgr2=0x7f59ec154290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59ec0cc490 0x7f59ec154290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 -- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59ec0cc900 msgr2=0x7f59ec1f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59ec0cc900 0x7f59ec1f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 -- 172.21.15.81:0/1217493774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59ec1f6d40 con 0x7f59ec159680 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f2b90640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec1efc80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f59e400b9a0 tx=0x7f59e400bda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59e2ffd640 1 -- 172.21.15.81:0/1217493774 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4019070 con 0x7f59ec159680 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59e2ffd640 1 -- 172.21.15.81:0/1217493774 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f59e400cbb0 con 0x7f59ec159680 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59ec1411b0 con 0x7f59ec159680 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59e2ffd640 1 -- 172.21.15.81:0/1217493774 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4014440 con 0x7f59ec159680 2024-09-17T05:26:11.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.397+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59ec141730 con 0x7f59ec159680 2024-09-17T05:26:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.398+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59ec0cf2b0 con 0x7f59ec159680 2024-09-17T05:26:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.399+0000 7f59e2ffd640 1 -- 172.21.15.81:0/1217493774 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f59e401c070 con 0x7f59ec159680 2024-09-17T05:26:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.399+0000 7f59e2ffd640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f59d00795b0 0x7f59d007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.399+0000 7f59e2ffd640 1 -- 172.21.15.81:0/1217493774 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7f59e4099460 con 0x7f59ec159680 2024-09-17T05:26:11.401 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.399+0000 7f59f238f640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f59d00795b0 0x7f59d007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.400+0000 7f59f238f640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f59d00795b0 0x7f59d007ba70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f59e8033000 tx=0x7f59e8004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:11.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.404+0000 7f59e2ffd640 1 -- 172.21.15.81:0/1217493774 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f59ec1f6d40 con 0x7f59ec159680 2024-09-17T05:26:11.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.586+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f59ec15d470 con 0x7f59ec159680 2024-09-17T05:26:11.587 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.586+0000 7f59e2ffd640 1 -- 172.21.15.81:0/1217493774 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v154) ==== 74+0+13156 (secure 0 0 0) 0x7f59e4062b70 con 0x7f59ec159680 2024-09-17T05:26:11.588 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:11.588 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":154,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:26:10.274805+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":25,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":149,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.160:6835/3389320458":"2024-09-18T05:26:07.265956+0000","172.21.15.160:6801/3389320458":"2024-09-18T05:26:07.265956+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f59d00795b0 msgr2=0x7f59d007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f59d00795b0 0x7f59d007ba70 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f59e8033000 tx=0x7f59e8004730 comp rx=0 tx=0).stop 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 msgr2=0x7f59ec1efc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec1efc80 secure :-1 s=READY pgs=1803 cs=0 l=1 rev1=1 crypto rx=0x7f59e400b9a0 tx=0x7f59e400bda0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 shutdown_connections 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f59ec159680 0x7f59ec1efc80 unknown :-1 s=CLOSED pgs=1803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f59d00795b0 0x7f59d007ba70 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f59ec0cc900 0x7f59ec1f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 --2- 172.21.15.81:0/1217493774 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f59ec0cc490 0x7f59ec154290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 >> 172.21.15.81:0/1217493774 conn(0x7f59ec0b1690 msgr2=0x7f59ec15bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 shutdown_connections 2024-09-17T05:26:11.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.589+0000 7f59f45f3640 1 -- 172.21.15.81:0/1217493774 wait complete. 2024-09-17T05:26:11.600 INFO:tasks.ceph_test_case.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-17T05:18:37.391103+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-17T05:26:11.601 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-17T05:26:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.703+0000 7f5d8bb10640 1 -- 172.21.15.81:0/3838276456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d6c004800 msgr2=0x7f5d6c004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.703+0000 7f5d8bb10640 1 --2- 172.21.15.81:0/3838276456 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d6c004800 0x7f5d6c004c80 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7f5d78009b20 tx=0x7f5d6c005830 comp rx=0 tx=0).stop 2024-09-17T05:26:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.703+0000 7f5d8a0ad640 1 -- 172.21.15.81:0/3838276456 reap_dead start 2024-09-17T05:26:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.703+0000 7f5d8bb10640 1 -- 172.21.15.81:0/3838276456 shutdown_connections 2024-09-17T05:26:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.703+0000 7f5d8bb10640 1 -- 172.21.15.81:0/3838276456 >> 172.21.15.81:0/3838276456 conn(0x7f5d840b1700 msgr2=0x7f5d840b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.704+0000 7f5d8bb10640 1 -- 172.21.15.81:0/3838276456 shutdown_connections 2024-09-17T05:26:11.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.704+0000 7f5d8bb10640 1 -- 172.21.15.81:0/3838276456 wait complete. 2024-09-17T05:26:11.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.705+0000 7f5d8bb10640 1 Processor -- start 2024-09-17T05:26:11.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.705+0000 7f5d8bb10640 1 -- start start 2024-09-17T05:26:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.705+0000 7f5d8bb10640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d6c004800 0x7f5d840c3f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.705+0000 7f5d8bb10640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84168820 0x7f5d84167c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8bb10640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d84145340 0x7f5d84150b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8bb10640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840cbd50 con 0x7f5d84145340 2024-09-17T05:26:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8bb10640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5d840cbbd0 con 0x7f5d84168820 2024-09-17T05:26:11.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8bb10640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5d840cbed0 con 0x7f5d6c004800 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d84145340 0x7f5d84150b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d84145340 0x7f5d84150b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46918/0 (socket says 172.21.15.81:46918) 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 -- 172.21.15.81:0/601568520 learned_addr learned my addr 172.21.15.81:0/601568520 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d898ac640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d6c004800 0x7f5d840c3f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d890ab640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84168820 0x7f5d84167c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 -- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d6c004800 msgr2=0x7f5d840c3f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d6c004800 0x7f5d840c3f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 -- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84168820 msgr2=0x7f5d84167c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84168820 0x7f5d84167c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 -- 172.21.15.81:0/601568520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d84168150 con 0x7f5d84145340 2024-09-17T05:26:11.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8a0ad640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d84145340 0x7f5d84150b10 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ca8b0 tx=0x7f5d7c0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:11.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d827fc640 1 -- 172.21.15.81:0/601568520 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c011900 con 0x7f5d84145340 2024-09-17T05:26:11.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d827fc640 1 -- 172.21.15.81:0/601568520 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5d7c018070 con 0x7f5d84145340 2024-09-17T05:26:11.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d84168eb0 con 0x7f5d84145340 2024-09-17T05:26:11.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d827fc640 1 -- 172.21.15.81:0/601568520 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d7c011d60 con 0x7f5d84145340 2024-09-17T05:26:11.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.706+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d84158580 con 0x7f5d84145340 2024-09-17T05:26:11.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.707+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d840cdd00 con 0x7f5d84145340 2024-09-17T05:26:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.708+0000 7f5d827fc640 1 -- 172.21.15.81:0/601568520 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f5d7c01d460 con 0x7f5d84145340 2024-09-17T05:26:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.708+0000 7f5d827fc640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5d700795b0 0x7f5d7007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.709+0000 7f5d827fc640 1 -- 172.21.15.81:0/601568520 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7f5d7c099fe0 con 0x7f5d84145340 2024-09-17T05:26:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.709+0000 7f5d898ac640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5d700795b0 0x7f5d7007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:11.711 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.709+0000 7f5d898ac640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5d700795b0 0x7f5d7007ba70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5d74005fd0 tx=0x7f5d74009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:11.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.713+0000 7f5d827fc640 1 -- 172.21.15.81:0/601568520 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5d84168150 con 0x7f5d84145340 2024-09-17T05:26:11.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.888+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f5d84168c00 con 0x7f5d84145340 2024-09-17T05:26:11.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.888+0000 7f5d827fc640 1 -- 172.21.15.81:0/601568520 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v154) ==== 93+0+10 (secure 0 0 0) 0x7f5d7c063670 con 0x7f5d84145340 2024-09-17T05:26:11.890 INFO:teuthology.orchestra.run.smithi081.stdout:pg_num: 1 2024-09-17T05:26:11.891 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5d700795b0 msgr2=0x7f5d7007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5d700795b0 0x7f5d7007ba70 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f5d74005fd0 tx=0x7f5d74009500 comp rx=0 tx=0).stop 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d84145340 msgr2=0x7f5d84150b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d84145340 0x7f5d84150b10 secure :-1 s=READY pgs=1806 cs=0 l=1 rev1=1 crypto rx=0x7f5d840ca8b0 tx=0x7f5d7c0039c0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 shutdown_connections 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5d84145340 0x7f5d84150b10 unknown :-1 s=CLOSED pgs=1806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5d700795b0 0x7f5d7007ba70 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5d84168820 0x7f5d84167c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 --2- 172.21.15.81:0/601568520 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5d6c004800 0x7f5d840c3f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 >> 172.21.15.81:0/601568520 conn(0x7f5d840b1700 msgr2=0x7f5d8406e500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 shutdown_connections 2024-09-17T05:26:11.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:11.890+0000 7f5d8bb10640 1 -- 172.21.15.81:0/601568520 wait complete. 2024-09-17T05:26:11.902 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:26:12.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.002+0000 7fd4465d3640 1 -- 172.21.15.81:0/2246266610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd428004d40 msgr2=0x7fd4280051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.002+0000 7fd4465d3640 1 --2- 172.21.15.81:0/2246266610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd428004d40 0x7fd4280051c0 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fd438009ed0 tx=0x7fd428005830 comp rx=0 tx=0).stop 2024-09-17T05:26:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.002+0000 7fd444b70640 1 -- 172.21.15.81:0/2246266610 reap_dead start 2024-09-17T05:26:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.002+0000 7fd4465d3640 1 -- 172.21.15.81:0/2246266610 shutdown_connections 2024-09-17T05:26:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.002+0000 7fd4465d3640 1 -- 172.21.15.81:0/2246266610 >> 172.21.15.81:0/2246266610 conn(0x7fd440074cb0 msgr2=0x7fd44009b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.002+0000 7fd4465d3640 1 -- 172.21.15.81:0/2246266610 shutdown_connections 2024-09-17T05:26:12.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.002+0000 7fd4465d3640 1 -- 172.21.15.81:0/2246266610 wait complete. 2024-09-17T05:26:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.003+0000 7fd4465d3640 1 Processor -- start 2024-09-17T05:26:12.005 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd4465d3640 1 -- start start 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd4465d3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd428004d40 0x7fd4401507e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd4465d3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440156970 0x7fd4400b6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd4465d3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4401f5c20 0x7fd44015a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd4465d3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd4400ccaa0 con 0x7fd440156970 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd4465d3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd4400cc920 con 0x7fd428004d40 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd4465d3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd4400cdac0 con 0x7fd4401f5c20 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.004+0000 7fd43f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440156970 0x7fd4400b6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440156970 0x7fd4400b6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46948/0 (socket says 172.21.15.81:46948) 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 -- 172.21.15.81:0/62152103 learned_addr learned my addr 172.21.15.81:0/62152103 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43ffff640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd428004d40 0x7fd4401507e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd444b70640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4401f5c20 0x7fd44015a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 -- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4401f5c20 msgr2=0x7fd44015a3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4401f5c20 0x7fd44015a3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 -- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd428004d40 msgr2=0x7fd4401507e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd428004d40 0x7fd4401507e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 -- 172.21.15.81:0/62152103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd440154480 con 0x7fd440156970 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43ffff640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd428004d40 0x7fd4401507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd444b70640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4401f5c20 0x7fd44015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43f7fe640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440156970 0x7fd4400b6570 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fd434004f10 tx=0x7fd434001630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:12.008 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43cff9640 1 -- 172.21.15.81:0/62152103 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434015020 con 0x7fd440156970 2024-09-17T05:26:12.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43cff9640 1 -- 172.21.15.81:0/62152103 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd434011960 con 0x7fd440156970 2024-09-17T05:26:12.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd4401f6470 con 0x7fd440156970 2024-09-17T05:26:12.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd43cff9640 1 -- 172.21.15.81:0/62152103 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd434011d10 con 0x7fd440156970 2024-09-17T05:26:12.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.005+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4401f6a30 con 0x7fd440156970 2024-09-17T05:26:12.009 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.006+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd4400d2170 con 0x7fd440156970 2024-09-17T05:26:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.007+0000 7fd43cff9640 1 -- 172.21.15.81:0/62152103 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fd434018020 con 0x7fd440156970 2024-09-17T05:26:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.007+0000 7fd43cff9640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd42c0795b0 0x7fd42c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.007+0000 7fd43ffff640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd42c0795b0 0x7fd42c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.007+0000 7fd43cff9640 1 -- 172.21.15.81:0/62152103 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7fd43409a010 con 0x7fd440156970 2024-09-17T05:26:12.010 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.008+0000 7fd43ffff640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd42c0795b0 0x7fd42c07ba70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd430001050 tx=0x7fd4300067a0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:12.012 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.011+0000 7fd43cff9640 1 -- 172.21.15.81:0/62152103 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd43401f030 con 0x7fd440156970 2024-09-17T05:26:12.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.256+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fd4400b6ab0 con 0x7fd440156970 2024-09-17T05:26:12.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.284+0000 7fd43cff9640 1 -- 172.21.15.81:0/62152103 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v413) ==== 166+0+0 (secure 0 0 0) 0x7fd434063cf0 con 0x7fd440156970 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd42c0795b0 msgr2=0x7fd42c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd42c0795b0 0x7fd42c07ba70 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fd430001050 tx=0x7fd4300067a0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440156970 msgr2=0x7fd4400b6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440156970 0x7fd4400b6570 secure :-1 s=READY pgs=1809 cs=0 l=1 rev1=1 crypto rx=0x7fd434004f10 tx=0x7fd434001630 comp rx=0 tx=0).stop 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 shutdown_connections 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd4401f5c20 0x7fd44015a3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd440156970 0x7fd4400b6570 unknown :-1 s=CLOSED pgs=1809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd42c0795b0 0x7fd42c07ba70 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.288 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 --2- 172.21.15.81:0/62152103 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd428004d40 0x7fd4401507e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.286+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 >> 172.21.15.81:0/62152103 conn(0x7fd440074cb0 msgr2=0x7fd44009b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.287+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 shutdown_connections 2024-09-17T05:26:12.289 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.287+0000 7fd4465d3640 1 -- 172.21.15.81:0/62152103 wait complete. 2024-09-17T05:26:12.298 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config dump 2024-09-17T05:26:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 -- 172.21.15.81:0/1334903626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40b1920 msgr2=0x7fb2b40d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/1334903626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40b1920 0x7fb2b40d1d10 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7fb2b40cfa60 tx=0x7fb2a402a4d0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 -- 172.21.15.81:0/1334903626 shutdown_connections 2024-09-17T05:26:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/1334903626 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b40b1920 0x7fb2b40d1d10 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/1334903626 >> v2:172.21.15.160:3300/0 conn(0x7fb2b415bdc0 0x7fb2b40b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 -- 172.21.15.81:0/1334903626 >> 172.21.15.81:0/1334903626 conn(0x7fb2b4074cb0 msgr2=0x7fb2b409b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:12.399 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 -- 172.21.15.81:0/1334903626 shutdown_connections 2024-09-17T05:26:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.398+0000 7fb2bacfe640 1 -- 172.21.15.81:0/1334903626 wait complete. 2024-09-17T05:26:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.399+0000 7fb2bacfe640 1 Processor -- start 2024-09-17T05:26:12.400 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.399+0000 7fb2bacfe640 1 -- start start 2024-09-17T05:26:12.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2bacfe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2b40b1920 0x7fb2b415c4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2bacfe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2b40d2250 0x7fb2b415e880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2bacfe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b415bdc0 0x7fb2b415edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.402 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2bacfe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b40cdac0 con 0x7fb2b415bdc0 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2bacfe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb2b40cf850 con 0x7fb2b40b1920 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2bacfe640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb2b40cdc40 con 0x7fb2b40d2250 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b415bdc0 0x7fb2b415edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b415bdc0 0x7fb2b415edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46966/0 (socket says 172.21.15.81:46966) 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 -- 172.21.15.81:0/239207329 learned_addr learned my addr 172.21.15.81:0/239207329 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b8a9a640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2b40b1920 0x7fb2b415c4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2abfff640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2b40d2250 0x7fb2b415e880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 -- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2b40d2250 msgr2=0x7fb2b415e880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2b40d2250 0x7fb2b415e880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 -- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2b40b1920 msgr2=0x7fb2b415c4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2b40b1920 0x7fb2b415c4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.403 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 -- 172.21.15.81:0/239207329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2b415ded0 con 0x7fb2b415bdc0 2024-09-17T05:26:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.400+0000 7fb2b929b640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b415bdc0 0x7fb2b415edc0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c410 tx=0x7fb2ac00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.401+0000 7fb2a97fa640 1 -- 172.21.15.81:0/239207329 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac017070 con 0x7fb2b415bdc0 2024-09-17T05:26:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.401+0000 7fb2a97fa640 1 -- 172.21.15.81:0/239207329 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb2ac0035f0 con 0x7fb2b415bdc0 2024-09-17T05:26:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.401+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2b415ce30 con 0x7fb2b415bdc0 2024-09-17T05:26:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.401+0000 7fb2a97fa640 1 -- 172.21.15.81:0/239207329 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac003a80 con 0x7fb2b415bdc0 2024-09-17T05:26:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.401+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2b415d3f0 con 0x7fb2b415bdc0 2024-09-17T05:26:12.404 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.402+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2b40b27c0 con 0x7fb2b415bdc0 2024-09-17T05:26:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.402+0000 7fb2a97fa640 1 -- 172.21.15.81:0/239207329 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fb2ac01a070 con 0x7fb2b415bdc0 2024-09-17T05:26:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.403+0000 7fb2a97fa640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2a00795b0 0x7fb2a007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.403+0000 7fb2a97fa640 1 -- 172.21.15.81:0/239207329 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7fb2ac098b20 con 0x7fb2b415bdc0 2024-09-17T05:26:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.403+0000 7fb2b8a9a640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2a00795b0 0x7fb2a007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.405 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.403+0000 7fb2b8a9a640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2a00795b0 0x7fb2a007ba70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009f20 tx=0x7fb2b00094f0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:12.408 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.407+0000 7fb2a97fa640 1 -- 172.21.15.81:0/239207329 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb2ac0627e0 con 0x7fb2b415bdc0 2024-09-17T05:26:12.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.584+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config dump"} v 0) -- 0x7fb2b415a140 con 0x7fb2b415bdc0 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.585+0000 7fb2a97fa640 1 -- 172.21.15.81:0/239207329 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config dump"}]=0 v47) ==== 59+0+1998 (secure 0 0 0) 0x7fb2ac0620e0 con 0x7fb2b415bdc0 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:WHO MASK LEVEL OPTION VALUE RO 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:mon advanced mon_op_complaint_time 120 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:mon dev mon_warn_on_pool_no_app false 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:osd advanced osd_op_complaint_time 180.000000 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:osd.0 basic osd_mclock_max_capacity_iops_ssd 8322.849317 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:osd.1 basic osd_mclock_max_capacity_iops_ssd 5977.337499 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:osd.2 basic osd_mclock_max_capacity_iops_ssd 6001.361505 2024-09-17T05:26:12.586 INFO:teuthology.orchestra.run.smithi081.stdout:osd.3 basic osd_mclock_max_capacity_iops_ssd 5548.755874 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:osd.4 basic osd_mclock_max_capacity_iops_ssd 4896.521413 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:osd.5 basic osd_mclock_max_capacity_iops_ssd 4993.177663 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:osd.6 basic osd_mclock_max_capacity_iops_ssd 5295.386182 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:osd.7 basic osd_mclock_max_capacity_iops_ssd 5470.024989 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds 20/20 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_mds_balancer 20/20 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced debug_ms 2/2 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_frag true 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_debug_scatterstat true 2024-09-17T05:26:12.587 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced mds_op_complaint_time 180.000000 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:mds dev mds_verify_scatter true 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced osd_op_complaint_time 180.000000 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_mon_op_timeout 900 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:mds advanced rados_osd_op_timeout 900 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced client_mount_timeout 600 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_client 20/20 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced debug_ms 1/1 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_mon_op_timeout 900 2024-09-17T05:26:12.588 INFO:teuthology.orchestra.run.smithi081.stdout:client advanced rados_osd_op_timeout 900 2024-09-17T05:26:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2a00795b0 msgr2=0x7fb2a007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2a00795b0 0x7fb2a007ba70 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0009f20 tx=0x7fb2b00094f0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b415bdc0 msgr2=0x7fb2b415edc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b415bdc0 0x7fb2b415edc0 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac00c410 tx=0x7fb2ac00c8d0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 shutdown_connections 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb2b415bdc0 0x7fb2b415edc0 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb2b40d2250 0x7fb2b415e880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2a00795b0 0x7fb2a007ba70 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 --2- 172.21.15.81:0/239207329 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb2b40b1920 0x7fb2b415c4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 >> 172.21.15.81:0/239207329 conn(0x7fb2b4074cb0 msgr2=0x7fb2b4071b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 shutdown_connections 2024-09-17T05:26:12.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.587+0000 7fb2bacfe640 1 -- 172.21.15.81:0/239207329 wait complete. 2024-09-17T05:26:12.599 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:26:12.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 -- 172.21.15.81:0/2618610996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940b1360 msgr2=0x7f1f940d1c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 --2- 172.21.15.81:0/2618610996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940b1360 0x7f1f940d1c20 secure :-1 s=READY pgs=1813 cs=0 l=1 rev1=1 crypto rx=0x7f1f940d0cb0 tx=0x7f1f8802a530 comp rx=0 tx=0).stop 2024-09-17T05:26:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 -- 172.21.15.81:0/2618610996 shutdown_connections 2024-09-17T05:26:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 --2- 172.21.15.81:0/2618610996 >> v2:172.21.15.160:3300/0 conn(0x7f1f940d2160 0x7f1f940cc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 --2- 172.21.15.81:0/2618610996 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940b1360 0x7f1f940d1c20 unknown :-1 s=CLOSED pgs=1813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 -- 172.21.15.81:0/2618610996 >> 172.21.15.81:0/2618610996 conn(0x7f1f9409aa30 msgr2=0x7f1f9409ae40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 -- 172.21.15.81:0/2618610996 shutdown_connections 2024-09-17T05:26:12.704 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.702+0000 7f1f99c33640 1 -- 172.21.15.81:0/2618610996 wait complete. 2024-09-17T05:26:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.703+0000 7f1f99c33640 1 Processor -- start 2024-09-17T05:26:12.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f99c33640 1 -- start start 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f99c33640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f940b1360 0x7f1f94159020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f99c33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940d2160 0x7f1f94159750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f99c33640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f9415bdc0 0x7f1f94159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f99c33640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940ccf60 con 0x7f1f940d2160 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f99c33640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1f940ccde0 con 0x7f1f940b1360 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f99c33640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1f940cd0e0 con 0x7f1f9415bdc0 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940d2160 0x7f1f94159750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f92ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940d2160 0x7f1f94159750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:46994/0 (socket says 172.21.15.81:46994) 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.704+0000 7f1f92ffd640 1 -- 172.21.15.81:0/52352055 learned_addr learned my addr 172.21.15.81:0/52352055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f93fff640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f9415bdc0 0x7f1f94159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.707 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f937fe640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f940b1360 0x7f1f94159020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f92ffd640 1 -- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f9415bdc0 msgr2=0x7f1f94159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f92ffd640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f9415bdc0 0x7f1f94159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f92ffd640 1 -- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f940b1360 msgr2=0x7f1f94159020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f92ffd640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f940b1360 0x7f1f94159020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f92ffd640 1 -- 172.21.15.81:0/52352055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f94159560 con 0x7f1f940d2160 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f92ffd640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940d2160 0x7f1f94159750 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1f8802ab20 tx=0x7f1f88032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f7bfff640 1 -- 172.21.15.81:0/52352055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88040070 con 0x7f1f940d2160 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f7bfff640 1 -- 172.21.15.81:0/52352055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1f88005310 con 0x7f1f940d2160 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f9415b5d0 con 0x7f1f940d2160 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f7bfff640 1 -- 172.21.15.81:0/52352055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f88005c90 con 0x7f1f940d2160 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.705+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f940b75f0 con 0x7f1f940d2160 2024-09-17T05:26:12.708 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.706+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f940cd6a0 con 0x7f1f940d2160 2024-09-17T05:26:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.707+0000 7f1f7bfff640 1 -- 172.21.15.81:0/52352055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f1f88039040 con 0x7f1f940d2160 2024-09-17T05:26:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.707+0000 7f1f7bfff640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1f800795b0 0x7f1f8007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.707+0000 7f1f937fe640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1f800795b0 0x7f1f8007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:12.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.707+0000 7f1f7bfff640 1 -- 172.21.15.81:0/52352055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7f1f880ba6c0 con 0x7f1f940d2160 2024-09-17T05:26:12.710 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.708+0000 7f1f937fe640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1f800795b0 0x7f1f8007ba70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1f940cca50 tx=0x7f1f84009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:12.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.711+0000 7f1f7bfff640 1 -- 172.21.15.81:0/52352055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1f88084640 con 0x7f1f940d2160 2024-09-17T05:26:12.889 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.888+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7f1f940d1dc0 con 0x7f1f940d2160 2024-09-17T05:26:12.892 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.891+0000 7f1f7bfff640 1 -- 172.21.15.81:0/52352055 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7f1f88083f40 con 0x7f1f940d2160 2024-09-17T05:26:12.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1f800795b0 msgr2=0x7f1f8007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1f800795b0 0x7f1f8007ba70 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f1f940cca50 tx=0x7f1f84009040 comp rx=0 tx=0).stop 2024-09-17T05:26:12.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940d2160 msgr2=0x7f1f94159750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:12.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940d2160 0x7f1f94159750 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7f1f8802ab20 tx=0x7f1f88032c10 comp rx=0 tx=0).stop 2024-09-17T05:26:12.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 shutdown_connections 2024-09-17T05:26:12.895 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1f9415bdc0 0x7f1f94159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1f940d2160 0x7f1f94159750 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1f800795b0 0x7f1f8007ba70 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 --2- 172.21.15.81:0/52352055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1f940b1360 0x7f1f94159020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:12.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 >> 172.21.15.81:0/52352055 conn(0x7f1f9409aa30 msgr2=0x7f1f940af5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:12.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 shutdown_connections 2024-09-17T05:26:12.896 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:12.894+0000 7f1f99c33640 1 -- 172.21.15.81:0/52352055 wait complete. 2024-09-17T05:26:12.905 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:26:12.906 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:26:12.959 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:26:13.010 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:26:13.010 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:13.011 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:13.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:26:13.027 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:13.027 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:13.045 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:26:13.045 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:13.045 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:13.083 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:26:13.083 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:13.083 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:13.103 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:26:13.103 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2024-09-17T05:26:13.103 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:13.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/1653463131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb406ff80 msgr2=0x7f0fb40703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/1653463131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb406ff80 0x7f0fb40703f0 secure :-1 s=READY pgs=1815 cs=0 l=1 rev1=1 crypto rx=0x7f0fb406ee40 tx=0x7f0fac02a560 comp rx=0 tx=0).stop 2024-09-17T05:26:13.223 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/1653463131 shutdown_connections 2024-09-17T05:26:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/1653463131 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb406ff80 0x7f0fb40703f0 unknown :-1 s=CLOSED pgs=1815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/1653463131 >> v2:172.21.15.160:3300/0 conn(0x7f0fb40735a0 0x7f0fb40739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/1653463131 >> 172.21.15.81:0/1653463131 conn(0x7f0fb40b1690 msgr2=0x7f0fb40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/1653463131 shutdown_connections 2024-09-17T05:26:13.224 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.222+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/1653463131 wait complete. 2024-09-17T05:26:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.223+0000 7f0fbb8cd640 1 Processor -- start 2024-09-17T05:26:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.223+0000 7f0fbb8cd640 1 -- start start 2024-09-17T05:26:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fbb8cd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb406ff80 0x7f0fb41f5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.226 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fbb8cd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fb40735a0 0x7f0fb4150830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fbb8cd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb415aa70 0x7f0fb40c9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fbb8cd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40cd270 con 0x7f0fb415aa70 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fbb8cd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0fb40cd0f0 con 0x7f0fb406ff80 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fbb8cd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0fb40cd3f0 con 0x7f0fb40735a0 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb415aa70 0x7f0fb40c9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb415aa70 0x7f0fb40c9ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:33988/0 (socket says 172.21.15.81:33988) 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 -- 172.21.15.81:0/126351117 learned_addr learned my addr 172.21.15.81:0/126351117 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb8e68640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fb40735a0 0x7f0fb4150830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9669640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb406ff80 0x7f0fb41f5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 -- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fb40735a0 msgr2=0x7f0fb4150830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fb40735a0 0x7f0fb4150830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 -- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb406ff80 msgr2=0x7f0fb41f5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb406ff80 0x7f0fb41f5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9e6a640 1 -- 172.21.15.81:0/126351117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fb40ca4f0 con 0x7f0fb415aa70 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.224+0000 7f0fb9669640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb406ff80 0x7f0fb41f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.225+0000 7f0fb9e6a640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb415aa70 0x7f0fb40c9ca0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0099c0 tx=0x7f0fac003910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.225+0000 7f0fb1ffb640 1 -- 172.21.15.81:0/126351117 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac03f070 con 0x7f0fb415aa70 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.225+0000 7f0fb1ffb640 1 -- 172.21.15.81:0/126351117 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0fac0047a0 con 0x7f0fb415aa70 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.225+0000 7f0fb1ffb640 1 -- 172.21.15.81:0/126351117 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fac035030 con 0x7f0fb415aa70 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.225+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fb41f4b30 con 0x7f0fb415aa70 2024-09-17T05:26:13.228 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.225+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fb4150d70 con 0x7f0fb415aa70 2024-09-17T05:26:13.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.226+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fb4074750 con 0x7f0fb415aa70 2024-09-17T05:26:13.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.227+0000 7f0fb1ffb640 1 -- 172.21.15.81:0/126351117 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f0fac042070 con 0x7f0fb415aa70 2024-09-17T05:26:13.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.227+0000 7f0fb1ffb640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0fa00795b0 0x7f0fa007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.227+0000 7f0fb1ffb640 1 -- 172.21.15.81:0/126351117 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7f0fac0ba610 con 0x7f0fb415aa70 2024-09-17T05:26:13.229 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.227+0000 7f0fb9669640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0fa00795b0 0x7f0fa007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.230 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.228+0000 7f0fb9669640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0fa00795b0 0x7f0fa007ba70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001da0 tx=0x7f0fa4009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:13.232 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.231+0000 7f0fb1ffb640 1 -- 172.21.15.81:0/126351117 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0fb4074750 con 0x7f0fb415aa70 2024-09-17T05:26:13.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.443+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fb40cd8a0 con 0x7f0fb415aa70 2024-09-17T05:26:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.444+0000 7f0fb1ffb640 1 -- 172.21.15.81:0/126351117 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 95 v95) ==== 94+0+3917 (secure 0 0 0) 0x7f0fac083d20 con 0x7f0fb415aa70 2024-09-17T05:26:13.445 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:13.445 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":95,"btime":"2024-09-17T05:26:08:269559+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7184,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/3930078279","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":3930078279},{"type":"v1","addr":"172.21.15.160:6835","nonce":3930078279}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":95},{"gid":7618,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/2035889358","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2035889358},{"type":"v1","addr":"172.21.15.160:6834","nonce":2035889358}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89},{"gid":8838,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/3559863017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":3559863017},{"type":"v1","addr":"172.21.15.81:6834","nonce":3559863017}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":88},{"gid":8841,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3296945190","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3296945190},{"type":"v1","addr":"172.21.15.81:6835","nonce":3296945190}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":89}],"filesystems":[]} 2024-09-17T05:26:13.445 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 95 2024-09-17T05:26:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0fa00795b0 msgr2=0x7f0fa007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0fa00795b0 0x7f0fa007ba70 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f0fa4001da0 tx=0x7f0fa4009040 comp rx=0 tx=0).stop 2024-09-17T05:26:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb415aa70 msgr2=0x7f0fb40c9ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb415aa70 0x7f0fb40c9ca0 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f0fac0099c0 tx=0x7f0fac003910 comp rx=0 tx=0).stop 2024-09-17T05:26:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 shutdown_connections 2024-09-17T05:26:13.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0fb415aa70 0x7f0fb40c9ca0 unknown :-1 s=CLOSED pgs=1816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0fb40735a0 0x7f0fb4150830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0fa00795b0 0x7f0fa007ba70 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 --2- 172.21.15.81:0/126351117 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0fb406ff80 0x7f0fb41f5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 >> 172.21.15.81:0/126351117 conn(0x7f0fb40b1690 msgr2=0x7f0fb4157380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 shutdown_connections 2024-09-17T05:26:13.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.446+0000 7f0fbb8cd640 1 -- 172.21.15.81:0/126351117 wait complete. 2024-09-17T05:26:13.458 INFO:tasks.ceph.mds.a:Restarting daemon 2024-09-17T05:26:13.458 INFO:tasks.ceph.mds.a:Stopping old one... 2024-09-17T05:26:13.459 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:26:13.459 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:26:13.459 INFO:tasks.ceph.mds.c:Restarting daemon 2024-09-17T05:26:13.459 INFO:tasks.ceph.mds.c:Stopping old one... 2024-09-17T05:26:13.459 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:26:13.459 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:26:13.460 INFO:tasks.ceph.mds.b:Restarting daemon 2024-09-17T05:26:13.460 INFO:tasks.ceph.mds.b:Stopping old one... 2024-09-17T05:26:13.460 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:26:13.460 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:26:13.460 INFO:tasks.ceph.mds.d:Restarting daemon 2024-09-17T05:26:13.460 INFO:tasks.ceph.mds.d:Stopping old one... 2024-09-17T05:26:13.460 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:26:13.461 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:26:13.468 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:26:13.468 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-09-17T05:26:13.469 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:26:13.469 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-09-17T05:26:13.471 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:26:13.471 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-09-17T05:26:13.472 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:26:13.472 DEBUG:teuthology.orchestra.run.smithi160:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-09-17T05:26:13.510 INFO:tasks.ceph.mds.a:Started 2024-09-17T05:26:13.510 DEBUG:teuthology.parallel:result is None 2024-09-17T05:26:13.511 INFO:tasks.ceph.mds.c:Started 2024-09-17T05:26:13.511 DEBUG:teuthology.parallel:result is None 2024-09-17T05:26:13.514 INFO:tasks.ceph.mds.d:Started 2024-09-17T05:26:13.514 DEBUG:teuthology.parallel:result is None 2024-09-17T05:26:13.515 INFO:tasks.ceph.mds.b:Started 2024-09-17T05:26:13.515 DEBUG:teuthology.parallel:result is None 2024-09-17T05:26:13.515 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2024-09-17T05:26:13.585 INFO:tasks.ceph.mds.a.smithi081.stdout:starting mds.a at 2024-09-17T05:26:13.585 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:26:13.595 INFO:tasks.ceph.mds.d.smithi160.stdout:starting mds.d at 2024-09-17T05:26:13.596 INFO:tasks.ceph.mds.b.smithi160.stdout:starting mds.b at 2024-09-17T05:26:13.596 INFO:tasks.ceph.mds.b.smithi160.stderr:2024-09-17T05:26:13.595+0000 7f38b8f0a640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6834/0: (98) Address already in use 2024-09-17T05:26:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.620+0000 7fe5164fe640 1 -- 172.21.15.81:0/2203763979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80051c0 msgr2=0x7fe4f800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.620+0000 7fe5164fe640 1 --2- 172.21.15.81:0/2203763979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80051c0 0x7fe4f800b9c0 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fe50800c770 tx=0x7fe4f8005830 comp rx=0 tx=0).stop 2024-09-17T05:26:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.620+0000 7fe5164fe640 1 -- 172.21.15.81:0/2203763979 shutdown_connections 2024-09-17T05:26:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.620+0000 7fe5164fe640 1 --2- 172.21.15.81:0/2203763979 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe4f80051c0 0x7fe4f800b9c0 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.620+0000 7fe5164fe640 1 -- 172.21.15.81:0/2203763979 >> 172.21.15.81:0/2203763979 conn(0x7fe5100d3ea0 msgr2=0x7fe5100d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.620+0000 7fe5164fe640 1 -- 172.21.15.81:0/2203763979 shutdown_connections 2024-09-17T05:26:13.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.620+0000 7fe5164fe640 1 -- 172.21.15.81:0/2203763979 wait complete. 2024-09-17T05:26:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.622+0000 7fe5164fe640 1 Processor -- start 2024-09-17T05:26:13.623 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.622+0000 7fe5164fe640 1 -- start start 2024-09-17T05:26:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe5164fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4f80051c0 0x7fe51015a310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe5164fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe51015e570 0x7fe5101f5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe5164fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe51015e9f0 0x7fe51015bf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe51015e570 0x7fe5101f5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe5164fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe5100cf9b0 con 0x7fe51015e570 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe51015e570 0x7fe5101f5720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34024/0 (socket says 172.21.15.81:34024) 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 -- 172.21.15.81:0/1799699147 learned_addr learned my addr 172.21.15.81:0/1799699147 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe5101627a0 con 0x7fe4f80051c0 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe5100cfb30 con 0x7fe51015e9f0 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50ffff640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4f80051c0 0x7fe51015a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe514a9b640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe51015e9f0 0x7fe51015bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 -- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe51015e9f0 msgr2=0x7fe51015bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe51015e9f0 0x7fe51015bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 -- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4f80051c0 msgr2=0x7fe51015a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4f80051c0 0x7fe51015a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:13.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 -- 172.21.15.81:0/1799699147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe51015eec0 con 0x7fe51015e570 2024-09-17T05:26:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.623+0000 7fe50f7fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe51015e570 0x7fe5101f5720 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe504011ab0 tx=0x7fe504011f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.624+0000 7fe50cff9640 1 -- 172.21.15.81:0/1799699147 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe50401e070 con 0x7fe51015e570 2024-09-17T05:26:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.624+0000 7fe50cff9640 1 -- 172.21.15.81:0/1799699147 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe50400fc70 con 0x7fe51015e570 2024-09-17T05:26:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.624+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe510160910 con 0x7fe51015e570 2024-09-17T05:26:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.624+0000 7fe50cff9640 1 -- 172.21.15.81:0/1799699147 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe504004030 con 0x7fe51015e570 2024-09-17T05:26:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.624+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe510160ed0 con 0x7fe51015e570 2024-09-17T05:26:13.627 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.625+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5100d07a0 con 0x7fe51015e570 2024-09-17T05:26:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.625+0000 7fe50cff9640 1 -- 172.21.15.81:0/1799699147 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fe504021070 con 0x7fe51015e570 2024-09-17T05:26:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.626+0000 7fe50cff9640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe4fc0795b0 0x7fe4fc07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.626+0000 7fe50ffff640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe4fc0795b0 0x7fe4fc07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.626+0000 7fe50cff9640 1 -- 172.21.15.81:0/1799699147 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(154..154 src has 1..154) ==== 5015+0+0 (secure 0 0 0) 0x7fe504099fb0 con 0x7fe51015e570 2024-09-17T05:26:13.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.626+0000 7fe50ffff640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe4fc0795b0 0x7fe4fc07ba70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe500006fd0 tx=0x7fe500006b50 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:13.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.630+0000 7fe50cff9640 1 -- 172.21.15.81:0/1799699147 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe5040636c0 con 0x7fe51015e570 2024-09-17T05:26:13.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:13.817+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) -- 0x7fe51008d590 con 0x7fe51015e570 2024-09-17T05:26:14.298 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.297+0000 7fe50cff9640 1 -- 172.21.15.81:0/1799699147 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v156) ==== 97+0+0 (secure 0 0 0) 0x7fe5040680f0 con 0x7fe51015e570 2024-09-17T05:26:14.298 INFO:teuthology.orchestra.run.smithi081.stderr: removed all blocklist entries 2024-09-17T05:26:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe4fc0795b0 msgr2=0x7fe4fc07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe4fc0795b0 0x7fe4fc07ba70 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe500006fd0 tx=0x7fe500006b50 comp rx=0 tx=0).stop 2024-09-17T05:26:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe51015e570 msgr2=0x7fe5101f5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe51015e570 0x7fe5101f5720 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fe504011ab0 tx=0x7fe504011f70 comp rx=0 tx=0).stop 2024-09-17T05:26:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 shutdown_connections 2024-09-17T05:26:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe51015e9f0 0x7fe51015bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.301 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe51015e570 0x7fe5101f5720 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe4fc0795b0 0x7fe4fc07ba70 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 --2- 172.21.15.81:0/1799699147 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe4f80051c0 0x7fe51015a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 >> 172.21.15.81:0/1799699147 conn(0x7fe5100d3ea0 msgr2=0x7fe51006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 shutdown_connections 2024-09-17T05:26:14.302 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.300+0000 7fe5164fe640 1 -- 172.21.15.81:0/1799699147 wait complete. 2024-09-17T05:26:14.313 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2024-09-17T05:26:14.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 -- 172.21.15.81:0/1805773023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b3813f7d0 msgr2=0x7f5b3806f0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1805773023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b3813f7d0 0x7f5b3806f0f0 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7f5b380b4de0 tx=0x7f5b3002b9c0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 -- 172.21.15.81:0/1805773023 shutdown_connections 2024-09-17T05:26:14.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1805773023 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b3813f7d0 0x7f5b3806f0f0 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.415 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1805773023 >> v2:172.21.15.160:3300/0 conn(0x7f5b38072cb0 0x7f5b3813f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 -- 172.21.15.81:0/1805773023 >> 172.21.15.81:0/1805773023 conn(0x7f5b380b1690 msgr2=0x7f5b380b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 -- 172.21.15.81:0/1805773023 shutdown_connections 2024-09-17T05:26:14.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.414+0000 7f5b3f816640 1 -- 172.21.15.81:0/1805773023 wait complete. 2024-09-17T05:26:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.415+0000 7f5b3f816640 1 Processor -- start 2024-09-17T05:26:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.415+0000 7f5b3f816640 1 -- start start 2024-09-17T05:26:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3f816640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b38072cb0 0x7f5b38143320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3f816640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b3813ce00 0x7f5b381559d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3f816640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3813f7d0 0x7f5b38155f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.418 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3f816640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38070690 con 0x7f5b38072cb0 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3f816640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f5b38070810 con 0x7f5b3813f7d0 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3f816640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f5b3806f630 con 0x7f5b3813ce00 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b38072cb0 0x7f5b38143320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b38072cb0 0x7f5b38143320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34036/0 (socket says 172.21.15.81:34036) 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 -- 172.21.15.81:0/1166847276 learned_addr learned my addr 172.21.15.81:0/1166847276 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3ddb3640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3813f7d0 0x7f5b38155f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3cdb1640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b3813ce00 0x7f5b381559d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 -- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b3813ce00 msgr2=0x7f5b381559d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b3813ce00 0x7f5b381559d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 -- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3813f7d0 msgr2=0x7f5b38155f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3813f7d0 0x7f5b38155f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 -- 172.21.15.81:0/1166847276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b38143860 con 0x7f5b38072cb0 2024-09-17T05:26:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3cdb1640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b3813ce00 0x7f5b381559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3d5b2640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b38072cb0 0x7f5b38143320 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c500 tx=0x7f5b3400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b2dffb640 1 -- 172.21.15.81:0/1166847276 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34017070 con 0x7f5b38072cb0 2024-09-17T05:26:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b2dffb640 1 -- 172.21.15.81:0/1166847276 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f5b340035f0 con 0x7f5b38072cb0 2024-09-17T05:26:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b380cdfd0 con 0x7f5b38072cb0 2024-09-17T05:26:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.416+0000 7f5b2dffb640 1 -- 172.21.15.81:0/1166847276 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b34003a40 con 0x7f5b38072cb0 2024-09-17T05:26:14.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.417+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b380ce270 con 0x7f5b38072cb0 2024-09-17T05:26:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.418+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5b3813f290 con 0x7f5b38072cb0 2024-09-17T05:26:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.418+0000 7f5b2dffb640 1 -- 172.21.15.81:0/1166847276 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f5b3401a070 con 0x7f5b38072cb0 2024-09-17T05:26:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.419+0000 7f5b2dffb640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5b1c0795b0 0x7f5b1c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.419+0000 7f5b2dffb640 1 -- 172.21.15.81:0/1166847276 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4929+0+0 (secure 0 0 0) 0x7f5b34098d50 con 0x7f5b38072cb0 2024-09-17T05:26:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.419+0000 7f5b3cdb1640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5b1c0795b0 0x7f5b1c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.421 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.419+0000 7f5b3cdb1640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5b1c0795b0 0x7f5b1c07ba70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006fd0 tx=0x7f5b28008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:14.424 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.423+0000 7f5b2dffb640 1 -- 172.21.15.81:0/1166847276 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f5b34062ab0 con 0x7f5b38072cb0 2024-09-17T05:26:14.667 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.666+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) -- 0x7f5b381595d0 con 0x7f5b38072cb0 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.667+0000 7f5b2dffb640 1 -- 172.21.15.81:0/1166847276 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v26) ==== 80+0+5304 (secure 0 0 0) 0x7f5b340623b0 con 0x7f5b38072cb0 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "auth_dump": [ 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.a", 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm2vDBKBAA/icuzB/52Vrt7ZikGK2pcw==", 2024-09-17T05:26:14.668 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.b", 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmzOJ3NBAAxN/S4Y+5JXEJckWZ381IVg==", 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.669 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.671 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.c", 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmkjjKLxAAQNxuFL+duNv6WBSTCw5axQ==", 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:26:14.672 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mds.d", 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlm9keKOxAAlyo7ryQuDyrF1lhYv2yGNA==", 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:26:14.673 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.0", 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD+EOlmjz18HRAAtVpPmORs9TRgPqyGRYtE4A==", 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.674 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.1", 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQABEelma2AoHxAAjWZutGo7sYkjwo9kHDrJlw==", 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.2", 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAFEelmqbv+ERAADG5N0dcC/K/itc3oq7Uwxw==", 2024-09-17T05:26:14.675 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.3", 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAIEelmKKT1IRAAnpc2Btu7dxn4YFmaI9TYuA==", 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.676 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.4", 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAPEelmlU0dAxAA7Nah/djhtyDAGbF0wZg6TQ==", 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.677 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.5", 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQASEelmHLjbEhAA2YghRS+6llqeNchDTA5vCQ==", 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.6", 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAVEelm6KcGIxAA9hBkytAexc0O8+CpvXrtNg==", 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.678 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "osd.7", 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQAYEelmC6MDNBAAOmStzAFv82j9Stq/Q95cXQ==", 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow profile osd", 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile osd", 2024-09-17T05:26:14.679 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.0", 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A==", 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow r", 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rw tag cephfs data=cephfs" 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.680 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.1", 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlm7dC9DBAA7erzkkjYItiYrBLMuWOrSA==", 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.2", 2024-09-17T05:26:14.681 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmLV2ICRAAYCgEU62NSm+pBiLko4KoTg==", 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.3", 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD7EOlmsRlHEhAANuqJFjxSLeKVyOQ3D3WdHA==", 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.682 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow", 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow r", 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow rw", 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow rwx" 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "client.admin", 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmcmCgDBAA+4HUXyLfMNCKyK8zVqV+Nw==", 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mgr": "allow *", 2024-09-17T05:26:14.683 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow *", 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.x", 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmjiiMJRAAojypYI3wsUtwAvPgm90mHQ==", 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:14.684 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "entity": "mgr.y", 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "key": "AQD6EOlmFl0jIRAAWXcyGGwifXO6WnmkHKbs9Q==", 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "caps": { 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mds": "allow *", 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "mon": "allow profile mgr", 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: "osd": "allow *" 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout: ] 2024-09-17T05:26:14.685 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5b1c0795b0 msgr2=0x7f5b1c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5b1c0795b0 0x7f5b1c07ba70 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f5b28006fd0 tx=0x7f5b28008040 comp rx=0 tx=0).stop 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b38072cb0 msgr2=0x7f5b38143320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b38072cb0 0x7f5b38143320 secure :-1 s=READY pgs=1827 cs=0 l=1 rev1=1 crypto rx=0x7f5b3400c500 tx=0x7f5b3400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 shutdown_connections 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f5b1c0795b0 0x7f5b1c07ba70 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f5b3813f7d0 0x7f5b38155f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f5b3813ce00 0x7f5b381559d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 --2- 172.21.15.81:0/1166847276 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f5b38072cb0 0x7f5b38143320 unknown :-1 s=CLOSED pgs=1827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 >> 172.21.15.81:0/1166847276 conn(0x7f5b380b1690 msgr2=0x7f5b3813e170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 shutdown_connections 2024-09-17T05:26:14.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.669+0000 7f5b3f816640 1 -- 172.21.15.81:0/1166847276 wait complete. 2024-09-17T05:26:14.688 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-09-17T05:26:14.790 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.789+0000 7f83aed9f640 1 -- 172.21.15.81:0/4267968527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 msgr2=0x7f83940051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.789+0000 7f83aed9f640 1 --2- 172.21.15.81:0/4267968527 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 0x7f83940051c0 secure :-1 s=READY pgs=1829 cs=0 l=1 rev1=1 crypto rx=0x7f83a0009e20 tx=0x7f8394005830 comp rx=0 tx=0).stop 2024-09-17T05:26:14.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.789+0000 7f83ae59e640 1 -- 172.21.15.81:0/4267968527 reap_dead start 2024-09-17T05:26:14.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.789+0000 7f83aed9f640 1 -- 172.21.15.81:0/4267968527 shutdown_connections 2024-09-17T05:26:14.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.789+0000 7f83aed9f640 1 -- 172.21.15.81:0/4267968527 >> 172.21.15.81:0/4267968527 conn(0x7f83a80d3d30 msgr2=0x7f83a80d4140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:14.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.789+0000 7f83aed9f640 1 -- 172.21.15.81:0/4267968527 shutdown_connections 2024-09-17T05:26:14.791 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.789+0000 7f83aed9f640 1 -- 172.21.15.81:0/4267968527 wait complete. 2024-09-17T05:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.790+0000 7f83aed9f640 1 Processor -- start 2024-09-17T05:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.790+0000 7f83aed9f640 1 -- start start 2024-09-17T05:26:14.793 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83aed9f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 0x7f83a80cd030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83aed9f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a80cbdd0 0x7f83a80cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83aed9f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a80b6b60 0x7f83a80b6fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83aed9f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80d2280 con 0x7f8394004d40 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83aed9f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f83a80d4b80 con 0x7f83a80b6b60 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83aed9f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f83a80d2400 con 0x7f83a80cbdd0 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83add9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 0x7f83a80cd030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83add9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 0x7f83a80cd030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34056/0 (socket says 172.21.15.81:34056) 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83add9d640 1 -- 172.21.15.81:0/1921638177 learned_addr learned my addr 172.21.15.81:0/1921638177 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83ae59e640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a80b6b60 0x7f83a80b6fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.791+0000 7f83ad59c640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a80cbdd0 0x7f83a80cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83add9d640 1 -- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a80cbdd0 msgr2=0x7f83a80cc230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.794 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83add9d640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a80cbdd0 0x7f83a80cc230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83add9d640 1 -- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a80b6b60 msgr2=0x7f83a80b6fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83add9d640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a80b6b60 0x7f83a80b6fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83add9d640 1 -- 172.21.15.81:0/1921638177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f83a80cb010 con 0x7f8394004d40 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83ad59c640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a80cbdd0 0x7f83a80cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83add9d640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 0x7f83a80cd030 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e690 tx=0x7f83a400eb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921638177 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a4015070 con 0x7f8394004d40 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921638177 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f83a4004310 con 0x7f8394004d40 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f83a80cb2f0 con 0x7f8394004d40 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921638177 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83a400caa0 con 0x7f8394004d40 2024-09-17T05:26:14.795 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.792+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f83a80cb8b0 con 0x7f8394004d40 2024-09-17T05:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.793+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f83a80b3430 con 0x7f8394004d40 2024-09-17T05:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.793+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921638177 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f83a400cc40 con 0x7f8394004d40 2024-09-17T05:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.794+0000 7f839e7fc640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f838c0795b0 0x7f838c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.794+0000 7f83ad59c640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f838c0795b0 0x7f838c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:14.796 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.795+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921638177 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4929+0+0 (secure 0 0 0) 0x7f83a4099c60 con 0x7f8394004d40 2024-09-17T05:26:14.797 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.795+0000 7f83ad59c640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f838c0795b0 0x7f838c07ba70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f83a80ca980 tx=0x7f839800b260 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:14.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.799+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921638177 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f83a4063a80 con 0x7f8394004d40 2024-09-17T05:26:14.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.976+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f83a80cba80 con 0x7f8394004d40 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.977+0000 7f839e7fc640 1 -- 172.21.15.81:0/1921638177 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v158) ==== 84+0+65 (secure 0 0 0) 0x7f83a4063380 con 0x7f8394004d40 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: "poolnum": 1, 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: "poolname": ".mgr" 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:14.978 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:26:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f838c0795b0 msgr2=0x7f838c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f838c0795b0 0x7f838c07ba70 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f83a80ca980 tx=0x7f839800b260 comp rx=0 tx=0).stop 2024-09-17T05:26:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 msgr2=0x7f83a80cd030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 0x7f83a80cd030 secure :-1 s=READY pgs=1830 cs=0 l=1 rev1=1 crypto rx=0x7f83a400e690 tx=0x7f83a400eb50 comp rx=0 tx=0).stop 2024-09-17T05:26:14.980 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 shutdown_connections 2024-09-17T05:26:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f838c0795b0 0x7f838c07ba70 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f83a80b6b60 0x7f83a80b6fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f83a80cbdd0 0x7f83a80cc230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 --2- 172.21.15.81:0/1921638177 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8394004d40 0x7f83a80cd030 unknown :-1 s=CLOSED pgs=1830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 >> 172.21.15.81:0/1921638177 conn(0x7f83a80d3d30 msgr2=0x7f83a815d310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 shutdown_connections 2024-09-17T05:26:14.981 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:14.979+0000 7f83aed9f640 1 -- 172.21.15.81:0/1921638177 wait complete. 2024-09-17T05:26:14.991 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-17T05:26:14.991 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-17T05:26:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 -- 172.21.15.81:0/3501694022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba240ae600 msgr2=0x7fba240cf3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 --2- 172.21.15.81:0/3501694022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba240ae600 0x7fba240cf3c0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7fba24074dd0 tx=0x7fba0c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 -- 172.21.15.81:0/3501694022 shutdown_connections 2024-09-17T05:26:15.097 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 --2- 172.21.15.81:0/3501694022 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba240aeb50 0x7fba2415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 --2- 172.21.15.81:0/3501694022 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba240ae600 0x7fba240cf3c0 unknown :-1 s=CLOSED pgs=1831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 --2- 172.21.15.81:0/3501694022 >> v2:172.21.15.160:3300/0 conn(0x7fba2415a220 0x7fba240cee80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 -- 172.21.15.81:0/3501694022 >> 172.21.15.81:0/3501694022 conn(0x7fba240b1620 msgr2=0x7fba240b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 -- 172.21.15.81:0/3501694022 shutdown_connections 2024-09-17T05:26:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.096+0000 7fba28f94640 1 -- 172.21.15.81:0/3501694022 wait complete. 2024-09-17T05:26:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.097+0000 7fba28f94640 1 Processor -- start 2024-09-17T05:26:15.098 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.097+0000 7fba28f94640 1 -- start start 2024-09-17T05:26:15.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba28f94640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba240ae600 0x7fba24145640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba28f94640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba240aeb50 0x7fba24154660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba28f94640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba2415a220 0x7fba241e4830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba28f94640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fba2406e660 con 0x7fba2415a220 2024-09-17T05:26:15.100 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba28f94640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fba2406e4e0 con 0x7fba240ae600 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba28f94640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fba2406e7e0 con 0x7fba240aeb50 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba22d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba2415a220 0x7fba241e4830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba22d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba2415a220 0x7fba241e4830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34070/0 (socket says 172.21.15.81:34070) 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba22d9d640 1 -- 172.21.15.81:0/1453608485 learned_addr learned my addr 172.21.15.81:0/1453608485 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba21d9b640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba240aeb50 0x7fba24154660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba2259c640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba240ae600 0x7fba24145640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba22d9d640 1 -- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba240aeb50 msgr2=0x7fba24154660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba22d9d640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba240aeb50 0x7fba24154660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba22d9d640 1 -- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba240ae600 msgr2=0x7fba24145640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.098+0000 7fba22d9d640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba240ae600 0x7fba24145640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba22d9d640 1 -- 172.21.15.81:0/1453608485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba241582c0 con 0x7fba2415a220 2024-09-17T05:26:15.101 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba2259c640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba240ae600 0x7fba24145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:15.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba22d9d640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba2415a220 0x7fba241e4830 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fba1400eaa0 tx=0x7fba1400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:15.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba1affd640 1 -- 172.21.15.81:0/1453608485 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba1400cdb0 con 0x7fba2415a220 2024-09-17T05:26:15.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba1affd640 1 -- 172.21.15.81:0/1453608485 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fba14004c10 con 0x7fba2415a220 2024-09-17T05:26:15.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba24158560 con 0x7fba2415a220 2024-09-17T05:26:15.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba1affd640 1 -- 172.21.15.81:0/1453608485 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fba14005020 con 0x7fba2415a220 2024-09-17T05:26:15.102 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.099+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba24158b20 con 0x7fba2415a220 2024-09-17T05:26:15.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.100+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba240cee80 con 0x7fba2415a220 2024-09-17T05:26:15.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.101+0000 7fba1affd640 1 -- 172.21.15.81:0/1453608485 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fba140051c0 con 0x7fba2415a220 2024-09-17T05:26:15.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.101+0000 7fba1affd640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fba040795b0 0x7fba0407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.101+0000 7fba2259c640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fba040795b0 0x7fba0407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.101+0000 7fba1affd640 1 -- 172.21.15.81:0/1453608485 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(158..158 src has 1..158) ==== 4929+0+0 (secure 0 0 0) 0x7fba1409a110 con 0x7fba2415a220 2024-09-17T05:26:15.103 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.102+0000 7fba2259c640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fba040795b0 0x7fba0407ba70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fba1c005fd0 tx=0x7fba1c005d10 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:15.106 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.106+0000 7fba1affd640 1 -- 172.21.15.81:0/1453608485 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fba14016030 con 0x7fba2415a220 2024-09-17T05:26:15.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.283+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fba240b1e10 con 0x7fba2415a220 2024-09-17T05:26:15.308 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.307+0000 7fba1affd640 1 -- 172.21.15.81:0/1453608485 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v159) ==== 138+0+0 (secure 0 0 0) 0x7fba14063820 con 0x7fba2415a220 2024-09-17T05:26:15.309 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' created 2024-09-17T05:26:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fba040795b0 msgr2=0x7fba0407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fba040795b0 0x7fba0407ba70 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fba1c005fd0 tx=0x7fba1c005d10 comp rx=0 tx=0).stop 2024-09-17T05:26:15.312 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba2415a220 msgr2=0x7fba241e4830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba2415a220 0x7fba241e4830 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7fba1400eaa0 tx=0x7fba1400ef60 comp rx=0 tx=0).stop 2024-09-17T05:26:15.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 shutdown_connections 2024-09-17T05:26:15.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fba2415a220 0x7fba241e4830 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fba240aeb50 0x7fba24154660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fba040795b0 0x7fba0407ba70 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.311+0000 7fba28f94640 1 --2- 172.21.15.81:0/1453608485 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fba240ae600 0x7fba24145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.313 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.312+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 >> 172.21.15.81:0/1453608485 conn(0x7fba240b1620 msgr2=0x7fba240ad8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:15.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.313+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 shutdown_connections 2024-09-17T05:26:15.314 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.313+0000 7fba28f94640 1 -- 172.21.15.81:0/1453608485 wait complete. 2024-09-17T05:26:15.326 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-17T05:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.433+0000 7f4c515a0640 1 -- 172.21.15.81:0/2436105442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 msgr2=0x7f4c4c0d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.433+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2436105442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c0d1d30 secure :-1 s=READY pgs=1833 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c0b69d0 tx=0x7f4c3c02a4f0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.433+0000 7f4c515a0640 1 -- 172.21.15.81:0/2436105442 shutdown_connections 2024-09-17T05:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.433+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2436105442 >> v2:172.21.15.160:3300/0 conn(0x7f4c4c0d01b0 0x7f4c4c0d2270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.433+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2436105442 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c0d1d30 unknown :-1 s=CLOSED pgs=1833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.433+0000 7f4c515a0640 1 -- 172.21.15.81:0/2436105442 >> 172.21.15.81:0/2436105442 conn(0x7f4c4c0d3e30 msgr2=0x7f4c4c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:15.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.434+0000 7f4c515a0640 1 -- 172.21.15.81:0/2436105442 shutdown_connections 2024-09-17T05:26:15.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.434+0000 7f4c515a0640 1 -- 172.21.15.81:0/2436105442 wait complete. 2024-09-17T05:26:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.435+0000 7f4c515a0640 1 Processor -- start 2024-09-17T05:26:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.435+0000 7f4c515a0640 1 -- start start 2024-09-17T05:26:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c4c0d01b0 0x7f4c4c0c9d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c4c0d27b0 0x7f4c4c150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c1540c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.438 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d0f50 con 0x7f4c4c1617f0 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4c4c0b5000 con 0x7f4c4c0d27b0 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4c4c0d10d0 con 0x7f4c4c0d01b0 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c1540c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c1540c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34080/0 (socket says 172.21.15.81:34080) 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 -- 172.21.15.81:0/2296527607 learned_addr learned my addr 172.21.15.81:0/2296527607 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4a7fc640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c4c0d27b0 0x7f4c4c150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4affd640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c4c0d01b0 0x7f4c4c0c9d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 -- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c4c0d01b0 msgr2=0x7f4c4c0c9d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c4c0d01b0 0x7f4c4c0c9d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 -- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c4c0d27b0 msgr2=0x7f4c4c150e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c4c0d27b0 0x7f4c4c150e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 -- 172.21.15.81:0/2296527607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c4c0c8c70 con 0x7f4c4c1617f0 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c4b7fe640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c1540c0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c780 tx=0x7f4c4400cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c337fe640 1 -- 172.21.15.81:0/2296527607 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c44017070 con 0x7f4c4c1617f0 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c337fe640 1 -- 172.21.15.81:0/2296527607 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4c44003c60 con 0x7f4c4c1617f0 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c337fe640 1 -- 172.21.15.81:0/2296527607 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c440052d0 con 0x7f4c4c1617f0 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c4c0c8f50 con 0x7f4c4c1617f0 2024-09-17T05:26:15.440 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.436+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c4c0c9510 con 0x7f4c4c1617f0 2024-09-17T05:26:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.438+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4c4c0d0840 con 0x7f4c4c1617f0 2024-09-17T05:26:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.438+0000 7f4c337fe640 1 -- 172.21.15.81:0/2296527607 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f4c4401a070 con 0x7f4c4c1617f0 2024-09-17T05:26:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.439+0000 7f4c337fe640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4c380795b0 0x7f4c3807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.439+0000 7f4c4affd640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4c380795b0 0x7f4c3807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.439+0000 7f4c337fe640 1 -- 172.21.15.81:0/2296527607 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(159..159 src has 1..159) ==== 5299+0+0 (secure 0 0 0) 0x7f4c44098d60 con 0x7f4c4c1617f0 2024-09-17T05:26:15.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.439+0000 7f4c4affd640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4c380795b0 0x7f4c3807ba70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c033000 tx=0x7f4c3c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:15.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.443+0000 7f4c337fe640 1 -- 172.21.15.81:0/2296527607 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4c44062470 con 0x7f4c4c1617f0 2024-09-17T05:26:15.622 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:15.621+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f4c4c0b3570 con 0x7f4c4c1617f0 2024-09-17T05:26:16.115 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:26:16.117 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:26:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.317+0000 7f4c337fe640 1 -- 172.21.15.81:0/2296527607 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v160) ==== 170+0+0 (secure 0 0 0) 0x7f4c44066ea0 con 0x7f4c4c1617f0 2024-09-17T05:26:16.318 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' created 2024-09-17T05:26:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4c380795b0 msgr2=0x7f4c3807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4c380795b0 0x7f4c3807ba70 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f4c3c033000 tx=0x7f4c3c004730 comp rx=0 tx=0).stop 2024-09-17T05:26:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 msgr2=0x7f4c4c1540c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c1540c0 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400c780 tx=0x7f4c4400cb80 comp rx=0 tx=0).stop 2024-09-17T05:26:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 shutdown_connections 2024-09-17T05:26:16.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4c4c1617f0 0x7f4c4c1540c0 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4c380795b0 0x7f4c3807ba70 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4c4c0d27b0 0x7f4c4c150e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 --2- 172.21.15.81:0/2296527607 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4c4c0d01b0 0x7f4c4c0c9d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 >> 172.21.15.81:0/2296527607 conn(0x7f4c4c0d3e30 msgr2=0x7f4c4c06d220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 shutdown_connections 2024-09-17T05:26:16.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.320+0000 7f4c515a0640 1 -- 172.21.15.81:0/2296527607 wait complete. 2024-09-17T05:26:16.347 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-17T05:26:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 -- 172.21.15.81:0/4050508121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd050151e30 msgr2=0x7fd05006fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 --2- 172.21.15.81:0/4050508121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd050151e30 0x7fd05006fb90 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fd0500cd200 tx=0x7fd04002aac0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 -- 172.21.15.81:0/4050508121 shutdown_connections 2024-09-17T05:26:16.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 --2- 172.21.15.81:0/4050508121 >> v2:172.21.15.160:3300/0 conn(0x7fd0500cc540 0x7fd0500cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 --2- 172.21.15.81:0/4050508121 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd050151e30 0x7fd05006fb90 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 -- 172.21.15.81:0/4050508121 >> 172.21.15.81:0/4050508121 conn(0x7fd0500b1700 msgr2=0x7fd0500b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 -- 172.21.15.81:0/4050508121 shutdown_connections 2024-09-17T05:26:16.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.451+0000 7fd054c16640 1 -- 172.21.15.81:0/4050508121 wait complete. 2024-09-17T05:26:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.452+0000 7fd054c16640 1 Processor -- start 2024-09-17T05:26:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.452+0000 7fd054c16640 1 -- start start 2024-09-17T05:26:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd054c16640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0500cc540 0x7fd05014fe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:16.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd054c16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd050151e30 0x7fd0501f3350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd054c16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd05015b3d0 0x7fd0501f3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd054c16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500cb050 con 0x7fd05015b3d0 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd054c16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd0500caed0 con 0x7fd050151e30 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd054c16640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd0500cb1d0 con 0x7fd0500cc540 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd05015b3d0 0x7fd0501f3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd05015b3d0 0x7fd0501f3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34096/0 (socket says 172.21.15.81:34096) 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 -- 172.21.15.81:0/2453338458 learned_addr learned my addr 172.21.15.81:0/2453338458 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04dd9b640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd050151e30 0x7fd0501f3350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04e59c640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0500cc540 0x7fd05014fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:16.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 -- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0500cc540 msgr2=0x7fd05014fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0500cc540 0x7fd05014fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 -- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd050151e30 msgr2=0x7fd0501f3350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd050151e30 0x7fd0501f3350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 -- 172.21.15.81:0/2453338458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0500c75b0 con 0x7fd05015b3d0 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd04ed9d640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd05015b3d0 0x7fd0501f3de0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd04800c3c0 tx=0x7fd04800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.453+0000 7fd03effd640 1 -- 172.21.15.81:0/2453338458 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048017070 con 0x7fd05015b3d0 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.454+0000 7fd03effd640 1 -- 172.21.15.81:0/2453338458 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd0480053c0 con 0x7fd05015b3d0 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.454+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0500c7890 con 0x7fd05015b3d0 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.454+0000 7fd03effd640 1 -- 172.21.15.81:0/2453338458 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd048003850 con 0x7fd05015b3d0 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.454+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd050158570 con 0x7fd05015b3d0 2024-09-17T05:26:16.457 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.454+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0501f2c20 con 0x7fd05015b3d0 2024-09-17T05:26:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.455+0000 7fd03effd640 1 -- 172.21.15.81:0/2453338458 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fd04801a070 con 0x7fd05015b3d0 2024-09-17T05:26:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.456+0000 7fd03effd640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0300795b0 0x7fd03007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.456+0000 7fd04e59c640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0300795b0 0x7fd03007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:16.458 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.456+0000 7fd03effd640 1 -- 172.21.15.81:0/2453338458 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(160..160 src has 1..160) ==== 5681+0+0 (secure 0 0 0) 0x7fd0480989c0 con 0x7fd05015b3d0 2024-09-17T05:26:16.459 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.456+0000 7fd04e59c640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0300795b0 0x7fd03007ba70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd040035000 tx=0x7fd040038040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:16.461 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.460+0000 7fd03effd640 1 -- 172.21.15.81:0/2453338458 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd0480620d0 con 0x7fd05015b3d0 2024-09-17T05:26:16.673 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:16.672+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fd0500cb680 con 0x7fd05015b3d0 2024-09-17T05:26:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.320+0000 7fd03effd640 1 -- 172.21.15.81:0/2453338458 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 26 and data pool 27 v98) ==== 174+0+0 (secure 0 0 0) 0x7fd048066b00 con 0x7fd05015b3d0 2024-09-17T05:26:17.322 INFO:teuthology.orchestra.run.smithi081.stderr:new fs with metadata pool 26 and data pool 27 2024-09-17T05:26:17.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0300795b0 msgr2=0x7fd03007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0300795b0 0x7fd03007ba70 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fd040035000 tx=0x7fd040038040 comp rx=0 tx=0).stop 2024-09-17T05:26:17.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd05015b3d0 msgr2=0x7fd0501f3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd05015b3d0 0x7fd0501f3de0 secure :-1 s=READY pgs=1836 cs=0 l=1 rev1=1 crypto rx=0x7fd04800c3c0 tx=0x7fd04800c880 comp rx=0 tx=0).stop 2024-09-17T05:26:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 shutdown_connections 2024-09-17T05:26:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd05015b3d0 0x7fd0501f3de0 unknown :-1 s=CLOSED pgs=1836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd0300795b0 0x7fd03007ba70 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd050151e30 0x7fd0501f3350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 --2- 172.21.15.81:0/2453338458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd0500cc540 0x7fd05014fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.328+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 >> 172.21.15.81:0/2453338458 conn(0x7fd0500b1700 msgr2=0x7fd0500cdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.329+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 shutdown_connections 2024-09-17T05:26:17.331 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.329+0000 7fd054c16640 1 -- 172.21.15.81:0/2453338458 wait complete. 2024-09-17T05:26:17.346 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.447+0000 7fc8cebad640 1 -- 172.21.15.81:0/3145153638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 msgr2=0x7fc8c815d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.447+0000 7fc8cebad640 1 --2- 172.21.15.81:0/3145153638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c815d270 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8009830 tx=0x7fc8b802a510 comp rx=0 tx=0).stop 2024-09-17T05:26:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.447+0000 7fc8cebad640 1 -- 172.21.15.81:0/3145153638 shutdown_connections 2024-09-17T05:26:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.447+0000 7fc8cebad640 1 --2- 172.21.15.81:0/3145153638 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c815d270 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.447+0000 7fc8cebad640 1 -- 172.21.15.81:0/3145153638 >> 172.21.15.81:0/3145153638 conn(0x7fc8c80b1690 msgr2=0x7fc8c80b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.447+0000 7fc8cebad640 1 -- 172.21.15.81:0/3145153638 shutdown_connections 2024-09-17T05:26:17.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.447+0000 7fc8cebad640 1 -- 172.21.15.81:0/3145153638 wait complete. 2024-09-17T05:26:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.448+0000 7fc8cebad640 1 Processor -- start 2024-09-17T05:26:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.448+0000 7fc8cebad640 1 -- start start 2024-09-17T05:26:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8c80cc490 0x7fc8c80aed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c80af600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8c815fe60 0x7fc8c80afb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c80cca80 con 0x7fc8c8159680 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc8c80cc900 con 0x7fc8c815fe60 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc8c80ccc00 con 0x7fc8c80cc490 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c80af600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c80af600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34122/0 (socket says 172.21.15.81:34122) 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 -- 172.21.15.81:0/482589123 learned_addr learned my addr 172.21.15.81:0/482589123 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cd14a640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8c815fe60 0x7fc8c80afb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cc949640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8c80cc490 0x7fc8c80aed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 -- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8c80cc490 msgr2=0x7fc8c80aed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8c80cc490 0x7fc8c80aed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 -- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8c815fe60 msgr2=0x7fc8c80afb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8c815fe60 0x7fc8c80afb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 -- 172.21.15.81:0/482589123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8c8144030 con 0x7fc8c8159680 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cd14a640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8c815fe60 0x7fc8c80afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cc949640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8c80cc490 0x7fc8c80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c7fff640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c80af600 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c500 tx=0x7fc8bc00c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c57fa640 1 -- 172.21.15.81:0/482589123 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc017070 con 0x7fc8c8159680 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c57fa640 1 -- 172.21.15.81:0/482589123 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc8bc0035f0 con 0x7fc8c8159680 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc8c8146d10 con 0x7fc8c8159680 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8c57fa640 1 -- 172.21.15.81:0/482589123 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8bc003a40 con 0x7fc8c8159680 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.449+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8c80a98a0 con 0x7fc8c8159680 2024-09-17T05:26:17.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.450+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc8c81f2860 con 0x7fc8c8159680 2024-09-17T05:26:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.451+0000 7fc8c57fa640 1 -- 172.21.15.81:0/482589123 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fc8bc01a070 con 0x7fc8c8159680 2024-09-17T05:26:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.451+0000 7fc8c57fa640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc8b40795b0 0x7fc8b407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.454 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.451+0000 7fc8c57fa640 1 -- 172.21.15.81:0/482589123 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5781+0+0 (secure 0 0 0) 0x7fc8bc098cf0 con 0x7fc8c8159680 2024-09-17T05:26:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.451+0000 7fc8cc949640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc8b40795b0 0x7fc8b407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.455 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.452+0000 7fc8cc949640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc8b40795b0 0x7fc8b407ba70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8034000 tx=0x7fc8b8004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:17.456 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.456+0000 7fc8c57fa640 1 -- 172.21.15.81:0/482589123 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc8bc062a50 con 0x7fc8c8159680 2024-09-17T05:26:17.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.633+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fc8c80cf390 con 0x7fc8c8159680 2024-09-17T05:26:17.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.634+0000 7fc8c57fa640 1 -- 172.21.15.81:0/482589123 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) ==== 74+0+16868 (secure 0 0 0) 0x7fc8bc062350 con 0x7fc8c8159680 2024-09-17T05:26:17.635 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:17.635 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":161,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:26:16.673576+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:26:15.288741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:26:15.626241+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:17.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc8b40795b0 msgr2=0x7fc8b407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc8b40795b0 0x7fc8b407ba70 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fc8b8034000 tx=0x7fc8b8004730 comp rx=0 tx=0).stop 2024-09-17T05:26:17.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 msgr2=0x7fc8c80af600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c80af600 secure :-1 s=READY pgs=1839 cs=0 l=1 rev1=1 crypto rx=0x7fc8bc00c500 tx=0x7fc8bc00c9c0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 shutdown_connections 2024-09-17T05:26:17.637 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc8b40795b0 0x7fc8b407ba70 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc8c815fe60 0x7fc8c80afb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc8c8159680 0x7fc8c80af600 unknown :-1 s=CLOSED pgs=1839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 --2- 172.21.15.81:0/482589123 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc8c80cc490 0x7fc8c80aed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 >> 172.21.15.81:0/482589123 conn(0x7fc8c80b1690 msgr2=0x7fc8c8158920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 shutdown_connections 2024-09-17T05:26:17.638 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.636+0000 7fc8cebad640 1 -- 172.21.15.81:0/482589123 wait complete. 2024-09-17T05:26:17.648 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 -- 172.21.15.81:0/395946799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0d02c0 msgr2=0x7fb31c0d0750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 --2- 172.21.15.81:0/395946799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0d02c0 0x7fb31c0d0750 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0cc3b0 tx=0x7fb30402a530 comp rx=0 tx=0).stop 2024-09-17T05:26:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 -- 172.21.15.81:0/395946799 shutdown_connections 2024-09-17T05:26:17.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 --2- 172.21.15.81:0/395946799 >> v2:172.21.15.160:3300/0 conn(0x7fb31c15f510 0x7fb31c0d2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 --2- 172.21.15.81:0/395946799 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c0d02c0 0x7fb31c0d0750 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 -- 172.21.15.81:0/395946799 >> 172.21.15.81:0/395946799 conn(0x7fb31c0d1b30 msgr2=0x7fb31c0d1f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 -- 172.21.15.81:0/395946799 shutdown_connections 2024-09-17T05:26:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.749+0000 7fb31bfff640 1 -- 172.21.15.81:0/395946799 wait complete. 2024-09-17T05:26:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.750+0000 7fb31bfff640 1 Processor -- start 2024-09-17T05:26:17.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.750+0000 7fb31bfff640 1 -- start start 2024-09-17T05:26:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c0d02c0 0x7fb31c1f2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c15f130 0x7fb31c1f1c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31bfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c15f510 0x7fb31c159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31bfff640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c0b5820 con 0x7fb31c15f510 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31bfff640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb31c0b56a0 con 0x7fb31c15f130 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31bfff640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb31c0b59a0 con 0x7fb31c0d02c0 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c15f510 0x7fb31c159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c15f510 0x7fb31c159160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34150/0 (socket says 172.21.15.81:34150) 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31b7fe640 1 -- 172.21.15.81:0/4026277887 learned_addr learned my addr 172.21.15.81:0/4026277887 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31affd640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c0d02c0 0x7fb31c1f2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.751+0000 7fb31a7fc640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c15f130 0x7fb31c1f1c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31b7fe640 1 -- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c0d02c0 msgr2=0x7fb31c1f2f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31b7fe640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c0d02c0 0x7fb31c1f2f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31b7fe640 1 -- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c15f130 msgr2=0x7fb31c1f1c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31b7fe640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c15f130 0x7fb31c1f1c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31b7fe640 1 -- 172.21.15.81:0/4026277887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31c1f3440 con 0x7fb31c15f510 2024-09-17T05:26:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31b7fe640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c15f510 0x7fb31c159160 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fb31400d660 tx=0x7fb31400db20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb313fff640 1 -- 172.21.15.81:0/4026277887 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314017070 con 0x7fb31c15f510 2024-09-17T05:26:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb313fff640 1 -- 172.21.15.81:0/4026277887 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb314005310 con 0x7fb31c15f510 2024-09-17T05:26:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb313fff640 1 -- 172.21.15.81:0/4026277887 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb314009820 con 0x7fb31c15f510 2024-09-17T05:26:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31c15b850 con 0x7fb31c15f510 2024-09-17T05:26:17.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.752+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb31c15aa90 con 0x7fb31c15f510 2024-09-17T05:26:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.753+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb31c0d0750 con 0x7fb31c15f510 2024-09-17T05:26:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.754+0000 7fb313fff640 1 -- 172.21.15.81:0/4026277887 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fb3140099c0 con 0x7fb31c15f510 2024-09-17T05:26:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.754+0000 7fb313fff640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2fc0795b0 0x7fb2fc07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.754+0000 7fb313fff640 1 -- 172.21.15.81:0/4026277887 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5781+0+0 (secure 0 0 0) 0x7fb3140997c0 con 0x7fb31c15f510 2024-09-17T05:26:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.754+0000 7fb31affd640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2fc0795b0 0x7fb2fc07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:17.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.755+0000 7fb31affd640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2fc0795b0 0x7fb2fc07ba70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0012e0 tx=0x7fb30c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:17.759 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.758+0000 7fb313fff640 1 -- 172.21.15.81:0/4026277887 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb31c1f3440 con 0x7fb31c15f510 2024-09-17T05:26:17.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.936+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb31c0cf1e0 con 0x7fb31c15f510 2024-09-17T05:26:17.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.938+0000 7fb313fff640 1 -- 172.21.15.81:0/4026277887 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v161) ==== 74+0+16868 (secure 0 0 0) 0x7fb314062ed0 con 0x7fb31c15f510 2024-09-17T05:26:17.939 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:17.939 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":161,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:26:16.673576+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:26:15.288741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:26:15.626241+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2fc0795b0 msgr2=0x7fb2fc07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2fc0795b0 0x7fb2fc07ba70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb30c0012e0 tx=0x7fb30c009040 comp rx=0 tx=0).stop 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c15f510 msgr2=0x7fb31c159160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c15f510 0x7fb31c159160 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7fb31400d660 tx=0x7fb31400db20 comp rx=0 tx=0).stop 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 shutdown_connections 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb31c15f510 0x7fb31c159160 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb2fc0795b0 0x7fb2fc07ba70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb31c15f130 0x7fb31c1f1c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 --2- 172.21.15.81:0/4026277887 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb31c0d02c0 0x7fb31c1f2f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:17.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 >> 172.21.15.81:0/4026277887 conn(0x7fb31c0d1b30 msgr2=0x7fb31c15e300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:17.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 shutdown_connections 2024-09-17T05:26:17.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:17.940+0000 7fb31bfff640 1 -- 172.21.15.81:0/4026277887 wait complete. 2024-09-17T05:26:17.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-09-17T05:26:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.056+0000 7f005f1db640 1 -- 172.21.15.81:0/325237232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0048004d40 msgr2=0x7f00480051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.056+0000 7f005f1db640 1 --2- 172.21.15.81:0/325237232 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0048004d40 0x7f00480051c0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f005000c590 tx=0x7f0048005830 comp rx=0 tx=0).stop 2024-09-17T05:26:18.057 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.056+0000 7f005d778640 1 -- 172.21.15.81:0/325237232 reap_dead start 2024-09-17T05:26:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.056+0000 7f005f1db640 1 -- 172.21.15.81:0/325237232 shutdown_connections 2024-09-17T05:26:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.056+0000 7f005f1db640 1 -- 172.21.15.81:0/325237232 >> 172.21.15.81:0/325237232 conn(0x7f00580d3e30 msgr2=0x7f00580d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.056+0000 7f005f1db640 1 -- 172.21.15.81:0/325237232 shutdown_connections 2024-09-17T05:26:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.056+0000 7f005f1db640 1 -- 172.21.15.81:0/325237232 wait complete. 2024-09-17T05:26:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.057+0000 7f005f1db640 1 Processor -- start 2024-09-17T05:26:18.058 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.057+0000 7f005f1db640 1 -- start start 2024-09-17T05:26:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005f1db640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0048004d40 0x7f00581515e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005f1db640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00580ca2a0 0x7f00581f4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005f1db640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00581f53f0 0x7f00581f7d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005f1db640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f00580d2270 con 0x7f00581f53f0 2024-09-17T05:26:18.060 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005f1db640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f00580b5000 con 0x7f0048004d40 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005f1db640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f00580d23f0 con 0x7f00580ca2a0 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005d778640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00581f53f0 0x7f00581f7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005d778640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00581f53f0 0x7f00581f7d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34160/0 (socket says 172.21.15.81:34160) 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005d778640 1 -- 172.21.15.81:0/4121295031 learned_addr learned my addr 172.21.15.81:0/4121295031 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f005cf77640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0048004d40 0x7f00581515e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.058+0000 7f0057fff640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00580ca2a0 0x7f00581f4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005d778640 1 -- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00580ca2a0 msgr2=0x7f00581f4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005d778640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00580ca2a0 0x7f00581f4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005d778640 1 -- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0048004d40 msgr2=0x7f00581515e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005d778640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0048004d40 0x7f00581515e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005d778640 1 -- 172.21.15.81:0/4121295031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00580ca870 con 0x7f00581f53f0 2024-09-17T05:26:18.061 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005d778640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00581f53f0 0x7f00581f7d70 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f005000c6b0 tx=0x7f0050001aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f00557fa640 1 -- 172.21.15.81:0/4121295031 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0050001fd0 con 0x7f00581f53f0 2024-09-17T05:26:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f00557fa640 1 -- 172.21.15.81:0/4121295031 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f005002b990 con 0x7f00581f53f0 2024-09-17T05:26:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00580cb640 con 0x7f00581f53f0 2024-09-17T05:26:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f00557fa640 1 -- 172.21.15.81:0/4121295031 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f005002bde0 con 0x7f00581f53f0 2024-09-17T05:26:18.062 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.059+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00581f82b0 con 0x7f00581f53f0 2024-09-17T05:26:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.060+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00580cb460 con 0x7f00581f53f0 2024-09-17T05:26:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.060+0000 7f00557fa640 1 -- 172.21.15.81:0/4121295031 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f0050032370 con 0x7f00581f53f0 2024-09-17T05:26:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.061+0000 7f00557fa640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f003c0795b0 0x7f003c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.061+0000 7f005cf77640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f003c0795b0 0x7f003c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.061+0000 7f00557fa640 1 -- 172.21.15.81:0/4121295031 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(161..161 src has 1..161) ==== 5781+0+0 (secure 0 0 0) 0x7f00500b9080 con 0x7f00581f53f0 2024-09-17T05:26:18.063 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.061+0000 7f005cf77640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f003c0795b0 0x7f003c07ba70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f004c009cd0 tx=0x7f004c005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:18.066 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.065+0000 7f00557fa640 1 -- 172.21.15.81:0/4121295031 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f00580cb460 con 0x7f00581f53f0 2024-09-17T05:26:18.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.278+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7f00580d1d30 con 0x7f00581f53f0 2024-09-17T05:26:18.868 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.867+0000 7f00557fa640 1 -- 172.21.15.81:0/4121295031 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v100) ==== 118+0+0 (secure 0 0 0) 0x7f0050082790 con 0x7f00581f53f0 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f003c0795b0 msgr2=0x7f003c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f003c0795b0 0x7f003c07ba70 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f004c009cd0 tx=0x7f004c005f90 comp rx=0 tx=0).stop 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00581f53f0 msgr2=0x7f00581f7d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00581f53f0 0x7f00581f7d70 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f005000c6b0 tx=0x7f0050001aa0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 shutdown_connections 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f00581f53f0 0x7f00581f7d70 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f00580ca2a0 0x7f00581f4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f003c0795b0 0x7f003c07ba70 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.871 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 --2- 172.21.15.81:0/4121295031 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0048004d40 0x7f00581515e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 >> 172.21.15.81:0/4121295031 conn(0x7f00580d3e30 msgr2=0x7f00580ced10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 shutdown_connections 2024-09-17T05:26:18.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.870+0000 7f005f1db640 1 -- 172.21.15.81:0/4121295031 wait complete. 2024-09-17T05:26:18.884 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2024-09-17T05:26:18.884 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-09-17T05:26:18.993 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 -- 172.21.15.81:0/3640236938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 msgr2=0x7ff0080d1ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 --2- 172.21.15.81:0/3640236938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0080d1ab0 secure :-1 s=READY pgs=1846 cs=0 l=1 rev1=1 crypto rx=0x7ff0080cf640 tx=0x7feff002a560 comp rx=0 tx=0).stop 2024-09-17T05:26:18.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 -- 172.21.15.81:0/3640236938 shutdown_connections 2024-09-17T05:26:18.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 --2- 172.21.15.81:0/3640236938 >> v2:172.21.15.160:3300/0 conn(0x7ff0080d1ff0 0x7ff0080ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 --2- 172.21.15.81:0/3640236938 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0080d1ab0 unknown :-1 s=CLOSED pgs=1846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 -- 172.21.15.81:0/3640236938 >> 172.21.15.81:0/3640236938 conn(0x7ff00809aa30 msgr2=0x7ff00809ae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:18.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 -- 172.21.15.81:0/3640236938 shutdown_connections 2024-09-17T05:26:18.994 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.992+0000 7ff00d310640 1 -- 172.21.15.81:0/3640236938 wait complete. 2024-09-17T05:26:18.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 Processor -- start 2024-09-17T05:26:18.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 -- start start 2024-09-17T05:26:18.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0081f7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:18.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0080d1ff0 0x7ff0081f8260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:18.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff00815be30 0x7ff0081f4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:18.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff0080cd6e0 con 0x7ff0080d06b0 2024-09-17T05:26:18.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff0080cd560 con 0x7ff0080d1ff0 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.994+0000 7ff00d310640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff0080cd860 con 0x7ff00815be30 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0081f7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0081f7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34170/0 (socket says 172.21.15.81:34170) 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 -- 172.21.15.81:0/2918234046 learned_addr learned my addr 172.21.15.81:0/2918234046 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff0067fc640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0080d1ff0 0x7ff0081f8260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff0077fe640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff00815be30 0x7ff0081f4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 -- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff00815be30 msgr2=0x7ff0081f4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff00815be30 0x7ff0081f4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 -- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0080d1ff0 msgr2=0x7ff0081f8260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0080d1ff0 0x7ff0081f8260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:18.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 -- 172.21.15.81:0/2918234046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0081f8b30 con 0x7ff0080d06b0 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff0067fc640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0080d1ff0 0x7ff0081f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff006ffd640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0081f7d20 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7feff800ba50 tx=0x7feff800bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7fefff7fe640 1 -- 172.21.15.81:0/2918234046 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff8019070 con 0x7ff0080d06b0 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7fefff7fe640 1 -- 172.21.15.81:0/2918234046 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feff800cd00 con 0x7ff0080d06b0 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0080ca2c0 con 0x7ff0080d06b0 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7fefff7fe640 1 -- 172.21.15.81:0/2918234046 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feff80146a0 con 0x7ff0080d06b0 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.995+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0080ca880 con 0x7ff0080d06b0 2024-09-17T05:26:18.999 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.996+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0080cde00 con 0x7ff0080d06b0 2024-09-17T05:26:19.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.997+0000 7fefff7fe640 1 -- 172.21.15.81:0/2918234046 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7feff801c070 con 0x7ff0080d06b0 2024-09-17T05:26:19.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.998+0000 7fefff7fe640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fefe80795b0 0x7fefe807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:19.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.998+0000 7ff0067fc640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fefe80795b0 0x7fefe807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:19.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.998+0000 7fefff7fe640 1 -- 172.21.15.81:0/2918234046 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7feff8099610 con 0x7ff0080d06b0 2024-09-17T05:26:19.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:18.998+0000 7ff0067fc640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fefe80795b0 0x7fefe807ba70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feff0033000 tx=0x7feff0004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:19.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.002+0000 7fefff7fe640 1 -- 172.21.15.81:0/2918234046 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7feff8063370 con 0x7ff0080d06b0 2024-09-17T05:26:19.216 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.215+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7ff00809b210 con 0x7ff0080d06b0 2024-09-17T05:26:19.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.868+0000 7fefff7fe640 1 -- 172.21.15.81:0/2918234046 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v101) ==== 122+0+0 (secure 0 0 0) 0x7feff8062c70 con 0x7ff0080d06b0 2024-09-17T05:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fefe80795b0 msgr2=0x7fefe807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fefe80795b0 0x7fefe807ba70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7feff0033000 tx=0x7feff0004730 comp rx=0 tx=0).stop 2024-09-17T05:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 msgr2=0x7ff0081f7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:19.872 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0081f7d20 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7feff800ba50 tx=0x7feff800bf10 comp rx=0 tx=0).stop 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 shutdown_connections 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff00815be30 0x7ff0081f4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fefe80795b0 0x7fefe807ba70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff0080d1ff0 0x7ff0081f8260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 --2- 172.21.15.81:0/2918234046 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0080d06b0 0x7ff0081f7d20 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 >> 172.21.15.81:0/2918234046 conn(0x7ff00809aa30 msgr2=0x7ff0080b2420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 shutdown_connections 2024-09-17T05:26:19.873 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.871+0000 7ff00d310640 1 -- 172.21.15.81:0/2918234046 wait complete. 2024-09-17T05:26:19.883 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-09-17T05:26:19.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.984+0000 7f4cc8647640 1 -- 172.21.15.81:0/114504372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 msgr2=0x7f4cc015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.984+0000 7f4cc8647640 1 --2- 172.21.15.81:0/114504372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc015d270 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc009830 tx=0x7f4cbc02a510 comp rx=0 tx=0).stop 2024-09-17T05:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.985+0000 7f4cc8647640 1 -- 172.21.15.81:0/114504372 shutdown_connections 2024-09-17T05:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.985+0000 7f4cc8647640 1 --2- 172.21.15.81:0/114504372 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc015fe60 0x7f4cc00ceac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.985+0000 7f4cc8647640 1 --2- 172.21.15.81:0/114504372 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc015d270 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.986 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.985+0000 7f4cc8647640 1 -- 172.21.15.81:0/114504372 >> 172.21.15.81:0/114504372 conn(0x7f4cc00b1690 msgr2=0x7f4cc00b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.985+0000 7f4cc8647640 1 -- 172.21.15.81:0/114504372 shutdown_connections 2024-09-17T05:26:19.987 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.985+0000 7f4cc8647640 1 -- 172.21.15.81:0/114504372 wait complete. 2024-09-17T05:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 Processor -- start 2024-09-17T05:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 -- start start 2024-09-17T05:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cc490 0x7f4cc00a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc014d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc015fe60 0x7f4cc00ade70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00cca80 con 0x7f4cc0159680 2024-09-17T05:26:19.989 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc00cc900 con 0x7f4cc015fe60 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.986+0000 7f4cc8647640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4cc00ccc00 con 0x7f4cc00cc490 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc014d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc014d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34178/0 (socket says 172.21.15.81:34178) 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 -- 172.21.15.81:0/2881379149 learned_addr learned my addr 172.21.15.81:0/2881379149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc63e3640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cc490 0x7f4cc00a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc6be4640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc015fe60 0x7f4cc00ade70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 -- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cc490 msgr2=0x7f4cc00a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cc490 0x7f4cc00a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 -- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc015fe60 msgr2=0x7f4cc00ade70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc015fe60 0x7f4cc00ade70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:19.990 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 -- 172.21.15.81:0/2881379149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc00ab7c0 con 0x7f4cc0159680 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc6be4640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc015fe60 0x7f4cc00ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc5be2640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc014d3c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000c450 tx=0x7f4cb000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cb6ffd640 1 -- 172.21.15.81:0/2881379149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0016020 con 0x7f4cc0159680 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cb6ffd640 1 -- 172.21.15.81:0/2881379149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4cb0012920 con 0x7f4cc0159680 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc00aa7a0 con 0x7f4cc0159680 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cb6ffd640 1 -- 172.21.15.81:0/2881379149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0012d70 con 0x7f4cc0159680 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.987+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc00aba60 con 0x7f4cc0159680 2024-09-17T05:26:19.991 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.988+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cc00ceaa0 con 0x7f4cc0159680 2024-09-17T05:26:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.989+0000 7f4cb6ffd640 1 -- 172.21.15.81:0/2881379149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f4cb0019020 con 0x7f4cc0159680 2024-09-17T05:26:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.990+0000 7f4cb6ffd640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4ca40795b0 0x7f4ca407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.990+0000 7f4cc63e3640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4ca40795b0 0x7f4ca407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.990+0000 7f4cb6ffd640 1 -- 172.21.15.81:0/2881379149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f4cb0099510 con 0x7f4cc0159680 2024-09-17T05:26:19.992 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.990+0000 7f4cc63e3640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4ca40795b0 0x7f4ca407ba70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc034000 tx=0x7f4cbc004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:19.995 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:19.994+0000 7f4cb6ffd640 1 -- 172.21.15.81:0/2881379149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4cb0020030 con 0x7f4cc0159680 2024-09-17T05:26:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.207+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4cc015d570 con 0x7f4cc0159680 2024-09-17T05:26:20.209 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.208+0000 7f4cb6ffd640 1 -- 172.21.15.81:0/2881379149 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5229 (secure 0 0 0) 0x7f4cb0063270 con 0x7f4cc0159680 2024-09-17T05:26:20.209 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:20.209 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"btime":"2024-09-17T05:26:19:868354+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2790285877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2790285877},{"type":"v1","addr":"172.21.15.160:6835","nonce":2790285877}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/790920368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":790920368},{"type":"v1","addr":"172.21.15.160:6834","nonce":790920368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/234206731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":234206731},{"type":"v1","addr":"172.21.15.81:6834","nonce":234206731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:26:16.673540+0000","modified":"2024-09-17T05:26:19.217419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9207":{"gid":9207,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/2091743317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2091743317},{"type":"v1","addr":"172.21.15.81:6835","nonce":2091743317}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9207,"qdb_cluster":[9207]},"id":13}]} 2024-09-17T05:26:20.210 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 101 2024-09-17T05:26:20.211 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4ca40795b0 msgr2=0x7f4ca407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4ca40795b0 0x7f4ca407ba70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f4cbc034000 tx=0x7f4cbc004730 comp rx=0 tx=0).stop 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 msgr2=0x7f4cc014d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc014d3c0 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000c450 tx=0x7f4cb000c910 comp rx=0 tx=0).stop 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 shutdown_connections 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4ca40795b0 0x7f4ca407ba70 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4cc015fe60 0x7f4cc00ade70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4cc0159680 0x7f4cc014d3c0 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 --2- 172.21.15.81:0/2881379149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4cc00cc490 0x7f4cc00a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 >> 172.21.15.81:0/2881379149 conn(0x7f4cc00b1690 msgr2=0x7f4cc015db20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 shutdown_connections 2024-09-17T05:26:20.212 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.210+0000 7f4cc8647640 1 -- 172.21.15.81:0/2881379149 wait complete. 2024-09-17T05:26:20.222 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:20.304 INFO:tasks.ceph.mds.c.smithi081.stderr:2024-09-17T05:26:20.303+0000 7fe5bc9d2640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-17T05:26:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 -- 172.21.15.81:0/3534513048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40b3140 msgr2=0x7f12c40cf470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 --2- 172.21.15.81:0/3534513048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40b3140 0x7f12c40cf470 secure :-1 s=READY pgs=1851 cs=0 l=1 rev1=1 crypto rx=0x7f12c4069dc0 tx=0x7f12ac02a560 comp rx=0 tx=0).stop 2024-09-17T05:26:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 -- 172.21.15.81:0/3534513048 shutdown_connections 2024-09-17T05:26:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 --2- 172.21.15.81:0/3534513048 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12c40725a0 0x7f12c4072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 --2- 172.21.15.81:0/3534513048 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40b3140 0x7f12c40cf470 unknown :-1 s=CLOSED pgs=1851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 --2- 172.21.15.81:0/3534513048 >> v2:172.21.15.160:3300/0 conn(0x7f12c4151370 0x7f12c40cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 -- 172.21.15.81:0/3534513048 >> 172.21.15.81:0/3534513048 conn(0x7f12c40b1690 msgr2=0x7f12c40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 -- 172.21.15.81:0/3534513048 shutdown_connections 2024-09-17T05:26:20.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.322+0000 7f12cad5d640 1 -- 172.21.15.81:0/3534513048 wait complete. 2024-09-17T05:26:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.323+0000 7f12cad5d640 1 Processor -- start 2024-09-17T05:26:20.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.323+0000 7f12cad5d640 1 -- start start 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12cad5d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40725a0 0x7f12c4147890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12cad5d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12c40b3140 0x7f12c4149dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12cad5d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12c4151370 0x7f12c413c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12cad5d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f12c406ea80 con 0x7f12c40725a0 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12cad5d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f12c406e900 con 0x7f12c40b3140 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12cad5d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f12c406ec00 con 0x7f12c4151370 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40725a0 0x7f12c4147890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40725a0 0x7f12c4147890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34202/0 (socket says 172.21.15.81:34202) 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 -- 172.21.15.81:0/2988752575 learned_addr learned my addr 172.21.15.81:0/2988752575 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c92fa640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12c4151370 0x7f12c413c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.327 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c3fff640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12c40b3140 0x7f12c4149dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 -- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12c4151370 msgr2=0x7f12c413c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12c4151370 0x7f12c413c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 -- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12c40b3140 msgr2=0x7f12c4149dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12c40b3140 0x7f12c4149dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 -- 172.21.15.81:0/2988752575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12c4141f30 con 0x7f12c40725a0 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c92fa640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12c4151370 0x7f12c413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c3fff640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12c40b3140 0x7f12c4149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.324+0000 7f12c8af9640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40725a0 0x7f12c4147890 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f12b400ba50 tx=0x7f12b400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.325+0000 7f12c17fa640 1 -- 172.21.15.81:0/2988752575 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b4019070 con 0x7f12c40725a0 2024-09-17T05:26:20.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.325+0000 7f12c17fa640 1 -- 172.21.15.81:0/2988752575 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f12b400ccf0 con 0x7f12c40725a0 2024-09-17T05:26:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.325+0000 7f12c17fa640 1 -- 172.21.15.81:0/2988752575 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f12b40146a0 con 0x7f12c40725a0 2024-09-17T05:26:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.325+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12c41485c0 con 0x7f12c40725a0 2024-09-17T05:26:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.325+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12c41482e0 con 0x7f12c40725a0 2024-09-17T05:26:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.326+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f12c4072a10 con 0x7f12c40725a0 2024-09-17T05:26:20.329 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.326+0000 7f12c17fa640 1 -- 172.21.15.81:0/2988752575 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f12b401c070 con 0x7f12c40725a0 2024-09-17T05:26:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.327+0000 7f12c17fa640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12a40795e0 0x7f12a407baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.327+0000 7f12c3fff640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12a40795e0 0x7f12a407baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.327+0000 7f12c17fa640 1 -- 172.21.15.81:0/2988752575 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f12b40995b0 con 0x7f12c40725a0 2024-09-17T05:26:20.330 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.327+0000 7f12c3fff640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12a40795e0 0x7f12a407baa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f12ac033000 tx=0x7f12ac004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:20.332 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.331+0000 7f12c17fa640 1 -- 172.21.15.81:0/2988752575 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f12b4063310 con 0x7f12c40725a0 2024-09-17T05:26:20.509 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.508+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f12c40b0bf0 con 0x7f12c40725a0 2024-09-17T05:26:20.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.509+0000 7f12c17fa640 1 -- 172.21.15.81:0/2988752575 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) ==== 74+0+16855 (secure 0 0 0) 0x7f12b4062c10 con 0x7f12c40725a0 2024-09-17T05:26:20.510 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:20.510 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":162,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:26:18.303033+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:26:15.288741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:26:15.626241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:20.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12a40795e0 msgr2=0x7f12a407baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.512 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12a40795e0 0x7f12a407baa0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f12ac033000 tx=0x7f12ac004730 comp rx=0 tx=0).stop 2024-09-17T05:26:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40725a0 msgr2=0x7f12c4147890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40725a0 0x7f12c4147890 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f12b400ba50 tx=0x7f12b400bf10 comp rx=0 tx=0).stop 2024-09-17T05:26:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 shutdown_connections 2024-09-17T05:26:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f12c4151370 0x7f12c413c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f12a40795e0 0x7f12a407baa0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f12c40b3140 0x7f12c4149dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 --2- 172.21.15.81:0/2988752575 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f12c40725a0 0x7f12c4147890 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 >> 172.21.15.81:0/2988752575 conn(0x7f12c40b1690 msgr2=0x7f12c40b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 shutdown_connections 2024-09-17T05:26:20.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.511+0000 7f12cad5d640 1 -- 172.21.15.81:0/2988752575 wait complete. 2024-09-17T05:26:20.523 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:26:20.524 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:26:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 -- 172.21.15.81:0/2110933347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0074310 msgr2=0x7f17f006e920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 --2- 172.21.15.81:0/2110933347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0074310 0x7f17f006e920 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f17e8005fd0 tx=0x7f17e802aa90 comp rx=0 tx=0).stop 2024-09-17T05:26:20.625 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 -- 172.21.15.81:0/2110933347 shutdown_connections 2024-09-17T05:26:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 --2- 172.21.15.81:0/2110933347 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f0074310 0x7f17f006e920 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 --2- 172.21.15.81:0/2110933347 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f00cdaa0 0x7f17f0073dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 -- 172.21.15.81:0/2110933347 >> 172.21.15.81:0/2110933347 conn(0x7f17f00b19c0 msgr2=0x7f17f00b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 -- 172.21.15.81:0/2110933347 shutdown_connections 2024-09-17T05:26:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.624+0000 7f17f80be640 1 -- 172.21.15.81:0/2110933347 wait complete. 2024-09-17T05:26:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.625+0000 7f17f80be640 1 Processor -- start 2024-09-17T05:26:20.626 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.625+0000 7f17f80be640 1 -- start start 2024-09-17T05:26:20.628 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f80be640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f0074310 0x7f17f01f1f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f80be640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f00cdaa0 0x7f17f009aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f80be640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f015f3d0 0x7f17f009af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f80be640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f17f006ee60 con 0x7f17f015f3d0 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f80be640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f17f015f9c0 con 0x7f17f00cdaa0 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f80be640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f17f006efe0 con 0x7f17f0074310 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f015f3d0 0x7f17f009af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f015f3d0 0x7f17f009af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34218/0 (socket says 172.21.15.81:34218) 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 -- 172.21.15.81:0/2702700407 learned_addr learned my addr 172.21.15.81:0/2702700407 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f5659640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f00cdaa0 0x7f17f009aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.629 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f5e5a640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f0074310 0x7f17f01f1f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 -- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f0074310 msgr2=0x7f17f01f1f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f0074310 0x7f17f01f1f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 -- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f00cdaa0 msgr2=0x7f17f009aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f00cdaa0 0x7f17f009aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.626+0000 7f17f665b640 1 -- 172.21.15.81:0/2702700407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17f00c9ae0 con 0x7f17f015f3d0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.627+0000 7f17f665b640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f015f3d0 0x7f17f009af70 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009d90 tx=0x7f17e8003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.627+0000 7f17e67fc640 1 -- 172.21.15.81:0/2702700407 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8046070 con 0x7f17f015f3d0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.627+0000 7f17e67fc640 1 -- 172.21.15.81:0/2702700407 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f17e8004040 con 0x7f17f015f3d0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.627+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17f00c9dc0 con 0x7f17f015f3d0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.627+0000 7f17e67fc640 1 -- 172.21.15.81:0/2702700407 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17e8004450 con 0x7f17f015f3d0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.627+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17f00c7280 con 0x7f17f015f3d0 2024-09-17T05:26:20.630 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.628+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17f006e920 con 0x7f17f015f3d0 2024-09-17T05:26:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.629+0000 7f17e67fc640 1 -- 172.21.15.81:0/2702700407 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f17e8049070 con 0x7f17f015f3d0 2024-09-17T05:26:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.629+0000 7f17e67fc640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17d40795b0 0x7f17d407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.629+0000 7f17f5e5a640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17d40795b0 0x7f17d407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.629+0000 7f17e67fc640 1 -- 172.21.15.81:0/2702700407 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f17e80ba510 con 0x7f17f015f3d0 2024-09-17T05:26:20.631 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.630+0000 7f17f5e5a640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17d40795b0 0x7f17d407ba70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f17ec001720 tx=0x7f17ec009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:20.634 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.633+0000 7f17e67fc640 1 -- 172.21.15.81:0/2702700407 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f17e8032030 con 0x7f17f015f3d0 2024-09-17T05:26:20.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.807+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f17f00b5e50 con 0x7f17d40795b0 2024-09-17T05:26:20.811 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.811+0000 7f17e67fc640 1 -- 172.21.15.81:0/2702700407 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252480 (secure 0 0 0) 0x7f17f00b5e50 con 0x7f17d40795b0 2024-09-17T05:26:20.814 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:20.816 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:26:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17d40795b0 msgr2=0x7f17d407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17d40795b0 0x7f17d407ba70 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f17ec001720 tx=0x7f17ec009040 comp rx=0 tx=0).stop 2024-09-17T05:26:20.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f015f3d0 msgr2=0x7f17f009af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f015f3d0 0x7f17f009af70 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f17e8009d90 tx=0x7f17e8003ba0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 shutdown_connections 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f17f015f3d0 0x7f17f009af70 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f17d40795b0 0x7f17d407ba70 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f17f00cdaa0 0x7f17f009aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 --2- 172.21.15.81:0/2702700407 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f17f0074310 0x7f17f01f1f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 >> 172.21.15.81:0/2702700407 conn(0x7f17f00b19c0 msgr2=0x7f17f00aff60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 shutdown_connections 2024-09-17T05:26:20.818 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.814+0000 7f17f80be640 1 -- 172.21.15.81:0/2702700407 wait complete. 2024-09-17T05:26:20.826 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-17T05:26:20.064384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270856,"kb_used_data":17160,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703864,"statfs":{"total":773094113280,"available":772816756736,"internally_reserved":0,"allocated":17571840,"data_stored":8394964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.754687"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316416+0000","last_change":"2024-09-17T05:26:17.321606+0000","last_active":"2024-09-17T05:26:18.316416+0000","last_peered":"2024-09-17T05:26:18.316416+0000","last_clean":"2024-09-17T05:26:18.316416+0000","last_became_active":"2024-09-17T05:26:17.321367+0000","last_became_peered":"2024-09-17T05:26:17.321367+0000","last_unstale":"2024-09-17T05:26:18.316416+0000","last_undegraded":"2024-09-17T05:26:18.316416+0000","last_fullsized":"2024-09-17T05:26:18.316416+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:27.955244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496107+0000","last_change":"2024-09-17T05:26:17.323199+0000","last_active":"2024-09-17T05:26:18.496107+0000","last_peered":"2024-09-17T05:26:18.496107+0000","last_clean":"2024-09-17T05:26:18.496107+0000","last_became_active":"2024-09-17T05:26:17.321209+0000","last_became_peered":"2024-09-17T05:26:17.321209+0000","last_unstale":"2024-09-17T05:26:18.496107+0000","last_undegraded":"2024-09-17T05:26:18.496107+0000","last_fullsized":"2024-09-17T05:26:18.496107+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:28.122869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.497054+0000","last_change":"2024-09-17T05:26:17.320057+0000","last_active":"2024-09-17T05:26:18.497054+0000","last_peered":"2024-09-17T05:26:18.497054+0000","last_clean":"2024-09-17T05:26:18.497054+0000","last_became_active":"2024-09-17T05:26:17.319772+0000","last_became_peered":"2024-09-17T05:26:17.319772+0000","last_unstale":"2024-09-17T05:26:18.497054+0000","last_undegraded":"2024-09-17T05:26:18.497054+0000","last_fullsized":"2024-09-17T05:26:18.497054+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:38.694722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331742+0000","last_change":"2024-09-17T05:26:17.321686+0000","last_active":"2024-09-17T05:26:18.331742+0000","last_peered":"2024-09-17T05:26:18.331742+0000","last_clean":"2024-09-17T05:26:18.331742+0000","last_became_active":"2024-09-17T05:26:17.321180+0000","last_became_peered":"2024-09-17T05:26:17.321180+0000","last_unstale":"2024-09-17T05:26:18.331742+0000","last_undegraded":"2024-09-17T05:26:18.331742+0000","last_fullsized":"2024-09-17T05:26:18.331742+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:55.205634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496701+0000","last_change":"2024-09-17T05:26:17.317442+0000","last_active":"2024-09-17T05:26:18.496701+0000","last_peered":"2024-09-17T05:26:18.496701+0000","last_clean":"2024-09-17T05:26:18.496701+0000","last_became_active":"2024-09-17T05:26:17.317159+0000","last_became_peered":"2024-09-17T05:26:17.317159+0000","last_unstale":"2024-09-17T05:26:18.496701+0000","last_undegraded":"2024-09-17T05:26:18.496701+0000","last_fullsized":"2024-09-17T05:26:18.496701+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:11.022197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496070+0000","last_change":"2024-09-17T05:26:17.327035+0000","last_active":"2024-09-17T05:26:18.496070+0000","last_peered":"2024-09-17T05:26:18.496070+0000","last_clean":"2024-09-17T05:26:18.496070+0000","last_became_active":"2024-09-17T05:26:17.326744+0000","last_became_peered":"2024-09-17T05:26:17.326744+0000","last_unstale":"2024-09-17T05:26:18.496070+0000","last_undegraded":"2024-09-17T05:26:18.496070+0000","last_fullsized":"2024-09-17T05:26:18.496070+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:00.487998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316049+0000","last_change":"2024-09-17T05:26:17.321479+0000","last_active":"2024-09-17T05:26:18.316049+0000","last_peered":"2024-09-17T05:26:18.316049+0000","last_clean":"2024-09-17T05:26:18.316049+0000","last_became_active":"2024-09-17T05:26:17.321222+0000","last_became_peered":"2024-09-17T05:26:17.321222+0000","last_unstale":"2024-09-17T05:26:18.316049+0000","last_undegraded":"2024-09-17T05:26:18.316049+0000","last_fullsized":"2024-09-17T05:26:18.316049+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:01.149100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496182+0000","last_change":"2024-09-17T05:26:17.322608+0000","last_active":"2024-09-17T05:26:18.496182+0000","last_peered":"2024-09-17T05:26:18.496182+0000","last_clean":"2024-09-17T05:26:18.496182+0000","last_became_active":"2024-09-17T05:26:17.322345+0000","last_became_peered":"2024-09-17T05:26:17.322345+0000","last_unstale":"2024-09-17T05:26:18.496182+0000","last_undegraded":"2024-09-17T05:26:18.496182+0000","last_fullsized":"2024-09-17T05:26:18.496182+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:05.261609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496409+0000","last_change":"2024-09-17T05:26:17.312465+0000","last_active":"2024-09-17T05:26:18.496409+0000","last_peered":"2024-09-17T05:26:18.496409+0000","last_clean":"2024-09-17T05:26:18.496409+0000","last_became_active":"2024-09-17T05:26:17.312156+0000","last_became_peered":"2024-09-17T05:26:17.312156+0000","last_unstale":"2024-09-17T05:26:18.496409+0000","last_undegraded":"2024-09-17T05:26:18.496409+0000","last_fullsized":"2024-09-17T05:26:18.496409+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:40.437261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495919+0000","last_change":"2024-09-17T05:26:17.317552+0000","last_active":"2024-09-17T05:26:18.495919+0000","last_peered":"2024-09-17T05:26:18.495919+0000","last_clean":"2024-09-17T05:26:18.495919+0000","last_became_active":"2024-09-17T05:26:17.317285+0000","last_became_peered":"2024-09-17T05:26:17.317285+0000","last_unstale":"2024-09-17T05:26:18.495919+0000","last_undegraded":"2024-09-17T05:26:18.495919+0000","last_fullsized":"2024-09-17T05:26:18.495919+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:11.673832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.497053+0000","last_change":"2024-09-17T05:26:17.319658+0000","last_active":"2024-09-17T05:26:18.497053+0000","last_peered":"2024-09-17T05:26:18.497053+0000","last_clean":"2024-09-17T05:26:18.497053+0000","last_became_active":"2024-09-17T05:26:17.319378+0000","last_became_peered":"2024-09-17T05:26:17.319378+0000","last_unstale":"2024-09-17T05:26:18.497053+0000","last_undegraded":"2024-09-17T05:26:18.497053+0000","last_fullsized":"2024-09-17T05:26:18.497053+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:54.460602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315338+0000","last_change":"2024-09-17T05:26:17.319612+0000","last_active":"2024-09-17T05:26:18.315338+0000","last_peered":"2024-09-17T05:26:18.315338+0000","last_clean":"2024-09-17T05:26:18.315338+0000","last_became_active":"2024-09-17T05:26:17.319119+0000","last_became_peered":"2024-09-17T05:26:17.319119+0000","last_unstale":"2024-09-17T05:26:18.315338+0000","last_undegraded":"2024-09-17T05:26:18.315338+0000","last_fullsized":"2024-09-17T05:26:18.315338+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:44.108869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315199+0000","last_change":"2024-09-17T05:26:17.311470+0000","last_active":"2024-09-17T05:26:18.315199+0000","last_peered":"2024-09-17T05:26:18.315199+0000","last_clean":"2024-09-17T05:26:18.315199+0000","last_became_active":"2024-09-17T05:26:17.311105+0000","last_became_peered":"2024-09-17T05:26:17.311105+0000","last_unstale":"2024-09-17T05:26:18.315199+0000","last_undegraded":"2024-09-17T05:26:18.315199+0000","last_fullsized":"2024-09-17T05:26:18.315199+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:07.117208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316140+0000","last_change":"2024-09-17T05:26:17.323957+0000","last_active":"2024-09-17T05:26:18.316140+0000","last_peered":"2024-09-17T05:26:18.316140+0000","last_clean":"2024-09-17T05:26:18.316140+0000","last_became_active":"2024-09-17T05:26:17.323691+0000","last_became_peered":"2024-09-17T05:26:17.323691+0000","last_unstale":"2024-09-17T05:26:18.316140+0000","last_undegraded":"2024-09-17T05:26:18.316140+0000","last_fullsized":"2024-09-17T05:26:18.316140+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:28.251850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316045+0000","last_change":"2024-09-17T05:26:17.324710+0000","last_active":"2024-09-17T05:26:18.316045+0000","last_peered":"2024-09-17T05:26:18.316045+0000","last_clean":"2024-09-17T05:26:18.316045+0000","last_became_active":"2024-09-17T05:26:17.324176+0000","last_became_peered":"2024-09-17T05:26:17.324176+0000","last_unstale":"2024-09-17T05:26:18.316045+0000","last_undegraded":"2024-09-17T05:26:18.316045+0000","last_fullsized":"2024-09-17T05:26:18.316045+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:22.628815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496714+0000","last_change":"2024-09-17T05:26:17.311096+0000","last_active":"2024-09-17T05:26:18.496714+0000","last_peered":"2024-09-17T05:26:18.496714+0000","last_clean":"2024-09-17T05:26:18.496714+0000","last_became_active":"2024-09-17T05:26:17.310501+0000","last_became_peered":"2024-09-17T05:26:17.310501+0000","last_unstale":"2024-09-17T05:26:18.496714+0000","last_undegraded":"2024-09-17T05:26:18.496714+0000","last_fullsized":"2024-09-17T05:26:18.496714+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:05.324361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316414+0000","last_change":"2024-09-17T05:26:17.320937+0000","last_active":"2024-09-17T05:26:18.316414+0000","last_peered":"2024-09-17T05:26:18.316414+0000","last_clean":"2024-09-17T05:26:18.316414+0000","last_became_active":"2024-09-17T05:26:17.320667+0000","last_became_peered":"2024-09-17T05:26:17.320667+0000","last_unstale":"2024-09-17T05:26:18.316414+0000","last_undegraded":"2024-09-17T05:26:18.316414+0000","last_fullsized":"2024-09-17T05:26:18.316414+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:52.574222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496144+0000","last_change":"2024-09-17T05:26:17.318164+0000","last_active":"2024-09-17T05:26:18.496144+0000","last_peered":"2024-09-17T05:26:18.496144+0000","last_clean":"2024-09-17T05:26:18.496144+0000","last_became_active":"2024-09-17T05:26:17.317862+0000","last_became_peered":"2024-09-17T05:26:17.317862+0000","last_unstale":"2024-09-17T05:26:18.496144+0000","last_undegraded":"2024-09-17T05:26:18.496144+0000","last_fullsized":"2024-09-17T05:26:18.496144+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:06.764200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496226+0000","last_change":"2024-09-17T05:26:17.316890+0000","last_active":"2024-09-17T05:26:18.496226+0000","last_peered":"2024-09-17T05:26:18.496226+0000","last_clean":"2024-09-17T05:26:18.496226+0000","last_became_active":"2024-09-17T05:26:17.316617+0000","last_became_peered":"2024-09-17T05:26:17.316617+0000","last_unstale":"2024-09-17T05:26:18.496226+0000","last_undegraded":"2024-09-17T05:26:18.496226+0000","last_fullsized":"2024-09-17T05:26:18.496226+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:29.744228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495764+0000","last_change":"2024-09-17T05:26:17.323047+0000","last_active":"2024-09-17T05:26:18.495764+0000","last_peered":"2024-09-17T05:26:18.495764+0000","last_clean":"2024-09-17T05:26:18.495764+0000","last_became_active":"2024-09-17T05:26:17.322780+0000","last_became_peered":"2024-09-17T05:26:17.322780+0000","last_unstale":"2024-09-17T05:26:18.495764+0000","last_undegraded":"2024-09-17T05:26:18.495764+0000","last_fullsized":"2024-09-17T05:26:18.495764+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:05.372241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331443+0000","last_change":"2024-09-17T05:26:17.322102+0000","last_active":"2024-09-17T05:26:18.331443+0000","last_peered":"2024-09-17T05:26:18.331443+0000","last_clean":"2024-09-17T05:26:18.331443+0000","last_became_active":"2024-09-17T05:26:17.320991+0000","last_became_peered":"2024-09-17T05:26:17.320991+0000","last_unstale":"2024-09-17T05:26:18.331443+0000","last_undegraded":"2024-09-17T05:26:18.331443+0000","last_fullsized":"2024-09-17T05:26:18.331443+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:15.044935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315884+0000","last_change":"2024-09-17T05:26:17.322459+0000","last_active":"2024-09-17T05:26:18.315884+0000","last_peered":"2024-09-17T05:26:18.315884+0000","last_clean":"2024-09-17T05:26:18.315884+0000","last_became_active":"2024-09-17T05:26:17.322164+0000","last_became_peered":"2024-09-17T05:26:17.322164+0000","last_unstale":"2024-09-17T05:26:18.315884+0000","last_undegraded":"2024-09-17T05:26:18.315884+0000","last_fullsized":"2024-09-17T05:26:18.315884+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:08.645785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315029+0000","last_change":"2024-09-17T05:26:17.326803+0000","last_active":"2024-09-17T05:26:18.315029+0000","last_peered":"2024-09-17T05:26:18.315029+0000","last_clean":"2024-09-17T05:26:18.315029+0000","last_became_active":"2024-09-17T05:26:17.326484+0000","last_became_peered":"2024-09-17T05:26:17.326484+0000","last_unstale":"2024-09-17T05:26:18.315029+0000","last_undegraded":"2024-09-17T05:26:18.315029+0000","last_fullsized":"2024-09-17T05:26:18.315029+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:57.011836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331534+0000","last_change":"2024-09-17T05:26:17.322859+0000","last_active":"2024-09-17T05:26:18.331534+0000","last_peered":"2024-09-17T05:26:18.331534+0000","last_clean":"2024-09-17T05:26:18.331534+0000","last_became_active":"2024-09-17T05:26:17.322572+0000","last_became_peered":"2024-09-17T05:26:17.322572+0000","last_unstale":"2024-09-17T05:26:18.331534+0000","last_undegraded":"2024-09-17T05:26:18.331534+0000","last_fullsized":"2024-09-17T05:26:18.331534+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:29.042811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496199+0000","last_change":"2024-09-17T05:26:17.317603+0000","last_active":"2024-09-17T05:26:18.496199+0000","last_peered":"2024-09-17T05:26:18.496199+0000","last_clean":"2024-09-17T05:26:18.496199+0000","last_became_active":"2024-09-17T05:26:17.316986+0000","last_became_peered":"2024-09-17T05:26:17.316986+0000","last_unstale":"2024-09-17T05:26:18.496199+0000","last_undegraded":"2024-09-17T05:26:18.496199+0000","last_fullsized":"2024-09-17T05:26:18.496199+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:54.288771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316492+0000","last_change":"2024-09-17T05:26:17.324479+0000","last_active":"2024-09-17T05:26:18.316492+0000","last_peered":"2024-09-17T05:26:18.316492+0000","last_clean":"2024-09-17T05:26:18.316492+0000","last_became_active":"2024-09-17T05:26:17.323559+0000","last_became_peered":"2024-09-17T05:26:17.323559+0000","last_unstale":"2024-09-17T05:26:18.316492+0000","last_undegraded":"2024-09-17T05:26:18.316492+0000","last_fullsized":"2024-09-17T05:26:18.316492+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:01.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315021+0000","last_change":"2024-09-17T05:26:17.318603+0000","last_active":"2024-09-17T05:26:18.315021+0000","last_peered":"2024-09-17T05:26:18.315021+0000","last_clean":"2024-09-17T05:26:18.315021+0000","last_became_active":"2024-09-17T05:26:17.318294+0000","last_became_peered":"2024-09-17T05:26:17.318294+0000","last_unstale":"2024-09-17T05:26:18.315021+0000","last_undegraded":"2024-09-17T05:26:18.315021+0000","last_fullsized":"2024-09-17T05:26:18.315021+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:40.437261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496816+0000","last_change":"2024-09-17T05:26:17.319937+0000","last_active":"2024-09-17T05:26:18.496816+0000","last_peered":"2024-09-17T05:26:18.496816+0000","last_clean":"2024-09-17T05:26:18.496816+0000","last_became_active":"2024-09-17T05:26:17.319639+0000","last_became_peered":"2024-09-17T05:26:17.319639+0000","last_unstale":"2024-09-17T05:26:18.496816+0000","last_undegraded":"2024-09-17T05:26:18.496816+0000","last_fullsized":"2024-09-17T05:26:18.496816+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:09.044373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.314712+0000","last_change":"2024-09-17T05:26:17.318625+0000","last_active":"2024-09-17T05:26:18.314712+0000","last_peered":"2024-09-17T05:26:18.314712+0000","last_clean":"2024-09-17T05:26:18.314712+0000","last_became_active":"2024-09-17T05:26:17.318344+0000","last_became_peered":"2024-09-17T05:26:17.318344+0000","last_unstale":"2024-09-17T05:26:18.314712+0000","last_undegraded":"2024-09-17T05:26:18.314712+0000","last_fullsized":"2024-09-17T05:26:18.314712+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:57.093965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495863+0000","last_change":"2024-09-17T05:26:17.318181+0000","last_active":"2024-09-17T05:26:18.495863+0000","last_peered":"2024-09-17T05:26:18.495863+0000","last_clean":"2024-09-17T05:26:18.495863+0000","last_became_active":"2024-09-17T05:26:17.317880+0000","last_became_peered":"2024-09-17T05:26:17.317880+0000","last_unstale":"2024-09-17T05:26:18.495863+0000","last_undegraded":"2024-09-17T05:26:18.495863+0000","last_fullsized":"2024-09-17T05:26:18.495863+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:30.086336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495575+0000","last_change":"2024-09-17T05:26:17.316903+0000","last_active":"2024-09-17T05:26:18.495575+0000","last_peered":"2024-09-17T05:26:18.495575+0000","last_clean":"2024-09-17T05:26:18.495575+0000","last_became_active":"2024-09-17T05:26:17.316154+0000","last_became_peered":"2024-09-17T05:26:17.316154+0000","last_unstale":"2024-09-17T05:26:18.495575+0000","last_undegraded":"2024-09-17T05:26:18.495575+0000","last_fullsized":"2024-09-17T05:26:18.495575+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:06.253350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316047+0000","last_change":"2024-09-17T05:26:17.315631+0000","last_active":"2024-09-17T05:26:18.316047+0000","last_peered":"2024-09-17T05:26:18.316047+0000","last_clean":"2024-09-17T05:26:18.316047+0000","last_became_active":"2024-09-17T05:26:17.315371+0000","last_became_peered":"2024-09-17T05:26:17.315371+0000","last_unstale":"2024-09-17T05:26:18.316047+0000","last_undegraded":"2024-09-17T05:26:18.316047+0000","last_fullsized":"2024-09-17T05:26:18.316047+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:07.768326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496206+0000","last_change":"2024-09-17T05:26:17.320607+0000","last_active":"2024-09-17T05:26:18.496206+0000","last_peered":"2024-09-17T05:26:18.496206+0000","last_clean":"2024-09-17T05:26:18.496206+0000","last_became_active":"2024-09-17T05:26:17.320329+0000","last_became_peered":"2024-09-17T05:26:17.320329+0000","last_unstale":"2024-09-17T05:26:18.496206+0000","last_undegraded":"2024-09-17T05:26:18.496206+0000","last_fullsized":"2024-09-17T05:26:18.496206+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:44.945380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"161'4","reported_seq":19,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315644+0000","last_change":"2024-09-17T05:26:16.333187+0000","last_active":"2024-09-17T05:26:18.315644+0000","last_peered":"2024-09-17T05:26:18.315644+0000","last_clean":"2024-09-17T05:26:18.315644+0000","last_became_active":"2024-09-17T05:26:16.332924+0000","last_became_peered":"2024-09-17T05:26:16.332924+0000","last_unstale":"2024-09-17T05:26:18.315644+0000","last_undegraded":"2024-09-17T05:26:18.315644+0000","last_fullsized":"2024-09-17T05:26:18.315644+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:24.859439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315922+0000","last_change":"2024-09-17T05:26:17.322290+0000","last_active":"2024-09-17T05:26:18.315922+0000","last_peered":"2024-09-17T05:26:18.315922+0000","last_clean":"2024-09-17T05:26:18.315922+0000","last_became_active":"2024-09-17T05:26:17.322000+0000","last_became_peered":"2024-09-17T05:26:17.322000+0000","last_unstale":"2024-09-17T05:26:18.315922+0000","last_undegraded":"2024-09-17T05:26:18.315922+0000","last_fullsized":"2024-09-17T05:26:18.315922+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:54.738012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496328+0000","last_change":"2024-09-17T05:26:16.334672+0000","last_active":"2024-09-17T05:26:18.496328+0000","last_peered":"2024-09-17T05:26:18.496328+0000","last_clean":"2024-09-17T05:26:18.496328+0000","last_became_active":"2024-09-17T05:26:16.334416+0000","last_became_peered":"2024-09-17T05:26:16.334416+0000","last_unstale":"2024-09-17T05:26:18.496328+0000","last_undegraded":"2024-09-17T05:26:18.496328+0000","last_fullsized":"2024-09-17T05:26:18.496328+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:13.572966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316306+0000","last_change":"2024-09-17T05:26:17.324454+0000","last_active":"2024-09-17T05:26:18.316306+0000","last_peered":"2024-09-17T05:26:18.316306+0000","last_clean":"2024-09-17T05:26:18.316306+0000","last_became_active":"2024-09-17T05:26:17.323995+0000","last_became_peered":"2024-09-17T05:26:17.323995+0000","last_unstale":"2024-09-17T05:26:18.316306+0000","last_undegraded":"2024-09-17T05:26:18.316306+0000","last_fullsized":"2024-09-17T05:26:18.316306+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:44.610811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.497143+0000","last_change":"2024-09-17T05:26:16.334772+0000","last_active":"2024-09-17T05:26:18.497143+0000","last_peered":"2024-09-17T05:26:18.497143+0000","last_clean":"2024-09-17T05:26:18.497143+0000","last_became_active":"2024-09-17T05:26:16.334509+0000","last_became_peered":"2024-09-17T05:26:16.334509+0000","last_unstale":"2024-09-17T05:26:18.497143+0000","last_undegraded":"2024-09-17T05:26:18.497143+0000","last_fullsized":"2024-09-17T05:26:18.497143+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:58.693199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495959+0000","last_change":"2024-09-17T05:26:17.320940+0000","last_active":"2024-09-17T05:26:18.495959+0000","last_peered":"2024-09-17T05:26:18.495959+0000","last_clean":"2024-09-17T05:26:18.495959+0000","last_became_active":"2024-09-17T05:26:17.320685+0000","last_became_peered":"2024-09-17T05:26:17.320685+0000","last_unstale":"2024-09-17T05:26:18.495959+0000","last_undegraded":"2024-09-17T05:26:18.495959+0000","last_fullsized":"2024-09-17T05:26:18.495959+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:25.435745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331837+0000","last_change":"2024-09-17T05:26:16.337132+0000","last_active":"2024-09-17T05:26:18.331837+0000","last_peered":"2024-09-17T05:26:18.331837+0000","last_clean":"2024-09-17T05:26:18.331837+0000","last_became_active":"2024-09-17T05:26:16.336762+0000","last_became_peered":"2024-09-17T05:26:16.336762+0000","last_unstale":"2024-09-17T05:26:18.331837+0000","last_undegraded":"2024-09-17T05:26:18.331837+0000","last_fullsized":"2024-09-17T05:26:18.331837+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:19.712957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331480+0000","last_change":"2024-09-17T05:26:17.321573+0000","last_active":"2024-09-17T05:26:18.331480+0000","last_peered":"2024-09-17T05:26:18.331480+0000","last_clean":"2024-09-17T05:26:18.331480+0000","last_became_active":"2024-09-17T05:26:17.321223+0000","last_became_peered":"2024-09-17T05:26:17.321223+0000","last_unstale":"2024-09-17T05:26:18.331480+0000","last_undegraded":"2024-09-17T05:26:18.331480+0000","last_fullsized":"2024-09-17T05:26:18.331480+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:08.108949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496245+0000","last_change":"2024-09-17T05:26:16.338072+0000","last_active":"2024-09-17T05:26:18.496245+0000","last_peered":"2024-09-17T05:26:18.496245+0000","last_clean":"2024-09-17T05:26:18.496245+0000","last_became_active":"2024-09-17T05:26:16.337765+0000","last_became_peered":"2024-09-17T05:26:16.337765+0000","last_unstale":"2024-09-17T05:26:18.496245+0000","last_undegraded":"2024-09-17T05:26:18.496245+0000","last_fullsized":"2024-09-17T05:26:18.496245+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:22.478789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496375+0000","last_change":"2024-09-17T05:26:17.328224+0000","last_active":"2024-09-17T05:26:18.496375+0000","last_peered":"2024-09-17T05:26:18.496375+0000","last_clean":"2024-09-17T05:26:18.496375+0000","last_became_active":"2024-09-17T05:26:17.326433+0000","last_became_peered":"2024-09-17T05:26:17.326433+0000","last_unstale":"2024-09-17T05:26:18.496375+0000","last_undegraded":"2024-09-17T05:26:18.496375+0000","last_fullsized":"2024-09-17T05:26:18.496375+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:33.422558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496461+0000","last_change":"2024-09-17T05:26:16.337362+0000","last_active":"2024-09-17T05:26:18.496461+0000","last_peered":"2024-09-17T05:26:18.496461+0000","last_clean":"2024-09-17T05:26:18.496461+0000","last_became_active":"2024-09-17T05:26:16.337065+0000","last_became_peered":"2024-09-17T05:26:16.337065+0000","last_unstale":"2024-09-17T05:26:18.496461+0000","last_undegraded":"2024-09-17T05:26:18.496461+0000","last_fullsized":"2024-09-17T05:26:18.496461+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:06.115037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331475+0000","last_change":"2024-09-17T05:26:17.319781+0000","last_active":"2024-09-17T05:26:18.331475+0000","last_peered":"2024-09-17T05:26:18.331475+0000","last_clean":"2024-09-17T05:26:18.331475+0000","last_became_active":"2024-09-17T05:26:17.319278+0000","last_became_peered":"2024-09-17T05:26:17.319278+0000","last_unstale":"2024-09-17T05:26:18.331475+0000","last_undegraded":"2024-09-17T05:26:18.331475+0000","last_fullsized":"2024-09-17T05:26:18.331475+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:48.895644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.314586+0000","last_change":"2024-09-17T05:26:16.339720+0000","last_active":"2024-09-17T05:26:18.314586+0000","last_peered":"2024-09-17T05:26:18.314586+0000","last_clean":"2024-09-17T05:26:18.314586+0000","last_became_active":"2024-09-17T05:26:16.339438+0000","last_became_peered":"2024-09-17T05:26:16.339438+0000","last_unstale":"2024-09-17T05:26:18.314586+0000","last_undegraded":"2024-09-17T05:26:18.314586+0000","last_fullsized":"2024-09-17T05:26:18.314586+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:26.348053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331740+0000","last_change":"2024-09-17T05:26:17.320107+0000","last_active":"2024-09-17T05:26:18.331740+0000","last_peered":"2024-09-17T05:26:18.331740+0000","last_clean":"2024-09-17T05:26:18.331740+0000","last_became_active":"2024-09-17T05:26:17.319838+0000","last_became_peered":"2024-09-17T05:26:17.319838+0000","last_unstale":"2024-09-17T05:26:18.331740+0000","last_undegraded":"2024-09-17T05:26:18.331740+0000","last_fullsized":"2024-09-17T05:26:18.331740+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:07.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495584+0000","last_change":"2024-09-17T05:26:16.336869+0000","last_active":"2024-09-17T05:26:18.495584+0000","last_peered":"2024-09-17T05:26:18.495584+0000","last_clean":"2024-09-17T05:26:18.495584+0000","last_became_active":"2024-09-17T05:26:16.336610+0000","last_became_peered":"2024-09-17T05:26:16.336610+0000","last_unstale":"2024-09-17T05:26:18.495584+0000","last_undegraded":"2024-09-17T05:26:18.495584+0000","last_fullsized":"2024-09-17T05:26:18.495584+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:39.789936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496682+0000","last_change":"2024-09-17T05:26:17.320355+0000","last_active":"2024-09-17T05:26:18.496682+0000","last_peered":"2024-09-17T05:26:18.496682+0000","last_clean":"2024-09-17T05:26:18.496682+0000","last_became_active":"2024-09-17T05:26:17.320099+0000","last_became_peered":"2024-09-17T05:26:17.320099+0000","last_unstale":"2024-09-17T05:26:18.496682+0000","last_undegraded":"2024-09-17T05:26:18.496682+0000","last_fullsized":"2024-09-17T05:26:18.496682+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:48.599435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315965+0000","last_change":"2024-09-17T05:26:16.337467+0000","last_active":"2024-09-17T05:26:18.315965+0000","last_peered":"2024-09-17T05:26:18.315965+0000","last_clean":"2024-09-17T05:26:18.315965+0000","last_became_active":"2024-09-17T05:26:16.337196+0000","last_became_peered":"2024-09-17T05:26:16.337196+0000","last_unstale":"2024-09-17T05:26:18.315965+0000","last_undegraded":"2024-09-17T05:26:18.315965+0000","last_fullsized":"2024-09-17T05:26:18.315965+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:56.584963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331793+0000","last_change":"2024-09-17T05:26:17.323928+0000","last_active":"2024-09-17T05:26:18.331793+0000","last_peered":"2024-09-17T05:26:18.331793+0000","last_clean":"2024-09-17T05:26:18.331793+0000","last_became_active":"2024-09-17T05:26:17.323619+0000","last_became_peered":"2024-09-17T05:26:17.323619+0000","last_unstale":"2024-09-17T05:26:18.331793+0000","last_undegraded":"2024-09-17T05:26:18.331793+0000","last_fullsized":"2024-09-17T05:26:18.331793+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:37.217684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"161'3","reported_seq":18,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496284+0000","last_change":"2024-09-17T05:26:16.331947+0000","last_active":"2024-09-17T05:26:18.496284+0000","last_peered":"2024-09-17T05:26:18.496284+0000","last_clean":"2024-09-17T05:26:18.496284+0000","last_became_active":"2024-09-17T05:26:16.331637+0000","last_became_peered":"2024-09-17T05:26:16.331637+0000","last_unstale":"2024-09-17T05:26:18.496284+0000","last_undegraded":"2024-09-17T05:26:18.496284+0000","last_fullsized":"2024-09-17T05:26:18.496284+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:10.020027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316427+0000","last_change":"2024-09-17T05:26:17.325171+0000","last_active":"2024-09-17T05:26:18.316427+0000","last_peered":"2024-09-17T05:26:18.316427+0000","last_clean":"2024-09-17T05:26:18.316427+0000","last_became_active":"2024-09-17T05:26:17.324878+0000","last_became_peered":"2024-09-17T05:26:17.324878+0000","last_unstale":"2024-09-17T05:26:18.316427+0000","last_undegraded":"2024-09-17T05:26:18.316427+0000","last_fullsized":"2024-09-17T05:26:18.316427+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:42.574995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"161'6","reported_seq":21,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331932+0000","last_change":"2024-09-17T05:26:16.338543+0000","last_active":"2024-09-17T05:26:18.331932+0000","last_peered":"2024-09-17T05:26:18.331932+0000","last_clean":"2024-09-17T05:26:18.331932+0000","last_became_active":"2024-09-17T05:26:16.338259+0000","last_became_peered":"2024-09-17T05:26:16.338259+0000","last_unstale":"2024-09-17T05:26:18.331932+0000","last_undegraded":"2024-09-17T05:26:18.331932+0000","last_fullsized":"2024-09-17T05:26:18.331932+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:00.391327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496186+0000","last_change":"2024-09-17T05:26:17.324969+0000","last_active":"2024-09-17T05:26:18.496186+0000","last_peered":"2024-09-17T05:26:18.496186+0000","last_clean":"2024-09-17T05:26:18.496186+0000","last_became_active":"2024-09-17T05:26:17.324704+0000","last_became_peered":"2024-09-17T05:26:17.324704+0000","last_unstale":"2024-09-17T05:26:18.496186+0000","last_undegraded":"2024-09-17T05:26:18.496186+0000","last_fullsized":"2024-09-17T05:26:18.496186+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:34.296534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315659+0000","last_change":"2024-09-17T05:26:16.339808+0000","last_active":"2024-09-17T05:26:18.315659+0000","last_peered":"2024-09-17T05:26:18.315659+0000","last_clean":"2024-09-17T05:26:18.315659+0000","last_became_active":"2024-09-17T05:26:16.339537+0000","last_became_peered":"2024-09-17T05:26:16.339537+0000","last_unstale":"2024-09-17T05:26:18.315659+0000","last_undegraded":"2024-09-17T05:26:18.315659+0000","last_fullsized":"2024-09-17T05:26:18.315659+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:35.534305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496327+0000","last_change":"2024-09-17T05:26:17.310608+0000","last_active":"2024-09-17T05:26:18.496327+0000","last_peered":"2024-09-17T05:26:18.496327+0000","last_clean":"2024-09-17T05:26:18.496327+0000","last_became_active":"2024-09-17T05:26:17.310317+0000","last_became_peered":"2024-09-17T05:26:17.310317+0000","last_unstale":"2024-09-17T05:26:18.496327+0000","last_undegraded":"2024-09-17T05:26:18.496327+0000","last_fullsized":"2024-09-17T05:26:18.496327+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:44.814036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315834+0000","last_change":"2024-09-17T05:26:16.336631+0000","last_active":"2024-09-17T05:26:18.315834+0000","last_peered":"2024-09-17T05:26:18.315834+0000","last_clean":"2024-09-17T05:26:18.315834+0000","last_became_active":"2024-09-17T05:26:16.336344+0000","last_became_peered":"2024-09-17T05:26:16.336344+0000","last_unstale":"2024-09-17T05:26:18.315834+0000","last_undegraded":"2024-09-17T05:26:18.315834+0000","last_fullsized":"2024-09-17T05:26:18.315834+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:54.238271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495502+0000","last_change":"2024-09-17T05:26:17.323552+0000","last_active":"2024-09-17T05:26:18.495502+0000","last_peered":"2024-09-17T05:26:18.495502+0000","last_clean":"2024-09-17T05:26:18.495502+0000","last_became_active":"2024-09-17T05:26:17.323278+0000","last_became_peered":"2024-09-17T05:26:17.323278+0000","last_unstale":"2024-09-17T05:26:18.495502+0000","last_undegraded":"2024-09-17T05:26:18.495502+0000","last_fullsized":"2024-09-17T05:26:18.495502+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:22.900502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495606+0000","last_change":"2024-09-17T05:26:16.330420+0000","last_active":"2024-09-17T05:26:18.495606+0000","last_peered":"2024-09-17T05:26:18.495606+0000","last_clean":"2024-09-17T05:26:18.495606+0000","last_became_active":"2024-09-17T05:26:16.330165+0000","last_became_peered":"2024-09-17T05:26:16.330165+0000","last_unstale":"2024-09-17T05:26:18.495606+0000","last_undegraded":"2024-09-17T05:26:18.495606+0000","last_fullsized":"2024-09-17T05:26:18.495606+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:33.294363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316277+0000","last_change":"2024-09-17T05:26:17.316147+0000","last_active":"2024-09-17T05:26:18.316277+0000","last_peered":"2024-09-17T05:26:18.316277+0000","last_clean":"2024-09-17T05:26:18.316277+0000","last_became_active":"2024-09-17T05:26:17.315852+0000","last_became_peered":"2024-09-17T05:26:17.315852+0000","last_unstale":"2024-09-17T05:26:18.316277+0000","last_undegraded":"2024-09-17T05:26:18.316277+0000","last_fullsized":"2024-09-17T05:26:18.316277+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:48.795102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"161'8","reported_seq":23,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495609+0000","last_change":"2024-09-17T05:26:16.336370+0000","last_active":"2024-09-17T05:26:18.495609+0000","last_peered":"2024-09-17T05:26:18.495609+0000","last_clean":"2024-09-17T05:26:18.495609+0000","last_became_active":"2024-09-17T05:26:16.336096+0000","last_became_peered":"2024-09-17T05:26:16.336096+0000","last_unstale":"2024-09-17T05:26:18.495609+0000","last_undegraded":"2024-09-17T05:26:18.495609+0000","last_fullsized":"2024-09-17T05:26:18.495609+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:40.170007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496336+0000","last_change":"2024-09-17T05:26:17.315518+0000","last_active":"2024-09-17T05:26:18.496336+0000","last_peered":"2024-09-17T05:26:18.496336+0000","last_clean":"2024-09-17T05:26:18.496336+0000","last_became_active":"2024-09-17T05:26:17.315230+0000","last_became_peered":"2024-09-17T05:26:17.315230+0000","last_unstale":"2024-09-17T05:26:18.496336+0000","last_undegraded":"2024-09-17T05:26:18.496336+0000","last_fullsized":"2024-09-17T05:26:18.496336+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:57.093965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495689+0000","last_change":"2024-09-17T05:26:16.334935+0000","last_active":"2024-09-17T05:26:18.495689+0000","last_peered":"2024-09-17T05:26:18.495689+0000","last_clean":"2024-09-17T05:26:18.495689+0000","last_became_active":"2024-09-17T05:26:16.334665+0000","last_became_peered":"2024-09-17T05:26:16.334665+0000","last_unstale":"2024-09-17T05:26:18.495689+0000","last_undegraded":"2024-09-17T05:26:18.495689+0000","last_fullsized":"2024-09-17T05:26:18.495689+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:29.571006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496164+0000","last_change":"2024-09-17T05:26:17.317264+0000","last_active":"2024-09-17T05:26:18.496164+0000","last_peered":"2024-09-17T05:26:18.496164+0000","last_clean":"2024-09-17T05:26:18.496164+0000","last_became_active":"2024-09-17T05:26:17.316639+0000","last_became_peered":"2024-09-17T05:26:17.316639+0000","last_unstale":"2024-09-17T05:26:18.496164+0000","last_undegraded":"2024-09-17T05:26:18.496164+0000","last_fullsized":"2024-09-17T05:26:18.496164+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:20.236025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496433+0000","last_change":"2024-09-17T05:26:16.340027+0000","last_active":"2024-09-17T05:26:18.496433+0000","last_peered":"2024-09-17T05:26:18.496433+0000","last_clean":"2024-09-17T05:26:18.496433+0000","last_became_active":"2024-09-17T05:26:16.339738+0000","last_became_peered":"2024-09-17T05:26:16.339738+0000","last_unstale":"2024-09-17T05:26:18.496433+0000","last_undegraded":"2024-09-17T05:26:18.496433+0000","last_fullsized":"2024-09-17T05:26:18.496433+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:45.889335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496875+0000","last_change":"2024-09-17T05:26:17.316922+0000","last_active":"2024-09-17T05:26:18.496875+0000","last_peered":"2024-09-17T05:26:18.496875+0000","last_clean":"2024-09-17T05:26:18.496875+0000","last_became_active":"2024-09-17T05:26:17.316669+0000","last_became_peered":"2024-09-17T05:26:17.316669+0000","last_unstale":"2024-09-17T05:26:18.496875+0000","last_undegraded":"2024-09-17T05:26:18.496875+0000","last_fullsized":"2024-09-17T05:26:18.496875+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:04.178773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496334+0000","last_change":"2024-09-17T05:26:16.335751+0000","last_active":"2024-09-17T05:26:18.496334+0000","last_peered":"2024-09-17T05:26:18.496334+0000","last_clean":"2024-09-17T05:26:18.496334+0000","last_became_active":"2024-09-17T05:26:16.335502+0000","last_became_peered":"2024-09-17T05:26:16.335502+0000","last_unstale":"2024-09-17T05:26:18.496334+0000","last_undegraded":"2024-09-17T05:26:18.496334+0000","last_fullsized":"2024-09-17T05:26:18.496334+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:14.655198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496113+0000","last_change":"2024-09-17T05:26:17.315622+0000","last_active":"2024-09-17T05:26:18.496113+0000","last_peered":"2024-09-17T05:26:18.496113+0000","last_clean":"2024-09-17T05:26:18.496113+0000","last_became_active":"2024-09-17T05:26:17.315183+0000","last_became_peered":"2024-09-17T05:26:17.315183+0000","last_unstale":"2024-09-17T05:26:18.496113+0000","last_undegraded":"2024-09-17T05:26:18.496113+0000","last_fullsized":"2024-09-17T05:26:18.496113+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:22.301835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496916+0000","last_change":"2024-09-17T05:26:16.334148+0000","last_active":"2024-09-17T05:26:18.496916+0000","last_peered":"2024-09-17T05:26:18.496916+0000","last_clean":"2024-09-17T05:26:18.496916+0000","last_became_active":"2024-09-17T05:26:16.333853+0000","last_became_peered":"2024-09-17T05:26:16.333853+0000","last_unstale":"2024-09-17T05:26:18.496916+0000","last_undegraded":"2024-09-17T05:26:18.496916+0000","last_fullsized":"2024-09-17T05:26:18.496916+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:29.767115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495889+0000","last_change":"2024-09-17T05:26:17.318271+0000","last_active":"2024-09-17T05:26:18.495889+0000","last_peered":"2024-09-17T05:26:18.495889+0000","last_clean":"2024-09-17T05:26:18.495889+0000","last_became_active":"2024-09-17T05:26:17.318012+0000","last_became_peered":"2024-09-17T05:26:17.318012+0000","last_unstale":"2024-09-17T05:26:18.495889+0000","last_undegraded":"2024-09-17T05:26:18.495889+0000","last_fullsized":"2024-09-17T05:26:18.495889+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:19.230476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496000+0000","last_change":"2024-09-17T05:26:16.331444+0000","last_active":"2024-09-17T05:26:18.496000+0000","last_peered":"2024-09-17T05:26:18.496000+0000","last_clean":"2024-09-17T05:26:18.496000+0000","last_became_active":"2024-09-17T05:26:16.331196+0000","last_became_peered":"2024-09-17T05:26:16.331196+0000","last_unstale":"2024-09-17T05:26:18.496000+0000","last_undegraded":"2024-09-17T05:26:18.496000+0000","last_fullsized":"2024-09-17T05:26:18.496000+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:32.420387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496566+0000","last_change":"2024-09-17T05:26:17.321647+0000","last_active":"2024-09-17T05:26:18.496566+0000","last_peered":"2024-09-17T05:26:18.496566+0000","last_clean":"2024-09-17T05:26:18.496566+0000","last_became_active":"2024-09-17T05:26:17.321261+0000","last_became_peered":"2024-09-17T05:26:17.321261+0000","last_unstale":"2024-09-17T05:26:18.496566+0000","last_undegraded":"2024-09-17T05:26:18.496566+0000","last_fullsized":"2024-09-17T05:26:18.496566+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:05.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316407+0000","last_change":"2024-09-17T05:26:16.330559+0000","last_active":"2024-09-17T05:26:18.316407+0000","last_peered":"2024-09-17T05:26:18.316407+0000","last_clean":"2024-09-17T05:26:18.316407+0000","last_became_active":"2024-09-17T05:26:16.330282+0000","last_became_peered":"2024-09-17T05:26:16.330282+0000","last_unstale":"2024-09-17T05:26:18.316407+0000","last_undegraded":"2024-09-17T05:26:18.316407+0000","last_fullsized":"2024-09-17T05:26:18.316407+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:24.504016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495796+0000","last_change":"2024-09-17T05:26:17.320818+0000","last_active":"2024-09-17T05:26:18.495796+0000","last_peered":"2024-09-17T05:26:18.495796+0000","last_clean":"2024-09-17T05:26:18.495796+0000","last_became_active":"2024-09-17T05:26:17.320545+0000","last_became_peered":"2024-09-17T05:26:17.320545+0000","last_unstale":"2024-09-17T05:26:18.495796+0000","last_undegraded":"2024-09-17T05:26:18.495796+0000","last_fullsized":"2024-09-17T05:26:18.495796+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:06.709266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316162+0000","last_change":"2024-09-17T05:26:16.336861+0000","last_active":"2024-09-17T05:26:18.316162+0000","last_peered":"2024-09-17T05:26:18.316162+0000","last_clean":"2024-09-17T05:26:18.316162+0000","last_became_active":"2024-09-17T05:26:16.336548+0000","last_became_peered":"2024-09-17T05:26:16.336548+0000","last_unstale":"2024-09-17T05:26:18.316162+0000","last_undegraded":"2024-09-17T05:26:18.316162+0000","last_fullsized":"2024-09-17T05:26:18.316162+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:01.639201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315264+0000","last_change":"2024-09-17T05:26:17.326365+0000","last_active":"2024-09-17T05:26:18.315264+0000","last_peered":"2024-09-17T05:26:18.315264+0000","last_clean":"2024-09-17T05:26:18.315264+0000","last_became_active":"2024-09-17T05:26:17.326074+0000","last_became_peered":"2024-09-17T05:26:17.326074+0000","last_unstale":"2024-09-17T05:26:18.315264+0000","last_undegraded":"2024-09-17T05:26:18.315264+0000","last_fullsized":"2024-09-17T05:26:18.315264+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:33.170367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496441+0000","last_change":"2024-09-17T05:26:16.334948+0000","last_active":"2024-09-17T05:26:18.496441+0000","last_peered":"2024-09-17T05:26:18.496441+0000","last_clean":"2024-09-17T05:26:18.496441+0000","last_became_active":"2024-09-17T05:26:16.334692+0000","last_became_peered":"2024-09-17T05:26:16.334692+0000","last_unstale":"2024-09-17T05:26:18.496441+0000","last_undegraded":"2024-09-17T05:26:18.496441+0000","last_fullsized":"2024-09-17T05:26:18.496441+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:28.014606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315441+0000","last_change":"2024-09-17T05:26:17.317796+0000","last_active":"2024-09-17T05:26:18.315441+0000","last_peered":"2024-09-17T05:26:18.315441+0000","last_clean":"2024-09-17T05:26:18.315441+0000","last_became_active":"2024-09-17T05:26:17.317491+0000","last_became_peered":"2024-09-17T05:26:17.317491+0000","last_unstale":"2024-09-17T05:26:18.315441+0000","last_undegraded":"2024-09-17T05:26:18.315441+0000","last_fullsized":"2024-09-17T05:26:18.315441+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:29.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496792+0000","last_change":"2024-09-17T05:26:16.333065+0000","last_active":"2024-09-17T05:26:18.496792+0000","last_peered":"2024-09-17T05:26:18.496792+0000","last_clean":"2024-09-17T05:26:18.496792+0000","last_became_active":"2024-09-17T05:26:16.332805+0000","last_became_peered":"2024-09-17T05:26:16.332805+0000","last_unstale":"2024-09-17T05:26:18.496792+0000","last_undegraded":"2024-09-17T05:26:18.496792+0000","last_fullsized":"2024-09-17T05:26:18.496792+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:58.251903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316524+0000","last_change":"2024-09-17T05:26:17.325653+0000","last_active":"2024-09-17T05:26:18.316524+0000","last_peered":"2024-09-17T05:26:18.316524+0000","last_clean":"2024-09-17T05:26:18.316524+0000","last_became_active":"2024-09-17T05:26:17.324385+0000","last_became_peered":"2024-09-17T05:26:17.324385+0000","last_unstale":"2024-09-17T05:26:18.316524+0000","last_undegraded":"2024-09-17T05:26:18.316524+0000","last_fullsized":"2024-09-17T05:26:18.316524+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:16.174696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"162'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.332948+0000","last_change":"2024-09-17T05:26:16.337420+0000","last_active":"2024-09-17T05:26:18.332948+0000","last_peered":"2024-09-17T05:26:18.332948+0000","last_clean":"2024-09-17T05:26:18.332948+0000","last_became_active":"2024-09-17T05:26:16.337160+0000","last_became_peered":"2024-09-17T05:26:16.337160+0000","last_unstale":"2024-09-17T05:26:18.332948+0000","last_undegraded":"2024-09-17T05:26:18.332948+0000","last_fullsized":"2024-09-17T05:26:18.332948+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:05.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495955+0000","last_change":"2024-09-17T05:26:17.324770+0000","last_active":"2024-09-17T05:26:18.495955+0000","last_peered":"2024-09-17T05:26:18.495955+0000","last_clean":"2024-09-17T05:26:18.495955+0000","last_became_active":"2024-09-17T05:26:17.324479+0000","last_became_peered":"2024-09-17T05:26:17.324479+0000","last_unstale":"2024-09-17T05:26:18.495955+0000","last_undegraded":"2024-09-17T05:26:18.495955+0000","last_fullsized":"2024-09-17T05:26:18.495955+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:28.352126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495881+0000","last_change":"2024-09-17T05:26:16.338139+0000","last_active":"2024-09-17T05:26:18.495881+0000","last_peered":"2024-09-17T05:26:18.495881+0000","last_clean":"2024-09-17T05:26:18.495881+0000","last_became_active":"2024-09-17T05:26:16.337795+0000","last_became_peered":"2024-09-17T05:26:16.337795+0000","last_unstale":"2024-09-17T05:26:18.495881+0000","last_undegraded":"2024-09-17T05:26:18.495881+0000","last_fullsized":"2024-09-17T05:26:18.495881+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:43.106698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315915+0000","last_change":"2024-09-17T05:26:17.326916+0000","last_active":"2024-09-17T05:26:18.315915+0000","last_peered":"2024-09-17T05:26:18.315915+0000","last_clean":"2024-09-17T05:26:18.315915+0000","last_became_active":"2024-09-17T05:26:17.326619+0000","last_became_peered":"2024-09-17T05:26:17.326619+0000","last_unstale":"2024-09-17T05:26:18.315915+0000","last_undegraded":"2024-09-17T05:26:18.315915+0000","last_fullsized":"2024-09-17T05:26:18.315915+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:25.187926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496948+0000","last_change":"2024-09-17T05:26:16.336632+0000","last_active":"2024-09-17T05:26:18.496948+0000","last_peered":"2024-09-17T05:26:18.496948+0000","last_clean":"2024-09-17T05:26:18.496948+0000","last_became_active":"2024-09-17T05:26:16.336372+0000","last_became_peered":"2024-09-17T05:26:16.336372+0000","last_unstale":"2024-09-17T05:26:18.496948+0000","last_undegraded":"2024-09-17T05:26:18.496948+0000","last_fullsized":"2024-09-17T05:26:18.496948+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:49.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316363+0000","last_change":"2024-09-17T05:26:17.322854+0000","last_active":"2024-09-17T05:26:18.316363+0000","last_peered":"2024-09-17T05:26:18.316363+0000","last_clean":"2024-09-17T05:26:18.316363+0000","last_became_active":"2024-09-17T05:26:17.322536+0000","last_became_peered":"2024-09-17T05:26:17.322536+0000","last_unstale":"2024-09-17T05:26:18.316363+0000","last_undegraded":"2024-09-17T05:26:18.316363+0000","last_fullsized":"2024-09-17T05:26:18.316363+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:54.495060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331602+0000","last_change":"2024-09-17T05:26:16.335386+0000","last_active":"2024-09-17T05:26:18.331602+0000","last_peered":"2024-09-17T05:26:18.331602+0000","last_clean":"2024-09-17T05:26:18.331602+0000","last_became_active":"2024-09-17T05:26:16.335083+0000","last_became_peered":"2024-09-17T05:26:16.335083+0000","last_unstale":"2024-09-17T05:26:18.331602+0000","last_undegraded":"2024-09-17T05:26:18.331602+0000","last_fullsized":"2024-09-17T05:26:18.331602+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:45.537266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315096+0000","last_change":"2024-09-17T05:26:17.309090+0000","last_active":"2024-09-17T05:26:18.315096+0000","last_peered":"2024-09-17T05:26:18.315096+0000","last_clean":"2024-09-17T05:26:18.315096+0000","last_became_active":"2024-09-17T05:26:17.308805+0000","last_became_peered":"2024-09-17T05:26:17.308805+0000","last_unstale":"2024-09-17T05:26:18.315096+0000","last_undegraded":"2024-09-17T05:26:18.315096+0000","last_fullsized":"2024-09-17T05:26:18.315096+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.346263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496293+0000","last_change":"2024-09-17T05:26:16.339645+0000","last_active":"2024-09-17T05:26:18.496293+0000","last_peered":"2024-09-17T05:26:18.496293+0000","last_clean":"2024-09-17T05:26:18.496293+0000","last_became_active":"2024-09-17T05:26:16.339378+0000","last_became_peered":"2024-09-17T05:26:16.339378+0000","last_unstale":"2024-09-17T05:26:18.496293+0000","last_undegraded":"2024-09-17T05:26:18.496293+0000","last_fullsized":"2024-09-17T05:26:18.496293+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:43.966885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495955+0000","last_change":"2024-09-17T05:26:17.321848+0000","last_active":"2024-09-17T05:26:18.495955+0000","last_peered":"2024-09-17T05:26:18.495955+0000","last_clean":"2024-09-17T05:26:18.495955+0000","last_became_active":"2024-09-17T05:26:17.321619+0000","last_became_peered":"2024-09-17T05:26:17.321619+0000","last_unstale":"2024-09-17T05:26:18.495955+0000","last_undegraded":"2024-09-17T05:26:18.495955+0000","last_fullsized":"2024-09-17T05:26:18.495955+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:30.039634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315440+0000","last_change":"2024-09-17T05:26:16.338229+0000","last_active":"2024-09-17T05:26:18.315440+0000","last_peered":"2024-09-17T05:26:18.315440+0000","last_clean":"2024-09-17T05:26:18.315440+0000","last_became_active":"2024-09-17T05:26:16.337925+0000","last_became_peered":"2024-09-17T05:26:16.337925+0000","last_unstale":"2024-09-17T05:26:18.315440+0000","last_undegraded":"2024-09-17T05:26:18.315440+0000","last_fullsized":"2024-09-17T05:26:18.315440+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:16.431945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495855+0000","last_change":"2024-09-17T05:26:17.310582+0000","last_active":"2024-09-17T05:26:18.495855+0000","last_peered":"2024-09-17T05:26:18.495855+0000","last_clean":"2024-09-17T05:26:18.495855+0000","last_became_active":"2024-09-17T05:26:17.310306+0000","last_became_peered":"2024-09-17T05:26:17.310306+0000","last_unstale":"2024-09-17T05:26:18.495855+0000","last_undegraded":"2024-09-17T05:26:18.495855+0000","last_fullsized":"2024-09-17T05:26:18.495855+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:25.861610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.314756+0000","last_change":"2024-09-17T05:26:16.335978+0000","last_active":"2024-09-17T05:26:18.314756+0000","last_peered":"2024-09-17T05:26:18.314756+0000","last_clean":"2024-09-17T05:26:18.314756+0000","last_became_active":"2024-09-17T05:26:16.335698+0000","last_became_peered":"2024-09-17T05:26:16.335698+0000","last_unstale":"2024-09-17T05:26:18.314756+0000","last_undegraded":"2024-09-17T05:26:18.314756+0000","last_fullsized":"2024-09-17T05:26:18.314756+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:23.463629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316310+0000","last_change":"2024-09-17T05:26:17.325356+0000","last_active":"2024-09-17T05:26:18.316310+0000","last_peered":"2024-09-17T05:26:18.316310+0000","last_clean":"2024-09-17T05:26:18.316310+0000","last_became_active":"2024-09-17T05:26:17.324958+0000","last_became_peered":"2024-09-17T05:26:17.324958+0000","last_unstale":"2024-09-17T05:26:18.316310+0000","last_undegraded":"2024-09-17T05:26:18.316310+0000","last_fullsized":"2024-09-17T05:26:18.316310+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:49.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315226+0000","last_change":"2024-09-17T05:26:16.334688+0000","last_active":"2024-09-17T05:26:18.315226+0000","last_peered":"2024-09-17T05:26:18.315226+0000","last_clean":"2024-09-17T05:26:18.315226+0000","last_became_active":"2024-09-17T05:26:16.334397+0000","last_became_peered":"2024-09-17T05:26:16.334397+0000","last_unstale":"2024-09-17T05:26:18.315226+0000","last_undegraded":"2024-09-17T05:26:18.315226+0000","last_fullsized":"2024-09-17T05:26:18.315226+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:05.707095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":389,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331235+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:26:18.331235+0000","last_peered":"2024-09-17T05:26:18.331235+0000","last_clean":"2024-09-17T05:26:18.331235+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:26:18.331235+0000","last_undegraded":"2024-09-17T05:26:18.331235+0000","last_fullsized":"2024-09-17T05:26:18.331235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33776,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338064,"statfs":{"total":96636764160,"available":96602177536,"internally_reserved":0,"allocated":2646016,"data_stored":1493156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2043904,"data_stored":901758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509536,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2043904,"data_stored":901758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509536,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":902892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":901358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2039808,"data_stored":901176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509536,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2048000,"data_stored":901232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37932,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333908,"statfs":{"total":96636764160,"available":96597921792,"internally_reserved":0,"allocated":2637824,"data_stored":1491634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:26:20.830 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:26:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 -- 172.21.15.81:0/2003823458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac06ff80 msgr2=0x7f8bac070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.968 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 --2- 172.21.15.81:0/2003823458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac06ff80 0x7f8bac070410 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4005fd0 tx=0x7f8ba402aa10 comp rx=0 tx=0).stop 2024-09-17T05:26:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 -- 172.21.15.81:0/2003823458 shutdown_connections 2024-09-17T05:26:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 --2- 172.21.15.81:0/2003823458 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac06ff80 0x7f8bac070410 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 --2- 172.21.15.81:0/2003823458 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bac0735a0 0x7f8bac0739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 -- 172.21.15.81:0/2003823458 >> 172.21.15.81:0/2003823458 conn(0x7f8bac0b1690 msgr2=0x7f8bac0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 -- 172.21.15.81:0/2003823458 shutdown_connections 2024-09-17T05:26:20.969 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.967+0000 7f8bb276b640 1 -- 172.21.15.81:0/2003823458 wait complete. 2024-09-17T05:26:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.968+0000 7f8bb276b640 1 Processor -- start 2024-09-17T05:26:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.968+0000 7f8bb276b640 1 -- start start 2024-09-17T05:26:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bb276b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bac06ff80 0x7f8bac14d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bb276b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac0735a0 0x7f8bac1568f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bb276b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bac15aa70 0x7f8bac1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.971 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bb276b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac0cd270 con 0x7f8bac0735a0 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bb276b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8bac0cd0f0 con 0x7f8bac15aa70 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bb276b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8bac0cd3f0 con 0x7f8bac06ff80 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac0735a0 0x7f8bac1568f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac0735a0 0x7f8bac1568f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34232/0 (socket says 172.21.15.81:34232) 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 -- 172.21.15.81:0/676067325 learned_addr learned my addr 172.21.15.81:0/676067325 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8babfff640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bac06ff80 0x7f8bac14d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bb0d08640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bac15aa70 0x7f8bac1494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 -- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bac06ff80 msgr2=0x7f8bac14d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bac06ff80 0x7f8bac14d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 -- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bac15aa70 msgr2=0x7f8bac1494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:20.972 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bac15aa70 0x7f8bac1494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8bab7fe640 1 -- 172.21.15.81:0/676067325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bac156430 con 0x7f8bac0735a0 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.969+0000 7f8babfff640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bac06ff80 0x7f8bac14d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.970+0000 7f8bab7fe640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac0735a0 0x7f8bac1568f0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400d770 tx=0x7f8b9400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.970+0000 7f8ba8ff9640 1 -- 172.21.15.81:0/676067325 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94017070 con 0x7f8bac0735a0 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.970+0000 7f8ba8ff9640 1 -- 172.21.15.81:0/676067325 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b94009d20 con 0x7f8bac0735a0 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.970+0000 7f8ba8ff9640 1 -- 172.21.15.81:0/676067325 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b94005280 con 0x7f8bac0735a0 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.970+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bac0cbeb0 con 0x7f8bac0735a0 2024-09-17T05:26:20.973 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.970+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bac15de00 con 0x7f8bac0735a0 2024-09-17T05:26:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.971+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bac0cd910 con 0x7f8bac0735a0 2024-09-17T05:26:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.971+0000 7f8ba8ff9640 1 -- 172.21.15.81:0/676067325 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f8b94005420 con 0x7f8bac0735a0 2024-09-17T05:26:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.972+0000 7f8ba8ff9640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b8c0795b0 0x7f8b8c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.972+0000 7f8babfff640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b8c0795b0 0x7f8b8c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.972+0000 7f8ba8ff9640 1 -- 172.21.15.81:0/676067325 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f8b940998b0 con 0x7f8bac0735a0 2024-09-17T05:26:20.974 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.972+0000 7f8babfff640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b8c0795b0 0x7f8b8c07ba70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8bac155070 tx=0x7f8b9c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:20.977 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:20.976+0000 7f8ba8ff9640 1 -- 172.21.15.81:0/676067325 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8bac156430 con 0x7f8bac0735a0 2024-09-17T05:26:21.149 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.148+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f8bac0cbc60 con 0x7f8b8c0795b0 2024-09-17T05:26:21.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.152+0000 7f8ba8ff9640 1 -- 172.21.15.81:0/676067325 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+252480 (secure 0 0 0) 0x7f8bac0cbc60 con 0x7f8b8c0795b0 2024-09-17T05:26:21.156 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:21.157 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:26:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b8c0795b0 msgr2=0x7f8b8c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b8c0795b0 0x7f8b8c07ba70 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f8bac155070 tx=0x7f8b9c009040 comp rx=0 tx=0).stop 2024-09-17T05:26:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac0735a0 msgr2=0x7f8bac1568f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac0735a0 0x7f8bac1568f0 secure :-1 s=READY pgs=1855 cs=0 l=1 rev1=1 crypto rx=0x7f8b9400d770 tx=0x7f8b9400dc30 comp rx=0 tx=0).stop 2024-09-17T05:26:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 shutdown_connections 2024-09-17T05:26:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b8c0795b0 0x7f8b8c07ba70 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8bac15aa70 0x7f8bac1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8bac0735a0 0x7f8bac1568f0 unknown :-1 s=CLOSED pgs=1855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.160 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 --2- 172.21.15.81:0/676067325 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8bac06ff80 0x7f8bac14d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 >> 172.21.15.81:0/676067325 conn(0x7f8bac0b1690 msgr2=0x7f8bac156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 shutdown_connections 2024-09-17T05:26:21.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.155+0000 7f8bb276b640 1 -- 172.21.15.81:0/676067325 wait complete. 2024-09-17T05:26:21.168 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":202,"stamp":"2024-09-17T05:26:20.064384+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592778,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":158,"num_write_kb":1642,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":118,"ondisk_log_size":118,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":128,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":270856,"kb_used_data":17160,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703864,"statfs":{"total":773094113280,"available":772816756736,"internally_reserved":0,"allocated":17571840,"data_stored":8394964,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.754687"},"pg_stats":[{"pgid":"27.3f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316416+0000","last_change":"2024-09-17T05:26:17.321606+0000","last_active":"2024-09-17T05:26:18.316416+0000","last_peered":"2024-09-17T05:26:18.316416+0000","last_clean":"2024-09-17T05:26:18.316416+0000","last_became_active":"2024-09-17T05:26:17.321367+0000","last_became_peered":"2024-09-17T05:26:17.321367+0000","last_unstale":"2024-09-17T05:26:18.316416+0000","last_undegraded":"2024-09-17T05:26:18.316416+0000","last_fullsized":"2024-09-17T05:26:18.316416+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:47:27.955244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.3e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496107+0000","last_change":"2024-09-17T05:26:17.323199+0000","last_active":"2024-09-17T05:26:18.496107+0000","last_peered":"2024-09-17T05:26:18.496107+0000","last_clean":"2024-09-17T05:26:18.496107+0000","last_became_active":"2024-09-17T05:26:17.321209+0000","last_became_peered":"2024-09-17T05:26:17.321209+0000","last_unstale":"2024-09-17T05:26:18.496107+0000","last_undegraded":"2024-09-17T05:26:18.496107+0000","last_fullsized":"2024-09-17T05:26:18.496107+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:28.122869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.3d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.497054+0000","last_change":"2024-09-17T05:26:17.320057+0000","last_active":"2024-09-17T05:26:18.497054+0000","last_peered":"2024-09-17T05:26:18.497054+0000","last_clean":"2024-09-17T05:26:18.497054+0000","last_became_active":"2024-09-17T05:26:17.319772+0000","last_became_peered":"2024-09-17T05:26:17.319772+0000","last_unstale":"2024-09-17T05:26:18.497054+0000","last_undegraded":"2024-09-17T05:26:18.497054+0000","last_fullsized":"2024-09-17T05:26:18.497054+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:51:38.694722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.3c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331742+0000","last_change":"2024-09-17T05:26:17.321686+0000","last_active":"2024-09-17T05:26:18.331742+0000","last_peered":"2024-09-17T05:26:18.331742+0000","last_clean":"2024-09-17T05:26:18.331742+0000","last_became_active":"2024-09-17T05:26:17.321180+0000","last_became_peered":"2024-09-17T05:26:17.321180+0000","last_unstale":"2024-09-17T05:26:18.331742+0000","last_undegraded":"2024-09-17T05:26:18.331742+0000","last_fullsized":"2024-09-17T05:26:18.331742+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:32:55.205634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496701+0000","last_change":"2024-09-17T05:26:17.317442+0000","last_active":"2024-09-17T05:26:18.496701+0000","last_peered":"2024-09-17T05:26:18.496701+0000","last_clean":"2024-09-17T05:26:18.496701+0000","last_became_active":"2024-09-17T05:26:17.317159+0000","last_became_peered":"2024-09-17T05:26:17.317159+0000","last_unstale":"2024-09-17T05:26:18.496701+0000","last_undegraded":"2024-09-17T05:26:18.496701+0000","last_fullsized":"2024-09-17T05:26:18.496701+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:11.022197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.3a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496070+0000","last_change":"2024-09-17T05:26:17.327035+0000","last_active":"2024-09-17T05:26:18.496070+0000","last_peered":"2024-09-17T05:26:18.496070+0000","last_clean":"2024-09-17T05:26:18.496070+0000","last_became_active":"2024-09-17T05:26:17.326744+0000","last_became_peered":"2024-09-17T05:26:17.326744+0000","last_unstale":"2024-09-17T05:26:18.496070+0000","last_undegraded":"2024-09-17T05:26:18.496070+0000","last_fullsized":"2024-09-17T05:26:18.496070+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:32:00.487998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.39","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316049+0000","last_change":"2024-09-17T05:26:17.321479+0000","last_active":"2024-09-17T05:26:18.316049+0000","last_peered":"2024-09-17T05:26:18.316049+0000","last_clean":"2024-09-17T05:26:18.316049+0000","last_became_active":"2024-09-17T05:26:17.321222+0000","last_became_peered":"2024-09-17T05:26:17.321222+0000","last_unstale":"2024-09-17T05:26:18.316049+0000","last_undegraded":"2024-09-17T05:26:18.316049+0000","last_fullsized":"2024-09-17T05:26:18.316049+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:42:01.149100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.38","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496182+0000","last_change":"2024-09-17T05:26:17.322608+0000","last_active":"2024-09-17T05:26:18.496182+0000","last_peered":"2024-09-17T05:26:18.496182+0000","last_clean":"2024-09-17T05:26:18.496182+0000","last_became_active":"2024-09-17T05:26:17.322345+0000","last_became_peered":"2024-09-17T05:26:17.322345+0000","last_unstale":"2024-09-17T05:26:18.496182+0000","last_undegraded":"2024-09-17T05:26:18.496182+0000","last_fullsized":"2024-09-17T05:26:18.496182+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:50:05.261609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.37","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496409+0000","last_change":"2024-09-17T05:26:17.312465+0000","last_active":"2024-09-17T05:26:18.496409+0000","last_peered":"2024-09-17T05:26:18.496409+0000","last_clean":"2024-09-17T05:26:18.496409+0000","last_became_active":"2024-09-17T05:26:17.312156+0000","last_became_peered":"2024-09-17T05:26:17.312156+0000","last_unstale":"2024-09-17T05:26:18.496409+0000","last_undegraded":"2024-09-17T05:26:18.496409+0000","last_fullsized":"2024-09-17T05:26:18.496409+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:40.437261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.36","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495919+0000","last_change":"2024-09-17T05:26:17.317552+0000","last_active":"2024-09-17T05:26:18.495919+0000","last_peered":"2024-09-17T05:26:18.495919+0000","last_clean":"2024-09-17T05:26:18.495919+0000","last_became_active":"2024-09-17T05:26:17.317285+0000","last_became_peered":"2024-09-17T05:26:17.317285+0000","last_unstale":"2024-09-17T05:26:18.495919+0000","last_undegraded":"2024-09-17T05:26:18.495919+0000","last_fullsized":"2024-09-17T05:26:18.495919+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:35:11.673832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.35","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.497053+0000","last_change":"2024-09-17T05:26:17.319658+0000","last_active":"2024-09-17T05:26:18.497053+0000","last_peered":"2024-09-17T05:26:18.497053+0000","last_clean":"2024-09-17T05:26:18.497053+0000","last_became_active":"2024-09-17T05:26:17.319378+0000","last_became_peered":"2024-09-17T05:26:17.319378+0000","last_unstale":"2024-09-17T05:26:18.497053+0000","last_undegraded":"2024-09-17T05:26:18.497053+0000","last_fullsized":"2024-09-17T05:26:18.497053+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:14:54.460602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.34","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315338+0000","last_change":"2024-09-17T05:26:17.319612+0000","last_active":"2024-09-17T05:26:18.315338+0000","last_peered":"2024-09-17T05:26:18.315338+0000","last_clean":"2024-09-17T05:26:18.315338+0000","last_became_active":"2024-09-17T05:26:17.319119+0000","last_became_peered":"2024-09-17T05:26:17.319119+0000","last_unstale":"2024-09-17T05:26:18.315338+0000","last_undegraded":"2024-09-17T05:26:18.315338+0000","last_fullsized":"2024-09-17T05:26:18.315338+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:44.108869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.33","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315199+0000","last_change":"2024-09-17T05:26:17.311470+0000","last_active":"2024-09-17T05:26:18.315199+0000","last_peered":"2024-09-17T05:26:18.315199+0000","last_clean":"2024-09-17T05:26:18.315199+0000","last_became_active":"2024-09-17T05:26:17.311105+0000","last_became_peered":"2024-09-17T05:26:17.311105+0000","last_unstale":"2024-09-17T05:26:18.315199+0000","last_undegraded":"2024-09-17T05:26:18.315199+0000","last_fullsized":"2024-09-17T05:26:18.315199+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:07.117208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.32","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316140+0000","last_change":"2024-09-17T05:26:17.323957+0000","last_active":"2024-09-17T05:26:18.316140+0000","last_peered":"2024-09-17T05:26:18.316140+0000","last_clean":"2024-09-17T05:26:18.316140+0000","last_became_active":"2024-09-17T05:26:17.323691+0000","last_became_peered":"2024-09-17T05:26:17.323691+0000","last_unstale":"2024-09-17T05:26:18.316140+0000","last_undegraded":"2024-09-17T05:26:18.316140+0000","last_fullsized":"2024-09-17T05:26:18.316140+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:25:28.251850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.31","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316045+0000","last_change":"2024-09-17T05:26:17.324710+0000","last_active":"2024-09-17T05:26:18.316045+0000","last_peered":"2024-09-17T05:26:18.316045+0000","last_clean":"2024-09-17T05:26:18.316045+0000","last_became_active":"2024-09-17T05:26:17.324176+0000","last_became_peered":"2024-09-17T05:26:17.324176+0000","last_unstale":"2024-09-17T05:26:18.316045+0000","last_undegraded":"2024-09-17T05:26:18.316045+0000","last_fullsized":"2024-09-17T05:26:18.316045+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:26:22.628815+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.30","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496714+0000","last_change":"2024-09-17T05:26:17.311096+0000","last_active":"2024-09-17T05:26:18.496714+0000","last_peered":"2024-09-17T05:26:18.496714+0000","last_clean":"2024-09-17T05:26:18.496714+0000","last_became_active":"2024-09-17T05:26:17.310501+0000","last_became_peered":"2024-09-17T05:26:17.310501+0000","last_unstale":"2024-09-17T05:26:18.496714+0000","last_undegraded":"2024-09-17T05:26:18.496714+0000","last_fullsized":"2024-09-17T05:26:18.496714+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:33:05.324361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316414+0000","last_change":"2024-09-17T05:26:17.320937+0000","last_active":"2024-09-17T05:26:18.316414+0000","last_peered":"2024-09-17T05:26:18.316414+0000","last_clean":"2024-09-17T05:26:18.316414+0000","last_became_active":"2024-09-17T05:26:17.320667+0000","last_became_peered":"2024-09-17T05:26:17.320667+0000","last_unstale":"2024-09-17T05:26:18.316414+0000","last_undegraded":"2024-09-17T05:26:18.316414+0000","last_fullsized":"2024-09-17T05:26:18.316414+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:26:52.574222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.2e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496144+0000","last_change":"2024-09-17T05:26:17.318164+0000","last_active":"2024-09-17T05:26:18.496144+0000","last_peered":"2024-09-17T05:26:18.496144+0000","last_clean":"2024-09-17T05:26:18.496144+0000","last_became_active":"2024-09-17T05:26:17.317862+0000","last_became_peered":"2024-09-17T05:26:17.317862+0000","last_unstale":"2024-09-17T05:26:18.496144+0000","last_undegraded":"2024-09-17T05:26:18.496144+0000","last_fullsized":"2024-09-17T05:26:18.496144+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:30:06.764200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496226+0000","last_change":"2024-09-17T05:26:17.316890+0000","last_active":"2024-09-17T05:26:18.496226+0000","last_peered":"2024-09-17T05:26:18.496226+0000","last_clean":"2024-09-17T05:26:18.496226+0000","last_became_active":"2024-09-17T05:26:17.316617+0000","last_became_peered":"2024-09-17T05:26:17.316617+0000","last_unstale":"2024-09-17T05:26:18.496226+0000","last_undegraded":"2024-09-17T05:26:18.496226+0000","last_fullsized":"2024-09-17T05:26:18.496226+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:31:29.744228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.2c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495764+0000","last_change":"2024-09-17T05:26:17.323047+0000","last_active":"2024-09-17T05:26:18.495764+0000","last_peered":"2024-09-17T05:26:18.495764+0000","last_clean":"2024-09-17T05:26:18.495764+0000","last_became_active":"2024-09-17T05:26:17.322780+0000","last_became_peered":"2024-09-17T05:26:17.322780+0000","last_unstale":"2024-09-17T05:26:18.495764+0000","last_undegraded":"2024-09-17T05:26:18.495764+0000","last_fullsized":"2024-09-17T05:26:18.495764+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:18:05.372241+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.2b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331443+0000","last_change":"2024-09-17T05:26:17.322102+0000","last_active":"2024-09-17T05:26:18.331443+0000","last_peered":"2024-09-17T05:26:18.331443+0000","last_clean":"2024-09-17T05:26:18.331443+0000","last_became_active":"2024-09-17T05:26:17.320991+0000","last_became_peered":"2024-09-17T05:26:17.320991+0000","last_unstale":"2024-09-17T05:26:18.331443+0000","last_undegraded":"2024-09-17T05:26:18.331443+0000","last_fullsized":"2024-09-17T05:26:18.331443+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:56:15.044935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.2a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315884+0000","last_change":"2024-09-17T05:26:17.322459+0000","last_active":"2024-09-17T05:26:18.315884+0000","last_peered":"2024-09-17T05:26:18.315884+0000","last_clean":"2024-09-17T05:26:18.315884+0000","last_became_active":"2024-09-17T05:26:17.322164+0000","last_became_peered":"2024-09-17T05:26:17.322164+0000","last_unstale":"2024-09-17T05:26:18.315884+0000","last_undegraded":"2024-09-17T05:26:18.315884+0000","last_fullsized":"2024-09-17T05:26:18.315884+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:08:08.645785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.29","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315029+0000","last_change":"2024-09-17T05:26:17.326803+0000","last_active":"2024-09-17T05:26:18.315029+0000","last_peered":"2024-09-17T05:26:18.315029+0000","last_clean":"2024-09-17T05:26:18.315029+0000","last_became_active":"2024-09-17T05:26:17.326484+0000","last_became_peered":"2024-09-17T05:26:17.326484+0000","last_unstale":"2024-09-17T05:26:18.315029+0000","last_undegraded":"2024-09-17T05:26:18.315029+0000","last_fullsized":"2024-09-17T05:26:18.315029+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:58:57.011836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.28","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331534+0000","last_change":"2024-09-17T05:26:17.322859+0000","last_active":"2024-09-17T05:26:18.331534+0000","last_peered":"2024-09-17T05:26:18.331534+0000","last_clean":"2024-09-17T05:26:18.331534+0000","last_became_active":"2024-09-17T05:26:17.322572+0000","last_became_peered":"2024-09-17T05:26:17.322572+0000","last_unstale":"2024-09-17T05:26:18.331534+0000","last_undegraded":"2024-09-17T05:26:18.331534+0000","last_fullsized":"2024-09-17T05:26:18.331534+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:19:29.042811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.27","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496199+0000","last_change":"2024-09-17T05:26:17.317603+0000","last_active":"2024-09-17T05:26:18.496199+0000","last_peered":"2024-09-17T05:26:18.496199+0000","last_clean":"2024-09-17T05:26:18.496199+0000","last_became_active":"2024-09-17T05:26:17.316986+0000","last_became_peered":"2024-09-17T05:26:17.316986+0000","last_unstale":"2024-09-17T05:26:18.496199+0000","last_undegraded":"2024-09-17T05:26:18.496199+0000","last_fullsized":"2024-09-17T05:26:18.496199+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:32:54.288771+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.26","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316492+0000","last_change":"2024-09-17T05:26:17.324479+0000","last_active":"2024-09-17T05:26:18.316492+0000","last_peered":"2024-09-17T05:26:18.316492+0000","last_clean":"2024-09-17T05:26:18.316492+0000","last_became_active":"2024-09-17T05:26:17.323559+0000","last_became_peered":"2024-09-17T05:26:17.323559+0000","last_unstale":"2024-09-17T05:26:18.316492+0000","last_undegraded":"2024-09-17T05:26:18.316492+0000","last_fullsized":"2024-09-17T05:26:18.316492+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:40:01.687577+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.25","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315021+0000","last_change":"2024-09-17T05:26:17.318603+0000","last_active":"2024-09-17T05:26:18.315021+0000","last_peered":"2024-09-17T05:26:18.315021+0000","last_clean":"2024-09-17T05:26:18.315021+0000","last_became_active":"2024-09-17T05:26:17.318294+0000","last_became_peered":"2024-09-17T05:26:17.318294+0000","last_unstale":"2024-09-17T05:26:18.315021+0000","last_undegraded":"2024-09-17T05:26:18.315021+0000","last_fullsized":"2024-09-17T05:26:18.315021+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:46:40.437261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.24","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496816+0000","last_change":"2024-09-17T05:26:17.319937+0000","last_active":"2024-09-17T05:26:18.496816+0000","last_peered":"2024-09-17T05:26:18.496816+0000","last_clean":"2024-09-17T05:26:18.496816+0000","last_became_active":"2024-09-17T05:26:17.319639+0000","last_became_peered":"2024-09-17T05:26:17.319639+0000","last_unstale":"2024-09-17T05:26:18.496816+0000","last_undegraded":"2024-09-17T05:26:18.496816+0000","last_fullsized":"2024-09-17T05:26:18.496816+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:37:09.044373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.23","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.314712+0000","last_change":"2024-09-17T05:26:17.318625+0000","last_active":"2024-09-17T05:26:18.314712+0000","last_peered":"2024-09-17T05:26:18.314712+0000","last_clean":"2024-09-17T05:26:18.314712+0000","last_became_active":"2024-09-17T05:26:17.318344+0000","last_became_peered":"2024-09-17T05:26:17.318344+0000","last_unstale":"2024-09-17T05:26:18.314712+0000","last_undegraded":"2024-09-17T05:26:18.314712+0000","last_fullsized":"2024-09-17T05:26:18.314712+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:57.093965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.22","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495863+0000","last_change":"2024-09-17T05:26:17.318181+0000","last_active":"2024-09-17T05:26:18.495863+0000","last_peered":"2024-09-17T05:26:18.495863+0000","last_clean":"2024-09-17T05:26:18.495863+0000","last_became_active":"2024-09-17T05:26:17.317880+0000","last_became_peered":"2024-09-17T05:26:17.317880+0000","last_unstale":"2024-09-17T05:26:18.495863+0000","last_undegraded":"2024-09-17T05:26:18.495863+0000","last_fullsized":"2024-09-17T05:26:18.495863+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:31:30.086336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.21","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495575+0000","last_change":"2024-09-17T05:26:17.316903+0000","last_active":"2024-09-17T05:26:18.495575+0000","last_peered":"2024-09-17T05:26:18.495575+0000","last_clean":"2024-09-17T05:26:18.495575+0000","last_became_active":"2024-09-17T05:26:17.316154+0000","last_became_peered":"2024-09-17T05:26:17.316154+0000","last_unstale":"2024-09-17T05:26:18.495575+0000","last_undegraded":"2024-09-17T05:26:18.495575+0000","last_fullsized":"2024-09-17T05:26:18.495575+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:06.253350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.20","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316047+0000","last_change":"2024-09-17T05:26:17.315631+0000","last_active":"2024-09-17T05:26:18.316047+0000","last_peered":"2024-09-17T05:26:18.316047+0000","last_clean":"2024-09-17T05:26:18.316047+0000","last_became_active":"2024-09-17T05:26:17.315371+0000","last_became_peered":"2024-09-17T05:26:17.315371+0000","last_unstale":"2024-09-17T05:26:18.316047+0000","last_undegraded":"2024-09-17T05:26:18.316047+0000","last_fullsized":"2024-09-17T05:26:18.316047+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:10:07.768326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.1e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496206+0000","last_change":"2024-09-17T05:26:17.320607+0000","last_active":"2024-09-17T05:26:18.496206+0000","last_peered":"2024-09-17T05:26:18.496206+0000","last_clean":"2024-09-17T05:26:18.496206+0000","last_became_active":"2024-09-17T05:26:17.320329+0000","last_became_peered":"2024-09-17T05:26:17.320329+0000","last_unstale":"2024-09-17T05:26:18.496206+0000","last_undegraded":"2024-09-17T05:26:18.496206+0000","last_fullsized":"2024-09-17T05:26:18.496206+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:01:44.945380+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.1f","version":"161'4","reported_seq":19,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315644+0000","last_change":"2024-09-17T05:26:16.333187+0000","last_active":"2024-09-17T05:26:18.315644+0000","last_peered":"2024-09-17T05:26:18.315644+0000","last_clean":"2024-09-17T05:26:18.315644+0000","last_became_active":"2024-09-17T05:26:16.332924+0000","last_became_peered":"2024-09-17T05:26:16.332924+0000","last_unstale":"2024-09-17T05:26:18.315644+0000","last_undegraded":"2024-09-17T05:26:18.315644+0000","last_fullsized":"2024-09-17T05:26:18.315644+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:24.859439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315922+0000","last_change":"2024-09-17T05:26:17.322290+0000","last_active":"2024-09-17T05:26:18.315922+0000","last_peered":"2024-09-17T05:26:18.315922+0000","last_clean":"2024-09-17T05:26:18.315922+0000","last_became_active":"2024-09-17T05:26:17.322000+0000","last_became_peered":"2024-09-17T05:26:17.322000+0000","last_unstale":"2024-09-17T05:26:18.315922+0000","last_undegraded":"2024-09-17T05:26:18.315922+0000","last_fullsized":"2024-09-17T05:26:18.315922+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:40:54.738012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.1e","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496328+0000","last_change":"2024-09-17T05:26:16.334672+0000","last_active":"2024-09-17T05:26:18.496328+0000","last_peered":"2024-09-17T05:26:18.496328+0000","last_clean":"2024-09-17T05:26:18.496328+0000","last_became_active":"2024-09-17T05:26:16.334416+0000","last_became_peered":"2024-09-17T05:26:16.334416+0000","last_unstale":"2024-09-17T05:26:18.496328+0000","last_undegraded":"2024-09-17T05:26:18.496328+0000","last_fullsized":"2024-09-17T05:26:18.496328+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:10:13.572966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.1c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316306+0000","last_change":"2024-09-17T05:26:17.324454+0000","last_active":"2024-09-17T05:26:18.316306+0000","last_peered":"2024-09-17T05:26:18.316306+0000","last_clean":"2024-09-17T05:26:18.316306+0000","last_became_active":"2024-09-17T05:26:17.323995+0000","last_became_peered":"2024-09-17T05:26:17.323995+0000","last_unstale":"2024-09-17T05:26:18.316306+0000","last_undegraded":"2024-09-17T05:26:18.316306+0000","last_fullsized":"2024-09-17T05:26:18.316306+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:20:44.610811+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1d","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.497143+0000","last_change":"2024-09-17T05:26:16.334772+0000","last_active":"2024-09-17T05:26:18.497143+0000","last_peered":"2024-09-17T05:26:18.497143+0000","last_clean":"2024-09-17T05:26:18.497143+0000","last_became_active":"2024-09-17T05:26:16.334509+0000","last_became_peered":"2024-09-17T05:26:16.334509+0000","last_unstale":"2024-09-17T05:26:18.497143+0000","last_undegraded":"2024-09-17T05:26:18.497143+0000","last_fullsized":"2024-09-17T05:26:18.497143+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:08:58.693199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.1d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495959+0000","last_change":"2024-09-17T05:26:17.320940+0000","last_active":"2024-09-17T05:26:18.495959+0000","last_peered":"2024-09-17T05:26:18.495959+0000","last_clean":"2024-09-17T05:26:18.495959+0000","last_became_active":"2024-09-17T05:26:17.320685+0000","last_became_peered":"2024-09-17T05:26:17.320685+0000","last_unstale":"2024-09-17T05:26:18.495959+0000","last_undegraded":"2024-09-17T05:26:18.495959+0000","last_fullsized":"2024-09-17T05:26:18.495959+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:45:25.435745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.1c","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331837+0000","last_change":"2024-09-17T05:26:16.337132+0000","last_active":"2024-09-17T05:26:18.331837+0000","last_peered":"2024-09-17T05:26:18.331837+0000","last_clean":"2024-09-17T05:26:18.331837+0000","last_became_active":"2024-09-17T05:26:16.336762+0000","last_became_peered":"2024-09-17T05:26:16.336762+0000","last_unstale":"2024-09-17T05:26:18.331837+0000","last_undegraded":"2024-09-17T05:26:18.331837+0000","last_fullsized":"2024-09-17T05:26:18.331837+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:19.712957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.1b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331480+0000","last_change":"2024-09-17T05:26:17.321573+0000","last_active":"2024-09-17T05:26:18.331480+0000","last_peered":"2024-09-17T05:26:18.331480+0000","last_clean":"2024-09-17T05:26:18.331480+0000","last_became_active":"2024-09-17T05:26:17.321223+0000","last_became_peered":"2024-09-17T05:26:17.321223+0000","last_unstale":"2024-09-17T05:26:18.331480+0000","last_undegraded":"2024-09-17T05:26:18.331480+0000","last_fullsized":"2024-09-17T05:26:18.331480+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:12:08.108949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.1a","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496245+0000","last_change":"2024-09-17T05:26:16.338072+0000","last_active":"2024-09-17T05:26:18.496245+0000","last_peered":"2024-09-17T05:26:18.496245+0000","last_clean":"2024-09-17T05:26:18.496245+0000","last_became_active":"2024-09-17T05:26:16.337765+0000","last_became_peered":"2024-09-17T05:26:16.337765+0000","last_unstale":"2024-09-17T05:26:18.496245+0000","last_undegraded":"2024-09-17T05:26:18.496245+0000","last_fullsized":"2024-09-17T05:26:18.496245+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:34:22.478789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.18","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496375+0000","last_change":"2024-09-17T05:26:17.328224+0000","last_active":"2024-09-17T05:26:18.496375+0000","last_peered":"2024-09-17T05:26:18.496375+0000","last_clean":"2024-09-17T05:26:18.496375+0000","last_became_active":"2024-09-17T05:26:17.326433+0000","last_became_peered":"2024-09-17T05:26:17.326433+0000","last_unstale":"2024-09-17T05:26:18.496375+0000","last_undegraded":"2024-09-17T05:26:18.496375+0000","last_fullsized":"2024-09-17T05:26:18.496375+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:33.422558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.19","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496461+0000","last_change":"2024-09-17T05:26:16.337362+0000","last_active":"2024-09-17T05:26:18.496461+0000","last_peered":"2024-09-17T05:26:18.496461+0000","last_clean":"2024-09-17T05:26:18.496461+0000","last_became_active":"2024-09-17T05:26:16.337065+0000","last_became_peered":"2024-09-17T05:26:16.337065+0000","last_unstale":"2024-09-17T05:26:18.496461+0000","last_undegraded":"2024-09-17T05:26:18.496461+0000","last_fullsized":"2024-09-17T05:26:18.496461+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:53:06.115037+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.19","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331475+0000","last_change":"2024-09-17T05:26:17.319781+0000","last_active":"2024-09-17T05:26:18.331475+0000","last_peered":"2024-09-17T05:26:18.331475+0000","last_clean":"2024-09-17T05:26:18.331475+0000","last_became_active":"2024-09-17T05:26:17.319278+0000","last_became_peered":"2024-09-17T05:26:17.319278+0000","last_unstale":"2024-09-17T05:26:18.331475+0000","last_undegraded":"2024-09-17T05:26:18.331475+0000","last_fullsized":"2024-09-17T05:26:18.331475+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:46:48.895644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.18","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.314586+0000","last_change":"2024-09-17T05:26:16.339720+0000","last_active":"2024-09-17T05:26:18.314586+0000","last_peered":"2024-09-17T05:26:18.314586+0000","last_clean":"2024-09-17T05:26:18.314586+0000","last_became_active":"2024-09-17T05:26:16.339438+0000","last_became_peered":"2024-09-17T05:26:16.339438+0000","last_unstale":"2024-09-17T05:26:18.314586+0000","last_undegraded":"2024-09-17T05:26:18.314586+0000","last_fullsized":"2024-09-17T05:26:18.314586+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:25:26.348053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.16","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331740+0000","last_change":"2024-09-17T05:26:17.320107+0000","last_active":"2024-09-17T05:26:18.331740+0000","last_peered":"2024-09-17T05:26:18.331740+0000","last_clean":"2024-09-17T05:26:18.331740+0000","last_became_active":"2024-09-17T05:26:17.319838+0000","last_became_peered":"2024-09-17T05:26:17.319838+0000","last_unstale":"2024-09-17T05:26:18.331740+0000","last_undegraded":"2024-09-17T05:26:18.331740+0000","last_fullsized":"2024-09-17T05:26:18.331740+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:09:07.268030+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.17","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495584+0000","last_change":"2024-09-17T05:26:16.336869+0000","last_active":"2024-09-17T05:26:18.495584+0000","last_peered":"2024-09-17T05:26:18.495584+0000","last_clean":"2024-09-17T05:26:18.495584+0000","last_became_active":"2024-09-17T05:26:16.336610+0000","last_became_peered":"2024-09-17T05:26:16.336610+0000","last_unstale":"2024-09-17T05:26:18.495584+0000","last_undegraded":"2024-09-17T05:26:18.495584+0000","last_fullsized":"2024-09-17T05:26:18.495584+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:47:39.789936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.17","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496682+0000","last_change":"2024-09-17T05:26:17.320355+0000","last_active":"2024-09-17T05:26:18.496682+0000","last_peered":"2024-09-17T05:26:18.496682+0000","last_clean":"2024-09-17T05:26:18.496682+0000","last_became_active":"2024-09-17T05:26:17.320099+0000","last_became_peered":"2024-09-17T05:26:17.320099+0000","last_unstale":"2024-09-17T05:26:18.496682+0000","last_undegraded":"2024-09-17T05:26:18.496682+0000","last_fullsized":"2024-09-17T05:26:18.496682+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:41:48.599435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.16","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315965+0000","last_change":"2024-09-17T05:26:16.337467+0000","last_active":"2024-09-17T05:26:18.315965+0000","last_peered":"2024-09-17T05:26:18.315965+0000","last_clean":"2024-09-17T05:26:18.315965+0000","last_became_active":"2024-09-17T05:26:16.337196+0000","last_became_peered":"2024-09-17T05:26:16.337196+0000","last_unstale":"2024-09-17T05:26:18.315965+0000","last_undegraded":"2024-09-17T05:26:18.315965+0000","last_fullsized":"2024-09-17T05:26:18.315965+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:14:56.584963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.14","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331793+0000","last_change":"2024-09-17T05:26:17.323928+0000","last_active":"2024-09-17T05:26:18.331793+0000","last_peered":"2024-09-17T05:26:18.331793+0000","last_clean":"2024-09-17T05:26:18.331793+0000","last_became_active":"2024-09-17T05:26:17.323619+0000","last_became_peered":"2024-09-17T05:26:17.323619+0000","last_unstale":"2024-09-17T05:26:18.331793+0000","last_undegraded":"2024-09-17T05:26:18.331793+0000","last_fullsized":"2024-09-17T05:26:18.331793+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:24:37.217684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"26.15","version":"161'3","reported_seq":18,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496284+0000","last_change":"2024-09-17T05:26:16.331947+0000","last_active":"2024-09-17T05:26:18.496284+0000","last_peered":"2024-09-17T05:26:18.496284+0000","last_clean":"2024-09-17T05:26:18.496284+0000","last_became_active":"2024-09-17T05:26:16.331637+0000","last_became_peered":"2024-09-17T05:26:16.331637+0000","last_unstale":"2024-09-17T05:26:18.496284+0000","last_undegraded":"2024-09-17T05:26:18.496284+0000","last_fullsized":"2024-09-17T05:26:18.496284+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:00:10.020027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.15","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316427+0000","last_change":"2024-09-17T05:26:17.325171+0000","last_active":"2024-09-17T05:26:18.316427+0000","last_peered":"2024-09-17T05:26:18.316427+0000","last_clean":"2024-09-17T05:26:18.316427+0000","last_became_active":"2024-09-17T05:26:17.324878+0000","last_became_peered":"2024-09-17T05:26:17.324878+0000","last_unstale":"2024-09-17T05:26:18.316427+0000","last_undegraded":"2024-09-17T05:26:18.316427+0000","last_fullsized":"2024-09-17T05:26:18.316427+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:11:42.574995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.14","version":"161'6","reported_seq":21,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331932+0000","last_change":"2024-09-17T05:26:16.338543+0000","last_active":"2024-09-17T05:26:18.331932+0000","last_peered":"2024-09-17T05:26:18.331932+0000","last_clean":"2024-09-17T05:26:18.331932+0000","last_became_active":"2024-09-17T05:26:16.338259+0000","last_became_peered":"2024-09-17T05:26:16.338259+0000","last_unstale":"2024-09-17T05:26:18.331932+0000","last_undegraded":"2024-09-17T05:26:18.331932+0000","last_fullsized":"2024-09-17T05:26:18.331932+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:00.391327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1612,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.12","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496186+0000","last_change":"2024-09-17T05:26:17.324969+0000","last_active":"2024-09-17T05:26:18.496186+0000","last_peered":"2024-09-17T05:26:18.496186+0000","last_clean":"2024-09-17T05:26:18.496186+0000","last_became_active":"2024-09-17T05:26:17.324704+0000","last_became_peered":"2024-09-17T05:26:17.324704+0000","last_unstale":"2024-09-17T05:26:18.496186+0000","last_undegraded":"2024-09-17T05:26:18.496186+0000","last_fullsized":"2024-09-17T05:26:18.496186+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:34.296534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"26.13","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315659+0000","last_change":"2024-09-17T05:26:16.339808+0000","last_active":"2024-09-17T05:26:18.315659+0000","last_peered":"2024-09-17T05:26:18.315659+0000","last_clean":"2024-09-17T05:26:18.315659+0000","last_became_active":"2024-09-17T05:26:16.339537+0000","last_became_peered":"2024-09-17T05:26:16.339537+0000","last_unstale":"2024-09-17T05:26:18.315659+0000","last_undegraded":"2024-09-17T05:26:18.315659+0000","last_fullsized":"2024-09-17T05:26:18.315659+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:46:35.534305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.13","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496327+0000","last_change":"2024-09-17T05:26:17.310608+0000","last_active":"2024-09-17T05:26:18.496327+0000","last_peered":"2024-09-17T05:26:18.496327+0000","last_clean":"2024-09-17T05:26:18.496327+0000","last_became_active":"2024-09-17T05:26:17.310317+0000","last_became_peered":"2024-09-17T05:26:17.310317+0000","last_unstale":"2024-09-17T05:26:18.496327+0000","last_undegraded":"2024-09-17T05:26:18.496327+0000","last_fullsized":"2024-09-17T05:26:18.496327+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:09:44.814036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.12","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315834+0000","last_change":"2024-09-17T05:26:16.336631+0000","last_active":"2024-09-17T05:26:18.315834+0000","last_peered":"2024-09-17T05:26:18.315834+0000","last_clean":"2024-09-17T05:26:18.315834+0000","last_became_active":"2024-09-17T05:26:16.336344+0000","last_became_peered":"2024-09-17T05:26:16.336344+0000","last_unstale":"2024-09-17T05:26:18.315834+0000","last_undegraded":"2024-09-17T05:26:18.315834+0000","last_fullsized":"2024-09-17T05:26:18.315834+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:57:54.238271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.10","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495502+0000","last_change":"2024-09-17T05:26:17.323552+0000","last_active":"2024-09-17T05:26:18.495502+0000","last_peered":"2024-09-17T05:26:18.495502+0000","last_clean":"2024-09-17T05:26:18.495502+0000","last_became_active":"2024-09-17T05:26:17.323278+0000","last_became_peered":"2024-09-17T05:26:17.323278+0000","last_unstale":"2024-09-17T05:26:18.495502+0000","last_undegraded":"2024-09-17T05:26:18.495502+0000","last_fullsized":"2024-09-17T05:26:18.495502+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:38:22.900502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.11","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495606+0000","last_change":"2024-09-17T05:26:16.330420+0000","last_active":"2024-09-17T05:26:18.495606+0000","last_peered":"2024-09-17T05:26:18.495606+0000","last_clean":"2024-09-17T05:26:18.495606+0000","last_became_active":"2024-09-17T05:26:16.330165+0000","last_became_peered":"2024-09-17T05:26:16.330165+0000","last_unstale":"2024-09-17T05:26:18.495606+0000","last_undegraded":"2024-09-17T05:26:18.495606+0000","last_fullsized":"2024-09-17T05:26:18.495606+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:05:33.294363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.11","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316277+0000","last_change":"2024-09-17T05:26:17.316147+0000","last_active":"2024-09-17T05:26:18.316277+0000","last_peered":"2024-09-17T05:26:18.316277+0000","last_clean":"2024-09-17T05:26:18.316277+0000","last_became_active":"2024-09-17T05:26:17.315852+0000","last_became_peered":"2024-09-17T05:26:17.315852+0000","last_unstale":"2024-09-17T05:26:18.316277+0000","last_undegraded":"2024-09-17T05:26:18.316277+0000","last_fullsized":"2024-09-17T05:26:18.316277+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:05:48.795102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.10","version":"161'8","reported_seq":23,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495609+0000","last_change":"2024-09-17T05:26:16.336370+0000","last_active":"2024-09-17T05:26:18.495609+0000","last_peered":"2024-09-17T05:26:18.495609+0000","last_clean":"2024-09-17T05:26:18.495609+0000","last_became_active":"2024-09-17T05:26:16.336096+0000","last_became_peered":"2024-09-17T05:26:16.336096+0000","last_unstale":"2024-09-17T05:26:18.495609+0000","last_undegraded":"2024-09-17T05:26:18.495609+0000","last_fullsized":"2024-09-17T05:26:18.495609+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T09:18:40.170007+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.e","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496336+0000","last_change":"2024-09-17T05:26:17.315518+0000","last_active":"2024-09-17T05:26:18.496336+0000","last_peered":"2024-09-17T05:26:18.496336+0000","last_clean":"2024-09-17T05:26:18.496336+0000","last_became_active":"2024-09-17T05:26:17.315230+0000","last_became_peered":"2024-09-17T05:26:17.315230+0000","last_unstale":"2024-09-17T05:26:18.496336+0000","last_undegraded":"2024-09-17T05:26:18.496336+0000","last_fullsized":"2024-09-17T05:26:18.496336+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:36:57.093965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.f","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495689+0000","last_change":"2024-09-17T05:26:16.334935+0000","last_active":"2024-09-17T05:26:18.495689+0000","last_peered":"2024-09-17T05:26:18.495689+0000","last_clean":"2024-09-17T05:26:18.495689+0000","last_became_active":"2024-09-17T05:26:16.334665+0000","last_became_peered":"2024-09-17T05:26:16.334665+0000","last_unstale":"2024-09-17T05:26:18.495689+0000","last_undegraded":"2024-09-17T05:26:18.495689+0000","last_fullsized":"2024-09-17T05:26:18.495689+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:20:29.571006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.f","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496164+0000","last_change":"2024-09-17T05:26:17.317264+0000","last_active":"2024-09-17T05:26:18.496164+0000","last_peered":"2024-09-17T05:26:18.496164+0000","last_clean":"2024-09-17T05:26:18.496164+0000","last_became_active":"2024-09-17T05:26:17.316639+0000","last_became_peered":"2024-09-17T05:26:17.316639+0000","last_unstale":"2024-09-17T05:26:18.496164+0000","last_undegraded":"2024-09-17T05:26:18.496164+0000","last_fullsized":"2024-09-17T05:26:18.496164+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:31:20.236025+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.e","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496433+0000","last_change":"2024-09-17T05:26:16.340027+0000","last_active":"2024-09-17T05:26:18.496433+0000","last_peered":"2024-09-17T05:26:18.496433+0000","last_clean":"2024-09-17T05:26:18.496433+0000","last_became_active":"2024-09-17T05:26:16.339738+0000","last_became_peered":"2024-09-17T05:26:16.339738+0000","last_unstale":"2024-09-17T05:26:18.496433+0000","last_undegraded":"2024-09-17T05:26:18.496433+0000","last_fullsized":"2024-09-17T05:26:18.496433+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:17:45.889335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"27.c","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496875+0000","last_change":"2024-09-17T05:26:17.316922+0000","last_active":"2024-09-17T05:26:18.496875+0000","last_peered":"2024-09-17T05:26:18.496875+0000","last_clean":"2024-09-17T05:26:18.496875+0000","last_became_active":"2024-09-17T05:26:17.316669+0000","last_became_peered":"2024-09-17T05:26:17.316669+0000","last_unstale":"2024-09-17T05:26:18.496875+0000","last_undegraded":"2024-09-17T05:26:18.496875+0000","last_fullsized":"2024-09-17T05:26:18.496875+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:49:04.178773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.d","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496334+0000","last_change":"2024-09-17T05:26:16.335751+0000","last_active":"2024-09-17T05:26:18.496334+0000","last_peered":"2024-09-17T05:26:18.496334+0000","last_clean":"2024-09-17T05:26:18.496334+0000","last_became_active":"2024-09-17T05:26:16.335502+0000","last_became_peered":"2024-09-17T05:26:16.335502+0000","last_unstale":"2024-09-17T05:26:18.496334+0000","last_undegraded":"2024-09-17T05:26:18.496334+0000","last_fullsized":"2024-09-17T05:26:18.496334+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:22:14.655198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.d","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496113+0000","last_change":"2024-09-17T05:26:17.315622+0000","last_active":"2024-09-17T05:26:18.496113+0000","last_peered":"2024-09-17T05:26:18.496113+0000","last_clean":"2024-09-17T05:26:18.496113+0000","last_became_active":"2024-09-17T05:26:17.315183+0000","last_became_peered":"2024-09-17T05:26:17.315183+0000","last_unstale":"2024-09-17T05:26:18.496113+0000","last_undegraded":"2024-09-17T05:26:18.496113+0000","last_fullsized":"2024-09-17T05:26:18.496113+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T08:26:22.301835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.c","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496916+0000","last_change":"2024-09-17T05:26:16.334148+0000","last_active":"2024-09-17T05:26:18.496916+0000","last_peered":"2024-09-17T05:26:18.496916+0000","last_clean":"2024-09-17T05:26:18.496916+0000","last_became_active":"2024-09-17T05:26:16.333853+0000","last_became_peered":"2024-09-17T05:26:16.333853+0000","last_unstale":"2024-09-17T05:26:18.496916+0000","last_undegraded":"2024-09-17T05:26:18.496916+0000","last_fullsized":"2024-09-17T05:26:18.496916+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:59:29.767115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495889+0000","last_change":"2024-09-17T05:26:17.318271+0000","last_active":"2024-09-17T05:26:18.495889+0000","last_peered":"2024-09-17T05:26:18.495889+0000","last_clean":"2024-09-17T05:26:18.495889+0000","last_became_active":"2024-09-17T05:26:17.318012+0000","last_became_peered":"2024-09-17T05:26:17.318012+0000","last_unstale":"2024-09-17T05:26:18.495889+0000","last_undegraded":"2024-09-17T05:26:18.495889+0000","last_fullsized":"2024-09-17T05:26:18.495889+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:45:19.230476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"26.b","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496000+0000","last_change":"2024-09-17T05:26:16.331444+0000","last_active":"2024-09-17T05:26:18.496000+0000","last_peered":"2024-09-17T05:26:18.496000+0000","last_clean":"2024-09-17T05:26:18.496000+0000","last_became_active":"2024-09-17T05:26:16.331196+0000","last_became_peered":"2024-09-17T05:26:16.331196+0000","last_unstale":"2024-09-17T05:26:18.496000+0000","last_undegraded":"2024-09-17T05:26:18.496000+0000","last_fullsized":"2024-09-17T05:26:18.496000+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:13:32.420387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"27.b","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496566+0000","last_change":"2024-09-17T05:26:17.321647+0000","last_active":"2024-09-17T05:26:18.496566+0000","last_peered":"2024-09-17T05:26:18.496566+0000","last_clean":"2024-09-17T05:26:18.496566+0000","last_became_active":"2024-09-17T05:26:17.321261+0000","last_became_peered":"2024-09-17T05:26:17.321261+0000","last_unstale":"2024-09-17T05:26:18.496566+0000","last_undegraded":"2024-09-17T05:26:18.496566+0000","last_fullsized":"2024-09-17T05:26:18.496566+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T15:52:05.987265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.a","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316407+0000","last_change":"2024-09-17T05:26:16.330559+0000","last_active":"2024-09-17T05:26:18.316407+0000","last_peered":"2024-09-17T05:26:18.316407+0000","last_clean":"2024-09-17T05:26:18.316407+0000","last_became_active":"2024-09-17T05:26:16.330282+0000","last_became_peered":"2024-09-17T05:26:16.330282+0000","last_unstale":"2024-09-17T05:26:18.316407+0000","last_undegraded":"2024-09-17T05:26:18.316407+0000","last_fullsized":"2024-09-17T05:26:18.316407+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:15:24.504016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.8","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495796+0000","last_change":"2024-09-17T05:26:17.320818+0000","last_active":"2024-09-17T05:26:18.495796+0000","last_peered":"2024-09-17T05:26:18.495796+0000","last_clean":"2024-09-17T05:26:18.495796+0000","last_became_active":"2024-09-17T05:26:17.320545+0000","last_became_peered":"2024-09-17T05:26:17.320545+0000","last_unstale":"2024-09-17T05:26:18.495796+0000","last_undegraded":"2024-09-17T05:26:18.495796+0000","last_fullsized":"2024-09-17T05:26:18.495796+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:06.709266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.9","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316162+0000","last_change":"2024-09-17T05:26:16.336861+0000","last_active":"2024-09-17T05:26:18.316162+0000","last_peered":"2024-09-17T05:26:18.316162+0000","last_clean":"2024-09-17T05:26:18.316162+0000","last_became_active":"2024-09-17T05:26:16.336548+0000","last_became_peered":"2024-09-17T05:26:16.336548+0000","last_unstale":"2024-09-17T05:26:18.316162+0000","last_undegraded":"2024-09-17T05:26:18.316162+0000","last_fullsized":"2024-09-17T05:26:18.316162+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:09:01.639201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"27.9","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315264+0000","last_change":"2024-09-17T05:26:17.326365+0000","last_active":"2024-09-17T05:26:18.315264+0000","last_peered":"2024-09-17T05:26:18.315264+0000","last_clean":"2024-09-17T05:26:18.315264+0000","last_became_active":"2024-09-17T05:26:17.326074+0000","last_became_peered":"2024-09-17T05:26:17.326074+0000","last_unstale":"2024-09-17T05:26:18.315264+0000","last_undegraded":"2024-09-17T05:26:18.315264+0000","last_fullsized":"2024-09-17T05:26:18.315264+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:00:33.170367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.8","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496441+0000","last_change":"2024-09-17T05:26:16.334948+0000","last_active":"2024-09-17T05:26:18.496441+0000","last_peered":"2024-09-17T05:26:18.496441+0000","last_clean":"2024-09-17T05:26:18.496441+0000","last_became_active":"2024-09-17T05:26:16.334692+0000","last_became_peered":"2024-09-17T05:26:16.334692+0000","last_unstale":"2024-09-17T05:26:18.496441+0000","last_undegraded":"2024-09-17T05:26:18.496441+0000","last_fullsized":"2024-09-17T05:26:18.496441+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:28.014606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.6","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315441+0000","last_change":"2024-09-17T05:26:17.317796+0000","last_active":"2024-09-17T05:26:18.315441+0000","last_peered":"2024-09-17T05:26:18.315441+0000","last_clean":"2024-09-17T05:26:18.315441+0000","last_became_active":"2024-09-17T05:26:17.317491+0000","last_became_peered":"2024-09-17T05:26:17.317491+0000","last_unstale":"2024-09-17T05:26:18.315441+0000","last_undegraded":"2024-09-17T05:26:18.315441+0000","last_fullsized":"2024-09-17T05:26:18.315441+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:47:29.016776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.7","version":"161'2","reported_seq":17,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496792+0000","last_change":"2024-09-17T05:26:16.333065+0000","last_active":"2024-09-17T05:26:18.496792+0000","last_peered":"2024-09-17T05:26:18.496792+0000","last_clean":"2024-09-17T05:26:18.496792+0000","last_became_active":"2024-09-17T05:26:16.332805+0000","last_became_peered":"2024-09-17T05:26:16.332805+0000","last_unstale":"2024-09-17T05:26:18.496792+0000","last_undegraded":"2024-09-17T05:26:18.496792+0000","last_fullsized":"2024-09-17T05:26:18.496792+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:29:58.251903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.7","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316524+0000","last_change":"2024-09-17T05:26:17.325653+0000","last_active":"2024-09-17T05:26:18.316524+0000","last_peered":"2024-09-17T05:26:18.316524+0000","last_clean":"2024-09-17T05:26:18.316524+0000","last_became_active":"2024-09-17T05:26:17.324385+0000","last_became_peered":"2024-09-17T05:26:17.324385+0000","last_unstale":"2024-09-17T05:26:18.316524+0000","last_undegraded":"2024-09-17T05:26:18.316524+0000","last_fullsized":"2024-09-17T05:26:18.316524+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:50:16.174696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.6","version":"162'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.332948+0000","last_change":"2024-09-17T05:26:16.337420+0000","last_active":"2024-09-17T05:26:18.332948+0000","last_peered":"2024-09-17T05:26:18.332948+0000","last_clean":"2024-09-17T05:26:18.332948+0000","last_became_active":"2024-09-17T05:26:16.337160+0000","last_became_peered":"2024-09-17T05:26:16.337160+0000","last_unstale":"2024-09-17T05:26:18.332948+0000","last_undegraded":"2024-09-17T05:26:18.332948+0000","last_fullsized":"2024-09-17T05:26:18.332948+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:52:05.494840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.4","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495955+0000","last_change":"2024-09-17T05:26:17.324770+0000","last_active":"2024-09-17T05:26:18.495955+0000","last_peered":"2024-09-17T05:26:18.495955+0000","last_clean":"2024-09-17T05:26:18.495955+0000","last_became_active":"2024-09-17T05:26:17.324479+0000","last_became_peered":"2024-09-17T05:26:17.324479+0000","last_unstale":"2024-09-17T05:26:18.495955+0000","last_undegraded":"2024-09-17T05:26:18.495955+0000","last_fullsized":"2024-09-17T05:26:18.495955+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:15:28.352126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.5","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495881+0000","last_change":"2024-09-17T05:26:16.338139+0000","last_active":"2024-09-17T05:26:18.495881+0000","last_peered":"2024-09-17T05:26:18.495881+0000","last_clean":"2024-09-17T05:26:18.495881+0000","last_became_active":"2024-09-17T05:26:16.337795+0000","last_became_peered":"2024-09-17T05:26:16.337795+0000","last_unstale":"2024-09-17T05:26:18.495881+0000","last_undegraded":"2024-09-17T05:26:18.495881+0000","last_fullsized":"2024-09-17T05:26:18.495881+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:39:43.106698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.5","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315915+0000","last_change":"2024-09-17T05:26:17.326916+0000","last_active":"2024-09-17T05:26:18.315915+0000","last_peered":"2024-09-17T05:26:18.315915+0000","last_clean":"2024-09-17T05:26:18.315915+0000","last_became_active":"2024-09-17T05:26:17.326619+0000","last_became_peered":"2024-09-17T05:26:17.326619+0000","last_unstale":"2024-09-17T05:26:18.315915+0000","last_undegraded":"2024-09-17T05:26:18.315915+0000","last_fullsized":"2024-09-17T05:26:18.315915+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:30:25.187926+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"26.4","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496948+0000","last_change":"2024-09-17T05:26:16.336632+0000","last_active":"2024-09-17T05:26:18.496948+0000","last_peered":"2024-09-17T05:26:18.496948+0000","last_clean":"2024-09-17T05:26:18.496948+0000","last_became_active":"2024-09-17T05:26:16.336372+0000","last_became_peered":"2024-09-17T05:26:16.336372+0000","last_unstale":"2024-09-17T05:26:18.496948+0000","last_undegraded":"2024-09-17T05:26:18.496948+0000","last_fullsized":"2024-09-17T05:26:18.496948+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T11:28:49.823084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"27.2","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316363+0000","last_change":"2024-09-17T05:26:17.322854+0000","last_active":"2024-09-17T05:26:18.316363+0000","last_peered":"2024-09-17T05:26:18.316363+0000","last_clean":"2024-09-17T05:26:18.316363+0000","last_became_active":"2024-09-17T05:26:17.322536+0000","last_became_peered":"2024-09-17T05:26:17.322536+0000","last_unstale":"2024-09-17T05:26:18.316363+0000","last_undegraded":"2024-09-17T05:26:18.316363+0000","last_fullsized":"2024-09-17T05:26:18.316363+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T16:57:54.495060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.3","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331602+0000","last_change":"2024-09-17T05:26:16.335386+0000","last_active":"2024-09-17T05:26:18.331602+0000","last_peered":"2024-09-17T05:26:18.331602+0000","last_clean":"2024-09-17T05:26:18.331602+0000","last_became_active":"2024-09-17T05:26:16.335083+0000","last_became_peered":"2024-09-17T05:26:16.335083+0000","last_unstale":"2024-09-17T05:26:18.331602+0000","last_undegraded":"2024-09-17T05:26:18.331602+0000","last_fullsized":"2024-09-17T05:26:18.331602+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:38:45.537266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"27.3","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315096+0000","last_change":"2024-09-17T05:26:17.309090+0000","last_active":"2024-09-17T05:26:18.315096+0000","last_peered":"2024-09-17T05:26:18.315096+0000","last_clean":"2024-09-17T05:26:18.315096+0000","last_became_active":"2024-09-17T05:26:17.308805+0000","last_became_peered":"2024-09-17T05:26:17.308805+0000","last_unstale":"2024-09-17T05:26:18.315096+0000","last_undegraded":"2024-09-17T05:26:18.315096+0000","last_fullsized":"2024-09-17T05:26:18.315096+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:01:16.346263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"26.2","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.496293+0000","last_change":"2024-09-17T05:26:16.339645+0000","last_active":"2024-09-17T05:26:18.496293+0000","last_peered":"2024-09-17T05:26:18.496293+0000","last_clean":"2024-09-17T05:26:18.496293+0000","last_became_active":"2024-09-17T05:26:16.339378+0000","last_became_peered":"2024-09-17T05:26:16.339378+0000","last_unstale":"2024-09-17T05:26:18.496293+0000","last_undegraded":"2024-09-17T05:26:18.496293+0000","last_fullsized":"2024-09-17T05:26:18.496293+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T12:09:43.966885+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"27.0","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495955+0000","last_change":"2024-09-17T05:26:17.321848+0000","last_active":"2024-09-17T05:26:18.495955+0000","last_peered":"2024-09-17T05:26:18.495955+0000","last_clean":"2024-09-17T05:26:18.495955+0000","last_became_active":"2024-09-17T05:26:17.321619+0000","last_became_peered":"2024-09-17T05:26:17.321619+0000","last_unstale":"2024-09-17T05:26:18.495955+0000","last_undegraded":"2024-09-17T05:26:18.495955+0000","last_fullsized":"2024-09-17T05:26:18.495955+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T14:00:30.039634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"26.1","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315440+0000","last_change":"2024-09-17T05:26:16.338229+0000","last_active":"2024-09-17T05:26:18.315440+0000","last_peered":"2024-09-17T05:26:18.315440+0000","last_clean":"2024-09-17T05:26:18.315440+0000","last_became_active":"2024-09-17T05:26:16.337925+0000","last_became_peered":"2024-09-17T05:26:16.337925+0000","last_unstale":"2024-09-17T05:26:18.315440+0000","last_undegraded":"2024-09-17T05:26:18.315440+0000","last_fullsized":"2024-09-17T05:26:18.315440+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T17:00:16.431945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"27.1","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.495855+0000","last_change":"2024-09-17T05:26:17.310582+0000","last_active":"2024-09-17T05:26:18.495855+0000","last_peered":"2024-09-17T05:26:18.495855+0000","last_clean":"2024-09-17T05:26:18.495855+0000","last_became_active":"2024-09-17T05:26:17.310306+0000","last_became_peered":"2024-09-17T05:26:17.310306+0000","last_unstale":"2024-09-17T05:26:18.495855+0000","last_undegraded":"2024-09-17T05:26:18.495855+0000","last_fullsized":"2024-09-17T05:26:18.495855+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T10:23:25.861610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"26.0","version":"0'0","reported_seq":15,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.314756+0000","last_change":"2024-09-17T05:26:16.335978+0000","last_active":"2024-09-17T05:26:18.314756+0000","last_peered":"2024-09-17T05:26:18.314756+0000","last_clean":"2024-09-17T05:26:18.314756+0000","last_became_active":"2024-09-17T05:26:16.335698+0000","last_became_peered":"2024-09-17T05:26:16.335698+0000","last_unstale":"2024-09-17T05:26:18.314756+0000","last_undegraded":"2024-09-17T05:26:18.314756+0000","last_fullsized":"2024-09-17T05:26:18.314756+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T13:25:23.463629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"27.1a","version":"0'0","reported_seq":13,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.316310+0000","last_change":"2024-09-17T05:26:17.325356+0000","last_active":"2024-09-17T05:26:18.316310+0000","last_peered":"2024-09-17T05:26:18.316310+0000","last_clean":"2024-09-17T05:26:18.316310+0000","last_became_active":"2024-09-17T05:26:17.324958+0000","last_became_peered":"2024-09-17T05:26:17.324958+0000","last_unstale":"2024-09-17T05:26:18.316310+0000","last_undegraded":"2024-09-17T05:26:18.316310+0000","last_fullsized":"2024-09-17T05:26:18.316310+0000","mapping_epoch":160,"log_start":"0'0","ondisk_log_start":"0'0","created":160,"last_epoch_clean":161,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:16.309326+0000","last_clean_scrub_stamp":"2024-09-17T05:26:16.309326+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T07:43:49.340847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"26.1b","version":"161'1","reported_seq":16,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.315226+0000","last_change":"2024-09-17T05:26:16.334688+0000","last_active":"2024-09-17T05:26:18.315226+0000","last_peered":"2024-09-17T05:26:18.315226+0000","last_clean":"2024-09-17T05:26:18.315226+0000","last_became_active":"2024-09-17T05:26:16.334397+0000","last_became_peered":"2024-09-17T05:26:16.334397+0000","last_unstale":"2024-09-17T05:26:18.315226+0000","last_undegraded":"2024-09-17T05:26:18.315226+0000","last_fullsized":"2024-09-17T05:26:18.315226+0000","mapping_epoch":159,"log_start":"0'0","ondisk_log_start":"0'0","created":159,"last_epoch_clean":160,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:26:15.307155+0000","last_clean_scrub_stamp":"2024-09-17T05:26:15.307155+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:43:05.707095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"72'79","reported_seq":389,"reported_epoch":162,"state":"active+clean","last_fresh":"2024-09-17T05:26:18.331235+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:26:18.331235+0000","last_peered":"2024-09-17T05:26:18.331235+0000","last_clean":"2024-09-17T05:26:18.331235+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:26:18.331235+0000","last_undegraded":"2024-09-17T05:26:18.331235+0000","last_fullsized":"2024-09-17T05:26:18.331235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":26,"num_pg":32,"stat_sum":{"num_bytes":2410,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":4820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":8},{"poolid":27,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509537,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33776,"kb_used_data":2584,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338064,"statfs":{"total":96636764160,"available":96602177536,"internally_reserved":0,"allocated":2646016,"data_stored":1493156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509537,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2043904,"data_stored":901758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509536,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":1996,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2043904,"data_stored":901758,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509536,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":902892,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509536,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2052096,"data_stored":901358,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509537,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33184,"kb_used_data":1992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338656,"statfs":{"total":96636764160,"available":96602783744,"internally_reserved":0,"allocated":2039808,"data_stored":901176,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509536,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33188,"kb_used_data":2000,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338652,"statfs":{"total":96636764160,"available":96602779648,"internally_reserved":0,"allocated":2048000,"data_stored":901232,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574945,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37932,"kb_used_data":2576,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333908,"statfs":{"total":96636764160,"available":96597921792,"internally_reserved":0,"allocated":2637824,"data_stored":1491634,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":56,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":26,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":27,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:26:21.172 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:26:21.172 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2024-09-17T05:26:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 -- 172.21.15.81:0/315623990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c0aec30 msgr2=0x7f228c0b37f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.317 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 --2- 172.21.15.81:0/315623990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c0aec30 0x7f228c0b37f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f2284005fd0 tx=0x7f228402aa90 comp rx=0 tx=0).stop 2024-09-17T05:26:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 -- 172.21.15.81:0/315623990 shutdown_connections 2024-09-17T05:26:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 --2- 172.21.15.81:0/315623990 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c0aec30 0x7f228c0b37f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 --2- 172.21.15.81:0/315623990 >> v2:172.21.15.160:3300/0 conn(0x7f228c0cf350 0x7f228c0ae6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 -- 172.21.15.81:0/315623990 >> 172.21.15.81:0/315623990 conn(0x7f228c0cf860 msgr2=0x7f228c0cfc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 -- 172.21.15.81:0/315623990 shutdown_connections 2024-09-17T05:26:21.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.316+0000 7f229279f640 1 -- 172.21.15.81:0/315623990 wait complete. 2024-09-17T05:26:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.317+0000 7f229279f640 1 Processor -- start 2024-09-17T05:26:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.317+0000 7f229279f640 1 -- start start 2024-09-17T05:26:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229279f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0aec30 0x7f228c146380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229279f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f228c0cf350 0x7f228c14bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229279f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c150da0 0x7f228c0afce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229279f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f228c0b3d30 con 0x7f228c0aec30 2024-09-17T05:26:21.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229279f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f228c070490 con 0x7f228c0cf350 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229279f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f228c0b3eb0 con 0x7f228c150da0 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229179d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0aec30 0x7f228c146380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229179d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0aec30 0x7f228c146380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34238/0 (socket says 172.21.15.81:34238) 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f229179d640 1 -- 172.21.15.81:0/2459344019 learned_addr learned my addr 172.21.15.81:0/2459344019 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f2291f9e640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c150da0 0x7f228c0afce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.318+0000 7f2290f9c640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f228c0cf350 0x7f228c14bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229179d640 1 -- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c150da0 msgr2=0x7f228c0afce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229179d640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c150da0 0x7f228c0afce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229179d640 1 -- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f228c0cf350 msgr2=0x7f228c14bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229179d640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f228c0cf350 0x7f228c14bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.321 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229179d640 1 -- 172.21.15.81:0/2459344019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f228c158400 con 0x7f228c0aec30 2024-09-17T05:26:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229179d640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0aec30 0x7f228c146380 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f228800c3d0 tx=0x7f228800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f2281ffb640 1 -- 172.21.15.81:0/2459344019 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288017070 con 0x7f228c0aec30 2024-09-17T05:26:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f2281ffb640 1 -- 172.21.15.81:0/2459344019 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22880053c0 con 0x7f228c0aec30 2024-09-17T05:26:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f228c1586e0 con 0x7f228c0aec30 2024-09-17T05:26:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f2281ffb640 1 -- 172.21.15.81:0/2459344019 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2288003850 con 0x7f228c0aec30 2024-09-17T05:26:21.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.319+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f228c158ca0 con 0x7f228c0aec30 2024-09-17T05:26:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.320+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f228c146920 con 0x7f228c0aec30 2024-09-17T05:26:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.321+0000 7f2281ffb640 1 -- 172.21.15.81:0/2459344019 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f228801a070 con 0x7f228c0aec30 2024-09-17T05:26:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.321+0000 7f2281ffb640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22700795b0 0x7f227007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.321+0000 7f2281ffb640 1 -- 172.21.15.81:0/2459344019 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f2288098b50 con 0x7f228c0aec30 2024-09-17T05:26:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.321+0000 7f2290f9c640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22700795b0 0x7f227007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.322+0000 7f2290f9c640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22700795b0 0x7f227007ba70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f228c0cc6d0 tx=0x7f227c005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:21.326 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.325+0000 7f2281ffb640 1 -- 172.21.15.81:0/2459344019 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f22880621d0 con 0x7f228c0aec30 2024-09-17T05:26:21.572 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.571+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) -- 0x7f228c0b37f0 con 0x7f228c0aec30 2024-09-17T05:26:21.573 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.572+0000 7f2281ffb640 1 -- 172.21.15.81:0/2459344019 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v27) ==== 190+0+147 (secure 0 0 0) 0x7f2288066c00 con 0x7f228c0aec30 2024-09-17T05:26:21.574 INFO:teuthology.orchestra.run.smithi081.stdout:[client.0] 2024-09-17T05:26:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: key = AQD7EOlm2BL5AxAA4EYlwuodSK5EJ3K02KXQ7A== 2024-09-17T05:26:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: caps mds = "allow" 2024-09-17T05:26:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: caps mon = "allow r" 2024-09-17T05:26:21.574 INFO:teuthology.orchestra.run.smithi081.stdout: caps osd = "allow rw tag cephfs data=cephfs" 2024-09-17T05:26:21.574 INFO:teuthology.orchestra.run.smithi081.stderr:updated caps for client.0 2024-09-17T05:26:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22700795b0 msgr2=0x7f227007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22700795b0 0x7f227007ba70 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f228c0cc6d0 tx=0x7f227c005f90 comp rx=0 tx=0).stop 2024-09-17T05:26:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0aec30 msgr2=0x7f228c146380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0aec30 0x7f228c146380 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f228800c3d0 tx=0x7f228800c890 comp rx=0 tx=0).stop 2024-09-17T05:26:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 shutdown_connections 2024-09-17T05:26:21.576 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f228c150da0 0x7f228c0afce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22700795b0 0x7f227007ba70 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f228c0cf350 0x7f228c14bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 --2- 172.21.15.81:0/2459344019 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f228c0aec30 0x7f228c146380 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 >> 172.21.15.81:0/2459344019 conn(0x7f228c0cf860 msgr2=0x7f228c06e860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 shutdown_connections 2024-09-17T05:26:21.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.575+0000 7f229279f640 1 -- 172.21.15.81:0/2459344019 wait complete. 2024-09-17T05:26:21.586 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 -- 172.21.15.81:0/480608261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 msgr2=0x7f271c0739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 --2- 172.21.15.81:0/480608261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 0x7f271c0739a0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f2710009830 tx=0x7f271002a510 comp rx=0 tx=0).stop 2024-09-17T05:26:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 -- 172.21.15.81:0/480608261 shutdown_connections 2024-09-17T05:26:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 --2- 172.21.15.81:0/480608261 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 0x7f271c0739a0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 --2- 172.21.15.81:0/480608261 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f271c15aa70 0x7f271c0b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 -- 172.21.15.81:0/480608261 >> 172.21.15.81:0/480608261 conn(0x7f271c0b1690 msgr2=0x7f271c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 -- 172.21.15.81:0/480608261 shutdown_connections 2024-09-17T05:26:21.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.687+0000 7f27246b6640 1 -- 172.21.15.81:0/480608261 wait complete. 2024-09-17T05:26:21.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.688+0000 7f27246b6640 1 Processor -- start 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.688+0000 7f27246b6640 1 -- start start 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f27246b6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f271c06ff80 0x7f271c145f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f27246b6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 0x7f271c15d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f27246b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c15aa70 0x7f271c142840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f27246b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f271c0707c0 con 0x7f271c15aa70 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f27246b6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f271c070640 con 0x7f271c0735a0 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f27246b6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f271c0cd5f0 con 0x7f271c06ff80 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c15aa70 0x7f271c142840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c15aa70 0x7f271c142840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34242/0 (socket says 172.21.15.81:34242) 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 -- 172.21.15.81:0/2414787414 learned_addr learned my addr 172.21.15.81:0/2414787414 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:21.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2721c51640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 0x7f271c15d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722452640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f271c06ff80 0x7f271c145f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 -- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f271c06ff80 msgr2=0x7f271c145f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f271c06ff80 0x7f271c145f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 -- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 msgr2=0x7f271c15d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 0x7f271c15d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722c53640 1 -- 172.21.15.81:0/2414787414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f271c146450 con 0x7f271c15aa70 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2721c51640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 0x7f271c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.689+0000 7f2722452640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f271c06ff80 0x7f271c145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.690+0000 7f2722c53640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c15aa70 0x7f271c142840 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f271400e710 tx=0x7f271400ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.690+0000 7f271affd640 1 -- 172.21.15.81:0/2414787414 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f271400cc60 con 0x7f271c15aa70 2024-09-17T05:26:21.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.690+0000 7f271affd640 1 -- 172.21.15.81:0/2414787414 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f271400ee20 con 0x7f271c15aa70 2024-09-17T05:26:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.690+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f271c1f50e0 con 0x7f271c15aa70 2024-09-17T05:26:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.690+0000 7f271affd640 1 -- 172.21.15.81:0/2414787414 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27140116d0 con 0x7f271c15aa70 2024-09-17T05:26:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.690+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f271c1f5980 con 0x7f271c15aa70 2024-09-17T05:26:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.691+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f271c0739a0 con 0x7f271c15aa70 2024-09-17T05:26:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.691+0000 7f271affd640 1 -- 172.21.15.81:0/2414787414 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f2714011870 con 0x7f271c15aa70 2024-09-17T05:26:21.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.692+0000 7f271affd640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27080795e0 0x7f270807baa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.692+0000 7f271affd640 1 -- 172.21.15.81:0/2414787414 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f271409bf50 con 0x7f271c15aa70 2024-09-17T05:26:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.692+0000 7f2722452640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27080795e0 0x7f270807baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:21.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.692+0000 7f2722452640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27080795e0 0x7f270807baa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f270c005fd0 tx=0x7f270c009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:21.697 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.696+0000 7f271affd640 1 -- 172.21.15.81:0/2414787414 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f271c146450 con 0x7f271c15aa70 2024-09-17T05:26:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.909+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f271c157590 con 0x7f271c15aa70 2024-09-17T05:26:21.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.910+0000 7f271affd640 1 -- 172.21.15.81:0/2414787414 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 101 v101) ==== 95+0+5229 (secure 0 0 0) 0x7f2714016030 con 0x7f271c15aa70 2024-09-17T05:26:21.911 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:21.911 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":101,"btime":"2024-09-17T05:26:19:868354+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2790285877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2790285877},{"type":"v1","addr":"172.21.15.160:6835","nonce":2790285877}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/790920368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":790920368},{"type":"v1","addr":"172.21.15.160:6834","nonce":790920368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/234206731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":234206731},{"type":"v1","addr":"172.21.15.81:6834","nonce":234206731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:26:16.673540+0000","modified":"2024-09-17T05:26:19.217419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9207":{"gid":9207,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/2091743317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2091743317},{"type":"v1","addr":"172.21.15.81:6835","nonce":2091743317}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9207,"qdb_cluster":[9207]},"id":13}]} 2024-09-17T05:26:21.911 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 101 2024-09-17T05:26:21.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27080795e0 msgr2=0x7f270807baa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27080795e0 0x7f270807baa0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f270c005fd0 tx=0x7f270c009500 comp rx=0 tx=0).stop 2024-09-17T05:26:21.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c15aa70 msgr2=0x7f271c142840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:21.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c15aa70 0x7f271c142840 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f271400e710 tx=0x7f271400ebd0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.913 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 shutdown_connections 2024-09-17T05:26:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f271c15aa70 0x7f271c142840 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f27080795e0 0x7f270807baa0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f271c0735a0 0x7f271c15d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 --2- 172.21.15.81:0/2414787414 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f271c06ff80 0x7f271c145f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 >> 172.21.15.81:0/2414787414 conn(0x7f271c0b1690 msgr2=0x7f271c072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 shutdown_connections 2024-09-17T05:26:21.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:21.912+0000 7f27246b6640 1 -- 172.21.15.81:0/2414787414 wait complete. 2024-09-17T05:26:22.326 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 101, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-09-17T05:26:16.673540+0000', 'modified': '2024-09-17T05:26:19.217419+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9207}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9207': {'gid': 9207, 'name': 'c', 'rank': 0, 'incarnation': 98, 'state': 'up:active', 'state_seq': 2, 'addr': '172.21.15.81:6835/2091743317', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.81:6833', 'nonce': 2091743317}, {'type': 'v1', 'addr': '172.21.15.81:6835', 'nonce': 2091743317}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540719139924082687, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [27], 'metadata_pool': 26, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 9207, 'qdb_cluster': [9207]} 2024-09-17T05:26:22.326 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-09-17T05:26:22.327 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 -- 172.21.15.81:0/2526345903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77440cc2e0 msgr2=0x7f77440cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 --2- 172.21.15.81:0/2526345903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77440cc2e0 0x7f77440cb520 secure :-1 s=READY pgs=1858 cs=0 l=1 rev1=1 crypto rx=0x7f77440c3e40 tx=0x7f773c02a8f0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 -- 172.21.15.81:0/2526345903 shutdown_connections 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 --2- 172.21.15.81:0/2526345903 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f77440cc2e0 0x7f77440cb520 unknown :-1 s=CLOSED pgs=1858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 --2- 172.21.15.81:0/2526345903 >> v2:172.21.15.160:3300/0 conn(0x7f77440cc830 0x7f77440cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 -- 172.21.15.81:0/2526345903 >> 172.21.15.81:0/2526345903 conn(0x7f77440741f0 msgr2=0x7f7744074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 -- 172.21.15.81:0/2526345903 shutdown_connections 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.430+0000 7f774b594640 1 -- 172.21.15.81:0/2526345903 wait complete. 2024-09-17T05:26:22.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.431+0000 7f774b594640 1 Processor -- start 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.431+0000 7f774b594640 1 -- start start 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f774b594640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440cc2e0 0x7f774415c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f774b594640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440cc830 0x7f77440c8750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f774b594640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f774415e1d0 0x7f7744160810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f774b594640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f7744070b90 con 0x7f774415e1d0 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f774b594640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f7744070a10 con 0x7f77440cc830 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f774b594640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f7744070d10 con 0x7f77440cc2e0 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f774415e1d0 0x7f7744160810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f774415e1d0 0x7f7744160810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34256/0 (socket says 172.21.15.81:34256) 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 -- 172.21.15.81:0/3604201973 learned_addr learned my addr 172.21.15.81:0/3604201973 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749330640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440cc2e0 0x7f774415c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7748b2f640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440cc830 0x7f77440c8750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 -- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440cc2e0 msgr2=0x7f774415c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440cc2e0 0x7f774415c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 -- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440cc830 msgr2=0x7f77440c8750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440cc830 0x7f77440c8750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 -- 172.21.15.81:0/3604201973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f774415c840 con 0x7f774415e1d0 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7749b31640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f774415e1d0 0x7f7744160810 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f773c033040 tx=0x7f773c003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7739ffb640 1 -- 172.21.15.81:0/3604201973 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c004240 con 0x7f774415e1d0 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.432+0000 7f7739ffb640 1 -- 172.21.15.81:0/3604201973 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f773c02d070 con 0x7f774415e1d0 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.433+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77440c91a0 con 0x7f774415e1d0 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.433+0000 7f7739ffb640 1 -- 172.21.15.81:0/3604201973 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c004680 con 0x7f774415e1d0 2024-09-17T05:26:22.437 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.433+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f774415e7f0 con 0x7f774415e1d0 2024-09-17T05:26:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.434+0000 7f7739ffb640 1 -- 172.21.15.81:0/3604201973 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f773c031480 con 0x7f774415e1d0 2024-09-17T05:26:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.435+0000 7f7739ffb640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77280795b0 0x7f772807ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.435+0000 7f7749330640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77280795b0 0x7f772807ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.435+0000 7f7739ffb640 1 -- 172.21.15.81:0/3604201973 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f773c0bb250 con 0x7f774415e1d0 2024-09-17T05:26:22.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.435+0000 7f7749330640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77280795b0 0x7f772807ba70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7740006fd0 tx=0x7f7740008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.435+0000 7f774e43f740 1 Processor -- start 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.435+0000 7f774e43f740 1 -- start start 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a39b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f774e43f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a81df0 0x5615a2a821f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a375f0 0x5615a2a37a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f774e43f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5615a29ae820 con 0x5615a2a81df0 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5615a299dc50 con 0x5615a2a621b0 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5615a29a1a60 con 0x5615a2a375f0 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a81df0 0x5615a2a821f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a81df0 0x5615a2a821f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34272/0 (socket says 172.21.15.81:34272) 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 -- 172.21.15.81:0/632178690 learned_addr learned my addr 172.21.15.81:0/632178690 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:22.445 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7749330640 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a39b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7749b31640 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a375f0 0x5615a2a37a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 -- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a375f0 msgr2=0x5615a2a37a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a375f0 0x5615a2a37a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 -- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 msgr2=0x5615a2a39b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a39b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7748b2f640 1 -- 172.21.15.81:0/632178690 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a26ff850 con 0x5615a2a81df0 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7749b31640 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a375f0 0x5615a2a37a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.436+0000 7f7749330640 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a39b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f7748b2f640 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a81df0 0x5615a2a821f0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f773400b730 tx=0x7f773400bbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f80b94d3a08fd57 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.446 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f772effd640 1 -- 172.21.15.81:0/632178690 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773400be40 con 0x5615a2a81df0 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f772effd640 1 -- 172.21.15.81:0/632178690 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7734019070 con 0x5615a2a81df0 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f772effd640 1 -- 172.21.15.81:0/632178690 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773400dce0 con 0x5615a2a81df0 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 -- 172.21.15.81:0/632178690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a81df0 msgr2=0x5615a2a821f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a81df0 0x5615a2a821f0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f773400b730 tx=0x7f773400bbf0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 -- 172.21.15.81:0/632178690 shutdown_connections 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a375f0 0x5615a2a37a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a81df0 0x5615a2a821f0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 --2- 172.21.15.81:0/632178690 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a39b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 -- 172.21.15.81:0/632178690 >> 172.21.15.81:0/632178690 conn(0x5615a2a386a0 msgr2=0x5615a2a3c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 -- 172.21.15.81:0/632178690 shutdown_connections 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.437+0000 7f774e43f740 1 -- 172.21.15.81:0/632178690 wait complete. 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.438+0000 7f774e43f740 1 -- start start 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.438+0000 7f774e43f740 1 Processor -- start 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a7a530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a93fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f774e43f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a3abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f774e43f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5615a270e620 con 0x5615a2a94520 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5615a29435f0 con 0x5615a2a621b0 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5615a2a36b30 con 0x5615a2a81df0 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f774e43f740 10 client.0 _ll_register_callbacks cb 0x5615a29470a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a3abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.448 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a3abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34276/0 (socket says 172.21.15.81:34276) 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 -- 172.21.15.81:0/2070727053 learned_addr learned my addr 172.21.15.81:0/2070727053 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749330640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a7a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7748b2f640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a93fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 -- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 msgr2=0x5615a2a93fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a93fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 -- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 msgr2=0x5615a2a7a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a7a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.449 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 -- 172.21.15.81:0/2070727053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a27766b0 con 0x5615a2a94520 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7748b2f640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a93fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749330640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a7a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7749b31640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a3abd0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f773c080960 tx=0x7f773c084eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d43b7154c430abc2 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.439+0000 7f7723fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7723fff640 1 -- 172.21.15.81:0/2070727053 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c0843c0 con 0x5615a2a94520 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7723fff640 1 -- 172.21.15.81:0/2070727053 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f773c08ddb0 con 0x5615a2a94520 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7734019070 con 0x5615a2a94520 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7723fff640 1 -- 172.21.15.81:0/2070727053 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f773c004820 con 0x5615a2a94520 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 10 client.9330 fetch_fsmap learned FSMap version 101 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x5615a2a7d8f0 con 0x5615a2a94520 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7723fff640 1 -- 172.21.15.81:0/2070727053 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f7734019070 con 0x5615a2a94520 2024-09-17T05:26:22.450 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7723fff640 1 -- 172.21.15.81:0/2070727053 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f773c004b40 con 0x5615a2a94520 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 10 client.9330 fetch_fsmap finished waiting for FSMap version 101 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 10 client.9330 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 20 client.9330 populate_metadata read hostname 'smithi081' 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2a7b1d0 0x5615a2a7df50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 4 client.9330 mds_command: new command op to 9207 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 --> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615a29b0770 con 0x5615a2a7b1d0 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7749330640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2a7b1d0 0x5615a2a7df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.451 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7749330640 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2a7b1d0 0x5615a2a7df50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1b4b568b7110c479 server_cookie=2e76ee4dca537f82 in_seq=0 out_seq=0 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.440+0000 7f7723fff640 10 client.9330 ms_handle_connect on v2:172.21.15.81:6833/2091743317 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f7723fff640 1 -- 172.21.15.81:0/2070727053 <== mds.0 v2:172.21.15.81:6833/2091743317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24444 (crc 0 0 0) 0x5615a29b0770 con 0x5615a2a7b1d0 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f7723fff640 10 client.9330 handle_command_reply: tid=0 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 client.9330 shutdown 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 msgr2=0x5615a2a3abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a3abd0 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f773c080960 tx=0x7f773c084eb0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 shutdown_connections 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a3abd0 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2a7b1d0 0x5615a2a7df50 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a93fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.452 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 --2- 172.21.15.81:0/2070727053 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a7a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f7723fff640 0 client.9330 ms_handle_reset on v2:172.21.15.81:6833/2091743317 2024-09-17T05:26:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 >> 172.21.15.81:0/2070727053 conn(0x5615a2a375f0 msgr2=0x5615a2a355d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 shutdown_connections 2024-09-17T05:26:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 1 -- 172.21.15.81:0/2070727053 wait complete. 2024-09-17T05:26:22.453 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.441+0000 7f774e43f740 20 client.9330 trim_cache size 0 max 16384 2024-09-17T05:26:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.459+0000 7f774e43f740 1 Processor -- start 2024-09-17T05:26:22.460 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.459+0000 7f774e43f740 1 -- start start 2024-09-17T05:26:22.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a621b0 0x5615a2a7df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a81df0 0x5615a2a7e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f774e43f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2aa44a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f774e43f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f77442003b0 con 0x5615a2a94520 2024-09-17T05:26:22.463 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f774415fa80 con 0x5615a2a81df0 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f77441600d0 con 0x5615a2a621b0 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2aa44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2aa44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34290/0 (socket says 172.21.15.81:34290) 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 -- 172.21.15.81:0/1034146813 learned_addr learned my addr 172.21.15.81:0/1034146813 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 -- 172.21.15.81:0/1034146813 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a621b0 msgr2=0x5615a2a7df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 --2- 172.21.15.81:0/1034146813 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a621b0 0x5615a2a7df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 -- 172.21.15.81:0/1034146813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a81df0 msgr2=0x5615a2a7e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 --2- 172.21.15.81:0/1034146813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a81df0 0x5615a2a7e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 -- 172.21.15.81:0/1034146813 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615a2a81500 con 0x5615a2a94520 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.460+0000 7f7749b31640 1 --2- 172.21.15.81:0/1034146813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2aa44a0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f773c009d60 tx=0x7f773c089220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b8b90a3615cde43 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.464 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f772e7fc640 1 -- 172.21.15.81:0/1034146813 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c084200 con 0x5615a2a94520 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f772e7fc640 1 -- 172.21.15.81:0/1034146813 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f773c0a2070 con 0x5615a2a94520 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f772e7fc640 1 -- 172.21.15.81:0/1034146813 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c08dfd0 con 0x5615a2a94520 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 -- 172.21.15.81:0/1034146813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 msgr2=0x5615a2aa44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 --2- 172.21.15.81:0/1034146813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2aa44a0 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f773c009d60 tx=0x7f773c089220 comp rx=0 tx=0).stop 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 -- 172.21.15.81:0/1034146813 shutdown_connections 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 --2- 172.21.15.81:0/1034146813 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2aa44a0 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 --2- 172.21.15.81:0/1034146813 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a81df0 0x5615a2a7e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 --2- 172.21.15.81:0/1034146813 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a621b0 0x5615a2a7df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 -- 172.21.15.81:0/1034146813 >> 172.21.15.81:0/1034146813 conn(0x5615a2a375f0 msgr2=0x5615a2a5a880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 -- 172.21.15.81:0/1034146813 shutdown_connections 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.461+0000 7f774e43f740 1 -- 172.21.15.81:0/1034146813 wait complete. 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.462+0000 7f774e43f740 1 -- start start 2024-09-17T05:26:22.465 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.462+0000 7f774e43f740 1 Processor -- start 2024-09-17T05:26:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a96fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a97520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a5a350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x5615a2a7abb0 con 0x5615a2a94520 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x5615a2a7ee90 con 0x5615a2a621b0 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x5615a2a7b650 con 0x5615a2a81df0 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 10 client.0 _ll_register_callbacks cb 0x7f773c005ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a5a350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a5a350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34294/0 (socket says 172.21.15.81:34294) 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 -- 172.21.15.81:0/1217657181 learned_addr learned my addr 172.21.15.81:0/1217657181 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 -- 172.21.15.81:0/1217657181 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 msgr2=0x5615a2a97520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a97520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 -- 172.21.15.81:0/1217657181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 msgr2=0x5615a2a96fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a96fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 -- 172.21.15.81:0/1217657181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615a2a83f80 con 0x5615a2a94520 2024-09-17T05:26:22.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7749b31640 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a5a350 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f773c004e30 tx=0x7f773c081010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70225ef080863e49 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7723fff640 10 client.0 ms_handle_connect on v2:172.21.15.81:3300/0 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7723fff640 1 -- 172.21.15.81:0/1217657181 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f773c084200 con 0x5615a2a94520 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7723fff640 1 -- 172.21.15.81:0/1217657181 <== mon.0 v2:172.21.15.81:3300/0 2 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f773c083d20 con 0x5615a2a94520 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f773c0a2070 con 0x5615a2a94520 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f7723fff640 1 -- 172.21.15.81:0/1217657181 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_get_version_reply(handle=1 version=101) ==== 24+0+0 (secure 0 0 0) 0x7f773c0843c0 con 0x5615a2a94520 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.463+0000 7f774e43f740 10 client.9336 fetch_fsmap learned FSMap version 101 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,fsmap=101,monmap=2+}) -- 0x5615a2a83f80 con 0x5615a2a94520 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f7723fff640 1 -- 172.21.15.81:0/1217657181 <== mon.0 v2:172.21.15.81:3300/0 4 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f773c0a2070 con 0x5615a2a94520 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f7723fff640 1 -- 172.21.15.81:0/1217657181 <== mon.0 v2:172.21.15.81:3300/0 5 ==== fsmap(e 101) ==== 3502+0+0 (secure 0 0 0) 0x7f773c080200 con 0x5615a2a94520 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 10 client.9336 fetch_fsmap finished waiting for FSMap version 101 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 10 client.9336 resolve_mds: resolved name 'c' to daemon mds.c 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 20 client.9336 populate_metadata read hostname 'smithi081' 2024-09-17T05:26:22.471 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2aa3490 0x5615a2a5a890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 4 client.9336 mds_command: new command op to 9207 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 --> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] -- command(tid 0: {"prefix": "status"}) -- 0x5615a29ac220 con 0x5615a2aa3490 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f7749330640 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2aa3490 0x5615a2a5a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f7723fff640 10 client.9336 ms_handle_connect on v2:172.21.15.81:6833/2091743317 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f7749330640 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2aa3490 0x5615a2a5a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b3b6182120fea211 server_cookie=a881f474b5ab0136 in_seq=0 out_seq=0 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f7723fff640 1 -- 172.21.15.81:0/1217657181 <== mds.0 v2:172.21.15.81:6833/2091743317 1 ==== command_reply(tid 0: 0 ) ==== 8+0+334 (crc 0 0 0) 0x5615a29ac220 con 0x5615a2aa3490 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f7723fff640 10 client.9336 handle_command_reply: tid=0 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 1 client.9336 shutdown 2024-09-17T05:26:22.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 msgr2=0x5615a2a5a350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.464+0000 7f774e43f740 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a5a350 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f773c004e30 tx=0x7f773c081010 comp rx=0 tx=0).stop 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 shutdown_connections 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x5615a2a94520 0x5615a2a5a350 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.81:6833/2091743317,v1:172.21.15.81:6835/2091743317] conn(0x5615a2aa3490 0x5615a2a5a890 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x5615a2a81df0 0x5615a2a97520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 --2- 172.21.15.81:0/1217657181 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x5615a2a621b0 0x5615a2a96fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 >> 172.21.15.81:0/1217657181 conn(0x5615a2a375f0 msgr2=0x5615a2a7dd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f7723fff640 0 client.9336 ms_handle_reset on v2:172.21.15.81:6833/2091743317 2024-09-17T05:26:22.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 shutdown_connections 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 1 -- 172.21.15.81:0/1217657181 wait complete. 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774e43f740 20 client.9336 trim_cache size 0 max 16384 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stdout: "cluster_fsid": "c4ef6ecb-6242-426c-8fbd-acb002cef223", 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stdout: "whoami": 0, 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 9207, 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stdout: "want_state": "up:active", 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stdout: "state": "up:active", 2024-09-17T05:26:22.474 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs", 2024-09-17T05:26:22.475 INFO:teuthology.orchestra.run.smithi081.stdout: "rank_uptime": 5.1433393289999998, 2024-09-17T05:26:22.475 INFO:teuthology.orchestra.run.smithi081.stdout: "mdsmap_epoch": 101, 2024-09-17T05:26:22.475 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch": 162, 2024-09-17T05:26:22.475 INFO:teuthology.orchestra.run.smithi081.stdout: "osdmap_epoch_barrier": 162, 2024-09-17T05:26:22.475 INFO:teuthology.orchestra.run.smithi081.stdout: "uptime": 8.8790198599999997 2024-09-17T05:26:22.475 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77280795b0 msgr2=0x7f772807ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77280795b0 0x7f772807ba70 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f7740006fd0 tx=0x7f7740008040 comp rx=0 tx=0).stop 2024-09-17T05:26:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f774415e1d0 msgr2=0x7f7744160810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f774415e1d0 0x7f7744160810 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7f773c033040 tx=0x7f773c003c20 comp rx=0 tx=0).stop 2024-09-17T05:26:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 shutdown_connections 2024-09-17T05:26:22.476 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f774415e1d0 0x7f7744160810 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f77280795b0 0x7f772807ba70 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f77440cc830 0x7f77440c8750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 --2- 172.21.15.81:0/3604201973 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f77440cc2e0 0x7f774415c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 >> 172.21.15.81:0/3604201973 conn(0x7f77440741f0 msgr2=0x7f77440b0890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 shutdown_connections 2024-09-17T05:26:22.477 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.465+0000 7f774b594640 1 -- 172.21.15.81:0/3604201973 wait complete. 2024-09-17T05:26:22.478 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:26:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.578+0000 7f4b270d4640 1 -- 172.21.15.81:0/611508109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 msgr2=0x7f4b200cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.578+0000 7f4b270d4640 1 --2- 172.21.15.81:0/611508109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b200cef30 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f4b10009860 tx=0x7f4b1002a540 comp rx=0 tx=0).stop 2024-09-17T05:26:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.578+0000 7f4b270d4640 1 -- 172.21.15.81:0/611508109 shutdown_connections 2024-09-17T05:26:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.578+0000 7f4b270d4640 1 --2- 172.21.15.81:0/611508109 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b200cef30 unknown :-1 s=CLOSED pgs=1865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.578+0000 7f4b270d4640 1 -- 172.21.15.81:0/611508109 >> 172.21.15.81:0/611508109 conn(0x7f4b200b1690 msgr2=0x7f4b200b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.578+0000 7f4b270d4640 1 -- 172.21.15.81:0/611508109 shutdown_connections 2024-09-17T05:26:22.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.578+0000 7f4b270d4640 1 -- 172.21.15.81:0/611508109 wait complete. 2024-09-17T05:26:22.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.579+0000 7f4b270d4640 1 Processor -- start 2024-09-17T05:26:22.580 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.579+0000 7f4b270d4640 1 -- start start 2024-09-17T05:26:22.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b270d4640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b20072cb0 0x7f4b201f8b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b270d4640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b200b3140 0x7f4b20146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b270d4640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b201f5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b270d4640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4b20070280 con 0x7f4b20151370 2024-09-17T05:26:22.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b270d4640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4b20070100 con 0x7f4b20072cb0 2024-09-17T05:26:22.582 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b270d4640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4b20070400 con 0x7f4b200b3140 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b201f5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b201f5480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34316/0 (socket says 172.21.15.81:34316) 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 -- 172.21.15.81:0/1987222536 learned_addr learned my addr 172.21.15.81:0/1987222536 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b24e70640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b20072cb0 0x7f4b201f8b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b1ffff640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b200b3140 0x7f4b20146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 -- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b200b3140 msgr2=0x7f4b20146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b200b3140 0x7f4b20146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 -- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b20072cb0 msgr2=0x7f4b201f8b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b20072cb0 0x7f4b201f8b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 -- 172.21.15.81:0/1987222536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b20147130 con 0x7f4b20151370 2024-09-17T05:26:22.583 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.580+0000 7f4b25671640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b201f5480 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800c410 tx=0x7f4b1800c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.581+0000 7f4b1d7fa640 1 -- 172.21.15.81:0/1987222536 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b18011790 con 0x7f4b20151370 2024-09-17T05:26:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.581+0000 7f4b1d7fa640 1 -- 172.21.15.81:0/1987222536 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4b18017070 con 0x7f4b20151370 2024-09-17T05:26:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.581+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b201537c0 con 0x7f4b20151370 2024-09-17T05:26:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.581+0000 7f4b1d7fa640 1 -- 172.21.15.81:0/1987222536 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b18011cc0 con 0x7f4b20151370 2024-09-17T05:26:22.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.581+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b20153d80 con 0x7f4b20151370 2024-09-17T05:26:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.582+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b20150b30 con 0x7f4b20151370 2024-09-17T05:26:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.582+0000 7f4b1d7fa640 1 -- 172.21.15.81:0/1987222536 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f4b1801c460 con 0x7f4b20151370 2024-09-17T05:26:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.583+0000 7f4b1d7fa640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b000795b0 0x7f4b0007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.583+0000 7f4b1d7fa640 1 -- 172.21.15.81:0/1987222536 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f4b18099260 con 0x7f4b20151370 2024-09-17T05:26:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.583+0000 7f4b24e70640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b000795b0 0x7f4b0007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:22.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.583+0000 7f4b24e70640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b000795b0 0x7f4b0007ba70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4b10034000 tx=0x7f4b10004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:22.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.587+0000 7f4b1d7fa640 1 -- 172.21.15.81:0/1987222536 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4b20150b30 con 0x7f4b20151370 2024-09-17T05:26:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.798+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f4b200cef30 con 0x7f4b20151370 2024-09-17T05:26:22.799 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.799+0000 7f4b1d7fa640 1 -- 172.21.15.81:0/1987222536 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) ==== 53+0+73 (secure 0 0 0) 0x7f4b18021020 con 0x7f4b20151370 2024-09-17T05:26:22.800 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b000795b0 msgr2=0x7f4b0007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b000795b0 0x7f4b0007ba70 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f4b10034000 tx=0x7f4b10004730 comp rx=0 tx=0).stop 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 msgr2=0x7f4b201f5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b201f5480 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f4b1800c410 tx=0x7f4b1800c8d0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 shutdown_connections 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4b20151370 0x7f4b201f5480 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4b200b3140 0x7f4b20146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.802 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4b000795b0 0x7f4b0007ba70 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 --2- 172.21.15.81:0/1987222536 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4b20072cb0 0x7f4b201f8b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 >> 172.21.15.81:0/1987222536 conn(0x7f4b200b1690 msgr2=0x7f4b200ce570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 shutdown_connections 2024-09-17T05:26:22.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:22.801+0000 7f4b270d4640 1 -- 172.21.15.81:0/1987222536 wait complete. 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi081.front.sepia.ceph.com 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:26:22.813 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:26:22.814 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:22.814 DEBUG:teuthology.orchestra.run.smithi081:> ip addr 2024-09-17T05:26:22.829 INFO:teuthology.orchestra.run.smithi081.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:26:22.829 INFO:teuthology.orchestra.run.smithi081.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:26:22.829 INFO:teuthology.orchestra.run.smithi081.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:26:22.829 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 ::1/128 scope host 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:30 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f0 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:d8:a1:31 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: altname enp7s0f1 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:52 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:26:22.830 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 0c:c4:7a:8f:d7:53 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: inet 172.21.15.81/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft 42335sec preferred_lft 42335sec 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::ec4:7aff:fe8f:d753/64 scope link noprefixroute 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d410:22ff:feca:72d1/64 scope link 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:26:22.831 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether 9e:fb:03:dc:09:42 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:26:22.832 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::9cfb:3ff:fedc:942/64 scope link 2024-09-17T05:26:22.832 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:22.832 INFO:teuthology.orchestra.run.smithi081.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:26:22.832 INFO:teuthology.orchestra.run.smithi081.stdout: link/ether da:b8:16:9a:55:c8 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:26:22.832 INFO:teuthology.orchestra.run.smithi081.stdout: inet6 fe80::d8b8:16ff:fe9a:55c8/64 scope link 2024-09-17T05:26:22.832 INFO:teuthology.orchestra.run.smithi081.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:22.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:22.832 DEBUG:teuthology.orchestra.run.smithi081:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:26:22.893 INFO:teuthology.orchestra.run.smithi081.stdout:1 2024-09-17T05:26:22.896 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:22.896 DEBUG:teuthology.orchestra.run.smithi081:> route 2024-09-17T05:26:22.951 INFO:teuthology.orchestra.run.smithi081.stdout:Kernel IP routing table 2024-09-17T05:26:22.951 INFO:teuthology.orchestra.run.smithi081.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:26:22.951 INFO:teuthology.orchestra.run.smithi081.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:26:22.952 INFO:teuthology.orchestra.run.smithi081.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:26:22.952 INFO:teuthology.orchestra.run.smithi081.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:26:22.952 DEBUG:teuthology.orchestra.run.smithi081:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:26:22.952 DEBUG:teuthology.orchestra.run.smithi081:> set -e 2024-09-17T05:26:22.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:26:22.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:26:22.952 DEBUG:teuthology.orchestra.run.smithi081:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:26:22.952 DEBUG:teuthology.orchestra.run.smithi081:> ') 2024-09-17T05:26:23.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:23 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:26:23.071 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:26:23.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:23.078 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:26:23.093 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:26:23.093 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:26:23.093 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:26:23.094 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:23.094 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link set brx.0 up 2024-09-17T05:26:23.158 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-09-17T05:26:23.158 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:26:23.159 DEBUG:teuthology.orchestra.run.smithi081:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:23.214 INFO:teuthology.orchestra.run.smithi081.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-17T05:26:23.215 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:26:23.215 DEBUG:teuthology.orchestra.run.smithi081:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:23.270 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:26:23.335 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:26:23.391 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:26:23.392 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:26:23.393 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:26:23.394 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:26:23.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:23.395 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:26:23.447 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:26:23.447 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-09-17T05:26:23.489 DEBUG:teuthology.orchestra.run.smithi081:> sudo modprobe fuse 2024-09-17T05:26:23.513 DEBUG:teuthology.orchestra.run.smithi081:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:26:23.568 INFO:teuthology.orchestra.run.smithi081.stdout:/proc 2024-09-17T05:26:23.568 INFO:teuthology.orchestra.run.smithi081.stdout:/sys 2024-09-17T05:26:23.568 INFO:teuthology.orchestra.run.smithi081.stdout:/dev 2024-09-17T05:26:23.568 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/security 2024-09-17T05:26:23.568 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/shm 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/pts 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/run 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/cgroup 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/pstore 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/bpf 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/ 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/selinux 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/debug 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/mqueue 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/dev/hugepages 2024-09-17T05:26:23.569 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/tracing 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/fs/fuse/connections 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/sys/kernel/config 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/run/user/1000 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-0 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-1 2024-09-17T05:26:23.570 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-2 2024-09-17T05:26:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:/var/lib/ceph/osd/ceph-3 2024-09-17T05:26:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns 2024-09-17T05:26:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:26:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:26:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:26:23.571 INFO:teuthology.orchestra.run.smithi081.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:26:23.572 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:23.572 DEBUG:teuthology.orchestra.run.smithi081:> ls /sys/fs/fuse/connections 2024-09-17T05:26:23.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:2024-09-17T05:26:23.569+0000 7f186a60a480 -1 init, newargv = 0x55c782cb4350 newargc=15 2024-09-17T05:26:23.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[81990]: starting ceph client 2024-09-17T05:26:23.574 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[81990]: starting fuse 2024-09-17T05:26:23.588 INFO:teuthology.orchestra.run.smithi081.stdout:41 2024-09-17T05:26:23.588 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> import glob 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> import re 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> import os 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> import subprocess 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> def _find_admin_socket(client_name): 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> files = glob.glob(asok_path) 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> # Given a non-glob path, it better be there 2024-09-17T05:26:23.589 DEBUG:teuthology.orchestra.run.smithi081:> if "*" not in asok_path: 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> assert(len(files) == 1) 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> return files[0] 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> for f in files: 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> contents = proc_f.read() 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> if mountpoint in contents: 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> return f 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> print(_find_admin_socket("client.0")) 2024-09-17T05:26:23.590 DEBUG:teuthology.orchestra.run.smithi081:> ' 2024-09-17T05:26:23.706 INFO:teuthology.orchestra.run.smithi081.stdout:/var/run/ceph/ceph-client.0.81990.asok 2024-09-17T05:26:23.709 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:23 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:26:23.716 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.81990.asok 2024-09-17T05:26:23.716 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:23.717 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.81990.asok status 2024-09-17T05:26:23.849 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "metadata": { 2024-09-17T05:26:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:26:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:26:23.849 INFO:teuthology.orchestra.run.smithi081.stdout: "entity_id": "0", 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "hostname": "smithi081", 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "pid": "81990", 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "root": "/" 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_count": 0, 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "dentry_pinned_count": 0, 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "id": 9354, 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "inst": { 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "name": { 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "client", 2024-09-17T05:26:23.850 INFO:teuthology.orchestra.run.smithi081.stdout: "num": 9354 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 507940571 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": { 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "type": "v1", 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: "nonce": 507940571 2024-09-17T05:26:23.851 INFO:teuthology.orchestra.run.smithi081.stdout: }, 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "inst_str": "client.9354 192.168.0.1:0/507940571", 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "addr_str": "192.168.0.1:0/507940571", 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "inode_count": 1, 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "mds_epoch": 101, 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch": 162, 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "blocklisted": false, 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout: "fs_name": "cephfs" 2024-09-17T05:26:23.852 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:23.860 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:23.860 DEBUG:teuthology.orchestra.run.smithi081:> stat --file-system '--printf=%T 2024-09-17T05:26:23.861 DEBUG:teuthology.orchestra.run.smithi081:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:23.876 INFO:teuthology.orchestra.run.smithi081.stdout:fuseblk 2024-09-17T05:26:23.876 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:23.876 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:23.877 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:23.942 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-09-17T05:26:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 -- 172.21.15.81:0/323232526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d0d00 msgr2=0x7f23e00cf9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 --2- 172.21.15.81:0/323232526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d0d00 0x7f23e00cf9e0 secure :-1 s=READY pgs=1870 cs=0 l=1 rev1=1 crypto rx=0x7f23c8005fd0 tx=0x7f23c802aa00 comp rx=0 tx=0).stop 2024-09-17T05:26:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 -- 172.21.15.81:0/323232526 shutdown_connections 2024-09-17T05:26:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 --2- 172.21.15.81:0/323232526 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23e00d4960 0x7f23e00b6c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 --2- 172.21.15.81:0/323232526 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d0d00 0x7f23e00cf9e0 unknown :-1 s=CLOSED pgs=1870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.083 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 -- 172.21.15.81:0/323232526 >> 172.21.15.81:0/323232526 conn(0x7f23e00d3e40 msgr2=0x7f23e00d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 -- 172.21.15.81:0/323232526 shutdown_connections 2024-09-17T05:26:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.082+0000 7f23e54b6640 1 -- 172.21.15.81:0/323232526 wait complete. 2024-09-17T05:26:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.083+0000 7f23e54b6640 1 Processor -- start 2024-09-17T05:26:24.084 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.083+0000 7f23e54b6640 1 -- start start 2024-09-17T05:26:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23e54b6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23e00d0d00 0x7f23e015ee20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23e54b6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d4960 0x7f23e01f49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23e54b6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23e015df30 0x7f23e009e270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:24.086 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23e54b6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00b71b0 con 0x7f23e00d4960 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23e54b6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f23e00d2b20 con 0x7f23e015df30 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23e54b6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f23e00b7330 con 0x7f23e00d0d00 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d4960 0x7f23e01f49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d4960 0x7f23e01f49c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53054/0 (socket says 172.21.15.81:53054) 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 -- 172.21.15.81:0/277616521 learned_addr learned my addr 172.21.15.81:0/277616521 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23deffd640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23e00d0d00 0x7f23e015ee20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23df7fe640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23e015df30 0x7f23e009e270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 -- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23e00d0d00 msgr2=0x7f23e015ee20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23e00d0d00 0x7f23e015ee20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 -- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23e015df30 msgr2=0x7f23e009e270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23e015df30 0x7f23e009e270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.087 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 -- 172.21.15.81:0/277616521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f23e01f4f00 con 0x7f23e00d4960 2024-09-17T05:26:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23de7fc640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d4960 0x7f23e01f49c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000f80 tx=0x7f23c8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.084+0000 7f23d77fe640 1 -- 172.21.15.81:0/277616521 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8047070 con 0x7f23e00d4960 2024-09-17T05:26:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.085+0000 7f23d77fe640 1 -- 172.21.15.81:0/277616521 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f23c8004250 con 0x7f23e00d4960 2024-09-17T05:26:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.085+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f23e01f51a0 con 0x7f23e00d4960 2024-09-17T05:26:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.085+0000 7f23d77fe640 1 -- 172.21.15.81:0/277616521 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23c8033050 con 0x7f23e00d4960 2024-09-17T05:26:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.085+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f23e01f5760 con 0x7f23e00d4960 2024-09-17T05:26:24.088 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.086+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f23e00b78c0 con 0x7f23e00d4960 2024-09-17T05:26:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.086+0000 7f23d77fe640 1 -- 172.21.15.81:0/277616521 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f23c8036070 con 0x7f23e00d4960 2024-09-17T05:26:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.087+0000 7f23d77fe640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f23c00795b0 0x7f23c007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.087+0000 7f23d77fe640 1 -- 172.21.15.81:0/277616521 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f23c80ba820 con 0x7f23e00d4960 2024-09-17T05:26:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.087+0000 7f23deffd640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f23c00795b0 0x7f23c007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:24.089 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.087+0000 7f23deffd640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f23c00795b0 0x7f23c007ba70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f23d8006fd0 tx=0x7f23d8008040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:24.092 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.091+0000 7f23d77fe640 1 -- 172.21.15.81:0/277616521 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f23c8084500 con 0x7f23e00d4960 2024-09-17T05:26:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.306+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f23e00d2540 con 0x7f23e00d4960 2024-09-17T05:26:24.307 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.306+0000 7f23d77fe640 1 -- 172.21.15.81:0/277616521 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v101) ==== 53+0+73 (secure 0 0 0) 0x7f23c8083e00 con 0x7f23e00d4960 2024-09-17T05:26:24.307 INFO:teuthology.orchestra.run.smithi081.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f23c00795b0 msgr2=0x7f23c007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f23c00795b0 0x7f23c007ba70 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f23d8006fd0 tx=0x7f23d8008040 comp rx=0 tx=0).stop 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d4960 msgr2=0x7f23e01f49c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d4960 0x7f23e01f49c0 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7f23c8000f80 tx=0x7f23c8003f10 comp rx=0 tx=0).stop 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 shutdown_connections 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f23c00795b0 0x7f23c007ba70 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f23e015df30 0x7f23e009e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f23e00d4960 0x7f23e01f49c0 unknown :-1 s=CLOSED pgs=1871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 --2- 172.21.15.81:0/277616521 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f23e00d0d00 0x7f23e015ee20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 >> 172.21.15.81:0/277616521 conn(0x7f23e00d3e40 msgr2=0x7f23e00d4220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:24.310 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 shutdown_connections 2024-09-17T05:26:24.311 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:24.308+0000 7f23e54b6640 1 -- 172.21.15.81:0/277616521 wait complete. 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi160.front.sepia.ceph.com 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-17T05:26:24.320 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-17T05:26:24.321 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:26:24.321 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:24.321 DEBUG:teuthology.orchestra.run.smithi160:> ip addr 2024-09-17T05:26:24.341 INFO:teuthology.orchestra.run.smithi160.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-17T05:26:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-17T05:26:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: inet 127.0.0.1/8 scope host lo 2024-09-17T05:26:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 ::1/128 scope host 2024-09-17T05:26:24.341 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:80 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f0 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:d9:82:81 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: altname enp7s0f1 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5a brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether 0c:c4:7a:88:7f:5b brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: inet 172.21.15.160/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft 42331sec preferred_lft 42331sec 2024-09-17T05:26:24.342 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::ec4:7aff:fe88:7f5b/64 scope link noprefixroute 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::88b5:9eff:fea1:2773/64 scope link 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether c2:74:55:39:6e:e6 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::c074:55ff:fe39:6ee6/64 scope link 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2024-09-17T05:26:24.343 INFO:teuthology.orchestra.run.smithi160.stdout: link/ether b2:d4:b5:a7:64:41 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: inet6 fe80::b0d4:b5ff:fea7:6441/64 scope link 2024-09-17T05:26:24.344 INFO:teuthology.orchestra.run.smithi160.stdout: valid_lft forever preferred_lft forever 2024-09-17T05:26:24.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:24.344 DEBUG:teuthology.orchestra.run.smithi160:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-17T05:26:24.410 INFO:teuthology.orchestra.run.smithi160.stdout:1 2024-09-17T05:26:24.412 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:24.412 DEBUG:teuthology.orchestra.run.smithi160:> route 2024-09-17T05:26:24.471 INFO:teuthology.orchestra.run.smithi160.stdout:Kernel IP routing table 2024-09-17T05:26:24.472 INFO:teuthology.orchestra.run.smithi160.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-17T05:26:24.472 INFO:teuthology.orchestra.run.smithi160.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-17T05:26:24.472 INFO:teuthology.orchestra.run.smithi160.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-17T05:26:24.472 INFO:teuthology.orchestra.run.smithi160.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-17T05:26:24.472 DEBUG:teuthology.orchestra.run.smithi160:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-17T05:26:24.472 DEBUG:teuthology.orchestra.run.smithi160:> set -e 2024-09-17T05:26:24.472 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-17T05:26:24.472 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-17T05:26:24.472 DEBUG:teuthology.orchestra.run.smithi160:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-17T05:26:24.473 DEBUG:teuthology.orchestra.run.smithi160:> ') 2024-09-17T05:26:24.566 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:26:24 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-17T05:26:24.600 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:26:24 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:26:24.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:24.606 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:26:24.621 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:26:24.622 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:26:24.622 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:26:24.622 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:24.622 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link set brx.0 up 2024-09-17T05:26:24.687 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-09-17T05:26:24.687 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:26:24.687 DEBUG:teuthology.orchestra.run.smithi160:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:24.743 INFO:teuthology.orchestra.run.smithi160.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-09-17T05:26:24.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-17T05:26:24.744 DEBUG:teuthology.orchestra.run.smithi160:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:24.799 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:26:24.865 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:26:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:26:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:26:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:26:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:26:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:26:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:26:25.079 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:26:25.080 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:26:25.081 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:26:25.082 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:25.082 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:25.082 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:25.082 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:25.082 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:25.082 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:26:25.135 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-17T05:26:25.136 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-09-17T05:26:25.178 DEBUG:teuthology.orchestra.run.smithi160:> sudo modprobe fuse 2024-09-17T05:26:25.202 DEBUG:teuthology.orchestra.run.smithi160:> cat /proc/self/mounts | awk '{print $2}' 2024-09-17T05:26:25.259 INFO:teuthology.orchestra.run.smithi160.stdout:/proc 2024-09-17T05:26:25.259 INFO:teuthology.orchestra.run.smithi160.stdout:/sys 2024-09-17T05:26:25.259 INFO:teuthology.orchestra.run.smithi160.stdout:/dev 2024-09-17T05:26:25.259 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/security 2024-09-17T05:26:25.259 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/shm 2024-09-17T05:26:25.259 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/pts 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/run 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/cgroup 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/pstore 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/bpf 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/ 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/selinux 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/proc/sys/fs/binfmt_misc 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/debug 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/mqueue 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/dev/hugepages 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/tracing 2024-09-17T05:26:25.260 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/fs/fuse/connections 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/sys/kernel/config 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-sysctl.service 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/nfs/rpc_pipefs 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/run/user/1000 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-4 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-5 2024-09-17T05:26:25.261 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-6 2024-09-17T05:26:25.262 INFO:teuthology.orchestra.run.smithi160.stdout:/var/lib/ceph/osd/ceph-7 2024-09-17T05:26:25.262 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns 2024-09-17T05:26:25.262 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:25.262 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:25.262 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:25.262 INFO:teuthology.orchestra.run.smithi160.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:25.262 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:25.263 DEBUG:teuthology.orchestra.run.smithi160:> ls /sys/fs/fuse/connections 2024-09-17T05:26:25.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:2024-09-17T05:26:25.259+0000 7fc294321480 -1 init, newargv = 0x562ad1c48c40 newargc=15 2024-09-17T05:26:25.263 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[50646]: starting ceph client 2024-09-17T05:26:25.265 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[50646]: starting fuse 2024-09-17T05:26:25.278 INFO:teuthology.orchestra.run.smithi160.stdout:41 2024-09-17T05:26:25.278 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2024-09-17T05:26:25.278 DEBUG:teuthology.orchestra.run.smithi160:> sudo stdin-killer -- python3 -c ' 2024-09-17T05:26:25.278 DEBUG:teuthology.orchestra.run.smithi160:> import glob 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> import re 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> import os 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> import subprocess 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> def _find_admin_socket(client_name): 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> files = glob.glob(asok_path) 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> # Given a non-glob path, it better be there 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> if "*" not in asok_path: 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> assert(len(files) == 1) 2024-09-17T05:26:25.279 DEBUG:teuthology.orchestra.run.smithi160:> return files[0] 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> for f in files: 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> contents = proc_f.read() 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> if mountpoint in contents: 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> return f 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> print(_find_admin_socket("client.1")) 2024-09-17T05:26:25.280 DEBUG:teuthology.orchestra.run.smithi160:> ' 2024-09-17T05:26:25.396 INFO:teuthology.orchestra.run.smithi160.stdout:/var/run/ceph/ceph-client.1.50646.asok 2024-09-17T05:26:25.399 INFO:teuthology.orchestra.run.smithi160.stderr:2024-09-17T05:26:25 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:26:25.407 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.50646.asok 2024-09-17T05:26:25.407 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:25.407 DEBUG:teuthology.orchestra.run.smithi160:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.50646.asok status 2024-09-17T05:26:25.540 INFO:teuthology.orchestra.run.smithi160.stdout:{ 2024-09-17T05:26:25.540 INFO:teuthology.orchestra.run.smithi160.stdout: "metadata": { 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_sha1": "820f760e4779dafd30d668ecea7aba6355dfd3d8", 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "ceph_version": "ceph version 19.3.0-4963-g820f760e (820f760e4779dafd30d668ecea7aba6355dfd3d8) squid (dev)", 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "entity_id": "1", 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "hostname": "smithi160", 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "pid": "50646", 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "root": "/" 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_count": 0, 2024-09-17T05:26:25.541 INFO:teuthology.orchestra.run.smithi160.stdout: "dentry_pinned_count": 0, 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "id": 7966, 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "inst": { 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "name": { 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "client", 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "num": 7966 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 885571899 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: } 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:25.542 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": { 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "type": "v1", 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "addr": "192.168.0.1:0", 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "nonce": 885571899 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: }, 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "inst_str": "client.7966 192.168.0.1:0/885571899", 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "addr_str": "192.168.0.1:0/885571899", 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "inode_count": 1, 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "mds_epoch": 101, 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch": 162, 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "osd_epoch_barrier": 0, 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "blocklisted": false, 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout: "fs_name": "cephfs" 2024-09-17T05:26:25.543 INFO:teuthology.orchestra.run.smithi160.stdout:} 2024-09-17T05:26:25.549 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:25.549 DEBUG:teuthology.orchestra.run.smithi160:> stat --file-system '--printf=%T 2024-09-17T05:26:25.549 DEBUG:teuthology.orchestra.run.smithi160:> ' -- /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:25.565 INFO:teuthology.orchestra.run.smithi160.stdout:fuseblk 2024-09-17T05:26:25.565 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:25.565 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:25.565 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:25.630 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs flag set enable_multiple true --yes-i-really-mean-it 2024-09-17T05:26:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.748+0000 7f61b3abd640 1 -- 172.21.15.81:0/4004423685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198004800 msgr2=0x7f6198004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.748+0000 7f61b3abd640 1 --2- 172.21.15.81:0/4004423685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198004800 0x7f6198004c80 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f619c009b20 tx=0x7f6198005830 comp rx=0 tx=0).stop 2024-09-17T05:26:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.748+0000 7f61b3abd640 1 -- 172.21.15.81:0/4004423685 shutdown_connections 2024-09-17T05:26:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.748+0000 7f61b3abd640 1 --2- 172.21.15.81:0/4004423685 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6198004800 0x7f6198004c80 unknown :-1 s=CLOSED pgs=1874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.748+0000 7f61b3abd640 1 -- 172.21.15.81:0/4004423685 >> 172.21.15.81:0/4004423685 conn(0x7f61ac0b1620 msgr2=0x7f61ac0b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.748+0000 7f61b3abd640 1 -- 172.21.15.81:0/4004423685 shutdown_connections 2024-09-17T05:26:25.749 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.748+0000 7f61b3abd640 1 -- 172.21.15.81:0/4004423685 wait complete. 2024-09-17T05:26:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.749+0000 7f61b3abd640 1 Processor -- start 2024-09-17T05:26:25.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.749+0000 7f61b3abd640 1 -- start start 2024-09-17T05:26:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b3abd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6198004800 0x7f61ac148530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b3abd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61ac1533a0 0x7f61ac14ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:25.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b3abd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61ac151170 0x7f61ac14c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b3abd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac15bd60 con 0x7f61ac151170 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b3abd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f61ac15bbe0 con 0x7f6198004800 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b3abd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f61ac15bee0 con 0x7f61ac1533a0 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61ac151170 0x7f61ac14c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61ac151170 0x7f61ac14c1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53070/0 (socket says 172.21.15.81:53070) 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 -- 172.21.15.81:0/2243403912 learned_addr learned my addr 172.21.15.81:0/2243403912 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b1859640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6198004800 0x7f61ac148530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b1058640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61ac1533a0 0x7f61ac14ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 -- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61ac1533a0 msgr2=0x7f61ac14ecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61ac1533a0 0x7f61ac14ecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 -- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6198004800 msgr2=0x7f61ac148530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:25.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6198004800 0x7f61ac148530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 -- 172.21.15.81:0/2243403912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61ac148a70 con 0x7f61ac151170 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b1859640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6198004800 0x7f61ac148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b205a640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61ac151170 0x7f61ac14c1c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b4b30 tx=0x7f61a40064f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61a27fc640 1 -- 172.21.15.81:0/2243403912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a400f960 con 0x7f61ac151170 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61a27fc640 1 -- 172.21.15.81:0/2243403912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f61a400fb00 con 0x7f61ac151170 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61a27fc640 1 -- 172.21.15.81:0/2243403912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f61a4011430 con 0x7f61ac151170 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.750+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61ac1500d0 con 0x7f61ac151170 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.751+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61ac150690 con 0x7f61ac151170 2024-09-17T05:26:25.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.752+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61ac1580d0 con 0x7f61ac151170 2024-09-17T05:26:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.752+0000 7f61a27fc640 1 -- 172.21.15.81:0/2243403912 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f61a40115d0 con 0x7f61ac151170 2024-09-17T05:26:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.753+0000 7f61a27fc640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61900795b0 0x7f619007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.753+0000 7f61b1859640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61900795b0 0x7f619007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.753+0000 7f61a27fc640 1 -- 172.21.15.81:0/2243403912 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f61a4099eb0 con 0x7f61ac151170 2024-09-17T05:26:25.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.753+0000 7f61b1859640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61900795b0 0x7f619007ba70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8001e00 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:25.758 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.757+0000 7f61a27fc640 1 -- 172.21.15.81:0/2243403912 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f61a40635c0 con 0x7f61ac151170 2024-09-17T05:26:25.970 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:25.969+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true} v 0) -- 0x7f61ac06e720 con 0x7f61ac151170 2024-09-17T05:26:26.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.159+0000 7f61a27fc640 1 -- 172.21.15.81:0/2243403912 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs flag set", "flag_name": "enable_multiple", "val": "true", "yes_i_really_mean_it": true}]=0 v102) ==== 136+0+0 (secure 0 0 0) 0x7f61a4067ff0 con 0x7f61ac151170 2024-09-17T05:26:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61900795b0 msgr2=0x7f619007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61900795b0 0x7f619007ba70 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f61a8006fd0 tx=0x7f61a8001e00 comp rx=0 tx=0).stop 2024-09-17T05:26:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61ac151170 msgr2=0x7f61ac14c1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61ac151170 0x7f61ac14c1c0 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f61ac0b4b30 tx=0x7f61a40064f0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 shutdown_connections 2024-09-17T05:26:26.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f61ac151170 0x7f61ac14c1c0 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f61ac1533a0 0x7f61ac14ecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f61900795b0 0x7f619007ba70 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 --2- 172.21.15.81:0/2243403912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f6198004800 0x7f61ac148530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 >> 172.21.15.81:0/2243403912 conn(0x7f61ac0b1620 msgr2=0x7f61ac15d630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:26.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 shutdown_connections 2024-09-17T05:26:26.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.161+0000 7f61b3abd640 1 -- 172.21.15.81:0/2243403912 wait complete. 2024-09-17T05:26:26.174 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs volume ls 2024-09-17T05:26:26.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 -- 172.21.15.81:0/2723150222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f973415aa70 msgr2=0x7f97340b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 --2- 172.21.15.81:0/2723150222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f973415aa70 0x7f97340b4690 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f9724009830 tx=0x7f972402a4a0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 -- 172.21.15.81:0/2723150222 shutdown_connections 2024-09-17T05:26:26.275 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 --2- 172.21.15.81:0/2723150222 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f97340735a0 0x7f97340739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 --2- 172.21.15.81:0/2723150222 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f973415aa70 0x7f97340b4690 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 -- 172.21.15.81:0/2723150222 >> 172.21.15.81:0/2723150222 conn(0x7f97340b1690 msgr2=0x7f97340b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:26.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 -- 172.21.15.81:0/2723150222 shutdown_connections 2024-09-17T05:26:26.276 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.274+0000 7f973aed6640 1 -- 172.21.15.81:0/2723150222 wait complete. 2024-09-17T05:26:26.278 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.275+0000 7f973aed6640 1 Processor -- start 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.275+0000 7f973aed6640 1 -- start start 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f973aed6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973406ff80 0x7f97341f56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f973aed6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97340735a0 0x7f9734145570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f973aed6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f973415aa70 0x7f97341593e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f973aed6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f97340707a0 con 0x7f973406ff80 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f973aed6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f9734070620 con 0x7f97340735a0 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f973aed6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f97341f5c10 con 0x7f973415aa70 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973406ff80 0x7f97341f56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.279 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973406ff80 0x7f97341f56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53076/0 (socket says 172.21.15.81:53076) 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 -- 172.21.15.81:0/2842695055 learned_addr learned my addr 172.21.15.81:0/2842695055 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9733fff640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97340735a0 0x7f9734145570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9739473640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f973415aa70 0x7f97341593e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 -- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f973415aa70 msgr2=0x7f97341593e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f973415aa70 0x7f97341593e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 -- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97340735a0 msgr2=0x7f9734145570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97340735a0 0x7f9734145570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 -- 172.21.15.81:0/2842695055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9734145ab0 con 0x7f973406ff80 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9733fff640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97340735a0 0x7f9734145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.276+0000 7f9738c72640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973406ff80 0x7f97341f56d0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9724009950 tx=0x7f9724003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:26.280 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.277+0000 7f97317fa640 1 -- 172.21.15.81:0/2842695055 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724005c90 con 0x7f973406ff80 2024-09-17T05:26:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.277+0000 7f97317fa640 1 -- 172.21.15.81:0/2842695055 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f9724005020 con 0x7f973406ff80 2024-09-17T05:26:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.277+0000 7f97317fa640 1 -- 172.21.15.81:0/2842695055 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9724005450 con 0x7f973406ff80 2024-09-17T05:26:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.277+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9734159920 con 0x7f973406ff80 2024-09-17T05:26:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.277+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97341f4910 con 0x7f973406ff80 2024-09-17T05:26:26.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.278+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97340cd8c0 con 0x7f973406ff80 2024-09-17T05:26:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.278+0000 7f97317fa640 1 -- 172.21.15.81:0/2842695055 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f97240317c0 con 0x7f973406ff80 2024-09-17T05:26:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.279+0000 7f97317fa640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97200795b0 0x7f972007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.279+0000 7f97317fa640 1 -- 172.21.15.81:0/2842695055 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f97240ba700 con 0x7f973406ff80 2024-09-17T05:26:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.279+0000 7f9733fff640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97200795b0 0x7f972007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.279+0000 7f9733fff640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97200795b0 0x7f972007ba70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f97341e77f0 tx=0x7f9728005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:26.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.283+0000 7f97317fa640 1 -- 172.21.15.81:0/2842695055 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f972403f030 con 0x7f973406ff80 2024-09-17T05:26:26.481 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.480+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs volume ls", "target": ["mon-mgr", ""]}) -- 0x7f973415a220 con 0x7f97200795b0 2024-09-17T05:26:26.482 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.481+0000 7f97317fa640 1 -- 172.21.15.81:0/2842695055 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+41 (secure 0 0 0) 0x7f973415a220 con 0x7f97200795b0 2024-09-17T05:26:26.482 INFO:teuthology.orchestra.run.smithi081.stdout:[ 2024-09-17T05:26:26.482 INFO:teuthology.orchestra.run.smithi081.stdout: { 2024-09-17T05:26:26.482 INFO:teuthology.orchestra.run.smithi081.stdout: "name": "cephfs" 2024-09-17T05:26:26.482 INFO:teuthology.orchestra.run.smithi081.stdout: } 2024-09-17T05:26:26.482 INFO:teuthology.orchestra.run.smithi081.stdout:] 2024-09-17T05:26:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97200795b0 msgr2=0x7f972007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.484 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97200795b0 0x7f972007ba70 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f97341e77f0 tx=0x7f9728005f90 comp rx=0 tx=0).stop 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973406ff80 msgr2=0x7f97341f56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973406ff80 0x7f97341f56d0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f9724009950 tx=0x7f9724003c10 comp rx=0 tx=0).stop 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 shutdown_connections 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f973415aa70 0x7f97341593e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f97200795b0 0x7f972007ba70 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f97340735a0 0x7f9734145570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 --2- 172.21.15.81:0/2842695055 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f973406ff80 0x7f97341f56d0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 >> 172.21.15.81:0/2842695055 conn(0x7f97340b1690 msgr2=0x7f97340cdad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 shutdown_connections 2024-09-17T05:26:26.485 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.483+0000 7f973aed6640 1 -- 172.21.15.81:0/2842695055 wait complete. 2024-09-17T05:26:26.495 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2024-09-17T05:26:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.598+0000 7fa518c16640 1 -- 172.21.15.81:0/1614811892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140b4df0 msgr2=0x7fa514168ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.598+0000 7fa518c16640 1 --2- 172.21.15.81:0/1614811892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140b4df0 0x7fa514168ce0 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7fa504009830 tx=0x7fa50402a530 comp rx=0 tx=0).stop 2024-09-17T05:26:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.598+0000 7fa518c16640 1 -- 172.21.15.81:0/1614811892 shutdown_connections 2024-09-17T05:26:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.598+0000 7fa518c16640 1 --2- 172.21.15.81:0/1614811892 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5140b4df0 0x7fa514168ce0 unknown :-1 s=CLOSED pgs=1879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.598+0000 7fa518c16640 1 -- 172.21.15.81:0/1614811892 >> 172.21.15.81:0/1614811892 conn(0x7fa5140d3e30 msgr2=0x7fa5140d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.598+0000 7fa518c16640 1 -- 172.21.15.81:0/1614811892 shutdown_connections 2024-09-17T05:26:26.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.598+0000 7fa518c16640 1 -- 172.21.15.81:0/1614811892 wait complete. 2024-09-17T05:26:26.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 Processor -- start 2024-09-17T05:26:26.602 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 -- start start 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5140b4df0 0x7fa514150150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5140d01b0 0x7fa51415c260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5141617f0 0x7fa514152570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fa5141695b0 con 0x7fa5141617f0 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fa514169430 con 0x7fa5140b4df0 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.600+0000 7fa518c16640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fa514169730 con 0x7fa5140d01b0 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5141617f0 0x7fa514152570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5141617f0 0x7fa514152570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53090/0 (socket says 172.21.15.81:53090) 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 -- 172.21.15.81:0/774289596 learned_addr learned my addr 172.21.15.81:0/774289596 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:26.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa51259c640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5140b4df0 0x7fa514150150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa511d9b640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5140d01b0 0x7fa51415c260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 -- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5140d01b0 msgr2=0x7fa51415c260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5140d01b0 0x7fa51415c260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 -- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5140b4df0 msgr2=0x7fa514150150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5140b4df0 0x7fa514150150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 -- 172.21.15.81:0/774289596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa5141509a0 con 0x7fa5141617f0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa512d9d640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5141617f0 0x7fa514152570 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa50402ab20 tx=0x7fa504032cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa50affd640 1 -- 172.21.15.81:0/774289596 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504040070 con 0x7fa5141617f0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa50affd640 1 -- 172.21.15.81:0/774289596 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fa504005310 con 0x7fa5141617f0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa50affd640 1 -- 172.21.15.81:0/774289596 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa504003800 con 0x7fa5141617f0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa514150c80 con 0x7fa5141617f0 2024-09-17T05:26:26.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.601+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa514150690 con 0x7fa5141617f0 2024-09-17T05:26:26.605 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.602+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa5140d1d30 con 0x7fa5141617f0 2024-09-17T05:26:26.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.603+0000 7fa50affd640 1 -- 172.21.15.81:0/774289596 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fa504039040 con 0x7fa5141617f0 2024-09-17T05:26:26.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.603+0000 7fa50affd640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4f40795b0 0x7fa4f407ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:26.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.603+0000 7fa50affd640 1 -- 172.21.15.81:0/774289596 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7fa5040ba990 con 0x7fa5141617f0 2024-09-17T05:26:26.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.603+0000 7fa51259c640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4f40795b0 0x7fa4f407ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:26.606 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.604+0000 7fa51259c640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4f40795b0 0x7fa4f407ba70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0012e0 tx=0x7fa50c009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:26.608 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.608+0000 7fa50affd640 1 -- 172.21.15.81:0/774289596 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fa5040846f0 con 0x7fa5141617f0 2024-09-17T05:26:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.783+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) -- 0x7fa5140d4640 con 0x7fa5141617f0 2024-09-17T05:26:26.784 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.784+0000 7fa50affd640 1 -- 172.21.15.81:0/774289596 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v48)=0 v48) ==== 122+0+0 (secure 0 0 0) 0x7fa504083ff0 con 0x7fa5141617f0 2024-09-17T05:26:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4f40795b0 msgr2=0x7fa4f407ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4f40795b0 0x7fa4f407ba70 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa50c0012e0 tx=0x7fa50c009040 comp rx=0 tx=0).stop 2024-09-17T05:26:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5141617f0 msgr2=0x7fa514152570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5141617f0 0x7fa514152570 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7fa50402ab20 tx=0x7fa504032cd0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 shutdown_connections 2024-09-17T05:26:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fa5141617f0 0x7fa514152570 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fa5140d01b0 0x7fa51415c260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fa4f40795b0 0x7fa4f407ba70 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 --2- 172.21.15.81:0/774289596 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fa5140b4df0 0x7fa514150150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 >> 172.21.15.81:0/774289596 conn(0x7fa5140d3e30 msgr2=0x7fa51406e630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 shutdown_connections 2024-09-17T05:26:26.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:26.786+0000 7fa518c16640 1 -- 172.21.15.81:0/774289596 wait complete. 2024-09-17T05:26:26.797 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:26.798 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo mkdir -p ./volumes/subvol_grp8800/subvol50240) 2024-09-17T05:26:26.830 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:26.830 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec getfattr --only-values -n ceph.dir.layout.pool .) 2024-09-17T05:26:26.886 INFO:teuthology.orchestra.run.smithi081.stdout:cephfs_data 2024-09-17T05:26:26.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:26.887 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo setfattr -n ceph.dir.layout.pool -v cephfs_data ./volumes/subvol_grp8800/subvol50240) 2024-09-17T05:26:26.956 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:26.956 DEBUG:teuthology.orchestra.run.smithi081:> sudo dd of=/home/ubuntu/cephtest/mnt.0/./volumes/subvol_grp8800/subvol50240/.meta 2024-09-17T05:26:27.024 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol50240 subvol_grp8800 2024-09-17T05:26:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 -- 172.21.15.81:0/2536585483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c0ce8d0 msgr2=0x7fda8c074c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 --2- 172.21.15.81:0/2536585483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c0ce8d0 0x7fda8c074c80 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fda8c06e4d0 tx=0x7fda8802a4d0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 -- 172.21.15.81:0/2536585483 shutdown_connections 2024-09-17T05:26:27.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 --2- 172.21.15.81:0/2536585483 >> v2:172.21.15.160:3300/0 conn(0x7fda8c068ac0 0x7fda8c0b06e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 --2- 172.21.15.81:0/2536585483 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c0ce8d0 0x7fda8c074c80 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 -- 172.21.15.81:0/2536585483 >> 172.21.15.81:0/2536585483 conn(0x7fda8c074160 msgr2=0x7fda8c074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 -- 172.21.15.81:0/2536585483 shutdown_connections 2024-09-17T05:26:27.172 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.170+0000 7fda9476b640 1 -- 172.21.15.81:0/2536585483 wait complete. 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.171+0000 7fda9476b640 1 Processor -- start 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.171+0000 7fda9476b640 1 -- start start 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda9476b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c068ac0 0x7fda8c156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda9476b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda8c0ce8d0 0x7fda8c1568b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda9476b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda8c15ab70 0x7fda8c1f3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda9476b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c0b0fb0 con 0x7fda8c068ac0 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda9476b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fda8c0b0e30 con 0x7fda8c0ce8d0 2024-09-17T05:26:27.174 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda9476b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fda8c0b1130 con 0x7fda8c15ab70 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c068ac0 0x7fda8c156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c068ac0 0x7fda8c156ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53098/0 (socket says 172.21.15.81:53098) 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 -- 172.21.15.81:0/1243359691 learned_addr learned my addr 172.21.15.81:0/1243359691 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda91d06640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda8c0ce8d0 0x7fda8c1568b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92d08640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda8c15ab70 0x7fda8c1f3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 -- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda8c15ab70 msgr2=0x7fda8c1f3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda8c15ab70 0x7fda8c1f3100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 -- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda8c0ce8d0 msgr2=0x7fda8c1568b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda8c0ce8d0 0x7fda8c1568b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 -- 172.21.15.81:0/1243359691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8c1f3640 con 0x7fda8c068ac0 2024-09-17T05:26:27.175 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda92507640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c068ac0 0x7fda8c156ec0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00b420 tx=0x7fda7c00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.172+0000 7fda82ffd640 1 -- 172.21.15.81:0/1243359691 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c011830 con 0x7fda8c068ac0 2024-09-17T05:26:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.173+0000 7fda82ffd640 1 -- 172.21.15.81:0/1243359691 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fda7c016070 con 0x7fda8c068ac0 2024-09-17T05:26:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.173+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8c157b30 con 0x7fda8c068ac0 2024-09-17T05:26:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.173+0000 7fda82ffd640 1 -- 172.21.15.81:0/1243359691 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c011d60 con 0x7fda8c068ac0 2024-09-17T05:26:27.176 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.173+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda8c1580f0 con 0x7fda8c068ac0 2024-09-17T05:26:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.174+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda8c0b06e0 con 0x7fda8c068ac0 2024-09-17T05:26:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.174+0000 7fda82ffd640 1 -- 172.21.15.81:0/1243359691 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7fda7c01b460 con 0x7fda8c068ac0 2024-09-17T05:26:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.175+0000 7fda82ffd640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fda700795b0 0x7fda7007ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.175+0000 7fda82ffd640 1 -- 172.21.15.81:0/1243359691 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7fda7c099210 con 0x7fda8c068ac0 2024-09-17T05:26:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.175+0000 7fda91d06640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fda700795b0 0x7fda7007ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.177 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.175+0000 7fda91d06640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fda700795b0 0x7fda7007ba70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda88033000 tx=0x7fda88004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:27.180 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.179+0000 7fda82ffd640 1 -- 172.21.15.81:0/1243359691 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fda7c020020 con 0x7fda8c068ac0 2024-09-17T05:26:27.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.382+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol50240", "group_name": "subvol_grp8800", "target": ["mon-mgr", ""]}) -- 0x7fda8c0b5db0 con 0x7fda700795b0 2024-09-17T05:26:27.388 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:27.387+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:27.388 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:27.387+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:27.388 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:27.387+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:27.388 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:27.387+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:27.388 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:27.387+0000 7fe39376f640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:27.416 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.415+0000 7fda82ffd640 1 -- 172.21.15.81:0/1243359691 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7fda8c0b5db0 con 0x7fda700795b0 2024-09-17T05:26:27.417 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp8800/subvol50240 2024-09-17T05:26:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fda700795b0 msgr2=0x7fda7007ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fda700795b0 0x7fda7007ba70 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fda88033000 tx=0x7fda88004730 comp rx=0 tx=0).stop 2024-09-17T05:26:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c068ac0 msgr2=0x7fda8c156ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c068ac0 0x7fda8c156ec0 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fda7c00b420 tx=0x7fda7c00b8e0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 shutdown_connections 2024-09-17T05:26:27.419 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fda8c15ab70 0x7fda8c1f3100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fda700795b0 0x7fda7007ba70 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fda8c0ce8d0 0x7fda8c1568b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 --2- 172.21.15.81:0/1243359691 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fda8c068ac0 0x7fda8c156ec0 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 >> 172.21.15.81:0/1243359691 conn(0x7fda8c074160 msgr2=0x7fda8c0ce1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 shutdown_connections 2024-09-17T05:26:27.420 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.418+0000 7fda9476b640 1 -- 172.21.15.81:0/1243359691 wait complete. 2024-09-17T05:26:27.430 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume getpath cephfs subvol50240 subvol_grp8800 2024-09-17T05:26:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 -- 172.21.15.81:0/1323805730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 msgr2=0x7f65a0072a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.535 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 --2- 172.21.15.81:0/1323805730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 0x7f65a0072a10 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f6590009830 tx=0x7f659002a5a0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 -- 172.21.15.81:0/1323805730 shutdown_connections 2024-09-17T05:26:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 --2- 172.21.15.81:0/1323805730 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 0x7f65a0072a10 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 --2- 172.21.15.81:0/1323805730 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65a015d610 0x7f65a0070180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 -- 172.21.15.81:0/1323805730 >> 172.21.15.81:0/1323805730 conn(0x7f65a00b1620 msgr2=0x7f65a00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 -- 172.21.15.81:0/1323805730 shutdown_connections 2024-09-17T05:26:27.536 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.534+0000 7f65a6abd640 1 -- 172.21.15.81:0/1323805730 wait complete. 2024-09-17T05:26:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.535+0000 7f65a6abd640 1 Processor -- start 2024-09-17T05:26:27.537 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.535+0000 7f65a6abd640 1 -- start start 2024-09-17T05:26:27.538 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a6abd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a00ae690 0x7f65a01f2220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a6abd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 0x7f65a00b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a6abd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65a015d610 0x7f65a00b0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a6abd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f65a00b3560 con 0x7f65a00ae690 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a6abd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f65a00b33e0 con 0x7f65a00aec50 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a6abd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f65a00b36e0 con 0x7f65a015d610 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a4859640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a00ae690 0x7f65a01f2220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a4859640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a00ae690 0x7f65a01f2220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53110/0 (socket says 172.21.15.81:53110) 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a4859640 1 -- 172.21.15.81:0/777935734 learned_addr learned my addr 172.21.15.81:0/777935734 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f6597fff640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 0x7f65a00b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.539 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.536+0000 7f65a505a640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65a015d610 0x7f65a00b0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a4859640 1 -- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65a015d610 msgr2=0x7f65a00b0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a4859640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65a015d610 0x7f65a00b0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a4859640 1 -- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 msgr2=0x7f65a00b02e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a4859640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 0x7f65a00b02e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a4859640 1 -- 172.21.15.81:0/777935734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65a00a97c0 con 0x7f65a00ae690 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a4859640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a00ae690 0x7f65a01f2220 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e9c0 tx=0x7f659c00ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65957fa640 1 -- 172.21.15.81:0/777935734 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c00cd80 con 0x7f65a00ae690 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65a00a9aa0 con 0x7f65a00ae690 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65957fa640 1 -- 172.21.15.81:0/777935734 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f659c004020 con 0x7f65a00ae690 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65957fa640 1 -- 172.21.15.81:0/777935734 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f659c004450 con 0x7f65a00ae690 2024-09-17T05:26:27.540 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.537+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65a00aa060 con 0x7f65a00ae690 2024-09-17T05:26:27.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.538+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65a00aa3a0 con 0x7f65a00ae690 2024-09-17T05:26:27.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.539+0000 7f65957fa640 1 -- 172.21.15.81:0/777935734 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 26) ==== 102359+0+0 (secure 0 0 0) 0x7f659c0035f0 con 0x7f65a00ae690 2024-09-17T05:26:27.544 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.539+0000 7f65957fa640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f658c0795b0 0x7f658c07ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:27.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.540+0000 7f6597fff640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f658c0795b0 0x7f658c07ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:27.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.540+0000 7f65957fa640 1 -- 172.21.15.81:0/777935734 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f659c09a090 con 0x7f65a00ae690 2024-09-17T05:26:27.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.540+0000 7f6597fff640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f658c0795b0 0x7f658c07ba70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6590034000 tx=0x7f6590004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:27.545 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.544+0000 7f65957fa640 1 -- 172.21.15.81:0/777935734 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f65a00aa3a0 con 0x7f65a00ae690 2024-09-17T05:26:27.750 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.749+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "sub_name": "subvol50240", "group_name": "subvol_grp8800", "target": ["mon-mgr", ""]}) -- 0x7f65a0073210 con 0x7f658c0795b0 2024-09-17T05:26:27.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.753+0000 7f65957fa640 1 -- 172.21.15.81:0/777935734 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+36 (secure 0 0 0) 0x7f65a0073210 con 0x7f658c0795b0 2024-09-17T05:26:27.754 INFO:teuthology.orchestra.run.smithi081.stdout:/volumes/subvol_grp8800/subvol50240 2024-09-17T05:26:27.756 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f658c0795b0 msgr2=0x7f658c07ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f658c0795b0 0x7f658c07ba70 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f6590034000 tx=0x7f6590004730 comp rx=0 tx=0).stop 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a00ae690 msgr2=0x7f65a01f2220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a00ae690 0x7f65a01f2220 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f659c00e9c0 tx=0x7f659c00ee80 comp rx=0 tx=0).stop 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 shutdown_connections 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f65a015d610 0x7f65a00b0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f658c0795b0 0x7f658c07ba70 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f65a00aec50 0x7f65a00b02e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 --2- 172.21.15.81:0/777935734 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f65a00ae690 0x7f65a01f2220 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 >> 172.21.15.81:0/777935734 conn(0x7f65a00b1620 msgr2=0x7f65a00cf1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 shutdown_connections 2024-09-17T05:26:27.757 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:27.755+0000 7f65a6abd640 1 -- 172.21.15.81:0/777935734 wait complete. 2024-09-17T05:26:27.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:27.768 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec sudo cat ./volumes/_legacy/3faba7ba9c9e6849dff8cbadf5dda820.meta) 2024-09-17T05:26:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:[GLOBAL] 2024-09-17T05:26:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:version = 1 2024-09-17T05:26:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:type = subvolume 2024-09-17T05:26:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:path = /volumes/subvol_grp8800/subvol50240 2024-09-17T05:26:28.594 INFO:teuthology.orchestra.run.smithi081.stdout:state = complete 2024-09-17T05:26:28.595 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:28.596 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolume rm cephfs subvol50240 subvol_grp8800 2024-09-17T05:26:28.712 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 -- 172.21.15.81:0/1635181170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057406e940 msgr2=0x7f057406fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 --2- 172.21.15.81:0/1635181170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057406e940 0x7f057406fe80 secure :-1 s=READY pgs=1886 cs=0 l=1 rev1=1 crypto rx=0x7f05740cc6d0 tx=0x7f056802a560 comp rx=0 tx=0).stop 2024-09-17T05:26:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 -- 172.21.15.81:0/1635181170 shutdown_connections 2024-09-17T05:26:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 --2- 172.21.15.81:0/1635181170 >> v2:172.21.15.160:3300/0 conn(0x7f05740703c0 0x7f0574157cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 --2- 172.21.15.81:0/1635181170 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f057406e940 0x7f057406fe80 unknown :-1 s=CLOSED pgs=1886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 -- 172.21.15.81:0/1635181170 >> 172.21.15.81:0/1635181170 conn(0x7f05740b1620 msgr2=0x7f05740b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 -- 172.21.15.81:0/1635181170 shutdown_connections 2024-09-17T05:26:28.713 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.711+0000 7f057a07f640 1 -- 172.21.15.81:0/1635181170 wait complete. 2024-09-17T05:26:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.712+0000 7f057a07f640 1 Processor -- start 2024-09-17T05:26:28.715 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f057a07f640 1 -- start start 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f057a07f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057406e940 0x7f05740aa380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f057a07f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05740703c0 0x7f05740ab130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f057a07f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05740aee40 0x7f05741e4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f057a07f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f05741586a0 con 0x7f05740aee40 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f057a07f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0574158520 con 0x7f05740703c0 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f057a07f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0574158820 con 0x7f057406e940 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f0573fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05740aee40 0x7f05741e4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f0573fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05740aee40 0x7f05741e4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53128/0 (socket says 172.21.15.81:53128) 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.713+0000 7f0573fff640 1 -- 172.21.15.81:0/2205626326 learned_addr learned my addr 172.21.15.81:0/2205626326 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f05737fe640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057406e940 0x7f05740aa380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:28.716 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f0572ffd640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05740703c0 0x7f05740ab130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f0573fff640 1 -- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057406e940 msgr2=0x7f05740aa380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f0573fff640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057406e940 0x7f05740aa380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f0573fff640 1 -- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05740703c0 msgr2=0x7f05740ab130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f0573fff640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05740703c0 0x7f05740ab130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f0573fff640 1 -- 172.21.15.81:0/2205626326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f05740a95c0 con 0x7f05740aee40 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f0573fff640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05740aee40 0x7f05741e4520 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f056c00d750 tx=0x7f056c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f055bfff640 1 -- 172.21.15.81:0/2205626326 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c017070 con 0x7f05740aee40 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f055bfff640 1 -- 172.21.15.81:0/2205626326 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f056c009ac0 con 0x7f05740aee40 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f05740a98a0 con 0x7f05740aee40 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f055bfff640 1 -- 172.21.15.81:0/2205626326 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f056c005020 con 0x7f05740aee40 2024-09-17T05:26:28.717 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.714+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05740a9e60 con 0x7f05740aee40 2024-09-17T05:26:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.715+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f057406fe80 con 0x7f05740aee40 2024-09-17T05:26:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.716+0000 7f055bfff640 1 -- 172.21.15.81:0/2205626326 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 102410+0+0 (secure 0 0 0) 0x7f056c0051c0 con 0x7f05740aee40 2024-09-17T05:26:28.718 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.716+0000 7f055bfff640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0560079640 0x7f056007bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.716+0000 7f055bfff640 1 -- 172.21.15.81:0/2205626326 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f056c099620 con 0x7f05740aee40 2024-09-17T05:26:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.717+0000 7f05737fe640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0560079640 0x7f056007bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:28.719 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.717+0000 7f05737fe640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0560079640 0x7f056007bb00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f056400b450 tx=0x7f056400d040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:28.721 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.721+0000 7f055bfff640 1 -- 172.21.15.81:0/2205626326 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f056c062ed0 con 0x7f05740aee40 2024-09-17T05:26:28.926 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.925+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolume rm", "vol_name": "cephfs", "sub_name": "subvol50240", "group_name": "subvol_grp8800", "target": ["mon-mgr", ""]}) -- 0x7f05740cf7a0 con 0x7f0560079640 2024-09-17T05:26:28.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.937+0000 7f055bfff640 1 -- 172.21.15.81:0/2205626326 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f05740cf7a0 con 0x7f0560079640 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0560079640 msgr2=0x7f056007bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0560079640 0x7f056007bb00 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f056400b450 tx=0x7f056400d040 comp rx=0 tx=0).stop 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05740aee40 msgr2=0x7f05741e4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05740aee40 0x7f05741e4520 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f056c00d750 tx=0x7f056c00dc10 comp rx=0 tx=0).stop 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 shutdown_connections 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f05740aee40 0x7f05741e4520 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0560079640 0x7f056007bb00 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f05740703c0 0x7f05740ab130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 --2- 172.21.15.81:0/2205626326 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f057406e940 0x7f05740aa380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 >> 172.21.15.81:0/2205626326 conn(0x7f05740b1620 msgr2=0x7f057415d9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 shutdown_connections 2024-09-17T05:26:28.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:28.941+0000 7f057a07f640 1 -- 172.21.15.81:0/2205626326 wait complete. 2024-09-17T05:26:28.943 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.943+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.943 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.943+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.944 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.943+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.944 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.943+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.944 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.943+0000 7fe396775640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.954 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'stat -c %h /home/ubuntu/cephtest/mnt.0/./volumes/_deleting') 2024-09-17T05:26:28.958 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.957+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.958 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.957+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.958 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.957+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.958 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.957+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:28.958 INFO:tasks.ceph.mgr.y.smithi081.stderr:2024-09-17T05:26:28.957+0000 7fe395f74640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-17T05:26:29.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-09-17T05:26:29.007 INFO:teuthology.orchestra.run.smithi081.stdout:2 2024-09-17T05:26:29.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-17T05:26:29.013 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs subvolumegroup rm cephfs subvol_grp8800 2024-09-17T05:26:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.156+0000 7f1fc2685640 1 -- 172.21.15.81:0/861139562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 msgr2=0x7f1fa40051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.156+0000 7f1fc2685640 1 --2- 172.21.15.81:0/861139562 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 0x7f1fa40051c0 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f1fb4009ed0 tx=0x7f1fa4005830 comp rx=0 tx=0).stop 2024-09-17T05:26:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.156+0000 7f1fc0c22640 1 -- 172.21.15.81:0/861139562 reap_dead start 2024-09-17T05:26:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.157+0000 7f1fc2685640 1 -- 172.21.15.81:0/861139562 shutdown_connections 2024-09-17T05:26:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.157+0000 7f1fc2685640 1 -- 172.21.15.81:0/861139562 >> 172.21.15.81:0/861139562 conn(0x7f1fbc0b1700 msgr2=0x7f1fbc0b1ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.157+0000 7f1fc2685640 1 -- 172.21.15.81:0/861139562 shutdown_connections 2024-09-17T05:26:29.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.157+0000 7f1fc2685640 1 -- 172.21.15.81:0/861139562 wait complete. 2024-09-17T05:26:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.158+0000 7f1fc2685640 1 Processor -- start 2024-09-17T05:26:29.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.158+0000 7f1fc2685640 1 -- start start 2024-09-17T05:26:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 0x7f1fbc148010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc0c2c80 0x7f1fbc0c6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0c26a0 0x7f1fbc0c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0cc550 con 0x7f1fa4004d40 2024-09-17T05:26:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f1fbc0ce3f0 con 0x7f1fbc0c26a0 2024-09-17T05:26:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f1fbc0cc6d0 con 0x7f1fbc0c2c80 2024-09-17T05:26:29.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 0x7f1fbc148010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 0x7f1fbc148010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53182/0 (socket says 172.21.15.81:53182) 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 -- 172.21.15.81:0/3005300056 learned_addr learned my addr 172.21.15.81:0/3005300056 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbb7fe640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc0c2c80 0x7f1fbc0c6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc0c22640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0c26a0 0x7f1fbc0c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 -- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc0c2c80 msgr2=0x7f1fbc0c6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc0c2c80 0x7f1fbc0c6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 -- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0c26a0 msgr2=0x7f1fbc0c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0c26a0 0x7f1fbc0c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 -- 172.21.15.81:0/3005300056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fbc0c98d0 con 0x7f1fa4004d40 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbb7fe640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc0c2c80 0x7f1fbc0c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fbbfff640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 0x7f1fbc148010 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e590 tx=0x7f1fac00ea50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fb8ff9640 1 -- 172.21.15.81:0/3005300056 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac015070 con 0x7f1fa4004d40 2024-09-17T05:26:29.162 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fb8ff9640 1 -- 172.21.15.81:0/3005300056 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1fac00ca00 con 0x7f1fa4004d40 2024-09-17T05:26:29.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fbc1525e0 con 0x7f1fa4004d40 2024-09-17T05:26:29.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fb8ff9640 1 -- 172.21.15.81:0/3005300056 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac00ce50 con 0x7f1fa4004d40 2024-09-17T05:26:29.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.159+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fbc0c94d0 con 0x7f1fa4004d40 2024-09-17T05:26:29.163 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.160+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fbc152bd0 con 0x7f1fa4004d40 2024-09-17T05:26:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.161+0000 7f1fb8ff9640 1 -- 172.21.15.81:0/3005300056 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 102410+0+0 (secure 0 0 0) 0x7f1fac018070 con 0x7f1fa4004d40 2024-09-17T05:26:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.161+0000 7f1fb8ff9640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1fa8079810 0x7f1fa807bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.162+0000 7f1fb8ff9640 1 -- 172.21.15.81:0/3005300056 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f1fac099ad0 con 0x7f1fa4004d40 2024-09-17T05:26:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.162+0000 7f1fbb7fe640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1fa8079810 0x7f1fa807bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:29.164 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.162+0000 7f1fbb7fe640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1fa8079810 0x7f1fa807bcd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc151740 tx=0x7f1fb0006b70 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:29.166 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.166+0000 7f1fb8ff9640 1 -- 172.21.15.81:0/3005300056 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f1fac0639d0 con 0x7f1fa4004d40 2024-09-17T05:26:29.365 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.364+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup rm", "vol_name": "cephfs", "group_name": "subvol_grp8800", "target": ["mon-mgr", ""]}) -- 0x7f1fbc0cda10 con 0x7f1fa8079810 2024-09-17T05:26:29.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.368+0000 7f1fb8ff9640 1 -- 172.21.15.81:0/3005300056 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f1fbc0cda10 con 0x7f1fa8079810 2024-09-17T05:26:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1fa8079810 msgr2=0x7f1fa807bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1fa8079810 0x7f1fa807bcd0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f1fbc151740 tx=0x7f1fb0006b70 comp rx=0 tx=0).stop 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 msgr2=0x7f1fbc148010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 0x7f1fbc148010 secure :-1 s=READY pgs=1894 cs=0 l=1 rev1=1 crypto rx=0x7f1fac00e590 tx=0x7f1fac00ea50 comp rx=0 tx=0).stop 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 shutdown_connections 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f1fa8079810 0x7f1fa807bcd0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1fbc0c26a0 0x7f1fbc0c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1fbc0c2c80 0x7f1fbc0c6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 --2- 172.21.15.81:0/3005300056 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1fa4004d40 0x7f1fbc148010 unknown :-1 s=CLOSED pgs=1894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 >> 172.21.15.81:0/3005300056 conn(0x7f1fbc0b1700 msgr2=0x7f1fbc15c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 shutdown_connections 2024-09-17T05:26:29.372 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.370+0000 7f1fc2685640 1 -- 172.21.15.81:0/3005300056 wait complete. 2024-09-17T05:26:29.382 INFO:teuthology.nuke:Clearing teuthology firewall rules... 2024-09-17T05:26:29.382 DEBUG:teuthology.orchestra.run.smithi081:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:26:29.415 DEBUG:teuthology.orchestra.run.smithi160:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2024-09-17T05:26:29.457 INFO:teuthology.nuke:Cleared teuthology firewall rules. 2024-09-17T05:26:29.457 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:29.457 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:29.458 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:29.473 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:29.474 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:29.529 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:26:29.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2458422684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 msgr2=0x7f8b640703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2458422684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b640703f0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f8b6406ee40 tx=0x7f8b5c02aa30 comp rx=0 tx=0).stop 2024-09-17T05:26:29.671 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2458422684 shutdown_connections 2024-09-17T05:26:29.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2458422684 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b640703f0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2458422684 >> v2:172.21.15.160:3300/0 conn(0x7f8b640735a0 0x7f8b640739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2458422684 >> 172.21.15.81:0/2458422684 conn(0x7f8b640b1690 msgr2=0x7f8b640b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:29.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2458422684 shutdown_connections 2024-09-17T05:26:29.672 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.670+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2458422684 wait complete. 2024-09-17T05:26:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.671+0000 7f8b6a3b5640 1 Processor -- start 2024-09-17T05:26:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.671+0000 7f8b6a3b5640 1 -- start start 2024-09-17T05:26:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b6a3b5640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b6413e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b6a3b5640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b640735a0 0x7f8b6406ee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b6a3b5640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b6415aa70 0x7f8b6406f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b6a3b5640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8b640cd270 con 0x7f8b6406ff80 2024-09-17T05:26:29.674 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b6a3b5640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8b640cd0f0 con 0x7f8b640735a0 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b6a3b5640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8b640cd3f0 con 0x7f8b6415aa70 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b6413e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b6413e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53192/0 (socket says 172.21.15.81:53192) 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 -- 172.21.15.81:0/2080014857 learned_addr learned my addr 172.21.15.81:0/2080014857 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 -- 172.21.15.81:0/2080014857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b6415aa70 msgr2=0x7f8b6406f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b6415aa70 0x7f8b6406f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 -- 172.21.15.81:0/2080014857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b640735a0 msgr2=0x7f8b6406ee70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b640735a0 0x7f8b6406ee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 -- 172.21.15.81:0/2080014857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b64141980 con 0x7f8b6406ff80 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.672+0000 7f8b63fff640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b6413e1f0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c3a0 tx=0x7f8b5400c860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:29.675 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.673+0000 7f8b617fa640 1 -- 172.21.15.81:0/2080014857 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54017070 con 0x7f8b6406ff80 2024-09-17T05:26:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.673+0000 7f8b617fa640 1 -- 172.21.15.81:0/2080014857 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8b540053c0 con 0x7f8b6406ff80 2024-09-17T05:26:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.673+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b6413eaa0 con 0x7f8b6406ff80 2024-09-17T05:26:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.673+0000 7f8b617fa640 1 -- 172.21.15.81:0/2080014857 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b54003850 con 0x7f8b6406ff80 2024-09-17T05:26:29.676 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.673+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b6413f060 con 0x7f8b6406ff80 2024-09-17T05:26:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.674+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b64070eb0 con 0x7f8b6406ff80 2024-09-17T05:26:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.674+0000 7f8b617fa640 1 -- 172.21.15.81:0/2080014857 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 27) ==== 102410+0+0 (secure 0 0 0) 0x7f8b5401a070 con 0x7f8b6406ff80 2024-09-17T05:26:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.675+0000 7f8b617fa640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b44079640 0x7f8b4407bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.675+0000 7f8b617fa640 1 -- 172.21.15.81:0/2080014857 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f8b54098b90 con 0x7f8b6406ff80 2024-09-17T05:26:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.675+0000 7f8b5bfff640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b44079640 0x7f8b4407bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:29.677 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.675+0000 7f8b5bfff640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b44079640 0x7f8b4407bb00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005fd0 tx=0x7f8b4c005850 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:29.680 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.679+0000 7f8b617fa640 1 -- 172.21.15.81:0/2080014857 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8b64070eb0 con 0x7f8b6406ff80 2024-09-17T05:26:29.866 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.865+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8b6406a0c0 con 0x7f8b6406ff80 2024-09-17T05:26:29.867 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.866+0000 7f8b617fa640 1 -- 172.21.15.81:0/2080014857 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v162) ==== 80+0+0 (secure 0 0 0) 0x7f8b6406a0c0 con 0x7f8b6406ff80 2024-09-17T05:26:29.867 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:26:29.869 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b44079640 msgr2=0x7f8b4407bb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b44079640 0x7f8b4407bb00 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f8b4c005fd0 tx=0x7f8b4c005850 comp rx=0 tx=0).stop 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 msgr2=0x7f8b6413e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b6413e1f0 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f8b5400c3a0 tx=0x7f8b5400c860 comp rx=0 tx=0).stop 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 shutdown_connections 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8b6415aa70 0x7f8b6406f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8b44079640 0x7f8b4407bb00 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8b640735a0 0x7f8b6406ee70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 --2- 172.21.15.81:0/2080014857 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8b6406ff80 0x7f8b6413e1f0 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 >> 172.21.15.81:0/2080014857 conn(0x7f8b640b1690 msgr2=0x7f8b640b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 shutdown_connections 2024-09-17T05:26:29.870 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:29.868+0000 7f8b6a3b5640 1 -- 172.21.15.81:0/2080014857 wait complete. 2024-09-17T05:26:29.883 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi081.front.sepia.ceph.com... 2024-09-17T05:26:29.883 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:29.883 DEBUG:teuthology.orchestra.run.smithi081:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-17T05:26:29.906 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi081.stderr:ceph-fuse[81990]: fuse finished with error 0 and tester_r 0 2024-09-17T05:26:29.908 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:26:29.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:29.908 DEBUG:teuthology.orchestra.run.smithi081:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-17T05:26:29.968 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:29.968 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:29.968 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:29.986 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:29.986 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:30.049 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-09-17T05:26:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 -- 172.21.15.81:0/153158553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 msgr2=0x7fc2380703f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/153158553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380703f0 secure :-1 s=READY pgs=1897 cs=0 l=1 rev1=1 crypto rx=0x7fc23806ee40 tx=0x7fc23002a980 comp rx=0 tx=0).stop 2024-09-17T05:26:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 -- 172.21.15.81:0/153158553 shutdown_connections 2024-09-17T05:26:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/153158553 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380703f0 unknown :-1 s=CLOSED pgs=1897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/153158553 >> v2:172.21.15.160:3300/0 conn(0x7fc2380735a0 0x7fc2380739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 -- 172.21.15.81:0/153158553 >> 172.21.15.81:0/153158553 conn(0x7fc2380b1690 msgr2=0x7fc2380b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:30.153 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 -- 172.21.15.81:0/153158553 shutdown_connections 2024-09-17T05:26:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.152+0000 7fc23ec7f640 1 -- 172.21.15.81:0/153158553 wait complete. 2024-09-17T05:26:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.153+0000 7fc23ec7f640 1 Processor -- start 2024-09-17T05:26:30.154 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.153+0000 7fc23ec7f640 1 -- start start 2024-09-17T05:26:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ec7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380c6f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ec7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2380735a0 0x7fc2381f5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ec7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc23815aa70 0x7fc238145c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ec7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fc2380cd270 con 0x7fc23806ff80 2024-09-17T05:26:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ec7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fc2380cd0f0 con 0x7fc2380735a0 2024-09-17T05:26:30.156 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ec7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fc2380cd3f0 con 0x7fc23815aa70 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380c6f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380c6f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53222/0 (socket says 172.21.15.81:53222) 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 -- 172.21.15.81:0/800904384 learned_addr learned my addr 172.21.15.81:0/800904384 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 -- 172.21.15.81:0/800904384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc23815aa70 msgr2=0x7fc238145c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc23815aa70 0x7fc238145c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 -- 172.21.15.81:0/800904384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2380735a0 msgr2=0x7fc2381f5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2380735a0 0x7fc2381f5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 -- 172.21.15.81:0/800904384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2381f5b80 con 0x7fc23806ff80 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ca1b640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380c6f90 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d9c0 tx=0x7fc22c00de80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc2357fa640 1 -- 172.21.15.81:0/800904384 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c01b070 con 0x7fc23806ff80 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc2357fa640 1 -- 172.21.15.81:0/800904384 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fc22c00ee30 con 0x7fc23806ff80 2024-09-17T05:26:30.157 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2380c5ef0 con 0x7fc23806ff80 2024-09-17T05:26:30.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.154+0000 7fc2357fa640 1 -- 172.21.15.81:0/800904384 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc22c016680 con 0x7fc23806ff80 2024-09-17T05:26:30.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.155+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2380c64b0 con 0x7fc23806ff80 2024-09-17T05:26:30.158 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.156+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc2380cea40 con 0x7fc23806ff80 2024-09-17T05:26:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.156+0000 7fc2357fa640 1 -- 172.21.15.81:0/800904384 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fc22c01e070 con 0x7fc23806ff80 2024-09-17T05:26:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.157+0000 7fc2357fa640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc21c079760 0x7fc21c07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.157+0000 7fc237fff640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc21c079760 0x7fc21c07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.157+0000 7fc2357fa640 1 -- 172.21.15.81:0/800904384 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7fc22c09b6d0 con 0x7fc23806ff80 2024-09-17T05:26:30.159 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.157+0000 7fc237fff640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc21c079760 0x7fc21c07bc20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc22400a8f0 tx=0x7fc224005be0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:30.161 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.161+0000 7fc2357fa640 1 -- 172.21.15.81:0/800904384 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fc2381f5b80 con 0x7fc23806ff80 2024-09-17T05:26:30.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.347+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fc2380b3060 con 0x7fc23806ff80 2024-09-17T05:26:30.349 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.348+0000 7fc2357fa640 1 -- 172.21.15.81:0/800904384 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v162) ==== 80+0+0 (secure 0 0 0) 0x7fc22c0653f0 con 0x7fc23806ff80 2024-09-17T05:26:30.349 INFO:teuthology.orchestra.run.smithi081.stderr:listed 0 entries 2024-09-17T05:26:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc21c079760 msgr2=0x7fc21c07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc21c079760 0x7fc21c07bc20 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fc22400a8f0 tx=0x7fc224005be0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 msgr2=0x7fc2380c6f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380c6f90 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7fc22c00d9c0 tx=0x7fc22c00de80 comp rx=0 tx=0).stop 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 shutdown_connections 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fc23815aa70 0x7fc238145c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fc21c079760 0x7fc21c07bc20 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fc2380735a0 0x7fc2381f5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 --2- 172.21.15.81:0/800904384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fc23806ff80 0x7fc2380c6f90 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 >> 172.21.15.81:0/800904384 conn(0x7fc2380b1690 msgr2=0x7fc238155d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 shutdown_connections 2024-09-17T05:26:30.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.350+0000 7fc23ec7f640 1 -- 172.21.15.81:0/800904384 wait complete. 2024-09-17T05:26:30.362 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi160.front.sepia.ceph.com... 2024-09-17T05:26:30.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:30.362 DEBUG:teuthology.orchestra.run.smithi160:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2024-09-17T05:26:30.389 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi160.stderr:ceph-fuse[50646]: fuse finished with error 0 and tester_r 0 2024-09-17T05:26:30.391 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:26:30.391 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:30.391 DEBUG:teuthology.orchestra.run.smithi160:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-09-17T05:26:30.454 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:30.454 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:30.454 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:30.470 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:26:30.471 INFO:tasks.cephfs.mount:Terminating background process 2024-09-17T05:26:30.471 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:30.471 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:30.511 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:26:30.512 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/4206313647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd40735a0 msgr2=0x7f0dd40739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/4206313647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd40735a0 0x7f0dd40739d0 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005fd0 tx=0x7f0dbc02a540 comp rx=0 tx=0).stop 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/4206313647 shutdown_connections 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/4206313647 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dd406ff80 0x7f0dd4070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/4206313647 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd40735a0 0x7f0dd40739d0 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/4206313647 >> 172.21.15.81:0/4206313647 conn(0x7f0dd40b1690 msgr2=0x7f0dd40b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/4206313647 shutdown_connections 2024-09-17T05:26:30.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.611+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/4206313647 wait complete. 2024-09-17T05:26:30.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.612+0000 7f0dd8c5a640 1 Processor -- start 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.612+0000 7f0dd8c5a640 1 -- start start 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd8c5a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd406ff80 0x7f0dd41e3010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd8c5a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dd40735a0 0x7f0dd41e7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd8c5a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dd415aa70 0x7f0dd41e8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd8c5a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd40cd270 con 0x7f0dd406ff80 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd8c5a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0dd40cd0f0 con 0x7f0dd415aa70 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd8c5a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0dd40cd3f0 con 0x7f0dd40735a0 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd406ff80 0x7f0dd41e3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd406ff80 0x7f0dd41e3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53242/0 (socket says 172.21.15.81:53242) 2024-09-17T05:26:30.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd259c640 1 -- 172.21.15.81:0/2164855738 learned_addr learned my addr 172.21.15.81:0/2164855738 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.613+0000 7f0dd1d9b640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dd40735a0 0x7f0dd41e7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd2d9d640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dd415aa70 0x7f0dd41e8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd259c640 1 -- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dd40735a0 msgr2=0x7f0dd41e7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd259c640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dd40735a0 0x7f0dd41e7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd259c640 1 -- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dd415aa70 msgr2=0x7f0dd41e8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd259c640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dd415aa70 0x7f0dd41e8500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd259c640 1 -- 172.21.15.81:0/2164855738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dd41e3a90 con 0x7f0dd406ff80 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd259c640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd406ff80 0x7f0dd41e3010 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c760 tx=0x7f0dc400cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dcaffd640 1 -- 172.21.15.81:0/2164855738 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc4003b70 con 0x7f0dd406ff80 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dcaffd640 1 -- 172.21.15.81:0/2164855738 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0dc4003d30 con 0x7f0dd406ff80 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dd41e3d70 con 0x7f0dd406ff80 2024-09-17T05:26:30.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dcaffd640 1 -- 172.21.15.81:0/2164855738 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc400aab0 con 0x7f0dd406ff80 2024-09-17T05:26:30.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.614+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dd41e4330 con 0x7f0dd406ff80 2024-09-17T05:26:30.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.615+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dd40cd8c0 con 0x7f0dd406ff80 2024-09-17T05:26:30.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.615+0000 7f0dcaffd640 1 -- 172.21.15.81:0/2164855738 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f0dc400ac50 con 0x7f0dd406ff80 2024-09-17T05:26:30.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.616+0000 7f0dcaffd640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0db4079760 0x7f0db407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.616+0000 7f0dcaffd640 1 -- 172.21.15.81:0/2164855738 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f0dc4099660 con 0x7f0dd406ff80 2024-09-17T05:26:30.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.616+0000 7f0dd1d9b640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0db4079760 0x7f0db407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.616+0000 7f0dd1d9b640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0db4079760 0x7f0db407bc20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc033000 tx=0x7f0dbc004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:30.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.620+0000 7f0dcaffd640 1 -- 172.21.15.81:0/2164855738 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0dc4063380 con 0x7f0dd406ff80 2024-09-17T05:26:30.832 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.831+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0dd40b1a70 con 0x7f0dd406ff80 2024-09-17T05:26:30.833 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.832+0000 7f0dcaffd640 1 -- 172.21.15.81:0/2164855738 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5229 (secure 0 0 0) 0x7f0dc4062c80 con 0x7f0dd406ff80 2024-09-17T05:26:30.833 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:30.833 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":102,"btime":"2024-09-17T05:26:26:155731+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2790285877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2790285877},{"type":"v1","addr":"172.21.15.160:6835","nonce":2790285877}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/790920368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":790920368},{"type":"v1","addr":"172.21.15.160:6834","nonce":790920368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/234206731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":234206731},{"type":"v1","addr":"172.21.15.81:6834","nonce":234206731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:26:16.673540+0000","modified":"2024-09-17T05:26:19.217419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9207":{"gid":9207,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/2091743317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2091743317},{"type":"v1","addr":"172.21.15.81:6835","nonce":2091743317}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9207,"qdb_cluster":[9207]},"id":13}]} 2024-09-17T05:26:30.833 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 102 2024-09-17T05:26:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0db4079760 msgr2=0x7f0db407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0db4079760 0x7f0db407bc20 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc033000 tx=0x7f0dbc004730 comp rx=0 tx=0).stop 2024-09-17T05:26:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd406ff80 msgr2=0x7f0dd41e3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd406ff80 0x7f0dd41e3010 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f0dc400c760 tx=0x7f0dc400cc20 comp rx=0 tx=0).stop 2024-09-17T05:26:30.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 shutdown_connections 2024-09-17T05:26:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0db4079760 0x7f0db407bc20 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0dd415aa70 0x7f0dd41e8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0dd40735a0 0x7f0dd41e7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 --2- 172.21.15.81:0/2164855738 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0dd406ff80 0x7f0dd41e3010 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 >> 172.21.15.81:0/2164855738 conn(0x7f0dd40b1690 msgr2=0x7f0dd415d670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 shutdown_connections 2024-09-17T05:26:30.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.834+0000 7f0dd8c5a640 1 -- 172.21.15.81:0/2164855738 wait complete. 2024-09-17T05:26:30.846 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 -- 172.21.15.81:0/3073419897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc2e0 msgr2=0x7ff0440cb520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3073419897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc2e0 0x7ff0440cb520 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7ff0440c3e40 tx=0x7ff03c02a9a0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 -- 172.21.15.81:0/3073419897 shutdown_connections 2024-09-17T05:26:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3073419897 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc2e0 0x7ff0440cb520 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3073419897 >> v2:172.21.15.160:3300/0 conn(0x7ff0440cc830 0x7ff0440cafe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 -- 172.21.15.81:0/3073419897 >> 172.21.15.81:0/3073419897 conn(0x7ff0440741f0 msgr2=0x7ff044074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 -- 172.21.15.81:0/3073419897 shutdown_connections 2024-09-17T05:26:30.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.948+0000 7ff04bb90640 1 -- 172.21.15.81:0/3073419897 wait complete. 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.949+0000 7ff04bb90640 1 Processor -- start 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.949+0000 7ff04bb90640 1 -- start start 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04bb90640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0440cc2e0 0x7ff04414b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04bb90640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc830 0x7ff0441f87c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04bb90640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff04415e1d0 0x7ff04415e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04bb90640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff044070b90 con 0x7ff0440cc830 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04bb90640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff044070a10 con 0x7ff04415e1d0 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04bb90640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff044070d10 con 0x7ff0440cc2e0 2024-09-17T05:26:30.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc830 0x7ff0441f87c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc830 0x7ff0441f87c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53256/0 (socket says 172.21.15.81:53256) 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 -- 172.21.15.81:0/3727344960 learned_addr learned my addr 172.21.15.81:0/3727344960 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04992c640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0440cc2e0 0x7ff04414b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04a12d640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff04415e1d0 0x7ff04415e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 -- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0440cc2e0 msgr2=0x7ff04414b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0440cc2e0 0x7ff04414b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 -- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff04415e1d0 msgr2=0x7ff04415e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff04415e1d0 0x7ff04415e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 -- 172.21.15.81:0/3727344960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff04414ae10 con 0x7ff0440cc830 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04a12d640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff04415e1d0 0x7ff04415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:30.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04912b640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc830 0x7ff0441f87c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff03400b4a0 tx=0x7ff03400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:30.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff03a7fc640 1 -- 172.21.15.81:0/3727344960 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034014070 con 0x7ff0440cc830 2024-09-17T05:26:30.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff03a7fc640 1 -- 172.21.15.81:0/3727344960 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff034010700 con 0x7ff0440cc830 2024-09-17T05:26:30.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff04415ee80 con 0x7ff0440cc830 2024-09-17T05:26:30.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.950+0000 7ff03a7fc640 1 -- 172.21.15.81:0/3727344960 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff034010b50 con 0x7ff0440cc830 2024-09-17T05:26:30.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.951+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff04414b390 con 0x7ff0440cc830 2024-09-17T05:26:30.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.952+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0440cbde0 con 0x7ff0440cc830 2024-09-17T05:26:30.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.952+0000 7ff03a7fc640 1 -- 172.21.15.81:0/3727344960 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7ff034017070 con 0x7ff0440cc830 2024-09-17T05:26:30.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.953+0000 7ff03a7fc640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079760 0x7ff02807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:30.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.953+0000 7ff03a7fc640 1 -- 172.21.15.81:0/3727344960 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7ff0340992c0 con 0x7ff0440cc830 2024-09-17T05:26:30.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.953+0000 7ff04992c640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079760 0x7ff02807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:30.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.953+0000 7ff04992c640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079760 0x7ff02807bc20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff0400015e0 tx=0x7ff040009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:30.958 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:30.957+0000 7ff03a7fc640 1 -- 172.21.15.81:0/3727344960 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff034062fe0 con 0x7ff0440cc830 2024-09-17T05:26:31.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.166+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff0440ae510 con 0x7ff0440cc830 2024-09-17T05:26:31.167 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.167+0000 7ff03a7fc640 1 -- 172.21.15.81:0/3727344960 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5229 (secure 0 0 0) 0x7ff0340628e0 con 0x7ff0440cc830 2024-09-17T05:26:31.168 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:31.168 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":102,"btime":"2024-09-17T05:26:26:155731+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2790285877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2790285877},{"type":"v1","addr":"172.21.15.160:6835","nonce":2790285877}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/790920368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":790920368},{"type":"v1","addr":"172.21.15.160:6834","nonce":790920368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/234206731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":234206731},{"type":"v1","addr":"172.21.15.81:6834","nonce":234206731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:26:16.673540+0000","modified":"2024-09-17T05:26:19.217419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9207":{"gid":9207,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/2091743317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2091743317},{"type":"v1","addr":"172.21.15.81:6835","nonce":2091743317}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9207,"qdb_cluster":[9207]},"id":13}]} 2024-09-17T05:26:31.168 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 102 2024-09-17T05:26:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079760 msgr2=0x7ff02807bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079760 0x7ff02807bc20 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7ff0400015e0 tx=0x7ff040009040 comp rx=0 tx=0).stop 2024-09-17T05:26:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc830 msgr2=0x7ff0441f87c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc830 0x7ff0441f87c0 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7ff03400b4a0 tx=0x7ff03400b960 comp rx=0 tx=0).stop 2024-09-17T05:26:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 shutdown_connections 2024-09-17T05:26:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff028079760 0x7ff02807bc20 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.170 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff04415e1d0 0x7ff04415e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0440cc830 0x7ff0441f87c0 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 --2- 172.21.15.81:0/3727344960 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff0440cc2e0 0x7ff04414b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 >> 172.21.15.81:0/3727344960 conn(0x7ff0440741f0 msgr2=0x7ff0440ce240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 shutdown_connections 2024-09-17T05:26:31.171 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.169+0000 7ff04bb90640 1 -- 172.21.15.81:0/3727344960 wait complete. 2024-09-17T05:26:31.181 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:31.281 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 -- 172.21.15.81:0/417571357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 msgr2=0x7f8d440b6c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 --2- 172.21.15.81:0/417571357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440b6c70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7f8d440cf6d0 tx=0x7f8d3c02aaa0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 -- 172.21.15.81:0/417571357 shutdown_connections 2024-09-17T05:26:31.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 --2- 172.21.15.81:0/417571357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440b6c70 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 --2- 172.21.15.81:0/417571357 >> v2:172.21.15.160:3300/0 conn(0x7f8d440d0d00 0x7f8d440cf9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 -- 172.21.15.81:0/417571357 >> 172.21.15.81:0/417571357 conn(0x7f8d440d3e40 msgr2=0x7f8d440d4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:31.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 -- 172.21.15.81:0/417571357 shutdown_connections 2024-09-17T05:26:31.282 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.280+0000 7f8d48de2640 1 -- 172.21.15.81:0/417571357 wait complete. 2024-09-17T05:26:31.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 Processor -- start 2024-09-17T05:26:31.283 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 -- start start 2024-09-17T05:26:31.284 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d440d0d00 0x7f8d4414c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440a0520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d4415df30 0x7f8d440a0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440d2ae0 con 0x7f8d440d4960 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f8d440b71b0 con 0x7f8d440d0d00 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d48de2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f8d440cbf60 con 0x7f8d4415df30 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d41d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440a0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d41d9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440a0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53272/0 (socket says 172.21.15.81:53272) 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.282+0000 7f8d41d9b640 1 -- 172.21.15.81:0/2069461912 learned_addr learned my addr 172.21.15.81:0/2069461912 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d4259c640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d440d0d00 0x7f8d4414c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d42d9d640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d4415df30 0x7f8d440a0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.285 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d41d9b640 1 -- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d4415df30 msgr2=0x7f8d440a0a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d41d9b640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d4415df30 0x7f8d440a0a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d41d9b640 1 -- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d440d0d00 msgr2=0x7f8d4414c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d41d9b640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d440d0d00 0x7f8d4414c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d41d9b640 1 -- 172.21.15.81:0/2069461912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d4414eef0 con 0x7f8d440d4960 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d41d9b640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440a0520 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800d950 tx=0x7f8d3800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d32ffd640 1 -- 172.21.15.81:0/2069461912 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d38017070 con 0x7f8d440d4960 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d32ffd640 1 -- 172.21.15.81:0/2069461912 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f8d38009d20 con 0x7f8d440d4960 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d440cc1b0 con 0x7f8d440d4960 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d32ffd640 1 -- 172.21.15.81:0/2069461912 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d380106c0 con 0x7f8d440d4960 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.283+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d440cc770 con 0x7f8d440d4960 2024-09-17T05:26:31.286 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.284+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d440b76d0 con 0x7f8d440d4960 2024-09-17T05:26:31.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.285+0000 7f8d32ffd640 1 -- 172.21.15.81:0/2069461912 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f8d38010860 con 0x7f8d440d4960 2024-09-17T05:26:31.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.285+0000 7f8d32ffd640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d24079760 0x7f8d2407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.285+0000 7f8d32ffd640 1 -- 172.21.15.81:0/2069461912 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f8d38099d10 con 0x7f8d440d4960 2024-09-17T05:26:31.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.285+0000 7f8d4259c640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d24079760 0x7f8d2407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.287 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.286+0000 7f8d4259c640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d24079760 0x7f8d2407bc20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8d340015e0 tx=0x7f8d34009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:31.290 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.289+0000 7f8d32ffd640 1 -- 172.21.15.81:0/2069461912 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f8d38063a30 con 0x7f8d440d4960 2024-09-17T05:26:31.469 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.468+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8d440d13f0 con 0x7f8d440d4960 2024-09-17T05:26:31.470 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.469+0000 7f8d32ffd640 1 -- 172.21.15.81:0/2069461912 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) ==== 74+0+16855 (secure 0 0 0) 0x7f8d38063330 con 0x7f8d440d4960 2024-09-17T05:26:31.470 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:31.471 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":162,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:26:18.303033+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:26:15.288741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:26:15.626241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:31.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d24079760 msgr2=0x7f8d2407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.472 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d24079760 0x7f8d2407bc20 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f8d340015e0 tx=0x7f8d34009040 comp rx=0 tx=0).stop 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 msgr2=0x7f8d440a0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440a0520 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7f8d3800d950 tx=0x7f8d3800de10 comp rx=0 tx=0).stop 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 shutdown_connections 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f8d4415df30 0x7f8d440a0a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f8d440d4960 0x7f8d440a0520 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f8d24079760 0x7f8d2407bc20 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 --2- 172.21.15.81:0/2069461912 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f8d440d0d00 0x7f8d4414c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 >> 172.21.15.81:0/2069461912 conn(0x7f8d440d3e40 msgr2=0x7f8d440b8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 shutdown_connections 2024-09-17T05:26:31.473 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.471+0000 7f8d48de2640 1 -- 172.21.15.81:0/2069461912 wait complete. 2024-09-17T05:26:31.483 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:26:31.484 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:31.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.583+0000 7fe7511f8640 1 -- 172.21.15.81:0/591615156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe738005210 msgr2=0x7fe73800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.584 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.583+0000 7fe7511f8640 1 --2- 172.21.15.81:0/591615156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe738005210 0x7fe73800b9c0 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7fe74c0ce5e0 tx=0x7fe738005830 comp rx=0 tx=0).stop 2024-09-17T05:26:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.583+0000 7fe7511f8640 1 -- 172.21.15.81:0/591615156 shutdown_connections 2024-09-17T05:26:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.583+0000 7fe7511f8640 1 --2- 172.21.15.81:0/591615156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe738005210 0x7fe73800b9c0 unknown :-1 s=CLOSED pgs=1909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.583+0000 7fe7511f8640 1 -- 172.21.15.81:0/591615156 >> 172.21.15.81:0/591615156 conn(0x7fe74c0b1690 msgr2=0x7fe74c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.583+0000 7fe7511f8640 1 -- 172.21.15.81:0/591615156 shutdown_connections 2024-09-17T05:26:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.583+0000 7fe7511f8640 1 -- 172.21.15.81:0/591615156 wait complete. 2024-09-17T05:26:31.585 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.584+0000 7fe7511f8640 1 Processor -- start 2024-09-17T05:26:31.586 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.584+0000 7fe7511f8640 1 -- start start 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe7511f8640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe738005210 0x7fe74c13f050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe7511f8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c154950 0x7fe74c154dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe7511f8640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1529a0 0x7fe74c152e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe7511f8640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c15f750 con 0x7fe74c154950 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe7511f8640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe74c0ccb10 con 0x7fe738005210 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe7511f8640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe74c15f8d0 con 0x7fe74c1529a0 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe743fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c154950 0x7fe74c154dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.588 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe743fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c154950 0x7fe74c154dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53278/0 (socket says 172.21.15.81:53278) 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe743fff640 1 -- 172.21.15.81:0/640012156 learned_addr learned my addr 172.21.15.81:0/640012156 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe74ad9d640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe738005210 0x7fe74c13f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe74b59e640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1529a0 0x7fe74c152e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe743fff640 1 -- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1529a0 msgr2=0x7fe74c152e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe743fff640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1529a0 0x7fe74c152e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe743fff640 1 -- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe738005210 msgr2=0x7fe74c13f050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.585+0000 7fe743fff640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe738005210 0x7fe74c13f050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.586+0000 7fe743fff640 1 -- 172.21.15.81:0/640012156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe74c13f590 con 0x7fe74c154950 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.586+0000 7fe743fff640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c154950 0x7fe74c154dd0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fe73400e600 tx=0x7fe73400eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.586+0000 7fe7437fe640 1 -- 172.21.15.81:0/640012156 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe734015070 con 0x7fe74c154950 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.586+0000 7fe7437fe640 1 -- 172.21.15.81:0/640012156 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe73400ca90 con 0x7fe74c154950 2024-09-17T05:26:31.589 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.586+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe74c1554a0 con 0x7fe74c154950 2024-09-17T05:26:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.586+0000 7fe7437fe640 1 -- 172.21.15.81:0/640012156 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe73400cea0 con 0x7fe74c154950 2024-09-17T05:26:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.586+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe74c155a60 con 0x7fe74c154950 2024-09-17T05:26:31.590 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.587+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe74c15d860 con 0x7fe74c154950 2024-09-17T05:26:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.588+0000 7fe7437fe640 1 -- 172.21.15.81:0/640012156 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fe734018070 con 0x7fe74c154950 2024-09-17T05:26:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.588+0000 7fe7437fe640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe72c079760 0x7fe72c07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.588+0000 7fe7437fe640 1 -- 172.21.15.81:0/640012156 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7fe734099cd0 con 0x7fe74c154950 2024-09-17T05:26:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.588+0000 7fe74ad9d640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe72c079760 0x7fe72c07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.591 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.588+0000 7fe74ad9d640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe72c079760 0x7fe72c07bc20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00fad0 tx=0x7fe73c00f4b0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:31.593 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.592+0000 7fe7437fe640 1 -- 172.21.15.81:0/640012156 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe7340639f0 con 0x7fe74c154950 2024-09-17T05:26:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.802+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe74c0cc1c0 con 0x7fe74c154950 2024-09-17T05:26:31.803 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.802+0000 7fe7437fe640 1 -- 172.21.15.81:0/640012156 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5229 (secure 0 0 0) 0x7fe74c0cc1c0 con 0x7fe74c154950 2024-09-17T05:26:31.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:31.804 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":102,"btime":"2024-09-17T05:26:26:155731+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2790285877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2790285877},{"type":"v1","addr":"172.21.15.160:6835","nonce":2790285877}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/790920368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":790920368},{"type":"v1","addr":"172.21.15.160:6834","nonce":790920368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/234206731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":234206731},{"type":"v1","addr":"172.21.15.81:6834","nonce":234206731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:26:16.673540+0000","modified":"2024-09-17T05:26:19.217419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9207":{"gid":9207,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/2091743317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2091743317},{"type":"v1","addr":"172.21.15.81:6835","nonce":2091743317}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9207,"qdb_cluster":[9207]},"id":13}]} 2024-09-17T05:26:31.804 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 102 2024-09-17T05:26:31.805 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe72c079760 msgr2=0x7fe72c07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe72c079760 0x7fe72c07bc20 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7fe73c00fad0 tx=0x7fe73c00f4b0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c154950 msgr2=0x7fe74c154dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c154950 0x7fe74c154dd0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7fe73400e600 tx=0x7fe73400eac0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 shutdown_connections 2024-09-17T05:26:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe74c1529a0 0x7fe74c152e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe74c154950 0x7fe74c154dd0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.806 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe72c079760 0x7fe72c07bc20 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 --2- 172.21.15.81:0/640012156 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe738005210 0x7fe74c13f050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 >> 172.21.15.81:0/640012156 conn(0x7fe74c0b1690 msgr2=0x7fe74c0cf960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 shutdown_connections 2024-09-17T05:26:31.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.804+0000 7fe7511f8640 1 -- 172.21.15.81:0/640012156 wait complete. 2024-09-17T05:26:31.816 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:26:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.917+0000 7f2277500640 1 -- 172.21.15.81:0/104273444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225c004d40 msgr2=0x7f225c0051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.917+0000 7f2277500640 1 --2- 172.21.15.81:0/104273444 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f225c004d40 0x7f225c0051c0 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f2268009ed0 tx=0x7f225c005830 comp rx=0 tx=0).stop 2024-09-17T05:26:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.917+0000 7f2275a9d640 1 -- 172.21.15.81:0/104273444 reap_dead start 2024-09-17T05:26:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.917+0000 7f2277500640 1 -- 172.21.15.81:0/104273444 shutdown_connections 2024-09-17T05:26:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.917+0000 7f2277500640 1 -- 172.21.15.81:0/104273444 >> 172.21.15.81:0/104273444 conn(0x7f22700d3ea0 msgr2=0x7f22700d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.917+0000 7f2277500640 1 -- 172.21.15.81:0/104273444 shutdown_connections 2024-09-17T05:26:31.919 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.917+0000 7f2277500640 1 -- 172.21.15.81:0/104273444 wait complete. 2024-09-17T05:26:31.921 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.918+0000 7f2277500640 1 Processor -- start 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.918+0000 7f2277500640 1 -- start start 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2277500640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22701f8a80 0x7f22701f8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2277500640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22700b7d20 0x7f227014d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2277500640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f227015e570 0x7f227015ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2277500640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2270162690 con 0x7f22701f8a80 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2277500640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f22700b3800 con 0x7f227015e570 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2277500640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f22701f93a0 con 0x7f22700b7d20 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22701f8a80 0x7f22701f8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22701f8a80 0x7f22701f8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53292/0 (socket says 172.21.15.81:53292) 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 -- 172.21.15.81:0/3161051150 learned_addr learned my addr 172.21.15.81:0/3161051150 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2275a9d640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f227015e570 0x7f227015ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.922 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2274a9b640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22700b7d20 0x7f227014d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 -- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22700b7d20 msgr2=0x7f227014d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22700b7d20 0x7f227014d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 -- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f227015e570 msgr2=0x7f227015ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f227015e570 0x7f227015ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 -- 172.21.15.81:0/3161051150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227014e1e0 con 0x7f22701f8a80 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2274a9b640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22700b7d20 0x7f227014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f227529c640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22701f8a80 0x7f22701f8e60 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f2264006670 tx=0x7f2264004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2261ffb640 1 -- 172.21.15.81:0/3161051150 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264015020 con 0x7f22701f8a80 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2261ffb640 1 -- 172.21.15.81:0/3161051150 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2264010980 con 0x7f22701f8a80 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227014dc20 con 0x7f22701f8a80 2024-09-17T05:26:31.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.919+0000 7f2261ffb640 1 -- 172.21.15.81:0/3161051150 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2264010d90 con 0x7f22701f8a80 2024-09-17T05:26:31.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.920+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2270160600 con 0x7f22701f8a80 2024-09-17T05:26:31.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.921+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22700cf9b0 con 0x7f22701f8a80 2024-09-17T05:26:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.921+0000 7f2261ffb640 1 -- 172.21.15.81:0/3161051150 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f2264018020 con 0x7f22701f8a80 2024-09-17T05:26:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.922+0000 7f2261ffb640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2254079760 0x7f225407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.922+0000 7f2274a9b640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2254079760 0x7f225407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.922+0000 7f2261ffb640 1 -- 172.21.15.81:0/3161051150 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f226409a3f0 con 0x7f22701f8a80 2024-09-17T05:26:31.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.922+0000 7f2274a9b640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2254079760 0x7f225407bc20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f227015ab00 tx=0x7f226c005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:31.927 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:31.926+0000 7f2261ffb640 1 -- 172.21.15.81:0/3161051150 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f226401f020 con 0x7f22701f8a80 2024-09-17T05:26:32.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.140+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22700b2120 con 0x7f22701f8a80 2024-09-17T05:26:32.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.140+0000 7f2261ffb640 1 -- 172.21.15.81:0/3161051150 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 102 v102) ==== 95+0+5229 (secure 0 0 0) 0x7f22700ce970 con 0x7f22701f8a80 2024-09-17T05:26:32.141 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:32.142 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":102,"btime":"2024-09-17T05:26:26:155731+0000","default_fscid":13,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2790285877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2790285877},{"type":"v1","addr":"172.21.15.160:6835","nonce":2790285877}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/790920368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":790920368},{"type":"v1","addr":"172.21.15.160:6834","nonce":790920368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/234206731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":234206731},{"type":"v1","addr":"172.21.15.81:6834","nonce":234206731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96}],"filesystems":[{"mdsmap":{"epoch":101,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-09-17T05:26:16.673540+0000","modified":"2024-09-17T05:26:19.217419+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":9207},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9207":{"gid":9207,"name":"c","rank":0,"incarnation":98,"state":"up:active","state_seq":2,"addr":"172.21.15.81:6835/2091743317","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":2091743317},{"type":"v1","addr":"172.21.15.81:6835","nonce":2091743317}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[27],"metadata_pool":26,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":9207,"qdb_cluster":[9207]},"id":13}]} 2024-09-17T05:26:32.142 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 102 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2254079760 msgr2=0x7f225407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2254079760 0x7f225407bc20 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f227015ab00 tx=0x7f226c005f90 comp rx=0 tx=0).stop 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22701f8a80 msgr2=0x7f22701f8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22701f8a80 0x7f22701f8e60 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f2264006670 tx=0x7f2264004ab0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 shutdown_connections 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2254079760 0x7f225407bc20 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f227015e570 0x7f227015ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22700b7d20 0x7f227014d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 --2- 172.21.15.81:0/3161051150 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22701f8a80 0x7f22701f8e60 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 >> 172.21.15.81:0/3161051150 conn(0x7f22700d3ea0 msgr2=0x7f22700b5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:32.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 shutdown_connections 2024-09-17T05:26:32.145 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.142+0000 7f2277500640 1 -- 172.21.15.81:0/3161051150 wait complete. 2024-09-17T05:26:32.155 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 -- 172.21.15.81:0/3719500495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 msgr2=0x7fd77c070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 --2- 172.21.15.81:0/3719500495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 0x7fd77c070410 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fd774005fd0 tx=0x7fd77402a820 comp rx=0 tx=0).stop 2024-09-17T05:26:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 -- 172.21.15.81:0/3719500495 shutdown_connections 2024-09-17T05:26:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 --2- 172.21.15.81:0/3719500495 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 0x7fd77c070410 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 --2- 172.21.15.81:0/3719500495 >> v2:172.21.15.160:3300/0 conn(0x7fd77c0735a0 0x7fd77c0739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 -- 172.21.15.81:0/3719500495 >> 172.21.15.81:0/3719500495 conn(0x7fd77c0b1690 msgr2=0x7fd77c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 -- 172.21.15.81:0/3719500495 shutdown_connections 2024-09-17T05:26:32.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.254+0000 7fd782700640 1 -- 172.21.15.81:0/3719500495 wait complete. 2024-09-17T05:26:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.255+0000 7fd782700640 1 Processor -- start 2024-09-17T05:26:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.255+0000 7fd782700640 1 -- start start 2024-09-17T05:26:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd782700640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 0x7fd77c1f38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd782700640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0735a0 0x7fd77c154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd782700640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd77c15aa70 0x7fd77c1451d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd782700640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c0cd270 con 0x7fd77c0735a0 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd782700640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd77c0cd0f0 con 0x7fd77c15aa70 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd782700640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd77c0cd3f0 con 0x7fd77c06ff80 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0735a0 0x7fd77c154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd77b7fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0735a0 0x7fd77c154ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53304/0 (socket says 172.21.15.81:53304) 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd77b7fe640 1 -- 172.21.15.81:0/4046327352 learned_addr learned my addr 172.21.15.81:0/4046327352 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd780c9d640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd77c15aa70 0x7fd77c1451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd77bfff640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 0x7fd77c1f38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd77b7fe640 1 -- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 msgr2=0x7fd77c1f38e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.256+0000 7fd77b7fe640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 0x7fd77c1f38e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd77b7fe640 1 -- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd77c15aa70 msgr2=0x7fd77c1451d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd77b7fe640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd77c15aa70 0x7fd77c1451d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd77b7fe640 1 -- 172.21.15.81:0/4046327352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd77c13fd60 con 0x7fd77c0735a0 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd77b7fe640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0735a0 0x7fd77c154ab0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fd77000ea60 tx=0x7fd77000ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd778ff9640 1 -- 172.21.15.81:0/4046327352 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd77000cde0 con 0x7fd77c0735a0 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd778ff9640 1 -- 172.21.15.81:0/4046327352 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd770004020 con 0x7fd77c0735a0 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd77c1559e0 con 0x7fd77c0735a0 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd778ff9640 1 -- 172.21.15.81:0/4046327352 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd770004450 con 0x7fd77c0735a0 2024-09-17T05:26:32.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.257+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd77c140000 con 0x7fd77c0735a0 2024-09-17T05:26:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.258+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd77c06fda0 con 0x7fd77c0735a0 2024-09-17T05:26:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.259+0000 7fd778ff9640 1 -- 172.21.15.81:0/4046327352 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fd7700035f0 con 0x7fd77c0735a0 2024-09-17T05:26:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.259+0000 7fd778ff9640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd768079760 0x7fd76807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.259+0000 7fd77bfff640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd768079760 0x7fd76807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.259+0000 7fd778ff9640 1 -- 172.21.15.81:0/4046327352 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7fd770099f70 con 0x7fd77c0735a0 2024-09-17T05:26:32.262 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.260+0000 7fd77bfff640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd768079760 0x7fd76807bc20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd76c001720 tx=0x7fd76c007e90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:32.264 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.263+0000 7fd778ff9640 1 -- 172.21.15.81:0/4046327352 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd77c06fda0 con 0x7fd77c0735a0 2024-09-17T05:26:32.443 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.442+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd77c0b2df0 con 0x7fd77c0735a0 2024-09-17T05:26:32.444 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.443+0000 7fd778ff9640 1 -- 172.21.15.81:0/4046327352 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v162) ==== 74+0+16855 (secure 0 0 0) 0x7fd7700638a0 con 0x7fd77c0735a0 2024-09-17T05:26:32.444 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:32.444 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":162,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:26:18.303033+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":26,"pool_name":"cephfs_metadata","create_time":"2024-09-17T05:26:15.288741+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"161","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":27,"pool_name":"cephfs_data","create_time":"2024-09-17T05:26:15.626241+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"162","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd768079760 msgr2=0x7fd76807bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd768079760 0x7fd76807bc20 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fd76c001720 tx=0x7fd76c007e90 comp rx=0 tx=0).stop 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0735a0 msgr2=0x7fd77c154ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0735a0 0x7fd77c154ab0 secure :-1 s=READY pgs=1914 cs=0 l=1 rev1=1 crypto rx=0x7fd77000ea60 tx=0x7fd77000ef20 comp rx=0 tx=0).stop 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 shutdown_connections 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd768079760 0x7fd76807bc20 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd77c15aa70 0x7fd77c1451d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd77c0735a0 0x7fd77c154ab0 unknown :-1 s=CLOSED pgs=1914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 --2- 172.21.15.81:0/4046327352 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd77c06ff80 0x7fd77c1f38e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 >> 172.21.15.81:0/4046327352 conn(0x7fd77c0b1690 msgr2=0x7fd77c0ce2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 shutdown_connections 2024-09-17T05:26:32.447 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.445+0000 7fd782700640 1 -- 172.21.15.81:0/4046327352 wait complete. 2024-09-17T05:26:32.458 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-09-17T05:26:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 -- 172.21.15.81:0/2056323712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 msgr2=0x7f594c072ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 --2- 172.21.15.81:0/2056323712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c072ae0 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7f5944005fd0 tx=0x7f594402aa00 comp rx=0 tx=0).stop 2024-09-17T05:26:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 -- 172.21.15.81:0/2056323712 shutdown_connections 2024-09-17T05:26:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 --2- 172.21.15.81:0/2056323712 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c072ae0 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.560 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 --2- 172.21.15.81:0/2056323712 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f594c0cf640 0x7f594c0725a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 -- 172.21.15.81:0/2056323712 >> 172.21.15.81:0/2056323712 conn(0x7f594c0b1690 msgr2=0x7f594c0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:32.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 -- 172.21.15.81:0/2056323712 shutdown_connections 2024-09-17T05:26:32.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.559+0000 7f5950e62640 1 -- 172.21.15.81:0/2056323712 wait complete. 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.560+0000 7f5950e62640 1 Processor -- start 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.560+0000 7f5950e62640 1 -- start start 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c146730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f594c0cf640 0x7f594c0b04f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f594c151370 0x7f594c0b0a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f594c070020 con 0x7f594c0b3140 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f594c06fea0 con 0x7f594c0cf640 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f594c0701a0 con 0x7f594c151370 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c146730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c146730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53316/0 (socket says 172.21.15.81:53316) 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 -- 172.21.15.81:0/2930396498 learned_addr learned my addr 172.21.15.81:0/2930396498 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 -- 172.21.15.81:0/2930396498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f594c151370 msgr2=0x7f594c0b0a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f594c151370 0x7f594c0b0a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 -- 172.21.15.81:0/2930396498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f594c0cf640 msgr2=0x7f594c0b04f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f594c0cf640 0x7f594c0b04f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 -- 172.21.15.81:0/2930396498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f594c148d00 con 0x7f594c0b3140 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f594a59c640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c146730 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f593c00b410 tx=0x7f593c00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5942ffd640 1 -- 172.21.15.81:0/2930396498 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c015020 con 0x7f594c0b3140 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5942ffd640 1 -- 172.21.15.81:0/2930396498 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f593c011920 con 0x7f594c0b3140 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f594c1f50c0 con 0x7f594c0b3140 2024-09-17T05:26:32.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5942ffd640 1 -- 172.21.15.81:0/2930396498 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f593c011d70 con 0x7f594c0b3140 2024-09-17T05:26:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.561+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f594c1f5680 con 0x7f594c0b3140 2024-09-17T05:26:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.562+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f594c1f5880 con 0x7f594c0b3140 2024-09-17T05:26:32.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.563+0000 7f5942ffd640 1 -- 172.21.15.81:0/2930396498 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f593c018020 con 0x7f594c0b3140 2024-09-17T05:26:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.563+0000 7f5942ffd640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f592c079760 0x7f592c07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.564+0000 7f5942ffd640 1 -- 172.21.15.81:0/2930396498 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(162..162 src has 1..162) ==== 5781+0+0 (secure 0 0 0) 0x7f593c099930 con 0x7f594c0b3140 2024-09-17T05:26:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.564+0000 7f5943fff640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f592c079760 0x7f592c07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.564+0000 7f5943fff640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f592c079760 0x7f592c07bc20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f594c1500d0 tx=0x7f5934005bf0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:32.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.568+0000 7f5942ffd640 1 -- 172.21.15.81:0/2930396498 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f594c1f5880 con 0x7f594c0b3140 2024-09-17T05:26:32.780 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.779+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f594c1f4eb0 con 0x7f594c0b3140 2024-09-17T05:26:32.780 INFO:tasks.ceph.mon.a.smithi081.stderr:2024-09-17T05:26:32.779+0000 7fe3dc5df640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-17T05:26:32.782 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.781+0000 7f5942ffd640 1 -- 172.21.15.81:0/2930396498 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v103) ==== 161+0+0 (secure 0 0 0) 0x7f593c01f020 con 0x7f594c0b3140 2024-09-17T05:26:32.782 INFO:teuthology.orchestra.run.smithi081.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-17T05:26:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f592c079760 msgr2=0x7f592c07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f592c079760 0x7f592c07bc20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f594c1500d0 tx=0x7f5934005bf0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 msgr2=0x7f594c146730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.785 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c146730 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7f593c00b410 tx=0x7f593c00b8d0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 shutdown_connections 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f594c151370 0x7f594c0b0a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f592c079760 0x7f592c07bc20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f594c0cf640 0x7f594c0b04f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 --2- 172.21.15.81:0/2930396498 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f594c0b3140 0x7f594c146730 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 >> 172.21.15.81:0/2930396498 conn(0x7f594c0b1690 msgr2=0x7f594c06e5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 shutdown_connections 2024-09-17T05:26:32.786 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.784+0000 7f5950e62640 1 -- 172.21.15.81:0/2930396498 wait complete. 2024-09-17T05:26:32.797 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-09-17T05:26:32.822 INFO:tasks.ceph.mds.c.smithi081.stdout:starting mds.c at 2024-09-17T05:26:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.901+0000 7f2c04775640 1 -- 172.21.15.81:0/1854865454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 msgr2=0x7f2bfc0cf920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.901+0000 7f2c04775640 1 --2- 172.21.15.81:0/1854865454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc0cf920 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4005fd0 tx=0x7f2bf402aa90 comp rx=0 tx=0).stop 2024-09-17T05:26:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.901+0000 7f2c04775640 1 -- 172.21.15.81:0/1854865454 shutdown_connections 2024-09-17T05:26:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.901+0000 7f2c04775640 1 --2- 172.21.15.81:0/1854865454 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc0cf920 unknown :-1 s=CLOSED pgs=1921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.901+0000 7f2c04775640 1 -- 172.21.15.81:0/1854865454 >> 172.21.15.81:0/1854865454 conn(0x7f2bfc09d3c0 msgr2=0x7f2bfc0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.901+0000 7f2c04775640 1 -- 172.21.15.81:0/1854865454 shutdown_connections 2024-09-17T05:26:32.903 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.901+0000 7f2c04775640 1 -- 172.21.15.81:0/1854865454 wait complete. 2024-09-17T05:26:32.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 Processor -- start 2024-09-17T05:26:32.904 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 -- start start 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bfc0d0bd0 0x7f2bfc0b23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bfc0d0fb0 0x7f2bfc14f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc15e840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc169270 con 0x7f2bfc1619c0 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2bfc1690f0 con 0x7f2bfc0d0fb0 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c04775640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2bfc1693f0 con 0x7f2bfc0d0bd0 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c02d12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc15e840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c02d12640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc15e840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:53356/0 (socket says 172.21.15.81:53356) 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.903+0000 7f2c02d12640 1 -- 172.21.15.81:0/2523803102 learned_addr learned my addr 172.21.15.81:0/2523803102 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c01d10640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bfc0d0fb0 0x7f2bfc14f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02511640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bfc0d0bd0 0x7f2bfc0b23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02d12640 1 -- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bfc0d0bd0 msgr2=0x7f2bfc0b23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02d12640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bfc0d0bd0 0x7f2bfc0b23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02d12640 1 -- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bfc0d0fb0 msgr2=0x7f2bfc14f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02d12640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bfc0d0fb0 0x7f2bfc14f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02d12640 1 -- 172.21.15.81:0/2523803102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bfc14f620 con 0x7f2bfc1619c0 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02511640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bfc0d0bd0 0x7f2bfc0b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c02d12640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc15e840 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4006010 tx=0x7f2bf4003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:32.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2bf2ffd640 1 -- 172.21.15.81:0/2523803102 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4044070 con 0x7f2bfc1619c0 2024-09-17T05:26:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2bf2ffd640 1 -- 172.21.15.81:0/2523803102 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2bf4004250 con 0x7f2bfc1619c0 2024-09-17T05:26:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bfc0b1310 con 0x7f2bfc1619c0 2024-09-17T05:26:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2bf2ffd640 1 -- 172.21.15.81:0/2523803102 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bf4004680 con 0x7f2bfc1619c0 2024-09-17T05:26:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.904+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bfc0b18d0 con 0x7f2bfc1619c0 2024-09-17T05:26:32.908 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.905+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2bfc0b40d0 con 0x7f2bfc1619c0 2024-09-17T05:26:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.906+0000 7f2bf2ffd640 1 -- 172.21.15.81:0/2523803102 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f2bf4047070 con 0x7f2bfc1619c0 2024-09-17T05:26:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.906+0000 7f2bf2ffd640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2be0079760 0x7f2be007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.906+0000 7f2bf2ffd640 1 -- 172.21.15.81:0/2523803102 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5867+0+0 (secure 0 0 0) 0x7f2bf40ba8c0 con 0x7f2bfc1619c0 2024-09-17T05:26:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.906+0000 7f2c02511640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2be0079760 0x7f2be007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:32.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.907+0000 7f2c02511640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2be0079760 0x7f2be007bc20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8001750 tx=0x7f2bf8009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:32.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:32.910+0000 7f2bf2ffd640 1 -- 172.21.15.81:0/2523803102 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2bf4032030 con 0x7f2bfc1619c0 2024-09-17T05:26:33.125 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.124+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f2bfc159fa0 con 0x7f2bfc1619c0 2024-09-17T05:26:33.783 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.782+0000 7f2bf2ffd640 1 -- 172.21.15.81:0/2523803102 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v104) ==== 104+0+0 (secure 0 0 0) 0x7f2bf4004820 con 0x7f2bfc1619c0 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2be0079760 msgr2=0x7f2be007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2be0079760 0x7f2be007bc20 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f2bf8001750 tx=0x7f2bf8009040 comp rx=0 tx=0).stop 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 msgr2=0x7f2bfc15e840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc15e840 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f2bf4006010 tx=0x7f2bf4003f10 comp rx=0 tx=0).stop 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 shutdown_connections 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2bfc1619c0 0x7f2bfc15e840 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2be0079760 0x7f2be007bc20 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2bfc0d0fb0 0x7f2bfc14f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 --2- 172.21.15.81:0/2523803102 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2bfc0d0bd0 0x7f2bfc0b23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:33.787 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.785+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 >> 172.21.15.81:0/2523803102 conn(0x7f2bfc09d3c0 msgr2=0x7f2bfc1541e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.786+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 shutdown_connections 2024-09-17T05:26:33.788 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.786+0000 7f2c04775640 1 -- 172.21.15.81:0/2523803102 wait complete. 2024-09-17T05:26:33.799 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-17T05:26:33.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.945+0000 7fe394ca3640 1 -- 172.21.15.81:0/2102509316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390158770 msgr2=0x7fe39015ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:33.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.945+0000 7fe394ca3640 1 --2- 172.21.15.81:0/2102509316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390158770 0x7fe39015ba50 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7fe380005fd0 tx=0x7fe38002aa10 comp rx=0 tx=0).stop 2024-09-17T05:26:33.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.945+0000 7fe394ca3640 1 -- 172.21.15.81:0/2102509316 shutdown_connections 2024-09-17T05:26:33.946 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.945+0000 7fe394ca3640 1 --2- 172.21.15.81:0/2102509316 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390158770 0x7fe39015ba50 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.945+0000 7fe394ca3640 1 -- 172.21.15.81:0/2102509316 >> 172.21.15.81:0/2102509316 conn(0x7fe3900b1620 msgr2=0x7fe3900b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.945+0000 7fe394ca3640 1 -- 172.21.15.81:0/2102509316 shutdown_connections 2024-09-17T05:26:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.945+0000 7fe394ca3640 1 -- 172.21.15.81:0/2102509316 wait complete. 2024-09-17T05:26:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.946+0000 7fe394ca3640 1 Processor -- start 2024-09-17T05:26:33.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.946+0000 7fe394ca3640 1 -- start start 2024-09-17T05:26:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe394ca3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe390070590 0x7fe390142750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe394ca3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe390073190 0x7fe3901f7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe394ca3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390141e00 0x7fe39006f8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe394ca3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe39015a3a0 con 0x7fe390141e00 2024-09-17T05:26:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe394ca3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe39015a220 con 0x7fe390070590 2024-09-17T05:26:33.949 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe394ca3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe39015a520 con 0x7fe390073190 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe38ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390141e00 0x7fe39006f8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe38ed9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390141e00 0x7fe39006f8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55662/0 (socket says 172.21.15.81:55662) 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe38ed9d640 1 -- 172.21.15.81:0/3437277357 learned_addr learned my addr 172.21.15.81:0/3437277357 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe38ed9d640 1 -- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe390073190 msgr2=0x7fe3901f7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe38e59c640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe390070590 0x7fe390142750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe38ed9d640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe390073190 0x7fe3901f7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.947+0000 7fe38ed9d640 1 -- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe390070590 msgr2=0x7fe390142750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe38ed9d640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe390070590 0x7fe390142750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe38ed9d640 1 -- 172.21.15.81:0/3437277357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3901f7580 con 0x7fe390141e00 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe38e59c640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe390070590 0x7fe390142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:33.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe38ed9d640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390141e00 0x7fe39006f8c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c3c0 tx=0x7fe38800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:33.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe37effd640 1 -- 172.21.15.81:0/3437277357 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388017070 con 0x7fe390141e00 2024-09-17T05:26:33.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe37effd640 1 -- 172.21.15.81:0/3437277357 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe3880035f0 con 0x7fe390141e00 2024-09-17T05:26:33.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe37effd640 1 -- 172.21.15.81:0/3437277357 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe388003a40 con 0x7fe390141e00 2024-09-17T05:26:33.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3900acaa0 con 0x7fe390141e00 2024-09-17T05:26:33.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.948+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3901e3550 con 0x7fe390141e00 2024-09-17T05:26:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.949+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe3900ac7d0 con 0x7fe390141e00 2024-09-17T05:26:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.950+0000 7fe37effd640 1 -- 172.21.15.81:0/3437277357 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fe38801a070 con 0x7fe390141e00 2024-09-17T05:26:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.950+0000 7fe37effd640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe370079760 0x7fe37007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.950+0000 7fe38e59c640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe370079760 0x7fe37007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.950+0000 7fe37effd640 1 -- 172.21.15.81:0/3437277357 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(163..163 src has 1..163) ==== 5867+0+0 (secure 0 0 0) 0x7fe388098bd0 con 0x7fe390141e00 2024-09-17T05:26:33.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.951+0000 7fe38e59c640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe370079760 0x7fe37007bc20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe380035000 tx=0x7fe380004ab0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:33.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:33.954+0000 7fe37effd640 1 -- 172.21.15.81:0/3437277357 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fe3900acaa0 con 0x7fe390141e00 2024-09-17T05:26:34.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.132+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fe39015ba50 con 0x7fe390141e00 2024-09-17T05:26:34.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.905+0000 7fe37effd640 1 -- 172.21.15.81:0/3437277357 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v164) ==== 181+0+0 (secure 0 0 0) 0x7fe3880628f0 con 0x7fe390141e00 2024-09-17T05:26:34.906 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_metadata' removed 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe370079760 msgr2=0x7fe37007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe370079760 0x7fe37007bc20 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fe380035000 tx=0x7fe380004ab0 comp rx=0 tx=0).stop 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390141e00 msgr2=0x7fe39006f8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390141e00 0x7fe39006f8c0 secure :-1 s=READY pgs=1925 cs=0 l=1 rev1=1 crypto rx=0x7fe38800c3c0 tx=0x7fe38800c880 comp rx=0 tx=0).stop 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 shutdown_connections 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe390141e00 0x7fe39006f8c0 unknown :-1 s=CLOSED pgs=1925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe390073190 0x7fe3901f7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:34.909 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe370079760 0x7fe37007bc20 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 --2- 172.21.15.81:0/3437277357 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe390070590 0x7fe390142750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 >> 172.21.15.81:0/3437277357 conn(0x7fe3900b1620 msgr2=0x7fe3901572c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 shutdown_connections 2024-09-17T05:26:34.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:34.908+0000 7fe394ca3640 1 -- 172.21.15.81:0/3437277357 wait complete. 2024-09-17T05:26:34.924 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-17T05:26:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.035+0000 7f67d7a1f640 1 -- 172.21.15.81:0/2075603384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006e4e0 msgr2=0x7f67d00ae6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.035+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/2075603384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006e4e0 0x7f67d00ae6f0 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f67c4005fd0 tx=0x7f67c402a540 comp rx=0 tx=0).stop 2024-09-17T05:26:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.035+0000 7f67d7a1f640 1 -- 172.21.15.81:0/2075603384 shutdown_connections 2024-09-17T05:26:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.035+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/2075603384 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d006e4e0 0x7f67d00ae6f0 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:35.036 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.035+0000 7f67d7a1f640 1 -- 172.21.15.81:0/2075603384 >> 172.21.15.81:0/2075603384 conn(0x7f67d00b1620 msgr2=0x7f67d00b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.035+0000 7f67d7a1f640 1 -- 172.21.15.81:0/2075603384 shutdown_connections 2024-09-17T05:26:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.035+0000 7f67d7a1f640 1 -- 172.21.15.81:0/2075603384 wait complete. 2024-09-17T05:26:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.036+0000 7f67d7a1f640 1 Processor -- start 2024-09-17T05:26:35.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.036+0000 7f67d7a1f640 1 -- start start 2024-09-17T05:26:35.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d7a1f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67d006e4e0 0x7f67d014bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:35.039 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d7a1f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d0072610 0x7f67d01f4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d7a1f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d0150ef0 0x7f67d0149870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d7a1f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0072c20 con 0x7f67d0150ef0 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d7a1f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f67d0072aa0 con 0x7f67d0072610 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d7a1f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f67d0072da0 con 0x7f67d006e4e0 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d0150ef0 0x7f67d0149870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d0150ef0 0x7f67d0149870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55684/0 (socket says 172.21.15.81:55684) 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 -- 172.21.15.81:0/821072007 learned_addr learned my addr 172.21.15.81:0/821072007 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d4fba640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d0072610 0x7f67d01f4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d57bb640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67d006e4e0 0x7f67d014bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 -- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67d006e4e0 msgr2=0x7f67d014bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:35.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67d006e4e0 0x7f67d014bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 -- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d0072610 msgr2=0x7f67d01f4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d0072610 0x7f67d01f4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 -- 172.21.15.81:0/821072007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67d01f5c40 con 0x7f67d0150ef0 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d4fba640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d0072610 0x7f67d01f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67d5fbc640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d0150ef0 0x7f67d0149870 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c780 tx=0x7f67c000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.037+0000 7f67cdffb640 1 -- 172.21.15.81:0/821072007 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c0004b60 con 0x7f67d0150ef0 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.038+0000 7f67cdffb640 1 -- 172.21.15.81:0/821072007 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f67c0004df0 con 0x7f67d0150ef0 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.038+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67d01f53a0 con 0x7f67d0150ef0 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.038+0000 7f67cdffb640 1 -- 172.21.15.81:0/821072007 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67c000aa70 con 0x7f67d0150ef0 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.038+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67d01f5960 con 0x7f67d0150ef0 2024-09-17T05:26:35.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.039+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67d00ae6f0 con 0x7f67d0150ef0 2024-09-17T05:26:35.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.039+0000 7f67cdffb640 1 -- 172.21.15.81:0/821072007 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f67c000ac10 con 0x7f67d0150ef0 2024-09-17T05:26:35.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.040+0000 7f67cdffb640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67bc079760 0x7f67bc07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:35.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.040+0000 7f67cdffb640 1 -- 172.21.15.81:0/821072007 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(164..164 src has 1..164) ==== 5429+0+0 (secure 0 0 0) 0x7f67c0099ad0 con 0x7f67d0150ef0 2024-09-17T05:26:35.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.040+0000 7f67d57bb640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67bc079760 0x7f67bc07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:35.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.040+0000 7f67d57bb640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67bc079760 0x7f67bc07bc20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f67d01576a0 tx=0x7f67c8009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:35.045 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.044+0000 7f67cdffb640 1 -- 172.21.15.81:0/821072007 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f67c0020070 con 0x7f67d0150ef0 2024-09-17T05:26:35.221 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.220+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f67d00d0960 con 0x7f67d0150ef0 2024-09-17T05:26:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.913+0000 7f67cdffb640 1 -- 172.21.15.81:0/821072007 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v165) ==== 169+0+0 (secure 0 0 0) 0x7f67c00637f0 con 0x7f67d0150ef0 2024-09-17T05:26:35.914 INFO:teuthology.orchestra.run.smithi081.stderr:pool 'cephfs_data' removed 2024-09-17T05:26:35.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67bc079760 msgr2=0x7f67bc07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:35.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67bc079760 0x7f67bc07bc20 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f67d01576a0 tx=0x7f67c8009040 comp rx=0 tx=0).stop 2024-09-17T05:26:35.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d0150ef0 msgr2=0x7f67d0149870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:35.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d0150ef0 0x7f67d0149870 secure :-1 s=READY pgs=1928 cs=0 l=1 rev1=1 crypto rx=0x7f67c000c780 tx=0x7f67c000cc40 comp rx=0 tx=0).stop 2024-09-17T05:26:35.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 shutdown_connections 2024-09-17T05:26:35.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67d0150ef0 0x7f67d0149870 unknown :-1 s=CLOSED pgs=1928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:35.917 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f67bc079760 0x7f67bc07bc20 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67d0072610 0x7f67d01f4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 --2- 172.21.15.81:0/821072007 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f67d006e4e0 0x7f67d014bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.915+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 >> 172.21.15.81:0/821072007 conn(0x7f67d00b1620 msgr2=0x7f67d015d090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.916+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 shutdown_connections 2024-09-17T05:26:35.918 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:35.916+0000 7f67d7a1f640 1 -- 172.21.15.81:0/821072007 wait complete. 2024-09-17T05:26:35.932 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config reset 27 2024-09-17T05:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 -- 172.21.15.81:0/2515038781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc490 msgr2=0x7f22dc15f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 --2- 172.21.15.81:0/2515038781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc490 0x7f22dc15f750 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f22d0005fd0 tx=0x7f22d002a5d0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 -- 172.21.15.81:0/2515038781 shutdown_connections 2024-09-17T05:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 --2- 172.21.15.81:0/2515038781 >> v2:172.21.15.160:3300/0 conn(0x7f22dc0cc8d0 0x7f22dc15fc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.037 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 --2- 172.21.15.81:0/2515038781 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc490 0x7f22dc15f750 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 -- 172.21.15.81:0/2515038781 >> 172.21.15.81:0/2515038781 conn(0x7f22dc0b1690 msgr2=0x7f22dc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 -- 172.21.15.81:0/2515038781 shutdown_connections 2024-09-17T05:26:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.036+0000 7f22e41a3640 1 -- 172.21.15.81:0/2515038781 wait complete. 2024-09-17T05:26:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.037+0000 7f22e41a3640 1 Processor -- start 2024-09-17T05:26:36.038 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.037+0000 7f22e41a3640 1 -- start start 2024-09-17T05:26:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e41a3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0cc490 0x7f22dc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e41a3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc8d0 0x7f22dc14ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.040 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e41a3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22dc159680 0x7f22dc146610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e41a3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc0cec40 con 0x7f22dc159680 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e41a3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f22dc0ceac0 con 0x7f22dc0cc490 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e41a3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f22dc0cedc0 con 0x7f22dc0cc8d0 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22dc159680 0x7f22dc146610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22dc159680 0x7f22dc146610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55690/0 (socket says 172.21.15.81:55690) 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 -- 172.21.15.81:0/4068311981 learned_addr learned my addr 172.21.15.81:0/4068311981 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e1f3f640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0cc490 0x7f22dc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e173e640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc8d0 0x7f22dc14ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 -- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc8d0 msgr2=0x7f22dc14ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc8d0 0x7f22dc14ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.041 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 -- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0cc490 msgr2=0x7f22dc152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0cc490 0x7f22dc152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.038+0000 7f22e2740640 1 -- 172.21.15.81:0/4068311981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22dc150520 con 0x7f22dc159680 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.039+0000 7f22e2740640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22dc159680 0x7f22dc146610 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f22d400e9e0 tx=0x7f22d400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.039+0000 7f22da7fc640 1 -- 172.21.15.81:0/4068311981 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d400cd50 con 0x7f22dc159680 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.039+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22dc154f50 con 0x7f22dc159680 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.039+0000 7f22da7fc640 1 -- 172.21.15.81:0/4068311981 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f22d4004020 con 0x7f22dc159680 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.039+0000 7f22da7fc640 1 -- 172.21.15.81:0/4068311981 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d4004450 con 0x7f22dc159680 2024-09-17T05:26:36.042 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.039+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22dc146b50 con 0x7f22dc159680 2024-09-17T05:26:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.040+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22dc0cf2e0 con 0x7f22dc159680 2024-09-17T05:26:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.040+0000 7f22da7fc640 1 -- 172.21.15.81:0/4068311981 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f22d40035f0 con 0x7f22dc159680 2024-09-17T05:26:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.041+0000 7f22da7fc640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22c8079760 0x7f22c807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.041+0000 7f22e1f3f640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22c8079760 0x7f22c807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.041+0000 7f22da7fc640 1 -- 172.21.15.81:0/4068311981 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f22d4099f00 con 0x7f22dc159680 2024-09-17T05:26:36.043 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.041+0000 7f22e1f3f640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22c8079760 0x7f22c807bc20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001e20 tx=0x7f22cc009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:36.046 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.045+0000 7f22da7fc640 1 -- 172.21.15.81:0/4068311981 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f22d40637b0 con 0x7f22dc159680 2024-09-17T05:26:36.227 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.227+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "config reset", "num": 27} v 0) -- 0x7f22dc06e890 con 0x7f22dc159680 2024-09-17T05:26:36.231 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.230+0000 7f22da7fc640 1 -- 172.21.15.81:0/4068311981 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "config reset", "num": 27}]=0 v49) ==== 71+0+0 (secure 0 0 0) 0x7f22d40681e0 con 0x7f22dc159680 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22c8079760 msgr2=0x7f22c807bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22c8079760 0x7f22c807bc20 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f22cc001e20 tx=0x7f22cc009040 comp rx=0 tx=0).stop 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22dc159680 msgr2=0x7f22dc146610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22dc159680 0x7f22dc146610 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f22d400e9e0 tx=0x7f22d400eea0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 shutdown_connections 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f22dc159680 0x7f22dc146610 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f22dc0cc8d0 0x7f22dc14ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f22c8079760 0x7f22c807bc20 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 --2- 172.21.15.81:0/4068311981 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f22dc0cc490 0x7f22dc152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.234 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 >> 172.21.15.81:0/4068311981 conn(0x7f22dc0b1690 msgr2=0x7f22dc15bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 shutdown_connections 2024-09-17T05:26:36.235 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.232+0000 7f22e41a3640 1 -- 172.21.15.81:0/4068311981 wait complete. 2024-09-17T05:26:36.245 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade' 2024-09-17T05:26:36.346 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.345+0000 7fb3b5efe640 1 -- 172.21.15.81:0/1686292756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb398004d40 msgr2=0x7fb3980051c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.345+0000 7fb3b5efe640 1 --2- 172.21.15.81:0/1686292756 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb398004d40 0x7fb3980051c0 secure :-1 s=READY pgs=1931 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c310 tx=0x7fb398005830 comp rx=0 tx=0).stop 2024-09-17T05:26:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.345+0000 7fb3affff640 1 -- 172.21.15.81:0/1686292756 reap_dead start 2024-09-17T05:26:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.345+0000 7fb3b5efe640 1 -- 172.21.15.81:0/1686292756 shutdown_connections 2024-09-17T05:26:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.345+0000 7fb3b5efe640 1 -- 172.21.15.81:0/1686292756 >> 172.21.15.81:0/1686292756 conn(0x7fb3b006cf60 msgr2=0x7fb3b006d370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.345+0000 7fb3b5efe640 1 -- 172.21.15.81:0/1686292756 shutdown_connections 2024-09-17T05:26:36.347 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.345+0000 7fb3b5efe640 1 -- 172.21.15.81:0/1686292756 wait complete. 2024-09-17T05:26:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.346+0000 7fb3b5efe640 1 Processor -- start 2024-09-17T05:26:36.348 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3b5efe640 1 -- start start 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3b5efe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb398004d40 0x7fb3b01ef6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3b5efe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3b0158230 0x7fb3b01586b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3b5efe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b01f5870 0x7fb3b01f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3b5efe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b015b900 con 0x7fb3b01f5870 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3b5efe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b015b780 con 0x7fb398004d40 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3b5efe640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b015ba80 con 0x7fb3b0158230 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b01f5870 0x7fb3b01f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3affff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b01f5870 0x7fb3b01f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55712/0 (socket says 172.21.15.81:55712) 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.347+0000 7fb3affff640 1 -- 172.21.15.81:0/4049444895 learned_addr learned my addr 172.21.15.81:0/4049444895 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:36.350 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3aeffd640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3b0158230 0x7fb3b01586b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3af7fe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb398004d40 0x7fb3b01ef6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3affff640 1 -- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3b0158230 msgr2=0x7fb3b01586b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3affff640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3b0158230 0x7fb3b01586b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3affff640 1 -- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb398004d40 msgr2=0x7fb3b01ef6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3affff640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb398004d40 0x7fb3b01ef6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3affff640 1 -- 172.21.15.81:0/4049444895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b0158bf0 con 0x7fb3b01f5870 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3af7fe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb398004d40 0x7fb3b01ef6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3affff640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b01f5870 0x7fb3b01f5cf0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fb3a802b130 tx=0x7fb3a8006670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb397fff640 1 -- 172.21.15.81:0/4049444895 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8031070 con 0x7fb3b01f5870 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb397fff640 1 -- 172.21.15.81:0/4049444895 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb3a802c6a0 con 0x7fb3b01f5870 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b01f65c0 con 0x7fb3b01f5870 2024-09-17T05:26:36.351 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb397fff640 1 -- 172.21.15.81:0/4049444895 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8006c70 con 0x7fb3b01f5870 2024-09-17T05:26:36.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.348+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b01426f0 con 0x7fb3b01f5870 2024-09-17T05:26:36.352 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.349+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3b015f020 con 0x7fb3b01f5870 2024-09-17T05:26:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.350+0000 7fb397fff640 1 -- 172.21.15.81:0/4049444895 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fb3a8034070 con 0x7fb3b01f5870 2024-09-17T05:26:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.350+0000 7fb397fff640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb39c079760 0x7fb39c07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.350+0000 7fb3af7fe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb39c079760 0x7fb39c07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.350+0000 7fb397fff640 1 -- 172.21.15.81:0/4049444895 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fb3a80b8fa0 con 0x7fb3b01f5870 2024-09-17T05:26:36.353 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.351+0000 7fb3af7fe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb39c079760 0x7fb39c07bc20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0006630 tx=0x7fb3a0003ba0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:36.355 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.354+0000 7fb397fff640 1 -- 172.21.15.81:0/4049444895 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb3b0158bf0 con 0x7fb3b01f5870 2024-09-17T05:26:36.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.599+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]} v 0) -- 0x7fb3b015ddb0 con 0x7fb3b01f5870 2024-09-17T05:26:36.920 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.920+0000 7fb397fff640 1 -- 172.21.15.81:0/4049444895 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_volumes.TestMisc.test_unparseable_metafile_on_legacy_to_v1_upgrade"]}]=0 v436) ==== 163+0+0 (secure 0 0 0) 0x7fb3a8082670 con 0x7fb3b01f5870 2024-09-17T05:26:36.923 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb39c079760 msgr2=0x7fb39c07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb39c079760 0x7fb39c07bc20 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fb3a0006630 tx=0x7fb3a0003ba0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b01f5870 msgr2=0x7fb3b01f5cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b01f5870 0x7fb3b01f5cf0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7fb3a802b130 tx=0x7fb3a8006670 comp rx=0 tx=0).stop 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 shutdown_connections 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb3b01f5870 0x7fb3b01f5cf0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb3b0158230 0x7fb3b01586b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb39c079760 0x7fb39c07bc20 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 --2- 172.21.15.81:0/4049444895 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb398004d40 0x7fb3b01ef6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 >> 172.21.15.81:0/4049444895 conn(0x7fb3b006cf60 msgr2=0x7fb3b00b1610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:36.924 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 shutdown_connections 2024-09-17T05:26:36.925 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:36.922+0000 7fb3b5efe640 1 -- 172.21.15.81:0/4049444895 wait complete. 2024-09-17T05:26:36.935 INFO:tasks.cephfs_test_runner:Validate unparseable text .meta file on legacy subvol root doesn't break the system ... ok 2024-09-17T05:26:36.935 INFO:tasks.cephfs_test_runner: 2024-09-17T05:26:36.936 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2024-09-17T05:26:36.936 INFO:tasks.cephfs_test_runner:Ran 11 tests in 447.491s 2024-09-17T05:26:36.936 INFO:tasks.cephfs_test_runner: 2024-09-17T05:26:36.936 INFO:tasks.cephfs_test_runner:OK 2024-09-17T05:26:36.936 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2024-09-17T05:26:36.945 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-17T05:26:36.953 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-17T05:26:36.953 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:36.954 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:36.969 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:26:36.970 DEBUG:teuthology.orchestra.run.smithi081:> set -ex 2024-09-17T05:26:36.970 DEBUG:teuthology.orchestra.run.smithi081:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:37.026 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056023,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1225 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497456k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2024-09-17T05:26:37.026 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:37.026 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:37.045 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:26:37.046 DEBUG:teuthology.orchestra.run.smithi160:> set -ex 2024-09-17T05:26:37.046 DEBUG:teuthology.orchestra.run.smithi160:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-17T05:26:37.104 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056026,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=18570 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248728k,nr_inodes=812182,mode=700,uid=1000,gid=1333,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497460k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2024-09-17T05:26:37.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.105 DEBUG:teuthology.orchestra.run.smithi081:> ip netns list 2024-09-17T05:26:37.120 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2024-09-17T05:26:37.120 INFO:teuthology.orchestra.run.smithi081.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-17T05:26:37.120 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.120 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2024-09-17T05:26:37.184 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.185 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-17T05:26:37.250 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.250 DEBUG:teuthology.orchestra.run.smithi081:> sudo ip link delete ceph-brx 2024-09-17T05:26:37.348 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.348 DEBUG:teuthology.orchestra.run.smithi160:> ip netns list 2024-09-17T05:26:37.367 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2024-09-17T05:26:37.367 INFO:teuthology.orchestra.run.smithi160.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-09-17T05:26:37.367 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.368 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2024-09-17T05:26:37.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.437 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-09-17T05:26:37.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-17T05:26:37.506 DEBUG:teuthology.orchestra.run.smithi160:> sudo ip link delete ceph-brx 2024-09-17T05:26:37.611 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-17T05:26:37.620 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-17T05:26:37.620 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:26:37.723 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 -- 172.21.15.81:0/1662188822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 msgr2=0x7f78640b4690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1662188822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78640b4690 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f78640b26e0 tx=0x7f785402a510 comp rx=0 tx=0).stop 2024-09-17T05:26:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 -- 172.21.15.81:0/1662188822 shutdown_connections 2024-09-17T05:26:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1662188822 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f7864070690 0x7f78640739d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1662188822 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78640b4690 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 -- 172.21.15.81:0/1662188822 >> 172.21.15.81:0/1662188822 conn(0x7f78640b1690 msgr2=0x7f78640b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 -- 172.21.15.81:0/1662188822 shutdown_connections 2024-09-17T05:26:37.724 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.722+0000 7f786c5c6640 1 -- 172.21.15.81:0/1662188822 wait complete. 2024-09-17T05:26:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 Processor -- start 2024-09-17T05:26:37.725 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 -- start start 2024-09-17T05:26:37.726 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7864070690 0x7f78640cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78640735a0 0x7f78640c5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78641e51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f78640cd270 con 0x7f786415aa70 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f78640cd0f0 con 0x7f7864070690 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786c5c6640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f78640cd3f0 con 0x7f78640735a0 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786ab63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78641e51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786ab63640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78641e51e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55726/0 (socket says 172.21.15.81:55726) 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786ab63640 1 -- 172.21.15.81:0/1756251271 learned_addr learned my addr 172.21.15.81:0/1756251271 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f786a362640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7864070690 0x7f78640cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.724+0000 7f7869b61640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78640735a0 0x7f78640c5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786ab63640 1 -- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78640735a0 msgr2=0x7f78640c5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786ab63640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78640735a0 0x7f78640c5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.727 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786ab63640 1 -- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7864070690 msgr2=0x7f78640cb600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786ab63640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7864070690 0x7f78640cb600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786ab63640 1 -- 172.21.15.81:0/1756251271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7864155a20 con 0x7f786415aa70 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786ab63640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78641e51e0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f785c00d750 tx=0x7f785c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f7862ffd640 1 -- 172.21.15.81:0/1756251271 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c017070 con 0x7f786415aa70 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f7862ffd640 1 -- 172.21.15.81:0/1756251271 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f785c005330 con 0x7f786415aa70 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f78641e5d50 con 0x7f786415aa70 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f7862ffd640 1 -- 172.21.15.81:0/1756251271 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f785c0097c0 con 0x7f786415aa70 2024-09-17T05:26:37.728 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.725+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f78640c4b50 con 0x7f786415aa70 2024-09-17T05:26:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.726+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f78640cd990 con 0x7f786415aa70 2024-09-17T05:26:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.727+0000 7f7862ffd640 1 -- 172.21.15.81:0/1756251271 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f785c009960 con 0x7f786415aa70 2024-09-17T05:26:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.727+0000 7f7862ffd640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7850079760 0x7f785007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.727+0000 7f786a362640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7850079760 0x7f785007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.727+0000 7f7862ffd640 1 -- 172.21.15.81:0/1756251271 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f785c0998e0 con 0x7f786415aa70 2024-09-17T05:26:37.729 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.728+0000 7f786a362640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7850079760 0x7f785007bc20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7854033000 tx=0x7f7854004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:37.732 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.732+0000 7f7862ffd640 1 -- 172.21.15.81:0/1756251271 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f785c062f10 con 0x7f786415aa70 2024-09-17T05:26:37.906 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.905+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f786415dbf0 con 0x7f7850079760 2024-09-17T05:26:37.907 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.906+0000 7f7862ffd640 1 -- 172.21.15.81:0/1756251271 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13427 (secure 0 0 0) 0x7f786415dbf0 con 0x7f7850079760 2024-09-17T05:26:37.907 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:37.908 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7850079760 msgr2=0x7f785007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7850079760 0x7f785007bc20 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f7854033000 tx=0x7f7854004730 comp rx=0 tx=0).stop 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 msgr2=0x7f78641e51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78641e51e0 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7f785c00d750 tx=0x7f785c00dc10 comp rx=0 tx=0).stop 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 shutdown_connections 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f786415aa70 0x7f78641e51e0 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f78640735a0 0x7f78640c5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f7850079760 0x7f785007bc20 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.910 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 --2- 172.21.15.81:0/1756251271 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f7864070690 0x7f78640cb600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 >> 172.21.15.81:0/1756251271 conn(0x7f78640b1690 msgr2=0x7f78640cbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 shutdown_connections 2024-09-17T05:26:37.911 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:37.908+0000 7f786c5c6640 1 -- 172.21.15.81:0/1756251271 wait complete. 2024-09-17T05:26:37.920 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":213,"stamp":"2024-09-17T05:26:36.067325+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271024,"kb_used_data":17360,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703696,"statfs":{"total":773094113280,"available":772816584704,"internally_reserved":0,"allocated":17776640,"data_stored":8546238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53146,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-71,"num_write_kb":-78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001068"},"pg_stats":[{"pgid":"1.0","version":"72'79","reported_seq":391,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:26:33.130202+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:26:33.130202+0000","last_peered":"2024-09-17T05:26:33.130202+0000","last_clean":"2024-09-17T05:26:33.130202+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:26:33.130202+0000","last_undegraded":"2024-09-17T05:26:33.130202+0000","last_fullsized":"2024-09-17T05:26:33.130202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33832,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338008,"statfs":{"total":96636764160,"available":96602120192,"internally_reserved":0,"allocated":2707456,"data_stored":1550031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":908214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2056192,"data_stored":907911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2125824,"data_stored":960070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2064384,"data_stored":907511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2052096,"data_stored":907329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":907385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37936,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333904,"statfs":{"total":96636764160,"available":96597917696,"internally_reserved":0,"allocated":2650112,"data_stored":1497787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:26:37.920 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:26:38.021 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.020+0000 7feafe382640 1 -- 172.21.15.81:0/330443509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 msgr2=0x7feaf80cf9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.020+0000 7feafe382640 1 --2- 172.21.15.81:0/330443509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf80cf9b0 secure :-1 s=READY pgs=1936 cs=0 l=1 rev1=1 crypto rx=0x7feaf0005fd0 tx=0x7feaf002ab40 comp rx=0 tx=0).stop 2024-09-17T05:26:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.020+0000 7feafe382640 1 -- 172.21.15.81:0/330443509 shutdown_connections 2024-09-17T05:26:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.020+0000 7feafe382640 1 --2- 172.21.15.81:0/330443509 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf80cf9b0 unknown :-1 s=CLOSED pgs=1936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.020+0000 7feafe382640 1 -- 172.21.15.81:0/330443509 >> 172.21.15.81:0/330443509 conn(0x7feaf80d3ea0 msgr2=0x7feaf80d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.020+0000 7feafe382640 1 -- 172.21.15.81:0/330443509 shutdown_connections 2024-09-17T05:26:38.022 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.020+0000 7feafe382640 1 -- 172.21.15.81:0/330443509 wait complete. 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.021+0000 7feafe382640 1 Processor -- start 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feafe382640 1 -- start start 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feafe382640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf80d0d40 0x7feaf80a1650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feafe382640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf815ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feafe382640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf815df90 0x7feaf80cd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feafe382640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7feaf80b3f10 con 0x7feaf80d49c0 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feafe382640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7feaf8162710 con 0x7feaf80d0d40 2024-09-17T05:26:38.025 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feafe382640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7feaf80b4090 con 0x7feaf815df90 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf815ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feaf77fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf815ffd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55746/0 (socket says 172.21.15.81:55746) 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feaf77fe640 1 -- 172.21.15.81:0/3331972137 learned_addr learned my addr 172.21.15.81:0/3331972137 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.022+0000 7feaf7fff640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf80d0d40 0x7feaf80a1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feafc91f640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf815df90 0x7feaf80cd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf77fe640 1 -- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf815df90 msgr2=0x7feaf80cd6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf77fe640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf815df90 0x7feaf80cd6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf77fe640 1 -- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf80d0d40 msgr2=0x7feaf80a1650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf77fe640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf80d0d40 0x7feaf80a1650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.026 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf77fe640 1 -- 172.21.15.81:0/3331972137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feaf8160a20 con 0x7feaf80d49c0 2024-09-17T05:26:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf77fe640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf815ffd0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7feaec00c420 tx=0x7feaec00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf4ff9640 1 -- 172.21.15.81:0/3331972137 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec0052d0 con 0x7feaf80d49c0 2024-09-17T05:26:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf4ff9640 1 -- 172.21.15.81:0/3331972137 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7feaec007020 con 0x7feaf80d49c0 2024-09-17T05:26:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feaf8160d00 con 0x7feaf80d49c0 2024-09-17T05:26:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feaf4ff9640 1 -- 172.21.15.81:0/3331972137 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feaec007470 con 0x7feaf80d49c0 2024-09-17T05:26:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.023+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feaf814df60 con 0x7feaf80d49c0 2024-09-17T05:26:38.027 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.024+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feaf80cf9b0 con 0x7feaf80d49c0 2024-09-17T05:26:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.025+0000 7feaf4ff9640 1 -- 172.21.15.81:0/3331972137 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7feaec0067d0 con 0x7feaf80d49c0 2024-09-17T05:26:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.025+0000 7feaf4ff9640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feae4079760 0x7feae407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.025+0000 7feaf7fff640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feae4079760 0x7feae407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.025+0000 7feaf4ff9640 1 -- 172.21.15.81:0/3331972137 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7feaec098d90 con 0x7feaf80d49c0 2024-09-17T05:26:38.028 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.025+0000 7feaf7fff640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feae4079760 0x7feae407bc20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7feae8000f60 tx=0x7feae8009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:38.030 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.029+0000 7feaf4ff9640 1 -- 172.21.15.81:0/3331972137 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7feaec062ab0 con 0x7feaf80d49c0 2024-09-17T05:26:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.202+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feaf808d590 con 0x7feae4079760 2024-09-17T05:26:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.203+0000 7feaf4ff9640 1 -- 172.21.15.81:0/3331972137 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13427 (secure 0 0 0) 0x7feaf808d590 con 0x7feae4079760 2024-09-17T05:26:38.204 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:38.204 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:26:38.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feae4079760 msgr2=0x7feae407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feae4079760 0x7feae407bc20 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7feae8000f60 tx=0x7feae8009040 comp rx=0 tx=0).stop 2024-09-17T05:26:38.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 msgr2=0x7feaf815ffd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.206 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf815ffd0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7feaec00c420 tx=0x7feaec00c8e0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 shutdown_connections 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7feaf815df90 0x7feaf80cd6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7feaf80d49c0 0x7feaf815ffd0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7feae4079760 0x7feae407bc20 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 --2- 172.21.15.81:0/3331972137 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7feaf80d0d40 0x7feaf80a1650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 >> 172.21.15.81:0/3331972137 conn(0x7feaf80d3ea0 msgr2=0x7feaf80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 shutdown_connections 2024-09-17T05:26:38.207 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.205+0000 7feafe382640 1 -- 172.21.15.81:0/3331972137 wait complete. 2024-09-17T05:26:38.217 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-17T05:26:38.067603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271024,"kb_used_data":17360,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703696,"statfs":{"total":773094113280,"available":772816584704,"internally_reserved":0,"allocated":17776640,"data_stored":8546238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53146,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-71,"num_write_kb":-78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000901"},"pg_stats":[{"pgid":"1.0","version":"72'79","reported_seq":391,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:26:33.130202+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:26:33.130202+0000","last_peered":"2024-09-17T05:26:33.130202+0000","last_clean":"2024-09-17T05:26:33.130202+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:26:33.130202+0000","last_undegraded":"2024-09-17T05:26:33.130202+0000","last_fullsized":"2024-09-17T05:26:33.130202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33832,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338008,"statfs":{"total":96636764160,"available":96602120192,"internally_reserved":0,"allocated":2707456,"data_stored":1550031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":908214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2056192,"data_stored":907911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2125824,"data_stored":960070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2064384,"data_stored":907511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2052096,"data_stored":907329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":907385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37936,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333904,"statfs":{"total":96636764160,"available":96597917696,"internally_reserved":0,"allocated":2650112,"data_stored":1497787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:26:38.217 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-17T05:26:38.218 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:26:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 -- 172.21.15.81:0/3474679558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f40d49c0 msgr2=0x7f89f40d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 --2- 172.21.15.81:0/3474679558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f40d49c0 0x7f89f40d0630 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f89f408cf10 tx=0x7f89e802a560 comp rx=0 tx=0).stop 2024-09-17T05:26:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 -- 172.21.15.81:0/3474679558 shutdown_connections 2024-09-17T05:26:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 --2- 172.21.15.81:0/3474679558 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f4162480 0x7f89f40d0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 --2- 172.21.15.81:0/3474679558 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f40d49c0 0x7f89f40d0630 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 --2- 172.21.15.81:0/3474679558 >> v2:172.21.15.160:3300/0 conn(0x7f89f415df90 0x7f89f40cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 -- 172.21.15.81:0/3474679558 >> 172.21.15.81:0/3474679558 conn(0x7f89f40d3ea0 msgr2=0x7f89f40d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 -- 172.21.15.81:0/3474679558 shutdown_connections 2024-09-17T05:26:38.320 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.317+0000 7f89fb95d640 1 -- 172.21.15.81:0/3474679558 wait complete. 2024-09-17T05:26:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.318+0000 7f89fb95d640 1 Processor -- start 2024-09-17T05:26:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89fb95d640 1 -- start start 2024-09-17T05:26:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89fb95d640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f40d49c0 0x7f89f41f7670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89fb95d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f415df90 0x7f89f40b9280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.322 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89fb95d640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f4162480 0x7f89f40b97c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89fb95d640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40b3b90 con 0x7f89f415df90 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89fb95d640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f89f40b3a10 con 0x7f89f4162480 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89fb95d640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f89f40b3d10 con 0x7f89f40d49c0 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89f8ef8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f415df90 0x7f89f40b9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89f8ef8640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f415df90 0x7f89f40b9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55770/0 (socket says 172.21.15.81:55770) 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.319+0000 7f89f8ef8640 1 -- 172.21.15.81:0/4085035881 learned_addr learned my addr 172.21.15.81:0/4085035881 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f96f9640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f40d49c0 0x7f89f41f7670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f9efa640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f4162480 0x7f89f40b97c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f8ef8640 1 -- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f40d49c0 msgr2=0x7f89f41f7670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f8ef8640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f40d49c0 0x7f89f41f7670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f8ef8640 1 -- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f4162480 msgr2=0x7f89f40b97c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f8ef8640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f4162480 0x7f89f40b97c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.323 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f8ef8640 1 -- 172.21.15.81:0/4085035881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89f41f4a40 con 0x7f89f415df90 2024-09-17T05:26:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f8ef8640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f415df90 0x7f89f40b9280 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f89e80099c0 tx=0x7f89e80038a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f1ffb640 1 -- 172.21.15.81:0/4085035881 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e803f070 con 0x7f89f415df90 2024-09-17T05:26:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f1ffb640 1 -- 172.21.15.81:0/4085035881 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f89e80047a0 con 0x7f89f415df90 2024-09-17T05:26:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89f41f4d20 con 0x7f89f415df90 2024-09-17T05:26:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89f1ffb640 1 -- 172.21.15.81:0/4085035881 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89e8035030 con 0x7f89f415df90 2024-09-17T05:26:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.320+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89f41f4730 con 0x7f89f415df90 2024-09-17T05:26:38.324 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.321+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89f40cc290 con 0x7f89f415df90 2024-09-17T05:26:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.322+0000 7f89f1ffb640 1 -- 172.21.15.81:0/4085035881 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f89e8042070 con 0x7f89f415df90 2024-09-17T05:26:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.322+0000 7f89f1ffb640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f89e0079790 0x7f89e007bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.322+0000 7f89f1ffb640 1 -- 172.21.15.81:0/4085035881 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f89e80ba4d0 con 0x7f89f415df90 2024-09-17T05:26:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.322+0000 7f89f96f9640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f89e0079790 0x7f89e007bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.325 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.323+0000 7f89f96f9640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f89e0079790 0x7f89e007bc50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f89f40b2e50 tx=0x7f89e4009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:38.328 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.327+0000 7f89f1ffb640 1 -- 172.21.15.81:0/4085035881 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f89e8083ba0 con 0x7f89f415df90 2024-09-17T05:26:38.499 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.498+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f89f408d590 con 0x7f89e0079790 2024-09-17T05:26:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.499+0000 7f89f1ffb640 1 -- 172.21.15.81:0/4085035881 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13427 (secure 0 0 0) 0x7f89f408d590 con 0x7f89e0079790 2024-09-17T05:26:38.500 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:38.500 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:26:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f89e0079790 msgr2=0x7f89e007bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f89e0079790 0x7f89e007bc50 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f89f40b2e50 tx=0x7f89e4009500 comp rx=0 tx=0).stop 2024-09-17T05:26:38.502 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f415df90 msgr2=0x7f89f40b9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f415df90 0x7f89f40b9280 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f89e80099c0 tx=0x7f89e80038a0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 shutdown_connections 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f89e0079790 0x7f89e007bc50 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f89f4162480 0x7f89f40b97c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f89f415df90 0x7f89f40b9280 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 --2- 172.21.15.81:0/4085035881 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f89f40d49c0 0x7f89f41f7670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 >> 172.21.15.81:0/4085035881 conn(0x7f89f40d3ea0 msgr2=0x7f89f40b41e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 shutdown_connections 2024-09-17T05:26:38.503 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.501+0000 7f89fb95d640 1 -- 172.21.15.81:0/4085035881 wait complete. 2024-09-17T05:26:38.513 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":214,"stamp":"2024-09-17T05:26:38.067603+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":271024,"kb_used_data":17360,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703696,"statfs":{"total":773094113280,"available":772816584704,"internally_reserved":0,"allocated":17776640,"data_stored":8546238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53146,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-71,"num_write_kb":-78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.000901"},"pg_stats":[{"pgid":"1.0","version":"72'79","reported_seq":391,"reported_epoch":163,"state":"active+clean","last_fresh":"2024-09-17T05:26:33.130202+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:26:33.130202+0000","last_peered":"2024-09-17T05:26:33.130202+0000","last_clean":"2024-09-17T05:26:33.130202+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:26:33.130202+0000","last_undegraded":"2024-09-17T05:26:33.130202+0000","last_fullsized":"2024-09-17T05:26:33.130202+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509540,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33832,"kb_used_data":2644,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338008,"statfs":{"total":96636764160,"available":96602120192,"internally_reserved":0,"allocated":2707456,"data_stored":1550031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509540,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":908214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509539,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33196,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338644,"statfs":{"total":96636764160,"available":96602771456,"internally_reserved":0,"allocated":2056192,"data_stored":907911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509539,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33264,"kb_used_data":2076,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338576,"statfs":{"total":96636764160,"available":96602701824,"internally_reserved":0,"allocated":2125824,"data_stored":960070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509539,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33204,"kb_used_data":2016,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338636,"statfs":{"total":96636764160,"available":96602763264,"internally_reserved":0,"allocated":2064384,"data_stored":907511,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509540,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33192,"kb_used_data":2004,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338648,"statfs":{"total":96636764160,"available":96602775552,"internally_reserved":0,"allocated":2052096,"data_stored":907329,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509539,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33200,"kb_used_data":2012,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338640,"statfs":{"total":96636764160,"available":96602767360,"internally_reserved":0,"allocated":2060288,"data_stored":907385,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574948,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37936,"kb_used_data":2588,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333904,"statfs":{"total":96636764160,"available":96597917696,"internally_reserved":0,"allocated":2650112,"data_stored":1497787,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:26:38.514 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-17T05:26:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.614+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/3149168124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 msgr2=0x7f0e64003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.614+0000 7f0e7d3a2640 1 --2- 172.21.15.81:0/3149168124 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 0x7f0e64003e20 secure :-1 s=READY pgs=1941 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009b50 tx=0x7f0e64005830 comp rx=0 tx=0).stop 2024-09-17T05:26:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.614+0000 7f0e777fe640 1 -- 172.21.15.81:0/3149168124 reap_dead start 2024-09-17T05:26:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.614+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/3149168124 shutdown_connections 2024-09-17T05:26:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.614+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/3149168124 >> 172.21.15.81:0/3149168124 conn(0x7f0e780d3ea0 msgr2=0x7f0e780d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.614+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/3149168124 shutdown_connections 2024-09-17T05:26:38.615 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.614+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/3149168124 wait complete. 2024-09-17T05:26:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.615+0000 7f0e7d3a2640 1 Processor -- start 2024-09-17T05:26:38.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.615+0000 7f0e7d3a2640 1 -- start start 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e7d3a2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 0x7f0e780c9dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e7d3a2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e7814b850 0x7f0e780b1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e7d3a2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e780b24c0 0x7f0e781f82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e7d3a2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0e780b42a0 con 0x7f0e64003a00 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e7d3a2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0e780b4120 con 0x7f0e780b24c0 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e7d3a2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0e780b4420 con 0x7f0e7814b850 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 0x7f0e780c9dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.618 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 0x7f0e780c9dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55780/0 (socket says 172.21.15.81:55780) 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 -- 172.21.15.81:0/4062315793 learned_addr learned my addr 172.21.15.81:0/4062315793 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e767fc640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e7814b850 0x7f0e780b1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e777fe640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e780b24c0 0x7f0e781f82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 -- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e7814b850 msgr2=0x7f0e780b1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e7814b850 0x7f0e780b1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 -- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e780b24c0 msgr2=0x7f0e781f82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e780b24c0 0x7f0e781f82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 -- 172.21.15.81:0/4062315793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e780b8180 con 0x7f0e64003a00 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e76ffd640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 0x7f0e780c9dc0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009a70 tx=0x7f0e700336d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/4062315793 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70043070 con 0x7f0e64003a00 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/4062315793 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0e70004030 con 0x7f0e64003a00 2024-09-17T05:26:38.619 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/4062315793 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e70038040 con 0x7f0e64003a00 2024-09-17T05:26:38.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.616+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e780b8460 con 0x7f0e64003a00 2024-09-17T05:26:38.620 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.617+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e780b8a20 con 0x7f0e64003a00 2024-09-17T05:26:38.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.617+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0e780cf9b0 con 0x7f0e64003a00 2024-09-17T05:26:38.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.618+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/4062315793 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f0e70046070 con 0x7f0e64003a00 2024-09-17T05:26:38.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.618+0000 7f0e6f7fe640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e58079760 0x7f0e5807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:38.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.619+0000 7f0e767fc640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e58079760 0x7f0e5807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:38.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.619+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/4062315793 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f0e700b9ac0 con 0x7f0e64003a00 2024-09-17T05:26:38.621 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.619+0000 7f0e767fc640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e58079760 0x7f0e5807bc20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0e780ce410 tx=0x7f0e60005f90 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:38.624 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.623+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/4062315793 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0e70083190 con 0x7f0e64003a00 2024-09-17T05:26:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.802+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0e780b28a0 con 0x7f0e64003a00 2024-09-17T05:26:38.804 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.803+0000 7f0e6f7fe640 1 -- 172.21.15.81:0/4062315793 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) ==== 74+0+13154 (secure 0 0 0) 0x7f0e70087bc0 con 0x7f0e64003a00 2024-09-17T05:26:38.804 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:38.805 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":165,"fsid":"c4ef6ecb-6242-426c-8fbd-acb002cef223","created":"2024-09-17T05:18:23.002813+0000","modified":"2024-09-17T05:26:35.906349+0000","last_up_change":"2024-09-17T05:18:36.067642+0000","last_in_change":"2024-09-17T05:18:26.053020+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":27,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-17T05:18:37.391103+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"608b7932-3897-4a57-bf7a-7c872d5ac824","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6800","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6801","nonce":3882197778}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6802","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6803","nonce":3882197778}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6806","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6807","nonce":3882197778}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6804","nonce":3882197778},{"type":"v1","addr":"172.21.15.81:6805","nonce":3882197778}]},"public_addr":"172.21.15.81:6801/3882197778","cluster_addr":"172.21.15.81:6803/3882197778","heartbeat_back_addr":"172.21.15.81:6807/3882197778","heartbeat_front_addr":"172.21.15.81:6805/3882197778","state":["exists","up"]},{"osd":1,"uuid":"953bb0fd-b21c-4570-b481-7701ef72e0a4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6816","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6817","nonce":2009991076}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6818","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6819","nonce":2009991076}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6822","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6823","nonce":2009991076}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6820","nonce":2009991076},{"type":"v1","addr":"172.21.15.81:6821","nonce":2009991076}]},"public_addr":"172.21.15.81:6817/2009991076","cluster_addr":"172.21.15.81:6819/2009991076","heartbeat_back_addr":"172.21.15.81:6823/2009991076","heartbeat_front_addr":"172.21.15.81:6821/2009991076","state":["exists","up"]},{"osd":2,"uuid":"13bfb47c-2b02-485d-aa37-c01ea54a6f93","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6824","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6825","nonce":2317076562}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6826","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6827","nonce":2317076562}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6830","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6831","nonce":2317076562}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6828","nonce":2317076562},{"type":"v1","addr":"172.21.15.81:6829","nonce":2317076562}]},"public_addr":"172.21.15.81:6825/2317076562","cluster_addr":"172.21.15.81:6827/2317076562","heartbeat_back_addr":"172.21.15.81:6831/2317076562","heartbeat_front_addr":"172.21.15.81:6829/2317076562","state":["exists","up"]},{"osd":3,"uuid":"a375dbfa-27fa-4716-a62b-bb5bc263ea28","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6808","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6809","nonce":437732864}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6810","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6811","nonce":437732864}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6814","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6815","nonce":437732864}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6812","nonce":437732864},{"type":"v1","addr":"172.21.15.81:6813","nonce":437732864}]},"public_addr":"172.21.15.81:6809/437732864","cluster_addr":"172.21.15.81:6811/437732864","heartbeat_back_addr":"172.21.15.81:6815/437732864","heartbeat_front_addr":"172.21.15.81:6813/437732864","state":["exists","up"]},{"osd":4,"uuid":"a812afb1-8cb9-4bcb-8a02-0aa95a036d39","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6826","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6827","nonce":3841431636}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6828","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6829","nonce":3841431636}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6832","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6833","nonce":3841431636}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6830","nonce":3841431636},{"type":"v1","addr":"172.21.15.160:6831","nonce":3841431636}]},"public_addr":"172.21.15.160:6827/3841431636","cluster_addr":"172.21.15.160:6829/3841431636","heartbeat_back_addr":"172.21.15.160:6833/3841431636","heartbeat_front_addr":"172.21.15.160:6831/3841431636","state":["exists","up"]},{"osd":5,"uuid":"0b3efa63-2f52-42be-8e50-f1e229482472","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6810","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6811","nonce":598189389}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6812","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6813","nonce":598189389}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6816","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6817","nonce":598189389}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6814","nonce":598189389},{"type":"v1","addr":"172.21.15.160:6815","nonce":598189389}]},"public_addr":"172.21.15.160:6811/598189389","cluster_addr":"172.21.15.160:6813/598189389","heartbeat_back_addr":"172.21.15.160:6817/598189389","heartbeat_front_addr":"172.21.15.160:6815/598189389","state":["exists","up"]},{"osd":6,"uuid":"60aebdf2-4dbf-428d-953c-a11612818cae","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6818","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6819","nonce":4274770585}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6820","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6821","nonce":4274770585}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6824","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6825","nonce":4274770585}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6822","nonce":4274770585},{"type":"v1","addr":"172.21.15.160:6823","nonce":4274770585}]},"public_addr":"172.21.15.160:6819/4274770585","cluster_addr":"172.21.15.160:6821/4274770585","heartbeat_back_addr":"172.21.15.160:6825/4274770585","heartbeat_front_addr":"172.21.15.160:6823/4274770585","state":["exists","up"]},{"osd":7,"uuid":"5fe8bdbb-1ea2-4f83-ba72-d8f9156f5563","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":15,"up_thru":160,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6802","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6803","nonce":2017118510}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6804","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6805","nonce":2017118510}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6808","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6809","nonce":2017118510}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6806","nonce":2017118510},{"type":"v1","addr":"172.21.15.160:6807","nonce":2017118510}]},"public_addr":"172.21.15.160:6803/2017118510","cluster_addr":"172.21.15.160:6805/2017118510","heartbeat_back_addr":"172.21.15.160:6809/2017118510","heartbeat_front_addr":"172.21.15.160:6807/2017118510","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:31.602607+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.855558+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.838611+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.596860+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.691280+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.909741+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:32.656554+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-17T05:18:33.119679+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.81:6835/2091743317":"2024-09-18T05:26:32.780757+0000","172.21.15.81:6833/2091743317":"2024-09-18T05:26:32.780757+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":17,"snaps":[{"begin":2,"length":1},{"begin":5,"length":1}]},{"pool":19,"snaps":[{"begin":2,"length":4}]}],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.805+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e58079760 msgr2=0x7f0e5807bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.805+0000 7f0e7d3a2640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e58079760 0x7f0e5807bc20 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f0e780ce410 tx=0x7f0e60005f90 comp rx=0 tx=0).stop 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.805+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 msgr2=0x7f0e780c9dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.805+0000 7f0e7d3a2640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 0x7f0e780c9dc0 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7f0e70009a70 tx=0x7f0e700336d0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 shutdown_connections 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0e58079760 0x7f0e5807bc20 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0e780b24c0 0x7f0e781f82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0e7814b850 0x7f0e780b1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 --2- 172.21.15.81:0/4062315793 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0e64003a00 0x7f0e780c9dc0 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:38.807 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 >> 172.21.15.81:0/4062315793 conn(0x7f0e780d3ea0 msgr2=0x7f0e780b0a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 shutdown_connections 2024-09-17T05:26:38.808 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:38.806+0000 7f0e7d3a2640 1 -- 172.21.15.81:0/4062315793 wait complete. 2024-09-17T05:26:39.819 INFO:tasks.ceph:Scrubbing osd.0 2024-09-17T05:26:39.819 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:39.936 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 -- 172.21.15.81:0/647933166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0a1c30 msgr2=0x7fd6ec073d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 --2- 172.21.15.81:0/647933166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0a1c30 0x7fd6ec073d80 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec076040 tx=0x7fd6d402a560 comp rx=0 tx=0).stop 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 -- 172.21.15.81:0/647933166 shutdown_connections 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 --2- 172.21.15.81:0/647933166 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6ec0742c0 0x7fd6ec06cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 --2- 172.21.15.81:0/647933166 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0a1c30 0x7fd6ec073d80 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 --2- 172.21.15.81:0/647933166 >> v2:172.21.15.160:3300/0 conn(0x7fd6ec15bca0 0x7fd6ec0cb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 -- 172.21.15.81:0/647933166 >> 172.21.15.81:0/647933166 conn(0x7fd6ec0d0b20 msgr2=0x7fd6ec0d0f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 -- 172.21.15.81:0/647933166 shutdown_connections 2024-09-17T05:26:39.937 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.935+0000 7fd6f1870640 1 -- 172.21.15.81:0/647933166 wait complete. 2024-09-17T05:26:39.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.937+0000 7fd6f1870640 1 Processor -- start 2024-09-17T05:26:39.938 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.937+0000 7fd6f1870640 1 -- start start 2024-09-17T05:26:39.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.937+0000 7fd6f1870640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0742c0 0x7fd6ec155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:39.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6f1870640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6ec0a1c30 0x7fd6ec1e8930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:39.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6f1870640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6ec15bca0 0x7fd6ec0b5e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:39.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6f1870640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec0cb830 con 0x7fd6ec0742c0 2024-09-17T05:26:39.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6f1870640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd6ec0cb6b0 con 0x7fd6ec15bca0 2024-09-17T05:26:39.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6f1870640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd6ec06d080 con 0x7fd6ec0a1c30 2024-09-17T05:26:39.940 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0742c0 0x7fd6ec155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0742c0 0x7fd6ec155520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55812/0 (socket says 172.21.15.81:55812) 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 -- 172.21.15.81:0/2459013313 learned_addr learned my addr 172.21.15.81:0/2459013313 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6e27fc640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6ec0a1c30 0x7fd6ec1e8930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eb7fe640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6ec15bca0 0x7fd6ec0b5e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 -- 172.21.15.81:0/2459013313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6ec0a1c30 msgr2=0x7fd6ec1e8930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6ec0a1c30 0x7fd6ec1e8930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 -- 172.21.15.81:0/2459013313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6ec15bca0 msgr2=0x7fd6ec0b5e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd6ec15bca0 0x7fd6ec0b5e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 -- 172.21.15.81:0/2459013313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6ec0c4b20 con 0x7fd6ec0742c0 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6e27fc640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd6ec0a1c30 0x7fd6ec1e8930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6eaffd640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0742c0 0x7fd6ec155520 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00e790 tx=0x7fd6dc00ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:39.941 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc00eea0 con 0x7fd6ec0742c0 2024-09-17T05:26:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd6dc00cdb0 con 0x7fd6ec0742c0 2024-09-17T05:26:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc010690 con 0x7fd6ec0742c0 2024-09-17T05:26:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6ec0d0700 con 0x7fd6ec0742c0 2024-09-17T05:26:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.938+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6ec0c50a0 con 0x7fd6ec0742c0 2024-09-17T05:26:39.942 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.939+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd6ec073d80 con 0x7fd6ec0742c0 2024-09-17T05:26:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.940+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fd6dc010830 con 0x7fd6ec0742c0 2024-09-17T05:26:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.940+0000 7fd6e8ff9640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd6cc079760 0x7fd6cc07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6e27fc640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd6cc079760 0x7fd6cc07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:39.943 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fd6dc09ac50 con 0x7fd6ec0742c0 2024-09-17T05:26:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6e8ff9640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7fd6cc07f650 0x7fd6cc081a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 --> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd6dc01bec0 con 0x7fd6cc07f650 2024-09-17T05:26:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7fd6dc09da00 con 0x7fd6ec0742c0 2024-09-17T05:26:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6eb7fe640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7fd6cc07f650 0x7fd6cc081a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6e27fc640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd6cc079760 0x7fd6cc07bc20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4033000 tx=0x7fd6d4004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.941+0000 7fd6eb7fe640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7fd6cc07f650 0x7fd6cc081a70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:39.944 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.942+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== osd.0 v2:172.21.15.81:6800/3882197778 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd6dc01bec0 con 0x7fd6cc07f650 2024-09-17T05:26:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.954+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 --> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd6ec0cd2d0 con 0x7fd6cc07f650 2024-09-17T05:26:39.955 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.954+0000 7fd6e8ff9640 1 -- 172.21.15.81:0/2459013313 <== osd.0 v2:172.21.15.81:6800/3882197778 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd6ec0cd2d0 con 0x7fd6cc07f650 2024-09-17T05:26:39.955 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:39.955 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:39.956 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:39.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7fd6cc07f650 msgr2=0x7fd6cc081a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6800/3882197778,v1:172.21.15.81:6801/3882197778] conn(0x7fd6cc07f650 0x7fd6cc081a70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd6cc079760 msgr2=0x7fd6cc07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd6cc079760 0x7fd6cc07bc20 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fd6d4033000 tx=0x7fd6d4004730 comp rx=0 tx=0).stop 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0742c0 msgr2=0x7fd6ec155520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 --2- 172.21.15.81:0/2459013313 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd6ec0742c0 0x7fd6ec155520 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00e790 tx=0x7fd6dc00ec50 comp rx=0 tx=0).stop 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6eb7fe640 1 -- 172.21.15.81:0/2459013313 reap_dead start 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 shutdown_connections 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 >> 172.21.15.81:0/2459013313 conn(0x7fd6ec0d0b20 msgr2=0x7fd6ec0c7cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 shutdown_connections 2024-09-17T05:26:39.957 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:39.955+0000 7fd6f1870640 1 -- 172.21.15.81:0/2459013313 wait complete. 2024-09-17T05:26:39.966 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.068+0000 7f6633c71640 1 -- 172.21.15.81:0/237304851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 msgr2=0x7f662c0ce240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.068+0000 7f6633c71640 1 --2- 172.21.15.81:0/237304851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0ce240 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7f662c0740e0 tx=0x7f661c02a5f0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.069+0000 7f6633c71640 1 -- 172.21.15.81:0/237304851 shutdown_connections 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.069+0000 7f6633c71640 1 --2- 172.21.15.81:0/237304851 >> v2:172.21.15.160:3300/0 conn(0x7f662c0ce780 0x7f662c0cbb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.069+0000 7f6633c71640 1 --2- 172.21.15.81:0/237304851 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0ce240 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.069+0000 7f6633c71640 1 -- 172.21.15.81:0/237304851 >> 172.21.15.81:0/237304851 conn(0x7f662c0741f0 msgr2=0x7f662c074600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.069+0000 7f6633c71640 1 -- 172.21.15.81:0/237304851 shutdown_connections 2024-09-17T05:26:40.070 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.069+0000 7f6633c71640 1 -- 172.21.15.81:0/237304851 wait complete. 2024-09-17T05:26:40.072 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 Processor -- start 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 -- start start 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f662c06f0b0 0x7f662c0d0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0d0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f662c0ce780 0x7f662c1f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f662c0cc0c0 con 0x7f662c0cd3e0 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f662c15e670 con 0x7f662c0ce780 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.070+0000 7f6633c71640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f662c0cc240 con 0x7f662c06f0b0 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0d0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0d0880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55818/0 (socket says 172.21.15.81:55818) 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 -- 172.21.15.81:0/4004342807 learned_addr learned my addr 172.21.15.81:0/4004342807 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:40.073 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f6631a0d640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f662c06f0b0 0x7f662c0d0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663220e640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f662c0ce780 0x7f662c1f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 -- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f662c06f0b0 msgr2=0x7f662c0d0340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f662c06f0b0 0x7f662c0d0340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 -- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f662c0ce780 msgr2=0x7f662c1f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f662c0ce780 0x7f662c1f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 -- 172.21.15.81:0/4004342807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f662c1f3400 con 0x7f662c0cd3e0 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f6631a0d640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f662c06f0b0 0x7f662c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663220e640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f662c0ce780 0x7f662c1f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f663120c640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0d0880 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f661c009850 tx=0x7f661c0039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f66227fc640 1 -- 172.21.15.81:0/4004342807 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c03f070 con 0x7f662c0cd3e0 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f66227fc640 1 -- 172.21.15.81:0/4004342807 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f661c004890 con 0x7f662c0cd3e0 2024-09-17T05:26:40.074 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f662c1f36e0 con 0x7f662c0cd3e0 2024-09-17T05:26:40.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f66227fc640 1 -- 172.21.15.81:0/4004342807 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f661c035030 con 0x7f662c0cd3e0 2024-09-17T05:26:40.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.071+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f662c1f3ca0 con 0x7f662c0cd3e0 2024-09-17T05:26:40.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.072+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f662c0cc6f0 con 0x7f662c0cd3e0 2024-09-17T05:26:40.075 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.073+0000 7f66227fc640 1 -- 172.21.15.81:0/4004342807 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f661c042070 con 0x7f662c0cd3e0 2024-09-17T05:26:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.073+0000 7f66227fc640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6610079760 0x7f661007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.074+0000 7f6631a0d640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6610079760 0x7f661007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.074+0000 7f66227fc640 1 -- 172.21.15.81:0/4004342807 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f661c0ba950 con 0x7f662c0cd3e0 2024-09-17T05:26:40.076 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.074+0000 7f6631a0d640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6610079760 0x7f661007bc20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6628001740 tx=0x7f6628009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.078 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.077+0000 7f66227fc640 1 -- 172.21.15.81:0/4004342807 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f661c084570 con 0x7f662c0cd3e0 2024-09-17T05:26:40.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.254+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f662c075070 con 0x7f6610079760 2024-09-17T05:26:40.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.255+0000 7f66227fc640 1 -- 172.21.15.81:0/4004342807 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f662c075070 con 0x7f6610079760 2024-09-17T05:26:40.256 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 0 to deep-scrub 2024-09-17T05:26:40.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6610079760 msgr2=0x7f661007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6610079760 0x7f661007bc20 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f6628001740 tx=0x7f6628009040 comp rx=0 tx=0).stop 2024-09-17T05:26:40.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 msgr2=0x7f662c0d0880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0d0880 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7f661c009850 tx=0x7f661c0039e0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 shutdown_connections 2024-09-17T05:26:40.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6610079760 0x7f661007bc20 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f662c0ce780 0x7f662c1f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f662c0cd3e0 0x7f662c0d0880 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 --2- 172.21.15.81:0/4004342807 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f662c06f0b0 0x7f662c0d0340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 >> 172.21.15.81:0/4004342807 conn(0x7f662c0741f0 msgr2=0x7f662c0cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 shutdown_connections 2024-09-17T05:26:40.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.257+0000 7f6633c71640 1 -- 172.21.15.81:0/4004342807 wait complete. 2024-09-17T05:26:40.269 INFO:tasks.ceph:Scrubbing osd.1 2024-09-17T05:26:40.269 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.373+0000 7f1976591640 1 -- 172.21.15.81:0/934928610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970073190 msgr2=0x7f197006fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.373+0000 7f1976591640 1 --2- 172.21.15.81:0/934928610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970073190 0x7f197006fe80 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7f1964005fd0 tx=0x7f196402a540 comp rx=0 tx=0).stop 2024-09-17T05:26:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.374+0000 7f1976591640 1 -- 172.21.15.81:0/934928610 shutdown_connections 2024-09-17T05:26:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.374+0000 7f1976591640 1 --2- 172.21.15.81:0/934928610 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970073190 0x7f197006fe80 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.374+0000 7f1976591640 1 --2- 172.21.15.81:0/934928610 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f1970158770 0x7f197015ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.374+0000 7f1976591640 1 -- 172.21.15.81:0/934928610 >> 172.21.15.81:0/934928610 conn(0x7f19700b1620 msgr2=0x7f19700b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.374+0000 7f1976591640 1 -- 172.21.15.81:0/934928610 shutdown_connections 2024-09-17T05:26:40.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.374+0000 7f1976591640 1 -- 172.21.15.81:0/934928610 wait complete. 2024-09-17T05:26:40.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.375+0000 7f1976591640 1 Processor -- start 2024-09-17T05:26:40.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.375+0000 7f1976591640 1 -- start start 2024-09-17T05:26:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19700703c0 0x7f19701f64f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1970073190 0x7f1970148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970153630 0x7f19701e52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f197015edc0 con 0x7f1970153630 2024-09-17T05:26:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f197015ec40 con 0x7f1970073190 2024-09-17T05:26:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f197015ef40 con 0x7f19700703c0 2024-09-17T05:26:40.378 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970153630 0x7f19701e52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970153630 0x7f19701e52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55838/0 (socket says 172.21.15.81:55838) 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 -- 172.21.15.81:0/2265106980 learned_addr learned my addr 172.21.15.81:0/2265106980 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f196ffff640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19700703c0 0x7f19701f64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f196f7fe640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1970073190 0x7f1970148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 -- 172.21.15.81:0/2265106980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19700703c0 msgr2=0x7f19701f64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f19700703c0 0x7f19701f64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 -- 172.21.15.81:0/2265106980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1970073190 msgr2=0x7f1970148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f1970073190 0x7f1970148470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 -- 172.21.15.81:0/2265106980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19701f6d40 con 0x7f1970153630 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1974b2e640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970153630 0x7f19701e52a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f196800c7a0 tx=0x7f196800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.379 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1968003b70 con 0x7f1970153630 2024-09-17T05:26:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f1968003d10 con 0x7f1970153630 2024-09-17T05:26:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19701f7020 con 0x7f1970153630 2024-09-17T05:26:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f196800aab0 con 0x7f1970153630 2024-09-17T05:26:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.376+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19700c4890 con 0x7f1970153630 2024-09-17T05:26:40.380 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.377+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f197006fe80 con 0x7f1970153630 2024-09-17T05:26:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.378+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f196800ac50 con 0x7f1970153630 2024-09-17T05:26:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.378+0000 7f196cff9640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f195c079760 0x7f195c07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.378+0000 7f196ffff640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f195c079760 0x7f195c07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.378+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f1968099720 con 0x7f1970153630 2024-09-17T05:26:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.379+0000 7f196cff9640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f195c07f650 0x7f195c081a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.379+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 --> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f195c082140 con 0x7f195c07f650 2024-09-17T05:26:40.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.379+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7f19680a3050 con 0x7f1970153630 2024-09-17T05:26:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.379+0000 7f196f7fe640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f195c07f650 0x7f195c081a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.379+0000 7f196ffff640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f195c079760 0x7f195c07bc20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1960005d70 tx=0x7f1960005d00 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.379+0000 7f196f7fe640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f195c07f650 0x7f195c081a70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.383 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.380+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== osd.1 v2:172.21.15.81:6816/2009991076 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f195c082140 con 0x7f195c07f650 2024-09-17T05:26:40.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 --> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f1970072bb0 con 0x7f195c07f650 2024-09-17T05:26:40.393 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f196cff9640 1 -- 172.21.15.81:0/2265106980 <== osd.1 v2:172.21.15.81:6816/2009991076 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f1970072bb0 con 0x7f195c07f650 2024-09-17T05:26:40.393 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:40.393 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:40.393 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:40.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f195c07f650 msgr2=0x7f195c081a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6816/2009991076,v1:172.21.15.81:6817/2009991076] conn(0x7f195c07f650 0x7f195c081a70 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f195c079760 msgr2=0x7f195c07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.394 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f195c079760 0x7f195c07bc20 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f1960005d70 tx=0x7f1960005d00 comp rx=0 tx=0).stop 2024-09-17T05:26:40.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970153630 msgr2=0x7f19701e52a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 --2- 172.21.15.81:0/2265106980 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f1970153630 0x7f19701e52a0 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7f196800c7a0 tx=0x7f196800cc60 comp rx=0 tx=0).stop 2024-09-17T05:26:40.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1974b2e640 1 -- 172.21.15.81:0/2265106980 reap_dead start 2024-09-17T05:26:40.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 shutdown_connections 2024-09-17T05:26:40.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.392+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 >> 172.21.15.81:0/2265106980 conn(0x7f19700b1620 msgr2=0x7f19700b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.393+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 shutdown_connections 2024-09-17T05:26:40.395 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.393+0000 7f1976591640 1 -- 172.21.15.81:0/2265106980 wait complete. 2024-09-17T05:26:40.403 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-17T05:26:40.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 -- 172.21.15.81:0/3907253831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc490 msgr2=0x7ff13415f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 --2- 172.21.15.81:0/3907253831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc490 0x7ff13415f750 secure :-1 s=READY pgs=1951 cs=0 l=1 rev1=1 crypto rx=0x7ff128005fd0 tx=0x7ff12802a530 comp rx=0 tx=0).stop 2024-09-17T05:26:40.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 -- 172.21.15.81:0/3907253831 shutdown_connections 2024-09-17T05:26:40.510 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 --2- 172.21.15.81:0/3907253831 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc490 0x7ff13415f750 unknown :-1 s=CLOSED pgs=1951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 --2- 172.21.15.81:0/3907253831 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff134159680 0x7ff13415d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 -- 172.21.15.81:0/3907253831 >> 172.21.15.81:0/3907253831 conn(0x7ff1340b1690 msgr2=0x7ff1340b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 -- 172.21.15.81:0/3907253831 shutdown_connections 2024-09-17T05:26:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.509+0000 7ff139fa2640 1 -- 172.21.15.81:0/3907253831 wait complete. 2024-09-17T05:26:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.510+0000 7ff139fa2640 1 Processor -- start 2024-09-17T05:26:40.511 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff139fa2640 1 -- start start 2024-09-17T05:26:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff139fa2640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1340cc490 0x7ff13415eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.513 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff139fa2640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc8d0 0x7ff134148100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff139fa2640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff134159680 0x7ff134145390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff139fa2640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff1340cf350 con 0x7ff1340cc8d0 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff139fa2640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff1340cf1d0 con 0x7ff1340cc490 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff139fa2640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff1340cf4d0 con 0x7ff134159680 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff132ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc8d0 0x7ff134148100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.511+0000 7ff132ffd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc8d0 0x7ff134148100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55862/0 (socket says 172.21.15.81:55862) 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff132ffd640 1 -- 172.21.15.81:0/317498629 learned_addr learned my addr 172.21.15.81:0/317498629 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff1337fe640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1340cc490 0x7ff13415eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff133fff640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff134159680 0x7ff134145390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.514 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff132ffd640 1 -- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff134159680 msgr2=0x7ff134145390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff132ffd640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff134159680 0x7ff134145390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff132ffd640 1 -- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1340cc490 msgr2=0x7ff13415eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff132ffd640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1340cc490 0x7ff13415eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff132ffd640 1 -- 172.21.15.81:0/317498629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff134148ae0 con 0x7ff1340cc8d0 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff132ffd640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc8d0 0x7ff134148100 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff1280039e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff11bfff640 1 -- 172.21.15.81:0/317498629 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff12803f070 con 0x7ff1340cc8d0 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff11bfff640 1 -- 172.21.15.81:0/317498629 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff128004890 con 0x7ff1340cc8d0 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff11bfff640 1 -- 172.21.15.81:0/317498629 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff128035030 con 0x7ff1340cc8d0 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff134148dc0 con 0x7ff1340cc8d0 2024-09-17T05:26:40.515 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.512+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff13415f060 con 0x7ff1340cc8d0 2024-09-17T05:26:40.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.513+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff134149000 con 0x7ff1340cc8d0 2024-09-17T05:26:40.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.514+0000 7ff11bfff640 1 -- 172.21.15.81:0/317498629 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7ff128042070 con 0x7ff1340cc8d0 2024-09-17T05:26:40.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.514+0000 7ff11bfff640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff120079760 0x7ff12007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.516 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.514+0000 7ff1337fe640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff120079760 0x7ff12007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.514+0000 7ff11bfff640 1 -- 172.21.15.81:0/317498629 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7ff1280ba720 con 0x7ff1340cc8d0 2024-09-17T05:26:40.517 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.515+0000 7ff1337fe640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff120079760 0x7ff12007bc20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff124005c40 tx=0x7ff12400a530 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.519 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.519+0000 7ff11bfff640 1 -- 172.21.15.81:0/317498629 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff134149000 con 0x7ff1340cc8d0 2024-09-17T05:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.695+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7ff13415c3e0 con 0x7ff120079760 2024-09-17T05:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.695+0000 7ff11bfff640 1 -- 172.21.15.81:0/317498629 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7ff13415c3e0 con 0x7ff120079760 2024-09-17T05:26:40.696 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 1 to deep-scrub 2024-09-17T05:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff120079760 msgr2=0x7ff12007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff120079760 0x7ff12007bc20 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ff124005c40 tx=0x7ff12400a530 comp rx=0 tx=0).stop 2024-09-17T05:26:40.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc8d0 msgr2=0x7ff134148100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc8d0 0x7ff134148100 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff1280039e0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 shutdown_connections 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff134159680 0x7ff134145390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff1340cc8d0 0x7ff134148100 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff120079760 0x7ff12007bc20 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 --2- 172.21.15.81:0/317498629 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff1340cc490 0x7ff13415eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 >> 172.21.15.81:0/317498629 conn(0x7ff1340b1690 msgr2=0x7ff13415c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 shutdown_connections 2024-09-17T05:26:40.699 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.697+0000 7ff139fa2640 1 -- 172.21.15.81:0/317498629 wait complete. 2024-09-17T05:26:40.709 INFO:tasks.ceph:Scrubbing osd.2 2024-09-17T05:26:40.709 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:40.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 -- 172.21.15.81:0/2563783856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54070590 msgr2=0x7f2e5415d050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 --2- 172.21.15.81:0/2563783856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54070590 0x7f2e5415d050 secure :-1 s=READY pgs=1954 cs=0 l=1 rev1=1 crypto rx=0x7f2e44005fd0 tx=0x7f2e4402aa10 comp rx=0 tx=0).stop 2024-09-17T05:26:40.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 -- 172.21.15.81:0/2563783856 shutdown_connections 2024-09-17T05:26:40.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 --2- 172.21.15.81:0/2563783856 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e54070590 0x7f2e5415d050 unknown :-1 s=CLOSED pgs=1954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 --2- 172.21.15.81:0/2563783856 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e5415aa20 0x7f2e54073170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 -- 172.21.15.81:0/2563783856 >> 172.21.15.81:0/2563783856 conn(0x7f2e540b1620 msgr2=0x7f2e540b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 -- 172.21.15.81:0/2563783856 shutdown_connections 2024-09-17T05:26:40.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.815+0000 7f2e5aba3640 1 -- 172.21.15.81:0/2563783856 wait complete. 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.816+0000 7f2e5aba3640 1 Processor -- start 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.816+0000 7f2e5aba3640 1 -- start start 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e5aba3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e54070590 0x7f2e54151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e5aba3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e540736b0 0x7f2e541f5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e5aba3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415aa20 0x7f2e541502f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e5aba3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5415d920 con 0x7f2e5415aa20 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e5aba3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f2e5415d7a0 con 0x7f2e540736b0 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e5aba3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f2e5415daa0 con 0x7f2e54070590 2024-09-17T05:26:40.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415aa20 0x7f2e541502f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415aa20 0x7f2e541502f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55876/0 (socket says 172.21.15.81:55876) 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 -- 172.21.15.81:0/514636153 learned_addr learned my addr 172.21.15.81:0/514636153 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e5893f640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e54070590 0x7f2e54151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e53fff640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e540736b0 0x7f2e541f5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 -- 172.21.15.81:0/514636153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e54070590 msgr2=0x7f2e54151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f2e54070590 0x7f2e54151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 -- 172.21.15.81:0/514636153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e540736b0 msgr2=0x7f2e541f5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e540736b0 0x7f2e541f5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e59140640 1 -- 172.21.15.81:0/514636153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2e541f6450 con 0x7f2e5415aa20 2024-09-17T05:26:40.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.817+0000 7f2e53fff640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f2e540736b0 0x7f2e541f5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.818+0000 7f2e59140640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415aa20 0x7f2e541502f0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f2e44006010 tx=0x7f2e44003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.818+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44047070 con 0x7f2e5415aa20 2024-09-17T05:26:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.818+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2e44004250 con 0x7f2e5415aa20 2024-09-17T05:26:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.818+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2e541f6730 con 0x7f2e5415aa20 2024-09-17T05:26:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.818+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2e44033050 con 0x7f2e5415aa20 2024-09-17T05:26:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.818+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2e5414b960 con 0x7f2e5415aa20 2024-09-17T05:26:40.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.818+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2e541f6c50 con 0x7f2e5415aa20 2024-09-17T05:26:40.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.819+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f2e4404a070 con 0x7f2e5415aa20 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e517fa640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2e34079760 0x7f2e3407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e5893f640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2e34079760 0x7f2e3407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f2e440bae90 con 0x7f2e5415aa20 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e517fa640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f2e3407f650 0x7f2e34081a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 --> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2e34082140 con 0x7f2e3407f650 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7f2e440bdbb0 con 0x7f2e5415aa20 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e53fff640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f2e3407f650 0x7f2e34081a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e5893f640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2e34079760 0x7f2e3407bc20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0058c0 tx=0x7f2e4c00c440 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.820+0000 7f2e53fff640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f2e3407f650 0x7f2e34081a70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.824 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.821+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== osd.2 v2:172.21.15.81:6824/2317076562 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2e34082140 con 0x7f2e3407f650 2024-09-17T05:26:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.833+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 --> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f2e5415d050 con 0x7f2e3407f650 2024-09-17T05:26:40.834 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.833+0000 7f2e517fa640 1 -- 172.21.15.81:0/514636153 <== osd.2 v2:172.21.15.81:6824/2317076562 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f2e5415d050 con 0x7f2e3407f650 2024-09-17T05:26:40.834 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:40.835 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:40.835 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:40.835 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f2e3407f650 msgr2=0x7f2e34081a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6824/2317076562,v1:172.21.15.81:6825/2317076562] conn(0x7f2e3407f650 0x7f2e34081a70 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2e34079760 msgr2=0x7f2e3407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2e34079760 0x7f2e3407bc20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2e4c0058c0 tx=0x7f2e4c00c440 comp rx=0 tx=0).stop 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415aa20 msgr2=0x7f2e541502f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 --2- 172.21.15.81:0/514636153 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f2e5415aa20 0x7f2e541502f0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7f2e44006010 tx=0x7f2e44003f10 comp rx=0 tx=0).stop 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e59140640 1 -- 172.21.15.81:0/514636153 reap_dead start 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 shutdown_connections 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 >> 172.21.15.81:0/514636153 conn(0x7f2e540b1620 msgr2=0x7f2e54156ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 shutdown_connections 2024-09-17T05:26:40.836 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.834+0000 7f2e5aba3640 1 -- 172.21.15.81:0/514636153 wait complete. 2024-09-17T05:26:40.845 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-17T05:26:40.947 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 -- 172.21.15.81:0/2933347397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 msgr2=0x7f29540d1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 --2- 172.21.15.81:0/2933347397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29540d1d10 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7f29540ce360 tx=0x7f293c02a4d0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 -- 172.21.15.81:0/2933347397 shutdown_connections 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 --2- 172.21.15.81:0/2933347397 >> v2:172.21.15.160:3300/0 conn(0x7f29540d2250 0x7f29540b1e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 --2- 172.21.15.81:0/2933347397 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29540d1d10 unknown :-1 s=CLOSED pgs=1956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 --2- 172.21.15.81:0/2933347397 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f295415bdc0 0x7f29540b13e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 -- 172.21.15.81:0/2933347397 >> 172.21.15.81:0/2933347397 conn(0x7f2954074cb0 msgr2=0x7f295409b180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 -- 172.21.15.81:0/2933347397 shutdown_connections 2024-09-17T05:26:40.948 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.946+0000 7f2958ff3640 1 -- 172.21.15.81:0/2933347397 wait complete. 2024-09-17T05:26:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 Processor -- start 2024-09-17T05:26:40.950 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 -- start start 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29541f6880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29540d2250 0x7f29540b65b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f295415bdc0 0x7f2954150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f29540cdc40 con 0x7f29540b1920 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f29540cdac0 con 0x7f295415bdc0 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f2958ff3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f29540b2370 con 0x7f29540d2250 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f295259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29541f6880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f295259c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29541f6880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55892/0 (socket says 172.21.15.81:55892) 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f295259c640 1 -- 172.21.15.81:0/1521467473 learned_addr learned my addr 172.21.15.81:0/1521467473 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.948+0000 7f294bfff640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29540d2250 0x7f29540b65b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.951 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f2952d9d640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f295415bdc0 0x7f2954150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f295259c640 1 -- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29540d2250 msgr2=0x7f29540b65b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f295259c640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29540d2250 0x7f29540b65b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f295259c640 1 -- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f295415bdc0 msgr2=0x7f2954150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f295259c640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f295415bdc0 0x7f2954150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f295259c640 1 -- 172.21.15.81:0/1521467473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f295415e720 con 0x7f29540b1920 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f295259c640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29541f6880 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f294400d770 tx=0x7f294400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f294affd640 1 -- 172.21.15.81:0/1521467473 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944017070 con 0x7f29540b1920 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f294affd640 1 -- 172.21.15.81:0/1521467473 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f2944009d20 con 0x7f29540b1920 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f295415ea00 con 0x7f29540b1920 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f294affd640 1 -- 172.21.15.81:0/1521467473 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2944005280 con 0x7f29540b1920 2024-09-17T05:26:40.952 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.949+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f295415efc0 con 0x7f29540b1920 2024-09-17T05:26:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.950+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f29540b2890 con 0x7f29540b1920 2024-09-17T05:26:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.951+0000 7f294affd640 1 -- 172.21.15.81:0/1521467473 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f2944005420 con 0x7f29540b1920 2024-09-17T05:26:40.953 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.951+0000 7f294affd640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2934079760 0x7f293407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.952+0000 7f294bfff640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2934079760 0x7f293407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.952+0000 7f294affd640 1 -- 172.21.15.81:0/1521467473 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f2944099980 con 0x7f29540b1920 2024-09-17T05:26:40.954 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.952+0000 7f294bfff640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2934079760 0x7f293407bc20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f293c033000 tx=0x7f293c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:40.956 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:40.956+0000 7f294affd640 1 -- 172.21.15.81:0/1521467473 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f2944063050 con 0x7f29540b1920 2024-09-17T05:26:41.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.131+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f2954069d90 con 0x7f2934079760 2024-09-17T05:26:41.132 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.131+0000 7f294affd640 1 -- 172.21.15.81:0/1521467473 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f293c004210 con 0x7f2934079760 2024-09-17T05:26:41.132 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 2 to deep-scrub 2024-09-17T05:26:41.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2934079760 msgr2=0x7f293407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2934079760 0x7f293407bc20 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f293c033000 tx=0x7f293c004730 comp rx=0 tx=0).stop 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 msgr2=0x7f29541f6880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29541f6880 secure :-1 s=READY pgs=1957 cs=0 l=1 rev1=1 crypto rx=0x7f294400d770 tx=0x7f294400dc30 comp rx=0 tx=0).stop 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 shutdown_connections 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f2934079760 0x7f293407bc20 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f295415bdc0 0x7f2954150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f29540d2250 0x7f29540b65b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 --2- 172.21.15.81:0/1521467473 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f29540b1920 0x7f29541f6880 unknown :-1 s=CLOSED pgs=1957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 >> 172.21.15.81:0/1521467473 conn(0x7f2954074cb0 msgr2=0x7f29540712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 shutdown_connections 2024-09-17T05:26:41.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.133+0000 7f2958ff3640 1 -- 172.21.15.81:0/1521467473 wait complete. 2024-09-17T05:26:41.145 INFO:tasks.ceph:Scrubbing osd.3 2024-09-17T05:26:41.145 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.250+0000 7f90df953640 1 -- 172.21.15.81:0/2623001567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c0003a50 msgr2=0x7f90c0003e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.250+0000 7f90df953640 1 --2- 172.21.15.81:0/2623001567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c0003a50 0x7f90c0003e70 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f90c8009ed0 tx=0x7f90c0005830 comp rx=0 tx=0).stop 2024-09-17T05:26:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.250+0000 7f90df953640 1 -- 172.21.15.81:0/2623001567 shutdown_connections 2024-09-17T05:26:41.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.250+0000 7f90df953640 1 --2- 172.21.15.81:0/2623001567 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90c0003a50 0x7f90c0003e70 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.250+0000 7f90df953640 1 -- 172.21.15.81:0/2623001567 >> 172.21.15.81:0/2623001567 conn(0x7f90d80d3e20 msgr2=0x7f90d80d4230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.250+0000 7f90df953640 1 -- 172.21.15.81:0/2623001567 shutdown_connections 2024-09-17T05:26:41.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.250+0000 7f90df953640 1 -- 172.21.15.81:0/2623001567 wait complete. 2024-09-17T05:26:41.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.251+0000 7f90df953640 1 Processor -- start 2024-09-17T05:26:41.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.251+0000 7f90df953640 1 -- start start 2024-09-17T05:26:41.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90df953640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c0003a50 0x7f90d815d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90df953640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80cbf40 0x7f90d80a15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90df953640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90d80a1af0 0x7f90d809f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90df953640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80d4cd0 con 0x7f90d80a1af0 2024-09-17T05:26:41.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90df953640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f90d80d4b50 con 0x7f90c0003a50 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90df953640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f90d80d2ce0 con 0x7f90d80cbf40 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90d80a1af0 0x7f90d809f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90d80a1af0 0x7f90d809f360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55918/0 (socket says 172.21.15.81:55918) 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 -- 172.21.15.81:0/3377213371 learned_addr learned my addr 172.21.15.81:0/3377213371 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90dd6ef640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c0003a50 0x7f90d815d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90dceee640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80cbf40 0x7f90d80a15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 -- 172.21.15.81:0/3377213371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80cbf40 msgr2=0x7f90d80a15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80cbf40 0x7f90d80a15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 -- 172.21.15.81:0/3377213371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c0003a50 msgr2=0x7f90d815d700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f90c0003a50 0x7f90d815d700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 -- 172.21.15.81:0/3377213371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90d81f4c60 con 0x7f90d80a1af0 2024-09-17T05:26:41.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90dceee640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f90d80cbf40 0x7f90d80a15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90ddef0640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90d80a1af0 0x7f90d809f360 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ce6c0 tx=0x7f90d000ea20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0010890 con 0x7f90d80a1af0 2024-09-17T05:26:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f90d0016070 con 0x7f90d80a1af0 2024-09-17T05:26:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90d0010de0 con 0x7f90d80a1af0 2024-09-17T05:26:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.252+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f90d81f4f40 con 0x7f90d80a1af0 2024-09-17T05:26:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.253+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90d81f5500 con 0x7f90d80a1af0 2024-09-17T05:26:41.256 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.253+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f90d80d2230 con 0x7f90d80a1af0 2024-09-17T05:26:41.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.254+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f90d001b460 con 0x7f90d80a1af0 2024-09-17T05:26:41.257 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.254+0000 7f90d5ffb640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90c4079760 0x7f90c407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f90d0099bb0 con 0x7f90d80a1af0 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90dd6ef640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90c4079760 0x7f90c407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90d5ffb640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f90c407f650 0x7f90c4081a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 --> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f90d000fe50 con 0x7f90c407f650 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7f90d00a3050 con 0x7f90d80a1af0 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90dceee640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f90c407f650 0x7f90c4081a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90dd6ef640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90c4079760 0x7f90c407bc20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f90c8035000 tx=0x7f90c8004a40 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.255+0000 7f90dceee640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f90c407f650 0x7f90c4081a70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.256+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== osd.3 v2:172.21.15.81:6808/437732864 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f90d000fe50 con 0x7f90c407f650 2024-09-17T05:26:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 --> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f90d80b9c30 con 0x7f90c407f650 2024-09-17T05:26:41.269 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90d5ffb640 1 -- 172.21.15.81:0/3377213371 <== osd.3 v2:172.21.15.81:6808/437732864 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f90d80b9c30 con 0x7f90c407f650 2024-09-17T05:26:41.269 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:41.269 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:41.269 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f90c407f650 msgr2=0x7f90c4081a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90df953640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6808/437732864,v1:172.21.15.81:6809/437732864] conn(0x7f90c407f650 0x7f90c4081a70 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90c4079760 msgr2=0x7f90c407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90df953640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f90c4079760 0x7f90c407bc20 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f90c8035000 tx=0x7f90c8004a40 comp rx=0 tx=0).stop 2024-09-17T05:26:41.270 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90d80a1af0 msgr2=0x7f90d809f360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90df953640 1 --2- 172.21.15.81:0/3377213371 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f90d80a1af0 0x7f90d809f360 secure :-1 s=READY pgs=1960 cs=0 l=1 rev1=1 crypto rx=0x7f90d80ce6c0 tx=0x7f90d000ea20 comp rx=0 tx=0).stop 2024-09-17T05:26:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.268+0000 7f90ddef0640 1 -- 172.21.15.81:0/3377213371 reap_dead start 2024-09-17T05:26:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.269+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 shutdown_connections 2024-09-17T05:26:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.269+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 >> 172.21.15.81:0/3377213371 conn(0x7f90d80d3e20 msgr2=0x7f90d80b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.269+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 shutdown_connections 2024-09-17T05:26:41.271 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.269+0000 7f90df953640 1 -- 172.21.15.81:0/3377213371 wait complete. 2024-09-17T05:26:41.279 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-17T05:26:41.381 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2527937159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc380735a0 msgr2=0x7fbc380739d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2527937159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc380735a0 0x7fbc380739d0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fbc380b26e0 tx=0x7fbc2c02a560 comp rx=0 tx=0).stop 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2527937159 shutdown_connections 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2527937159 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc3806ff80 0x7fbc38070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2527937159 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc380735a0 0x7fbc380739d0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2527937159 >> v2:172.21.15.160:3300/0 conn(0x7fbc3815aa70 0x7fbc380b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2527937159 >> 172.21.15.81:0/2527937159 conn(0x7fbc380b1690 msgr2=0x7fbc380b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2527937159 shutdown_connections 2024-09-17T05:26:41.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.380+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2527937159 wait complete. 2024-09-17T05:26:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.381+0000 7fbc3fe33640 1 Processor -- start 2024-09-17T05:26:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.381+0000 7fbc3fe33640 1 -- start start 2024-09-17T05:26:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3fe33640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc3806ff80 0x7fbc381f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3fe33640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc380735a0 0x7fbc380a9ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3fe33640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3815aa70 0x7fbc38158060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3fe33640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fbc380cd060 con 0x7fbc3815aa70 2024-09-17T05:26:41.385 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3fe33640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fbc380ccee0 con 0x7fbc3806ff80 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3fe33640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fbc380cd1e0 con 0x7fbc380735a0 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3815aa70 0x7fbc38158060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3815aa70 0x7fbc38158060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55922/0 (socket says 172.21.15.81:55922) 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 -- 172.21.15.81:0/2680437494 learned_addr learned my addr 172.21.15.81:0/2680437494 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3dbcf640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc3806ff80 0x7fbc381f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3d3ce640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc380735a0 0x7fbc380a9ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 -- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc380735a0 msgr2=0x7fbc380a9ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc380735a0 0x7fbc380a9ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 -- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc3806ff80 msgr2=0x7fbc381f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc3806ff80 0x7fbc381f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3e3d0640 1 -- 172.21.15.81:0/2680437494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc381f1270 con 0x7fbc3815aa70 2024-09-17T05:26:41.386 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3dbcf640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc3806ff80 0x7fbc381f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.382+0000 7fbc3d3ce640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc380735a0 0x7fbc380a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.383+0000 7fbc3e3d0640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3815aa70 0x7fbc38158060 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000d960 tx=0x7fbc3000de20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.383+0000 7fbc367fc640 1 -- 172.21.15.81:0/2680437494 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc3001b070 con 0x7fbc3815aa70 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.383+0000 7fbc367fc640 1 -- 172.21.15.81:0/2680437494 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fbc3000ee50 con 0x7fbc3815aa70 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.383+0000 7fbc367fc640 1 -- 172.21.15.81:0/2680437494 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc300166a0 con 0x7fbc3815aa70 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.383+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc381f1550 con 0x7fbc3815aa70 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.383+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc381f1b10 con 0x7fbc3815aa70 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.384+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbc380739d0 con 0x7fbc3815aa70 2024-09-17T05:26:41.387 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.384+0000 7fbc367fc640 1 -- 172.21.15.81:0/2680437494 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fbc3001e070 con 0x7fbc3815aa70 2024-09-17T05:26:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.385+0000 7fbc367fc640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc24079760 0x7fbc2407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.385+0000 7fbc3dbcf640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc24079760 0x7fbc2407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.385+0000 7fbc367fc640 1 -- 172.21.15.81:0/2680437494 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fbc3009b700 con 0x7fbc3815aa70 2024-09-17T05:26:41.388 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.385+0000 7fbc3dbcf640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc24079760 0x7fbc2407bc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbc28005c40 tx=0x7fbc2800a410 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.390 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.389+0000 7fbc367fc640 1 -- 172.21.15.81:0/2680437494 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fbc30065420 con 0x7fbc3815aa70 2024-09-17T05:26:41.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.564+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7fbc380b0e60 con 0x7fbc24079760 2024-09-17T05:26:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.565+0000 7fbc367fc640 1 -- 172.21.15.81:0/2680437494 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fbc380b0e60 con 0x7fbc24079760 2024-09-17T05:26:41.566 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 3 to deep-scrub 2024-09-17T05:26:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.566+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc24079760 msgr2=0x7fbc2407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.566+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc24079760 0x7fbc2407bc20 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fbc28005c40 tx=0x7fbc2800a410 comp rx=0 tx=0).stop 2024-09-17T05:26:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.566+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3815aa70 msgr2=0x7fbc38158060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.566+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3815aa70 0x7fbc38158060 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fbc3000d960 tx=0x7fbc3000de20 comp rx=0 tx=0).stop 2024-09-17T05:26:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 shutdown_connections 2024-09-17T05:26:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fbc3815aa70 0x7fbc38158060 unknown :-1 s=CLOSED pgs=1962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.568 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fbc380735a0 0x7fbc380a9ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fbc24079760 0x7fbc2407bc20 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 --2- 172.21.15.81:0/2680437494 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fbc3806ff80 0x7fbc381f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 >> 172.21.15.81:0/2680437494 conn(0x7fbc380b1690 msgr2=0x7fbc38156f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 shutdown_connections 2024-09-17T05:26:41.569 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.567+0000 7fbc3fe33640 1 -- 172.21.15.81:0/2680437494 wait complete. 2024-09-17T05:26:41.578 INFO:tasks.ceph:Scrubbing osd.4 2024-09-17T05:26:41.579 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.683+0000 7fcd9167f640 1 -- 172.21.15.81:0/1170846844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c15f2d0 msgr2=0x7fcd8c0cccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.683+0000 7fcd9167f640 1 --2- 172.21.15.81:0/1170846844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c15f2d0 0x7fcd8c0cccd0 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c005fd0 tx=0x7fcd7c02a560 comp rx=0 tx=0).stop 2024-09-17T05:26:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.683+0000 7fcd9167f640 1 -- 172.21.15.81:0/1170846844 shutdown_connections 2024-09-17T05:26:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.683+0000 7fcd9167f640 1 --2- 172.21.15.81:0/1170846844 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c15f2d0 0x7fcd8c0cccd0 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.683+0000 7fcd9167f640 1 -- 172.21.15.81:0/1170846844 >> 172.21.15.81:0/1170846844 conn(0x7fcd8c074160 msgr2=0x7fcd8c074570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.683+0000 7fcd9167f640 1 -- 172.21.15.81:0/1170846844 shutdown_connections 2024-09-17T05:26:41.685 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.683+0000 7fcd9167f640 1 -- 172.21.15.81:0/1170846844 wait complete. 2024-09-17T05:26:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 Processor -- start 2024-09-17T05:26:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 -- start start 2024-09-17T05:26:41.687 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8c0afe40 0x7fcd8c0b30f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c0cf490 0x7fcd8c14f040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8c15f2d0 0x7fcd8c0ca910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c0cffd0 con 0x7fcd8c0cf490 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fcd8c0cdb30 con 0x7fcd8c15f2d0 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd9167f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fcd8c0d0150 con 0x7fcd8c0afe40 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c0cf490 0x7fcd8c14f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd83fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c0cf490 0x7fcd8c14f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55942/0 (socket says 172.21.15.81:55942) 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.685+0000 7fcd83fff640 1 -- 172.21.15.81:0/575581190 learned_addr learned my addr 172.21.15.81:0/575581190 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd8b7fe640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8c15f2d0 0x7fcd8c0ca910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd8affd640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8c0afe40 0x7fcd8c0b30f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.688 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd83fff640 1 -- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8c0afe40 msgr2=0x7fcd8c0b30f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd83fff640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8c0afe40 0x7fcd8c0b30f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd83fff640 1 -- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8c15f2d0 msgr2=0x7fcd8c0ca910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd83fff640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fcd8c15f2d0 0x7fcd8c0ca910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd83fff640 1 -- 172.21.15.81:0/575581190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd8c0b54a0 con 0x7fcd8c0cf490 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd8affd640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fcd8c0afe40 0x7fcd8c0b30f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd83fff640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c0cf490 0x7fcd8c14f040 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c500 tx=0x7fcd7400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd740052d0 con 0x7fcd8c0cf490 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fcd74005470 con 0x7fcd8c0cf490 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd74012870 con 0x7fcd8c0cf490 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd8c0ca3f0 con 0x7fcd8c0cf490 2024-09-17T05:26:41.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.686+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd8c0cc720 con 0x7fcd8c0cf490 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.687+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fcd8c0d0610 con 0x7fcd8c0cf490 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.688+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fcd740035f0 con 0x7fcd8c0cf490 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.688+0000 7fcd837fe640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd6c079760 0x7fcd6c07bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.688+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fcd74099490 con 0x7fcd8c0cf490 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.688+0000 7fcd8affd640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd6c079760 0x7fcd6c07bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.688+0000 7fcd837fe640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7fcd6c07f650 0x7fcd6c081a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.688+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 --> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fcd6c082140 con 0x7fcd6c07f650 2024-09-17T05:26:41.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.688+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7fcd7409e400 con 0x7fcd8c0cf490 2024-09-17T05:26:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.689+0000 7fcd8affd640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd6c079760 0x7fcd6c07bc20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c033000 tx=0x7fcd7c004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.689+0000 7fcd8b7fe640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7fcd6c07f650 0x7fcd6c081a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.689+0000 7fcd8b7fe640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7fcd6c07f650 0x7fcd6c081a70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.692 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.690+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== osd.4 v2:172.21.15.160:6826/3841431636 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fcd6c082140 con 0x7fcd6c07f650 2024-09-17T05:26:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.702+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 --> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fcd8c06e970 con 0x7fcd6c07f650 2024-09-17T05:26:41.703 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd837fe640 1 -- 172.21.15.81:0/575581190 <== osd.4 v2:172.21.15.160:6826/3841431636 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fcd8c06e970 con 0x7fcd6c07f650 2024-09-17T05:26:41.704 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:41.704 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:41.704 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7fcd6c07f650 msgr2=0x7fcd6c081a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.160:6826/3841431636,v1:172.21.15.160:6827/3841431636] conn(0x7fcd6c07f650 0x7fcd6c081a70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd6c079760 msgr2=0x7fcd6c07bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fcd6c079760 0x7fcd6c07bc20 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fcd7c033000 tx=0x7fcd7c004730 comp rx=0 tx=0).stop 2024-09-17T05:26:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c0cf490 msgr2=0x7fcd8c14f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 --2- 172.21.15.81:0/575581190 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fcd8c0cf490 0x7fcd8c14f040 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fcd7400c500 tx=0x7fcd7400c9c0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.705 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd8b7fe640 1 -- 172.21.15.81:0/575581190 reap_dead start 2024-09-17T05:26:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 shutdown_connections 2024-09-17T05:26:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 >> 172.21.15.81:0/575581190 conn(0x7fcd8c074160 msgr2=0x7fcd8c0aebe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 shutdown_connections 2024-09-17T05:26:41.706 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.703+0000 7fcd9167f640 1 -- 172.21.15.81:0/575581190 wait complete. 2024-09-17T05:26:41.714 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-09-17T05:26:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.814+0000 7fac0cabe640 1 -- 172.21.15.81:0/4123360833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0806ff80 msgr2=0x7fac08070410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.814+0000 7fac0cabe640 1 --2- 172.21.15.81:0/4123360833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0806ff80 0x7fac08070410 secure :-1 s=READY pgs=1966 cs=0 l=1 rev1=1 crypto rx=0x7fac080b26e0 tx=0x7fac0002aa30 comp rx=0 tx=0).stop 2024-09-17T05:26:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.815+0000 7fac0cabe640 1 -- 172.21.15.81:0/4123360833 shutdown_connections 2024-09-17T05:26:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.815+0000 7fac0cabe640 1 --2- 172.21.15.81:0/4123360833 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0806ff80 0x7fac08070410 unknown :-1 s=CLOSED pgs=1966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.815+0000 7fac0cabe640 1 --2- 172.21.15.81:0/4123360833 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac080735a0 0x7fac080739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.815+0000 7fac0cabe640 1 --2- 172.21.15.81:0/4123360833 >> v2:172.21.15.160:3300/0 conn(0x7fac0815aa70 0x7fac080b4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.816 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.815+0000 7fac0cabe640 1 -- 172.21.15.81:0/4123360833 >> 172.21.15.81:0/4123360833 conn(0x7fac080b1690 msgr2=0x7fac080b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.815+0000 7fac0cabe640 1 -- 172.21.15.81:0/4123360833 shutdown_connections 2024-09-17T05:26:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.815+0000 7fac0cabe640 1 -- 172.21.15.81:0/4123360833 wait complete. 2024-09-17T05:26:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.816+0000 7fac0cabe640 1 Processor -- start 2024-09-17T05:26:41.817 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.816+0000 7fac0cabe640 1 -- start start 2024-09-17T05:26:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0cabe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0806ff80 0x7fac081f4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0cabe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080735a0 0x7fac081e9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0cabe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0815aa70 0x7fac0815ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.819 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0cabe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fac080cd060 con 0x7fac0815aa70 2024-09-17T05:26:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0cabe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fac080ccee0 con 0x7fac080735a0 2024-09-17T05:26:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0cabe640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fac080cd1e0 con 0x7fac0806ff80 2024-09-17T05:26:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0815aa70 0x7fac0815ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0815aa70 0x7fac0815ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55956/0 (socket says 172.21.15.81:55956) 2024-09-17T05:26:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 -- 172.21.15.81:0/3078819514 learned_addr learned my addr 172.21.15.81:0/3078819514 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fabfdd9b640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080735a0 0x7fac081e9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.820 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0659c640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0806ff80 0x7fac081f4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 -- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0806ff80 msgr2=0x7fac081f4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0806ff80 0x7fac081f4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 -- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080735a0 msgr2=0x7fac081e9890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080735a0 0x7fac081e9890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 -- 172.21.15.81:0/3078819514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac081445a0 con 0x7fac0815aa70 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac0659c640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0806ff80 0x7fac081f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.817+0000 7fac06d9d640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0815aa70 0x7fac0815ccc0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fac0002b020 tx=0x7fac00003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.818+0000 7fabff7fe640 1 -- 172.21.15.81:0/3078819514 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00047070 con 0x7fac0815aa70 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.818+0000 7fabff7fe640 1 -- 172.21.15.81:0/3078819514 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fac00004250 con 0x7fac0815aa70 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.818+0000 7fabff7fe640 1 -- 172.21.15.81:0/3078819514 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac00033050 con 0x7fac0815aa70 2024-09-17T05:26:41.821 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.818+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac08144880 con 0x7fac0815aa70 2024-09-17T05:26:41.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.818+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac081f45f0 con 0x7fac0815aa70 2024-09-17T05:26:41.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.818+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac080739a0 con 0x7fac0815aa70 2024-09-17T05:26:41.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.819+0000 7fabff7fe640 1 -- 172.21.15.81:0/3078819514 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fac0004a070 con 0x7fac0815aa70 2024-09-17T05:26:41.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.820+0000 7fabff7fe640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fabe8079790 0x7fabe807bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:41.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.820+0000 7fabff7fe640 1 -- 172.21.15.81:0/3078819514 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fac000ba9a0 con 0x7fac0815aa70 2024-09-17T05:26:41.822 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.820+0000 7fac0659c640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fabe8079790 0x7fabe807bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:41.823 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.820+0000 7fac0659c640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fabe8079790 0x7fabe807bc50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fabf8005d70 tx=0x7fabf8005d00 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:41.825 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:41.824+0000 7fabff7fe640 1 -- 172.21.15.81:0/3078819514 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fac00084890 con 0x7fac0815aa70 2024-09-17T05:26:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.002+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7fac080ce3a0 con 0x7fabe8079790 2024-09-17T05:26:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.003+0000 7fabff7fe640 1 -- 172.21.15.81:0/3078819514 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fac080ce3a0 con 0x7fabe8079790 2024-09-17T05:26:42.004 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 4 to deep-scrub 2024-09-17T05:26:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fabe8079790 msgr2=0x7fabe807bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fabe8079790 0x7fabe807bc50 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fabf8005d70 tx=0x7fabf8005d00 comp rx=0 tx=0).stop 2024-09-17T05:26:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0815aa70 msgr2=0x7fac0815ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0815aa70 0x7fac0815ccc0 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fac0002b020 tx=0x7fac00003f10 comp rx=0 tx=0).stop 2024-09-17T05:26:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 shutdown_connections 2024-09-17T05:26:42.006 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fac0815aa70 0x7fac0815ccc0 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fabe8079790 0x7fabe807bc50 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fac080735a0 0x7fac081e9890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 --2- 172.21.15.81:0/3078819514 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fac0806ff80 0x7fac081f4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 >> 172.21.15.81:0/3078819514 conn(0x7fac080b1690 msgr2=0x7fac080cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 shutdown_connections 2024-09-17T05:26:42.007 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.005+0000 7fac0cabe640 1 -- 172.21.15.81:0/3078819514 wait complete. 2024-09-17T05:26:42.016 INFO:tasks.ceph:Scrubbing osd.5 2024-09-17T05:26:42.016 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:42.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.121+0000 7fe536d4b640 1 -- 172.21.15.81:0/3896430665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520004800 msgr2=0x7fe520004c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.121+0000 7fe536d4b640 1 --2- 172.21.15.81:0/3896430665 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe520004800 0x7fe520004c80 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00baf0 tx=0x7fe520005830 comp rx=0 tx=0).stop 2024-09-17T05:26:42.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.121+0000 7fe5352e8640 1 -- 172.21.15.81:0/3896430665 reap_dead start 2024-09-17T05:26:42.122 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.121+0000 7fe536d4b640 1 -- 172.21.15.81:0/3896430665 shutdown_connections 2024-09-17T05:26:42.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.121+0000 7fe536d4b640 1 -- 172.21.15.81:0/3896430665 >> 172.21.15.81:0/3896430665 conn(0x7fe5300b1620 msgr2=0x7fe5300b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.121+0000 7fe536d4b640 1 -- 172.21.15.81:0/3896430665 shutdown_connections 2024-09-17T05:26:42.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.121+0000 7fe536d4b640 1 -- 172.21.15.81:0/3896430665 wait complete. 2024-09-17T05:26:42.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.122+0000 7fe536d4b640 1 Processor -- start 2024-09-17T05:26:42.123 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.122+0000 7fe536d4b640 1 -- start start 2024-09-17T05:26:42.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe536d4b640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe520004800 0x7fe530151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe536d4b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5301557d0 0x7fe530153e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe536d4b640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe530154380 0x7fe530144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe536d4b640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fe530159c90 con 0x7fe5301557d0 2024-09-17T05:26:42.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe536d4b640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fe530159b10 con 0x7fe520004800 2024-09-17T05:26:42.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe536d4b640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fe530159e10 con 0x7fe530154380 2024-09-17T05:26:42.126 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5301557d0 0x7fe530153e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5301557d0 0x7fe530153e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:55988/0 (socket says 172.21.15.81:55988) 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 -- 172.21.15.81:0/1655960322 learned_addr learned my addr 172.21.15.81:0/1655960322 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe534ae7640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe520004800 0x7fe530151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe5352e8640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe530154380 0x7fe530144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 -- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe530154380 msgr2=0x7fe530144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fe530154380 0x7fe530144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 -- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe520004800 msgr2=0x7fe530151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fe520004800 0x7fe530151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.123+0000 7fe52ffff640 1 -- 172.21.15.81:0/1655960322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe530155f20 con 0x7fe5301557d0 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.124+0000 7fe52ffff640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5301557d0 0x7fe530153e40 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00baf0 tx=0x7fe51c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.127 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.124+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c04a070 con 0x7fe5301557d0 2024-09-17T05:26:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.124+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fe51c032a90 con 0x7fe5301557d0 2024-09-17T05:26:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.124+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe530156200 con 0x7fe5301557d0 2024-09-17T05:26:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.124+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe51c045420 con 0x7fe5301557d0 2024-09-17T05:26:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.124+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5301567c0 con 0x7fe5301557d0 2024-09-17T05:26:42.128 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.125+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe5301595d0 con 0x7fe5301557d0 2024-09-17T05:26:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.125+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fe51c04d070 con 0x7fe5301557d0 2024-09-17T05:26:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe52d7fa640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe514079760 0x7fe51407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe534ae7640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe514079760 0x7fe51407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fe51c0baa10 con 0x7fe5301557d0 2024-09-17T05:26:42.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe52d7fa640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7fe51407f650 0x7fe514081a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 --> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe51c038ec0 con 0x7fe51407f650 2024-09-17T05:26:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7fe51c0bd7c0 con 0x7fe5301557d0 2024-09-17T05:26:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe534ae7640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe514079760 0x7fe51407bc20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe524000ff0 tx=0x7fe524006040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.126+0000 7fe5352e8640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7fe51407f650 0x7fe514081a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.127+0000 7fe5352e8640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7fe51407f650 0x7fe514081a70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.128+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== osd.5 v2:172.21.15.160:6810/598189389 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe51c038ec0 con 0x7fe51407f650 2024-09-17T05:26:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.140+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 --> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fe530072bb0 con 0x7fe51407f650 2024-09-17T05:26:42.141 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.140+0000 7fe52d7fa640 1 -- 172.21.15.81:0/1655960322 <== osd.5 v2:172.21.15.160:6810/598189389 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fe530072bb0 con 0x7fe51407f650 2024-09-17T05:26:42.141 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:42.142 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:42.142 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7fe51407f650 msgr2=0x7fe514081a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.160:6810/598189389,v1:172.21.15.160:6811/598189389] conn(0x7fe51407f650 0x7fe514081a70 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe514079760 msgr2=0x7fe51407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fe514079760 0x7fe51407bc20 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fe524000ff0 tx=0x7fe524006040 comp rx=0 tx=0).stop 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5301557d0 msgr2=0x7fe530153e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 --2- 172.21.15.81:0/1655960322 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fe5301557d0 0x7fe530153e40 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7fe51c00baf0 tx=0x7fe51c0326a0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe5352e8640 1 -- 172.21.15.81:0/1655960322 reap_dead start 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 shutdown_connections 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 >> 172.21.15.81:0/1655960322 conn(0x7fe5300b1620 msgr2=0x7fe5300cee00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.143 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 shutdown_connections 2024-09-17T05:26:42.144 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.141+0000 7fe536d4b640 1 -- 172.21.15.81:0/1655960322 wait complete. 2024-09-17T05:26:42.152 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-09-17T05:26:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 -- 172.21.15.81:0/3068894438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd040151370 msgr2=0x7fd0400cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 --2- 172.21.15.81:0/3068894438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd040151370 0x7fd0400cef30 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7fd030005fd0 tx=0x7fd03002a580 comp rx=0 tx=0).stop 2024-09-17T05:26:42.254 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 -- 172.21.15.81:0/3068894438 shutdown_connections 2024-09-17T05:26:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 --2- 172.21.15.81:0/3068894438 >> v2:172.21.15.160:3300/0 conn(0x7fd0400b3140 0x7fd0400cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 --2- 172.21.15.81:0/3068894438 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd040151370 0x7fd0400cef30 unknown :-1 s=CLOSED pgs=1971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 -- 172.21.15.81:0/3068894438 >> 172.21.15.81:0/3068894438 conn(0x7fd0400b1690 msgr2=0x7fd0400b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 -- 172.21.15.81:0/3068894438 shutdown_connections 2024-09-17T05:26:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.253+0000 7fd044872640 1 -- 172.21.15.81:0/3068894438 wait complete. 2024-09-17T05:26:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.254+0000 7fd044872640 1 Processor -- start 2024-09-17T05:26:42.255 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.254+0000 7fd044872640 1 -- start start 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd044872640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0400725a0 0x7fd040146e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd044872640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0400b3140 0x7fd04013e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd044872640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd040151370 0x7fd0400b0780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd044872640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fd04006ebe0 con 0x7fd0400b3140 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd044872640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fd04006ea60 con 0x7fd0400725a0 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd044872640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fd04006f9f0 con 0x7fd040151370 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0400b3140 0x7fd04013e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0400b3140 0x7fd04013e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56008/0 (socket says 172.21.15.81:56008) 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 -- 172.21.15.81:0/110557184 learned_addr learned my addr 172.21.15.81:0/110557184 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:42.258 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03e59c640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0400725a0 0x7fd040146e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03ed9d640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd040151370 0x7fd0400b0780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 -- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd040151370 msgr2=0x7fd0400b0780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd040151370 0x7fd0400b0780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 -- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0400725a0 msgr2=0x7fd040146e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0400725a0 0x7fd040146e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03dd9b640 1 -- 172.21.15.81:0/110557184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0400cd880 con 0x7fd0400b3140 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.255+0000 7fd03e59c640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0400725a0 0x7fd040146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.256+0000 7fd03dd9b640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0400b3140 0x7fd04013e240 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fd03400d770 tx=0x7fd03400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.256+0000 7fd02effd640 1 -- 172.21.15.81:0/110557184 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034017070 con 0x7fd0400b3140 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.256+0000 7fd02effd640 1 -- 172.21.15.81:0/110557184 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fd034009d20 con 0x7fd0400b3140 2024-09-17T05:26:42.259 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.256+0000 7fd02effd640 1 -- 172.21.15.81:0/110557184 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd034005280 con 0x7fd0400b3140 2024-09-17T05:26:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.256+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0400cdb60 con 0x7fd0400b3140 2024-09-17T05:26:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.256+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0400ce120 con 0x7fd0400b3140 2024-09-17T05:26:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.257+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0400ce320 con 0x7fd0400b3140 2024-09-17T05:26:42.260 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.257+0000 7fd02effd640 1 -- 172.21.15.81:0/110557184 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fd034005420 con 0x7fd0400b3140 2024-09-17T05:26:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.258+0000 7fd02effd640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd020079760 0x7fd02007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.258+0000 7fd02effd640 1 -- 172.21.15.81:0/110557184 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fd0340999f0 con 0x7fd0400b3140 2024-09-17T05:26:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.258+0000 7fd03e59c640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd020079760 0x7fd02007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.261 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.258+0000 7fd03e59c640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd020079760 0x7fd02007bc20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd030033000 tx=0x7fd030004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.263 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.262+0000 7fd02effd640 1 -- 172.21.15.81:0/110557184 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fd0400ce320 con 0x7fd0400b3140 2024-09-17T05:26:42.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.438+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fd040072a10 con 0x7fd020079760 2024-09-17T05:26:42.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.438+0000 7fd02effd640 1 -- 172.21.15.81:0/110557184 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd040072a10 con 0x7fd020079760 2024-09-17T05:26:42.439 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 5 to deep-scrub 2024-09-17T05:26:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd020079760 msgr2=0x7fd02007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd020079760 0x7fd02007bc20 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fd030033000 tx=0x7fd030004730 comp rx=0 tx=0).stop 2024-09-17T05:26:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0400b3140 msgr2=0x7fd04013e240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0400b3140 0x7fd04013e240 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fd03400d770 tx=0x7fd03400dc30 comp rx=0 tx=0).stop 2024-09-17T05:26:42.441 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 shutdown_connections 2024-09-17T05:26:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fd040151370 0x7fd0400b0780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fd0400b3140 0x7fd04013e240 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fd020079760 0x7fd02007bc20 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 --2- 172.21.15.81:0/110557184 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fd0400725a0 0x7fd040146e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 >> 172.21.15.81:0/110557184 conn(0x7fd0400b1690 msgr2=0x7fd0401518a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 shutdown_connections 2024-09-17T05:26:42.442 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.440+0000 7fd044872640 1 -- 172.21.15.81:0/110557184 wait complete. 2024-09-17T05:26:42.452 INFO:tasks.ceph:Scrubbing osd.6 2024-09-17T05:26:42.452 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:42.557 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.556+0000 7f677e1f3640 1 -- 172.21.15.81:0/2926639248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6760003fd0 msgr2=0x7f6760004800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.556+0000 7f677e1f3640 1 --2- 172.21.15.81:0/2926639248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f6760003fd0 0x7f6760004800 secure :-1 s=READY pgs=1974 cs=0 l=1 rev1=1 crypto rx=0x7f676c009b80 tx=0x7f6760005830 comp rx=0 tx=0).stop 2024-09-17T05:26:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.556+0000 7f6777fff640 1 -- 172.21.15.81:0/2926639248 reap_dead start 2024-09-17T05:26:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.556+0000 7f677e1f3640 1 -- 172.21.15.81:0/2926639248 shutdown_connections 2024-09-17T05:26:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.556+0000 7f677e1f3640 1 -- 172.21.15.81:0/2926639248 >> 172.21.15.81:0/2926639248 conn(0x7f67780b1620 msgr2=0x7f67780b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.556+0000 7f677e1f3640 1 -- 172.21.15.81:0/2926639248 shutdown_connections 2024-09-17T05:26:42.558 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.556+0000 7f677e1f3640 1 -- 172.21.15.81:0/2926639248 wait complete. 2024-09-17T05:26:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.558+0000 7f677e1f3640 1 Processor -- start 2024-09-17T05:26:42.559 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.558+0000 7f677e1f3640 1 -- start start 2024-09-17T05:26:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.558+0000 7f677e1f3640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6760003fd0 0x7f6778156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.558+0000 7f677e1f3640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67780ada00 0x7f67780cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.558+0000 7f677e1f3640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67780ce4c0 0x7f6778153200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.558+0000 7f677e1f3640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f677815bd00 con 0x7f67780ce4c0 2024-09-17T05:26:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.558+0000 7f677e1f3640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f677815bb80 con 0x7f67780ada00 2024-09-17T05:26:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f677e1f3640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f6778073360 con 0x7f6760003fd0 2024-09-17T05:26:42.561 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67780ce4c0 0x7f6778153200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67780ce4c0 0x7f6778153200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56024/0 (socket says 172.21.15.81:56024) 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 -- 172.21.15.81:0/3006558338 learned_addr learned my addr 172.21.15.81:0/3006558338 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6776ffd640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67780ada00 0x7f67780cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f67777fe640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6760003fd0 0x7f6778156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 -- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6760003fd0 msgr2=0x7f6778156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6760003fd0 0x7f6778156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 -- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67780ada00 msgr2=0x7f67780cdf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67780ada00 0x7f67780cdf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 -- 172.21.15.81:0/3006558338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6778156590 con 0x7f67780ce4c0 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f67777fe640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f6760003fd0 0x7f6778156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6776ffd640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f67780ada00 0x7f67780cdf80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:42.562 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f6777fff640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67780ce4c0 0x7f6778153200 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f67780ccbc0 tx=0x7f67700039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770015070 con 0x7f67780ce4c0 2024-09-17T05:26:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f6770011840 con 0x7f67780ce4c0 2024-09-17T05:26:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67781f60e0 con 0x7f67780ce4c0 2024-09-17T05:26:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6770011c70 con 0x7f67780ce4c0 2024-09-17T05:26:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.559+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67781f5840 con 0x7f67780ce4c0 2024-09-17T05:26:42.563 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.560+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f67781587e0 con 0x7f67780ce4c0 2024-09-17T05:26:42.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.561+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f6770018070 con 0x7f67780ce4c0 2024-09-17T05:26:42.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.561+0000 7f675ffff640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6764079760 0x7f676407bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.564 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f67777fe640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6764079760 0x7f676407bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f677009a590 con 0x7f67780ce4c0 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f675ffff640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7f676407f650 0x7f6764081a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 --> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6764082140 con 0x7f676407f650 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7f677009f500 con 0x7f67780ce4c0 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f67777fe640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6764079760 0x7f676407bc20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6768005fd0 tx=0x7f6768009500 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f6776ffd640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7f676407f650 0x7f6764081a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.562+0000 7f6776ffd640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7f676407f650 0x7f6764081a70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.565 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.563+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== osd.6 v2:172.21.15.160:6818/4274770585 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6764082140 con 0x7f676407f650 2024-09-17T05:26:42.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.575+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 --> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f67780ae470 con 0x7f676407f650 2024-09-17T05:26:42.577 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f675ffff640 1 -- 172.21.15.81:0/3006558338 <== osd.6 v2:172.21.15.160:6818/4274770585 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f67780ae470 con 0x7f676407f650 2024-09-17T05:26:42.577 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:42.577 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:42.577 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:42.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7f676407f650 msgr2=0x7f6764081a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.160:6818/4274770585,v1:172.21.15.160:6819/4274770585] conn(0x7f676407f650 0x7f6764081a70 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6764079760 msgr2=0x7f676407bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f6764079760 0x7f676407bc20 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f6768005fd0 tx=0x7f6768009500 comp rx=0 tx=0).stop 2024-09-17T05:26:42.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67780ce4c0 msgr2=0x7f6778153200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.578 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 --2- 172.21.15.81:0/3006558338 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f67780ce4c0 0x7f6778153200 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f67780ccbc0 tx=0x7f67700039c0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f6777fff640 1 -- 172.21.15.81:0/3006558338 reap_dead start 2024-09-17T05:26:42.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 shutdown_connections 2024-09-17T05:26:42.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 >> 172.21.15.81:0/3006558338 conn(0x7f67780b1620 msgr2=0x7f677815aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.576+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 shutdown_connections 2024-09-17T05:26:42.579 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.577+0000 7f677e1f3640 1 -- 172.21.15.81:0/3006558338 wait complete. 2024-09-17T05:26:42.588 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-09-17T05:26:42.689 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 -- 172.21.15.81:0/3778751945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 msgr2=0x7f02cc072a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3778751945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc072a30 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f02cc0693c0 tx=0x7f02c402b910 comp rx=0 tx=0).stop 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 -- 172.21.15.81:0/3778751945 shutdown_connections 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3778751945 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc072a30 unknown :-1 s=CLOSED pgs=1976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3778751945 >> v2:172.21.15.160:3300/0 conn(0x7f02cc0b3140 0x7f02cc0cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3778751945 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02cc151370 0x7f02cc0cef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 -- 172.21.15.81:0/3778751945 >> 172.21.15.81:0/3778751945 conn(0x7f02cc0b1690 msgr2=0x7f02cc0b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 -- 172.21.15.81:0/3778751945 shutdown_connections 2024-09-17T05:26:42.690 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.688+0000 7f02d26fe640 1 -- 172.21.15.81:0/3778751945 wait complete. 2024-09-17T05:26:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.689+0000 7f02d26fe640 1 Processor -- start 2024-09-17T05:26:42.691 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02d26fe640 1 -- start start 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02d26fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc0cc5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02d26fe640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02cc0b3140 0x7f02cc1f1180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02d26fe640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02cc151370 0x7f02cc1e2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02d26fe640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc06ea80 con 0x7f02cc0725a0 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02d26fe640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f02cc06e900 con 0x7f02cc0b3140 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02d26fe640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f02cc06ec00 con 0x7f02cc151370 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc0cc5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02cbfff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc0cc5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56040/0 (socket says 172.21.15.81:56040) 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.690+0000 7f02cbfff640 1 -- 172.21.15.81:0/3404137248 learned_addr learned my addr 172.21.15.81:0/3404137248 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:42.693 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cb7fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02cc0b3140 0x7f02cc1f1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02d0c9b640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02cc151370 0x7f02cc1e2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cbfff640 1 -- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02cc151370 msgr2=0x7f02cc1e2fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cbfff640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02cc151370 0x7f02cc1e2fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cbfff640 1 -- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02cc0b3140 msgr2=0x7f02cc1f1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cbfff640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02cc0b3140 0x7f02cc1f1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cbfff640 1 -- 172.21.15.81:0/3404137248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f02cc0ccca0 con 0x7f02cc0725a0 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cb7fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02cc0b3140 0x7f02cc1f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02d0c9b640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02cc151370 0x7f02cc1e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02cbfff640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc0cc5e0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00c9a0 tx=0x7f02bc00ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02c8ff9640 1 -- 172.21.15.81:0/3404137248 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc007b50 con 0x7f02cc0725a0 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02c8ff9640 1 -- 172.21.15.81:0/3404137248 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f02bc007e00 con 0x7f02cc0725a0 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f02cc0ccf80 con 0x7f02cc0725a0 2024-09-17T05:26:42.694 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02c8ff9640 1 -- 172.21.15.81:0/3404137248 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f02bc005280 con 0x7f02cc0725a0 2024-09-17T05:26:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.691+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f02cc0cd540 con 0x7f02cc0725a0 2024-09-17T05:26:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.692+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f02cc072a30 con 0x7f02cc0725a0 2024-09-17T05:26:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.693+0000 7f02c8ff9640 1 -- 172.21.15.81:0/3404137248 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f02bc005420 con 0x7f02cc0725a0 2024-09-17T05:26:42.695 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.693+0000 7f02c8ff9640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f02b8079760 0x7f02b807bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.693+0000 7f02cb7fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f02b8079760 0x7f02b807bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.693+0000 7f02c8ff9640 1 -- 172.21.15.81:0/3404137248 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f02bc099ad0 con 0x7f02cc0725a0 2024-09-17T05:26:42.696 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.694+0000 7f02cb7fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f02b8079760 0x7f02b807bc20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005fd0 tx=0x7f02c0005d40 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:42.698 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.698+0000 7f02c8ff9640 1 -- 172.21.15.81:0/3404137248 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f02bc014030 con 0x7f02cc0725a0 2024-09-17T05:26:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.875+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7f02cc1f16c0 con 0x7f02b8079760 2024-09-17T05:26:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.875+0000 7f02c8ff9640 1 -- 172.21.15.81:0/3404137248 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f02cc1f16c0 con 0x7f02b8079760 2024-09-17T05:26:42.877 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 6 to deep-scrub 2024-09-17T05:26:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f02b8079760 msgr2=0x7f02b807bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f02b8079760 0x7f02b807bc20 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f02c0005fd0 tx=0x7f02c0005d40 comp rx=0 tx=0).stop 2024-09-17T05:26:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 msgr2=0x7f02cc0cc5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.878 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc0cc5e0 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f02bc00c9a0 tx=0x7f02bc00ce60 comp rx=0 tx=0).stop 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 shutdown_connections 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f02cc151370 0x7f02cc1e2fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f02b8079760 0x7f02b807bc20 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f02cc0b3140 0x7f02cc1f1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 --2- 172.21.15.81:0/3404137248 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f02cc0725a0 0x7f02cc0cc5e0 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 >> 172.21.15.81:0/3404137248 conn(0x7f02cc0b1690 msgr2=0x7f02cc0af600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 shutdown_connections 2024-09-17T05:26:42.879 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.877+0000 7f02d26fe640 1 -- 172.21.15.81:0/3404137248 wait complete. 2024-09-17T05:26:42.889 INFO:tasks.ceph:Scrubbing osd.7 2024-09-17T05:26:42.889 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-09-17T05:26:42.996 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.995+0000 7ffa450bd640 1 -- 172.21.15.81:0/3852215173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa28003a00 msgr2=0x7ffa28003e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.995+0000 7ffa450bd640 1 --2- 172.21.15.81:0/3852215173 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa28003a00 0x7ffa28003e20 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7ffa30009f90 tx=0x7ffa28005830 comp rx=0 tx=0).stop 2024-09-17T05:26:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.995+0000 7ffa3f59e640 1 -- 172.21.15.81:0/3852215173 reap_dead start 2024-09-17T05:26:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.995+0000 7ffa450bd640 1 -- 172.21.15.81:0/3852215173 shutdown_connections 2024-09-17T05:26:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.995+0000 7ffa450bd640 1 -- 172.21.15.81:0/3852215173 >> 172.21.15.81:0/3852215173 conn(0x7ffa400b1620 msgr2=0x7ffa400b1a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.995+0000 7ffa450bd640 1 -- 172.21.15.81:0/3852215173 shutdown_connections 2024-09-17T05:26:42.997 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.995+0000 7ffa450bd640 1 -- 172.21.15.81:0/3852215173 wait complete. 2024-09-17T05:26:42.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 Processor -- start 2024-09-17T05:26:42.998 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 -- start start 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa28003a00 0x7ffa40147a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4015ce50 0x7ffa401547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa400b3770 0x7ffa400b3bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ffa40072a10 con 0x7ffa400b3770 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ffa400b35f0 con 0x7ffa4015ce50 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.997+0000 7ffa450bd640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ffa40072b90 con 0x7ffa28003a00 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa400b3770 0x7ffa400b3bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa400b3770 0x7ffa400b3bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56056/0 (socket says 172.21.15.81:56056) 2024-09-17T05:26:43.000 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 -- 172.21.15.81:0/4014882841 learned_addr learned my addr 172.21.15.81:0/4014882841 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3e59c640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4015ce50 0x7ffa401547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3ed9d640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa28003a00 0x7ffa40147a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 -- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa28003a00 msgr2=0x7ffa40147a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa28003a00 0x7ffa40147a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 -- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4015ce50 msgr2=0x7ffa401547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ffa4015ce50 0x7ffa401547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 -- 172.21.15.81:0/4014882841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa40154d10 con 0x7ffa400b3770 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3ed9d640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ffa28003a00 0x7ffa40147a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa3f59e640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa400b3770 0x7ffa400b3bb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7ffa400aeb20 tx=0x7ffa3800e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:43.001 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38010890 con 0x7ffa400b3770 2024-09-17T05:26:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ffa38016070 con 0x7ffa400b3770 2024-09-17T05:26:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa4015a8c0 con 0x7ffa400b3770 2024-09-17T05:26:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa38010dc0 con 0x7ffa400b3770 2024-09-17T05:26:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.998+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa4015ae80 con 0x7ffa400b3770 2024-09-17T05:26:43.002 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:42.999+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ffa400b40f0 con 0x7ffa400b3770 2024-09-17T05:26:43.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.000+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7ffa3801b460 con 0x7ffa400b3770 2024-09-17T05:26:43.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.000+0000 7ffa277fe640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffa2c079790 0x7ffa2c07bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.000+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7ffa3809a750 con 0x7ffa400b3770 2024-09-17T05:26:43.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.000+0000 7ffa3ed9d640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffa2c079790 0x7ffa2c07bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.003 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.000+0000 7ffa277fe640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7ffa2c07f680 0x7ffa2c081aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.000+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 --> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ffa38013e70 con 0x7ffa2c07f680 2024-09-17T05:26:43.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.000+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_get_version_reply(handle=1 version=165) ==== 24+0+0 (secure 0 0 0) 0x7ffa3809d470 con 0x7ffa400b3770 2024-09-17T05:26:43.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.001+0000 7ffa3e59c640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7ffa2c07f680 0x7ffa2c081aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.001+0000 7ffa3ed9d640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffa2c079790 0x7ffa2c07bc50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffa30036000 tx=0x7ffa30004a40 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:43.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.001+0000 7ffa3e59c640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7ffa2c07f680 0x7ffa2c081aa0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:43.004 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.002+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== osd.7 v2:172.21.15.160:6802/2017118510 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ffa38013e70 con 0x7ffa2c07f680 2024-09-17T05:26:43.015 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.014+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 --> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7ffa40073120 con 0x7ffa2c07f680 2024-09-17T05:26:43.016 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa277fe640 1 -- 172.21.15.81:0/4014882841 <== osd.7 v2:172.21.15.160:6802/2017118510 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7ffa40073120 con 0x7ffa2c07f680 2024-09-17T05:26:43.016 INFO:teuthology.orchestra.run.smithi081.stdout:{ 2024-09-17T05:26:43.016 INFO:teuthology.orchestra.run.smithi081.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-17T05:26:43.016 INFO:teuthology.orchestra.run.smithi081.stdout:} 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7ffa2c07f680 msgr2=0x7ffa2c081aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.160:6802/2017118510,v1:172.21.15.160:6803/2017118510] conn(0x7ffa2c07f680 0x7ffa2c081aa0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffa2c079790 msgr2=0x7ffa2c07bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ffa2c079790 0x7ffa2c07bc50 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7ffa30036000 tx=0x7ffa30004a40 comp rx=0 tx=0).stop 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa400b3770 msgr2=0x7ffa400b3bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 --2- 172.21.15.81:0/4014882841 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ffa400b3770 0x7ffa400b3bb0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7ffa400aeb20 tx=0x7ffa3800e9a0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa3f59e640 1 -- 172.21.15.81:0/4014882841 reap_dead start 2024-09-17T05:26:43.017 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 shutdown_connections 2024-09-17T05:26:43.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 >> 172.21.15.81:0/4014882841 conn(0x7ffa400b1620 msgr2=0x7ffa400b2cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:43.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 shutdown_connections 2024-09-17T05:26:43.018 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.015+0000 7ffa450bd640 1 -- 172.21.15.81:0/4014882841 wait complete. 2024-09-17T05:26:43.027 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-09-17T05:26:43.129 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.128+0000 7fb844c7f640 1 -- 172.21.15.81:0/1168428758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 msgr2=0x7fb840166a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.128+0000 7fb844c7f640 1 --2- 172.21.15.81:0/1168428758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb840166a60 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fb838009830 tx=0x7fb83802a480 comp rx=0 tx=0).stop 2024-09-17T05:26:43.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.128+0000 7fb844c7f640 1 -- 172.21.15.81:0/1168428758 shutdown_connections 2024-09-17T05:26:43.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.128+0000 7fb844c7f640 1 --2- 172.21.15.81:0/1168428758 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb840166a60 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.128+0000 7fb844c7f640 1 -- 172.21.15.81:0/1168428758 >> 172.21.15.81:0/1168428758 conn(0x7fb84009af50 msgr2=0x7fb8400d1cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:43.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.128+0000 7fb844c7f640 1 -- 172.21.15.81:0/1168428758 shutdown_connections 2024-09-17T05:26:43.130 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.128+0000 7fb844c7f640 1 -- 172.21.15.81:0/1168428758 wait complete. 2024-09-17T05:26:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.129+0000 7fb844c7f640 1 Processor -- start 2024-09-17T05:26:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb844c7f640 1 -- start start 2024-09-17T05:26:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb844c7f640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb8400cb600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb844c7f640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8400cfd10 0x7fb840070bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb844c7f640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb84015f2b0 0x7fb840071130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.133 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb844c7f640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7fb8401671b0 con 0x7fb8400cd730 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb844c7f640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7fb84015f830 con 0x7fb8400cfd10 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb844c7f640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7fb840167330 con 0x7fb84015f2b0 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb83e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb8400cb600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb83e59c640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb8400cb600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:56066/0 (socket says 172.21.15.81:56066) 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb83e59c640 1 -- 172.21.15.81:0/703651622 learned_addr learned my addr 172.21.15.81:0/703651622 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.130+0000 7fb83dd9b640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8400cfd10 0x7fb840070bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83ed9d640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb84015f2b0 0x7fb840071130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83e59c640 1 -- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb84015f2b0 msgr2=0x7fb840071130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83e59c640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb84015f2b0 0x7fb840071130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83e59c640 1 -- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8400cfd10 msgr2=0x7fb840070bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83e59c640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8400cfd10 0x7fb840070bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.134 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83e59c640 1 -- 172.21.15.81:0/703651622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8400b6f60 con 0x7fb8400cd730 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83dd9b640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8400cfd10 0x7fb840070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb83e59c640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb8400cb600 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fb83000cbc0 tx=0x7fb83000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb836ffd640 1 -- 172.21.15.81:0/703651622 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830016020 con 0x7fb8400cd730 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb836ffd640 1 -- 172.21.15.81:0/703651622 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7fb83000ad90 con 0x7fb8400cd730 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8400b66c0 con 0x7fb8400cd730 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb836ffd640 1 -- 172.21.15.81:0/703651622 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb830012680 con 0x7fb8400cd730 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.131+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8400b6c80 con 0x7fb8400cd730 2024-09-17T05:26:43.135 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.132+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8400ce350 con 0x7fb8400cd730 2024-09-17T05:26:43.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.133+0000 7fb836ffd640 1 -- 172.21.15.81:0/703651622 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7fb830019020 con 0x7fb8400cd730 2024-09-17T05:26:43.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.133+0000 7fb836ffd640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb820079760 0x7fb82007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.133+0000 7fb83dd9b640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb820079760 0x7fb82007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.136 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.133+0000 7fb836ffd640 1 -- 172.21.15.81:0/703651622 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7fb830099ef0 con 0x7fb8400cd730 2024-09-17T05:26:43.137 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.134+0000 7fb83dd9b640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb820079760 0x7fb82007bc20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb8400cef30 tx=0x7fb828009040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:43.138 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.137+0000 7fb836ffd640 1 -- 172.21.15.81:0/703651622 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7fb830020020 con 0x7fb8400cd730 2024-09-17T05:26:43.315 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.314+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7fb84015aa70 con 0x7fb820079760 2024-09-17T05:26:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.315+0000 7fb836ffd640 1 -- 172.21.15.81:0/703651622 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb84015aa70 con 0x7fb820079760 2024-09-17T05:26:43.316 INFO:teuthology.orchestra.run.smithi081.stderr:instructed osd(s) 7 to deep-scrub 2024-09-17T05:26:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb820079760 msgr2=0x7fb82007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb820079760 0x7fb82007bc20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fb8400cef30 tx=0x7fb828009040 comp rx=0 tx=0).stop 2024-09-17T05:26:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 msgr2=0x7fb8400cb600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.318 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb8400cb600 secure :-1 s=READY pgs=1983 cs=0 l=1 rev1=1 crypto rx=0x7fb83000cbc0 tx=0x7fb83000a060 comp rx=0 tx=0).stop 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 shutdown_connections 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7fb84015f2b0 0x7fb840071130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7fb820079760 0x7fb82007bc20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7fb8400cfd10 0x7fb840070bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 --2- 172.21.15.81:0/703651622 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7fb8400cd730 0x7fb8400cb600 unknown :-1 s=CLOSED pgs=1983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 >> 172.21.15.81:0/703651622 conn(0x7fb84009af50 msgr2=0x7fb840071d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 shutdown_connections 2024-09-17T05:26:43.319 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.317+0000 7fb844c7f640 1 -- 172.21.15.81:0/703651622 wait complete. 2024-09-17T05:26:43.329 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:26:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/3035625172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 msgr2=0x7f0a440739a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/3035625172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 0x7f0a440739a0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f0a38005fd0 tx=0x7f0a3802a540 comp rx=0 tx=0).stop 2024-09-17T05:26:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/3035625172 shutdown_connections 2024-09-17T05:26:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/3035625172 >> v2:172.21.15.160:3300/0 conn(0x7f0a4406ff80 0x7f0a44070410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/3035625172 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 0x7f0a440739a0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.430 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/3035625172 >> 172.21.15.81:0/3035625172 conn(0x7f0a440b1690 msgr2=0x7f0a440b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/3035625172 shutdown_connections 2024-09-17T05:26:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.429+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/3035625172 wait complete. 2024-09-17T05:26:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.430+0000 7f0a4a2ed640 1 Processor -- start 2024-09-17T05:26:43.431 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.430+0000 7f0a4a2ed640 1 -- start start 2024-09-17T05:26:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a4a2ed640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a4406ff80 0x7f0a44145820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a4a2ed640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 0x7f0a441f0de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a4a2ed640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a4415aa70 0x7f0a441f1320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a4a2ed640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f0a440cd270 con 0x7f0a4406ff80 2024-09-17T05:26:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a4a2ed640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f0a440cd0f0 con 0x7f0a4415aa70 2024-09-17T05:26:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a4a2ed640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f0a440cd3f0 con 0x7f0a440735a0 2024-09-17T05:26:43.433 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a4406ff80 0x7f0a44145820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a4406ff80 0x7f0a44145820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:34026/0 (socket says 172.21.15.81:34026) 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 -- 172.21.15.81:0/1853656146 learned_addr learned my addr 172.21.15.81:0/1853656146 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a4888a640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a4415aa70 0x7f0a441f1320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a437fe640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 0x7f0a441f0de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 -- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 msgr2=0x7f0a441f0de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 0x7f0a441f0de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 -- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a4415aa70 msgr2=0x7f0a441f1320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a4415aa70 0x7f0a441f1320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.431+0000 7f0a43fff640 1 -- 172.21.15.81:0/1853656146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a44145d60 con 0x7f0a4406ff80 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.432+0000 7f0a43fff640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a4406ff80 0x7f0a44145820 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c430 tx=0x7f0a3400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.432+0000 7f0a40ff9640 1 -- 172.21.15.81:0/1853656146 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a340052d0 con 0x7f0a4406ff80 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.432+0000 7f0a40ff9640 1 -- 172.21.15.81:0/1853656146 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f0a34005490 con 0x7f0a4406ff80 2024-09-17T05:26:43.434 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.432+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a44154a50 con 0x7f0a4406ff80 2024-09-17T05:26:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.432+0000 7f0a40ff9640 1 -- 172.21.15.81:0/1853656146 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a34010900 con 0x7f0a4406ff80 2024-09-17T05:26:43.435 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.432+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a441f2000 con 0x7f0a4406ff80 2024-09-17T05:26:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.433+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0a440cd910 con 0x7f0a4406ff80 2024-09-17T05:26:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.433+0000 7f0a40ff9640 1 -- 172.21.15.81:0/1853656146 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f0a34010aa0 con 0x7f0a4406ff80 2024-09-17T05:26:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.434+0000 7f0a40ff9640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a30079760 0x7f0a3007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:26:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.434+0000 7f0a437fe640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a30079760 0x7f0a3007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:26:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.434+0000 7f0a40ff9640 1 -- 172.21.15.81:0/1853656146 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f0a3409aea0 con 0x7f0a4406ff80 2024-09-17T05:26:43.436 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.435+0000 7f0a437fe640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a30079760 0x7f0a3007bc20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0a38033000 tx=0x7f0a38004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:26:43.439 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.438+0000 7f0a40ff9640 1 -- 172.21.15.81:0/1853656146 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f0a34064cd0 con 0x7f0a4406ff80 2024-09-17T05:26:43.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.612+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f0a44159460 con 0x7f0a30079760 2024-09-17T05:26:43.613 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.612+0000 7f0a40ff9640 1 -- 172.21.15.81:0/1853656146 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13465 (secure 0 0 0) 0x7f0a44159460 con 0x7f0a30079760 2024-09-17T05:26:43.614 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:26:43.614 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a30079760 msgr2=0x7f0a3007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a30079760 0x7f0a3007bc20 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f0a38033000 tx=0x7f0a38004730 comp rx=0 tx=0).stop 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a4406ff80 msgr2=0x7f0a44145820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a4406ff80 0x7f0a44145820 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f0a3400c430 tx=0x7f0a3400c830 comp rx=0 tx=0).stop 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 shutdown_connections 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f0a30079760 0x7f0a3007bc20 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.616 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f0a4415aa70 0x7f0a441f1320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f0a440735a0 0x7f0a441f0de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 --2- 172.21.15.81:0/1853656146 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f0a4406ff80 0x7f0a44145820 unknown :-1 s=CLOSED pgs=1984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:26:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 >> 172.21.15.81:0/1853656146 conn(0x7f0a440b1690 msgr2=0x7f0a44072860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:26:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 shutdown_connections 2024-09-17T05:26:43.617 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:26:43.615+0000 7f0a4a2ed640 1 -- 172.21.15.81:0/1853656146 wait complete. 2024-09-17T05:26:43.626 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":216,"stamp":"2024-09-17T05:26:42.068117+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271136,"kb_used_data":17448,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703584,"statfs":{"total":773094113280,"available":772816470016,"internally_reserved":0,"allocated":17866752,"data_stored":8533064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-53146,"num_objects":-24,"num_object_clones":0,"num_object_copies":-48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-24,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-71,"num_write_kb":-78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001098"},"pg_stats":[{"pgid":"1.0","version":"72'79","reported_seq":395,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T05:26:36.744719+0000","last_change":"2024-09-17T05:18:39.531324+0000","last_active":"2024-09-17T05:26:36.744719+0000","last_peered":"2024-09-17T05:26:36.744719+0000","last_clean":"2024-09-17T05:26:36.744719+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:26:36.744719+0000","last_undegraded":"2024-09-17T05:26:36.744719+0000","last_fullsized":"2024-09-17T05:26:36.744719+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-17T05:18:38.071071+0000","last_clean_scrub_stamp":"2024-09-17T05:18:38.071071+0000","objects_scrubbed":0,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T06:16:15.541496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":79,"ondisk_log_size":79,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509541,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33808,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338032,"statfs":{"total":96636764160,"available":96602144768,"internally_reserved":0,"allocated":2678784,"data_stored":1509409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509541,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509540,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574949,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37968,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333872,"statfs":{"total":96636764160,"available":96597884928,"internally_reserved":0,"allocated":2678784,"data_stored":1509409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:26:43.630 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-17T05:18:38.071071+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=18, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=17, tm_hour=5, tm_min=26, tm_sec=38, tm_wday=1, tm_yday=261, tm_isdst=0) 2024-09-17T05:26:43.630 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-17T05:26:46.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:26:46.181 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:27:03.632 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-17T05:27:03.751 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 -- 172.21.15.81:0/1261223971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e04151370 msgr2=0x7f4e040cef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 --2- 172.21.15.81:0/1261223971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e04151370 0x7f4e040cef30 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f4e040cc0c0 tx=0x7f4df402a560 comp rx=0 tx=0).stop 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 -- 172.21.15.81:0/1261223971 shutdown_connections 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 --2- 172.21.15.81:0/1261223971 >> v2:172.21.15.160:3300/0 conn(0x7f4e040725a0 0x7f4e04072a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 --2- 172.21.15.81:0/1261223971 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e040b3140 0x7f4e040cf470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 --2- 172.21.15.81:0/1261223971 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e04151370 0x7f4e040cef30 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 -- 172.21.15.81:0/1261223971 >> 172.21.15.81:0/1261223971 conn(0x7f4e040b1690 msgr2=0x7f4e040b1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 -- 172.21.15.81:0/1261223971 shutdown_connections 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.745+0000 7f4e0a375640 1 -- 172.21.15.81:0/1261223971 wait complete. 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.746+0000 7f4e0a375640 1 Processor -- start 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.747+0000 7f4e0a375640 1 -- start start 2024-09-17T05:27:03.752 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.747+0000 7f4e0a375640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e040725a0 0x7f4e041476a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.747+0000 7f4e0a375640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e040b3140 0x7f4e04153db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.747+0000 7f4e0a375640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e04151370 0x7f4e0413e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.747+0000 7f4e0a375640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0406ea20 con 0x7f4e040b3140 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.747+0000 7f4e0a375640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f4e0406e8a0 con 0x7f4e040725a0 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.747+0000 7f4e0a375640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f4e0406eba0 con 0x7f4e04151370 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e040b3140 0x7f4e04153db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e040b3140 0x7f4e04153db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45364/0 (socket says 172.21.15.81:45364) 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 -- 172.21.15.81:0/358858149 learned_addr learned my addr 172.21.15.81:0/358858149 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e03fff640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e040725a0 0x7f4e041476a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e08912640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e04151370 0x7f4e0413e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 -- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e04151370 msgr2=0x7f4e0413e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e04151370 0x7f4e0413e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.753 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 -- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e040725a0 msgr2=0x7f4e041476a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e040725a0 0x7f4e041476a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 -- 172.21.15.81:0/358858149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e040b37c0 con 0x7f4e040b3140 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e037fe640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e040b3140 0x7f4e04153db0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b4a0 tx=0x7f4df800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e00ff9640 1 -- 172.21.15.81:0/358858149 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8014070 con 0x7f4e040b3140 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e00ff9640 1 -- 172.21.15.81:0/358858149 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7f4df8010700 con 0x7f4e040b3140 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e040b3aa0 con 0x7f4e040b3140 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e00ff9640 1 -- 172.21.15.81:0/358858149 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4df8010b50 con 0x7f4e040b3140 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.748+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e04147be0 con 0x7f4e040b3140 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.749+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4e04072a10 con 0x7f4e040b3140 2024-09-17T05:27:03.754 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.750+0000 7f4e00ff9640 1 -- 172.21.15.81:0/358858149 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f4df8017070 con 0x7f4e040b3140 2024-09-17T05:27:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.750+0000 7f4e00ff9640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4df0079790 0x7f4df007bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.751+0000 7f4e03fff640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4df0079790 0x7f4df007bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.751+0000 7f4e00ff9640 1 -- 172.21.15.81:0/358858149 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f4df80992c0 con 0x7f4e040b3140 2024-09-17T05:27:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.751+0000 7f4e03fff640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4df0079790 0x7f4df007bc50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4df4033000 tx=0x7f4df4004730 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:27:03.755 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.755+0000 7f4e00ff9640 1 -- 172.21.15.81:0/358858149 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f4df8062990 con 0x7f4e040b3140 2024-09-17T05:27:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.928+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 --> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f4e040b3ea0 con 0x7f4df0079790 2024-09-17T05:27:03.929 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.928+0000 7f4e00ff9640 1 -- 172.21.15.81:0/358858149 <== mgr.4119 v2:172.21.15.81:6836/4249619124 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+13370 (secure 0 0 0) 0x7f4df4004470 con 0x7f4df0079790 2024-09-17T05:27:03.930 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:27:03.930 INFO:teuthology.orchestra.run.smithi081.stderr:dumped all 2024-09-17T05:27:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4df0079790 msgr2=0x7f4df007bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:03.931 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4df0079790 0x7f4df007bc50 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f4df4033000 tx=0x7f4df4004730 comp rx=0 tx=0).stop 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e040b3140 msgr2=0x7f4e04153db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e040b3140 0x7f4e04153db0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f4df800b4a0 tx=0x7f4df800b960 comp rx=0 tx=0).stop 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 shutdown_connections 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f4e04151370 0x7f4e0413e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f4e040b3140 0x7f4e04153db0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f4df0079790 0x7f4df007bc50 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 --2- 172.21.15.81:0/358858149 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f4e040725a0 0x7f4e041476a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 >> 172.21.15.81:0/358858149 conn(0x7f4e040b1690 msgr2=0x7f4e040b0050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 shutdown_connections 2024-09-17T05:27:03.932 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:03.930+0000 7f4e0a375640 1 -- 172.21.15.81:0/358858149 wait complete. 2024-09-17T05:27:03.942 INFO:teuthology.orchestra.run.smithi081.stdout:{"pg_ready":true,"pg_map":{"version":226,"stamp":"2024-09-17T05:27:02.072323+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":2,"kb":754974720,"kb_used":271120,"kb_used_data":17448,"kb_used_omap":12,"kb_used_meta":253491,"kb_avail":754703600,"statfs":{"total":773094113280,"available":772816486400,"internally_reserved":0,"allocated":17866752,"data_stored":8533064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":259575344},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002655"},"pg_stats":[{"pgid":"1.0","version":"165'81","reported_seq":406,"reported_epoch":165,"state":"active+clean","last_fresh":"2024-09-17T05:26:44.163235+0000","last_change":"2024-09-17T05:26:44.163177+0000","last_active":"2024-09-17T05:26:44.163235+0000","last_peered":"2024-09-17T05:26:44.163235+0000","last_clean":"2024-09-17T05:26:44.163235+0000","last_became_active":"2024-09-17T05:18:39.530192+0000","last_became_peered":"2024-09-17T05:18:39.530192+0000","last_unstale":"2024-09-17T05:26:44.163235+0000","last_undegraded":"2024-09-17T05:26:44.163235+0000","last_fullsized":"2024-09-17T05:26:44.163235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"165'81","last_scrub_stamp":"2024-09-17T05:26:44.163078+0000","last_deep_scrub":"165'81","last_deep_scrub_stamp":"2024-09-17T05:26:44.163078+0000","last_clean_scrub_stamp":"2024-09-17T05:26:44.163078+0000","objects_scrubbed":2,"log_size":81,"log_dups_size":0,"ondisk_log_size":81,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-18T05:27:35.853283+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":126,"num_read_kb":231,"num_write":113,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":81,"ondisk_log_size":81,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":15,"seq":64424509545,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":33800,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338040,"statfs":{"total":96636764160,"available":96602152960,"internally_reserved":0,"allocated":2678784,"data_stored":1509409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":15,"seq":64424509545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":15,"seq":64424509545,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33228,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338612,"statfs":{"total":96636764160,"available":96602738688,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":15,"seq":64424509544,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":33224,"kb_used_data":2036,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94338616,"statfs":{"total":96636764160,"available":96602742784,"internally_reserved":0,"allocated":2084864,"data_stored":919041,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574953,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37960,"kb_used_data":2616,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94333880,"statfs":{"total":96636764160,"available":96597893120,"internally_reserved":0,"allocated":2678784,"data_stored":1509409,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-17T05:27:03.943 DEBUG:teuthology.orchestra.run.smithi081:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-17T05:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.046+0000 7ff073dda640 1 -- 172.21.15.81:0/4097219448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 msgr2=0x7ff05800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.046+0000 7ff073dda640 1 --2- 172.21.15.81:0/4097219448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff05800b9c0 secure :-1 s=READY pgs=1988 cs=0 l=1 rev1=1 crypto rx=0x7ff064001d90 tx=0x7ff058005830 comp rx=0 tx=0).stop 2024-09-17T05:27:04.047 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.046+0000 7ff073dda640 1 -- 172.21.15.81:0/4097219448 shutdown_connections 2024-09-17T05:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.046+0000 7ff073dda640 1 --2- 172.21.15.81:0/4097219448 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff05800b9c0 unknown :-1 s=CLOSED pgs=1988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.046+0000 7ff073dda640 1 -- 172.21.15.81:0/4097219448 >> 172.21.15.81:0/4097219448 conn(0x7ff06c0d3e30 msgr2=0x7ff06c0d4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.046+0000 7ff073dda640 1 -- 172.21.15.81:0/4097219448 shutdown_connections 2024-09-17T05:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.046+0000 7ff073dda640 1 -- 172.21.15.81:0/4097219448 wait complete. 2024-09-17T05:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.047+0000 7ff073dda640 1 Processor -- start 2024-09-17T05:27:04.048 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.047+0000 7ff073dda640 1 -- start start 2024-09-17T05:27:04.050 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff073dda640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff06c15eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff073dda640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c0c7960 0x7ff06c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff073dda640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c0cbfa0 0x7ff06c0cc450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff073dda640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0d2170 con 0x7ff0580052e0 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff073dda640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7ff06c0d1ff0 con 0x7ff06c0cbfa0 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff073dda640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7ff06c0d22f0 con 0x7ff06c0c7960 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071b76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff06c15eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071b76640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff06c15eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45376/0 (socket says 172.21.15.81:45376) 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071b76640 1 -- 172.21.15.81:0/3861471200 learned_addr learned my addr 172.21.15.81:0/3861471200 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff072377640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c0cbfa0 0x7ff06c0cc450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.051 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071375640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c0c7960 0x7ff06c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071b76640 1 -- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c0c7960 msgr2=0x7ff06c0c7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071b76640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c0c7960 0x7ff06c0c7dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071b76640 1 -- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c0cbfa0 msgr2=0x7ff06c0cc450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.048+0000 7ff071b76640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c0cbfa0 0x7ff06c0cc450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.049+0000 7ff071b76640 1 -- 172.21.15.81:0/3861471200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff06c0caf00 con 0x7ff0580052e0 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.049+0000 7ff071b76640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff06c15eac0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7ff0680117d0 tx=0x7ff068011c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.049+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff068004460 con 0x7ff0580052e0 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.049+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(5 keys) ==== 141+0+0 (secure 0 0 0) 0x7ff068016070 con 0x7ff0580052e0 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.049+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff06c0cb1e0 con 0x7ff0580052e0 2024-09-17T05:27:04.052 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.049+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff06800fb60 con 0x7ff0580052e0 2024-09-17T05:27:04.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.049+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff06c0cb7a0 con 0x7ff0580052e0 2024-09-17T05:27:04.053 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.050+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff06c0d2850 con 0x7ff0580052e0 2024-09-17T05:27:04.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.050+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7ff068018030 con 0x7ff0580052e0 2024-09-17T05:27:04.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.051+0000 7ff0627fc640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff050079760 0x7ff05007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.051+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7ff068099fd0 con 0x7ff0580052e0 2024-09-17T05:27:04.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.051+0000 7ff071375640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff050079760 0x7ff05007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.054 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.052+0000 7ff071375640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff050079760 0x7ff05007bc20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff06c06e200 tx=0x7ff05c006040 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:27:04.056 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.055+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7ff0680636a0 con 0x7ff0580052e0 2024-09-17T05:27:04.242 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.241+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7ff06c0b52c0 con 0x7ff0580052e0 2024-09-17T05:27:04.247 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.246+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v50)=0 v50) ==== 123+0+0 (secure 0 0 0) 0x7ff0680680d0 con 0x7ff0580052e0 2024-09-17T05:27:04.249 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.248+0000 7ff0627fc640 1 -- 172.21.15.81:0/3861471200 <== mon.0 v2:172.21.15.81:3300/0 8 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7ff0680631b0 con 0x7ff0580052e0 2024-09-17T05:27:04.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff050079760 msgr2=0x7ff05007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff050079760 0x7ff05007bc20 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff06c06e200 tx=0x7ff05c006040 comp rx=0 tx=0).stop 2024-09-17T05:27:04.251 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 msgr2=0x7ff06c15eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff06c15eac0 secure :-1 s=READY pgs=1989 cs=0 l=1 rev1=1 crypto rx=0x7ff0680117d0 tx=0x7ff068011c90 comp rx=0 tx=0).stop 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 shutdown_connections 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7ff050079760 0x7ff05007bc20 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7ff06c0cbfa0 0x7ff06c0cc450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7ff06c0c7960 0x7ff06c0c7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 --2- 172.21.15.81:0/3861471200 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7ff0580052e0 0x7ff06c15eac0 unknown :-1 s=CLOSED pgs=1989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 >> 172.21.15.81:0/3861471200 conn(0x7ff06c0d3e30 msgr2=0x7ff06c0b41c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 shutdown_connections 2024-09-17T05:27:04.252 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.250+0000 7ff073dda640 1 -- 172.21.15.81:0/3861471200 wait complete. 2024-09-17T05:27:04.266 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-17T05:27:04.266 DEBUG:teuthology.orchestra.run.smithi081:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-09-17T05:27:04.369 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 -- 172.21.15.81:0/1865192411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b00d49c0 msgr2=0x7f32b00d0630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/1865192411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b00d49c0 0x7f32b00d0630 secure :-1 s=READY pgs=1990 cs=0 l=1 rev1=1 crypto rx=0x7f32b008cf10 tx=0x7f329802a560 comp rx=0 tx=0).stop 2024-09-17T05:27:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 -- 172.21.15.81:0/1865192411 shutdown_connections 2024-09-17T05:27:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/1865192411 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b00d49c0 0x7f32b00d0630 unknown :-1 s=CLOSED pgs=1990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/1865192411 >> v2:172.21.15.160:3300/0 conn(0x7f32b015df90 0x7f32b00cf9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 -- 172.21.15.81:0/1865192411 >> 172.21.15.81:0/1865192411 conn(0x7f32b00d3ea0 msgr2=0x7f32b00d42b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:27:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 -- 172.21.15.81:0/1865192411 shutdown_connections 2024-09-17T05:27:04.370 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.368+0000 7f32b4c6a640 1 -- 172.21.15.81:0/1865192411 wait complete. 2024-09-17T05:27:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 Processor -- start 2024-09-17T05:27:04.371 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 -- start start 2024-09-17T05:27:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 --2- >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32b00d49c0 0x7f32b01607d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.373 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b015df90 0x7f32b015c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 --2- >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b0162480 0x7f32b015caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 -- --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00d0f00 con 0x7f32b015df90 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 -- --> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] -- mon_getmap magic: 0 -- 0x7f32b00d0d80 con 0x7f32b0162480 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.370+0000 7f32b4c6a640 1 -- --> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] -- mon_getmap magic: 0 -- 0x7f32b00b3f10 con 0x7f32b00d49c0 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b015df90 0x7f32b015c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 --2- >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b015df90 0x7f32b015c560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.81:3300/0 says I am v2:172.21.15.81:45394/0 (socket says 172.21.15.81:45394) 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 -- 172.21.15.81:0/864512220 learned_addr learned my addr 172.21.15.81:0/864512220 (peer_addr_for_me v2:172.21.15.81:0/0) 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32aed9d640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b0162480 0x7f32b015caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.374 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32ae59c640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32b00d49c0 0x7f32b01607d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 -- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32b00d49c0 msgr2=0x7f32b01607d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32b00d49c0 0x7f32b01607d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 -- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b0162480 msgr2=0x7f32b015caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b0162480 0x7f32b015caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 -- 172.21.15.81:0/864512220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32b01f8280 con 0x7f32b015df90 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32add9b640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b015df90 0x7f32b015c560 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f3298009850 tx=0x7f3298003c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32a6ffd640 1 -- 172.21.15.81:0/864512220 <== mon.0 v2:172.21.15.81:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f329803f070 con 0x7f32b015df90 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32a6ffd640 1 -- 172.21.15.81:0/864512220 <== mon.0 v2:172.21.15.81:3300/0 2 ==== config(6 keys) ==== 172+0+0 (secure 0 0 0) 0x7f3298004a40 con 0x7f32b015df90 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32b01f8560 con 0x7f32b015df90 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32a6ffd640 1 -- 172.21.15.81:0/864512220 <== mon.0 v2:172.21.15.81:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3298035030 con 0x7f32b015df90 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.371+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32b01f8b20 con 0x7f32b015df90 2024-09-17T05:27:04.375 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.372+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32b00d3370 con 0x7f32b015df90 2024-09-17T05:27:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.373+0000 7f32a6ffd640 1 -- 172.21.15.81:0/864512220 <== mon.0 v2:172.21.15.81:3300/0 4 ==== mgrmap(e 28) ==== 102512+0+0 (secure 0 0 0) 0x7f3298042070 con 0x7f32b015df90 2024-09-17T05:27:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.374+0000 7f32a6ffd640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3290079760 0x7f329007bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-17T05:27:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.374+0000 7f32a6ffd640 1 -- 172.21.15.81:0/864512220 <== mon.0 v2:172.21.15.81:3300/0 5 ==== osd_map(165..165 src has 1..165) ==== 5015+0+0 (secure 0 0 0) 0x7f32980baca0 con 0x7f32b015df90 2024-09-17T05:27:04.376 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.374+0000 7f32ae59c640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3290079760 0x7f329007bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-17T05:27:04.377 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.374+0000 7f32ae59c640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3290079760 0x7f329007bc20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f32b01ebbe0 tx=0x7f32a80075b0 comp rx=0 tx=0).ready entity=mgr.4119 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-17T05:27:04.382 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.381+0000 7f32a6ffd640 1 -- 172.21.15.81:0/864512220 <== mon.0 v2:172.21.15.81:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196836 (secure 0 0 0) 0x7f32b00d3370 con 0x7f32b015df90 2024-09-17T05:27:04.599 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.598+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 --> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f32b00b44f0 con 0x7f32b015df90 2024-09-17T05:27:04.600 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.599+0000 7f32a6ffd640 1 -- 172.21.15.81:0/864512220 <== mon.0 v2:172.21.15.81:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 104 v104) ==== 95+0+3913 (secure 0 0 0) 0x7f32b00ce970 con 0x7f32b015df90 2024-09-17T05:27:04.600 INFO:teuthology.orchestra.run.smithi081.stdout: 2024-09-17T05:27:04.600 INFO:teuthology.orchestra.run.smithi081.stdout:{"epoch":104,"btime":"2024-09-17T05:26:33:782309+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":7864,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6835/2790285877","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6800","nonce":2790285877},{"type":"v1","addr":"172.21.15.160:6835","nonce":2790285877}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":7867,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.160:6834/790920368","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.160:6801","nonce":790920368},{"type":"v1","addr":"172.21.15.160:6834","nonce":790920368}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":97},{"gid":9204,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6834/234206731","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6832","nonce":234206731},{"type":"v1","addr":"172.21.15.81:6834","nonce":234206731}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":96},{"gid":9489,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.81:6835/3724272228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.81:6833","nonce":3724272228},{"type":"v1","addr":"172.21.15.81:6835","nonce":3724272228}]},"join_fscid":-1,"export_targets":[],"features":4540719139924082687,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":104}],"filesystems":[]} 2024-09-17T05:27:04.601 INFO:teuthology.orchestra.run.smithi081.stderr:dumped fsmap epoch 104 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3290079760 msgr2=0x7f329007bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3290079760 0x7f329007bc20 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f32b01ebbe0 tx=0x7f32a80075b0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b015df90 msgr2=0x7f32b015c560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b015df90 0x7f32b015c560 secure :-1 s=READY pgs=1991 cs=0 l=1 rev1=1 crypto rx=0x7f3298009850 tx=0x7f3298003c10 comp rx=0 tx=0).stop 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 shutdown_connections 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:6836/4249619124,v1:172.21.15.81:6837/4249619124] conn(0x7f3290079760 0x7f329007bc20 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3300/0,v1:172.21.15.160:6789/0] conn(0x7f32b0162480 0x7f32b015caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.603 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.81:3300/0,v1:172.21.15.81:6789/0] conn(0x7f32b015df90 0x7f32b015c560 unknown :-1 s=CLOSED pgs=1991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 --2- 172.21.15.81:0/864512220 >> [v2:172.21.15.160:3301/0,v1:172.21.15.160:6790/0] conn(0x7f32b00d49c0 0x7f32b01607d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-17T05:27:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 >> 172.21.15.81:0/864512220 conn(0x7f32b00d3ea0 msgr2=0x7f32b00b0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-17T05:27:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 shutdown_connections 2024-09-17T05:27:04.604 INFO:teuthology.orchestra.run.smithi081.stderr:2024-09-17T05:27:04.601+0000 7f32b4c6a640 1 -- 172.21.15.81:0/864512220 wait complete. 2024-09-17T05:27:04.613 DEBUG:tasks.cephfs.filesystem:already dead... 2024-09-17T05:27:04.614 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-17T05:27:04.614 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-09-17T05:27:04.614 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:04.622 INFO:tasks.ceph.mds.a:Stopped 2024-09-17T05:27:04.623 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-09-17T05:27:04.623 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:04.672 INFO:tasks.ceph.mds.c:Stopped 2024-09-17T05:27:04.673 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-09-17T05:27:04.673 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:04.685 INFO:tasks.ceph.mds.b:Stopped 2024-09-17T05:27:04.685 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-09-17T05:27:04.686 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:04.737 INFO:tasks.ceph.mds.d:Stopped 2024-09-17T05:27:04.737 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-17T05:27:04.737 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-17T05:27:04.738 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:04.769 INFO:tasks.ceph.osd.0:Stopped 2024-09-17T05:27:04.769 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-17T05:27:04.769 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:04.848 INFO:tasks.ceph.osd.1:Stopped 2024-09-17T05:27:04.848 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-17T05:27:04.849 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:04.925 INFO:tasks.ceph.osd.2:Stopped 2024-09-17T05:27:04.926 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-17T05:27:04.926 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.003 INFO:tasks.ceph.osd.3:Stopped 2024-09-17T05:27:05.003 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-09-17T05:27:05.003 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.039 INFO:tasks.ceph.osd.4:Stopped 2024-09-17T05:27:05.040 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-09-17T05:27:05.040 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.109 INFO:tasks.ceph.osd.5:Stopped 2024-09-17T05:27:05.109 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-09-17T05:27:05.109 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.176 INFO:tasks.ceph.osd.6:Stopped 2024-09-17T05:27:05.176 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-09-17T05:27:05.176 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.245 INFO:tasks.ceph.osd.7:Stopped 2024-09-17T05:27:05.246 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-17T05:27:05.246 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-09-17T05:27:05.247 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.277 INFO:tasks.ceph.mgr.y:Stopped 2024-09-17T05:27:05.277 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-17T05:27:05.277 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.314 INFO:tasks.ceph.mgr.x:Stopped 2024-09-17T05:27:05.314 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-17T05:27:05.315 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-17T05:27:05.315 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.329 INFO:tasks.ceph.mon.a:Stopped 2024-09-17T05:27:05.329 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-09-17T05:27:05.329 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.368 INFO:tasks.ceph.mon.b:Stopped 2024-09-17T05:27:05.368 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-09-17T05:27:05.368 INFO:teuthology.orchestra.run:waiting for 300 2024-09-17T05:27:05.422 INFO:tasks.ceph.mon.c:Stopped 2024-09-17T05:27:05.422 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-17T05:27:05.422 DEBUG:teuthology.orchestra.run.smithi081:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v 'fs.*is degraded' | egrep -v 'filesystem is degraded' | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v 'filesystem is offline' | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v 'insufficient standby MDS daemons available' | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | head -n 1 2024-09-17T05:27:05.462 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:27:05.463 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-17T05:27:05.678 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:27:05.678 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-17T05:27:05.854 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:27:05.854 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-17T05:27:05.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:27:05.912 DEBUG:teuthology.orchestra.run.smithi081:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-17T05:27:05.960 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:27:05.960 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-09-17T05:27:06.093 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:27:06.094 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-09-17T05:27:06.161 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:27:06.162 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-09-17T05:27:06.221 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:27:06.221 DEBUG:teuthology.orchestra.run.smithi160:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-09-17T05:27:06.277 INFO:tasks.ceph:Archiving mon data... 2024-09-17T05:27:06.278 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/data/mon.a.tgz 2024-09-17T05:27:06.278 DEBUG:teuthology.orchestra.run.smithi081:> mktemp 2024-09-17T05:27:06.294 INFO:teuthology.orchestra.run.smithi081.stdout:/tmp/tmp.VJki0MEG6K 2024-09-17T05:27:06.294 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.VJki0MEG6K 2024-09-17T05:27:06.578 DEBUG:teuthology.orchestra.run.smithi081:> sudo chmod 0666 /tmp/tmp.VJki0MEG6K 2024-09-17T05:27:06.660 DEBUG:teuthology.orchestra.remote:smithi081:/tmp/tmp.VJki0MEG6K is 1MB 2024-09-17T05:27:06.771 DEBUG:teuthology.orchestra.run.smithi081:> rm -fr /tmp/tmp.VJki0MEG6K 2024-09-17T05:27:06.786 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/data/mon.b.tgz 2024-09-17T05:27:06.786 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-09-17T05:27:06.805 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.O8SxbnsaHk 2024-09-17T05:27:06.805 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.O8SxbnsaHk 2024-09-17T05:27:07.096 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.O8SxbnsaHk 2024-09-17T05:27:07.180 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.O8SxbnsaHk is 1MB 2024-09-17T05:27:07.260 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.O8SxbnsaHk 2024-09-17T05:27:07.275 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/data/mon.c.tgz 2024-09-17T05:27:07.275 DEBUG:teuthology.orchestra.run.smithi160:> mktemp 2024-09-17T05:27:07.330 INFO:teuthology.orchestra.run.smithi160.stdout:/tmp/tmp.ns6CVBB1pO 2024-09-17T05:27:07.330 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.ns6CVBB1pO 2024-09-17T05:27:07.595 DEBUG:teuthology.orchestra.run.smithi160:> sudo chmod 0666 /tmp/tmp.ns6CVBB1pO 2024-09-17T05:27:07.678 DEBUG:teuthology.orchestra.remote:smithi160:/tmp/tmp.ns6CVBB1pO is 1MB 2024-09-17T05:27:07.761 DEBUG:teuthology.orchestra.run.smithi160:> rm -fr /tmp/tmp.ns6CVBB1pO 2024-09-17T05:27:07.777 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-17T05:27:07.777 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:27:07.780 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-17T05:27:07.865 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:27:07.896 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-17T05:27:07.897 INFO:tasks.ceph:Archiving crash dumps... 2024-09-17T05:27:07.898 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/remote/smithi081/crash 2024-09-17T05:27:07.899 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:27:07.932 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/remote/smithi160/crash 2024-09-17T05:27:07.933 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-17T05:27:07.961 INFO:tasks.ceph:Shutting down logrotate 2024-09-17T05:27:07.961 DEBUG:teuthology.orchestra.run.smithi081:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:27:07.977 DEBUG:teuthology.orchestra.run.smithi160:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-09-17T05:27:08.142 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:27:08.168 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-09-17T05:27:08.193 INFO:tasks.ceph:Compressing logs... 2024-09-17T05:27:08.193 DEBUG:teuthology.orchestra.run.smithi081:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:27:08.211 DEBUG:teuthology.orchestra.run.smithi160:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-17T05:27:08.234 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-17T05:27:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78487.log 2024-09-17T05:27:08.235 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-osd.0.log: --verbose -- /var/log/ceph/ceph-client.admin.81282.log 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46725.log 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.46725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.50646.log 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36548.log 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.50646.log: 89.1% -- replaced with /var/log/ceph/ceph-client.1.46725.log.gz 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48692.log 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.36548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.42783.log 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36548.log.gz 2024-09-17T05:27:08.283 INFO:teuthology.orchestra.run.smithi160.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.1.50646.log.gz 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.48692.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.42783.log: /var/log/ceph/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.1.48692.log.gz 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.43970.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.1.42783.log.gz 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36468.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.43970.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.44657.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.36468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36508.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36468.log.gz 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.44657.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36348.log 2024-09-17T05:27:08.284 INFO:teuthology.orchestra.run.smithi160.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.1.43970.log.gz 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.36508.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.45368.log 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36508.log.gz 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.36348.log: gzip -5 --verbose -- 89.1% /var/log/ceph/ceph-client.admin.36301.log 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr: -- replaced with /var/log/ceph/ceph-client.1.44657.log.gz 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.36348.log.gz 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36588.log 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.45368.log: /var/log/ceph/ceph-client.admin.36301.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36301.log.gz 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.36588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.49998.log 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr: 89.2% 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36588.log.gz 2024-09-17T05:27:08.285 INFO:teuthology.orchestra.run.smithi160.stderr: -- replaced with /var/log/ceph/ceph-client.1.45368.log.gz 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.48062.log 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.c.log: gzip/var/log/ceph/ceph-client.1.49998.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36388.log 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.48062.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.1.49998.log.gz 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.admin.36388.log: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr: -- replaced with /var/log/ceph/ceph-client.1.48062.log.gz 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.6.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36388.log.gz 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.3.43234.log 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph.log: 93.7% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr: 92.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-09-17T05:27:08.286 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.3.43234.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-17T05:27:08.287 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mds.d.log: 87.3% -- replaced with /var/log/ceph/ceph-client.3.43234.log.gz 2024-09-17T05:27:08.287 INFO:teuthology.orchestra.run.smithi160.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-09-17T05:27:08.289 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.46033.log 2024-09-17T05:27:08.297 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.47395.log 2024-09-17T05:27:08.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.46033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.1.49336.log 2024-09-17T05:27:08.304 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.47395.log: 89.1% -- replaced with /var/log/ceph/ceph-client.1.46033.log.gz 2024-09-17T05:27:08.310 INFO:teuthology.orchestra.run.smithi160.stderr: 91.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36428.log 2024-09-17T05:27:08.311 INFO:teuthology.orchestra.run.smithi160.stderr: -- replaced with /var/log/ceph/ceph-client.1.47395.log.gz 2024-09-17T05:27:08.325 INFO:teuthology.orchestra.run.smithi160.stderr:/var/log/ceph/ceph-client.1.49336.log: 89.2%/var/log/ceph/ceph-client.admin.36428.log: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.36428.log.gz 2024-09-17T05:27:08.325 INFO:teuthology.orchestra.run.smithi160.stderr: -- replaced with /var/log/ceph/ceph-client.1.49336.log.gz 2024-09-17T05:27:08.426 INFO:teuthology.orchestra.run.smithi160.stderr: 92.4% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-17T05:27:08.539 INFO:teuthology.orchestra.run.smithi160.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-09-17T05:27:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58786.log 2024-09-17T05:27:08.585 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.78487.log.gz 2024-09-17T05:27:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81282.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47523.log 2024-09-17T05:27:08.585 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.81282.log.gz 2024-09-17T05:27:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50050.log 2024-09-17T05:27:08.585 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58786.log: /var/log/ceph/ceph-client.admin.47523.log: 87.5%gzip -- replaced with /var/log/ceph/ceph-client.admin.58786.log.gz 2024-09-17T05:27:08.585 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.83584.log 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47523.log.gz 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63287.log 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50050.log.gz 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66863.log 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83584.log.gz 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63287.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73351.log 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63287.log.gz 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49134.log 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66863.log.gz 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73351.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47735.log 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.73351.log.gz 2024-09-17T05:27:08.586 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63198.log 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49134.log.gz 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72328.log 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47735.log.gz 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63198.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82504.log 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63198.log.gz 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72328.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47438.log 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.72328.log.gz 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82504.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80070.log 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82504.log.gz 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67158.log 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80070.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47438.log.gz 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57993.log 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80070.log.gz 2024-09-17T05:27:08.587 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67158.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36828.log 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.67158.log.gz 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74816.log 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57993.log: /var/log/ceph/ceph-client.admin.36828.log: 87.1%gzip -- replaced with /var/log/ceph/ceph-client.admin.57993.log.gz 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.47989.log 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.36828.log.gz 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60453.log 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74816.log.gz 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62209.log 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47989.log.gz 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60453.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55116.log 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60453.log.gz 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73938.log 2024-09-17T05:27:08.588 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62209.log.gz 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36824.log 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.55116.log.gz 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73938.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71238.log 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.73938.log.gz 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60626.log 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.36824.log.gz 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66802.log 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71238.log.gz 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73651.log 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60626.log.gz 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66802.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48976.log 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66802.log.gz 2024-09-17T05:27:08.589 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81990.log 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.73651.log.gz 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48976.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57951.log 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.48976.log.gz 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.81990.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56380.log 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57951.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81664.log 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.57951.log.gz 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79621.log 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56380.log.gz 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81664.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64075.log 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79621.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46719.log 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.79621.log.gz 2024-09-17T05:27:08.590 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.81664.log.gz 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.64075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64716.log 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73692.log 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46719.log: /var/log/ceph/ceph-client.admin.64716.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46719.log.gzgzip 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.61792.log 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.64716.log.gz 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73692.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76303.log 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.73692.log.gz 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53311.log 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61792.log: /var/log/ceph/ceph-client.0.76303.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83217.log 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.61792.log.gz 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67912.log 2024-09-17T05:27:08.591 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%/var/log/ceph/ceph-client.admin.83217.log: -- replaced with /var/log/ceph/ceph-client.admin.53311.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51081.log 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83217.log.gz 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69570.log 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.81990.log.gz 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.67912.log.gz 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55757.log 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51081.log: /var/log/ceph/ceph-client.admin.69570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81580.log 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51081.log.gz 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.69570.log.gz 2024-09-17T05:27:08.592 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55757.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64274.log 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55757.log.gz 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.58445.log 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81580.log.gz 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57741.log 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64274.log.gz 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84401.log 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.58445.log: /var/log/ceph/ceph-client.admin.57741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57741.log.gz 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84401.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43632.log 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84401.log.gz 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.0.58445.log.gz 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53154.log 2024-09-17T05:27:08.593 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43854.log: /var/log/ceph/ceph-client.admin.43632.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46093.log 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53154.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43632.log.gz 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58686.log 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53154.log.gz 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63114.log 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr: 92.3% -- replaced with /var/log/ceph/ceph-client.0.76303.log.gz 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63815.log 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46093.log.gz 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58686.log: /var/log/ceph/ceph-client.admin.63114.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68466.log 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.58686.log.gz 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63815.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63114.log.gz 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59945.log 2024-09-17T05:27:08.594 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.63815.log.gz 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36374.log 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68466.log: /var/log/ceph/ceph-client.admin.59945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56945.log 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68466.log.gz 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59945.log.gz 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51900.log 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36374.log.gz 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68080.log 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56945.log.gz 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61017.log 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51900.log.gz 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59579.log 2024-09-17T05:27:08.595 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68080.log.gz 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70631.log 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61017.log: /var/log/ceph/ceph-client.admin.59579.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52888.log 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.61017.log.gz 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59579.log.gz 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70631.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72016.log 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70631.log.gz 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54798.log 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52888.log: /var/log/ceph/ceph-client.admin.72016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77932.log 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.52888.log.gz 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54798.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.72016.log.gz 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80406.log 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54798.log.gz 2024-09-17T05:27:08.596 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63707.log 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77932.log: /var/log/ceph/ceph-client.admin.80406.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62013.log 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77932.log.gz 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80406.log.gz 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62335.log 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.63707.log.gz 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53437.log 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.62013.log.gz 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60029.log 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62335.log.gz 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36753.log 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53437.log: /var/log/ceph/ceph-client.admin.60029.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53437.log.gz 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59519.log 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60029.log.gz 2024-09-17T05:27:08.597 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37392.log 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36753.log: /var/log/ceph/ceph-client.admin.59519.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46642.log 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36753.log.gz 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59519.log.gz 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68877.log 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.37392.log.gz 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57476.log 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46642.log.gz 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74209.log 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68877.log: /var/log/ceph/ceph-client.admin.57476.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42914.log 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.68877.log.gz 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57476.log.gz 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74209.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44188.log 2024-09-17T05:27:08.598 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74209.log.gz 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71112.log 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42914.log: /var/log/ceph/ceph-client.admin.44188.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42914.log.gz 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64358.log 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44188.log.gz 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84258.log 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71112.log: /var/log/ceph/ceph-client.admin.64358.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71028.log 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.71112.log.gz 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64358.log.gz 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63539.log 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84258.log.gz 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83259.log 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71028.log: /var/log/ceph/ceph-client.admin.63539.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76667.log 2024-09-17T05:27:08.599 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71028.log.gz 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.63539.log.gz 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83259.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.83259.log.gz 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76667.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71154.log 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76667.log.gz 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46761.log 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.1.log: /var/log/ceph/ceph-client.admin.71154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43296.log 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71154.log.gz 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46761.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63749.log 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46761.log.gz 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80658.log 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43296.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43296.log.gz 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63749.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83500.log 2024-09-17T05:27:08.600 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57825.log 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80658.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.63749.log.gz 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83500.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80658.log.gz 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52112.log 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83500.log.gz 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78361.log 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57825.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.57825.log.gz 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72937.log 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52112.log.gz 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76721.log 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78361.log: /var/log/ceph/ceph-client.admin.72937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71417.log 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78361.log.gz 2024-09-17T05:27:08.601 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72937.log.gz 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76721.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55963.log 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.76721.log.gz 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71417.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37100.log 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71417.log.gz 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55963.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67534.log 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55963.log.gz 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47481.log 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.37100.log.gz/var/log/ceph/ceph-client.admin.67534.log: 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43674.log 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67534.log.gz 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47649.log 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47481.log.gz 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43674.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65365.log 2024-09-17T05:27:08.602 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43674.log.gz 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47649.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82862.log 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65365.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47649.log.gz 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50997.log 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.65365.log.gz 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82862.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49255.log 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50997.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82862.log.gz 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66947.log 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.50997.log.gz 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49255.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64493.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49255.log.gz 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66947.log: gzip -5 86.7% --verbose -- replaced with /var/log/ceph/ceph-client.admin.66947.log.gz -- 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.56861.log 2024-09-17T05:27:08.603 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64493.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81538.log 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56861.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.64493.log.gz 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55921.log 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56861.log.gz 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81538.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73064.log 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81538.log.gz 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55921.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81412.log 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55921.log.gz 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73064.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59758.log 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.73064.log.gz 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56506.log 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.81412.log.gz 2024-09-17T05:27:08.604 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59758.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57783.log 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59758.log.gz 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58077.log 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56506.log: /var/log/ceph/ceph-client.admin.57783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71497.log 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56506.log.gz 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57783.log.gz 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58077.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83542.log 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58077.log.gz 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68256.log 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71497.log: /var/log/ceph/ceph-client.admin.83542.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81370.log 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71497.log.gz 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68256.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83542.log.gz 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56464.log 2024-09-17T05:27:08.605 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68256.log.gz 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82988.log 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56464.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81370.log.gz 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84132.log 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56464.log.gz 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82988.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58922.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82988.log.gz 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84132.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46219.log 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.84132.log.gz 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73105.log 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.58922.log.gz 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46219.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80322.log 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46219.log.gz 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74900.log 2024-09-17T05:27:08.606 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73105.log: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.73105.log.gz 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80322.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55575.log 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83880.log 86.8% 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80322.log.gz 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74900.log: /var/log/ceph/ceph-client.admin.55575.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74900.log.gz 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48325.log 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.55575.log.gz 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65247.log 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83880.log: /var/log/ceph/ceph-client.admin.48325.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63623.log 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83880.log.gz 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48325.log.gz 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74335.log 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43853.log 2024-09-17T05:27:08.607 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4%/var/log/ceph/ceph-client.admin.63623.log: -- replaced with /var/log/ceph/ceph-client.admin.65247.log.gz 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.63623.log.gz 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74335.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75767.log 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.72058.log 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.74335.log.gz 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43853.log: /var/log/ceph/ceph-client.admin.75767.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43853.log.gz 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69486.log 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75767.log.gz 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53666.log 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69528.log 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72058.log.gz 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53666.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69486.log.gz 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71802.log 2024-09-17T05:27:08.608 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.53666.log.gz 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69528.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47565.log 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69528.log.gz 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45857.log 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71802.log: /var/log/ceph/ceph-client.admin.47565.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71802.log.gz 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62606.log 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47565.log.gz 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.45857.log: --verbose -- /var/log/ceph/ceph-client.admin.60677.log 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66905.log 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.45857.log.gz 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60677.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.62606.log.gz 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43254.log 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.60677.log.gz 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76043.log 2024-09-17T05:27:08.609 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.66905.log.gz 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62149.log 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43254.log: /var/log/ceph/ceph-client.admin.76043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48475.log 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43254.log.gz 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.76043.log.gz 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62149.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49714.log 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44640.log 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62149.log.gz/var/log/ceph/ceph-client.admin.48475.log: 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.48475.log.gz 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74858.log 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73815.log 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49714.log.gz 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44640.log: /var/log/ceph/ceph-client.admin.74858.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44640.log.gz 2024-09-17T05:27:08.610 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67702.log 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.74858.log.gz 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80700.log 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73815.log: /var/log/ceph/ceph-client.admin.67702.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83668.log 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.73815.log.gz 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80700.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67702.log.gz 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52498.log 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80700.log.gz 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82588.log 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83668.log.gz 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70172.log 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52498.log: /var/log/ceph/ceph-client.admin.82588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80574.log 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52498.log.gz 2024-09-17T05:27:08.611 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.82588.log.gz 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50913.log 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9%/var/log/ceph/ceph-client.admin.80574.log: -- replaced with /var/log/ceph/ceph-client.admin.70172.log.gz 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80154.log 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.80574.log.gz 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43844.log 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50913.log.gz 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80154.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50134.log 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80154.log.gz 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70757.log 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43844.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43844.log.gz 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63033.log 2024-09-17T05:27:08.612 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.52950.log 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.50134.log.gz 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70757.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70757.log.gz 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63033.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48892.log 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82820.log 87.4% 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.63033.log.gz 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52950.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52950.log.gz 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48892.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56422.log 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66989.log 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48892.log.gz 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82820.log: /var/log/ceph/ceph-client.admin.56422.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.82820.log.gz 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84090.log 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56422.log.gz 2024-09-17T05:27:08.613 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70573.log 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66989.log: /var/log/ceph/ceph-client.admin.84090.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65065.log 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66989.log.gz 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70573.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84090.log.gz 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36466.log 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.70573.log.gz 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56777.log 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.65065.log.gz 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68337.log 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36466.log: 77.4% -- replaced with /var/log/ceph/ceph-client.admin.36466.log.gz 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56777.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50176.log 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56777.log.gz 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63329.log 2024-09-17T05:27:08.614 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68337.log: /var/log/ceph/ceph-client.admin.50176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80238.log 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68337.log.gz 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50176.log.gz 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47396.log 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63329.log.gz 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71974.log 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80238.log: 93.2% -- replaced with /var/log/ceph/ceph-client.0.64075.log.gz 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80238.log.gz 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47396.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64316.log 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53479.log 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47396.log.gz 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71974.log: /var/log/ceph/ceph-client.admin.64316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53269.log 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.71974.log.gz 2024-09-17T05:27:08.615 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.64316.log.gz 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75557.log 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53479.log.gz 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46177.log 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53269.log.gz 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36410.log 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75557.log.gz 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46177.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43380.log 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46177.log.gz 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74419.log 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr: 76.4% -- replaced with /var/log/ceph/ceph-client.admin.36410.log.gz 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76763.log 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43380.log.gz 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45317.log 2024-09-17T05:27:08.616 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74419.log.gz 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76763.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64547.log 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76763.log.gz 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54612.log 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45317.log.gz 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69003.log 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.64547.log.gz 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70799.log 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54612.log.gz 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69003.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50783.log 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70799.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77536.log 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.69003.log.gz 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70799.log.gz 2024-09-17T05:27:08.617 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50783.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83072.log 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50783.log.gz 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36629.log 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77536.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52436.log 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83072.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77536.log.gz 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9%/var/log/ceph/ceph-client.admin.36629.log: -- replaced with /var/log/ceph/ceph-client.admin.83072.log.gz 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57261.log 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.36629.log.gz 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52436.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77578.log 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.52436.log.gz 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57261.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43506.log 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57261.log.gz 2024-09-17T05:27:08.618 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77578.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63665.log 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6%/var/log/ceph/ceph-client.admin.43506.log: -- replaced with /var/log/ceph/ceph-client.admin.77578.log.gz 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62091.log 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.43506.log.gz 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55860.log 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63665.log.gz 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62091.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83922.log 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55860.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.62091.log.gz 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58602.log 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55860.log.gz 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61710.log 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83922.log.gz 2024-09-17T05:27:08.619 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58602.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56987.log 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.58602.log.gz 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61710.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67828.log 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.61710.log.gz 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56987.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60292.log 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56987.log.gz 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67828.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53834.log 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67828.log.gz 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60292.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62522.log 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60292.log.gz 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53834.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47691.log 2024-09-17T05:27:08.620 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53834.log.gz 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62522.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43044.log 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47691.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.62522.log.gz 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72478.log 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47691.log.gz 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43044.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49672.log 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43044.log.gz 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72478.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73022.log 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49672.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72478.log.gz 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48031.log 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49672.log.gz 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73022.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84216.log 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.73022.log.gz 2024-09-17T05:27:08.621 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48031.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55008.log 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84216.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48031.log.gz 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48199.log 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.84216.log.gz 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63156.log 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.55008.log.gz 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48199.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81622.log 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63156.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.48199.log.gz 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54966.log 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63156.log.gz 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80837.log 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81622.log.gz 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54966.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53571.log 2024-09-17T05:27:08.622 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54966.log.gz 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80837.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36833.log 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80837.log.gz 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70715.log 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53571.log.gz 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36833.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78655.log 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.36833.log.gz 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70715.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59214.log 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.70715.log.gz 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78655.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67870.log 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78655.log.gz 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52764.log 2024-09-17T05:27:08.623 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59214.log.gz 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67870.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53792.log 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.67870.log.gz 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52764.log: /var/log/ceph/ceph.audit.log 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52764.log.gz 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53792.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84443.log 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.audit.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.53792.log.gz 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74293.log 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46009.log 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.84443.log.gz 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84048.log 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74293.log.gz 2024-09-17T05:27:08.624 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82904.log 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46009.log: /var/log/ceph/ceph-client.admin.84048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46492.log 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.46009.log.gz 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82904.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84048.log.gz 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78613.log 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82904.log.gz 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57699.log 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46492.log.gz 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78613.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36438.log 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%gzip -- replaced with /var/log/ceph/ceph-client.admin.78613.log.gz -5 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.53353.log 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57699.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57699.log.gz 2024-09-17T05:27:08.625 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36438.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77106.log 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36438.log.gz 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.53353.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.60975.log 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr: 89.8% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53353.log.gz 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77106.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77662.log 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.77106.log.gz 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67954.log 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60975.log: /var/log/ceph/ceph-client.admin.77662.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.60975.log.gz 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83753.log 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.77662.log.gz 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67954.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58844.log 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67954.log.gz 2024-09-17T05:27:08.626 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83753.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73897.log 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83753.log.gz 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62251.log 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58844.log.gz 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73897.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36568.log 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.73897.log.gz 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62251.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78027.log 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62251.log.gz 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36568.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77890.log 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.36568.log.gz 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78027.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62953.log 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78027.log.gz 2024-09-17T05:27:08.627 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56606.log 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77890.log.gz 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62953.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66717.log 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62953.log.gz 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54524.log 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56606.log.gz 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65289.log 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.66717.log.gz 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74461.log 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54524.log.gz 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65289.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76885.log 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.65289.log.gz 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74461.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75977.log 2024-09-17T05:27:08.628 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74461.log.gz 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77284.log 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.76885.log.gz 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75977.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54055.log 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77284.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58119.log 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77284.log.gz 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54055.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.75977.log.gz 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60891.log 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54055.log.gz 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58119.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59006.log 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60891.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74073.log 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.60891.log.gz 2024-09-17T05:27:08.629 INFO:teuthology.orchestra.run.smithi081.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.58119.log.gz 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50313.log 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59006.log.gz 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44682.log 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.74073.log.gz 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50313.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43002.log 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.50313.log.gz 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78739.log 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43002.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49630.log 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43002.log.gz 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78739.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44682.log.gz 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44784.log 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.78739.log.gz 2024-09-17T05:27:08.630 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49630.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77452.log 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49630.log.gz 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44784.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60807.log 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44784.log.gz 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44514.log 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.77452.log.gz 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60807.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43422.log 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60807.log.gz 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44514.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48115.log 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44514.log.gz 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43422.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80364.log 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43422.log.gz 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48115.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52640.log 2024-09-17T05:27:08.631 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.48115.log.gz 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68751.log 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.80364.log.gz 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52640.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72142.log 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.52640.log.gz 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71751.log 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68751.log.gz 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72142.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62648.log 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72142.log.gz 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73856.log 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71751.log.gz 2024-09-17T05:27:08.632 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56903.log 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62648.log.gz 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71844.log 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.73856.log.gz 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56903.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74690.log 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56903.log.gz 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71844.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55659.log 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71844.log.gz 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53395.log 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74690.log.gz 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55659.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82231.log 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.55659.log.gz 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36652.log 2024-09-17T05:27:08.633 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53395.log.gz 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.82231.log: --verbose -- /var/log/ceph/ceph-client.admin.43170.log 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36652.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82231.log.gz 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67786.log 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.36652.log.gz 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44176.log 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43170.log.gz 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75683.log 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67786.log.gz 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48157.log 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44176.log.gz 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75683.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83124.log 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.75683.log.gz 2024-09-17T05:27:08.634 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48157.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74995.log 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.48157.log.gz 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52374.log 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.83124.log.gz 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74995.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76460.log 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74995.log.gz 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52374.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67272.log 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52374.log.gz 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76460.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75893.log 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.76460.log.gz 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67272.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58964.log 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67272.log.gz 2024-09-17T05:27:08.635 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56296.log 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.75893.log.gz 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69612.log 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.58964.log.gz 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56296.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63371.log 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56296.log.gz 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69612.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61878.log 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.69612.log.gz 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49018.log 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61878.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49882.log 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.63371.log.gz 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.61878.log.gz 2024-09-17T05:27:08.636 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49018.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57345.log 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49018.log.gz 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56238.log 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.49882.log.gz 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77242.log 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57345.log.gz 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44192.log 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.56238.log.gz 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77242.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76586.log 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77242.log.gz 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44192.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75156.log 2024-09-17T05:27:08.637 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.44192.log.gz 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56651.log 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76586.log: /var/log/ceph/ceph-client.admin.75156.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.76586.log.gz 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70935.log 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75156.log.gz 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51249.log 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56651.log.gz 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63243.log 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.70935.log.gz 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51249.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79755.log 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51249.log.gz 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63243.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56548.log 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63243.log.gz 2024-09-17T05:27:08.638 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51291.log 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.79755.log.gz 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56548.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50741.log 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56548.log.gz 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51291.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62479.log 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84006.log 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50741.log.gz 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62479.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.51291.log.gz 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48283.log 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62479.log.gz 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84006.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61167.log 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.84006.log.gz 2024-09-17T05:27:08.639 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48283.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76544.log 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.48283.log.gz 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56338.log 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76544.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61167.log.gz 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36846.log 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.76544.log.gz 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72184.log 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.56338.log.gz 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36846.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78403.log 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.36846.log.gz 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72184.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73598.log 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.72184.log.gz 2024-09-17T05:27:08.640 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78403.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62690.log 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.78403.log.gz 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73598.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59172.log 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.73598.log.gz 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51165.log 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62690.log.gz 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59172.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60372.log 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.59172.log.gz 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77620.log 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51165.log.gz 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82389.log 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.60372.log.gz 2024-09-17T05:27:08.641 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54882.log 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77620.log.gz 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79306.log 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.82389.log.gz 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54882.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47097.log 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54882.log.gz 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79306.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.2.45693.log 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.79306.log.gz 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47097.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62293.log 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47097.log.gz 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.2.45693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69329.log 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55376.log 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62293.log.gz 2024-09-17T05:27:08.642 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.69329.log: 88.8% -- replaced with /var/log/ceph/ceph-client.2.45693.log.gz 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47013.log 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.55376.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68176.log 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59861.log 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.47013.log.gz 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68176.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80112.log 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53708.log 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59861.log: -- replaced with /var/log/ceph/ceph-client.admin.68176.log.gz 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80112.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53918.log 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.59861.log.gz 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80112.log.gz 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.53708.log: -- /var/log/ceph/ceph-client.admin.72980.log 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53918.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53708.log.gz 2024-09-17T05:27:08.643 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55533.log 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53918.log.gz 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72980.log: gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72980.log.gz 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.76824.log 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55533.log: /var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60495.log 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.55533.log.gz 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.76824.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.75240.log 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60495.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.76824.log.gz 2024-09-17T05:27:08.644 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61668.log 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.60495.log.gz 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75240.log: gzip 87.6% -5 --verbose -- /var/log/ceph/ceph-client.admin.79675.log 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.75240.log.gz 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61668.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56005.log 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9%gzip -- replaced with /var/log/ceph/ceph-client.admin.61668.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.56819.log 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79675.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.79675.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50092.log 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56005.log: /var/log/ceph/ceph-client.admin.56819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70092.log 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.56005.log.gz 2024-09-17T05:27:08.645 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%/var/log/ceph/ceph-client.admin.50092.log: -- replaced with /var/log/ceph/ceph-client.admin.56819.log.gz 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82443.log 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50092.log.gz 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.70092.log: -- /var/log/ceph/ceph-client.admin.57162.log 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82443.log: 92.5% -- replaced with /var/log/ceph/ceph-client.0.55376.log.gz 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.70092.log.gz 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75809.log 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.82443.log.gz 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49756.log 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57162.log: /var/log/ceph/ceph-client.admin.75809.log: gzip -5 --verbose -- 87.6% -- replaced with /var/log/ceph/ceph-client.admin.57162.log.gz 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.67744.log 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.75809.log.gz 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49756.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75075.log 2024-09-17T05:27:08.646 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.49756.log.gz 2024-09-17T05:27:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67744.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44180.log 2024-09-17T05:27:08.648 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1%/var/log/ceph/ceph-client.admin.75075.log: -- replaced with /var/log/ceph/ceph-client.admin.67744.log.gz 2024-09-17T05:27:08.648 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70008.log 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75075.log.gz 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44180.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61584.log 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70008.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44180.log.gz 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64589.log 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70008.log.gz 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61584.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36841.log 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61584.log.gz/var/log/ceph/ceph-client.admin.64589.log: 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75641.log 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9%/var/log/ceph/ceph-client.admin.36841.log: -- replaced with /var/log/ceph/ceph-client.admin.64589.log.gz 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59903.log 2024-09-17T05:27:08.649 INFO:teuthology.orchestra.run.smithi081.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.36841.log.gz 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61626.log 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75641.log: /var/log/ceph/ceph-client.admin.59903.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75641.log.gz 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.52269.log 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.59903.log.gz 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43212.log 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.61626.log.gz 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52269.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77326.log 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.52269.log.gz 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68603.log 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43212.log.gz 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77326.log: -5 --verbose -- 92.6% -- replaced with /var/log/ceph/ceph-client.0.69329.log.gz 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.62816.log 2024-09-17T05:27:08.650 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68603.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77326.log.gz 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68645.log 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68603.log.gz 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50647.log 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62816.log.gz 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68645.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44472.log 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.68645.log.gz 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50647.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61427.log 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.50647.log.gz 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.44472.log: -- /var/log/ceph/ceph-client.admin.57867.log 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.61427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54672.log 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44472.log.gz 2024-09-17T05:27:08.651 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57867.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74648.log 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57867.log.gz 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36835.log 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54672.log: 89.7% -- replaced with /var/log/ceph/ceph-client.0.61427.log.gz 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74648.log: gzip 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54672.log.gz -5 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.51039.log 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74648.log.gz 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57527.log 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36835.log: /var/log/ceph/ceph-client.admin.51039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59477.log 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.36835.log.gz 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51039.log.gz 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57527.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47821.log 2024-09-17T05:27:08.652 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 87.5% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.57527.log.gz /var/log/ceph/ceph-client.admin.67050.log 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59477.log: /var/log/ceph/ceph-client.admin.47821.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.59477.log.gz 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78107.log 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.47821.log.gz 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49546.log/var/log/ceph/ceph-client.admin.67050.log: 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.78107.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49488.log 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.67050.log.gz 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49546.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78107.log.gz 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58728.log 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49546.log.gz 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60113.log 2024-09-17T05:27:08.653 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49488.log.gz 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46803.log 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58728.log: /var/log/ceph/ceph-client.admin.60113.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.30272.log 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.58728.log.gz 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46803.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60113.log.gz 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81082.log 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.46803.log.gz 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.tmp-client.admin.30272.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.30272.log.gz 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75198.log 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82762.log 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81082.log: gzip/var/log/ceph/ceph-client.admin.75198.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.70340.log 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.81082.log.gz 2024-09-17T05:27:08.654 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82762.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75198.log.gz 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67996.log 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.82762.log.gz 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70340.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71070.log 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.70340.log.gz 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43856.log 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67996.log: /var/log/ceph/ceph-client.admin.71070.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81454.log 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67996.log.gz 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71070.log.gz 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51207.log 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42730.log 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.43856.log.gz 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81454.log: /var/log/ceph/ceph-client.admin.51207.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.81454.log.gz 2024-09-17T05:27:08.655 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73433.log 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42730.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59818.log 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51207.log.gz 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2%/var/log/ceph/ceph-client.admin.73433.log: -- replaced with /var/log/ceph/ceph-client.admin.42730.log.gz 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45815.log 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.73433.log.gz 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53092.log 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59818.log: /var/log/ceph/ceph-client.admin.45815.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83796.log 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59818.log.gz 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53092.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.45815.log.gz 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47863.log 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.53092.log.gz 2024-09-17T05:27:08.656 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83796.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70050.log 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83796.log.gz 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48735.log 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47863.log: /var/log/ceph/ceph-client.admin.70050.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54714.log 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47863.log.gz 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.48735.log: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.70050.log.gz 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80742.log 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54714.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59663.log 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.54714.log.gz 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80742.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66760.log 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80742.log.gz 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59663.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57082.log 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59663.log.gz 2024-09-17T05:27:08.657 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.66760.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71196.log 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.66760.log.gz 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.57082.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.67576.log 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71196.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57082.log.gz 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.71196.log.gz 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.46845.log 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67576.log: 87.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69912.log 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.67576.log.gz 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63581.log 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46845.log.gz 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69912.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72895.log 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.69912.log.gz 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63581.log: gzip -5 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63581.log.gz 2024-09-17T05:27:08.658 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72895.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44181.log 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.72895.log.gz 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71322.log 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44181.log: 92.4% -- replaced with /var/log/ceph/ceph-client.0.48735.log.gz 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46929.log 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.44181.log.gz 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60849.log 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71322.log: /var/log/ceph/ceph-client.admin.46929.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.71322.log.gz 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.44598.log 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.46929.log.gz 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68038.log 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60849.log.gz/var/log/ceph/ceph-client.admin.44598.log: 2024-09-17T05:27:08.659 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63497.log 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44598.log.gz 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68038.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42812.log 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68038.log.gz 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72370.log 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.63497.log.gz 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59716.log 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42812.log.gz 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80616.log 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.72370.log.gz 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59716.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71662.log 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80616.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59716.log.gz 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.51123.log 2024-09-17T05:27:08.660 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80616.log.gz 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71662.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73979.log 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.71662.log.gz 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51123.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62774.log 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.51123.log.gz 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73979.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46887.log 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.73979.log.gz 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71886.log 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.62774.log.gz 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74251.log 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46887.log: /var/log/ceph/ceph-client.admin.71886.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46887.log.gzgzip 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.82946.log 2024-09-17T05:27:08.661 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74251.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.71886.log.gz 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77704.log 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.74251.log.gz 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82946.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54389.log 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%/var/log/ceph/ceph-client.admin.77704.log: -- replaced with /var/log/ceph/ceph-client.admin.82946.log.gz 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70883.log 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77704.log.gz 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54389.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65174.log 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.54389.log.gz 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.70883.log: --verbose -- /var/log/ceph/ceph-client.admin.54840.log 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65174.log: 86.3% -- replaced with /var/log/ceph/ceph-client.admin.70883.log.gz 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 87.1% --verbose -- /var/log/ceph/ceph-client.admin.50603.log 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.65174.log.gz 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44191.log 2024-09-17T05:27:08.662 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.54840.log.gz 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50603.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50699.log 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44191.log: gzip -5 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50603.log.gz 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83030.log 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44191.log.gz 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50699.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64674.log 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50699.log.gz 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80532.log 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83030.log: /var/log/ceph/ceph-client.admin.64674.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.83030.log.gz 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60761.log 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64674.log.gz 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80532.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.49410.log 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.80532.log.gz 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60761.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-17T05:27:08.663 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9%/var/log/ceph/ceph-client.admin.49410.log: -- replaced with /var/log/ceph/ceph-client.admin.60761.log.gz 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53624.log 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.49410.log.gz 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67116.log 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53624.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57657.log 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.admin.67116.log: -- replaced with /var/log/ceph/ceph-client.admin.53624.log.gz 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82147.log 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.67116.log.gz 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57657.log: /var/log/ceph/ceph-client.admin.61059.log 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82147.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.57657.log.gz 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79821.log 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82147.log.gz 2024-09-17T05:27:08.664 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61059.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.61059.log.gz 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59987.log 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75473.log 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72100.log/var/log/ceph/ceph-client.admin.59987.log: 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.79821.log.gz 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.59987.log.gz 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75473.log: gzip -5 --verbose 87.4% -- replaced with /var/log/ceph/ceph-client.admin.75473.log.gz 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.57611.log 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68961.log 87.1% -- replaced with /var/log/ceph/ceph-client.admin.72100.log.gz 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57611.log: gzip -5 --verbose -- 87.4% /var/log/ceph/ceph-client.admin.36320.log 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57611.log.gz 2024-09-17T05:27:08.665 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68961.log: gzip -5 --verbose -- 87.3% -- replaced with /var/log/ceph/ceph-client.admin.68961.log.gz 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.73516.log 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36320.log: 76.8% -- replaced with /var/log/ceph/ceph-client.admin.36320.log.gz 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71620.log 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73516.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61752.log 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr: 84.3% -- replaced with /var/log/ceph/ceph-client.admin.73516.log.gz 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71620.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46051.log 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71620.log.gz 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84360.log 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr: 85.0% -- replaced with /var/log/ceph/ceph-client.admin.61752.log.gz 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48241.log 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46051.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51816.log 87.4% 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.46051.log.gz 2024-09-17T05:27:08.666 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84360.log: gzip/var/log/ceph/ceph-client.admin.48241.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.77494.log 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51816.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84360.log.gz 87.1% -- replaced with /var/log/ceph/ceph-client.admin.48241.log.gz 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.51816.log.gz 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52312.log 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77494.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50558.log 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.77494.log.gz 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71578.log 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52312.log.gz 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50558.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73269.log 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.50558.log.gz 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73392.log 2024-09-17T05:27:08.667 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71578.log: /var/log/ceph/ceph-client.admin.73269.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.71578.log.gz 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr: 84.7% -- replaced with /var/log/ceph/ceph-client.admin.73269.log.gz 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75935.log 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54756.log 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73392.log: /var/log/ceph/ceph-client.admin.75935.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73146.log 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr: 83.5% -- replaced with /var/log/ceph/ceph-client.admin.73392.log.gz 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54756.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.75935.log.gz 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:gzip 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54756.log.gz 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.71707.log 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77011.log 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73146.log: /var/log/ceph/ceph-client.admin.71707.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54482.log 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.73146.log.gz 2024-09-17T05:27:08.668 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71707.log.gz 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77011.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47181.log 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54482.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78697.log 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.77011.log.gz 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47181.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54482.log.gz 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47181.log.gz 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69966.log 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78697.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77848.log 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.78697.log.gz 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69966.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 87.0% -- replaced with /var/log/ceph/ceph-client.admin.69966.log.gz 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77848.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51774.log 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.77848.log.gz 2024-09-17T05:27:08.669 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42634.log 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51774.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79390.log 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.51774.log.gz 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42634.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83964.log 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79390.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42634.log.gz 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.79390.log.gz 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75371.log 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83964.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67618.log 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.83964.log.gz 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75371.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45967.log 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67618.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75371.log.gz 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.67618.log.gz 2024-09-17T05:27:08.670 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83838.log 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.45967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64631.log 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45967.log.gz 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61101.log 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64631.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.83838.log.gz 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.64631.log.gz 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74564.log 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61101.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81240.log 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74564.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.61101.log.gz 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74564.log.gz 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62858.log 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78272.log 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.81240.log.gz 2024-09-17T05:27:08.671 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62858.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58035.log 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.62858.log.gz 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78272.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78272.log.gz 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84174.log 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81189.log 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.58035.log.gz 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84174.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43590.log 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81189.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.84174.log.gz 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81189.log.gz 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46971.log 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43590.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41954.log 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43590.log.gz 2024-09-17T05:27:08.672 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46971.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83175.log 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.41954.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.46971.log.gz 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41954.log.gz 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61918.log 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83175.log: gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.83175.log.gz 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61918.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67660.log 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.61918.log.gz 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59068.log 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67660.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75851.log 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.67660.log.gz 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59068.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60071.log 2024-09-17T05:27:08.673 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75851.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.59068.log.gz 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.75851.log.gz 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80196.log 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60071.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43855.log 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60071.log.gz 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80196.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43338.log 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43855.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80196.log.gz 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43855.log.gz 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49924.log 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43338.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49798.log 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43338.log.gz 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49924.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70280.log 2024-09-17T05:27:08.674 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49798.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49924.log.gz 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.49798.log.gz 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81127.log 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70280.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53521.log 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.70280.log.gz 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70382.log 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53521.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81127.log.gz 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53521.log.gz 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54570.log 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70382.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80012.log 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.70382.log.gz 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72738.log 2024-09-17T05:27:08.675 INFO:teuthology.orchestra.run.smithi081.stderr: 92.1% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80012.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54570.log.gz 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.80012.log.gz 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47607.log 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.72738.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83710.log 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47607.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49315.log 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47607.log.gz 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.0.72738.log.gz 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83710.log: gzip -5 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83710.log.gz 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.83626.log 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49315.log: gzip -5 --verbose -- 86.6% -- replaced with /var/log/ceph/ceph-client.admin.49315.log.gz 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.74377.log 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83626.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62732.log 2024-09-17T05:27:08.676 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83626.log.gz 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74377.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56047.log 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.74377.log.gz 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75329.log 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.62732.log.gz 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56047.log: gzip 87.2% -5 --verbose -- /var/log/ceph/ceph-client.admin.76951.log 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.56047.log.gz 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75329.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47272.log 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.75329.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54258.log 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76951.log: 87.2%/var/log/ceph/ceph-client.admin.47272.log: -- replaced with /var/log/ceph/ceph-client.admin.76951.log.gz 2024-09-17T05:27:08.677 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47272.log.gz 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78230.log 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72412.log 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54258.log.gz/var/log/ceph/ceph-client.admin.78230.log: 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 87.2% /var/log/ceph/ceph-client.admin.58644.log 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.78230.log.gz 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72412.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37301.log 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.58644.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52702.log 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.72412.log.gz 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.58644.log.gz 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.37301.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50393.log 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52702.log: 86.6%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77410.log 2024-09-17T05:27:08.678 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37301.log.gz 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52702.log.gz 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80998.log 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50393.log: /var/log/ceph/ceph-client.admin.77410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52560.log 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6%/var/log/ceph/ceph-client.admin.80998.log: -- replaced with /var/log/ceph/ceph-client.admin.50393.log.gz 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.77410.log.gz 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80998.log.gz 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54135.log 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.52560.log: --verbose -- /var/log/ceph/ceph-client.admin.57432.log 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.admin.54135.log: -- replaced with /var/log/ceph/ceph-client.admin.52560.log.gz 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81040.log 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.54135.log.gz 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57569.log 2024-09-17T05:27:08.679 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57432.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81730.log 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81040.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.57432.log.gz 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57569.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81040.log.gz 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47905.log 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.57569.log.gz 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81730.log: gzip -5 --verbose -- 87.7% -- replaced with /var/log/ceph/ceph-client.admin.81730.log.gz 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.68835.log 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50008.log 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47905.log.gz 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68835.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48367.log 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68835.log.gz 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50871.log 2024-09-17T05:27:08.680 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50008.log.gz 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.48367.log: /var/log/ceph/ceph-client.admin.42958.log 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50871.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.48367.log.gz 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75285.log 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50871.log.gz 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42958.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73310.log 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36494.log 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42958.log.gz 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73310.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.75285.log.gz 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44556.log 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr: 85.2% -- replaced with /var/log/ceph/ceph-client.admin.73310.log.gz 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55050.log 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36494.log: /var/log/ceph/ceph-client.admin.44556.log: 77.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50829.log 2024-09-17T05:27:08.681 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36494.log.gz 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44556.log.gz 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68691.log 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55050.log: /var/log/ceph/ceph-client.admin.50829.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47354.log 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68691.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.50829.log.gz 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr: 90.9% 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68691.log.gz 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55050.log.gz 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81496.log 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47354.log: gzip -5 --verbose 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47354.log.gz 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.82684.log 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81496.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78571.log 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.81496.log.gz 2024-09-17T05:27:08.682 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46372.log 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82684.log.gz 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78571.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67408.log 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.78571.log.gz 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46372.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47055.log 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46372.log.gz 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75725.log 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67408.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49840.log 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47055.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67408.log.gz 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75725.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.47055.log.gz 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71280.log 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.75725.log.gz 2024-09-17T05:27:08.683 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73557.log 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.49840.log.gz 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71280.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.71280.log.gz 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.36737.log 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57303.log 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.73557.log.gz 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36737.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50516.log 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.36737.log.gz 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.57303.log: /var/log/ceph/ceph-client.admin.60719.log 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50516.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.57303.log.gz 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56160.log 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.50516.log.gz 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.84300.log 2024-09-17T05:27:08.684 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60719.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73187.log 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%/var/log/ceph/ceph-client.admin.56160.log: -- replaced with /var/log/ceph/ceph-client.admin.60719.log.gz 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.84300.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56160.log.gz 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44430.log 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.84300.log.gz 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80448.log 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73187.log: /var/log/ceph/ceph-client.admin.44430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70495.log 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr: 84.4% -- replaced with /var/log/ceph/ceph-client.admin.73187.log.gz 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80448.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.44430.log.gz 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68793.log 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.80448.log.gz 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54300.log 2024-09-17T05:27:08.685 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43848.log 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70495.log.gz 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68793.log: /var/log/ceph/ceph-client.admin.54300.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49966.log 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68793.log.gz 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.54300.log.gz/var/log/ceph/ceph-client.admin.43848.log: 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78889.log 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43848.log.gz 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.49966.log: /var/log/ceph/ceph-client.admin.51958.log 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78889.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49966.log.gz 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44388.log 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.78889.log.gz 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-client.admin.51958.log: --verbose -- /var/log/ceph/ceph-client.admin.60933.log 2024-09-17T05:27:08.686 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44388.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51958.log.gz 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74151.log 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44388.log.gz 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60933.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70841.log 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.60933.log.gz 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74151.log: gzip -5 87.7% -- replaced with /var/log/ceph/ceph-client.admin.74151.log.gz 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.68379.log 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70841.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77184.log 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.70841.log.gz 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68379.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57909.log 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.68379.log.gz 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51617.log 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77184.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.77184.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47947.log 2024-09-17T05:27:08.687 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57909.log: /var/log/ceph/ceph-client.0.51617.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77746.log 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.57909.log.gz 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47947.log: gzip 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47947.log.gz 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.72286.log 88.5% -- replaced with /var/log/ceph/ceph-client.0.51617.log.gz 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.77746.log: /var/log/ceph/ceph-client.admin.46314.log 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72286.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77746.log.gz 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78781.log 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.72286.log.gz 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70986.log 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46314.log: /var/log/ceph/ceph-client.admin.78781.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43852.log 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.46314.log.gz 2024-09-17T05:27:08.688 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70986.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.78781.log.gz 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53030.log 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.70986.log.gz 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43852.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78823.log 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43852.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43548.log 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53030.log: /var/log/ceph/ceph-client.admin.78823.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74774.log 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5%/var/log/ceph/ceph-client.admin.43548.log: -- replaced with /var/log/ceph/ceph-client.admin.53030.log.gz 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43548.log.gz 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.78823.log.gz 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62377.log 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr:gzip/var/log/ceph/ceph-client.admin.74774.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.52155.log 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62377.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.74774.log.gz 2024-09-17T05:27:08.689 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78317.log 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.62377.log.gz 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52155.log: gzip 87.5% -- replaced with /var/log/ceph/ceph-client.admin.52155.log.gz 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69069.log 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78317.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52034.log 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.78317.log.gz 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.69069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78529.log 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.69069.log.gz 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.52034.log: /var/log/ceph/ceph-client.admin.64759.log 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78529.log: gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.52034.log.gz -5 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.47779.log 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.78529.log.gz 2024-09-17T05:27:08.690 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.77806.log 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64759.log: /var/log/ceph/ceph-client.admin.47779.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.64759.log.gz 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47779.log.gz 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60197.log 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77806.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60582.log 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.77806.log.gz/var/log/ceph/ceph-client.admin.60197.log: 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 87.5% /var/log/ceph/ceph-client.admin.59621.log 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.60197.log.gz 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60582.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74606.log 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.60582.log.gz 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.59621.log: /var/log/ceph/ceph-client.admin.80917.log 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74606.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79934.log 2024-09-17T05:27:08.691 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.59621.log.gz 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74606.log.gz 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50474.log 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.80917.log: /var/log/ceph/ceph-client.admin.79934.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.80917.log.gz 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.79934.log.gz 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68919.log 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50474.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63455.log 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.50474.log.gz/var/log/ceph/ceph-client.admin.68919.log: 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- 87.3% /var/log/ceph/ceph-client.admin.75431.log 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68919.log.gz 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80490.log 2024-09-17T05:27:08.692 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.63455.log.gz 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68510.log 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.71932.log 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.75431.log.gz/var/log/ceph/ceph-client.admin.80490.log: 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68510.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.80490.log.gz 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48934.log 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68510.log.gz 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.71932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57388.log 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.71932.log.gz/var/log/ceph/ceph-client.admin.48934.log: 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58185.log 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.48934.log.gz 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42854.log 2024-09-17T05:27:08.693 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.57388.log: /var/log/ceph/ceph-client.admin.58185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55617.log 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.42854.log: 87.3% 87.3% -- replaced with /var/log/ceph/ceph-client.admin.58185.log.gz 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.57388.log.gz 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42854.log.gz 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61838.log 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55617.log: gzip -5 --verbose -- 87.2% -- replaced with /var/log/ceph/ceph-client.admin.55617.log.gz 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.73733.log 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.61838.log: gzip -5 --verbose 85.4% -- replaced with /var/log/ceph/ceph-client.admin.61838.log.gz 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.56693.log 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73733.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51357.log 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr: 84.1% -- replaced with /var/log/ceph/ceph-client.admin.73733.log.gz 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56693.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62564.log 2024-09-17T05:27:08.694 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.56693.log.gz 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51357.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43849.log 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51357.log.gz 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62564.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52826.log 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.62564.log.gz 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48073.log 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43849.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73774.log 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52826.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.43849.log.gz 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3%/var/log/ceph/ceph-client.admin.48073.log: -- replaced with /var/log/ceph/ceph-client.admin.52826.log.gz 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43464.log 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.48073.log.gz 2024-09-17T05:27:08.695 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60155.log 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73774.log: /var/log/ceph/ceph-client.admin.43464.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70673.log 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr: 84.1%/var/log/ceph/ceph-client.admin.60155.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.43464.log.gz 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr: -- replaced with /var/log/ceph/ceph-client.admin.73774.log.gz 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.60155.log.gz 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47139.log 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70673.log: gzip -5 87.2% -- replaced with /var/log/ceph/ceph-client.admin.70673.log.gz 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr: --verbose -- /var/log/ceph/ceph-client.admin.77368.log 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.47139.log: gzip -5 --verbose -- 87.4% -- replaced with /var/log/ceph/ceph-client.admin.47139.log.gz 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.50955.log 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.77368.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48409.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.77368.log.gz 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.696 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50955.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73228.log 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.50955.log.gz 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.48409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67350.log 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59110.log 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73228.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.48409.log.gz 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67350.log: 84.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.73474.log 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.73228.log.gz -- replaced with /var/log/ceph/ceph-client.admin.67350.log.gz 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59110.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.59110.log.gz 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.74732.log 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.73474.log: gzip -5 --verbose 84.6% -- replaced with /var/log/ceph/ceph-client.admin.73474.log.gz 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr: -- /var/log/ceph/ceph-client.admin.50218.log 2024-09-17T05:27:08.697 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.74732.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56735.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.74732.log.gz 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.50218.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65107.log 87.5% -- replaced with /var/log/ceph/ceph-client.admin.50218.log.gz 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.56735.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43086.log 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56735.log.gz 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.65107.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67492.log 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.65107.log.gz 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose/var/log/ceph/ceph-client.admin.43086.log: -- /var/log/ceph/ceph-client.admin.76502.log 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67492.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43086.log.gz 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78188.log 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.67492.log.gz 2024-09-17T05:27:08.698 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83458.log 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.76502.log: /var/log/ceph/ceph-client.admin.78188.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.74521.log 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.76502.log.gz 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.78188.log.gz 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49176.log 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.83458.log.gz/var/log/ceph/ceph-client.admin.74521.log: 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49588.log 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.74521.log.gz 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.80280.log 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.49176.log: /var/log/ceph/ceph-client.admin.49588.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43128.log 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0%/var/log/ceph/ceph-client.admin.80280.log: -- replaced with /var/log/ceph/ceph-client.admin.49176.log.gz 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.49588.log.gz 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.80280.log.gz 2024-09-17T05:27:08.699 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53960.log 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.43128.log: gzip -5 --verbose -- 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43128.log.gz 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr: /var/log/ceph/ceph-client.admin.62419.log 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67450.log 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.53960.log.gz 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.62419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54345.log 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.62419.log.gz 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.81328.log 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.67450.log: /var/log/ceph/ceph-client.admin.54345.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53750.log 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.81328.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.67450.log.gz 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.54345.log.gz 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.81328.log.gz 2024-09-17T05:27:08.700 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68421.log 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log/var/log/ceph/ceph-client.admin.53750.log: 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68421.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.53750.log.gz 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75515.log 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.68421.log.gz 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5/var/log/ceph/ceph-osd.3.log: --verbose -- /var/log/ceph/ceph-client.admin.59288.log 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75515.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44190.log 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.75515.log.gz 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.59288.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68561.log 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44190.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.59288.log.gz 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.44190.log.gz 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54216.log 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-09-17T05:27:08.701 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.68561.log: /var/log/ceph/ceph-client.admin.54216.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.68561.log.gz 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54216.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53876.log 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51858.log 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.53876.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.53876.log.gz 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79348.log 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.51858.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.51858.log.gz 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36830.log 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79348.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.79348.log.gz 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.78445.log 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.36830.log: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.36830.log.gz 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46135.log 2024-09-17T05:27:08.702 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.78445.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.78445.log.gz 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54924.log 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46135.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.46135.log.gz 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44184.log 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54924.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.54924.log.gz 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63413.log 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.44184.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.44184.log.gz 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.72226.log 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.63413.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.63413.log.gz 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54440.log 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.72226.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.72226.log.gz 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82189.log 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.54440.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.54440.log.gz 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46450.log 2024-09-17T05:27:08.703 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82189.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.82189.log.gz 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60537.log 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46450.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46450.log.gz 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.70238.log 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.60537.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.60537.log.gz 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52205.log 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.70238.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.70238.log.gz 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45213.log 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.52205.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52205.log.gz 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79149.log 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.45213.log: 89.1% -- replaced with /var/log/ceph/ceph-client.0.45213.log.gz 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55818.log 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.0.79149.log: 92.6% -- replaced with /var/log/ceph/ceph-client.0.79149.log.gz 2024-09-17T05:27:08.704 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.83301.log 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.55818.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.55818.log.gz 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46566.log 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.83301.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.83301.log.gz 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.79432.log 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.46566.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.46566.log.gz 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64232.log 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.79432.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.79432.log.gz 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.75599.log 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.64232.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.64232.log.gz 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.82273.log 2024-09-17T05:27:08.705 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.75599.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.75599.log.gz 2024-09-17T05:27:08.706 INFO:teuthology.orchestra.run.smithi081.stderr:/var/log/ceph/ceph-client.admin.82273.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.82273.log.gz 2024-09-17T05:27:08.706 INFO:teuthology.orchestra.run.smithi160.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-09-17T05:27:08.706 INFO:teuthology.orchestra.run.smithi160.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-09-17T05:27:08.863 INFO:teuthology.orchestra.run.smithi081.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-09-17T05:27:08.896 INFO:teuthology.orchestra.run.smithi160.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-09-17T05:27:08.899 INFO:teuthology.orchestra.run.smithi160.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-09-17T05:27:08.970 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-17T05:27:08.976 INFO:teuthology.orchestra.run.smithi160.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-09-17T05:27:09.035 INFO:teuthology.orchestra.run.smithi081.stderr: 93.1% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-09-17T05:27:09.087 INFO:teuthology.orchestra.run.smithi160.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-09-17T05:27:09.122 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-17T05:27:09.124 INFO:teuthology.orchestra.run.smithi160.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-09-17T05:27:09.126 INFO:teuthology.orchestra.run.smithi160.stderr: 2024-09-17T05:27:09.126 INFO:teuthology.orchestra.run.smithi160.stderr:real 0m0.878s 2024-09-17T05:27:09.126 INFO:teuthology.orchestra.run.smithi160.stderr:user 0m4.591s 2024-09-17T05:27:09.126 INFO:teuthology.orchestra.run.smithi160.stderr:sys 0m0.167s 2024-09-17T05:27:09.155 INFO:teuthology.orchestra.run.smithi081.stderr: 90.7% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-17T05:27:09.185 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-17T05:27:09.296 INFO:teuthology.orchestra.run.smithi081.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-17T05:27:09.298 INFO:teuthology.orchestra.run.smithi081.stderr: 2024-09-17T05:27:09.298 INFO:teuthology.orchestra.run.smithi081.stderr:real 0m1.073s 2024-09-17T05:27:09.298 INFO:teuthology.orchestra.run.smithi081.stderr:user 0m5.266s 2024-09-17T05:27:09.298 INFO:teuthology.orchestra.run.smithi081.stderr:sys 0m0.593s 2024-09-17T05:27:09.298 INFO:tasks.ceph:Archiving logs... 2024-09-17T05:27:09.298 DEBUG:teuthology.misc:Transferring archived files from smithi081:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/remote/smithi081/log 2024-09-17T05:27:09.299 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:27:10.528 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/log/ceph to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/remote/smithi160/log 2024-09-17T05:27:10.529 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-17T05:27:11.081 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-17T05:27:11.090 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-17T05:27:11.090 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:27:11.093 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-17T05:27:11.182 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-17T05:27:11.191 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-17T05:27:11.191 DEBUG:teuthology.orchestra.run.smithi081:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:27:11.194 DEBUG:teuthology.orchestra.run.smithi160:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-17T05:27:11.208 INFO:teuthology.orchestra.run.smithi081.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:27:11.210 INFO:teuthology.orchestra.run.smithi160.stderr:bash: line 1: ntpq: command not found 2024-09-17T05:27:11.213 INFO:teuthology.orchestra.run.smithi081.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:27:11.213 INFO:teuthology.orchestra.run.smithi081.stdout:=============================================================================== 2024-09-17T05:27:11.213 INFO:teuthology.orchestra.run.smithi081.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +1071us[+1090us] +/- 42ms 2024-09-17T05:27:11.213 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 23 +127us[ +145us] +/- 65ms 2024-09-17T05:27:11.213 INFO:teuthology.orchestra.run.smithi081.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 -2137us[-2120us] +/- 69ms 2024-09-17T05:27:11.214 INFO:teuthology.orchestra.run.smithi081.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:27:11.215 INFO:teuthology.orchestra.run.smithi160.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-17T05:27:11.215 INFO:teuthology.orchestra.run.smithi160.stdout:=============================================================================== 2024-09-17T05:27:11.215 INFO:teuthology.orchestra.run.smithi160.stdout:^* hv01.front.sepia.ceph.com 3 6 377 21 +1126us[+1152us] +/- 42ms 2024-09-17T05:27:11.215 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 22 +176us[ +202us] +/- 65ms 2024-09-17T05:27:11.215 INFO:teuthology.orchestra.run.smithi160.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 21 -2095us[-2095us] +/- 69ms 2024-09-17T05:27:11.215 INFO:teuthology.orchestra.run.smithi160.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-17T05:27:11.216 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-17T05:27:11.225 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-17T05:27:11.225 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-17T05:27:11.234 DEBUG:teuthology.orchestra.run.smithi081:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:27:11.347 DEBUG:teuthology.orchestra.run.smithi160:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-17T05:27:11.423 DEBUG:teuthology.orchestra.run.smithi081:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:27:11.453 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:11.454 DEBUG:teuthology.orchestra.run.smithi160:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-17T05:27:11.483 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:11.484 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-17T05:27:11.493 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-17T05:27:11.512 INFO:teuthology.task.internal:Duration was 901.442346 seconds 2024-09-17T05:27:11.513 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-17T05:27:11.521 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-17T05:27:11.522 DEBUG:teuthology.orchestra.run.smithi081:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:27:11.524 DEBUG:teuthology.orchestra.run.smithi160:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-17T05:27:11.561 INFO:teuthology.orchestra.run.smithi081.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:27:11.565 INFO:teuthology.orchestra.run.smithi160.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-17T05:27:11.801 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-17T05:27:11.801 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi081.front.sepia.ceph.com 2024-09-17T05:27:11.801 DEBUG:teuthology.orchestra.run.smithi081:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:27:11.861 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi160.front.sepia.ceph.com 2024-09-17T05:27:11.862 DEBUG:teuthology.orchestra.run.smithi160:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-17T05:27:11.890 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-17T05:27:11.890 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:27:11.904 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-17T05:27:11.957 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-17T05:27:11.957 DEBUG:teuthology.orchestra.run.smithi081:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:27:11.971 DEBUG:teuthology.orchestra.run.smithi160:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-17T05:27:12.109 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-17T05:27:12.119 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-17T05:27:12.119 DEBUG:teuthology.orchestra.run.smithi081:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:27:12.143 DEBUG:teuthology.orchestra.run.smithi160:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-17T05:27:12.169 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-17T05:27:12.178 DEBUG:teuthology.orchestra.run.smithi081:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:27:12.186 DEBUG:teuthology.orchestra.run.smithi160:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:27:12.207 INFO:teuthology.orchestra.run.smithi081.stdout:kernel.core_pattern = core 2024-09-17T05:27:12.233 INFO:teuthology.orchestra.run.smithi160.stdout:kernel.core_pattern = core 2024-09-17T05:27:12.247 DEBUG:teuthology.orchestra.run.smithi081:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:27:12.274 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:12.274 DEBUG:teuthology.orchestra.run.smithi160:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-17T05:27:12.301 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-17T05:27:12.302 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-17T05:27:12.311 INFO:teuthology.task.internal:Transferring archived files... 2024-09-17T05:27:12.312 DEBUG:teuthology.misc:Transferring archived files from smithi081:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/remote/smithi081 2024-09-17T05:27:12.312 DEBUG:teuthology.orchestra.run.smithi081:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:27:12.350 DEBUG:teuthology.misc:Transferring archived files from smithi160:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/avan-2024-09-17_05:02:16-fs:volumes-wip-athakkar-testing-2024-09-16-2351-distro-default-smithi/7908686/remote/smithi160 2024-09-17T05:27:12.351 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-17T05:27:12.384 INFO:teuthology.task.internal:Removing archive directory... 2024-09-17T05:27:12.384 DEBUG:teuthology.orchestra.run.smithi081:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:27:12.387 DEBUG:teuthology.orchestra.run.smithi160:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-17T05:27:12.435 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-17T05:27:12.446 INFO:teuthology.task.internal:Not uploading archives. 2024-09-17T05:27:12.446 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-17T05:27:12.455 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-17T05:27:12.455 DEBUG:teuthology.orchestra.run.smithi081:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:27:12.458 DEBUG:teuthology.orchestra.run.smithi160:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-17T05:27:12.470 INFO:teuthology.orchestra.run.smithi081.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:27 /home/ubuntu/cephtest 2024-09-17T05:27:12.490 INFO:teuthology.orchestra.run.smithi160.stdout: 265340 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 17 05:27 /home/ubuntu/cephtest 2024-09-17T05:27:12.492 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-17T05:27:12.503 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-17T05:27:12.524 INFO:teuthology.run:Summary data: description: fs:volumes/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mgr mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-bitmap overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile pg_health} tasks/volumes/{overrides test/misc}} duration: 901.4423463344574 flavor: default owner: scheduled_avan@teuthology success: true 2024-09-17T05:27:12.525 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-17T05:27:12.614 INFO:teuthology.run:pass